HDDM 0.5 documentation

Creating a simple model

A note of caution

Although HDDM tries to make hierarchical Bayesian estimation as straightforward and accessible as possible, the statistical methods used to estimate the posterior (i.e. Markov-Chain Monte Carlo) rely on certain assumptions (e.g. chain-convergence). Although we have tested the ability of HDDM to recover meaningful parameters for simple DDM applications, it is critical for the user to assess whether the necessary conditions for interpreting your results are met. There are multiple excellent introductory books on hierarchical Bayesian estimation. We recommend the following for cognitive scientists:

A Practical Course in Bayesian Graphical Modeling by E.J. Wagenmakers and M. Lee

Doing Bayesian Data Analysis: A Tutorial with R and BUGS by J. Kruschke

See also [25] for some background on hierarchical Bayesian estimation of the DDM.

Get started

Imagine that we collected data from one subject on the moving dots or coherent motion task (e.g., [RoitmanShadlen02]). In this task, participants indicate, via a keypress, in which of two directions dots are moving on a screen. Only some proportion of the dots move in a coherent direction; the remaining dots move in random directions (i.e. incoherent; see the figure). In our working example, consider an experiment in which subjects are presented with two conditions, an easy, high coherence and a hard, low coherence condition. In the following, we will walk through the steps on creating a model in HDDM to estimate the underlying psychological decision making parameters of this task.

_images/moving_dots.jpg

The easiest way to use HDDM if you do not know any Python is to create a configuration file. First, you have to prepare your data to be in a specific format (e.g. comma separated value; csv). The data that we use here were generated from a simulated DDM processes (i.e. they are not real data), so that we know the true underlying generative parameters. The data file can be found in the examples directory and is named simple_difficulty.csv (under Windows, these files can probably be found in C:\Python27\Lib\site-packages\hddm\examples). Lets take a look at what it looks like:

response,rt,difficulty
0.0,1.317,hard
1.0,1.214,hard
1.0,1.746,hard
0.0,4.786,hard
1.0,1.008,hard
1.0,1.766,easy
1.0,0.612,easy
1.0,0.648,easy
0.0,0.806,easy

The first line contains the header and specifies which columns contain which data.

IMPORTANT: There must be one column named ‘rt’ with reaction time in seconds and one named ‘response’. Make sure there are only numerical values in these columns.

The rows following the header contain the response made (e.g. 1=correct, 0=error or 1=left, 0=right), followed by the reaction time in seconds of the trial, followed by the difficulty of the trial.

The following configuration file specifies a model in which drift-rate depends on difficulty:

[depends]
v = difficulty

[mcmc]
samples=20000
burn=3000
thin=10

The (optional) tag [depends] specifies DDM parameters that depend on data. In our case, we want to estimate separate drift-rates (v) for the conditions found in the data column ‘difficulty’. Note, that ‘difficulty’ is just an example, you could call them differently as long as the column name your data file matches your depends parameter from the model specification.

The optional [mcmc] tag specifies parameter of the Markov chain Monte-Carlo estimation such as how many samples to draw from the posterior and how many samples to discard as “burn-in” (as in any MCMC case, often it takes the MCMC chains some time to converge to the true posterior; one would not want to use the initial samples to draw inferences about the true parameters; for details please see MCMC literature referred to earlier). Note that you can also specify these parameters via the command line.

Our model specification is now complete and we can fit the model by calling hddmfit.py:

hddm_fit.py simple_difficulty.conf simple_difficulty.csv

The first argument tells HDDM which model specification to use, the second argument specifies the data file to apply the model to.

Calling hddmfit.py in this way will generate the following output (note that the numbers will be slightly different each time you run this):

Creating model...
Sampling: 100% [0000000000000000000000000000000000] Iterations: 10000

   name       mean   std    2.5q   25q    50q    75q    97.5  mc_err
a         :  2.029  0.034  1.953  2.009  2.028  2.049  2.090  0.002
t         :  0.297  0.007  0.282  0.292  0.297  0.302  0.311  0.001
v('easy',):  0.992  0.051  0.902  0.953  0.987  1.028  1.102  0.003
v('hard',):  0.522  0.049  0.429  0.485  0.514  0.561  0.612  0.002

logp: -1171.276303
DIC: 2329.069932

The parameters of DDM are usually abbreviated and have the following meaning:

  • a: threshold
  • t: non-decision time
  • v: drift-rate
  • z: bias (optional)
  • sv: inter-trial variability in drift-rate (optional)
  • sz: inter-trial variability in bias (optional)
  • st: inter-trial variability in non-decision time (optional)

Because we used simulated data in this example, we know the true parameters that generated the data (i.e. a=2, t=0.3, v_easy=1, v_hard=0.5). As you can see, the mean posterior values are very close to the true parameters – our estimation worked! However, often we are not only interested in the best fitting value but also how confident we are in that estimation and how good other values are fitting. This is one of advantages of the Bayesian approach – it gives us the complete posterior distribution rather than just a single best guess. As such, the next columns are statistics on the shape of the distribution, such as the standard deviation and different quantiles to give you a feel for how certain you can be in the estimates.

Lastly, logp and DIC give you a measure of how well the model fits the data overall. These values are not all that useful if looked at in isolation but they provide a tool to do model comparison. Logp is the summed log-likelihood of the best-fitting values (higher is better). DIC stands for deviance information criterion and is a model fit measure that penalizes model complexity [SpiegelhalterBestCarlinEtAl02], similar to BIC or AIC (see also the WinBUGS DIC page). Generally, the model with the lowest DIC score is to be preferred.

Exercise:Create a new model that ignores the different difficulties (i.e. only estimate a single drift-rate). Compare the resulting DIC score with that of the previous model – does the increased complexity of the first model result in a sufficient increase in model fit to justify using it? Why does the drift-rate estimate of the second model make sense?

Output plots

In addition, HDDM generates some useful plots such as the posterior predictive probability density on top of the normalized RT distribution for each condition:

_images/easy.png
_images/hard.png

Note that error responses have been mirrored along the y-axis (to the left) to display both RT distributions in one plot.

These plots allow you to see how good the estimation fits our data. Here, we also see that our subjects makes more errors and are slower in the difficult condition. This combination is well captured by the reduced drift-rate estimated for this condition.

Moreover, HDDM generates the trace and histogram of the posterior samples. As pointed out in the introduction, we can rarely compute the posterior analytically so we have to estimate it. MCMC is a standard methods which allows you to draw samples from the posterior. On the left upper side of the plot we see the trace of this sampling. The main thing to look out for is if the chain drifts around such that the mean value is not stable or if there are periods where it seems stuck in one place (see the :role:`How-To` for tips on what to do if your chains did not converge). In our case the chain of the parameter “a” (threshold) seems to have converged nicely to the correct value. This is also illustrated in the right side plot which is the histogram of the trace and gives a feel for how to the posterior distribution looks like. In our case, it looks like a normal distribution centered around a value close to 2 – the parameter that was used to generate the data. Finally, plotted in the lower left corner is the auto-correlation.

_images/a.png

Now we are ready for part two of the tutorial.