Hostname: page-component-78c5997874-fbnjt Total loading time: 0 Render date: 2024-11-10T04:40:21.248Z Has data issue: false hasContentIssue false

Examining reaction time variability on the stop-signal task in the ABCD study

Published online by Cambridge University Press:  31 August 2022

Jeffery N. Epstein*
Affiliation:
Department of Pediatrics, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA University of Cincinnati, College of Medicine, Cincinnati, USA
Sarah L. Karalunas
Affiliation:
Department of Psychological Sciences, Purdue University, West Lafayette, USA
Leanne Tamm
Affiliation:
Department of Pediatrics, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA University of Cincinnati, College of Medicine, Cincinnati, USA
Jonathan A. Dudley
Affiliation:
Department of Radiology, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA
James D. Lynch
Affiliation:
Department of Psychology, University of Cincinnati, Cincinnati, USA
Mekibib Altaye
Affiliation:
Department of Pediatrics, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA University of Cincinnati, College of Medicine, Cincinnati, USA
John O. Simon
Affiliation:
Department of Pediatrics, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA
Thomas C. Maloney
Affiliation:
University of Cincinnati, College of Medicine, Cincinnati, USA
Gowtham Atluri
Affiliation:
Department of Electrical Engineering and Computer Science, University of Cincinnati, Cincinnati, USA
*
Corresponding author: Jeff Epstein, email: jeff.epstein@cchmc.org
Rights & Permissions [Opens in a new window]

Abstract

Objective:

Reaction time variability (RTV) has been estimated using Gaussian, ex-Gaussian, and diffusion model (DM) indices. Rarely have studies examined interrelationships among these performance indices in childhood, and the use of reaction time (RT) computational models has been slow to take hold in the developmental psychopathology literature. Here, we extend prior work in adults by examining the interrelationships among different model parameters in the ABCD sample and demonstrate how computational models of RT can clarify mechanisms of time-on-task effects and sex differences in RTs.

Method:

This study utilized trial-level data from the stop signal task from 8916 children (9–10 years old) to examine Gaussian, ex-Gaussian, and DM indicators of RTV. In addition to describing RTV patterns, we examined interrelations among these indicators, temporal patterns, and sex differences.

Results:

There was no one-to-one correspondence between DM and ex-Gaussian parameters. Nonetheless, drift rate was most strongly associated with standard deviation of RT and tau, while nondecisional processes were most strongly associated with RT, mu, and sigma. Performance worsened across time with changes driven primarily by decreasing drift rate. Boys were faster and less variable than girls, likely attributable to girls’ wide boundary separation.

Conclusions:

Intercorrelations among model parameters are similar in children as has been observed in adults. Computational approaches play a crucial role in understanding performance changes over time and can also clarify mechanisms of group differences. For example, standard RT models may incorrectly suggest slowed processing speed in girls that is actually attributable to other factors.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © INS. Published by Cambridge University Press, 2022

Attention is the set of processes that allow us to process certain information to the relative exclusion of other information (Racer & Dishion, Reference Racer and Dishion2012). An attention system that fails to achieve an adaptive balance between voluntary and involuntary attention is likely to cause cascading effects on higher order cognitive and emotional systems that may place an individual at risk for maladaptive behavior (Racer & Dishion, Reference Racer and Dishion2012). For example, impaired attention is associated with impairments in academic achievement (Barriga et al., Reference Barriga, Doran, Newell, Morrison, Barbetti and Robbins2002; Rabiner et al., Reference Rabiner and Coie2000; Tamm et al., Reference Tamm, Epstein, Denton, Vaughn, Peugh and Willcutt2014), school maladjustment (Herman & Ostrander, Reference Herman and Ostrander2007), and social functioning (Andrade et al., Reference Andrade, Brodeur, Waschbusch, Stewart and McGee2009; Tamm et al., Reference Tamm, Epstein and Becker2019).

Reaction time variability (RTV) is a marker for impaired attention. RTV has been suggested to reflect central nervous system integrity and is associated with cognitive functions such as top-down attention control (MacDonald et al., Reference MacDonald, Li and Backman2009). Numerous hypotheses have been suggested to account for RTV (Kofler et al., Reference Kofler, Rapport, Sarver, Raiker, Orban, Friedman and Kolomeyer2013), including that it reflects general inefficiency of information processing speed (Weigard et al., Reference Weigard, Clark and Sripada2021) or specific defects in top-down effortful control or arousal (Aston-Jones & Cohen, Reference Aston-Jones and Cohen2005; Unsworth & Robison, Reference Unsworth and Robison2020), which are both mechanisms that may contribute to attentional lapses during information processing (Killeen, Reference Killeen2019; Unsworth et al., Reference Unsworth, Redick, Lakey and Young2010). Similar mechanisms are implicated in a variety of psychiatric disorders, and RTV may be a correlate of a wide range of maladaptive behavior.

Indeed, RTV is frequently elevated in multiple patient populations including ADHD (Epstein et al., Reference Epstein, Langberg, Rosen, Graham, Narad, Antonini, Brinkman, Froehlich, Simon and Altaye2011; Tamm et al., Reference Tamm, Narad, Antonini, O’Brien, Hawk and Epstein2012), schizophrenia and depression (Schwartz et al., Reference Schwartz, Carr, Munich, Glauber, Lesser and Murray1989), mood disorders (Bora et al., Reference Bora, Vahip and Akdeniz2006), traumatic brain injury (Segalowitz et al., Reference Segalowitz, Dywan and Unsal1997; Stuss et al., Reference Stuss, Pogue, Buckle and Bondar1994; Tinius, Reference Tinius2003; Whyte et al., Reference Whyte, Polansky, Fleming, Coslett and Cavallucci1995), and autism (Verte et al., Reference Verte, Geurts, Roeyers, Oosterlaan, Sergeant, Verte, Geurts, Roeyers, Oosterlaan and Sergeant2005). Higher RTV is also associated with ratings of attentional impulsiveness (Swick et al., Reference Swick, Honzel, Larsen and Ashley2013), behavioral inattention (Antonini et al., Reference Antonini, Narad, Langberg and Epstein2013), impaired social processing (Tamm et al., Reference Tamm, Epstein and Becker2019), impaired reading decoding (Tamm et al., Reference Tamm, Epstein, Denton, Vaughn, Peugh and Willcutt2014), academic underachievement (Sjowall et al., Reference Sjowall, Bohlin, Rydell and Thorell2017), and poorer overall functioning (van Lieshout et al., Reference van Lieshout, Luman, Twisk, Faraone, Heslenfeld, Hartman, Hoekstra, Franke, Buitelaar, Rommelse and Oosterlaan2017).

One issue in clarifying how and why RTV is associated with such a range of behaviors and disorders is that it provides a unitary measure for a variety of partially distinct cognitive processes. There is currently little agreement about how to best measure and interpret differences in RTV. While many studies rely on standard deviation of reaction time (RTSD) to characterize RTV, such measures may not accurately capture the unimodal, positively skewed shape of the RT distribution (Heathcote et al., Reference Heathcote, Popiel and Mewhort1991). A growing number of researchers have begun to use mathematical models that can better accommodate the shape of the RT distributions. In addition, there is growing interest in neurobiologically informed computational models that can support mechanistic interpretation of group differences in RT and RTV metrics (Ferrante et al., Reference Ferrante, Redish, Oquendo, Averbeck, Kinnane and Gordon2019; White et al., Reference White, Ratcliff, Vasey and McKoon2010; Wiecki et al., Reference Wiecki, Poland and Frank2015). Primary models used to characterize performance include the ex-Gaussian model (Leth-Steenson et al., Reference Leth-Steenson, Elbaz and Douglas2000) and Ratcliff’s diffusion model (DM) (Ratcliff & Tuerlinckx, Reference Ratcliff and Tuerlinckx2002; Voss et al., Reference Voss, Rothermund and Voss2004).

Briefly, the ex-Gaussian model decomposes the RT distribution into Gaussian and exponential components to better fit the actual RT distribution (Leth-Steenson et al., Reference Leth-Steenson, Elbaz and Douglas2000). The ex-Gaussian distribution is characterized by three parameters: mu and sigma, reflecting the mean and SD of its Gaussian part, and tau, reflecting the exponential part (Leth-Steenson et al., Reference Leth-Steenson, Elbaz and Douglas2000). Cognitive interpretations of these parameters remain uncertain (Matzke & Wagenmakers, Reference Matzke and Wagenmakers2009); however, some interpret tau as reflecting attentional lapses (Epstein et al., Reference Epstein, Langberg, Rosen, Graham, Narad, Antonini, Brinkman, Froehlich, Simon and Altaye2011; Leth-Steenson et al., Reference Leth-Steenson, Elbaz and Douglas2000; Tamm et al., Reference Tamm, Narad, Antonini, O’Brien, Hawk and Epstein2012), and others suggest tau is indicative of intentional cognitive processes (Kieffaber et al., Reference Kieffaber, Kappenman, Bodkins, Shekhar, O’Donnell and Hetrick2006) or should not be interpreted in terms of specific processes (Matzke & Wagenmakers, Reference Matzke and Wagenmakers2009; Rieger & Miller, Reference Rieger and Miller2020).

The DM (Ratcliff & Tuerlinckx, Reference Ratcliff and Tuerlinckx2002; Voss et al., Reference Voss, Rothermund and Voss2004) provides additional information about cognitive processes that underlie performance as it simultaneously models RTs and accuracy. The DM assumes that information about a stimulus is accumulated via an information accumulation process until a decision is made and a response is initiated (Ratcliff & McKoon, Reference Ratcliff and McKoon2008; Ratcliff & Rouder, Reference Ratcliff and Rouder1998). DM parameters include (1) drift rate (how efficiently an individual can accumulate information to inform their response decision); (2) boundary separation (how “sure” a person needs to be before committing to a response, i.e., speed–accuracy trade-off); and (3) non-decision time (time it takes to complete all other information processes, such as encoding, and motor preparation and execution) (Ratcliff & McKoon, Reference Ratcliff and McKoon2008; Ratcliff & Rouder, Reference Ratcliff and Rouder1998).

Most prior studies, particularly in children, have relied on a single model to characterize task performance; however, simulation studies and studies in typically-developing adults have examined associations between ex-Gaussian and DM parameters. The general conclusions are that ex-Gaussian parameters often correlate broadly with multiple DM parameters (Matzke & Wagenmakers, Reference Matzke and Wagenmakers2009), but the strength of these correlations varies and, in some cases, specific associations are obtained (e.g., non-decision time specifically associated with mu; drift most strongly associated with tau (Fitousi, Reference Fitousi2020)). Similar patterns have been identified in at least one study of children with ADHD (Karalunas & Huang-Pollock, Reference Karalunas and Huang-Pollock2013); however, the sample size was modest. Clarifying these associations as they occur at various stages of development will be critical in helping researchers integrate previous findings to inform additional work.

Moreover, examining RT patterns with these models can clarify cognitive mechanisms contributing to differences on choice RT tasks. We highlight two examples here. First, we describe patterns of change in both Gaussian and other RT parameters over time. Time-on-task effects are well established for many cognitive tasks, and they are typically interpreted as reflecting challenges to sustained attention. However, other processes, such as increasing impulsivity or adjustments to response strategy based on task difficulty, could also play a role.

Second, we present the issue of sex differences in RT – a topic that has received much research attention but has primarily used Gaussian indices. In adults, studies consistently find that males have faster and less variable RTs than females (Deary & Der, Reference Deary and Der2005; Der & Deary, Reference Der and Deary2006; Reed et al., Reference Reed, Vernon and Johnson2004; Silverman, Reference Silverman2006). In children, some very early studies found similar patterns (Gilbert, Reference Gilbert1894; Goodenough, Reference Goodenough1935); however, more recent work has found differences in speed but not variability of RTs (Bunce et al., Reference Bunce, Tzur, Ramchurn, Gain and Bond2008; Kalb et al., Reference Kalb, Jansen, Reulbach and Kalb2004), albeit in samples that sometimes span large age ranges.

Sex differences in the cognitive processes contributing to mean level RT and RTV performance are only just being explored via computational modeling. There is some evidence for differential strategy use between the sexes during choice RT tasks (Adam et al., Reference Adam, Paas, Buekers, Wuyts, Spijkers and Wallmeyer1999), and studies in both adults (Era et al., Reference Era, Sainio, Koskinen, Ohlgren, Harkanen and Aromaa2011; Landauer et al., Reference Landauer, Armstrong and Digwood1980) and children (Lynn & Ja-Song, Reference Lynn and Ja-Song1993) suggest that females may have faster decision times but slower motor responses than males. In a recent study of adolescents, sex differences were observed in the way response caution changes with pubertal development (Castagna & Crowley, Reference Castagna and Crowley2021), suggesting that the processes accounting for RT differences (or lack thereof) may differ in younger children as compared to adolescents and adults. Indeed, school-age females demonstrated more effective evidence accumulation but higher response caution than males on an emotional decision-making task (Xu et al., Reference Xu, Hao, Chen, He, Jiang, Tian, Wang, Wang, Wang, Han, Tan, Men, Gao, He, Tao, Dong and Qin2021).

Overall, there is continued interest in cognitive performance measures and particularly computational performance parameters as potential transdiagnostic risk markers for psychopathology (Ferrante et al., Reference Ferrante, Redish, Oquendo, Averbeck, Kinnane and Gordon2019; Karalunas et al., Reference Karalunas, Hawkey, Gustafsson, Miller, Langhorst, Cordova, Fair and Nigg2018; Wiecki et al., Reference Wiecki, Poland and Frank2015). However, our understanding of (1) how parameters from different models relate to one another and (2) sex differences in the processes contributing to overall RT and RTV metrics comes largely from adult populations. Characterizing the associations between model parameters in childhood will be critical for integrating findings from prior studies of child psychopathology and informing model selection in future studies of childhood risk. In addition, clarifying sex differences in the mechanisms contributing to RT performance may ultimately help explain sex-specific cognitive and neural risk markers for psychopathology (e.g., Arnett et al., Reference Arnett, Pennington, Willcutt, DeFries and Olson2015).

This study utilized trial-level stop-signal task (SST) data from the Adolescent Brain Cognitive Development (ABCD) study to examine Gaussian, ex-Gaussian, and DM indicators of RTV. The sample provides an unprecedented opportunity to examine RTV patterns in a large pediatric sample. The sample is homogeneous developmentally (all participants were 9–10 years old) yet heterogeneous in terms of sex, race, and psychological diagnoses. In addition to examining interrelations among RTV indicators and how these relate to task accuracy, we describe changes in RTV with time on task. Finally, we examine sex differences across computational model parameters to illustrate how these indicators can illuminate processes contributing to documented sex differences in RT speed and variability.

Methods

Participants

The ABCD Study recruited youth aged 9–10 years of age across 21 geographically diverse US sites. Informed consent/assent was obtained, and all procedures were approved by a central Institutional Review Board ensuring research was completed in accordance with the Helsinki Declaration. The present study accessed publicly available ABCD data through the National Data Archive. In release 3.0, baseline trial-level SST data for 10,179 participants were available. Children were excluded if their accuracy on the SST was <66% on non-stop trials (n = 1199) or their mean stop probability was <25% or >75% (n = 196). Hence, the sample size for the current study was 8,916 children (mean age = 9.9, SD = .62; 49.1% female; 77.4% White, 19.8% Hispanic, 18.1% African American, 7.2% Asian, 3.3% American Indian, 0.2% Native Alaskan/Hawaiian, 0.5% Pacific Islander).

Measures

The SST is a computerized measure of response inhibition with two 180 trial runs with a brief (median = 43 s) break between runs (Casey et al., Reference Casey, Cannonier, Conley, Cohen, Barch, Heitzeg, Soules, Teslovich, Dellarco, Garavan, Orr, Wager, Banich, Speer, Sutherland, Riedel, Dick, Bjork and Thomas2018). On every trial, the participant views a horizontal arrow pointing either right or left. Participants indicate the direction of the arrow via a two-button response panel within 1000 ms after which a fixation cross appears with an intertrial interval that lasts from 700 to 2000 ms. Thirty (16.6%) trials in each run were stop trials on which the horizontal arrow is followed by an upward arrow (i.e., the stop signal) for 300 ms. Participants inhibit their response when they see the stop signal. The delay between presentation of the horizontal target arrow and the upward arrow (SSD) begins at 50 ms and varies according to the participant’s performance. Successful inhibition results in increases of 50 ms and unsuccessful inhibition results in decreases of 50 ms so that the rate of inhibition is approximately 50%. This SSD resets to 50 ms at the start of the second run.

RTs <150 ms were excluded in our computational models. Stop-signal reaction time (SSRT) was computed using the integration method in accordance with current consensus best-practice for measuring inhibitory control on this task (Verbruggen et al., Reference Verbruggen, Aron, Band, Beste, Bissett, Brockett, Chamberlain, Chambers, Colonius, Colzato, Corneil, Coxon, Dupuis, Eagle, Garavan, Greenhouse, Heathcote, Huster, Jahfari and Boehler2019). In the integration method, the time required to stop is estimated by integrating the RT distribution and identifying the point at which the integral equals the probability of responding. SSRT is then calculated by subtracting SSD from the finishing timeFootnote 1 . Consistent with best practice recommendations, Go RT omissions were replaced with the longest Go RT for that participant and premature responses on stop trials (i.e., responses before stop-signal presentation) were included when calculating the participant’s probability of successful stopping and the SSD’s.

Gaussian estimation

The SST RT trial data from Go-trials were utilized to compute mean RT (MRT), RTSD, and coefficient of variation (CV). MRT was computed by averaging RTs on correct response trials. RTSD was derived by computing the SD of each individual’s RTs. CV was computed by dividing RTSD by the MRT, providing a measure of RTV controlling for speed.

Ex-Gaussian estimation

Correct RTs on Go-trials were used to compute ex-Gaussian indicators using retimes (Massidda, Reference Massidda2013; Van Zandt, Reference Van Zandt2000). A mean (mu) and SD (sigma) for the Gaussian distribution are estimated along with the exponential distribution (tau) which reflects the tail or positive skew of the RT distribution.

DM estimation

Fast-DM (Voss & Voss, Reference Voss and Voss2007), which uses an iterative distribution fitting approach to compare the observed RT distribution to the distribution predicted to occur with specific parameter values, was used to estimate DM parameters. We allowed drift rate (v), boundary separation (a), non-decision time (t 0 ), and the variability of non-decision time (st 0 ) to vary between individuals. The relative starting point (z) was held constant at .5 indicating the absence of decisional bias. st 0 was modeled with the other parameters because it may improve overall model fits when fast guesses are present (Ratcliff & Tuerlinckx, Reference Ratcliff and Tuerlinckx2002). Other parameters (i.e., differences in speed of response execution, intertrial variability of starting point, intertrial variability of drift, and percentage of contaminants) were fixed at 0 given that they were unlikely to be reliably modeled with the number of trials available (Lerche et al., Reference Lerche, Voss and Nagler2017). Because both speed and accuracy are accounted for in DM, both correct and error RTs on Go-trials were used, reflecting the upper and lower boundaries of the model, respectively. Smaller absolute values of v indicate slower drift rates. Smaller values of a indicate greater speed-accuracy trade off. t 0 and st 0 are reported in seconds. Despite legitimate concerns with p-value cutoffs for participant exclusion there is currently no other consensus method, particularly in very large samples. Here, similar to others (Arnold et al., Reference Arnold, Broder and Bayen2015; Klatt et al., Reference Klatt, Schneider, Schubert, Hanenberg, Lewald, Wascher and Getzmann2020; Lerche et al., Reference Lerche, Neubauer and Voss2018), we relied on p-values and excluded participants (n = 4) based on a Kolmogorov–Smirnov fit statistic <.05 (see Supplemental Figure S1 for cumulative distribution plots).

Parameter recovery

Prior simulation studies have suggested that ex-Gaussian (Galloway-Long & Huang-Pollock, Reference Galloway-Long and Huang-Pollock2018), and DM parameters can be estimated with the number of trials available here, albeit with loss of precision for some parameters in the context of either slow or fast contaminants (Lerche et al., Reference Lerche, Voss and Nagler2017). Nonetheless, we conducted parameter recovery studies (Voss et al., Reference Voss, Nagler and Lerche2013). To assess parameter recovery with trial numbers available in the full task, 1,000 sets of values for (1) ex-Gaussian and (2) DM parameters were simulated using the mvrnorm function from the R MASS package. Simulated values were based on the observed means and covariance structure in the observed ABCD sample. Next, trial-level RT data for each of the 1,000 parameter sets was simulated using the rexgauss function from the R retimes package (ex-Gaussian) and the construct-samples tool from fast-dm (DM). Data sets included n = 261 (ex-Gaussian where only correct go-trials are used) or n = 300 Go-trials (DM where correct and incorrect trials are used). Parameter estimates were recovered from the simulated trial-level data using retimes or fast-dm. Bias was computed as the difference between the simulated and recovered parameters. Mean percent error, which indicates the signed average difference between simulated and recovered values as a function of the simulated parameter value, ranged from –1.1% to 0.2% for ex-Gaussian parameters and from –1.7 to 4.4% for DM parameters. Raw bias and mean percent error for all parameters are reported in Table S1 in the Supplement. We also considered correlations between simulated and recovered parameters, which we interpreted based on guidelines from White et al. (Reference White, Servant and Logan2018): r below .5 poor, 0.5 < r < 0.75 fair, 0.75 < r < 0.9 good, and r > 0.9 excellent. Parameter recovery was good to excellent for all parameters (see Table S2 and Figures S2S5 in the Supplement for correlations and Q-Q plots of simulated and recovered parameters).

We repeated parameter recovery studies for: (1) run level and (2) block-level data to assess whether parameters could be adequately recovered at these lower trial numbers. Parameter recovery was good to excellent for ex-Gaussian parameters at both the run and block level (range r = .84–.97). Parameter recovery was good to excellent for diffusion model parameters at the run level (range r = .77–.90) and fair to good at the block level (range r = .63–.80). Additional details, Q-Q plots, and simulated-recovered parameter correlations are all available in the Supplement.

Analyses

Descriptive statistics for performance indices and their intercorrelations (Pearson) were estimated. To explore task performance over time, each of the SST indices was estimated for each of the two runs, and paired t-tests were run testing for differential performance across runs. Next, each SST run was divided into two equal blocks, and performance across the four blocks was tested for linear and quadratic trends. Note that SSRT was only computed for the whole task since the SSD algorithm adjusts across the whole task precluding unbiased SSRT computation across runs/blocks. To examine sex differences, t-tests were conducted comparing performance outcomes between males and females. Cohen’s d (Cohen, Reference Cohen1992) was calculated to estimate effect size.

Results

Overall performance

The mean accuracy on nonstop trials (i.e., correct discrimination of arrow directionality) was 87.8% (SD = 7.7%; range: 0.661–1.000). The mean SSRT for the sample was 985.87 ms (SD = 484.10; range: 2–2577). RT performance indices are presented in Table 1 (see Supplemental Figure S6 for distributions).

Table 1. Descriptive statistics

Note. RT = reaction time, RTSD = standard deviation of RT, CV = coefficient of variation, DM = diffusion model.

Intercorrelations

The large sample size resulted in statistically significant correlations between most of the accuracy, SSRT, and RT performance indices (Table 2; see Supplemental Figure S6 for scatterplots). Accuracy was moderately correlated with SSRT (r = -.46). Of the RT indices, CV (r = -.65) and v (r = .77) were most highly correlated with accuracy. v was most highly correlated with SSRT (r = -.41).

Table 2. Intercorrelations between RTV and SST performance indices

Note. RT = reaction time, RTSD = standard deviation of RT, CV = coefficient of variation, SSRT = stop-signal RT.

*p < .05; **p < .01; ***p < .001; ****p < .0001.

Parameters derived from the same models showed varying patterns of correlation. As would be expected, RTSD was correlated with RT (r = .62) and CV (r = .66). For ex-Gaussian parameters, sigma was highly correlated with mu (r = .73), but the magnitude of correlation between other parameters was small (all rs < .1). Although the DM indices were significantly intercorrelated, the magnitude of these correlations was modest (r = .35 for v and t 0 and all other rs < .18).

There were also strong intercorrelations among parameters across models. Mu correlated most highly with t 0 (r = .91), but also correlated moderately with st 0 (r = .45) and a (r = .50). Sigma correlated strongly with t 0 (r = .60) and st 0 (r = .81) and moderately with a (r = .31). Tau correlated strongly with v (r = -.68) and moderately with a (r = .41).

Finally, we considered relationships between Gaussian metrics and parameters from the other models. Ex-Gaussian parameters describing the normal part of the RT distribution (mu, sigma) correlated strongly with RT (rs = .67–.88) and moderately with RTSD (rs = .21-.41), whereas tau showed the opposite pattern (i.e., strongly correlated with RTSD, r = .88, and moderately with RT, r = .43). For DM parameters, v was strongly correlated with RTSD (r = -.64) but only weakly correlated with RT (r = -.10). In contrast, t 0 was strongly correlated with RT (r = .71) but uncorrelated with RTSD (r = .001). a was moderately correlated with both RT and RTSD (rs = .42–.67).

Performance across time

While performance indices were significantly correlated across runs (r=.45–.86), there were also significant performance decrements between the runs (Table 3). Accuracy worsened, MRT slowed, and both RTSD and CV increased on the second run compared to the first. On ex-Gaussian indicators, the largest effect was an increase in tau from run 1 to run 2. Mu decreased and sigma increased from run 1 to 2 but with small effects. On DM indicators, the largest effect was for slower v from run 1 to run 2, but faster t 0 and larger st 0 were also observed on the second run, compared to the first run.

Table 3. Performance across SST runs

Note. **p < .01; ****p < .0001; RT = reaction time, RTSD = standard deviation of RT, CV = coefficient of variation, DM = drift diffusion model.

The two runs were further divided into 4 blocks (2 per run) to more finely examine performance on the SST task. All performance indices demonstrated significant linear and quadratic trends across blocks (Table 4).

Table 4. Performance across SST blocks

Note. RT = reaction time, RTSD = standard deviation of RT, CV = coefficient of variation, DM = drift diffusion model.

*p <. 05; **p < .01; ****p < .0001.

For most indicators, there was a distinct pattern of worsening performance from the first half of run 1 to the second half of run 1. This was followed by a pattern of fairly comparable performance in the second half of run 1 to the first half of run 2 followed by a repeated pattern of worsening performance between the first and second half of run 2. Notably, performance during the first block of run 1 and the second block of run 2 (i.e., first and fourth blocks) was quite discrepant with mean estimates displaying more than a .5 SD decrement between these blocks for some variables (e.g., RTSD, CV, tau, v) (Figure 1). Indeed, it appears that the RTV indicators (RTSD: t = 28.28, p < .0001; CV: t = 25.67, p < .0001; tau: t = 21.33, p < .0001; and v: t = 20.79, p < .0001) were most susceptible to this pattern, as evidenced by significant linear and quadratic trends for these variables.

Figure 1. Performance across SST blocks. Shaded areas reflect 95% confidence interval. Note. RTSD = standard deviation of reaction time, CV = coefficient of variation.

Sex differences

Females were more accurate than males on go-trials (d = .09), but did not differ from males on SSRT (d = .01), see Table 5. Males were faster (RT; d = .39) and less variable (RTSD; d = .31) than females. However, for CV, which factors in the mean when estimating variability, no sex differences emerged (d = .00).

Table 5. Sex differences

Note. **** p < .0001, RT = reaction time, RTSD = standard deviation of RT, CV = coefficient of variation, DM = drift diffusion model, SSRT = stop-signal reaction time.

Interrogating further with ex-Gaussian indicators, females had higher mu (d = .28), sigma (d = .21), and tau (d = .28) than males, though all effect sizes were relatively small. Analyses of the DM indicators found a moderate effect size for higher a in females than males (d = .42), and smaller but reliable effects for faster v (d = .09), and slower, more variable t 0 (d = .14) and st 0 (d = .30) in females than males.

Discussion

The ABCD sample is unprecedented including its large sample, geographic, gender and racial/ethnic diversity, and comprehensive assessment of behavioral, cognitive, and neurophysiological functioning. While the SST is generally considered an inhibitory task, the large number of RTs collected on “go” trials also makes it conducive to characterizing individual’s RT distributions. Here, we capitalize on the unique ABCD sample to demonstrate that associations among RT parameters from common computational modeling approaches in middle childhood are similar to findings in adults. Such confirmation can guide integration of prior studies using disparate approaches and inform model selection for additional studies. We also demonstrate how computational modeling can clarify the processes contributing to change in performance over time, and cognitive mechanisms contributing to sex differences in RT and RTV in middle childhood.

This is one of the few studies applying multiple RTV approaches to the same data set in middle childhood, when relationships among model parameters are largely unknown. Correlations between DM and ex-Gaussian parameters are consistent with prior simulation studies (Matzke & Wagenmakers, Reference Matzke and Wagenmakers2009). Ex-Gaussian parameters correlated at least moderately with multiple DM parameters, suggesting the ex-Gaussian measures cannot be interpreted in terms of specific cognitive processes (Rieger & Miller, Reference Rieger and Miller2020), or at least not in terms of the specific processes reflected in DM parameters (Fitousi, Reference Fitousi2020).

Nonetheless, the strength of correlations among parameters varied in consistent ways. In particular, v correlated most strongly with tau, consistent with slowing drift rates having the greatest effect on the tail of the RT distribution (Ratcliff, Reference Ratcliff2006; Ratcliff & McKoon, Reference Ratcliff and McKoon2008). In line with prior simulations (Fitousi, Reference Fitousi2020; Matzke & Wagenmakers, Reference Matzke and Wagenmakers2009) t 0 was most strongly correlated with mu. st 0 was most strongly correlated with sigma. Taken together, results suggest that differences in nondecisional processing primarily affect the Gaussian portion of the RT distribution, while differences in speed and efficiency of decision processes are important contributors to the exponential features of RT distributions. Such associations support recent calls to use ex-Gaussian and DM models in conjunction by designing experiments where convergent patterns across models may help rule in or out specific interpretations (Fitousi, Reference Fitousi2020).

Relations between parameters and Gaussian measures were also informative. In particular, v was strongly correlated with RTSD but not RT, whereas t 0 and st 0 metrics were strongly correlated with RT but not RTSD. This suggests that higher RTSDs observed in prior studies may best be understood in terms of slow/inefficient information processing, whereas RT differences may be more related to differences in nondecisional processes such as encoding and motor response speed. Crucially, this interpretation differs from that applied in many clinical studies where slow MRTs are interpreted as reflecting primarily slow/inefficient information processing rather than motor (or other nondecisional) processing. Similarly, RTSD was most strongly correlated with tau, consistent with long RTs being a primary driver of RTSD (Tamm et al., Reference Tamm, Narad, Antonini, O’Brien, Hawk and Epstein2012). Tau is often interpreted in terms of attention lapses, but general slowing may result in similarly long tails at the upper end of the distribution (Ratcliff, Reference Ratcliff2006; Ratcliff & McKoon, Reference Ratcliff and McKoon2008). Investigations to explore the roles of general slowing and specific attention lapses in this developmental period are needed (Killeen, Reference Killeen2019; Unsworth et al., Reference Unsworth, Redick, Lakey and Young2010; Weigard et al., Reference Weigard, Huang-Pollock, Brown and Heathcote2018).

Questions about the role of general slowing in higher level executive processes, particularly in the context of developmental psychopathology, remain relevant. Recent evidence suggests that such task general processes may account for a wide range of impairments on higher level executive tasks (Weigard et al., Reference Weigard, Clark and Sripada2021; Weigard & Sripada, Reference Weigard and Sripada2021), and findings here support this possibility. Overall, RT and RTV correlations with SSRT were modest (r range = .04–.29), similar to prior SST studies (Lipszyc & Schachar, Reference Lipszyc and Schachar2010). However, SSRT and v were moderately correlated, suggesting a unique relationship between this indicator of general speed/efficiency of processing and inhibitory control. At least one prior study has similarly found that slower v mediates impairments in SSRT observed in some psychiatric disorders (Karalunas & Huang-Pollock, Reference Karalunas and Huang-Pollock2013), and more recent studies also suggest a general cognitive efficiency factor predicts top-down control in everyday life better than traditional lab-based measures of top-down control (Weigard et al., Reference Weigard, Clark and Sripada2021).

Large temporal within-task effects were observed across every index of performance. Consistent with large bodies of prior research on sustained attention using a variety of tasks (Conners et al., Reference Conners, Epstein, Angold and Klaric2003; Fortenbaugh et al., Reference Fortenbaugh, Rothlein, McGlinchey, DeGutis and Esterman2018; Huang-Pollock et al., Reference Huang-Pollock, Karalunas, Tam and Moore2012; Klein et al., Reference Klein, Wendling, Huettner, Ruder and Peper2006; Losier et al., Reference Losier, McGrath and Klein1996; Rosenberg et al., Reference Rosenberg, Noonan, DeGutis and Esterman2013; Sykes et al., Reference Sykes, Douglas and Morgenstern1973), children demonstrated slower RTs, more variable responding, and poorer accuracy with increasing time on task. Decrements in performance, especially between the first and last blocks, were substantial (i.e., >.5 SD in magnitude). Notably, children did not demonstrate worsening performance between the second block on run 1 and the first block of run 2, which may be partially due to the short break between runs.

Examination of ex-Gaussian and DM parameters further clarifies the processes contributing to performance changes over time. Mu decreased across time indicating faster responding (often associated with better performance). However, when taken together with the corresponding decreases in t 0 (associated with faster motor output), these changes in the RT distribution are likely indicative of increases in motor impulsivity. The largest time effects were increases in tau and decreases in v, suggesting worsening attention and slowed/less efficient information processing as time on task increased. The changes in v, in particular, are consistent with its association with arousal-related circuitry that includes the locus coeruleus-norepinephrine system (Aston-Jones & Cohen, Reference Aston-Jones and Cohen2005).

Cognitively, decrements in both tau and v over time are also consistent with attention depletion models. Such models suggest that sustaining attention is an effortful process and thus the likelihood of an attention lapse increases as time in an attentive state increases (Killeen, Reference Killeen2013). This may be particularly true when the attentional state must be endogenously maintained (e.g., when the participant must actively work to maintain attention to things that are not inherently interesting). Events that exogenously capture attention (e.g., novel stimuli) or provide breaks to endogenously maintain attentional states (e.g., breaks between runs) may serve to attenuate attention depletion (Killeen, Reference Killeen2013). Such effects would help explain why participants’ performances declined nonlinearly across blocks with performance levels remaining similar before and after the provided break.

We also used the broad range of RT and performance indices to examine sex differences in RT. Consistent with most previous research, males had faster RTs than females and females had more variable RTs than males. Notably, the effect sizes for both of these effects were small (RT: d = .39; RTSD: d = .31) but were still nearly double those observed in a prior meta-analysis (d = .17 across the lifespan; Silverman, Reference Silverman2006) and other large-scale studies of both SST (d = .23 across the lifespan; Williams et al., Reference Williams, Ponesse, Schachar, Logan and Tannock1999) and other tasks (e.g., Dykiert et al., Reference Dykiert, Der, Starr and Deary2012). In general, sex differences in RT and RTSD have been less consistently found in children than adults (Dykiert et al., Reference Dykiert, Der, Starr and Deary2012; Ghisletta et al., Reference Ghisletta, Renaud, Fagot, Lecerf and de Ribaupierre2018). This pattern of findings has led some investigators to propose that variability in RTs may be related to the effects of post-pubertal levels of estrogen in brain areas involved in the regulation of variability in information processing and attention (Deary & Der, Reference Deary and Der2005). However, the effects at young ages in the ABCD sample argue against such a possibility. Additional studies directly considering puberty will be important. The difference in size of effects here versus in prior studies may be related to differences in task demands between studies, geographic regions in which participants were recruited, or other factors. Regardless, in the largest sample of children to-date (larger than even the total samples available in meta-analytic studies), there appear to be small but reliable sex differences in RT.

An additional question is what may be causing these differences. It is notable that the observed sex differences in RT occurred in the context of females having higher accuracy than males, which suggests a slower speed for higher accuracy trade-off among females. Indeed, DM parameters confirm this conclusion. The largest effect size for sex differences across all of the performance measures was for a (d = .42), consistent with increased response caution (i.e., decreased speed-accuracy trade-off) contributing to slower RTs in females. Results confirm that similar findings on emotional decision-making tasks (Xu et al., Reference Xu, Hao, Chen, He, Jiang, Tian, Wang, Wang, Wang, Han, Tan, Men, Gao, He, Tao, Dong and Qin2021) may reflect more general response strategy, rather than specific effects of emotional context.

Females also had slower and more variable t 0 than males, confirming a body of research suggesting that differences in motor response speed may contribute to overall sex effects in RT (Era et al., Reference Era, Sainio, Koskinen, Ohlgren, Harkanen and Aromaa2011; Landauer et al., Reference Landauer, Armstrong and Digwood1980; Lynn & Ja-Song, Reference Lynn and Ja-Song1993). While both greater response caution and slower, more variable motor output are likely driving the Gaussian findings of slower and more variable RTs, these effects “hide” that females actually have equally strong or slightly faster processing speed/efficiency than males based on DM parameters. Similarly, ex-Gaussian parameters, which bear nonspecific relationships to cognitive processes, showed a consistent pattern of females performing more poorly than males without identifying the equal or better cognitive efficiency observed when using DM parameters. Thus, the analyses here not only clarify the processes underlying observed sex effects in RTs but also illustrate how important information may be lost in using performance metrics that do not adequately distinguish different components of cognitive processing.

Here, we demonstrate in the largest sample of children to-date that the patterns of correlations between different RT models are similar in middle childhood to those observed in adults on a task with integrated inhibitory control demands. Additional studies using paradigms without inhibitory demands will be informative. Understanding these patterns can guide integration of prior studies using a single RT model, as well as parameter selection in future studies. Further, we confirm the presence of small but reliable sex differences in RT. We demonstrate that computational models can be used to characterize the processes underlying these differences—greater response caution and slower motor output in females. Importantly, we also show that the use of parameters that do not adequately differentiate cognitive processes may miss important information, such as the equally strong or better cognitive efficiency observed in females as compared to males, despite slower and more variable RTs based on Gaussian indicators. Similar models and approaches are likely to be informative for future studies focused on the association of the various RTV metrics with behavioral correlates (e.g., ratings of emotion/behavior or neurocognitive task performance) and within children diagnosed with various disorders (e.g., ADHD). Relatedly, additional studies examining the association of intrinsic brain activity with various RTV metrics will be important for clarifying the functional and clinical significance of RTV as a biomarker of attentional functioning.

Supplementary material

For supplementary material accompanying this paper visit https://doi.org/10.1017/S1355617722000431

Acknowledgements

We are grateful to Alex Weigard who provided very helpful constructive feedback on earlier versions of the manuscript.

Author contributions

Jeff Epstein: Conceptualization, Investigation, Methodology, Writing – Original draft preparation, review and editing, Funding acquisition. Sarah Karalunas: Conceptualization, Investigation, Methodology, Writing – Original draft preparation, review and editing, Formal analysis, Visualization, Validation, Funding acquisition. Leanne Tamm: Conceptualization, Writing – Original draft preparation, review and editing, Funding acquisition. Jon Dudley: Conceptualization, Investigation, Methodology, Data Curation, Visualization, Writing – Review and editing, Funding acquisition. James Lynch: Visualization, Writing – Review and editing. Mekibib Altaye: Conceptualization, Investigation, Methodology, Software, Data Curation, Writing – Review and editing, Funding acquisition. John Simon: Investigation, Methodology, Software, Data Curation, Writing – Review and editing. Tom Maloney: Investigation, Methodology, Software, Data Curation, Writing – Review and editing. Gowtham Atluri: Conceptualization, Writing – Review and editing, Funding acquisition.

Funding statement

The research reported here was supported by the National Institute of Mental Health (NIMH; 1 R01 MH123831-01). Data used in the preparation of this article were obtained from the Adolescent Brain Cognitive DevelopmentSM (ABCD) Study (https://abcdstudy.org), held in the NIMH Data Archive (NDA). This is a multisite, longitudinal study designed to recruit more than 10,000 children aged 9–10 years and follow them over 10 years into early adulthood. The ABCD Study® is supported by the National Institutes of Health (NIH) and additional federal partners under award numbers U01DA041048, U01DA050989, U01DA051016, U01DA041022, U01DA051018, U01DA051037, U01DA050987, U01DA041174, U01DA041106, U01DA041117, U01DA041028, U01DA041134, U01DA050988, U01DA051039, U01DA041156, U01DA041025, U01DA041120, U01DA051038, U01DA041148, U01DA041093, U01DA041089, U24DA041123, U24DA041147. A full list of supporters is available at https://abcdstudy.org/federal-partners.html. A listing of participating sites and a complete listing of the study investigators can be found at https://abcdstudy.org/consortium_members/. ABCD consortium investigators designed and implemented the study and/or provided data but did not necessarily participate in the analysis or writing of this report. This manuscript reflects the views of the authors and may not reflect the opinions or views of the NIH or ABCD consortium investigators. The ABCD data repository grows and changes over time. The ABCD data used in this report came from ABCD Curated Annual Release 3.0 (10.15154/1519007). Some of the data from this study (10.15154/1521162) have been shared on the NDA in accordance with National Institutes of Health (NIH) guidelines. The collection title is using Variance Time course Analyses with Stop Signal Data in the ABCD.

Conflicts of interest

None.

Footnotes

1 Note that the SSRT values in the ABCD study may be biased due to a violation in the assumption of context independence (Bissett et al., Reference Bissett, Hagen, Jones and Poldrack2021), and other methods of computing SSRT may eventually be implemented (Weigard, Matzke et al., Reference Weigard, Matzke, Tanis and Heathcote2021).

References

Adam, J. J., Paas, F. G., Buekers, M. J., Wuyts, I. J., Spijkers, W. A., & Wallmeyer, P. (1999). Gender differences in choice reaction time: Evidence for differential strategies. Ergonomics, 42, 327335. https://doi.org/10.1080/001401399185685 CrossRefGoogle ScholarPubMed
Andrade, B. F., Brodeur, D. A., Waschbusch, D. A., Stewart, S. H., & McGee, R. (2009). Selective and sustained attention as predictors of social problems in children with typical and disordered attention abilities. Journal of Attention Disorders, 12, 341352. https://doi.org/10.1177/1087054708320440 CrossRefGoogle ScholarPubMed
Antonini, T. N., Narad, M. E., Langberg, J. M., & Epstein, J. N. (2013). Behavioral correlates of reaction time variability in children with and without ADHD. Neuropsychology, 27, 201209. https://doi.org/10.1037/a0032071 CrossRefGoogle ScholarPubMed
Arnett, A. B., Pennington, B. F., Willcutt, E. G., DeFries, J. C., & Olson, R. K. (2015). Sex differences in ADHD symptom severity. Journal of Child Psychology & Psychiatry, 56, 632639. https://doi.org/10.1111/jcpp.12337 CrossRefGoogle ScholarPubMed
Arnold, N. R., Broder, A., & Bayen, U. J. (2015). Empirical validation of the diffusion model for recognition memory and a comparison of parameter-estimation methods. Psychological Research, 79, 882898. https://doi.org/10.1007/s00426-014-0608-y CrossRefGoogle Scholar
Aston-Jones, G., & Cohen, J. D. (2005). An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance. Annual Review of Neuroscience, 28, 403450. https://doi.org/10.1146/annurev.neuro.28.061604.135709 CrossRefGoogle ScholarPubMed
Barriga, A. Q., Doran, J. W., Newell, S. B., Morrison, E. M., Barbetti, V., & Robbins, B. D. (2002). Relationships between problem behaviors and academic achievement in adolescents: The unique role of attention problems. Journal of Emotional and Behavioral Disorders, 10, 233240.CrossRefGoogle Scholar
Bissett, P. G., Hagen, M. P., Jones, H. M., & Poldrack, R. A. (2021). Design issues and solutions for stop-signal data from the Adolescent Brain Cognitive Development (ABCD) study. Elife, 10, e60185.CrossRefGoogle ScholarPubMed
Bora, E., Vahip, S., & Akdeniz, F. (2006). Sustained attention deficits in manic and euthymic patients with bipolar disorder. Progress in Neuropsychopharmacology and Biological Psychiatry, 30, 10971102. https://doi.org/10.1016/j.pnpbp.2006.04.016 CrossRefGoogle ScholarPubMed
Bunce, D., Tzur, M., Ramchurn, A., Gain, F., & Bond, F. W. (2008). Mental health and cognitive function in adults aged 18 to 92 years. The Journals of Gerontology: Series B: Psychological Sciences and Social Sciences, 63, P67P74. https://doi.org/10.1093/geronb/63.2.p67 CrossRefGoogle ScholarPubMed
Casey, B. J., Cannonier, T., Conley, M. I., Cohen, A. O., Barch, D. M., Heitzeg, M. M., Soules, M. E., Teslovich, T., Dellarco, D. V., Garavan, H., Orr, C. A., Wager, T. D., Banich, M. T., Speer, N. K., Sutherland, M. T., Riedel, M. C., Dick, A. S., Bjork, J. M., Thomas, K. M., … ABCD Imaging Acquisition Workgroup. (2018). The adolescent brain cognitive development (ABCD) study: Imaging acquisition across 21 sites. Developmental Cognitive Neuroscience, 32, 4354. https://doi.org/10.1016/j.dcn.2018.03.001 CrossRefGoogle ScholarPubMed
Castagna, P. J., & Crowley, M. J. (2021). Relationship between puberty and inhibitory control: Computational modeling of the drift-diffusion process. Developmental Neuropsychology, 46, 360380. https://doi.org/10.1080/87565641.2021.1952206 CrossRefGoogle ScholarPubMed
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155159.CrossRefGoogle ScholarPubMed
Conners, C. K., Epstein, J. N., Angold, A., & Klaric, J. (2003). Continuous performance test performance in a normative epidemiological sample. Journal of Abnormal Child Psychology, 31, 555562. https://doi.org/10.1023/a:1025457300409 CrossRefGoogle Scholar
Deary, I. J., & Der, G. (2005). Reaction time, age, and cognitive ability: Longitudinal findings from age 16 to 63 years in representative population samples. Aging, Neuropsychology, and Cognition, 12, 187215. https://doi.org/10.1080/13825580590969235 CrossRefGoogle Scholar
Der, G., & Deary, I. J. (2006). Age and sex differences in reaction time in adulthood: Results from the United Kingdom health and lifestyle survey. Psychology of Aging, 21, 6273. https://doi.org/10.1037/0882-7974.21.1.62 CrossRefGoogle ScholarPubMed
Dykiert, D., Der, G., Starr, J. M., & Deary, I. J. (2012). Sex differences in reaction time mean and intraindividual variability across the life span. Developmental Psychology, 48, 12621276. https://doi.org/10.1037/a0027550 CrossRefGoogle ScholarPubMed
Epstein, J. N., Langberg, J. M., Rosen, P. J., Graham, A., Narad, M. E., Antonini, T. N., Brinkman, W. B., Froehlich, T., Simon, J. O., & Altaye, M. (2011). Evidence for higher reaction time variability for children with ADHD on a range of cognitive tasks including reward and event rate manipulations. Neuropsychology, 25, 427441. https://doi.org/10.1037/a0022155 CrossRefGoogle ScholarPubMed
Era, P., Sainio, P., Koskinen, S., Ohlgren, J., Harkanen, T., & Aromaa, A. (2011). Psychomotor speed in a random sample of 7,979 subjects aged 30 years and over. Aging Clinical and Experimental Research, 23, 135144. https://doi.org/10.1007/BF03351077 CrossRefGoogle Scholar
Ferrante, M., Redish, A. D., Oquendo, M. A., Averbeck, B. B., Kinnane, M. E., & Gordon, J. A. (2019). Computational psychiatry: A report from the 2017 NIMH workshop on opportunities and challenges. Molecular Psychiatry, 24, 479483. https://doi.org/10.1038/s41380-018-0063-z CrossRefGoogle ScholarPubMed
Fitousi, D. (2020). Linking the ex-Gaussian parameters to cognitive stages: Insights from the linear ballistic accumulator (LBA) model. Quantitative Methods in Psychology, 16, 91106. https://doi.org/10.20982/tqmp.16.2.p091 CrossRefGoogle Scholar
Fortenbaugh, F. C., Rothlein, D., McGlinchey, R., DeGutis, J., & Esterman, M. (2018). Tracking behavioral and neural fluctuations during sustained attention: A robust replication and extension. Neuroimage, 171, 148164. https://doi.org/10.1016/j.neuroimage.2018.01.002 CrossRefGoogle ScholarPubMed
Galloway-Long, H., & Huang-Pollock, C. (2018). Using inspection time and ex-Gaussian parameters of reaction time to predict executive functions in children with ADHD. Intelligence, 69, 186194. https://doi.org/10.1016/j.intell.2018.06.005 CrossRefGoogle ScholarPubMed
Ghisletta, P., Renaud, O., Fagot, D., Lecerf, T., & de Ribaupierre, A. (2018). Age and sex differences in intra-individual variability in a simple reaction time task. International Journal of Behavior and Development, 42, 294299. https://doi.org/10.1177/0165025417739179 CrossRefGoogle Scholar
Gilbert, J. A. (1894). Researches on the mental and physical development of school-children. In Edward W. Scripture (Ed.), Studies from the Yale psychological laboratory (pp. 40100). Yale University.Google Scholar
Goodenough, F. L. (1935). The development of the reactive process from early childhood to maturity. Journal of Experimental Psychology, 18, 431450. https://doi.org/10.1037/h0062460 CrossRefGoogle Scholar
Heathcote, A., Popiel, S. J., & Mewhort, D. J. K. (1991). Analysis of response time distributions: An example using the Stroop task. Psychological Bulletin, 109, 340347.CrossRefGoogle Scholar
Herman, K. C., & Ostrander, R. (2007). The effects of attention problems on depression: Developmental, academic, and cognitive pathways. School Psychology Quarterly, 22, 483510. https://doi.org/10.1037/1045-3830.22.4.483 CrossRefGoogle Scholar
Huang-Pollock, C. L., Karalunas, S. L., Tam, H., & Moore, A. N. (2012). Evaluating vigilance deficits in ADHD: A meta-analysis of CPT performance. Journal of Abnormal Psychology, 121, 360371. https://doi.org/10.1037/a0027205 CrossRefGoogle ScholarPubMed
Kalb, R., Jansen, S., Reulbach, U., & Kalb, S. (2004). Sex differences in simple reaction tasks. Perceptual Motor Skills, 98, 793802. https://doi.org/10.2466/pms.98.3.793-802 CrossRefGoogle ScholarPubMed
Karalunas, S. L., Hawkey, E., Gustafsson, H., Miller, M., Langhorst, M., Cordova, M., Fair, D., & Nigg, J. T. (2018). Overlapping and distinct cognitive impairments in attention-deficit/hyperactivity and Autism spectrum disorder without intellectual disability. Journal of Abnormal Child Psychology, 46, 17051716. https://doi.org/10.1007/s10802-017-0394-2 CrossRefGoogle ScholarPubMed
Karalunas, S. L., & Huang-Pollock, C. L. (2013). Integrating impairments in reaction time and executive function using a diffusion model framework. Journal of Abnormal Child Psychology, 41, 837850. https://doi.org/10.1007/s10802-013-9715-2 CrossRefGoogle ScholarPubMed
Kieffaber, P. D., Kappenman, E. S., Bodkins, M., Shekhar, A., O’Donnell, B. F., & Hetrick, W. P. (2006). Switch and maintenance of task set in schizophrenia. Schizophrenia Research, 84, 345358. https://doi.org/10.1016/j.schres.2006.01.022 CrossRefGoogle ScholarPubMed
Killeen, P. R. (2013). Absent without leave; a neuroenergetic theory of mind wandering. Frontiers in Psychology, 4, 373. https://doi.org/10.3389/fpsyg.2013.00373 CrossRefGoogle ScholarPubMed
Killeen, P. R. (2019). Models of attention-deficit hyperactivity disorder. Behavioural Processes, 162, 205214. https://doi.org/10.1016/j.beproc.2019.01.001 CrossRefGoogle ScholarPubMed
Klatt, L. I., Schneider, D., Schubert, A. L., Hanenberg, C., Lewald, J., Wascher, E., & Getzmann, S. (2020). Unraveling the relation between EEG correlates of attentional orienting and sound localization performance: A diffusion model approach. Journal of Cognitive Neuroscience, 32, 945962. https://doi.org/10.1101/616573 CrossRefGoogle ScholarPubMed
Klein, C., Wendling, K., Huettner, P., Ruder, H., & Peper, M. (2006). Intra-subject variability in attention-deficit hyperactivity disorder. Biological Psychiatry, 60, 10881097. https://doi.org/10.1016/j.biopsych.2006.04.003 CrossRefGoogle ScholarPubMed
Kofler, M. J., Rapport, M. D., Sarver, D. E., Raiker, J. S., Orban, S. A., Friedman, L. M., & Kolomeyer, E. G. (2013). Reaction time variability in ADHD: A meta-analytic review of 319 studies. Clinical Psychology Review, 33, 795811. https://doi.org/10.1016/j.cpr.2013.06.001 CrossRefGoogle ScholarPubMed
Landauer, A. A., Armstrong, S., & Digwood, J. (1980). Sex difference in choice reaction time. British Journal of Psychology, 71, 551555. https://doi.org/10.1111/j.2044-8295.1980.tb01766.x CrossRefGoogle Scholar
Lerche, V., Neubauer, A. B., & Voss, A. (2018). Effects of implicit fear of failure on cognitive processing: A diffusion model analysis. Motivation and Emotion, 42, 386402. https://doi.org/10.1007/s11031-018-9691-5 CrossRefGoogle Scholar
Lerche, V., Voss, A., & Nagler, M. (2017). How many trials are required for parameter estimation in diffusion modeling? A comparison of different optimization criteria. Behavior Research Methods, 49, 513537. https://doi.org/10.3758/s13428-016-0740-2 CrossRefGoogle ScholarPubMed
Leth-Steenson, C., Elbaz, Z. K., & Douglas, V. I. (2000). Mean response times, variability, and skew in the responding of ADHD children: A response time distributional approach. Acta Psychologica, 104, 167190.CrossRefGoogle Scholar
Lipszyc, J., & Schachar, R. (2010). Inhibitory control and psychopathology: A meta-analysis of studies using the stop signal task. Journal of the International Neuropsychological Society, 16, 10641076. https://doi.org/10.1017/S1355617710000895 CrossRefGoogle ScholarPubMed
Losier, B. J., McGrath, P. J., & Klein, R. M. (1996). Error patterns on the continuous performance test in non-medicated and medicated samples of children with and without ADHD: A meta-analytic review. Journal of Child Psychology & Psychiatry, 37, 971987. https://doi.org/10.1111/j.1469-7610.1996.tb01494.x CrossRefGoogle ScholarPubMed
Lynn, R., & Ja-Song, M. (1993). Sex differences in reaction times, decision times, and movement times in British and Korean children. Journal of Genetic Psychology, 154, 209213. https://doi.org/10.1080/00221325.1993.9914734 CrossRefGoogle ScholarPubMed
MacDonald, S. W., Li, S. C., & Backman, L. (2009). Neural underpinnings of within-person variability in cognitive functioning. Psychology of Aging, 24, 792808. https://doi.org/10.1037/a0017798 CrossRefGoogle ScholarPubMed
Massidda, D. (2013). Reaction Time Analysis. http://www.humandata.it/ Google Scholar
Matzke, D., & Wagenmakers, E. J. (2009). Psychological interpretation of the ex-Gaussian and shifted Wald parameters: A diffusion model analysis. Psychonomic Bulletin and Review, 16, 798817. https://doi.org/10.3758/PBR.16.5.798 CrossRefGoogle ScholarPubMed
Rabiner, D., Coie, J. D., & The Conduct Problems Prevention Research Group. (2000). Early attention problems and children’s reading achievement: A longitudinal investigation. Journal of the American Academy of Child & Adolescent Psychiatry, 39, 859867. https://doi.org/10.1097/00004583-200007000-00014 CrossRefGoogle ScholarPubMed
Racer, K. H., & Dishion, T. J. (2012). Disordered attention: Implications for understanding and treating internalizing and externalizing disorders in childhood. Cognitive Behavioral Practice, 19, 3140. https://doi.org/10.1016/j.cbpra.2010.06.005 CrossRefGoogle ScholarPubMed
Ratcliff, R. (2006). Modeling response signal and response time data. Cognitive Psychology, 53, 195237. https://doi.org/10.1016/j.cogpsych.2005.10.002 CrossRefGoogle ScholarPubMed
Ratcliff, R., & McKoon, G. (2008). The diffusion decision model: Theory and data for two-choice decision tasks. Neural Computation, 20, 873922. https://doi.org/10.1162/neco.2008.12-06-420 CrossRefGoogle ScholarPubMed
Ratcliff, R., & Rouder, J. N. (1998). Modeling response times for two-choice decisions. Psychological Science, 9, 347356.CrossRefGoogle Scholar
Ratcliff, R., & Tuerlinckx, F. (2002). Estimating parameters of the diffusion model: Approaches to dealing with contaminant reaction times and parameter variability. Psychonomics Bulletin Reviews, 9, 438481. https://www.ncbi.nlm.nih.gov/pubmed/12412886 CrossRefGoogle ScholarPubMed
Reed, T. E., Vernon, P. A., & Johnson, A. M. (2004). Sex difference in brain nerve conduction velocity in normal humans. Neuropsychologia, 42, 17091714. https://doi.org/10.1016/j.neuropsychologia.2004.02.016 CrossRefGoogle ScholarPubMed
Rieger, T., & Miller, J. (2020). Are model parameters linked to processing stages? An empirical investigation for the ex-Gaussian, ex-Wald, and EZ diffusion models. Psychological Research, 84, 16831699. https://doi.org/10.1007/s00426-019-01176-4 CrossRefGoogle ScholarPubMed
Rosenberg, M., Noonan, S., DeGutis, J., & Esterman, M. (2013). Sustaining visual attention in the face of distraction: A novel gradual-onset continuous performance task. Attention Perception & Psychophysiology, 75, 426439. https://doi.org/10.3758/s13414-012-0413-x CrossRefGoogle ScholarPubMed
Schwartz, F., Carr, A. C., Munich, R. L., Glauber, S., Lesser, B., & Murray, J. (1989). Reaction time impairment in schizophrenia and affective illness: The role of attention. Biological Psychiatry, 25, 540548. https://doi.org/10.1016/0006-3223(89)90214-x CrossRefGoogle ScholarPubMed
Segalowitz, S. J., Dywan, J., & Unsal, A. (1997). Attentional factors in response time variability after traumatic brain injury: An ERP study. Journal of the International Neuropsychological Society, 3, 95107. https://www.ncbi.nlm.nih.gov/pubmed/9126851 CrossRefGoogle ScholarPubMed
Silverman, I. W. (2006). Sex differences in simple visual reaction time: A historical meta-analysis. Sex Roles, 54, 5768. https://doi.org/10.1007/s11199-006-8869-6 CrossRefGoogle Scholar
Sjowall, D., Bohlin, G., Rydell, A. M., & Thorell, L. B. (2017). Neuropsychological deficits in preschool as predictors of ADHD symptoms and academic achievement in late adolescence. Child Neuropsychology, 23, 111128. https://doi.org/10.1080/09297049.2015.1063595 CrossRefGoogle ScholarPubMed
Stuss, D. T., Pogue, J., Buckle, L., & Bondar, J. (1994). Characterization of stability of performance in patients with traumatic brain injury: Variability and consistency on reaction time tests. Neuropsychology, 8, 316324. https://doi.org/10.1037/0894-4105.8.3.316 CrossRefGoogle Scholar
Swick, D., Honzel, N., Larsen, J., & Ashley, V. (2013). Increased response variability as a marker of executive dysfunction in veterans with post-traumatic stress disorder. Neuropsychologia, 51, 30333040. https://doi.org/10.1016/j.neuropsychologia.2013.10.008 CrossRefGoogle ScholarPubMed
Sykes, D. H., Douglas, V. I., & Morgenstern, G. (1973). Sustained attention in hyperactive children. Journal of Child Psychology and Psychiatry, 14, 213220.CrossRefGoogle ScholarPubMed
Tamm, L., Epstein, J. N., & Becker, S. P. (2019). A preliminary investigation of reaction time variability in relation to social functioning in children evaluated for ADHD. Child Neuropsychology, 25, 885898. https://doi.org/10.1080/09297049.2018.1523379 CrossRefGoogle ScholarPubMed
Tamm, L., Epstein, J. N., Denton, C. A., Vaughn, A. J., Peugh, J., & Willcutt, E. G. (2014). Reaction time variability associated with reading skills in poor readers with ADHD. Journal of the International Neuropsychological Society, 20, 292301. https://doi.org/10.1017/S1355617713001495 CrossRefGoogle ScholarPubMed
Tamm, L., Narad, M. E., Antonini, T. N., O’Brien, K. M., Hawk, L. W. Jr., & Epstein, J. N. (2012). Reaction time variability in ADHD: A review. Neurotherapeutics, 9, 500508. https://doi.org/10.1007/s13311-012-0138-5 CrossRefGoogle ScholarPubMed
Tinius, T. P. (2003). The integrated visual and auditory continuous performance test as a neuropsychological measure. Archives of Clinical Neuropsychology, 18, 439454. https://doi.org/10.1093/arclin/18.5.439 CrossRefGoogle ScholarPubMed
Unsworth, N., Redick, T. S., Lakey, C. E., & Young, D. L. (2010). Lapses in sustained attention and their relation to executive control and fluid abilities: An individual differences investigation. Intelligence, 38, 111122. https://doi.org/10.1016/j.intell.2009.08.002 CrossRefGoogle Scholar
Unsworth, N., & Robison, M. K. (2020). Working memory capacity and sustained attention: A cognitive-energetic perspective. Journal of Experimental Psychology: Learning, Memory, and Cognition, 46, 77103. https://doi.org/10.1037/xlm0000712 Google ScholarPubMed
van Lieshout, M., Luman, M., Twisk, J. W., Faraone, S. V., Heslenfeld, D. J., Hartman, C. A., Hoekstra, P. J., Franke, B., Buitelaar, J. K., Rommelse, N. N., & Oosterlaan, J. (2017). Neurocognitive predictors of ADHD outcome: A 6-year follow-up study. Journal of Abnormal Child Psychology, 45, 261272. https://doi.org/10.1007/s10802-016-0175-3 CrossRefGoogle ScholarPubMed
Van Zandt, T. (2000). How to fit a response time distribution. Psychonomic Bulletin Reviews, 7, 424465.CrossRefGoogle Scholar
Verbruggen, F., Aron, A. R., Band, G. P., Beste, C., Bissett, P. G., Brockett, A. T., Chamberlain, S. R., Chambers, C. D., Colonius, H., Colzato, L. S., Corneil, B. D., Coxon, J. P., Dupuis, A., Eagle, D. M., Garavan, H., Greenhouse, I., Heathcote, A., Huster, R. J., Jahfari, S., … Boehler, C. N. (2019). A consensus guide to capturing the ability to inhibit actions and impulsive behaviors in the stop-signal task. Elife, 8, e46323.CrossRefGoogle ScholarPubMed
Verte, S., Geurts, H. M., Roeyers, H., Oosterlaan, J., Sergeant, J. A., Verte, S., Geurts, H. M., Roeyers, H., Oosterlaan, J., & Sergeant, J. A. (2005). Executive functioning in children with autism and Tourette syndrome. Development & Psychopathology, 17, 415445.CrossRefGoogle ScholarPubMed
Voss, A., Nagler, M., & Lerche, V. (2013). Diffusion models in experimental psychology: A practical introduction. Experimental Psychology, 60, 385402. https://doi.org/10.1027/1618-3169/a000218 CrossRefGoogle ScholarPubMed
Voss, A., Rothermund, K., & Voss, J. (2004). Interpreting the parameters of the diffusion model: An empirical validation. Memory and Cognition, 32, 12061220. https://www.ncbi.nlm.nih.gov/pubmed/15813501 CrossRefGoogle Scholar
Voss, A., & Voss, J. (2007). Fast-dm: A free program for efficient diffusion model analysis. Behavior Research Methods, 39, 767775. https://www.ncbi.nlm.nih.gov/pubmed/18183889 CrossRefGoogle ScholarPubMed
Weigard, A., Clark, D. A., & Sripada, C. (2021). Cognitive efficiency beats top-down control as a reliable individual difference dimension relevant to self-control. Cognition, 215, 104818. https://doi.org/10.1016/j.cognition.2021.104818 CrossRefGoogle ScholarPubMed
Weigard, A., Huang-Pollock, C., Brown, S., & Heathcote, A. (2018). Testing formal predictions of neuroscientific theories of ADHD with a cognitive model-based approach. Journal of Abnormal Psychology, 127, 529539. https://doi.org/10.1037/abn0000357 CrossRefGoogle ScholarPubMed
Weigard, A., Matzke, D., Tanis, C., & Heathcote, A. (2021). Cognitive process modeling addresses context independence violations in the ABCD Study stop-signal task. bioRxiv.CrossRefGoogle Scholar
Weigard, A., & Sripada, C. (2021). Task-general efficiency of evidence accumulation as a computationally-defined neurocognitive trait: Implications for clinical neuroscience. Biological Psychiatry Global Open Science, 1, 515. https://doi.org/10.1016/j.bpsgos.2021.02.001 CrossRefGoogle ScholarPubMed
White, C. N., Ratcliff, R., Vasey, M. W., & McKoon, G. (2010). Using diffusion models to understand clinical disorders. Journal of Mathematical Psychology, 54, 3952. https://doi.org/10.1016/j.jmp.2010.01.004 CrossRefGoogle ScholarPubMed
White, C. N., Servant, M., & Logan, G. D. (2018). Testing the validity of conflict drift-diffusion models for use in estimating cognitive processes: A parameter-recovery study. Psychonomic Bulletin & Review, 25, 286301.CrossRefGoogle ScholarPubMed
Whyte, J., Polansky, M., Fleming, M., Coslett, H. B., & Cavallucci, C. (1995). Sustained arousal and attention after traumatic brain injury. Neuropsychologia, 33, 797813. https://doi.org/10.1016/0028-3932(95)00029-3 CrossRefGoogle ScholarPubMed
Wiecki, T. V., Poland, J., & Frank, M. J. (2015). Model-based cognitive neuroscience approaches to computational psychiatry: Clustering and classification. Clinical Psychological Science, 3, 378399. https://doi.org/10.1177/2167702614565359 CrossRefGoogle Scholar
Williams, B. R., Ponesse, J. S., Schachar, R. J., Logan, G. D., & Tannock, R. (1999). Development of inhibitory control across the life span. Developmental Psychology, 35, 205213. https://doi.org/10.1037//0012-1649.35.1.205 CrossRefGoogle ScholarPubMed
Xu, J., Hao, L., Chen, M., He, Y., Jiang, M., Tian, T., Wang, H., Wang, Y., Wang, D., Han, Z. R., Tan, S., Men, W., Gao, J., He, Y., Tao, S., Dong, Q., & Qin, S. (2021). Developmental sex differences in negative emotion decision-making dynamics: Computational evidence and amygdala-prefrontal pathways. Cerebral Cortex, 32, 2478–2491. https://doi.org/10.1093/cercor/bhab359 Google Scholar
Figure 0

Table 1. Descriptive statistics

Figure 1

Table 2. Intercorrelations between RTV and SST performance indices

Figure 2

Table 3. Performance across SST runs

Figure 3

Table 4. Performance across SST blocks

Figure 4

Figure 1. Performance across SST blocks. Shaded areas reflect 95% confidence interval. Note. RTSD = standard deviation of reaction time, CV = coefficient of variation.

Figure 5

Table 5. Sex differences

Supplementary material: File

Epstein et al. supplementary material

Epstein et al. supplementary material
Download Epstein et al. supplementary material(File)
File 3.5 MB