Hostname: page-component-78c5997874-8bhkd Total loading time: 0 Render date: 2024-11-10T17:18:11.289Z Has data issue: false hasContentIssue false
  • English
  • Français

Is the behavior rating inventory of executive function more strongly associated with measures of impairment or executive function?

Published online by Cambridge University Press:  01 March 2010

TARA MCAULEY ,
SHIRLEY CHEN ,
LISA GOOS ,
RUSSELL SCHACHAR  and
JENNIFER CROSBIE
TARA MCAULEY*
Affiliation:
Department of Psychiatry Research, The Hospital for Sick Children, Toronto, Ontario, Canada
SHIRLEY CHEN
Affiliation:
Department of Psychiatry Research, The Hospital for Sick Children, Toronto, Ontario, Canada
LISA GOOS
Affiliation:
Department of Psychiatry Research, The Hospital for Sick Children, Toronto, Ontario, Canada
RUSSELL SCHACHAR
Affiliation:
Department of Psychiatry Research, The Hospital for Sick Children, Toronto, Ontario, Canada
JENNIFER CROSBIE
Affiliation:
Department of Psychiatry Research, The Hospital for Sick Children, Toronto, Ontario, Canada
*
*Correspondence and reprint requests to: Tara McAuley, PhD, Department of Psychiatry Research, The Hospital for Sick Children, 555 University Avenue, Toronto, Ontario, Canada M5G 1X8. E-mail: tara.mcauley@sickkids.ca
Get access Rights & Permissions [Opens in a new window]

Abstract

The Behavior Rating Inventory of Executive Function (BRIEF) is commonly used in the assessment of children and adolescents presenting with a wide range of concerns. It is unclear, however, whether the questionnaire is more closely related to general measures of behavioral disruption and impairment or to specific measures of executive function. In the present study, associations between the Behavioral Regulation Index and Metacognition Index of the BRIEF and cognitive, behavioral, and academic measures were examined in a sample of clinic-referred youth (n = 60) and healthy youth (n = 37) 6–15 years of age. Measures included ratings of inattentive and hyperactive-impulsive symptoms in youth, ratings of how well youth functioned in their everyday environments, youth’s scores on measures of reading and math, and youth’s scores on measures of inhibition, performance monitoring, and working memory. Although both BRIEF indices were strongly related to parent and teacher ratings of behavioral disruption and impairment, neither was associated with youth’s scores on the performance-based tasks of executive function. These findings support the use of the BRIEF as a clinical tool for assessing a broad range of concerns, but raise questions about the relation of the BRIEF to performance-based tasks that are commonly used to assess executive function. (JINS, 2010, 16, 495–505.)

Keywords

BRIEFAssessmentBehaviorImpairmentChildrenAdolescents
Type
Research Articles
Information
Journal of the International Neuropsychological Society , Volume 16 , Issue 3 , May 2010 , pp. 495 - 505
Copyright
Copyright © The International Neuropsychological Society 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders - 4th ed. Washington, DC: American Psychiatric Association.Google Scholar
Anderson, V.A., Anderson, P., Northam, E., Jacobs, R., & Mikiewicz, O. (2002). Relationships between cognitive and behavioral measures of executive function in children with brain disease. Child Neuropsychology, 8, 231–240.CrossRefGoogle ScholarPubMed
Barkley, R.A. (1997). Behavioral inhibition, sustained attention, and executive functions: Constructing a unifying theory of ADHD. Psychological Bulletin, 121, 65–94.CrossRefGoogle ScholarPubMed
Biederman, J., Monuteaux, M.C., Doyle, A.E., Seidman, L.J., Wilens, T.E., Ferrero, F., et al. . (2004). Impact of executive function deficits and attention-deficit/hyperactivity disorder (ADHD) on academic outcomes in children. Journal of Consulting and Clinical Psychology, 72, 757–766.CrossRefGoogle ScholarPubMed
Bjorklund, D.F., & Douglas, R.N. (1997). The development of memory strategies. In Cowan, N. (Ed.), The development of memory in childhood. Studies in developmental psychology (pp. 201–246). Hove, England: Psychology Press.Google Scholar
Blair, C., & Peters, R. (2003). Physiological and neurocognitive correlates of adaptive behavior in preschool among children in Head Start. Developmental Neuropsychology, 24, 479–497.CrossRefGoogle ScholarPubMed
Bodnar, L.E., Prahme, M.C., Cutting, L.E., Denckla, M.B., & Mahone, E.M. (2006). Construct validity of parent ratings of inhibitory control. Child Neuropsychology, 13, 345–362.CrossRefGoogle Scholar
Boyle, M.H., Offord, D.R., Hofman, H.G., Catlin, G.P., Byles, J.A., Cadman, D.T., et al. . (1987). Ontario Child Health Study, I: Methodology. Archives of General Psychiatry, 44, 826–831.CrossRefGoogle ScholarPubMed
Brown, T.M., Ris, M.D., Beebe, D., Ammerman, R.T., Oppenheimer, S.G., Yeates, K.O., & Enrile, B.D. (2008). Factors of biological risk and reserve associated with executive behaviors in children and adolescents with spina bifida myelomeningocele. Child Neuropsychology, 14, 118–134.CrossRefGoogle ScholarPubMed
Burgess, P.W. (1997). Theory and methodology in executive function and research. In Rabbitt, P. (Ed.), Methodology of frontal and executive function (pp. 81–116). Hove, England: Psychology Press.Google Scholar
Burmeister, R., Hannay, H.J., Copeland, K., Fletcher, J.M., Boudousquie, A., & Dennis, M. (2005). Attention problems and executive functions in children with spina bifida and hydrocephalus. Child Neuropsychology, 11, 265–283.CrossRefGoogle ScholarPubMed
Conklin, H.M., Salorio, C.F., & Slomine, S.F. (2008). Working memory performance following pediatric traumatic brain injury. Brain Injury, 22, 847–857.CrossRefGoogle Scholar
Conners, K. (2001a). Conners’ parent rating scale – Revised:long. Toronto, ON: Multi-Health Systems Inc.Google Scholar
Conners, K. (2001b). Conners’ teacher rating scale – Revised:long. Toronto, ON: Multi-Health Systems Inc.Google Scholar
Conners, K. (2001c). Conners’ rating scales-revised. Technical manual. Toronto, ON: Multi-Health Systems Inc.Google Scholar
Drewe, E.A. (1974). The effect of type and area of brain lesion on Wisconsin Card Sorting Test performance. Cortex, 10, 159–170.CrossRefGoogle ScholarPubMed
Diamantopoulou, S., Rydell, A.M., Thorell, L.B., & Bohlin, G. (2007). Impact of executive functioning and symptoms of attention deficit hyperactivity disorder on children’s peer relations and school performance. Developmental Neuropsychology, 32, 521–542.CrossRefGoogle ScholarPubMed
Gathercole, S.E., & Pickering, S.J. (2000). Working memory deficits in children with low achievements in the national curriculum at 7 years of age. British Journal of Educational Psychology, 70, 177–194.CrossRefGoogle ScholarPubMed
Gilotty, L., Kenworthy, L., Sirian, L., Black, D.O., & Wagner, A.E. (2002). Adaptive skills and executive function in autism spectrum disorders. Child Neuropsychology, 8, 241–248.CrossRefGoogle ScholarPubMed
Gioia, G.A., Isquith, P.K., Guy, S.C., & Kenworthy, L. (2000a). The behavior rating inventory of executive function. Lutz, FL: Psychological Assessment Resources.Google Scholar
Gioia, G.A., Isquith, P.K., Guy, S.C., & Kenworthy, L. (2000b). The behavior rating inventory of executive function. Professional manual. Lutz, FL: Psychological Assessment Resources.Google Scholar
Huizinga, M., Dolan, C.V., & van der Molen, M.W. (2006). Age-related change in executive function: Developmental trends and a latent variables analysis. Neuropsychologia, 44, 2017–2036.CrossRefGoogle Scholar
Ickowicz, A., Schachar, R., Sugarman, R., Chen, S., Millette, C., & Cook, L. (2006). The parent interview for child symptoms (PICS): A situation-specific clinical research interview for attention deficit hyperactivity and related disorders. Canadian Journal of Psychiatry, 50, 325–328.CrossRefGoogle Scholar
Isquith, P.K., & Gioia, G.A. (2000). BRIEF predictions of ADHD: Clinical utility of the behavior rating inventory of executive function for detecting ADHD subtypes in children. Archives of Clinical Neuropsychology, 15, 780–781.CrossRefGoogle Scholar
Jarvis, H.L., & Gathercole, S.E. (2003). Verbal and non-verbal working memory and achievements on National Curriculum tests at 11 and 14 years of age. Educational and Child Psychology, 20, 123–140.CrossRefGoogle Scholar
Lezak, M.D. (1995). Neuropsychological assessment. New York, NY: Oxford University Press.Google Scholar
Lijffijt, M., Kenemans, J.L., Verbaten, M.N., & van Engeland, H. (2005). A meta-analytic review of stopping performance in attention-deficit/hyperactivity disorder: Deficient inhibitory motor control? Journal of Abnormal Psychology, 114, 216–222.CrossRefGoogle ScholarPubMed
Lindsay, J.H., Offord, D.R., Boyle, M.H., & Racine, Y.A. (1995). Factors predicting use of mental health and social services by children 6–16 years old: Findings from the Ontario Child Health Study. American Journal of Orthopsychiatry, 65, 76–86.Google Scholar
Logan, G.D., & Cowan, W.B. (1994). On the ability to inhibit thought and action: A theory of an act of control. Psychological Review, 91, 295–327.CrossRefGoogle Scholar
Mahone, M.E., Cirino, P.T., Cutting, L.E., Cerrone, P.M., Hagelthorn, K.M., Hiemenz, J.R., et al. . (2002). Validity of the behavior rating inventory of executive function in children with ADHD and/or Tourette syndrome. Archives of Clinical Neuropsychology, 17, 643–662.CrossRefGoogle ScholarPubMed
Mahone, M.E., Martin, R., Kates, W., Hay, T., & Horska, A. (2009). Neuroimaging correlates of parent ratings of working memory in children. Journal of the International Neuropsychological Society, 15, 31–41.CrossRefGoogle Scholar
Mahone, M.E., Zabel, T.A., Levey, E., Verda, M., & Kinsman, S. (2002). Parent and self-report ratings of executive function in adolescents with myelomeningocele and hydrocephalus. Child Neuropsychology, 8, 258–270.CrossRefGoogle ScholarPubMed
Mangeot, S., Armstrong, K., Colvin, A.N., Yeates, K.O., & Taylor, G.H. (2002). Long-term executive function deficits in children with traumatic brain injuries: Assessment using the Behavior Rating Inventory of Executive Function (BRIEF). Child Neuropsychology, 8, 271–284.CrossRefGoogle ScholarPubMed
Marsh, H.W., & Grayson, D. (1995). Latent variable models of multitrait-multimethod data. In Hoyle, R.H. (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 177–198). Thousand Oaks, CA: Sage Publications, Inc.Google Scholar
McCandless, S., & O’Laughlin, L. (2007). The clinical utility of the Behavior Rating Inventory of Executive Function (BRIEF) in the Diagnosis of ADHD. Journal of Attention Disorders, 10, 381–389.CrossRefGoogle ScholarPubMed
McClelland, M.M., Cameron, C.E., Connor, C.M., Farris, C.L., Jewkes, A.M., & Morrison, F.J. (2007). Links between behavioral regulation and preschoolers’ literacy, vocabulary, and math skills. Developmental Psychology, 43, 947–959.CrossRefGoogle ScholarPubMed
Miyake, A., Friedman, N.P., Emerson, M.J., Witzki, A.H., & Howerter, A. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41, 49–100.CrossRefGoogle ScholarPubMed
Newman, S.D., Carpenter, P.A., Varma, S., & Just, M.A. (2003). Frontal and parietal participation in problem solving in the Tower of London: fMRI and computational modeling of planning and high-level perception. Neuropsychologia, 41, 1668–1682.CrossRefGoogle Scholar
Niendam, T., Horwitz, J., Bearden, C., & Cannon, T. (2007). Ecological assessment of executive dysfunction in the psychosis prodrome: A pilot study. Schizophrenia Research, 93, 350–354.CrossRefGoogle ScholarPubMed
Oosterlaan, J., Logan, G.D., & Sergeant, J. (1998). Response Inhibition in AD/HD, CD, Comorbid AD/HD+CD, Anxious, and control children: A meta-analysis of studies with the stop task. Journal of Child Psychology and Psychiatry, 39, 411–425.Google ScholarPubMed
Owen, A.M., McMillan, K.M., Laird, A.R., & Bullmore, E. (2005). N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies. Human Brain Mapping, 25, 46–59.CrossRefGoogle ScholarPubMed
Parrish, J., Geary, E., Jones, J., Seth, R., Hermann, B., & Seidenberg, M. (2007). Executive functioning in childhood epilepsy: Parent report and cognitive assessment. Developmental Medicine & Child Neurology, 49, 412–416.CrossRefGoogle ScholarPubMed
Pennington, B.F., & Ozonoff, S. (1996). Executive functions and developmental psychobehavioral disruption. Journal of Child Psychology and Psychiatry, 37, 51–87.CrossRefGoogle Scholar
Riccio, C.A., Homack, S., Pizzitola Jarratt, K., & Wolfe, M.E. (2006). Differences in academic and executive function domains among children with ADHD Predominantly Inattentive and Combined Types. Archives of Clinical Neuropsychology, 21, 657–667.CrossRefGoogle ScholarPubMed
Ridderinkhof, K.R., van den Wildenberg, W.P.M., Segalowitz, S.J., & Carter, C.S. (2004). Neurocognitive mechanisms of cognitive control: The role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning. Brain and Cognition, 56, 129–140.CrossRefGoogle ScholarPubMed
Riggs, N.R., Jahromi, L.B., Razza, R.P., Dillworth-Bart, J.E., & Mueller, U. (2006). Executive function and the promotion of social-emotional competence. Journal of Applied Developmental Psychology, 27, 300–309.CrossRefGoogle Scholar
Romine, C.B., & Reynolds, C.R. (2005). A model of the development of frontal lobe functioning: Findings from a meta-analysis. Applied Neuropsychology, 12, 190–201.CrossRefGoogle Scholar
Russo, N., Flanagan, T., Iarocci, G., Berringer, D., Zelazo, P.D., & Burack, J.A. (2007). Deconstructing executive deficits among persons with autism: Implications for cognitive neuroscience. Brain and Cognition, 65, 77–86.CrossRefGoogle ScholarPubMed
Sanford, M.N., Offord, D.R., Boyle, M.H., Peace, A., & Racine, Y.A. (1992). Ontario child health study: Social and school impairments in children aged 6 to 16 years. Journal of the American Academy of Child and Adolescent Psychiatry, 31, 60–67.CrossRefGoogle ScholarPubMed
Schachar, R.J., Chen, S., Logan, G.D., Ornstein, T.J., Crosbie, J., Ickowicz, A., et al. . (2004). Evidence for an error monitoring deficit in attention deficit hyperactivity disorder. Journal of Abnormal Child Psychology, 32, 285–293.CrossRefGoogle ScholarPubMed
Schlagmüller, M., & Schneider, W. (2002). The development of organizational strategies in children: Evidence from a microgenetic longitudinal study. Journal of Experimental Child Psychology, 81, 298–319.CrossRefGoogle ScholarPubMed
Shallice, T. (1982). Specific impairments in planning. Philosophical Transcripts of the Royal Society of London, 298, 199–209.Google ScholarPubMed
Smith, A.B., Taylor, E., Brammer, M., & Rubia, K. (2004). Neural correlates of switching set as measured in fast, event-related functional magnetic resonance imaging. Human Brain Mapping, 21, 247–256.CrossRefGoogle ScholarPubMed
St. Clair-Thompson, H.L., & Gathercole, S.E. (2006). Executive functions and achievements in school: Shifting, updating, inhibition, and working memory. Quarterly Journal of Experimental Psychology, 59, 745–759.CrossRefGoogle ScholarPubMed
Sullivan, J.R., & Riccio, C.A. (2006). An empirical analysis of the BASC Frontal Lobe / Executive Control scale with a clinical sample. Archives of Clinical Neuropsychology, 21, 495–501.CrossRefGoogle ScholarPubMed
Tannock, R., Hum, M., Masellis, M., Humphries, T., & Schachar, R. (2002). Teacher telephone interview for children’s academic performance, attention, behavior, and learning: DSM-IV version (TTI-IV). Toronto, ON: The Hospital for Sick Children. Unpublished document.Google Scholar
Toplack, M.E., Bucciarelli, S.M., Jain, U., & Tannock, R. (2009). Executive functions: Performance based measures and the Behavior Rating Inventory of Executive Function (BRIEF) in adolescents with Attention Deficit/Hyperactivity Disorder (ADHD). Child Neuropsychology, 15, 53–72.CrossRefGoogle Scholar
Vriezen, E.R., & Pigott, S.E. (2002). The relationship between parental report on the BRIEF and performance-based tasks of executive function in children with moderate to severe traumatic brain injury. Child Neuropsychology, 8, 296–303.CrossRefGoogle Scholar
Waber, D.P., Gerber, E.B., Turcios, V.Y., Forbes, P.W., & Wagner, E.R. (2006). Executive functions and performance on high-stakes testing in children from urban schools. Developmental Neuropsychology, 29, 459–477.CrossRefGoogle ScholarPubMed
Wechsler, D. (1991). Wechsler intelligence scale for children. 3rd ed.San Antonio, TX: Harcourt Assessment.Google Scholar
Wechsler, D. (2003). Wechsler intelligence scale for children. 4th ed.San Antonio, TX: Harcourt Assessment.Google Scholar
Welsh, M. (2002). Developmental and clinical variations in executive functions. In Molfese, D.L. & Molfese, V. (Eds.), Developmental variations in learning: Applications to social, executive function, language, and reading skills (pp. 139–185). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.Google Scholar
Wilkinson, G.S. (1993a). Wide range achievement test 3. Wilmington, DE: Wide Range Inc.Google Scholar
Wilkinson, G.S. (1993b). Wide range achievement test 3. Administration manual. Wilmington, DE: Wide Range Inc.Google Scholar
Willcutt, E.G., Doyle, A.E., Nigg, J.T., Faraone, S.V., & Pennington, B.F. (2005). Validity of the executive function theory of attention-deficit/hyperactivity disorder: A meta-analytic review. Biological Psychiatry, 57, 1336–1346.CrossRefGoogle ScholarPubMed