Hostname: page-component-54dcc4c588-xh45t Total loading time: 0 Render date: 2025-10-07T15:00:06.939Z Has data issue: false hasContentIssue false

The (mis)measure of misbehavior: Cross-national invariance of the Youth Externalizing Problems Screener across 32 countries

Published online by Cambridge University Press:  07 October 2025

Milica Lazić*
Affiliation:
Department of Psychology, Faculty of Philosophy, University of Novi Sad, Novi Sad, Serbia
Sabirah Adams
Affiliation:
University of Cape Town, Cape Town, South Africa
Rebeca Aritio-Solana
Affiliation:
Educational Sciences Department, University of La Rioja, Logroño, Spain
Christ Billy Aryanto
Affiliation:
Faculty of Psychology, Atma Jaya Catholic University of Indonesia, Jakarta, Indonesia
Andreja Avsec
Affiliation:
Department of Psychology, Faculty of Arts, University of Ljubljana, Ljubljana, Slovenia
Ali Bakhshi
Affiliation:
State Welfare Organization of Iran, Tehran, Iran
Michael Bender
Affiliation:
Department of Social Psychology, Tilburg University, Tilburg, the Netherlands
Sophie Berjot
Affiliation:
Université de Reims Champagne-Ardenne, C2S, Reims, France
Sonia Betancourth Zambrano
Affiliation:
Teacher University of Nariño, Pasto, Nariño, Colombia
Andreja Brajša-Žganec
Affiliation:
Institute of Social Sciences Ivo Pilar, Zagreb, Croatia
Yunier Broche-Pérez
Affiliation:
Prisma Behavioral Center, West Palm Beach, FL, USA
Carmen Buzea
Affiliation:
Department of Social Sciences and Communication, Faculty of Sociology and Communication, Transilvania University of Brasov, Brasov, Romania
Rosario Cabello
Affiliation:
Department of Developmental and Educational Psychology, Faculty of Psychology, University of Málaga, Málaga, Spain
Valentina Carreca
Affiliation:
Department of Education Sciences, Psychology, Communication, University of Bari Aldo Moro, Bari, Italy
Rosalinda Cassibba
Affiliation:
Department of Education Sciences, Psychology, Communication, University of Bari Aldo Moro, Bari, Italy
Judith Cavazos-Arroyo
Affiliation:
Centro Interdisciplinario de Posgrados, Universidad Popular Autónoma del Estado de Puebla, Puebla, México
Fatemeh Daemi
Affiliation:
Department of Psychology, Islamic Azad University, Central Tehran Branch, Tehran, Iran
Diego D. Díaz-Guerra
Affiliation:
Psychology Department, Universidad Central Marta Abreu de Las Villas, Villa Clara, Cuba
Marija Džida
Affiliation:
Institute of Social Sciences Ivo Pilar, Zagreb, Croatia
Mona Eidelsburger
Affiliation:
Department of Psychology, Leopold Franzens University, Innsbruck, Austria
Pablo Fernández-Berrocal
Affiliation:
Department of Basic Psychology, Faculty of Psychology, University of Málaga, Málaga, Spain
Evelyn Fernández-Castillo
Affiliation:
Psychology Department, Universidad Central Marta Abreu de Las Villas, Villa Clara, Cuba
Eduardo Fonseca-Pedrero
Affiliation:
Educational Sciences Department, University of La Rioja, Logroño, Spain
Tomasz Frackowiak
Affiliation:
Institute of Psychology, University of Wroclaw, Wroclaw, Poland
Teresa Freire
Affiliation:
Psychology Research Center, School of Psychology, University of Minho, Braga, Portugal
Vesna Gavrilov-Jerković
Affiliation:
Department of Psychology, Faculty of Philosophy, University of Novi Sad, Novi Sad, Serbia
Biljana Gjoneska
Affiliation:
Macedonian Academy of Sciences and Arts, Skopje, North Macedonia
Jesús Guerrero-Alcedo
Affiliation:
Carrera de Psicología, Facultad de Ciencias de la Salud, Universidad Científica del Sur, Lima, Perú
Md Jamil Hossain
Affiliation:
Department of Public Health and Informatics, Jahangirnagar University, Savar, Dhaka, Bangladesh
Jessie Hillekens
Affiliation:
Department of Developmental Psychology, Tilburg University, Tilburg, the Netherlands
Stefan Höfer
Affiliation:
Department of Psychiatry II, Medical University of Innsbruck, Innsbruck, Austria
Tareq Mahmud
Affiliation:
Department of Public Health and Informatics, Jahangirnagar University, Savar, Dhaka, Bangladesh
Naved Iqbal
Affiliation:
Department of Psychology, Jamia Millia Islamia, New Delhi, India
Szilvia Jámbori
Affiliation:
Department of Developmental Psychology, Institute of Psychology, University of Szeged, Szeged, Hungary
Mohsen Joshanloo
Affiliation:
Department of Psychology, Keimyung University, Daegu, South Korea
Ljiljana Kaliterna Lipovčan
Affiliation:
Institute of Social Sciences Ivo Pilar, Zagreb, Croatia
Tina Kavčič
Affiliation:
Department of Psychology, Faculty of Arts, University of Ljubljana, Ljubljana, Slovenia Faculty of Health Sciences, University of Ljubljana, Ljubljana, Slovenia
Marta Kowal
Affiliation:
IDN Being Human Lab - Institute of Psychology, University of Wroclaw, Wroclaw, Poland
Marija Krstevska Taseva
Affiliation:
Association Center for Intercultural Dialogue, Kumanovo, North Macedonia
Kwok Kit Tong
Affiliation:
Department of Psychology, University of Macau, Macau, China
Denisse Manrique-Millones
Affiliation:
Carrera de Psicología, Facultad de Ciencias de la Salud, Universidad Científica del Sur, Lima, Perú
Michal Misiak
Affiliation:
IDN Being Human Lab - Institute of Psychology, University of Wroclaw, Wroclaw, Poland School of Anthropology & Museum Ethnography, University of Oxford, Oxford, UK
Pasquale Musso
Affiliation:
Department of Education Sciences, Psychology, Communication, University of Bari Aldo Moro, Bari, Italy
Vojana Obradović
Affiliation:
Department of Psychology, Faculty of Philosophy, University of Novi Sad, Novi Sad, Serbia
Javier Ortuño-Sierra
Affiliation:
Educational Sciences Department, University of La Rioja, Logroño, Spain
Ioana Orzea
Affiliation:
National College Radu Negru, Fagaras, Romania
Ahmet Özaslan
Affiliation:
Child and Adolescent Psychiatry Department, Gazi University, Ankara, Turkey Psychology Research Center, Khazar University, Baku, Azerbaijan
Joonha Park
Affiliation:
Graduate School of Education, Kyoto University, Kyoto, Japan
Marija Pašić
Affiliation:
Institute of Public Health of Montenegro, Podgorica, Montenegro
Rasa Pilkauskaitė Valickienė
Affiliation:
Institute of Psychology, Faculty of Human and Social Studies, Mykolas Romeris University, Vilnius, Lithuania
Rogelio Puente-Díaz
Affiliation:
School of Business and Economics, Universidad Anáhuac México, Huixquilucan, Estado de Mexico, Mexico
Lizbeth Puerta-Sierra
Affiliation:
School of Business and Economics, Universidad Anáhuac México, Huixquilucan, Estado de Mexico, Mexico
Gordana Ristevska Dimitrovska
Affiliation:
Higher Medical School, University St Kliment Ohridski Bitola, Bitola, North Macedonia
S. Craig Roberts
Affiliation:
IDN Being Human Lab - Institute of Psychology, University of Wroclaw, Wroclaw, Poland Division of Psychology, University of Stirling, Stirling, UK
Puji Tania Ronauli
Affiliation:
Faculty of Psychology, Atma Jaya Catholic University of Indonesia, Jakarta, Indonesia
Shazly Savahl
Affiliation:
University of Cape Town, Cape Town, South Africa
Danielius Serapinas
Affiliation:
Institute of Psychology, Faculty of Human and Social Studies, Mykolas Romeris University, Vilnius, Lithuania Department of Family Medicine, Faculty of Medicine, Lithuanian University of Health Sciences, Kaunas, Lithuania
Sok Ian Kuan
Affiliation:
Department of Psychology, University of Macau, Macau, China
Agnieszka Sorokowska
Affiliation:
Institute of Psychology, University of Wroclaw, Wroclaw, Poland
Piotr Sorokowski
Affiliation:
Institute of Psychology, University of Wroclaw, Wroclaw, Poland
Dijana Sulejmanović
Affiliation:
Islamic Pedagogic Faculty, University of Bihać, Bihać, Bosnia and Herzegovina
Mst Sadia Sultana
Affiliation:
Department of Health Society and Behavior, UC Irvine Joe C Wen School of Population and Public Health, Irvine, USA
Sze Man Yuen
Affiliation:
Department of Curriculum, Teaching, and Learning, University of Toronto, Toronto, Canada
Erzsébet Szél
Affiliation:
Department of Developmental Psychology, Institute of Psychology, University of Szeged, Szeged, Hungary
Dušana Šakan
Affiliation:
Department of Business Psychology, Faculty of Law and Business Studies dr Lazar Vrkatić, Union University Belgrade, Novi Sad, Serbia
Henri Tilga
Affiliation:
Institute of Sport Sciences and Physiotherapy, Faculty of Medicine, University of Tartu, Tartu, Estonia
Aleksandar Tomašević
Affiliation:
Scientific Computing Laboratory, Institute of Physics Belgrade, University of Belgrade, Belgrade, Serbia
Wenceslao Unanue
Affiliation:
Business School, Universidad Adolfo Ibáñez, Santiago, Chile
Jesús Unanue
Affiliation:
Facultad de Economía y Negocios, Universidad Andres Bello, Santiago, Chile
Marieke van Egmond
Affiliation:
Tranzo, Tilburg University, Tilburg, the Netherlands
Murat Yıldırım
Affiliation:
Psychology Research Center, Khazar University, Baku, Azerbaijan Department of Psychology, Faculty of Science and Letters, Ağrı İbrahim Çeçen University, Ağrı, Turkey
Gaja Zager Kocjan
Affiliation:
Department of Psychology, Faculty of Arts, University of Ljubljana, Ljubljana, Slovenia
Laura Zamarian
Affiliation:
Department of Neurology, Medical University of Innsbruck, Innsbruck, Austria
Marija Zotović-Kostić
Affiliation:
Department of Psychology, Faculty of Philosophy, University of Novi Sad, Novi Sad, Serbia
Veljko Jovanović
Affiliation:
Department of Psychology, Faculty of Philosophy, University of Novi Sad, Novi Sad, Serbia
*
Corresponding Author: Milica Lazić, Email: milica.lazic@ff.uns.ac.rs

Abstract

The present study investigated the cross-national measurement invariance of a 10-item Youth Externalizing Problems Screener (YEPS) on a sample of 17,489 adolescents from 32 countries. The original one-factor and two-factor models of YEPS were found to provide a poor fit to the data in most countries. Following the removal of two semantically overlapping items and the inclusion of correlated error terms, adequate model fit was obtained in 31 of 32 countries. Measurement invariance testing of an abbreviated 8-item YEPS (YEPS-SF) supported configural invariance. Partial scalar invariance was achieved only after freely estimating numerous parameters. The alignment analysis revealed that 22% of parameters were non-invariant across countries. South Africa, Hungary, and India showed the largest number of non-invariant parameters, whereas the lowest number was detected in several European countries. These findings highlight the potential of the YEPS-SF for use within individual countries and the challenge of developing cross-culturally comparable measures, suggesting that cultural adaptations may be necessary.

Information

Type
Regular Article
Copyright
© The Author(s), 2025. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Abad, J., & Forns, M. (2008). Personality profile for adolescents at risk for internalizing and externalizing problems. Psychological Reports, 103(1), 219230. https://doi.org/10.2466/pr0.103.1.219-230 CrossRefGoogle ScholarPubMed
Abikoff, H., & Klein, R. G. (1992). Attention-deficit hyperactivity and conduct disorder: Comorbidity and implications for treatment. Journal of Consulting and Clinical Psychology, 60(6), 881892. https://doi.org/10.1037/0022-006X.60.6.881 CrossRefGoogle ScholarPubMed
Achenbach, T. M. (1985). Assessment and taxonomy of child and adolescent psychopathology. Sage Publications, Inc.Google Scholar
Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. University of Vermont, Research Center for Children, Youth, & Families.Google Scholar
Arslan, G. (2022). School bullying and youth internalizing and externalizing behaviors: Do school belonging and school achievement matter? International Journal of Mental Health and Addiction, 20(4), 24602477. https://doi.org/10.1007/s11469-021-00526-x CrossRefGoogle Scholar
Asparouhov, T., & Muthén, B. (2010). Weighted least squares estimation with missing data. Mplus Technical Appendix, 5, 110.Google Scholar
Asparouhov, T., & Muthén, B. (2014). Multiple-group factor analysis alignment. Structural Equation Modeling, 21(4), 495508. https://doi.org/10.1080/10705511.2014.919210 CrossRefGoogle Scholar
Asparouhov, T., & Muthén, B. (2023). Multiple group alignment for exploratory and structural equation models. Structural Equation Modeling, 30(2), 169191. https://doi.org/10.1080/10705511.2022.2127100 CrossRefGoogle Scholar
Bandalos, D. L. (2021). Item meaning and order as causes of correlated residuals in confirmatory factor analysis. Structural Equation Modeling, 28(6), 903913. https://doi.org/10.1080/10705511.2021.1916395 CrossRefGoogle Scholar
Barkley, R. A. (2006). Attention-Deficit hyperactivity disorder: A handbook for diagnosis andtreatment (3rd ed.). Guilford Press.Google Scholar
Bennett, M., Roche, K. M., Huebner, D. M., & Lambert, S. F. (2020). School discrimination and changes in Latinx adolescents’ internalizing and externalizing symptoms. Journal of Youth and Adolescence, 49(10), 20202033. https://doi.org/10.1007/s10964-020-01256-4 CrossRefGoogle ScholarPubMed
Bowen, N. K., & Masa, R. D. (2015). Conducting measurement invariance tests with ordinal data: A guide for social work researchers. Journal of the Society for Social Work and Research, 6(2), 229249. https://doi.org/10.1086/681607 CrossRefGoogle Scholar
Brauer, K., Ranger, J., & Ziegler, M. (2023). Confirmatory factor analyses in psychological test adaptation and development: A nontechnical discussion of the WLSMV estimator [Editorial]. Psychological Test Adaptation and Development, 4(1), 412. https://doi.org/10.1027/2698-1866/a000034 CrossRefGoogle Scholar
Burks, H. F., & Gruber, C. P. (2006). Burks behavior rating scales (2nd ed.). Western Psychological Services.Google Scholar
Byrne, B. M., & Van de Vijver, F. J. (2017). The maximum likelihood alignment approach to testing for approximate measurement invariance: A paradigmatic cross-cultural application. Psicothema, 29(4), 539551. https://doi.org/10.7334/psicothema2017.178 CrossRefGoogle ScholarPubMed
Carvajal-Velez, L., Ahs, J. W., Requejo, J. H., Kieling, C., Lundin, A., Kumar, M., Luitel, N. P., Marlow, M., Skeen, S., Tomlinson, M., & Kohrt, B. A. (2023). Measurement of mental health among adolescents at the population level: A multicountry protocol for adaptation and validation of mental health measures. The Journal of Adolescent Health, 72(1S), S27S33. https://doi.org/10.1016/j.jadohealth.2021.11.035 CrossRefGoogle Scholar
Causadias, J. M., & Cicchetti, D. (2018). Cultural development and psychopathology. Development and Psychopathology, 30(5), 15491555. https://doi.org/10.1017/S0954579418001220 CrossRefGoogle ScholarPubMed
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464504. https://doi.org/10.1080/10705510701301834 CrossRefGoogle Scholar
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233255. https://doi.org/10.1207/S15328007SEM0902_5 CrossRefGoogle Scholar
Conners, C. K. (2008). Conners third edition (Conners 3). Western Psychological Services.Google Scholar
Cook, C. R., Williams, K. R., Guerra, N. G., Kim, T. E., & Sadek, S. (2010). Predictors of bullying and victimization in childhood and adolescence: A meta-analytic investigation. School Psychology Quarterly, 25(2), 6583. https://doi.org/10.1037/a0020149 CrossRefGoogle Scholar
Esch, P., Bocquet, V., Pull, C., Couffignal, S., Lehnert, T., Graas, M., Fond-Harmant, L., Ansseau, M. (2014). The downward spiral of mental disorders and educational attainment: A systematic review on early school leaving. BMC Psychiatry, 14, Article 237. https://doi.org/10.1186/s12888-014-0237-4.CrossRefGoogle Scholar
Flora, D. B. (2020). Your coefficient alpha is probably wrong, but which coefficient omega is right? A tutorial on using R to obtain better reliability estimates. Advances in Methods and Practices in Psychological Science, 3(4), 484501. https://doi.org/10.1177/2515245920951747 CrossRefGoogle Scholar
Frick, P. J., & Kimonis, E. R. (2005). Externalizing disorders of childhood and adolescence. In Maddux, J. E., & Winstead, B. A. (Eds.), Psychopathology: Foundations for a contemporary understanding (pp. 325351). Lawrence Erlbaum Associates Publishers.Google Scholar
Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40(11), 13371345. https://doi.org/10.1097/00004583-200111000-00015 Google ScholarPubMed
Guthold, R., Carvajal-Velez, L., Adebayo, E., Azzopardi, P., Baltag, V., Dastgiri, S., Dua, T., Fagan, L., Ferguson, B. J., Inchley, J. C., Mekuria, M. L., Moller, A. B., Servili, C., & Requejo, J. (2023). The importance of mental health measurement to improve global adolescent health. The Journal of Adolescent Health, 72(1S), S3S6. https://doi.org/10.1016/j.jadohealth.2021.03.030 CrossRefGoogle ScholarPubMed
He, J., & Van de Vijver, F. J. (2016). Response styles in factual items: Personal, contextual and cultural correlates. International Journal of Psychology, 51(6), 445452. https://doi.org/10.1002/ijop.12263 CrossRefGoogle ScholarPubMed
Hein, V., Emeljanovas, A., & Mieziene, B. (2018). A cross-cultural validation of the controlling teacher behaviours scale in physical education. European Physical Education Review, 24(2), 209224. https://doi.org/10.1177/1356336X16681821 CrossRefGoogle Scholar
Hinshaw, S. P. (1987). On the distinction between attentional deficits/hyperactivity and conduct problems/aggression in child psychopathology. Psychological Bulletin, 101(3), 443463. https://doi.org/10.1037/0033-2909.101.3.443 CrossRefGoogle ScholarPubMed
Johnson, T. P., Shavitt, S., & Holbrook, A. L. (2011). Survey response styles across cultures. In Matsumoto, D., & van de Vijver, F. J. R. (Eds.), Cross-cultural research methods in psychology (pp. 130175). Cambridge University Press.Google Scholar
Jovanović, V. (2024). The youth externalizing problems screener: Evidence of convergent validity and measurement invariance across gender, time, and two countries. European Journal of Psychological Assessment. https://doi.org/10.1027/1015-5759/a000871 CrossRefGoogle Scholar
Kapetanovic, S., Rothenberg, W. A., Lansford, J. E., Bornstein, M. H., Chang, L., Deater-Deckard, K., Di Giunta, L., Dodge, K. A., Gurdal, S., Malone, P. S., Oburu, P., Pastorelli, C., Skinner, A. T., Sorbring, E., Steinberg, L., Tapanya, S., Uribe Tirado, L. M., Yotanyamaneewong, S., Peña Alampay, L.et al. (2020). Cross-cultural examination of links between parent–adolescent communication and adolescent psychological problems in 12 cultural groups. Journal of Youth and Adolescence, 49(6), 12251244. https://doi.org/10.1007/s10964-020-01212-2 CrossRefGoogle ScholarPubMed
Kemmelmeier, M. (2016). Cultural differences in survey responding: Issues and insights in the study of response biases. International Journal of Psychology, 51(6), 439444. https://doi.org/10.1002/ijop.12386 CrossRefGoogle Scholar
Kim, E. K., & Choe, D. (2022). Universal social, emotional, and behavioral strength and risk screening: Relative predictive validity for students’ subjective well-being in schools. School Psychology Review, 51(1), 4054. https://doi.org/10.1080/2372966X.2020.1855062 CrossRefGoogle Scholar
King, K. M., & Chassin, L. (2007). A prospective study of the effects of age of initiation of alcohol and drug use on young adult substance dependence. Journal of Studies on Alcohol and Drugs, 68(2), 256265. https://doi.org/10.15288/jsad.2007.68.256 CrossRefGoogle ScholarPubMed
Kowal, M. (2024). Translation practices in cross-cultural social research and guidelines for the most popular approach: Back-translation. Anthropological Review, 87(3), 1932. https://doi.org/10.18778/1898-6773.87.3.02 CrossRefGoogle Scholar
Lansford, J. E., Godwin, J., Bornstein, M. H., Chang, L., Deater-Deckard, K., Di Giunta, L., Dodge, K. A., Malone, P. S., Oburu, P., Pastorelli, C., Skinner, A. T., Sorbring, E., Steinberg, L., Tapanya, S., Uribe Tirado, L. M., Alampay, L. P., Al-Hassan, S. M., & Bacchini, D. (2018). Parenting, culture, and the development of externalizing behaviors from age 7 to 14 in nine countries. Development and Psychopathology, 30(5), 19371958. https://doi.org/10.1017/S0954579418000925 CrossRefGoogle ScholarPubMed
Leitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., De Roover, K., Jak, S., Meitinger, K., Menold, N., Muthén, B., Rudnev, M., Schmidt, P., & van de Schoot, R. (2023). Measurement invariance in the social sciences: Historical development, methodological challenges, state of the art, and future perspectives. Social Science Research, 110, Article 102805. https://doi.org/10.1016/j.ssresearch.2022.102805 CrossRefGoogle Scholar
Marsh, H. W., Guo, J., Parker, P. D., Nagengast, B., Asparouhov, T., Muthén, B., & Dicke, T. (2018). What to do when scalar invariance fails: The extended alignment method for multi-group factor analysis comparison of latent means across many groups. Psychological Methods, 23(3), 524545. https://doi.org/10.1037/met0000113 CrossRefGoogle Scholar
Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111130.10.21500/20112084.857CrossRefGoogle Scholar
Moore, G. F., Littlecott, H. J., Turley, R., Waters, E., & Murphy, S. (2015). Socioeconomic gradients in the effects of universal school-based health behaviour interventions: A systematic review of intervention studies. BMC Public Health, 15, Article 907. https://doi.org/10.1186/s12889-015-2244-x CrossRefGoogle Scholar
Moss, H. B., & Lynch, K. G. (2001). Comorbid disruptive behavior disorder symptoms and their relationship to adolescent alcohol use disorders. Drug and Alcohol Dependence, 64(1), 7583. https://doi.org/10.1016/S0376-8716(00)00233-7 CrossRefGoogle ScholarPubMed
Muthén, B., & Asparouhov, T. (2014). IRT studies of many groups: the alignment method. Frontiers in Psychology, 5, Article 978. https://doi.org/10.3389/fpsyg.2014.00978 Google ScholarPubMed
Muthén, L. K., & Muthén, B. O. (1998-2017). Mplus user’s guide (8th ed.). Muthén & Muthén.Google Scholar
Pelham, W. E. Jr, Fabiano, G. A., & Massetti, G. M. (2005). Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34(3), 449476. https://doi.org/10.1207/s15374424jccp3403_5 CrossRefGoogle ScholarPubMed
Petot, D., Petot, J. M., & Chahed, M. (2023). Is the youth self-report total score a reliable measure of both a general factor of psychopathology and Achenbach’s eight syndromes? A cross-cultural study. Journal of Psychopathology and Behavioral Assessment, 45(1), 5874. https://doi.org/10.1007/s10862-022-10004-w CrossRefGoogle Scholar
Pinquart, M. (2021). Cultural differences in the association of harsh parenting with internalizing and externalizing symptoms: A meta-analysis. Journal of Child and Family Studies, 30(12), 29382951. https://doi.org/10.1007/s10826-021-02113-z CrossRefGoogle Scholar
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 7190. https://doi.org/10.1016/j.dr.2016.06.004 CrossRefGoogle ScholarPubMed
Renshaw, T. L., & Cook, C. R. (2019). Preliminary psychometrics of responses to the youth externalizing problems screener. Journal of Psychoeducational Assessment, 37(8), 10161022. https://doi.org/10.1177/0734282918809814 CrossRefGoogle Scholar
Rescorla, L., Achenbach, T., Ivanova, M. Y., Dumenci, L., Almqvist, F., Bilenberg, N., Bird, H., Wei Chen, , Dobrean, A., Döpfner, M., Erol, N., Fombonne, E., Fonseca, A., Frigerio, A., Grietens, H., Hannesdottir, H., Kanbayashi, Y., Lambert, M., Larsson, B. O.,…Verhulst, F. (2007). Behavioral and emotional problems reported by parents of children ages 6 to 16 in 31 societies. Journal of Emotional and Behavioral Disorders, 15(3), 130142. https://doi.org/10.1177/10634266070150030101 CrossRefGoogle Scholar
Rhee, S. H., Willcutt, E. G., Hartman, C. A., Pennington, B. F., & DeFries, J. C. (2008). Test of alternative hypotheses explaining the comorbidity between attention-deficit/hyperactivity disorder and conduct disorder. Journal of Abnormal Child Psychology, 36, 2940. https://doi.org/10.1007/s10802-007-9157-9 CrossRefGoogle ScholarPubMed
Rhemtulla, M., Brosseau-Liard, P.É., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354373. https://doi.org/10.1037/a0029315 CrossRefGoogle ScholarPubMed
Rothenberg, W. A., Lansford, J. E., Alampay, L. P., Al-Hassan, S. M., Bacchini, D., Bornstein, M. H., Chang, L., Deater-Deckard, K., Di Giunta, L., Dodge, K. A., Malone, P. S., Oburu, P., Pastorelli, C., Skinner, A. T., Sorbring, E., Steinberg, L., Tapanya, S., Tirado, L. M. U., & Yotanyamaneewong, S. (2020). Examining effects of mother and father warmth and control on child externalizing and internalizing problems from age 8 to 13 in nine countries. Development and Psychopathology, 32(3), 11131137. https://doi.org/10.1017/S0954579419001214 CrossRefGoogle ScholarPubMed
Ruchkin, V., Sukhodolsky, D. G., Vermeiren, R., Koposov, R. A., & Schwab-Stone, M. (2006). Depressive symptoms and associated psychopathology in urban adolescents: A cross-cultural study of three countries. The Journal of Nervous and Mental Disease, 194(2), 106113. https://doi.org/10.1097/01.nmd.0000198142.26754.18 CrossRefGoogle Scholar
Sass, D. A., Schmitt, T. A., & Marsh, H. W. (2014). Evaluating model fit with ordered categorical data within a measurement invariance framework: A comparison of estimators. Structural Equation Modeling, 21(2), 167180. https://doi.org/10.1080/10705511.2014.882658 CrossRefGoogle Scholar
Sethia, N. (2024). Influence of collectivistic and individualistic cultures on ADHD treatment preferences and efficacy in adults. Scripps Senior Theses, 2358, https://scholarship.claremont.edu/scripps_theses/2358 Google Scholar
Solano-Flores, G., & Nelson-Barber, S. (2001). On the cultural validity of science assessments. Journal of Research in Science Teaching, 38(5), 553573. https://doi.org/10.1002/tea.1018 CrossRefGoogle Scholar
Sourander, A., Westerlund, M., Kaneko, H., Heinonen, E., Klomek, A. B., How Ong, S., Fossum, S., Kolaitis, G., Lesinskiene, S., Li, L., Nguyen, M. H., Kumar Praharaj, S., Wiguna, T., Zamani, Z., Gilbert, S. (2024). Cross-cultural comparison of the strengths and difficulties self-report questionnaire in 12 Asian and European countries. Journal of the American Academy of Child and Adolescent Psychiatry, 64(7), 799809. https://doi.org/10.1016/j.jaac.2024.10.002 Google ScholarPubMed
Stevanovic, D., Jafari, P., Knez, R., Franic, T., Atilola, O., Davidovic, N., Bagheri, Z., & Lakic, A. (2017). Can we really use available scales for child and adolescent psychopathology across cultures? A systematic review of cross-cultural measurement invariance data. Transcultural Psychiatry, 54(1), 125152. https://doi.org/10.1177/1363461516689215 CrossRefGoogle ScholarPubMed
Stevanovic, D., Urbán, R., Atilola, O., Vostanis, P., Singh Balhara, Y. P., Avicenna, M., Kandemir, H., Knez, R., Franic, T., & Petrov, P. (2015). Does the Strengths and Difficulties Questionnaire – self report yield invariant measurements across different nations? Data from the International Child Mental Health Study Group Epidemiology and Psychiatric Sciences, 24(4), 323334. https://doi.org/10.1017/S2045796014000201 CrossRefGoogle ScholarPubMed
Tsitsika, A., Janikian, M., Wójcik, S., Makaruk, K., Tzavela, E., Tzavara, C., Greydanus, D., Merrick, J., & Richardson, C. (2015). Cyberbullying victimization prevalence and associations with internalizing and externalizing problems among adolescents in six European countries. Computers in Human Behavior, 51(Pt A), 17. https://doi.org/10.1016/j.chb.2015.04.048 CrossRefGoogle Scholar
Van de Vijver, F., & Hambleton, R. K. (1996). Translating tests. European Psychologist, 1(2), 8999. https://doi.org/10.1027/1016-9040.1.2.89 CrossRefGoogle Scholar
Van de Vijver, F. J., & Leung, K. (2021). Methods and data analysis for cross-cultural research (2nd ed.). Cambridge University Press.10.1017/9781107415188CrossRefGoogle Scholar
Van de Vijver, F. J., & Poortinga, Y. H. (1997). Towards an integrated analysis of bias in cross cultural assessment. European Journal of Psychological Assessment, 13(1), 2937. https://doi.org/10.1027/1015-5759.13.1.29 CrossRefGoogle Scholar
Van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2016). The bidirectional pathways between internalizing and externalizing problems and academic performance from 6 to 18 years. Development and Psychopathology, 28(3), 855867. https://doi.org/10.1017/S0954579416000353 CrossRefGoogle ScholarPubMed
van Oort, F. V., van der Ende, J., Wadsworth, M. E., Verhulst, F. C., & Achenbach, T. M. (2011). Cross-national comparison of the link between socioeconomic status and emotional and behavioral problems in youths. Social Psychiatry and Psychiatric Epidemiology, 46(2), 167172. https://doi.org/10.1007/s00127-010-0191-5 CrossRefGoogle ScholarPubMed
Vignoles, V. L., Smith, P. B., Becker, M., & Easterbrook, M. J. (2018). In search of a pan-European culture: European values, beliefs, and models of selfhood in global perspective. Journal of Cross-Cultural Psychology, 49(6), 868887. https://doi.org/10.1177/0022022117738751 CrossRefGoogle Scholar
Wang, J., & Wang, X. (2020). Structural equation modeling: Applications using Mplus (2nd ed.). John Wiley & Sons.Google Scholar
Waschbusch, D. A. (2002). A meta-analytic examination of comorbid hyperactive-impulsive-attention problems and conduct problems. Psychological Bulletin, 128(1), 118150. https://doi.org/10.1037/0033-2909.128.1.118 CrossRefGoogle ScholarPubMed
Watabe, Y., Lee, S. K., & Matsuhashi, Y. (2024). Cross-cultural investigation in differential perceptions of externalizing symptoms. Japanese Psychological Research, 66(3), 255263. https://doi.org/10.1111/jpr.12411 CrossRefGoogle Scholar
Weeks, S. N., Renshaw, T. L., Rainey, A. A., & Hiatt, A. (2024). Evaluating a unified screener for adolescent internalizing and externalizing problems. Journal of Emotional and Behavioral Disorders, 32(1), 2435. https://doi.org/10.1177/10634266221136064 CrossRefGoogle Scholar
Zwaanswijk, M., Van Der Ende, J. A. N., Verhaak, P. F., Bensing, J. M., & Verhulst, F. C. (2003). Factors associated with adolescent mental health service need and utilization. Journal of the American Academy of Child & Adolescent Psychiatry, 42(6), 692700. https://doi.org/10.1097/01.CHI.0000046862.56865.B7 Google ScholarPubMed
Zwirs, B. W., Burger, H., Buitelaar, J. K., & Schulpen, T. W. (2006). Ethnic differences in parental detection of externalizing disorders. European Child & Adolescent Psychiatry, 15, 418426. https://doi.org/10.1007/s00787-006-0550-7 CrossRefGoogle ScholarPubMed
Supplementary material: File

Lazić et al. supplementary material

Lazić et al. supplementary material
Download Lazić et al. supplementary material(File)
File 31.5 KB