Hostname: page-component-745bb68f8f-kw2vx Total loading time: 0 Render date: 2025-01-31T07:57:26.058Z Has data issue: false hasContentIssue false

Evaluating Computerised Assessment of Motor Imitation (CAMI) for identifying autism-specific difficulties not observed for attention-deficit hyperactivity disorder or neurotypical development

Published online by Cambridge University Press:  28 January 2025

Romila Santra
Affiliation:
Center for Neurodevelopmental and Imaging Research, Kennedy Krieger Institute, Baltimore, Maryland, USA
Carolina Pacheco
Affiliation:
Mathematical Institute for Data Science, Johns Hopkins University, Maryland, USA; and Department of Biomedical Engineering, Johns Hopkins University, Maryland, USA
Deana Crocetti
Affiliation:
Center for Neurodevelopmental and Imaging Research, Kennedy Krieger Institute, Baltimore, Maryland, USA
René Vidal
Affiliation:
School of Engineering and Applied Science, University of Pennsylvania, Pennsylvania, USA; and Perelman School of Medicine, University of Pennsylvania, Pennsylvania, USA
Stewart H. Mostofsky
Affiliation:
Center for Neurodevelopmental and Imaging Research, Kennedy Krieger Institute, Baltimore, Maryland, USA; Department of Neurology, Johns Hopkins University School of Medicine, Maryland, USA; and Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Maryland, USA
Bahar Tunçgenç*
Affiliation:
Department of Psychology, Nottingham Trent University, UK; and Institute of Human Sciences, University of Oxford, UK
*
Correspondence: Bahar Tunçgenç. Email: bahartuncgenc@gmail.com
Rights & Permissions [Opens in a new window]

Abstract

Background

Reliable and specific biomarkers that can distinguish autism spectrum disorders (ASDs) from commonly co-occurring attention-deficit/hyperactivity disorder (ADHD) are lacking, causing misses and delays in diagnosis, and reducing access to interventions and quality of life.

Aims

To examine whether an innovative, brief (1-min), videogame method called Computerised Assessment of Motor Imitation (CAMI), can identify ASD-specific imitation differences compared with neurotypical children and children with ADHD.

Method

This cross-sectional study used CAMI alongside standardised parent-report (Social Responsiveness Scale, Second Edition) and observational measures of autism (Autism Diagnostic Observation Schedule-Second Edition; ADOS-2), ADHD (Conners) and motor ability (Physical and Neurological Examination for Soft Signs). The sample comprised 183 children aged 7–13 years, with ADHD (without ASD), with ASD (with and without ADHD) and who were neurotypical.

Results

Regardless of co-occurring ADHD, children with ASD showed poorer CAMI performance than neurotypical children (P < 0.0001; adjusted R2 = 0.28), whereas children with ADHD and neurotypical children showed similar CAMI performance. Receiver operating curve and support vector machine analyses showed that CAMI distinguishes ASD from both neurotypical children (80% true positive rate) and children with ADHD (70% true positive rate), with a high success rate significantly above chance. Among children with ASD, poor CAMI performance was associated with increased autism traits, particularly ADOS-2 measures of social affect and restricted and repetitive behaviours (adjusted R2 = 0.23), but not with ADHD traits or motor ability.

Conclusions

Four levels of analyses confirm that poor imitation measured by the low-cost and scalable CAMI method specifically distinguishes ASD not only from neurotypical development, but also from commonly co-occurring ADHD.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2025. Published by Cambridge University Press on behalf of Royal College of Psychiatrists

Autism spectrum disorder (ASD) is an early-developing condition affecting one in 36 children in the USA and one in 100 children globally.Reference Maenner, Warren, Williams, Amoakohene, Bakian and Bilder1,Reference Zeidan, Fombonne, Scorah, Ibrahim, Durkin and Saxena2 Early diagnosis of ASD enables access to effective interventions and improvement in quality of life;Reference Anderson3 however, we lack cost-effective, specific and reliable biomarkers and testsReference Grzadzinski, Dick, Lord and Bishop4,Reference Krakowski, Cost, Anagnostou, Lai, Crosbie and Schachar5 that can distinguish children with ASD not just from neurotypical children, but also those with commonly co-occurring conditions such as attention-deficit hyperactivity disorder (ADHD) (50–70% co-occurrenceReference Rong, Yang, Jin and Wang6), resulting in a clouded clinical picture causing missed or delayed ASD diagnoses.Reference Malwane, Nguyen, Trejo, Kim and Cucalón-Calderón7 Motor imitation performance is a promising autism-specific biomarker, with imitation being critical for social learning and relationships,Reference Over8 and poor imitation widely reported in children with ASD compared with neurotypical children.Reference Bhat, Landa and Galloway9,Reference Lidstone and Mostofsky10 Prior studies further suggest an ASD-specific motor profile, as compared with ADHD, in tasks such as ball-catching and dyspraxia,Reference Ament, Mejia, Buhlman, Erklin, Caffo and Mostofsky11,Reference MacNeil and Mostofsky12 with an over-reliance on proprioceptive, as opposed to visual, feedback in children with ASD.Reference Izawa, Pekny, Marko, Haswell, Shadmehr and Mostofsky13,Reference Haswell, Izawa, Dowell, Mostofsky and Shadmehr14 Going forward, identifying the unique motor profiles specific to ASD versus ADHD will be crucial for precision medicine approaches to diagnosis and guiding interventions.

Establishing motor imitation as a biomarker for autism requires robust methods with high sensitivity and specificity. For decades, motor imitation assessments relied on human observation coding, which has limited reliability, precision and scalability because it is time-consuming and requires multiple highly trained observers. Addressing these challenges, we recently developed the Computerised Assessment of Motor Imitation (CAMI), a brief, engaging videogame-like task that assesses imitation performance using computer vision methods without attaching any wearables to the children and virtually without any human input for data processing. Our published findings have shown that for children aged 7–13 years, the CAMI distinguishes ASD diagnosis from neurotypical development more robustly than the traditional, human observation coding methods,Reference Tunçgenç, Pacheco, Rochowiak, Nicholas, Rengarajan and Zou15,Reference Lidstone, Rochowiak, Pacheco, Tunçgenç, Vidal and Mostofsky16 with the CAMI approaching 90% accuracy. These findings are initial steps toward establishing the CAMI as a reliable assessment method that can capture the autism phenotype without relying on language. However, before the CAMI can be enrolled more widely in younger age groups and more severely affected ASD populations, we need to advance its specificity by demonstrating that it identifies autism-specific imitation difficulties as different from other co-occurring conditions where atypical motor profiles are observed, such as ADHD, developmental coordination disorder or developmental language disorder.Reference Rechetnikov and Maitra17Reference Athanasiadou, Buitelaar, Brovedani, Chorna, Fulceri and Guzzetta19

Current study

To this end, in this study, we tested four groups of children: ADHD without ASD, ASD with co-occurring ADHD (ASD + ADHD), ASD without ADHD (ASD only) and neurotypical. Based on previous research, we hypothesised that children with ASD would show poorer imitation (i.e. lower CAMI scores) than children with ADHD and neurotypical children, whereas the latter two would not significantly differ from each other. In addition, we examined dimensional metrics of motor ability, and ASD and ADHD symptom severity, hypothesising that in children with ASD, CAMI performance would be associated with core ASD traits rather than with ADHD traits or motor ability. Finally, we conducted receiver operating curve (ROC) and support vector machine (SVM) analyses to examine how successfully CAMI scores alone could distinguish children with ASD from children with ADHD and neurotypical children, by calculating its specificity and sensitivity.

Method

Participants

Participants were 183 children aged 7–13 years old: 35 with ADHD (without ASD), 63 with ASD and co-occurring ADHD (ASD + ADHD), 21 with ASD without ADHD (ASD only) and 65 neurotypical children (see Table 1 for detailed sample characteristics). One additional child from the ASD-only group was tested but excluded from analysis because their CAMI score was more than three times above the interquartile range of the ASD sample. ADHD subtypes within the ADHD group were 12 inattentive, 22 combined and one not otherwise specified. ADHD subtypes within the ASD + ADHD group were 25 inattentive, six hyperactive/impulsive, 31 combined and one not otherwise specified.

Table 1 Sample characteristics of each group

ADHD, attention-deficit hyperactivity disorder; ASD, autism spectrum disorder; WISC-V GAI, Wechsler Intelligence Scale for Children General Ability Index, Fifth Edition; PANESS, Physical and Neurological Examination for Soft Signs; ADOS-2 total, T-scores of the Autism Diagnostic Observation Schedule, Second Edition; SRS-2 total, T-scores of the Social Responsiveness Scale, Second Edition; Conners, Conners ADHD Index; CAMI, Computerised Assessment of Motor Imitation.

Testing took place as part of a 2-day visit at the Center for Neurodevelopmental and Imaging Research, Kennedy Krieger Institute, Baltimore, Maryland, USA. All procedures complied with the ethical standards of the national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. All procedures involving human participants were approved by the Johns Hopkins University School of Medicine Institutional Review Board (approval number IRB00269589). Parents of all participants provided written informed consent, and the children provided verbal assent before data collection. Parents were reimbursed $50 for participation.

ASD diagnosis was confirmed with the clinician-administered Autism Diagnostic Observation Schedule-Second Edition, Module 3 (ADOS-2);Reference Lord, Rutter, DiLavore, Risi, Gotham and Bishop20 and ADHD diagnosis was confirmed with the Kiddie Schedule for Affective Disorders and SchizophreniaReference Kaufman, Birmaher, Brent, Rao, Flynn and Moreci21 and Conners,Reference Conners22 according to DSM-5 criteria. All participants had a full-scale IQ of ≥70, as measured by the Wechsler Intelligence Scale for Children, Fifth Edition (WISC-V),Reference Wechsler23 to ensure they could follow the instructions.

Measures and procedure

Children completed an imitation task, from which their CAMI scores were obtained. The children's parents filled out the Social Responsiveness Scale-Second Edition (SRS-2)Reference Constantino and Gruber24 and the Conners-3 or Conners-4Reference Conners22 rating scale, which were used as measures of the children's autism and ADHD traits, respectively. In addition, children completed the Physical and Neurological Examination for Soft Signs (PANESS)Reference Denckla25 as a measure of their motor ability, and the children in the ASD group were administered the ADOS-2.Reference Lord, Rutter, DiLavore, Risi, Gotham and Bishop20

CAMI

Imitation was assessed over two trials, each comprising a 1-min, highly engaging game, in which children were asked to copy the dance-like, whole-body movements of a video avatar while standing. The children's movements were recorded with two sensorless Kinect Xbox cameras located directly opposite and behind them. Following the raw data processing steps and the CAMI algorithm described in previous studies,Reference Tunçgenç, Pacheco, Rochowiak, Nicholas, Rengarajan and Zou15,Reference Lidstone, Rochowiak, Pacheco, Tunçgenç, Vidal and Mostofsky16 we calculated the children's imitation score for each trial. Identifying the most important joints for each move automatically in a data-driven manner, CAMI calculates an imitation score per trial that varies between 0 (no imitation at all) and 1 (perfect imitation, i.e. a well-trained researcher's imitation of the avatar). The two trials featured different movement sequences, and the scores in the two trials were significantly correlated with each other (r(179) = 0.76, P < 0.0001). Hence, CAMI scores from the two trials were averaged to obtain a composite CAMI score per participant that ranged from 0 to 1, with higher scores indicating better imitation performance.

ADOS-2

The ADOS-2Reference Lord, Rutter, DiLavore, Risi, Gotham and Bishop20 is a semi-structured, activity-based standardised assessment of autism-associated traits. There are five available modules, each designed for a different age group and expressive language level. All participants in this study were administered Module 3. Observational coding by the test administrator yields a total score and two subscale scores: social affect and restrictive and repetitive behaviours. Total comparison scores range from 1 to 10, where 1–2 indicates minimal to no evidence of ASD, 3–4 indicates a low level of ASD symptoms, 5–7 indicates a moderate level of ASD symptoms and 8–10 indicates a high level of ASD symptoms. All ASD participants in this study had a total score range of 6–27.

SRS-2

The SRS-2Reference Constantino and Gruber24 is a 65-item, parent-report questionnaire intended to quantify the social communication difficulties experienced in ASD. The scale yields a total score, as well as five subscales: social awareness, social cognition, social communication, social motivation, and restricted interests and repetitive behaviour. Overall T-scores were used in analyses, with higher scores indicating more autistic traits. According to the scale guidelines, scores <60 indicate no social communication difficulties, scores of 60–75 indicate mild-to-moderate difficulties and scores >75 indicate severe difficulties.

Conners

The Conners-3 and Conners-4 are parent-report rating scales used to assess ADHD and other co-occurring disorders in children aged 6–18 years, using 108 items and 114 items, respectively. DSM-IV-TR (DSM-V for Conners-4) subscales include inattention and hyperactivity/impulsivity, as well as three validity scales. T-scores from the DSM-based ADHD Index inattention and hyperactivity/impulsivity subscales were used in this study. In both subscales, T-scores have a mean of 50 and s.d. of 10, with higher scores indicating more difficulties with inattention or hyperactivity/impulsivity. According to scale guidelines, scores of 40–59 are considered within neurotypical range, scores of 60–64 are considered high average/slightly elevated, scores of 65–69 are considered elevated and scores >70 are considered very elevated, indicating many more concerns than reported in neurotypical populations. Participants in the ADHD and ASD + ADHD in this study had inattentiveness score range of 42–90, and hyperactivity/impulsivity score range of 38–90.

PANESS

The PANESSReference Denckla25 is a standardised behavioural examination administered to assess motor abilities of children aged 6–17 years. PANESS assesses motor domains, including gait, balance and timed movements, and returns both subscale scores for each domain and an overall summed motor ability (PANESS total) score. Previous literature shows poorer motor skills as measured by PANESS in children with ASD and children with ADHD.Reference Mandelbaum, Stevens, Rosenberg, Wiznitzer, Steinschneider and Filipek26Reference Mostofsky, Newschaffer and Denckla28 Scores are scaled based on age, gender and handedness norms, with higher scores indicating poorer motor ability. In this study, PANESS total scores were used.

Data analysis

All analyses were conducted in RStudio for Windows version 2023.06.0+21 (RStudio Team, PBC, Boston, MA; see http://www.rstudio.com/), using lme4Reference Bates, Mächler, Bolker and Walker29 and tidyrReference Wickham, Vaughan and Girlich30 packages. To examine whether children with ASD would show poorer imitation than children with ADHD and neurotypical children, we used a linear regression model, with the predictor variable being the four diagnostic groups (ADHD versus ASD + ADHD versus ASD only versus neurotypical), the outcome variable being the children's imitation performance as measured by CAMI score, and WISC-V General Ability Index and participant gender as the covariate, given the observed diagnostic group differences in the latter two variables. Bonferroni-corrected pairwise t-test was conducted to examine which diagnostic groups differed from each other, and Cohen's d-statistic was calculated to indicate effect sizes of diagnostic group differences.

To examine whether CAMI performance is associated with core ASD traits rather than with ADHD traits or motor ability, we used a linear regression model within the ASD group (ASD + ADHD and ASD-only combined), with the predictor variables being dimensional metrics of autism traits (SRS-2 and ADOS-2 total scores), ADHD traits (Conners inattention and hyperactivity/impulsivity scores) and motor ability (PANESS scores), and the outcome variable being CAMI scores. To explore whether the associations between the dimensional metrics and CAMI held similarly in other populations, linear regression models were conducted within the ADHD and neurotypical groups as well. Because of the high amount of missing data for the SRS-2 and PANESS from the ADHD group, and the ADOS-2 not being administered to the ADHD and neurotypical groups (see Table 1), these dimensional metrics were excluded from the predictors of the respective models. Multicollinearity between predictors was satisfactory for all models (generalised variance inflation factor (GVIF) range: 1.01–1.59). In addition, different dimensions of autism traits were explored for children with ASD, with the predictor variable being ADOS-2 subscale scores (i.e. social affect and restricted and repetitive behaviours), the outcome variable being CAMI scores and the ASD subgroups (i.e. ASD + ADHD versus ASD only) being the moderator variable. For all models, adjusted R 2-values are provided to indicate effect sizes by accounting for the number of predictors in regressions models.

To examine the diagnostic classification ability of CAMI scores, we trained SVM classifiers by using three-fold cross-validation (i.e. two folds for training, one fold for test). The folds were balanced on age, gender and IQ. SVM with linear kernel was used as a classifier, with the misclassification cost being inversely proportional to the number of samples per class to address the class imbalance. To improve interpretability of the results, we used a very simple model consisting of a linear SVM with only two learnable parameters, which means that the classification performance using our sample size versus an infinite amount of samples would be negligible, i.e. <0.2%.Reference Raudys31 In addition, we computed the ROC of the children's CAMI score across trials to confirm that the classification ability of CAMI is not specific to machine learning. The ROC curve is generated by plotting the true positive rate versus false positive rate for 500 classification thresholds uniformly distributed in the [0 1] range. The area under the curve (AUC) quantifies the diagnostic classification ability of the scores, with larger values indicating better classification.

Results

Differences in imitation performance across diagnostic groups

Linear regression model examining diagnostic group differences in imitation scores was significant (F(5,167) = 14.32, P < 0.0001, adjusted R2 = 0.28), with diagnosis (F(3,167) = 18.01, P < 0.0001; see Fig. 1), WISC-V General Ability Index scores (F(1,167) = 5.74, P = 0.02) and participant gender (F(1,167) = 11.83, P = 0.001) significantly predicting CAMI scores. Of note, linear regressions with the WISC-V General Ability Index scores and participant gender as predictors of CAMI scores within each diagnostic group revealed no significant associations for WISC-V General Ability Index scores in either group (all P > 0.05), but a significant gender effect within the neurotypical group only (F(1,57) = 8.24, P = 0.006), such that neurotypical girls (mean 0.62, s.d. = 0.21) had higher CAMI scores than neurotypical boys (mean 0.46, s.d. = 0.21).

Fig. 1 Imitation performance across diagnostic groups (n ADHD = 35, n ASD + ADHD = 63, n ASD-only = 20, n neurotypical = 65). Horizontal lines inside the box plots show the median, black diamonds show the mean and the dots show individual data points within each diagnostic group. ADHD, attention-deficit hyperactivity disorder; ASD, autism spectrum disorder; CAMI, Computerised Assessment of Motor Imitation. *P < 0.01, **P < 0.0001.

Bonferroni-corrected pairwise comparisons examining the diagnostic group differences revealed that children with ADHD performed similarly to neurotypical children (P = 0.13, d = 0.44). In contrast, children in both the ASD + ADHD (P < 0.0001, d = 1.20) and ASD-only (P < 0.0001, d = 1.13) groups had significantly lower imitation scores than neurotypical children. Children in the ASD + ADHD group had significantly lower imitation scores than children with ADHD (P = 0.007, d = 0.71), whereas children in the ASD-only group performed similarly to children with ADHD (P = 0.12, d = 0.64). These results largely support our hypothesis in that imitation difficulties as measured by CAMI are observed specifically in ASD, and not in ADHD, as compared with neurotypical populations. However, contrary to our predictions, the results did not show a significant difference between ADHD and ASD-only groups, which, given the similarity in the distributions of the two ASD groups, likely stems from the low sample size in the ASD-only group (see Discussion for more detailed discussion of this point).

Associations of imitation with ASD, ADHD and motor features

Within the ASD group, the model assessing how dimensional metrics of ASD, ADHD and motor features predict CAMI was significant (F(5,29) = 2.99, P = 0.03, adjusted R2 = 0.23). Among the predictors, only ADOS-2 total scores significantly predicted CAMI (F(1,29) = 5.90, P = 0.02), with poorer imitation being observed as autism traits increased. Additional linear models examining each ADOS-2 subscale further showed that higher scores in both the social affect (F(3,74) = 3.30, P = 0.03, adjusted R2 = 0.08) and the restricted and repetitive behaviours (F(3,74) = 5.40, P = 0.002, adjusted R2 = 0.15) subscales significantly predicted lower CAMI scores. These findings support our secondary hypothesis in that imitation performance in ASD is related with core autism traits, not ADHD traits or motor ability. Examination of how these associations manifest within the ADHD and neurotypical groups revealed that the dimensional metrics model was not significant within ADHD (F(2,27) = 0.41, P = 0.67, adjusted R2 = −0.04), but it was significant within the neurotypical group (F(4,37) = 8.08, P < 0.0001, adjusted R2 = 0.41). For neurotypical children, Conners inattention (F1,37) = 10.43, P = 0.003) and PANESS (F(1,37) = 21.75, P < 0.0001) scores significantly predicted CAMI scores, with higher attention and motor ability being associated with better CAMI performance. Associations of CAMI with SRS-2, PANESS and Conners metrics for the ADHD, ASD and neurotypical groups are shown in Fig. 2(a)–2(d), and associations with ADOS-2 subscale and total scores for the ASD subgroups are shown in Fig. 2(e). Altogether, these findings support our secondary hypothesis by showing that in ASD, imitation is associated specifically with autism traits, not ADHD traits or motor ability, whereas in neurotypical children, imitation is associated with attentional and motor abilities.

Fig. 2 Associations of imitation with ASD traits, ADHD traits and motor ability. Scatter plots showing associations of the CAMI with (a) SRS-2 total scores, (b) PANESS total scores, (c) Conners inattention scores, (b) Conners-3 hyperactivity/impulsivity scores and (e) ADOS-2 restricted and repetitive behaviours and social affect subscales and total scores. Colour codes for the groups are as follows: light blue for ADHD (n = 35), black for combined ASD (n = 84), dark blue for neurotypical (n = 65), light blue for ASD + ADHD (n = 63) and dark blue for ASD only (n = 20). ADHD, attention-deficit hyperactivity disorder; ASD, autism spectrum disorder; ADOS-2, Autism Diagnostic Observation Schedule-Second Edition; CAMI, Computerised Assessment of Motor Imitation; PANESS, Physical and Neurological Examination for Soft Signs; RRB, restricted and repetitive behaviours; SRS-2, Social Responsiveness Scale-Second Edition.

Diagnostic classification ability of the CAMI

The ROC analysis revealed that the true positive rate, as indicated by the AUC, was 80% for the CAMI's ability to distinguish children with ASD from neurotypical children and 70% for its ability to distinguish children with ASD from children with ADHD, whereas the AUC for distinguishing children with ADHD from neurotypical children was 60% (Fig. 3(a)). Chi-squared analysis with Yates correction for each of these comparisons revealed that although children with ASD were correctly classified significantly more than chance as compared with both neurotypical children (χ2(1) = 15.15, P < 0.0001) and children with ADHD (χ2(1) = 6.41, P = 0.01), the classification of children with ADHD from neurotypical children was not significantly different from chance levels (χ2(1) = 0.25, P = 0.62). These results align with SVM analyses, which revealed that CAMI scores alone could distinguish children with ASD from neurotypical children with 71.6% accuracy, children with ASD from children with ADHD with 66.4% accuracy, and children with ADHD from neurotypical children with 59.2% accuracy (Fig. 3(b)). Cumulatively, these findings evidence CAMI's specificity as an autism marker – CAMI can distinguish children with ASD from neurotypical children and children with ADHD with a success rate significantly above chance. In contrast, children with ADHD and neurotypical children show similar motor profiles in terms of their CAMI performance.

Fig. 3 Diagnostic classification ability of the CAMI confirmed by two complementary methods. (a) Receiver operating curve reveals high true positive rates (area under the curve) for distinguishing children with ASD (n = 84) from neurotypical children (n = 65) is 80%, and from children with ADHD (n = 33) is 70%. (b) Three-fold cross-validated support vector machine results show high classification accuracy for distinguishing children with ASD from neurotypical children (72%) and children with ADHD (66%). ADHD, attention-deficit hyperactivity disorder; ASD, autism spectrum disorder; AUC, area under the curve; CAMI, Computerised Assessment of Motor Imitation.

Discussion

This study demonstrated that motor imitation difficulties, as measured with the automated, brief (1-min) and engaging CAMI method, are specifically observed in ASD, but not in ADHD, as compared with neurotypical children. These results largely, but not wholly, support our hypothesis, because although the ADHD group's CAMI scores were higher than the ASD + ADHD group, they were not significantly different from the ASD-only group. For children with ASD, imitation was closely related to core autism traits. In contrast, for neurotypical children, imitation was associated with inattention and motor ability. These findings support our secondary hypothesis that imitation difficulties in ASD are associated with autism traits, rather than with ADHD traits or motor ability. Finally, both ROC and SVM analyses revealed that the CAMI distinguishes children with ASD from neurotypical children and children with ADHD with a high success rate that is significantly above chance, whereas the CAMI performance of children with ADHD is indistinguishable from that of neurotypical children.

The key contribution of this study is laying the groundwork for establishing the specificity of the CAMI as a biomarker of ASD. Regardless of co-occurring ADHD, children with an ASD diagnosis had significantly poorer CAMI performance as compared with neurotypical children. Although the CAMI performance of children with ADHD did not significantly differ from children in the ASD-only group, this is likely a by-product of low power resulting from the small sample size. Indeed, the CAMI performance of children with ADHD was significantly different from children in the ASD with co-occurring ADHD (i.e. ASD + ADHD) group, a group which had three times the sample size of the ASD-only group, with very similar mean and s.d. values. The specificity of the CAMI to ASD was demonstrated using four different analytic approaches: diagnostic group comparisons, nuanced dimensional metrics, ROC analyses and SVM machine learning methods. Converging results from these different types of analyses support the use of CAMI as a reliable and highly scalable method for detecting ASD based on motor imitation differences. Of note, our machine learning analysis shows that CAMI can distinguish children with ASD from both neurotypical children and children with ADHD with significant success, pointing to its strong potential for diagnostic precision.

Although the CAMI is currently a research tool whose reliability, validity and some degree of specificity has been established, it has significant potential in clinical practice. Before clinical use, however, further study is needed in terms of its longevity, specificity to autism and utility with younger and more affected (e.g. non-verbal, intellectually disabled) children. Our study provides evidence that not inattention or poor motor ability, but rather autistic traits, and social communication skills in particular, are associated with imitation in ASD. Future longitudinal research can elucidate the direction of this association, i.e. whether it is impaired social communication that leads to imitation difficulties or early emerging imitation difficulties that affect social communication function throughout the lifespan. The latter possibility is in line with previous literature, which has found that imitation skills of infants with ASD predict language development and play skills in later childhood,Reference Pittet, Kojovic, Franchini and Schaer32 but not necessarily motor skills.Reference Zachor, Ilanit and Itzchak33 Of note, and in line with theoretical models of motor imitation,Reference Wang and de Hamilton34,Reference Iacoboni35 better attentional and motor skills were associated with better imitation performance for neurotypical children. To understand these mechanisms in more detail, future research can not only utilise CAMI at earlier ages and longitudinally, but also use imaging techniques during CAMI to examine visual-motor integration mechanisms underlying imitation performance.

We utilised both parent-report and clinician-observed measures of autistic traits. Although the parent-report measure (SRS-2) did not correlate with imitation performance, the clinician-observed measure (ADOS-2) did. This discrepancy may speak to a tendency for parents to report their child to be less affected in communication and social interaction domains as compared with clinicians.Reference Lemler36 It may also be that direct behavioural observation via the ADOS-2 provides richer, more comprehensive information than does memory-based reportage in SRS-2. Whatever the reason for the discrepancy, these findings indicate that using measures from different reporters is critical to gain a more complete understanding of ASD.

Limitations

Given the heterogeneity of ASD and ADHD presentation, sample sizes of n = 20 for the ASD-only group and n = 35 for the ADHD group are relatively small. This sample size limitation may have accounted for our finding of statistically non-significant differences between the ADHD and ASD-only groups, calling for replication of these findings with larger sample sizes. In addition, missing data on several metrics in the ADHD group did not allow examination of autism traits and motor ability metrics within ADHD. It remains to be understood whether imitation performance in ADHD is associated with the same factors as neurotypical children. Additionally, given that imitation skills develop in early childhood,Reference Over8 future studies should adapt CAMI for use with younger children. Doing so will increase the utility of CAMI as a diagnostic and intervention tool, given that the average age of ASD diagnosis is 10 years oldReference van ‘t Hof, Tisseur, van Berckelear-Onnes, van Nieuwenhuyzen, Daniels and Deen37 and earlier diagnosis enables more effective interventions. Further, our ASD sample primarily included children of relatively high intellectual ability (i.e. an IQ score of >70). Future iterations of the task should aim to simplify instructions so they are accessible to those with intellectual disability, which would more wholly represent the wide intellectual range within the ASD population.

In conclusion, by using multiple levels of analyses – diagnostic group comparisons, dimensional associations, classification analyses using ROC and SVM – this study provides evidence that, as compared with neurotypical children, motor imitation difficulties, measured using the highly reliable and scalable CAMI method, are specific to ASD, and not shared with the frequently co-occurring neurodevelopmental condition ADHD. Imitation skills appear to have divergent pathways in neurotypical children and children with ADHD and ASD: although imitation is associated with attention and motor skills in neurotypical children, for children with ASD, imitation is related to core autism traits. Finally, ROC and SVM analyses showed strong agreement and further confirm that imitation ability, as measured by CAMI alone, distinguishes children with ASD from both neurotypical children (80% true positive rate) and children with ADHD (70% true positive rate) with high accuracy, whereas the CAMI performances of children with ADHD and neurotypical children are nearly indistinguishable (60% true positive rate). These findings provide the basis for establishing the CAMI as a biomarker specific to ASD.

Data availability

In line with the funder's requirements, anonymised data will be made available at the National Database for Autism Research upon publication (http://ndar.nih.gov/). Research materials and analysis scripts will be made available on the Open Science Framework page of the corresponding author, B.T.

Acknowledgements

This work was previously presented as a poster at the International Society for Autism Research (INSAR) Annual Meeting in Stockholm, Sweden, 3–6 May 2023.

Author contributions

R.S., S.H.M. and B.T. conceived of the study. R.S., D.C., S.H.M. and B.T. were responsible for the study methodology. C.P., R.V., S.H.M. and B.T. conducted the formal analysis. R.S. and D.C. were responsible for the study investigation. R.S., C.P., S.H.M. and B.T. wrote the manuscript.

Funding

This work was supported by the National Science Foundation (grant numbers 2124276 to S.H.M., principal investigator, and 2124277 to R.V., principal investigator), National Institutes of Health R21 (grant numbers MH127501, R01 MH106564 and P50 HD103538 to S.H.M., co-investigator) and Simons Foundation (grant number 724867 to S.H.M., principal investigator, and B.T., co-investigator).

Declaration of interest

None.

References

Maenner, MJ, Warren, Z, Williams, AR, Amoakohene, E, Bakian, AV, Bilder, DA, et al. Prevalence and Characteristics of Autism Spectrum Disorder among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2020. Morbidity and Mortality Weekly Report (MMWR) Surveillance Summaries 2023; 72(SS-2): 114. Centers for Disease Control and Prevention (http://doi.org/10.15585/mmwr.ss7202a1).Google ScholarPubMed
Zeidan, J, Fombonne, E, Scorah, J, Ibrahim, A, Durkin, MS, Saxena, S, et al. Global prevalence of autism: a systematic review update. Autism Res 2022; 15(5): 778–90.CrossRefGoogle ScholarPubMed
Anderson, GM. Autism biomarkers: challenges, pitfalls and possibilities. J Autism Dev Disord 2015; 45: 1103–13.CrossRefGoogle ScholarPubMed
Grzadzinski, R, Dick, C, Lord, C, Bishop, S. Parent-reported and clinician-observed autism spectrum disorder (ASD) symptoms in children with attention deficit/hyperactivity disorder (ADHD): implications for practice under DSM-5. Mol Autism 2016; 7 : 7.CrossRefGoogle ScholarPubMed
Krakowski, AD, Cost, KT, Anagnostou, E, Lai, MC, Crosbie, J, Schachar, R, et al. Inattention and hyperactive/impulsive component scores do not differentiate between autism spectrum disorder and attention-deficit/hyperactivity disorder in a clinical sample. Mol Autism 2020; 11(1): 28.CrossRefGoogle Scholar
Rong, Y, Yang, CJ, Jin, Y, Wang, Y. Prevalence of attention-deficit/hyperactivity disorder in individuals with autism spectrum disorder: a meta-analysis. Res Autism Spectr Disord 2021; 83: 101759.CrossRefGoogle Scholar
Malwane, MI, Nguyen, EB, Trejo, S, Kim, EY, Cucalón-Calderón, JR. A delayed diagnosis of autism Spectrum disorder in the setting of complex attention deficit hyperactivity disorder. Cureus 2022; 14: e25825.Google ScholarPubMed
Over, H. The social function of imitation in development. Annu Rev Dev Psychol 2020; 2(1): 93109.CrossRefGoogle Scholar
Bhat, AN, Landa, RJ, Galloway, JC. Current perspectives on motor functioning in infants, children, and adults with autism spectrum disorders. Phys Ther 2011; 91(7): 1116–29.CrossRefGoogle ScholarPubMed
Lidstone, DE, Mostofsky, SH. Moving toward understanding autism: visual-motor integration, imitation, and social skill development. Pediatr Neurol 2021; 122: 98105.CrossRefGoogle ScholarPubMed
Ament, K, Mejia, A, Buhlman, R, Erklin, S, Caffo, B, Mostofsky, S, et al. Evidence for specificity of motor impairments in catching and balance in children with autism. J Autism Dev Disord 2015; 45(3): 742–51.CrossRefGoogle ScholarPubMed
MacNeil, LK, Mostofsky, SH. Specificity of dyspraxia in children with autism. Neuropsychology 2012; 26(2): 165–71.CrossRefGoogle ScholarPubMed
Izawa, J, Pekny, SE, Marko, MK, Haswell, CC, Shadmehr, R, Mostofsky, SH. Motor learning relies on integrated sensory inputs in ADHD, but over-selectively on proprioception in autism spectrum conditions. Autism Res 2012; 5(2): 124–36.CrossRefGoogle ScholarPubMed
Haswell, C, Izawa, J, Dowell, L, Mostofsky, SH, Shadmehr, R. Representation of internal models of action in the autistic brain. Nat Neurosci 2009; 12(8): 970–2.CrossRefGoogle ScholarPubMed
Tunçgenç, B, Pacheco, C, Rochowiak, R, Nicholas, R, Rengarajan, S, Zou, E, et al. Computerized assessment of motor imitation as a scalable method for distinguishing children with autism. Biol Psychiatry Cogn Neurosci Neuroimag 2021; 6(3): 321–8.Google ScholarPubMed
Lidstone, DE, Rochowiak, R, Pacheco, C, Tunçgenç, B, Vidal, R, Mostofsky, SH. Automated and scalable computerized assessment of motor imitation (CAMI) in children with autism spectrum disorder using a single 2D camera: a pilot study. Res Autism Spectr Disord 2021; 87: 101840.CrossRefGoogle ScholarPubMed
Rechetnikov, RP, Maitra, K. Motor impairments in children associated with impairments of speech or language: a meta-analytic review of research literature. Am J Occup Ther 2009; 63: 255–63.CrossRefGoogle ScholarPubMed
Wilson, PH, Ruddock, S, Smits-Engelsman, B, Polatajko, H, Blank, R. Understanding performance deficits in developmental coordination disorder: a meta-analysis of recent research. Dev Med Child Neurol 2013; 55: 217–28.CrossRefGoogle ScholarPubMed
Athanasiadou, A, Buitelaar, JK, Brovedani, P, Chorna, O, Fulceri, F, Guzzetta, A, et al. Early motor signs of attention-deficit hyperactivity disorder: a systematic review. Eur Child Adolesc Psychiatry 2020; 29: 903–16.CrossRefGoogle ScholarPubMed
Lord, C, Rutter, M, DiLavore, PC, Risi, S, Gotham, K, Bishop, SL. Autism Diagnostic Observation Schedule (ADOS-2), Part 1: Modules 1 - 4 (2nd edn). Western Psychological Services, 2012.Google Scholar
Kaufman, J, Birmaher, B, Brent, D, Rao, U, Flynn, C, Moreci, P, et al. Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry 1997; 36(7): 980–8.CrossRefGoogle ScholarPubMed
Conners, CK. Conners 3rd Edition. Multi-Health Systems, 2008.Google Scholar
Wechsler, D. Wechsler Intelligence Scale for Children 5th Edition (5th edn). NCS, Pearson, 2014.Google Scholar
Constantino, JN, Gruber, CP. Social Responsiveness Scale, Second Edition (SRS-2). Pearson, 2012.Google Scholar
Denckla, MB. Revised neurological examination for subtle signs. Psychopharmacol Bull 1985; 21(4): 773800.Google ScholarPubMed
Mandelbaum, DE, Stevens, M, Rosenberg, E, Wiznitzer, M, Steinschneider, M, Filipek, P, et al. Sensorimotor performance in school-age children with autism, developmental language disorder, or low IQ. Dev Med Child Neurol 2006; 48(1): 33–9.CrossRefGoogle ScholarPubMed
Jansiewicz, EM, Goldberg, MC, Newschaffer, CJ, Denckla, MB, Landa, R, Mostofsky, SH. Motor signs distinguish children with high functioning autism and Asperger's syndrome from controls. J Autism Dev Disord 2006; 36(5): 613–21.CrossRefGoogle ScholarPubMed
Mostofsky, SH, Newschaffer, CJ, Denckla, MB. Overflow movements predict impaired response inhibition in children with ADHD. Percept Mot Skills 2003; 97: 1315–31.CrossRefGoogle ScholarPubMed
Bates, D, Mächler, M, Bolker, BM, Walker, SC. Fitting linear mixed-effects models using lme4. J Stat Softw 2015; 67(1): 148.CrossRefGoogle Scholar
Wickham, H, Vaughan, D, Girlich, M. tidyr: Tidy Messy Data. R package version 1.3.1, 2024 (https://tidyr.tidyverse.org).Google Scholar
Raudys, S. On dimensionality, sample size, and classification error of nonparametric linear classification algorithms. IEEE Trans Pattern Anal Mach Intell 1997; 19(6): 667–71.CrossRefGoogle Scholar
Pittet, I, Kojovic, N, Franchini, M, Schaer, M. Trajectories of imitation skills in preschoolers with autism spectrum disorders. J Neurodev Disord 2022; 14(1): 113.CrossRefGoogle ScholarPubMed
Zachor, DA, Ilanit, T, Itzchak, EB. Autism severity and motor abilities correlates of imitation situations in children with autism spectrum disorders. Res Autism Spectr Disord 2010; 4(3): 438–43.CrossRefGoogle Scholar
Wang, Y, de Hamilton, AFC. Social top-down response modulation (STORM): a model of the control of mimicry in social interaction. Front Hum Neurosci 2012; 6: 153.CrossRefGoogle Scholar
Iacoboni, M. Neural mechanisms of imitation. Curr Opin Neurobiol 2005; 15(6): 632–7.CrossRefGoogle ScholarPubMed
Lemler, M. Discrepancy between parent report and clinician observation of symptoms in children with autism spectrum disorders. Discussions 2013; 8: 2.Google Scholar
van ‘t Hof, M, Tisseur, C, van Berckelear-Onnes, I, van Nieuwenhuyzen, A, Daniels, AM, Deen, M, et al. Age at autism spectrum disorder diagnosis: a systematic review and meta-analysis from 2012 to 2019. Autism 2021; 25(4): 862–73.CrossRefGoogle ScholarPubMed
Figure 0

Table 1 Sample characteristics of each group

Figure 1

Fig. 1 Imitation performance across diagnostic groups (nADHD = 35, nASD + ADHD = 63, nASD-only = 20, nneurotypical = 65). Horizontal lines inside the box plots show the median, black diamonds show the mean and the dots show individual data points within each diagnostic group. ADHD, attention-deficit hyperactivity disorder; ASD, autism spectrum disorder; CAMI, Computerised Assessment of Motor Imitation. *P < 0.01, **P < 0.0001.

Figure 2

Fig. 2 Associations of imitation with ASD traits, ADHD traits and motor ability. Scatter plots showing associations of the CAMI with (a) SRS-2 total scores, (b) PANESS total scores, (c) Conners inattention scores, (b) Conners-3 hyperactivity/impulsivity scores and (e) ADOS-2 restricted and repetitive behaviours and social affect subscales and total scores. Colour codes for the groups are as follows: light blue for ADHD (n = 35), black for combined ASD (n = 84), dark blue for neurotypical (n = 65), light blue for ASD + ADHD (n = 63) and dark blue for ASD only (n = 20). ADHD, attention-deficit hyperactivity disorder; ASD, autism spectrum disorder; ADOS-2, Autism Diagnostic Observation Schedule-Second Edition; CAMI, Computerised Assessment of Motor Imitation; PANESS, Physical and Neurological Examination for Soft Signs; RRB, restricted and repetitive behaviours; SRS-2, Social Responsiveness Scale-Second Edition.

Figure 3

Fig. 3 Diagnostic classification ability of the CAMI confirmed by two complementary methods. (a) Receiver operating curve reveals high true positive rates (area under the curve) for distinguishing children with ASD (n = 84) from neurotypical children (n = 65) is 80%, and from children with ADHD (n = 33) is 70%. (b) Three-fold cross-validated support vector machine results show high classification accuracy for distinguishing children with ASD from neurotypical children (72%) and children with ADHD (66%). ADHD, attention-deficit hyperactivity disorder; ASD, autism spectrum disorder; AUC, area under the curve; CAMI, Computerised Assessment of Motor Imitation.

Submit a response

eLetters

No eLetters have been published for this article.