Dataset Information

Diagnostic validity of Autism Diagnostic Observation Schedule, second edition (K-ADOS-2) in the Korean population.

ABSTRACT:

Background

Although the Korean version of the Autism Diagnostic Observation Schedule-2 (K-ADOS-2) is widely being used to diagnose autism spectrum disorder (ASD) in South Korea, no previous study has examined the validity and reliability of all modules of K-ADOS-2 across a wide age range, particularly older children, adolescents, and adults.

Method

Data from 2,158 participants were included (mean age = 79.7 months; 73.6% male): 1473 participants with ASD and 685 participants without ASD (Toddler Module, n = 289; Module 1, n = 642; Module 2 n = 574; Module 3 n = 411; Module 4, n = 242). Participants completed a battery of tests, including the K-ADOS or K-ADOS-2 and other existing diagnostic instruments. Sensitivity, specificity, area under the receiver operating characteristic (ROC) curve, positive predictive value (PPV), negative predictive value (NPV), Cohen's kappa (k), and agreement with existing diagnostic instruments were computed. Cronbach's α values were also calculated.

Results

All developmental cells of the K-ADOS-2 showed sufficient ranges of sensitivity 85.4-100.0%; specificity, 80.4-96.8%; area under the ROC curve, .90-.97; PPV, 77.8-99.3%; NPV, 80.6-100.0%; and k values, .83-.92. The kappa agreements of developmental cells with existing diagnostic instruments ranged from .20 to .90. Cronbach's α values ranged from .82 to .91 across all developmental cells.

Limitation

The best-estimate clinical diagnoses made in this study were not independent of the K-ADOS-2 scores. Some modules did not include balanced numbers of participants in terms of gender and diagnostic status.

Conclusion

The K-ADOS-2 is a valid and reliable instrument in diagnosing ASD in South Korea. Future studies exploring the effectiveness of the K-ADOS-2 in capturing restricted, repetitive behaviors and differentiating ASD from other developmental disabilities are needed.

SUBMITTER: Kim SY

PROVIDER: S-EPMC9245227 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ImportanceThere are long-standing disparities in the prevalence of autism spectrum disorder (ASD) across race and sex. Surprisingly, few studies have examined whether these disparities arise partially out of systematic biases in the Autism Diagnostic Observation Schedule, Second Edition (ADOS-2), the reference standard measure of ASD.ObjectiveTo examine differential item functioning (DIF) of ADOS-2 items across sex and race.Design, setting, and participantsThis is a cross-sectional study of children who were evaluated for ASD between 2014 and 2020 at a specialty outpatient clinic located in the Mid-Atlantic region of the US. Data were analyzed from July 2021 to February 2022.ExposuresChild race (Black/African American vs White) and sex (female vs male).Main outcomes and measuresItem-level biases across ADOS-2 harmonized algorithm items, including social affect (SA; 10 items) and repetitive/restricted behaviors (RRBs; 4 items), were evaluated across 3 modules. Measurement bias was identified by examining DIF and differential test functioning (DTF), within a graded response, item response theory framework. Statistical significance was determined by a likelihood ratio χ2 test, and a series of metrics was used to examine the magnitude of DIF and DTF.ResultsA total of 6269 children (mean [SD] age, 6.77 [3.27] years; 1619 Black/African American [25.9%], 3151 White [50.3%], and 4970 male [79.4%]), were included in this study. Overall, 16 of 140 ADOS-2 diagnostic items (11%) had a significant DIF. For race, 8 items had a significant DIF, 6 of which involved SA. No single item showed DIF consistently across all modules. Most items with DIF had greater difficulty and poorer discrimination in Black/African American children compared with White children. For sex, 5 items showed significant DIF. DIF was split across SA and RRB. However, hand mannerisms evidenced DIF across all 5 algorithms, with generally greater difficulty. The magnitude of DIF was only moderate to large for 2 items: hand mannerisms (among female children) and repetitive interests (among Black/African American children). The overall estimated effect of DIF on total DTF was not large.Conclusions and relevanceThese findings suggest that the ADOS-2 does not have widespread systematic measurement bias across race or sex. However, the findings raise some concerns around underdetection that warrant further research.

Project description:The Rapid Interactive screening Test for Autism in Toddlers (RITA-T) is a fast and inexpensive early screening measure for autism spectrum disorder (ASD) that was tested previously in children 18-36 months-old; the current validation study compared the RITA-T with the Autism Diagnostic Observation Schedule™ Second Edition (ADOS-2). The hypothesis is to validate the RITA-T with comparison to the ADOS-2. Thirty-five individuals (18-84 months-old) identified as at risk for ASD received the RITA-T and the ADOS-2 during a single visit. Participants were split into two age groups and both whole-group and sub-group data analysis were conducted. With all participants, RITA-T scores correlated significantly with ADOS-2 total scores (P < 0.001), social affect (SA) sub-scores (P < 0.001), and restrictive and repetitive behavior (RRB) sub-scores (P < 0.05). Similarly, ADOS-2 total and SA scores were significantly correlated in both age groups, while the RRB sub-score was only significant in females (P < 0.05). Lastly, correlations using subgroups based on ethnicity were only significant in the minority ("Other") group for ADOS-2 total scores and in the Asian group for SA sub-scores (P < 0.05). Our receiver operating characteristic analysis showed that the optimal cut-off score of the RITA-T was consistently at 14, with a sensitivity of 81% and a specificity of 89% in the combined age group with the ADOS-2 and with a sensitivity 74% and specificity 50% with the DSM-5; The area under the curve was 0.84 (95%CI: 0.69-0.99) for ASD classified by ADOS-2 and 0.89 (95%CI: 0.79-0.99) for ASD diagnosed by DSM-5. The RITA-T performed similarly to the ADOS-2 when both were administered in a single visit. Significant correlations between the measures help validate the potential usefulness of the RITA-T as a rapid early screening measure of ASD. This study helps to show that the RITA-T may be used in a larger age range than originally reported and in different ethnic groups. The study involves human participants and was reviewed and approved by the Institutional Review Board (IRB) of Massachusetts General Hospital (MGH, 2017P0000857).

Project description:ImportanceAutism spectrum disorder (ASD) affects 1 in 44 children. The Autism Diagnostic Observation Schedule (ADOS) is a semi-structured observation developed for use in research but is considered a component of gold standard clinical diagnosis. The ADOS adds time and cost to diagnostic assessments.ObjectiveTo evaluate consistency between clinical diagnosis (index ASD diagnosis) and diagnosis incorporating the ADOS (reference standard ASD diagnosis) and to examine clinician and child factors that predict consistency between index diagnoses and reference standard diagnoses.Design, setting, and participantsThis prospective diagnostic study was conducted between May 2019 and February 2020. Developmental-behavioral pediatricians (DBPs) made a diagnosis based on clinical assessment (index ASD diagnosis). The ADOS was then administered, after which the DBP made a second diagnosis (reference standard ASD diagnosis). DBPs self-reported diagnostic certainty at the time of the index diagnoses and reference standard diagnoses. The study took place at 8 sites (7 US and 1 European) that provided subspecialty assessments for children with concerns for ASD. Participants included children aged 18 months to 5 years, 11 months, without a prior ASD diagnosis, consecutively referred for possible ASD. Among 648 eligible children, 23 refused, 376 enrolled, and 349 completed the study. All 40 eligible DBPs participated.ExposuresADOS administered to all child participants.Main outcomes and measuresIndex diagnoses and reference standard diagnoses of ASD (yes/no).ResultsAmong the 349 children (279 [79.7%] male; mean [SD] age, 39.9 [13.4] months), index diagnoses and reference standard diagnoses were consistent for 314 (90%) (ASD = 250; not ASD = 64) and changed for 35. Clinician diagnostic certainty was the most sensitive and specific predictor of diagnostic consistency (area under curve = 0.860; P < .001). In a multilevel logistic regression, no child or clinician factors improved prediction of diagnostic consistency based solely on clinician diagnostic certainty at time of index diagnosis.Conclusions and relevanceIn this prospective diagnostic study, clinical diagnoses of ASD by DBPs with vs without the ADOS were consistent in 90.0% of cases. Clinician diagnostic certainty predicted consistency of index diagnoses and reference standard diagnoses. This study suggests that the ADOS is generally not required for diagnosis of ASD in young children by DBPs and that DBPs can identify children for whom the ADOS may be needed.

Project description:Measuring outcomes for autistic children following social communication interventions is an ongoing challenge given the heterogeneous changes, which can be subtle. We tested and compared the overall and item-level intervention effects of the Brief Observation of Social Communication Change (BOSCC), Autism Diagnostic Observation Schedule (ADOS-2) algorithm, and ADOS-2 Calibrated Severity Scores (CSS) with autistic children aged 2-5 years from the Preschool Autism Communication Trial (PACT). The BOSCC was applied to Module 1 ADOS assessments (ADOS-BOSCC). Among the 117 children using single or no words (Module 1), the ADOS-BOSCC, ADOS algorithm, and ADOS CSS each detected small non-significant intervention effects. However, on the ADOS algorithm, there was a medium significant intervention effect for children with "few to no words" at baseline, while children with "some words" showed little intervention effect. For the full PACT sample (including ADOS Module 2, total n=152), ADOS metrics evidenced significant small (CSS) and medium (algorithm) overall intervention effects. None of the Module 1 item-level intervention effects reached significance, with largest changes observed for Gesture (ADOS-BOSCC and ADOS), Facial Expressions (ADOS), and Intonation (ADOS). Significant ADOS Module 2 item-level effects were observed for Mannerisms and Repetitive Interests and Stereotyped Behaviors. Despite strong psychometric properties, the ADOS-BOSCC was not more sensitive to behavioral changes than the ADOS among Module 1 children. Our results suggest the ADOS can be a sensitive outcome measure. Item-level intervention effect plots have the potential to indicate intervention "signatures of change," a concept that may be useful in future trials and systematic reviews. LAY SUMMARY: This study compares two outcome measures in a parent-mediated therapy. Neither was clearly better or worse than the other; however, the Autism Diagnostic Observation Schedule produced somewhat clearer evidence than the Brief Observation of Social Communication Change of improvement among children who had use of "few to no" words at the start. We explore which particular behaviors are associated with greater improvement. These findings can inform researchers when they consider how best to explore the impact of their intervention.