Dataset Information

Measuring treatment response in children with autism spectrum disorder: Applications of the Brief Observation of Social Communication Change to the Autism Diagnostic Observation Schedule.

ABSTRACT: This study aims to determine the validity and reliability of applying the coding strategy from the Brief Observation of Social Communication Change, a newly validated treatment outcome measure, to videotaped segments of the Autism Diagnostic Observation Schedule. Results indicate strong reliability and validity of the Brief Observation of Social Communication Change ratings using the Autism Diagnostic Observation Schedule segments in detecting changes in social communication over the course of treatment in young, minimally verbal children with autism spectrum disorder. Results also suggest that the Brief Observation of Social Communication Change, when applied to Autism Diagnostic Observation Schedule segments, may be more sensitive in detecting subtle changes in social communication compared to the Autism Diagnostic Observation Schedule Calibrated Severity Scores. These results may support the application of the Brief Observation of Social Communication Change to pre-existing datasets of Autism Diagnostic Observation Schedule videos to examine treatment responses.

SUBMITTER: Kim SH

PROVIDER: S-EPMC6522321 | biostudies-literature | 2019 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring treatment response in children with autism spectrum disorder: Applications of the Brief Observation of Social Communication Change to the Autism Diagnostic Observation Schedule.

Kim So Hyun SH Grzadzinski Rebecca R Martinez Kassandra K Lord Catherine C

Autism : the international journal of research and practice 20181010 5

This study aims to determine the validity and reliability of applying the coding strategy from the Brief Observation of Social Communication Change, a newly validated treatment outcome measure, to videotaped segments of the Autism Diagnostic Observation Schedule. Results indicate strong reliability and validity of the Brief Observation of Social Communication Change ratings using the Autism Diagnostic Observation Schedule segments in detecting changes in social communication over the course of t ...[more]

PMID: 30303398

Similar Datasets

Project description:Measuring outcomes for autistic children following social communication interventions is an ongoing challenge given the heterogeneous changes, which can be subtle. We tested and compared the overall and item-level intervention effects of the Brief Observation of Social Communication Change (BOSCC), Autism Diagnostic Observation Schedule (ADOS-2) algorithm, and ADOS-2 Calibrated Severity Scores (CSS) with autistic children aged 2-5 years from the Preschool Autism Communication Trial (PACT). The BOSCC was applied to Module 1 ADOS assessments (ADOS-BOSCC). Among the 117 children using single or no words (Module 1), the ADOS-BOSCC, ADOS algorithm, and ADOS CSS each detected small non-significant intervention effects. However, on the ADOS algorithm, there was a medium significant intervention effect for children with "few to no words" at baseline, while children with "some words" showed little intervention effect. For the full PACT sample (including ADOS Module 2, total n=152), ADOS metrics evidenced significant small (CSS) and medium (algorithm) overall intervention effects. None of the Module 1 item-level intervention effects reached significance, with largest changes observed for Gesture (ADOS-BOSCC and ADOS), Facial Expressions (ADOS), and Intonation (ADOS). Significant ADOS Module 2 item-level effects were observed for Mannerisms and Repetitive Interests and Stereotyped Behaviors. Despite strong psychometric properties, the ADOS-BOSCC was not more sensitive to behavioral changes than the ADOS among Module 1 children. Our results suggest the ADOS can be a sensitive outcome measure. Item-level intervention effect plots have the potential to indicate intervention "signatures of change," a concept that may be useful in future trials and systematic reviews. LAY SUMMARY: This study compares two outcome measures in a parent-mediated therapy. Neither was clearly better or worse than the other; however, the Autism Diagnostic Observation Schedule produced somewhat clearer evidence than the Brief Observation of Social Communication Change of improvement among children who had use of "few to no" words at the start. We explore which particular behaviors are associated with greater improvement. These findings can inform researchers when they consider how best to explore the impact of their intervention.

Project description:ImportanceAutism spectrum disorder (ASD) affects 1 in 44 children. The Autism Diagnostic Observation Schedule (ADOS) is a semi-structured observation developed for use in research but is considered a component of gold standard clinical diagnosis. The ADOS adds time and cost to diagnostic assessments.ObjectiveTo evaluate consistency between clinical diagnosis (index ASD diagnosis) and diagnosis incorporating the ADOS (reference standard ASD diagnosis) and to examine clinician and child factors that predict consistency between index diagnoses and reference standard diagnoses.Design, setting, and participantsThis prospective diagnostic study was conducted between May 2019 and February 2020. Developmental-behavioral pediatricians (DBPs) made a diagnosis based on clinical assessment (index ASD diagnosis). The ADOS was then administered, after which the DBP made a second diagnosis (reference standard ASD diagnosis). DBPs self-reported diagnostic certainty at the time of the index diagnoses and reference standard diagnoses. The study took place at 8 sites (7 US and 1 European) that provided subspecialty assessments for children with concerns for ASD. Participants included children aged 18 months to 5 years, 11 months, without a prior ASD diagnosis, consecutively referred for possible ASD. Among 648 eligible children, 23 refused, 376 enrolled, and 349 completed the study. All 40 eligible DBPs participated.ExposuresADOS administered to all child participants.Main outcomes and measuresIndex diagnoses and reference standard diagnoses of ASD (yes/no).ResultsAmong the 349 children (279 [79.7%] male; mean [SD] age, 39.9 [13.4] months), index diagnoses and reference standard diagnoses were consistent for 314 (90%) (ASD = 250; not ASD = 64) and changed for 35. Clinician diagnostic certainty was the most sensitive and specific predictor of diagnostic consistency (area under curve = 0.860; P < .001). In a multilevel logistic regression, no child or clinician factors improved prediction of diagnostic consistency based solely on clinician diagnostic certainty at time of index diagnosis.Conclusions and relevanceIn this prospective diagnostic study, clinical diagnoses of ASD by DBPs with vs without the ADOS were consistent in 90.0% of cases. Clinician diagnostic certainty predicted consistency of index diagnoses and reference standard diagnoses. This study suggests that the ADOS is generally not required for diagnosis of ASD in young children by DBPs and that DBPs can identify children for whom the ADOS may be needed.

Project description:BackgroundExploring ways to improve the trajectory and symptoms of autism spectrum disorder is prevalent in research, but less is known about the natural prognosis of autism spectrum disorder and course of symptoms. The objective of this study was to examine the temporal stability of autism spectrum disorder and autism diagnosis, and the longitudinal trajectories of autism core symptom severity. We furthermore sought to identify possible predictors for change.MethodsWe searched PubMed, PsycInfo, EMBASE, Web of Science, Cochrane Library up to October 2015 for prospective cohort studies addressing the autism spectrum disorder/autism diagnostic stability, and prospective studies of intervention effects. We included people of all ages with autism spectrum disorder/autism or at risk of having autism spectrum disorder, who were diagnosed and followed up for at least 12 months using the Autism Diagnostic Observation Schedule (ADOS). Both continuous ADOS scores and dichotomous diagnostic categories were pooled in random-effects meta-analysis and meta-regression.ResultsOf 1443 abstracts screened, 44 were eligible of which 40 studies contained appropriate data for meta-analysis. A total of 5771 participants from 7 months of age to 16.5 years were included. Our analyses showed no change in ADOS scores across time as measured by Calibrated Severity Scores (mean difference [MD] = 0.05, 95% CI -0.26 to 0.36). We observed a minor but statistically significant change in ADOS total raw scores (MD = -1.51, 95% CI -2.70 to -0.32). There was no improvement in restricted and repetitive behaviours (standardised MD [SMD] = -0.04, 95% CI -0.19 to 0.11), but a minor improvement in social affect over time (SMD = -0.31, 95% CI -0.50 to -0.12). No changes were observed for meeting the autism spectrum disorder criteria over time (risk difference [RD] = -0.01, 95% CI -0.03 to 0.01), but a significant change for meeting autism criteria over time (RD = -0.18, 95% CI -0.29 to -0.07). On average, there was a high heterogeneity between studies (I2 range: 65.3% to 93.1%).DiscussionWhile 18% of participants shifted from autism to autism spectrum disorder diagnosis, the overall autism spectrum disorder prevalence was unchanged. Overall autism core symptoms were remarkably stable over time across childhood indicating that intervention studies should focus on other areas, such as quality of life and adaptive functioning. However, due to high heterogeneity between studies and a number of limitations in the studies, the results need to be interpreted with caution.

Project description:The Rapid Interactive screening Test for Autism in Toddlers (RITA-T) is a fast and inexpensive early screening measure for autism spectrum disorder (ASD) that was tested previously in children 18-36 months-old; the current validation study compared the RITA-T with the Autism Diagnostic Observation Schedule™ Second Edition (ADOS-2). The hypothesis is to validate the RITA-T with comparison to the ADOS-2. Thirty-five individuals (18-84 months-old) identified as at risk for ASD received the RITA-T and the ADOS-2 during a single visit. Participants were split into two age groups and both whole-group and sub-group data analysis were conducted. With all participants, RITA-T scores correlated significantly with ADOS-2 total scores (P < 0.001), social affect (SA) sub-scores (P < 0.001), and restrictive and repetitive behavior (RRB) sub-scores (P < 0.05). Similarly, ADOS-2 total and SA scores were significantly correlated in both age groups, while the RRB sub-score was only significant in females (P < 0.05). Lastly, correlations using subgroups based on ethnicity were only significant in the minority ("Other") group for ADOS-2 total scores and in the Asian group for SA sub-scores (P < 0.05). Our receiver operating characteristic analysis showed that the optimal cut-off score of the RITA-T was consistently at 14, with a sensitivity of 81% and a specificity of 89% in the combined age group with the ADOS-2 and with a sensitivity 74% and specificity 50% with the DSM-5; The area under the curve was 0.84 (95%CI: 0.69-0.99) for ASD classified by ADOS-2 and 0.89 (95%CI: 0.79-0.99) for ASD diagnosed by DSM-5. The RITA-T performed similarly to the ADOS-2 when both were administered in a single visit. Significant correlations between the measures help validate the potential usefulness of the RITA-T as a rapid early screening measure of ASD. This study helps to show that the RITA-T may be used in a larger age range than originally reported and in different ethnic groups. The study involves human participants and was reviewed and approved by the Institutional Review Board (IRB) of Massachusetts General Hospital (MGH, 2017P0000857).

Project description:ImportanceThere are long-standing disparities in the prevalence of autism spectrum disorder (ASD) across race and sex. Surprisingly, few studies have examined whether these disparities arise partially out of systematic biases in the Autism Diagnostic Observation Schedule, Second Edition (ADOS-2), the reference standard measure of ASD.ObjectiveTo examine differential item functioning (DIF) of ADOS-2 items across sex and race.Design, setting, and participantsThis is a cross-sectional study of children who were evaluated for ASD between 2014 and 2020 at a specialty outpatient clinic located in the Mid-Atlantic region of the US. Data were analyzed from July 2021 to February 2022.ExposuresChild race (Black/African American vs White) and sex (female vs male).Main outcomes and measuresItem-level biases across ADOS-2 harmonized algorithm items, including social affect (SA; 10 items) and repetitive/restricted behaviors (RRBs; 4 items), were evaluated across 3 modules. Measurement bias was identified by examining DIF and differential test functioning (DTF), within a graded response, item response theory framework. Statistical significance was determined by a likelihood ratio χ2 test, and a series of metrics was used to examine the magnitude of DIF and DTF.ResultsA total of 6269 children (mean [SD] age, 6.77 [3.27] years; 1619 Black/African American [25.9%], 3151 White [50.3%], and 4970 male [79.4%]), were included in this study. Overall, 16 of 140 ADOS-2 diagnostic items (11%) had a significant DIF. For race, 8 items had a significant DIF, 6 of which involved SA. No single item showed DIF consistently across all modules. Most items with DIF had greater difficulty and poorer discrimination in Black/African American children compared with White children. For sex, 5 items showed significant DIF. DIF was split across SA and RRB. However, hand mannerisms evidenced DIF across all 5 algorithms, with generally greater difficulty. The magnitude of DIF was only moderate to large for 2 items: hand mannerisms (among female children) and repetitive interests (among Black/African American children). The overall estimated effect of DIF on total DTF was not large.Conclusions and relevanceThese findings suggest that the ADOS-2 does not have widespread systematic measurement bias across race or sex. However, the findings raise some concerns around underdetection that warrant further research.

Dataset Information

Measuring treatment response in children with autism spectrum disorder: Applications of the Brief Observation of Social Communication Change to the Autism Diagnostic Observation Schedule.

Publications

Measuring treatment response in children with autism spectrum disorder: Applications of the Brief Observation of Social Communication Change to the Autism Diagnostic Observation Schedule.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets