S-EPMC7711822 - Digitized Autism Observation Diagnostic Schedule: Social Interactions beyond the Limits of the Naked Eye. - OmicsDI

Unknown

Dataset Information

Digitized Autism Observation Diagnostic Schedule: Social Interactions beyond the Limits of the Naked Eye.

ABSTRACT: The complexity and non-linear dynamics of socio-motor phenomena underlying social interactions are often missed by observation methods that attempt to capture, describe, and rate the exchange in real time. Unknowingly to the rater, socio-motor behaviors of a dyad exert mutual influence over each other through subliminal mirroring and shared cohesiveness that escape the naked eye. Implicit in these ratings nonetheless is the assumption that the other participant of the social dyad has an identical nervous system as that of the interlocutor, and that sensory-motor information is processed similarly by both agents' brains. What happens when this is not the case? We here use the Autism Diagnostic Observation Schedule (ADOS) to formally study social dyadic interactions, at the macro- and micro-level of behaviors, by combining observation with digital data from wearables. We find that integrating subjective and objective data reveals fundamentally new ways to improve standard clinical tools, even to differentiate females from males using the digital version of the test. More generally, this work offers a way to turn a traditional, gold-standard clinical instrument into an objective outcome measure of human social behaviors and treatment effectiveness.

SUBMITTER: Bokadia H

PROVIDER: S-EPMC7711822 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

altmetric image

Publications

Digitized Autism Observation Diagnostic Schedule: Social Interactions beyond the Limits of the Naked Eye.

Bokadia Harshit H Rai Richa R Torres Elizabeth Barbara EB

Journal of personalized medicine 20201008 4

The complexity and non-linear dynamics of socio-motor phenomena underlying social interactions are often missed by observation methods that attempt to capture, describe, and rate the exchange in real time. Unknowingly to the rater, socio-motor behaviors of a dyad exert mutual influence over each other through subliminal mirroring and shared cohesiveness that escape the naked eye. Implicit in these ratings nonetheless is the assumption that the other participant of the social dyad has an identica ...[more]

Similar Datasets

Project description:Measuring outcomes for autistic children following social communication interventions is an ongoing challenge given the heterogeneous changes, which can be subtle. We tested and compared the overall and item-level intervention effects of the Brief Observation of Social Communication Change (BOSCC), Autism Diagnostic Observation Schedule (ADOS-2) algorithm, and ADOS-2 Calibrated Severity Scores (CSS) with autistic children aged 2-5 years from the Preschool Autism Communication Trial (PACT). The BOSCC was applied to Module 1 ADOS assessments (ADOS-BOSCC). Among the 117 children using single or no words (Module 1), the ADOS-BOSCC, ADOS algorithm, and ADOS CSS each detected small non-significant intervention effects. However, on the ADOS algorithm, there was a medium significant intervention effect for children with "few to no words" at baseline, while children with "some words" showed little intervention effect. For the full PACT sample (including ADOS Module 2, total n=152), ADOS metrics evidenced significant small (CSS) and medium (algorithm) overall intervention effects. None of the Module 1 item-level intervention effects reached significance, with largest changes observed for Gesture (ADOS-BOSCC and ADOS), Facial Expressions (ADOS), and Intonation (ADOS). Significant ADOS Module 2 item-level effects were observed for Mannerisms and Repetitive Interests and Stereotyped Behaviors. Despite strong psychometric properties, the ADOS-BOSCC was not more sensitive to behavioral changes than the ADOS among Module 1 children. Our results suggest the ADOS can be a sensitive outcome measure. Item-level intervention effect plots have the potential to indicate intervention "signatures of change," a concept that may be useful in future trials and systematic reviews. LAY SUMMARY: This study compares two outcome measures in a parent-mediated therapy. Neither was clearly better or worse than the other; however, the Autism Diagnostic Observation Schedule produced somewhat clearer evidence than the Brief Observation of Social Communication Change of improvement among children who had use of "few to no" words at the start. We explore which particular behaviors are associated with greater improvement. These findings can inform researchers when they consider how best to explore the impact of their intervention.

Project description:ImportanceAutism spectrum disorder (ASD) affects 1 in 44 children. The Autism Diagnostic Observation Schedule (ADOS) is a semi-structured observation developed for use in research but is considered a component of gold standard clinical diagnosis. The ADOS adds time and cost to diagnostic assessments.ObjectiveTo evaluate consistency between clinical diagnosis (index ASD diagnosis) and diagnosis incorporating the ADOS (reference standard ASD diagnosis) and to examine clinician and child factors that predict consistency between index diagnoses and reference standard diagnoses.Design, setting, and participantsThis prospective diagnostic study was conducted between May 2019 and February 2020. Developmental-behavioral pediatricians (DBPs) made a diagnosis based on clinical assessment (index ASD diagnosis). The ADOS was then administered, after which the DBP made a second diagnosis (reference standard ASD diagnosis). DBPs self-reported diagnostic certainty at the time of the index diagnoses and reference standard diagnoses. The study took place at 8 sites (7 US and 1 European) that provided subspecialty assessments for children with concerns for ASD. Participants included children aged 18 months to 5 years, 11 months, without a prior ASD diagnosis, consecutively referred for possible ASD. Among 648 eligible children, 23 refused, 376 enrolled, and 349 completed the study. All 40 eligible DBPs participated.ExposuresADOS administered to all child participants.Main outcomes and measuresIndex diagnoses and reference standard diagnoses of ASD (yes/no).ResultsAmong the 349 children (279 [79.7%] male; mean [SD] age, 39.9 [13.4] months), index diagnoses and reference standard diagnoses were consistent for 314 (90%) (ASD = 250; not ASD = 64) and changed for 35. Clinician diagnostic certainty was the most sensitive and specific predictor of diagnostic consistency (area under curve = 0.860; P < .001). In a multilevel logistic regression, no child or clinician factors improved prediction of diagnostic consistency based solely on clinician diagnostic certainty at time of index diagnosis.Conclusions and relevanceIn this prospective diagnostic study, clinical diagnoses of ASD by DBPs with vs without the ADOS were consistent in 90.0% of cases. Clinician diagnostic certainty predicted consistency of index diagnoses and reference standard diagnoses. This study suggests that the ADOS is generally not required for diagnosis of ASD in young children by DBPs and that DBPs can identify children for whom the ADOS may be needed.

Project description:ImportanceThere are long-standing disparities in the prevalence of autism spectrum disorder (ASD) across race and sex. Surprisingly, few studies have examined whether these disparities arise partially out of systematic biases in the Autism Diagnostic Observation Schedule, Second Edition (ADOS-2), the reference standard measure of ASD.ObjectiveTo examine differential item functioning (DIF) of ADOS-2 items across sex and race.Design, setting, and participantsThis is a cross-sectional study of children who were evaluated for ASD between 2014 and 2020 at a specialty outpatient clinic located in the Mid-Atlantic region of the US. Data were analyzed from July 2021 to February 2022.ExposuresChild race (Black/African American vs White) and sex (female vs male).Main outcomes and measuresItem-level biases across ADOS-2 harmonized algorithm items, including social affect (SA; 10 items) and repetitive/restricted behaviors (RRBs; 4 items), were evaluated across 3 modules. Measurement bias was identified by examining DIF and differential test functioning (DTF), within a graded response, item response theory framework. Statistical significance was determined by a likelihood ratio χ2 test, and a series of metrics was used to examine the magnitude of DIF and DTF.ResultsA total of 6269 children (mean [SD] age, 6.77 [3.27] years; 1619 Black/African American [25.9%], 3151 White [50.3%], and 4970 male [79.4%]), were included in this study. Overall, 16 of 140 ADOS-2 diagnostic items (11%) had a significant DIF. For race, 8 items had a significant DIF, 6 of which involved SA. No single item showed DIF consistently across all modules. Most items with DIF had greater difficulty and poorer discrimination in Black/African American children compared with White children. For sex, 5 items showed significant DIF. DIF was split across SA and RRB. However, hand mannerisms evidenced DIF across all 5 algorithms, with generally greater difficulty. The magnitude of DIF was only moderate to large for 2 items: hand mannerisms (among female children) and repetitive interests (among Black/African American children). The overall estimated effect of DIF on total DTF was not large.Conclusions and relevanceThese findings suggest that the ADOS-2 does not have widespread systematic measurement bias across race or sex. However, the findings raise some concerns around underdetection that warrant further research.

Project description:BackgroundExploring ways to improve the trajectory and symptoms of autism spectrum disorder is prevalent in research, but less is known about the natural prognosis of autism spectrum disorder and course of symptoms. The objective of this study was to examine the temporal stability of autism spectrum disorder and autism diagnosis, and the longitudinal trajectories of autism core symptom severity. We furthermore sought to identify possible predictors for change.MethodsWe searched PubMed, PsycInfo, EMBASE, Web of Science, Cochrane Library up to October 2015 for prospective cohort studies addressing the autism spectrum disorder/autism diagnostic stability, and prospective studies of intervention effects. We included people of all ages with autism spectrum disorder/autism or at risk of having autism spectrum disorder, who were diagnosed and followed up for at least 12 months using the Autism Diagnostic Observation Schedule (ADOS). Both continuous ADOS scores and dichotomous diagnostic categories were pooled in random-effects meta-analysis and meta-regression.ResultsOf 1443 abstracts screened, 44 were eligible of which 40 studies contained appropriate data for meta-analysis. A total of 5771 participants from 7 months of age to 16.5 years were included. Our analyses showed no change in ADOS scores across time as measured by Calibrated Severity Scores (mean difference [MD] = 0.05, 95% CI -0.26 to 0.36). We observed a minor but statistically significant change in ADOS total raw scores (MD = -1.51, 95% CI -2.70 to -0.32). There was no improvement in restricted and repetitive behaviours (standardised MD [SMD] = -0.04, 95% CI -0.19 to 0.11), but a minor improvement in social affect over time (SMD = -0.31, 95% CI -0.50 to -0.12). No changes were observed for meeting the autism spectrum disorder criteria over time (risk difference [RD] = -0.01, 95% CI -0.03 to 0.01), but a significant change for meeting autism criteria over time (RD = -0.18, 95% CI -0.29 to -0.07). On average, there was a high heterogeneity between studies (I2 range: 65.3% to 93.1%).DiscussionWhile 18% of participants shifted from autism to autism spectrum disorder diagnosis, the overall autism spectrum disorder prevalence was unchanged. Overall autism core symptoms were remarkably stable over time across childhood indicating that intervention studies should focus on other areas, such as quality of life and adaptive functioning. However, due to high heterogeneity between studies and a number of limitations in the studies, the results need to be interpreted with caution.