Dataset Information

Predictive validity of the Infant Toddler Checklist in primary care at the 18-month visit and developmental diagnosis at 3–5 years: a prospective cohort study

ABSTRACT:

Objective

There is international variation in recommendations regarding developmental screening and growing recognition of the low sensitivity of commonly used developmental screening tools. Our objective was to examine the predictive validity of the Infant Toddler Checklist (ITC) at 18 months to predict a developmental diagnosis at 3–5 years, in a primary care setting.

Methods

We designed a prospective cohort study, recruiting in primary care in Toronto, Canada. Parents completed the ITC at the 18-month visit and reported developmental diagnosis at 3–5 years (developmental delay, autism spectrum disorder (ASD), attention deficit hyperactivity disorder (ADHD), learning problem). We calculated screening test properties with 95% CIs. We used multivariable logistic regression analyses adjusted for important covariates.

Results

In the final sample (n=488), mean age at screening was 18.5 (SD 1.1) months, and at follow-up was 46.6 (SD 10.0) months. At screening, 46 (9.4%) had a positive ITC. At follow-up, 26 (5.3%) had a developmental diagnosis, including: developmental delay (n=22), ASD (n=4), ADHD (n=1), learning problem (n=1); parents of two children each reported two diagnoses (total of 28 diagnoses). Of four children with a diagnosis of ASD at follow-up, three had a positive ITC at 18 months. The ITC specificity (92%, 95% CI: 89% to 94%) and negative predictive value (96%, 95% CI: 95% to 97%) were high; false positive rate was low (8%, 95% CI: 6% to 11%); sensitivity was low (31%, 95% CI: 14% to 52%). There was a strong association between a positive ITC at 18 months and later developmental diagnosis (adjusted OR 4.48, 95% CI: 1.72 to 11.64; p=0.002).

Conclusion

The ITC had high specificity, high negative predictive value, low false positive rate, and identified children with later developmental delay and ASD. The ITC had low sensitivity, similar to other screening tools underscoring the importance of continuous developmental surveillance at all health supervision visits.

SUBMITTER: Borkhoff C

PROVIDER: S-EPMC9234802 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThere is a need for valid and reliable observational measures of early child development in low-income and middle-income country settings.MethodsThe aims of the study were to adapt the Bayley Scales of Infant Development (Bayley III) for a rural Ethiopian setting and evaluate reliability and validity. The study was carried out between January 2008 and January 2009 in the Butajira demographic surveillance site, south central Ethiopia. The Bayley III was adapted to be socioculturally appropriate for a rural Ethiopian context. Nurses and high school graduates were trained in administration of the measure for 10?days. Inter-rater reliability was evaluated (n?=?60). Content, construct and convergent validity was then examined on a population-based cohort of children at the ages of 30 (n?=?440) and 42?months (n?=?456). Mokken scale analysis was used to determine the scalability of items in unidimensional, hierarchical sub-scales. The mean score was compared by age of child and by stunting status (less than -2 z scores below the standard height-for-age).ResultsThe intra-class correlations between raters were above 0.90 for all sub-scales of the child development measure. Some scale items were not contextually relevant and showed poor scalability. However, the majority of items scaled onto the existing sub-scales of the international measure to form adequate-to-strong hierarchical scales with good internal consistency (Cronbach's ? above 0.70 except for gross motor and expressive language sub-scales). Item-scale coefficients were good. The mean score of all sub-scales was significantly higher in the older group of children (33.02 higher total score; P?<?0.001) and in the children who were stunted (total Bayley score 2.58 (95% confidence interval 0.07 to 5.10) points lower at 30?months and 3.87 (1.94 to 5.81) points lower at 42?months.ConclusionsAn adapted version of an international, observational measure of child development was found to be reliable, valid and feasible in a rural Ethiopian setting.

Project description:Developmental milestones are commonly used in child health care, although from many milestones the predictive validity has not been adequately assessed. We aimed to determine the predictive validity of 75 developmental milestones for detecting limited intellectual functioning that can be obtained before the age of 4 years. We performed a case-control study with 148 children aged 5-10 years with limited intellectual functioning (IQ 50-69), who were in special education (cases) and a random sample of 300 children aged 5-10 years who were in regular elementary education (controls). Developmental milestones scores were retrieved from Child Healthcare files. We calculated sensitivity, specificity, positive likelihood ratios (LR+) and diagnostic odds ratios (DOR) for limited intellectual functioning. The LR+ determines whether a test result changes the probability that a condition exists. Given the prevalence of intellectual disability (1-3%), we considered that an LR+ > 10 would be clinically useful, as it increases the a priori probability of limited intellectual functioning from 2% to a posteriori probability of at least 17%. Out of 75 assessed milestones, 50 were included in the analysis. We found nine milestones to have a significant adjusted (for socio-economic status and prematurity) DOR > 1 and a significant LR+ > 10 (assessment age in months between brackets): 'says "dada-baba? (9), 'balances head well while sitting' (9), 'sits on buttocks while legs stretched' (9), 'babbles while playing' (12), 'sits in stable position without support' (12), 'walks well alone' (24), 'says "sentences" of 3 or more words' (36), 'places 3 forms in form-box' (36) and 'copies circle' (48). Sensitivities of these 9 milestones varied from 8-54%, specificities of these 9 milestones varied from 95-100%. Combining these milestones at 9, 12, and 36 months respectively resulted in sensitivities of 27-60% and specificities of 94-99%. These nine developmental milestones have substantial predictive validity for limited intellectual functioning.

Project description:BackgroundPreterm infants and infants with perinatal brain injury show a higher incidence of neurodevelopmental disorders (NDD). The Infant Motor Profile (IMP) is a clinical assessment which evaluates the complexity of early motor behaviour. More data are needed to confirm its predictive ability and concurrent validity with other common and valid assessments such as the Alberta Infant Motor Scale (AIMS) and Prechtl's General Movement Assessment (GMA). The present study aims to evaluate the concurrent validity of the IMP with the AIMS, to assess its association with the GMA, to evaluate how the IMP reflects the severity of the brain injury and to compare the ability of the IMP and the AIMS to predict an abnormal outcome in 5-month-old infants at risk of NDD.Methods86 infants at risk of NDD were retrospectively recruited among the participants of two clinical trials. Preterm infants with or without perinatal brain injury and term infants with brain injury were assessed at 3?months corrected age (CA) using the GMA and at 5?months CA using the IMP and the AIMS. The neurodevelopmental outcome was established at 18?months.ResultsResults confirm a solid concurrent validity between the IMP Total Score and the AIMS (Spearman's ? 0.76; p?<?.001) and a significant association between IMP Total Score and the GMA. Unlike the AIMS, the IMP Total score accurately reflects the severity of neonatal brain injury (p?<?.001) and proves to be the strongest predictor of NDD (p?<?.001). The comparison of ?areas under receiver operating characteristic curves (AUC) confirms that the IMP Total score has the highest diagnostic accuracy at 5?months (AUC 0.92). For an optimal IMP Total Score cut-off value of 70, the assessment shows high sensitivity (93%) and specificity (81%) (PPV 84%; NPV 90%).ConclusionsEarly motor behaviour assessed with the IMP is strongly associated with middle-term neurodevelopmental outcome. The present study confirms the concurrent validity of the IMP with the AIMS, its association with the GMA and its ability to reflect brain lesion load, hence contributing to the construct validity of the assessment.Trial registrationNCT01990183 and NCT03234959 (clinicaltrials.gov).