Dataset Information

Predictive validity of preschool screening tools for language and behavioural difficulties: A PRISMA systematic review.

ABSTRACT: BACKGROUND:Preschool screening for developmental difficulties is increasingly becoming part of routine health service provision and yet the scope and validity of tools used within these screening assessments is variable. The aim of this review is to report on the predictive validity of preschool screening tools for language and behaviour difficulties used in a community setting. METHODS:Studies reporting the predictive validity of language or behaviour screening tools in the preschool years were identified through literature searches of Ovid Medline, Embase, EBSCO CINAHL, PsycInfo and ERIC. We selected peer-reviewed journal articles reporting the use of a screening tool for language or behaviour in a population-based sample of children aged 2-6 years of age, including a validated comparison diagnostic assessment and follow-up assessment for calculation of predictive validity. RESULTS:A total of eleven eligible studies was identified. Six studies reported language screening tools, two reported behaviour screening tools and three reported combined language & behaviour screening tools. The Language Development Survey (LDS) administered at age 2 years achieved the best predictive validity performance of the language screening tools (sens 67%, spec 94%, NPV 88% and PPV 80%). The Strengths and Difficulties Questionnaire (SDQ) administered at age 4 years achieved the best predictive validity compared to other behaviour screening tools (Sens 31%, spec 93%, NPV 84% and PPV 52%). The SDQ and Sure Start Language Measure (SSLM) administered at 2.5 years achieved the best predictive validity of the combined language & behaviour assessments (sens 87%, spec 64%, NPV 97% and PPV 31). Predictive validity data and diagnostic odds ratios identified language screening tools as more effective and achieving higher sensitivity and positive predictive value than either behaviour or combined screening tools. Screening tools with combined behaviour and language assessments were more specific and achieved higher negative predictive value than individual language or behaviour screening tools. Parent-report screening tools for language achieved higher sensitivity, specificity and negative predictive value than direct child assessment. CONCLUSIONS:Universal screening tools for language and behaviour concerns in preschool aged children used in a community setting can demonstrate excellent predictive validity, particularly when they utilise a parent-report assessment. Incorporating these tools into routine child health surveillance could improve the rate of early identification of language and behavioural difficulties, enabling more informed referrals to specialist services and facilitating access to early intervention.

SUBMITTER: Sim F

PROVIDER: S-EPMC6361441 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Predictive validity of preschool screening tools for language and behavioural difficulties: A PRISMA systematic review.

Sim Fiona F Thompson Lucy L Marryat Louise L Ramparsad Nitish N Wilson Philip P

PloS one 20190204 2

<h4>Background</h4>Preschool screening for developmental difficulties is increasingly becoming part of routine health service provision and yet the scope and validity of tools used within these screening assessments is variable. The aim of this review is to report on the predictive validity of preschool screening tools for language and behaviour difficulties used in a community setting.<h4>Methods</h4>Studies reporting the predictive validity of language or behaviour screening tools in the presc ...[more]

PMID: 30716083

Similar Datasets

Project description:Language disorder is one of the most prevalent developmental disorders and is associated with long-term sequelae. However, routine screening is still controversial and is not universally part of early childhood health surveillance. Evidence concerning the detection accuracy, benefits, and harms of screening for language disorders remains inadequate, as shown in a previous review. In October 2020, a systematic review was conducted to investigate the accuracy of available screening tools and the potential sources of variability. A literature search was conducted using CINAHL Plus, ComDisCome, PsycInfo, PsycArticles, ERIC, PubMed, Web of Science, and Scopus. Studies describing, developing, or validating screening tools for language disorder under the age of 6 were included. QUADAS-2 was used to evaluate risk of bias in individual studies. Meta-analyses were performed on the reported accuracy of the screening tools examined. The performance of the screening tools was explored by plotting hierarchical summary receiver operating characteristic (HSROC) curves. The effects of the proxy used in defining language disorders, the test administrators, the screening-diagnosis interval and age of screening on screening accuracy were investigated by meta-regression. Of the 2,366 articles located, 47 studies involving 67 screening tools were included. About one-third of the tests (35.4%) achieved at least fair accuracy, while only a small proportion (13.8%) achieved good accuracy. HSROC curves revealed a remarkable variation in sensitivity and specificity for the three major types of screening, which used the child's actual language ability, clinical markers, and both as the proxy, respectively. None of these three types of screening tools achieved good accuracy. Meta-regression showed that tools using the child's actual language as the proxy demonstrated better sensitivity than that of clinical markers. Tools using long screening-diagnosis intervals had a lower sensitivity than those using short screening-diagnosis intervals. Parent report showed a level of accuracy comparable to that of those administered by trained examiners. Screening tools used under and above 4yo appeared to have similar sensitivity and specificity. In conclusion, there are still gaps between the available screening tools for language disorders and the adoption of these tools in population screening. Future tool development can focus on maximizing accuracy and identifying metrics that are sensitive to the dynamic nature of language development.Systematic review registrationhttps://www.crd.york.ac.uk/prospero/display_record.php?RecordID=210505, PROSPERO: CRD42020210505.

Project description:BackgroundDevelopmental delay affects substantial proportions of children. It can generally be identified in the pre-school years and can impact on children's educational outcomes, which in turn may affect outcomes across the life span. High income countries increasingly assess children for developmental delay in the early years, as part of universal child health programmes, however there is little evidence as to which measures best predict later educational outcomes. This systematic review aims to assess results from the current literature on which measures hold the best predictive value, in order to inform the developmental surveillance aspects of universal child health programmes.MethodsSystematic review sources: Medline (2000 -current), Embase (2000 -current), PsycInfo (2000 -current) and ERIC (2000 -current). Additional searching of birth cohort studies was undertaken and experts consulted. Eligibility criteria: Included studies were in English from peer reviewed papers or books looking at developmental assessment of preschool children as part of universal child health surveillance programmes or birth cohort studies, with linked results of later educational success/difficulties. The study populations were limited to general populations of children aged 0-5 years in high income countries. Study selection, data extraction and risk of bias assessment were carried out by two independent authors and any disagreement discussed. PROSPERO registration number CRD42018103111.ResultsThirteen studies were identified for inclusion in the review. The studies were highly heterogeneous: age of children at first assessment ranged from 1-5 years, and at follow-up from 4-26 years. Type of initial and follow-up assessment also varied. Results indicated that, with the exception of one study, the most highly predictive initial assessments comprised combined measures of children's developmental progress, such as a screening tool alongside teacher ratings and developmental histories. Other stand-alone measures also performed adequately, the best of these being the Ages and Stages Questionnaire (ASQ). Latency between measures, age of child at initial measurement, size of studies and quality of studies all impacted on the strength of results.ConclusionsThis review was the first to systematically assess the predictive value of preschool developmental assessment at a population level on later educational outcomes. Results demonstrated consistent associations between relatively poor early child development and later educational difficulties. In general, specificity and Negative Predictive Value are high, suggesting that young children who perform well in developmental assessment are unlikely to go on to develop educational difficulties, however the sensitivity and Positive Predictive Values were generally low, indicating that these assessments would not meet the requirements for a screening test. For surveillance purposes, however, findings suggested that combined measures provided the best results, although these are resource intensive and thus difficult to implement in universal child health programmes. Health service providers may therefore wish to consider using stand-alone measures, which also were shown to provide adequate predictive value, such as the ASQ.

Project description:This study aimed to examine the predictive validity of two internationally well-known instruments, the Modified Home Falls and Accidents Screening Tool (Modified HOME FAST) and the Modified Home Falls and Accidents Screening Tool-Self Report (Modified HOME FAST-SR), and the newly developed Thai Home Falls Hazard Assessment Tool (Thai-HFHAT) (69 items) in predicting falls among older Thai adults. It also aimed to examine the predictive validity of the two abbreviated versions (44 and 27 items) of the Thai-HFHAT, which were developed post hoc to accommodate older adults' limited literacy and poor vision and to facilitate the identification of high-impact home fall hazards that are prevalent in the Thailand context. A prospective cohort study was conducted among 450 participants aged 60 years and above who were assessed by the aforementioned tools at baseline, for which data on fall incidence were then collected during the one-year follow-up. The Cox proportional hazard model was applied to estimate hazard ratios (HRs); then, Harrell's C-statistics and receiver operating characteristic (ROC) analyses were conducted to identify the best cutoff point, sensitivity and specificity for each instrument. The results showed that the fall hazard rate was 2.04 times per 1,000 person-days. Taking into account both the predictive validity and applicability, the Thai-HFHAT (44 items) was found to be the most suitable screening tool due to its highest sensitivity and specificity (93% and 72%) at the cutoff score of 18. In conclusion, our study showed that these internationally validated home fall hazard assessment tools were quite applicable for Thailand, but further tailoring the tools into a specific local context yielded even more highly valid tools in predicting fall risk among older Thai adults. Although these findings were well reproducible by inferring from the internal validation results, further external validation in the independent population is necessary.

Project description:Many injury severity scoring tools have been developed over the past few decades. These tools include the Injury Severity Score (ISS), New ISS (NISS), Trauma and Injury Severity Score (TRISS) and International Classification of Diseases (ICD)-based Injury Severity Score (ICISS). Although many studies have endeavored to determine the ability of these tools to predict the mortality of injured patients, their results have been inconsistent. We conducted a systematic review to summarize the predictive performances of these tools and explore the heterogeneity among studies. We defined a relevant article as any research article that reported the area under the Receiver Operating Characteristic curve as a measure of predictive performance. We conducted an online search using MEDLINE and Embase. We evaluated the quality of each relevant article using a quality assessment questionnaire consisting of 10 questions. The total number of positive answers was reported as the quality score of the study. Meta-analysis was not performed due to the heterogeneity among studies. We identified 64 relevant articles with 157 AUROCs of the tools. The median number of positive answers to the questionnaire was 5, ranging from 2 to 8. Less than half of the relevant studies reported the version of the Abbreviated Injury Scale (AIS) and/or ICD (37.5%). The heterogeneity among the studies could be observed in a broad distribution of crude mortality rates of study data, ranging from 1% to 38%. The NISS was mostly reported to perform better than the ISS when predicting the mortality of blunt trauma patients. The relative performance of the ICSS against the AIS-based tools was inconclusive because of the scarcity of studies. The performance of the ICISS appeared to be unstable because the performance could be altered by the type of formula and survival risk ratios used. In conclusion, high-quality studies were limited. The NISS might perform better in the mortality prediction of blunt injuries than the ISS. Additional studies are required to standardize the derivation of the ICISS and determine the relative performance of the ICISS against the AIS-based tools.

Project description:BACKGROUND:Many studies on malaria knowledge, attitude and practice among pregnant women have been conducted in Hausa speaking communities in Nigeria. Despite this, no standard and uniform instrument for assessing this important public health problem has been developed in the Hausa language, even though it is widely spoken. The aim of this study was to develop and validate a questionnaire in Hausa language assessing information, motivation, and behavioural skills for malaria prevention during pregnancy. METHODS:The questionnaire was first developed in English language, and then assessed for its contents by a team of experts. It was then forwardly translated to Hausa, and backwardly translated again to English by independent language experts. These two English versions were then compared by a Public Health expert, following which the questionnaire was administered to 190 Hausa speaking antenatal care attendees. Exploratory factor analysis was performed on the data collected. Sixty three out of the 190 respondents were invited after 2 weeks to answer the same questionnaire, following which reliability tests were performed. RESULTS:The questionnaire showed good internal consistency, with Cronbach's alpha values of 0.859, 0.890 and 0.773 for information, motivation and behavioural skills constructs respectively. The motivation and behavioural skills constructs were able to delineate their items into three and two sub-sections respectively. The factor loadings for the two constructs ranged from 0.610 to 0.965. As for test retest reliability, the Krippendorff's alpha values for the items of the motivation section ranged from 0.941 to 0.996; that for behavioural skills ranged from 0.810 to 0.953, while for frequency of ITN use, it was 0.988. The Cohen's kappa values for the information section ranged from 0.689-0.974, except the item for 'fever' (zazzabi) which was 0.382, and was as such reworded to a simpler terminology 'hotness of the body' (zafin jiki). CONCLUSIONS:The Hausa language IMB questionnaire on malaria in pregnancy demonstrated good validity, and a high level of reliability. It is as such recommended for use among Hausa speaking communities to ensure uniformity and objectivity.

Dataset Information

Predictive validity of preschool screening tools for language and behavioural difficulties: A PRISMA systematic review.

Publications

Predictive validity of preschool screening tools for language and behavioural difficulties: A PRISMA systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets