Dataset Information

Identification of high risk and early stage eating disorders: first validation of a digital screening tool.

ABSTRACT:

Background

Eating disorders are amongst the deadliest of all mental disorders, however detection and early intervention rates remain extremely low. Current standardised screening questionnaires can be arduous or confronting and are ill-validated for online use, despite a universal shift to digital healthcare. The present study describes the development and pilot validation of a novel digital screening tool (the InsideOut Institute-Screener) for high risk and early stage eating disorders to drive early intervention and reduced morbidity.

Methods

We utilised a mixed cross-sectional and repeated measures longitudinal survey research design to assess symptom severity and recognised parameters of statistical validity. Participants were recruited through social media and traditional advertising, and through MTurk. An Eating Disorders Examination Questionnaire (EDE-Q) global score of 2.3 and assessment of eating disorder behaviours was used to determine probable ED. 1346 participants aged 14-74 (mean [SE] age 26.60 [11.14] years; 73.8% female, 22.6% male) completed the survey battery. 19% were randomised to two-week follow-up for reliability analysis.

Results

Strong positive correlations between the IOI-S and both the EDE-Q global (r_s = .88) and SCOFF (r_s = .75) total score were found, providing support for the concurrent validity of the scale. Inter-item correlations were moderate to strong (r_s = .46-.73). Correlations between the IOI-S and two measures of social desirability diverged, providing support for the discriminant validity of the scale. The IOI-S demonstrated high internal consistency (α = .908, ω = .910) and excellent two-week test-retest reliability (.968, 95% CI 0.959-0.975; p ≤ 0.1). The IOI-S accurately distinguished probable eating disorders (sensitivity = 82.8%, specificity = 89.7% [AUC = .944], LR⁺ = 8.04, LR^- = 0.19) and two stepped levels of risk.

Conclusions and relevance

The present study provides excellent initial support for the psychometric validity of the InsideOut Institute digital screening tool, which has the potential to streamline early intervention in the hopes of reducing current high morbidity and mortality. Further validation should be undertaken in known clinical populations. Eating disorders are amongst the deadliest of all mental disorders, however detection and early intervention rates remain extremely low. The present study describes the initial psychometric validation of a novel digital screening tool (the InsideOut Institute Screener) for high risk and early stage eating disorders, for self-referral and/or use in primary care. 1346 participants aged 14-74 of all genders completed a survey battery designed to assess common parameters of statistical validity. Strong support was found for the screener's ability to accurately measure eating disorder risk and symptomatology. The screener was highly positively correlated with a well known and extensively validated long form self-report questionnaire for eating disorder symptomatology. This study is a pilot validation and the genesis of a project that aims ultimately to drive early intervention leading to reduced morbidity and mortality rates in this illness group.

SUBMITTER: Bryant E

PROVIDER: S-EPMC8419810 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Given that eating disorders (EDs) are relatively common in college populations, it is important to have reliable and valid tools to identify students so that they can be referred to evidence-based care. Although research supports the psychometric properties of existing ED screens for identifying cases of EDs, most studies have been conducted in samples of young white-majority women or have not reported the psychometric properties of the screening tool in men. The purpose of the current study was to validate a brief, 10-item screening tool for the identification of EDs-the brief assessment of stress and eating (BASE). Participants were college students (N = 596; 68.2% cisgender women) from a large Midwestern university who completed the BASE and SCOFF. The Eating Disorders Diagnostic Survey was used to generate DSM-5 ED diagnoses. We evaluated area under the curve (AUC) for both receiver operating curves (ROC) and precision-recall curves (PRC). Both the BASE and SCOFF performed significantly better than chance at identifying probable EDs in cisgender women (BASE AUC: ROC = .787, PRC = .633, sensitivity = .733, specificity = .697; SCOFF AUC: ROC = .810, PRC = .684, sensitivity = .793, specificity = .701). However, the BASE (AUC: ROC = .821, PRC = .605, sensitivity = .966, specificity = .495) significantly outperformed the SCOFF (AUC: ROC = .710, PRC = .354, sensitivity = .828, specificity = .514) for identifying probable EDs in cisgender college men. The BASE is appropriate for student healthcare and college research settings. Because the BASE outperforms the SCOFF in college men, results from the current study are expected to contribute to improved identification of EDs on college campuses. The BASE is a new screening tool to identify eating disorders. The BASE performed as well as, if not better than, the SCOFF (particularly in men). Given the need for brief, psychometrically strong, and unbiased ED screening tools in college students, the current study helps address an unmet student healthcare need that we expect will contribute to improved identification of EDs on college campuses.

Project description:BackgroundMany people with harmful addictive behaviors may not meet formal diagnostic thresholds for a disorder. A dimensional approach, by contrast, including clinical and community samples, is potentially key to early detection, prevention, and intervention. Importantly, while neurocognitive dysfunction underpins addictive behaviors, established assessment tools for neurocognitive assessment are lengthy and unengaging, difficult to administer at scale, and not suited to clinical or community needs. The BrainPark Assessment of Cognition (BrainPAC) Project sought to develop and validate an engaging and user-friendly digital assessment tool purpose-built to comprehensively assess the main consensus-driven constructs underpinning addictive behaviors.ObjectiveThe purpose of this study was to psychometrically validate a gamified battery of consensus-based neurocognitive tasks against standard laboratory paradigms, ascertain test-retest reliability, and determine their sensitivity to addictive behaviors (eg, alcohol use) and other risk factors (eg, trait impulsivity).MethodsGold standard laboratory paradigms were selected to measure key neurocognitive constructs (Balloon Analogue Risk Task [BART], Stop Signal Task [SST], Delay Discounting Task [DDT], Value-Modulated Attentional Capture [VMAC] Task, and Sequential Decision-Making Task [SDT]), as endorsed by an international panel of addiction experts; namely, response selection and inhibition, reward valuation, action selection, reward learning, expectancy and reward prediction error, habit, and compulsivity. Working with game developers, BrainPAC tasks were developed and validated in 3 successive cohorts (total N=600) and a separate test-retest cohort (N=50) via Mechanical Turk using a cross-sectional design.ResultsBrainPAC tasks were significantly correlated with the original laboratory paradigms on most metrics (r=0.18-0.63, P<.05). With the exception of the DDT k function and VMAC total points, all other task metrics across the 5 tasks did not differ between the gamified and nongamified versions (P>.05). Out of 5 tasks, 4 demonstrated adequate to excellent test-retest reliability (intraclass correlation coefficient 0.72-0.91, P<.001; except SDT). Gamified metrics were significantly associated with addictive behaviors on behavioral inventories, though largely independent of trait-based scales known to predict addiction risk.ConclusionsA purpose-built battery of digitally gamified tasks is sufficiently valid for the scalable assessment of key neurocognitive processes underpinning addictive behaviors. This validation provides evidence that a novel approach, purported to enhance task engagement, in the assessment of addiction-related neurocognition is feasible and empirically defensible. These findings have significant implications for risk detection and the successful deployment of next-generation assessment tools for substance use or misuse and other mental disorders characterized by neurocognitive anomalies related to motivation and self-regulation. Future development and validation of the BrainPAC tool should consider further enhancing convergence with established measures as well as collecting population-representative data to use clinically as normative comparisons.

Project description:BackgroundThe number of individuals meeting criteria for genetic counseling and testing for hereditary cancer syndromes (HCS) is far less than the number that actually receive it. To facilitate identification of patients at risk for HCS, Counsyl developed a digital identification tool (digital ID tool) to match personal and family cancer history to National Comprehensive Cancer Network (NCCN) BRCA-related Hereditary Breast and Ovarian Cancer (HBOC), Lynch syndrome, and polyposis testing criteria in one-to-one, automated fashion. The purpose of this study was to validate the ability of the digital ID tool to accurately identify histories that do and do not meet NCCN testing criteria.MethodsThird-party recorded three-generation pedigrees were retrospectively reviewed by a certified genetic counselor (CGC) to determine if independent events included in pedigree histories met NCCN guidelines, and were then sorted into groups: high risk events (meets criteria) and low risk events (does not meet criteria). Events were entered into the digital ID tool to determine the extent of its concordance with events sorted by CGC review. Statistical tests of accuracy were calculated at a 95% confidence interval (CI).ResultsOne hundred ninety-seven pedigrees were reviewed consecutively representing 765 independent events for analysis across groups. 382/382 (100%) high risk events identified by the digital ID tool and 381/383 (99.47%) low risk events identified by the digital ID tool were concordant with CGC sorting. The digital ID tool had a sensitivity of 100% (99.04-100% CI) and specificity of 99.48% (98.13-99.94% CI). The overall accuracy of the digital ID tool was estimated to be 99.74% (99.06-99.97% CI), reflecting the rate at which the digital ID tool reached the same conclusion as that of CGC review of pedigree events for the recommendation of genetic testing for individuals at risk for HCS.ConclusionsThe digital ID tool accurately matches NCCN criteria in one-to-one fashion to identify at-risk individuals for HCS and may be useful in clinical practice, specifically for BRCA-related HBOC and Lynch Syndrome.

Project description:BACKGROUND:Integrating care for common mental disorders (CMDs) such as depression, anxiety and alcohol abuse into primary healthcare (PHC) should assist in reducing South Africa (SA)'s quadruple burden of disease. CMDs compromise treatment adherence, health behaviour change and self-management of illnesses. Appropriate identification of mental disorders in primary care can be facilitated by brief, easy-to-administer screening that promotes high specificity. OBJECTIVES:To establish the criterion-based validity of a seven-item Brief Mental Health (BMH) screening tool for assessing positive symptoms of CMDs in primary care patients. METHODS:A total of 1 214 participants were recruited from all patients aged ?18 years visiting 10 clinics as part of routine care in the Newcastle subdistrict of Amajuba District in KwaZulu-Natal Province, SA, over a period of 2 weeks. Consenting patients provided basic biographical information prior to screening with the BMH tool. PHC nurses remained blind to this assessment. PHC nurse-initiated assessment using the Adult Primary Care (APC) guidelines was the gold standard against which the performance of the BMH tool was compared. A specificity standard of 80% was used to establish cut-points. Specificity was favoured over sensitivity to ensure that those who did not have CMD symptoms were excluded, as well as to reduce over-referrals. RESULTS:Of the participants, 72% were female. The AUD-C (alcohol abuse) performed well (area under the curve (AUC) 0.91 (95% confidence interval (CI) 0.88 - 0.95), cut-point ?4, Cronbach alpha 0.87); PHQ-2 (depression) performed reasonably well (AUC 0.72 (95% CI 0.65 - 0.78), cut-point ?3, alpha 0.71); and GAD-2 (anxiety) performance was acceptable (AUC 0.69 (95% CI 0.58 - 0.80), cut-point ?3, alpha 0.62). Using the higher cut-off scores, patients who truly did not have CMD symptoms had negative predictive values (NPVs) of >90%. Overall, 26% of patients had CMD positive symptoms relative to 8% using the APC guidelines. CONCLUSIONS:Using a higher specificity index, the positive predictive value and NPV show that at higher cut-point values the BMH not only helps identify individuals with alcohol misuse, depression and anxiety symptoms but also identifies a majority of those who do not have symptoms (true negatives), thus not overburdening nurses with false positives needing assessment. Research is needed to assess whether use of such a short and valid screening tool is generalisable to other clinic contexts as well as how mental health screening should best be introduced into routine clinic functioning and practice.