Dataset Information

Identification of high risk and early stage eating disorders: first validation of a digital screening tool.

ABSTRACT:

Background

Eating disorders are amongst the deadliest of all mental disorders, however detection and early intervention rates remain extremely low. Current standardised screening questionnaires can be arduous or confronting and are ill-validated for online use, despite a universal shift to digital healthcare. The present study describes the development and pilot validation of a novel digital screening tool (the InsideOut Institute-Screener) for high risk and early stage eating disorders to drive early intervention and reduced morbidity.

Methods

We utilised a mixed cross-sectional and repeated measures longitudinal survey research design to assess symptom severity and recognised parameters of statistical validity. Participants were recruited through social media and traditional advertising, and through MTurk. An Eating Disorders Examination Questionnaire (EDE-Q) global score of 2.3 and assessment of eating disorder behaviours was used to determine probable ED. 1346 participants aged 14-74 (mean [SE] age 26.60 [11.14] years; 73.8% female, 22.6% male) completed the survey battery. 19% were randomised to two-week follow-up for reliability analysis.

Results

Strong positive correlations between the IOI-S and both the EDE-Q global (r_s = .88) and SCOFF (r_s = .75) total score were found, providing support for the concurrent validity of the scale. Inter-item correlations were moderate to strong (r_s = .46-.73). Correlations between the IOI-S and two measures of social desirability diverged, providing support for the discriminant validity of the scale. The IOI-S demonstrated high internal consistency (α = .908, ω = .910) and excellent two-week test-retest reliability (.968, 95% CI 0.959-0.975; p ≤ 0.1). The IOI-S accurately distinguished probable eating disorders (sensitivity = 82.8%, specificity = 89.7% [AUC = .944], LR⁺ = 8.04, LR^- = 0.19) and two stepped levels of risk.

Conclusions and relevance

The present study provides excellent initial support for the psychometric validity of the InsideOut Institute digital screening tool, which has the potential to streamline early intervention in the hopes of reducing current high morbidity and mortality. Further validation should be undertaken in known clinical populations. Eating disorders are amongst the deadliest of all mental disorders, however detection and early intervention rates remain extremely low. The present study describes the initial psychometric validation of a novel digital screening tool (the InsideOut Institute Screener) for high risk and early stage eating disorders, for self-referral and/or use in primary care. 1346 participants aged 14-74 of all genders completed a survey battery designed to assess common parameters of statistical validity. Strong support was found for the screener's ability to accurately measure eating disorder risk and symptomatology. The screener was highly positively correlated with a well known and extensively validated long form self-report questionnaire for eating disorder symptomatology. This study is a pilot validation and the genesis of a project that aims ultimately to drive early intervention leading to reduced morbidity and mortality rates in this illness group.

SUBMITTER: Bryant E

PROVIDER: S-EPMC8419810 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe number of individuals meeting criteria for genetic counseling and testing for hereditary cancer syndromes (HCS) is far less than the number that actually receive it. To facilitate identification of patients at risk for HCS, Counsyl developed a digital identification tool (digital ID tool) to match personal and family cancer history to National Comprehensive Cancer Network (NCCN) BRCA-related Hereditary Breast and Ovarian Cancer (HBOC), Lynch syndrome, and polyposis testing criteria in one-to-one, automated fashion. The purpose of this study was to validate the ability of the digital ID tool to accurately identify histories that do and do not meet NCCN testing criteria.MethodsThird-party recorded three-generation pedigrees were retrospectively reviewed by a certified genetic counselor (CGC) to determine if independent events included in pedigree histories met NCCN guidelines, and were then sorted into groups: high risk events (meets criteria) and low risk events (does not meet criteria). Events were entered into the digital ID tool to determine the extent of its concordance with events sorted by CGC review. Statistical tests of accuracy were calculated at a 95% confidence interval (CI).ResultsOne hundred ninety-seven pedigrees were reviewed consecutively representing 765 independent events for analysis across groups. 382/382 (100%) high risk events identified by the digital ID tool and 381/383 (99.47%) low risk events identified by the digital ID tool were concordant with CGC sorting. The digital ID tool had a sensitivity of 100% (99.04-100% CI) and specificity of 99.48% (98.13-99.94% CI). The overall accuracy of the digital ID tool was estimated to be 99.74% (99.06-99.97% CI), reflecting the rate at which the digital ID tool reached the same conclusion as that of CGC review of pedigree events for the recommendation of genetic testing for individuals at risk for HCS.ConclusionsThe digital ID tool accurately matches NCCN criteria in one-to-one fashion to identify at-risk individuals for HCS and may be useful in clinical practice, specifically for BRCA-related HBOC and Lynch Syndrome.

Project description:BACKGROUND:Integrating care for common mental disorders (CMDs) such as depression, anxiety and alcohol abuse into primary healthcare (PHC) should assist in reducing South Africa (SA)'s quadruple burden of disease. CMDs compromise treatment adherence, health behaviour change and self-management of illnesses. Appropriate identification of mental disorders in primary care can be facilitated by brief, easy-to-administer screening that promotes high specificity. OBJECTIVES:To establish the criterion-based validity of a seven-item Brief Mental Health (BMH) screening tool for assessing positive symptoms of CMDs in primary care patients. METHODS:A total of 1 214 participants were recruited from all patients aged ?18 years visiting 10 clinics as part of routine care in the Newcastle subdistrict of Amajuba District in KwaZulu-Natal Province, SA, over a period of 2 weeks. Consenting patients provided basic biographical information prior to screening with the BMH tool. PHC nurses remained blind to this assessment. PHC nurse-initiated assessment using the Adult Primary Care (APC) guidelines was the gold standard against which the performance of the BMH tool was compared. A specificity standard of 80% was used to establish cut-points. Specificity was favoured over sensitivity to ensure that those who did not have CMD symptoms were excluded, as well as to reduce over-referrals. RESULTS:Of the participants, 72% were female. The AUD-C (alcohol abuse) performed well (area under the curve (AUC) 0.91 (95% confidence interval (CI) 0.88 - 0.95), cut-point ?4, Cronbach alpha 0.87); PHQ-2 (depression) performed reasonably well (AUC 0.72 (95% CI 0.65 - 0.78), cut-point ?3, alpha 0.71); and GAD-2 (anxiety) performance was acceptable (AUC 0.69 (95% CI 0.58 - 0.80), cut-point ?3, alpha 0.62). Using the higher cut-off scores, patients who truly did not have CMD symptoms had negative predictive values (NPVs) of >90%. Overall, 26% of patients had CMD positive symptoms relative to 8% using the APC guidelines. CONCLUSIONS:Using a higher specificity index, the positive predictive value and NPV show that at higher cut-point values the BMH not only helps identify individuals with alcohol misuse, depression and anxiety symptoms but also identifies a majority of those who do not have symptoms (true negatives), thus not overburdening nurses with false positives needing assessment. Research is needed to assess whether use of such a short and valid screening tool is generalisable to other clinic contexts as well as how mental health screening should best be introduced into routine clinic functioning and practice.

Project description:BackgroundFamilies of people with eating disorders are often caught up in rule bound eating and safety behaviours that characterise the illness. The main aim of this study was to develop a valid and specific scale to measure family accommodation in the context of having a relative with an eating disorder.MethodsA new scale, the Accommodation and Enabling Scale for Eating Disorders (AESED), was jointly generated by professionals and expert carers through qualitative analysis. In the first stage, this instrument was given to 201 family members of relatives diagnosed with an eating disorder, with additional self-report measures including the Experience of Caregiving Inventory (ECI), the Hospital Anxiety and Depression Scale (HADS) and the Family Questionnaire (FQ). In the second stage, the sensitivity of the AESED to change was tested in a pre-and-post design study with a new sample of 116 caregivers, using a DVDs-distance skills training for caregivers.ResultsA 33 item instrument was derived consisting of five factors: Avoidance and Modifying Routine, Reassurance Seeking, Meal Ritual, Control of Family and Turning a Blind Eye, which together explained 60.1% of the variance. This scale had good psychometric properties in terms of Cronbach's alpha which ranged from 0.77 to 0.92. Regarding the convergent validity, most of the AESED subscales was moderately supported by correlations with anxiety (HADS; r = 0.24 to 0.48) and depression levels (HADS; r = 0.17 to 0.47), negative caregiving (ECI; r = 0.18 to 0.45), and expressed emotion levels (FQ; r = 0.17 to 0.51). Pre-post intervention assessments showed that the overall AESED scale (d = 0.38) and the avoidance and modifying routine (d = 0.52), meal ritual (d = 0.27) and control of the family (d = 0.49) subscales were sensitive to change.ConclusionInternal consistency was good and initial validity of the scale was adequate, it was able to discriminate differences between clinical variables, however, further work is needed to confirm the factor structure and validity of the AESED. Nevertheless, this scale may be of value in exploring and helping to improve carers' coping strategies and in examining the effectiveness of family based interventions.

Project description:BackgroundFamily members of relatives with eating disorders experience high levels of distress due to the difficulties in their care giving role. However no measures have been developed to measure the specific impact that an individual with an eating disorder has on family life. The aim of this study was to develop a measure to assess the specific caregiving burden of both anorexia nervosa and bulimia nervosa. A secondary aim was to examine whether this measure was sensitive to change.MethodsA new scale, the Eating Disorders Symptom Impact Scale (EDSIS), was generated by a panel of clinicians and researchers based upon quantitative and qualitative work with carers and reviewed by a panel of "expert carers". A cross-sectional study was conducted among carers of relatives with an eating disorder to examine the properties of the new scale. In addition, participants from an ongoing pre-and-post design study completed several self-report questionnaires to assess the sensitivity of the EDSIS to change.ResultsA sample of 196 carers of relatives with an eating disorder aged 25-68 compted the scale. A 24-item EDSIS scale was derived with four factors: nutrition, guilt, dysregulated behaviour and social isolation. These explained 58.4% of the variance in carer distress. Reliability was acceptable (Cronbach's alpha ranged from 0.84 to 0.90). The convergent validity of the EDSIS subscales was moderately supported by correlations with a general caregiving measure (Experience of Caregiving Inventory (ECI), r = 0.42 to 0.60), psychological distress (General Health Questionnaire (GHQ-12), r = 0.33) and perceived functioning of the relative (Children Global Assessment Scale (CGAS), r = -30). A sample of 57 primary caregivers completed pre-post intervention assessments and the overall scale (t = 2.3, p < 0.05) and guilt subscale (t = 3.4, p < 0.01) were sensitive to change following a skills training workshop.ConclusionThe EDSIS instrument has good psychometric properties and may be of value to assess the impact of eating disorder symptoms on family members. It may be of value to highlight carers' needs and to monitor the effectiveness of family based interventions.