Dataset Information

Validating mental health assessment in Kenya using an innovative gold standard.

ABSTRACT: With the growing burden of mental health disorders worldwide, alongside efforts to expand availability of evidence-based interventions, strategies are needed to ensure accurate identification of individuals suffering from mental disorders. Efforts to locally validate mental health assessments are of particular value, yet gold-standard clinical validation is costly, time-intensive, and reliant on available professionals. This study aimed to validate assessment items for mental distress in Kenya, using an innovative gold standard and a combination of culturally adapted and locally developed items. The mixed-method study drew on surveys and semi-structured interviews, conducted by lay interviewers, with 48 caregivers. Interviews were used to designate mental health "cases" or "non-cases" based on emotional health problems, identified through a collaborative clinical rating process with local input. Individual mental health survey items were evaluated for their ability to discriminate between cases and non-cases. Discriminant survey items included 23 items adapted from existing mental health assessment tools, as well as 6 new items developed for the specific cultural context. When items were combined into a scale, results showed good psychometric properties. The use of clinically rated semi-structured interviews provides a promising alternative gold standard that can help address the challenges of conducting diagnostic clinical validation in low-resource settings.

SUBMITTER: Watson LK

PROVIDER: S-EPMC7321828 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validating mental health assessment in Kenya using an innovative gold standard.

Watson Leah K LK Kaiser Bonnie N BN Giusto Ali M AM Ayuku David D Puffer Eve S ES

International journal of psychology : Journal international de psychologie 20190617 3

With the growing burden of mental health disorders worldwide, alongside efforts to expand availability of evidence-based interventions, strategies are needed to ensure accurate identification of individuals suffering from mental disorders. Efforts to locally validate mental health assessments are of particular value, yet gold-standard clinical validation is costly, time-intensive, and reliant on available professionals. This study aimed to validate assessment items for mental distress in Kenya, ...[more]

PMID: 31209898

Similar Datasets

Project description:BackgroundThe computerized administration of self-report psychiatric diagnostic and outcomes assessments has risen in popularity. If results are similar enough across different administration modalities, then new administration technologies can be used interchangeably and the choice of technology can be based on other factors, such as convenience in the study design. An assessment based on item response theory (IRT), such as the Patient-Reported Outcomes Measurement Information System (PROMIS) depression item bank, offers new possibilities for assessing the effect of technology choice upon results.ObjectiveTo create equivalent halves of the PROMIS depression item bank and to use these halves to compare survey responses and user satisfaction among administration modalities-paper, mobile phone, or tablet-with a community mental health care population.MethodsThe 28 PROMIS depression items were divided into 2 halves based on content and simulations with an established PROMIS response data set. A total of 129 participants were recruited from an outpatient public sector mental health clinic based in Memphis. All participants took both nonoverlapping halves of the PROMIS IRT-based depression items (Part A and Part B): once using paper and pencil, and once using either a mobile phone or tablet. An 8-cell randomization was done on technology used, order of technologies used, and order of PROMIS Parts A and B. Both Parts A and B were administered as fixed-length assessments and both were scored using published PROMIS IRT parameters and algorithms.ResultsAll 129 participants received either Part A or B via paper assessment. Participants were also administered the opposite assessment, 63 using a mobile phone and 66 using a tablet. There was no significant difference in item response scores for Part A versus B. All 3 of the technologies yielded essentially identical assessment results and equivalent satisfaction levels.ConclusionsOur findings show that the PROMIS depression assessment can be divided into 2 equivalent halves, with the potential to simplify future experimental methodologies. Among community mental health care recipients, the PROMIS items function similarly whether administered via paper, tablet, or mobile phone. User satisfaction across modalities was also similar. Because paper, tablet, and mobile phone administrations yielded similar results, the choice of technology should be based on factors such as convenience and can even be changed during a study without adversely affecting the comparability of results.

Project description:IntroductionBalance disorders are common in people with Multiple Sclerosis (PwMS) and, together with other impairments and disabilities, often prevent PwMS from performing their daily living activities. Besides clinical scales and performance tests, robotic platforms can provide more sensitive, specific, and objective monitoring. Validated technologies have been adopted as gold standard, but innovative robotic solutions would represent an opportunity to detect balance impairment in PwMS.AimStudy's aim was to compare postural assessment of 46 PwMS with a relapsing-remitting form during static tasks performed with the novel robotic platform hunova® and the gold standard EquiTest®, METHODS: Pearson's r was run on Center of Pressure (COP)-related parameters and global static balance measures computed from hunova® and EquiTest® in eyes-open (EO) and eyes-closed (EC) conditions. In addition, agreeableness level toward the use of both devices was tested through numeric rating scale.ResultsConsidering COP-related parameters, correlations were significant for all measures (p < .001). Interestingly, in EO, a strong correlation was shown for sway area (r = .770), while Medio-Lateral (ML) and Anterior-Posterior (AP) oscillation range, path length, ML and AP speed, ML and AP root mean square distance had a relatively strong association (.454 ≤ r ≤ .576). In EC, except for ML oscillation range showing a relatively strong correlation (r = .532), other parameters were strongly associated (.603 ≤ r ≤ .782). Correlations between global balance indexes of hunova® and EquiTest® revealed a relatively strong association between the Somatosensory Score in EquiTest® and the Somatosensory Index in hunova® (r = - .488). While in EO Static Balance Index from hunova® was highly correlated with Equilibrium score of EquiTest® (r = .416), Static Balance Index had a relatively strong association with both the Equilibrium (r = .482) and Strategy Score (r = .583) of EquiTest® in EC. Results from agreeableness rating scale revealed that hunova® was highly appreciated compared to EquiTest® (p = .044).Conclusionshunova® represents an innovative adjunct to standard robotic balance evaluation for PwMS. This confirms that combining traditional and robotic assessments can more accurately detect balance impairments in MS.

Project description:BackgroundGlobally there is increasing recognition that new strategies are required to reduce disability due to common mental health problems. As 75% of mental health and substance use disorders emerge during the teenage or early adulthood years, these strategies need to be readily accessible to young people. When considering how to provide such services at scale, new and innovative technologies show promise in augmenting traditional clinic-based services.ObjectiveThe aim of this study was to test new and innovative technologies to assess clinical stage in early intervention youth mental health services using a prototypic online system known as the Mental Health eClinic (MHeC).MethodsThe online assessment within the MHeC was compared directly against traditional clinician assessment within 2 Sydney-based youth-specific mental health services (headspace Camperdown and headspace Campbelltown). A total of 204 young people were recruited to the study. Eligible participants completed both face-to-face and online assessments, which were randomly allocated and counterbalanced at a 1-to-3 ratio. These assessments were (1) a traditional 45- to 60-minute headspace face-to-face assessment performed by a Youth Access Clinician and (2) an approximate 60-minute online assessment (including a self-report Web-based survey, immediate dashboard of results, and a video visit with a clinician). All assessments were completed within a 2-week timeframe from initial presentation.ResultsOf the 72 participants who completed the study, 71% (51/72) were female and the mean age was 20.4 years (aged 16 to 25 years); 68% (49/72) of participants were recruited from headspace Camperdown and the remaining 32% (23/72) from headspace Campbelltown. Interrater agreement of participants' stage, as determined after face-to-face assessment or online assessment, demonstrated fair agreement (kappa=.39, P<.001) with concordance in 68% of cases (49/72). Among the discordant cases, those who were allocated to a higher stage by online raters were more likely to report a past history of mental health disorders (P=.001), previous suicide planning (P=.002), and current cannabis misuse (P=.03) compared to those allocated to a lower stage.ConclusionsThe MHeC presents a new and innovative method for determining key clinical service parameters. It has the potential to be adapted to varied settings in which young people are connected with traditional clinical services and assist in providing the right care at the right time.

Dataset Information

Validating mental health assessment in Kenya using an innovative gold standard.

Publications

Validating mental health assessment in Kenya using an innovative gold standard.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets