Dataset Information

Validation of an mHealth App for Depression Screening and Monitoring (Psychologist in a Pocket): Correlational Study and Concurrence Analysis.

ABSTRACT:

Background

Mobile health (mHealth) is a fast-growing professional sector. As of 2016, there were more than 259,000 mHealth apps available internationally. Although mHealth apps are growing in acceptance, relatively little attention and limited efforts have been invested to establish their scientific integrity through statistical validation. This paper presents the external validation of Psychologist in a Pocket (PiaP), an Android-based mental mHealth app which supports traditional approaches in depression screening and monitoring through the analysis of electronic text inputs in communication apps.

Objective

The main objectives of the study were (1) to externally validate the construct of the depression lexicon of PiaP with standardized psychological paper-and-pencil tools and (2) to determine the comparability of PiaP, a new depression measure, with a psychological gold standard in identifying depression.

Methods

College participants downloaded PiaP for a 2-week administration. Afterward, they were asked to complete 4 psychological depression instruments. Furthermore, 1-week and 2-week PiaP total scores (PTS) were correlated with (1) Beck Depression Index (BDI)-II and Center for Epidemiological Studies-Depression (CES-D) Scale for congruent construct validation, (2) Affect Balance Scale (ABS)-Negative Affect for convergent construct validation, and (3) Satisfaction With Life Scale (SWLS) and ABS-Positive Affect for divergent construct validation. In addition, concordance analysis between PiaP and BDI-II was performed.

Results

On the basis of the Pearson product-moment correlation, significant positive correlations exist between (1) 1-week PTS and CES-D Scale, (2) 2-week PTS and BDI-II, and (3) PiaP 2-week PTS and SWLS. Concordance analysis (Bland-Altman plot and analysis) suggested that PiaP's approach to depression screening is comparable with the gold standard (BDI-II).

Conclusions

The evaluation of mental health has historically relied on subjective measurements. With the integration of novel approaches using mobile technology (and, by extension, mHealth apps) in mental health care, the validation process becomes more compelling to ensure their accuracy and credibility. This study suggests that PiaP's approach to depression screening by analyzing electronic data is comparable with traditional and well-established depression instruments and can be used to augment the process of measuring depression symptoms.

SUBMITTER: Ramos RM

PROVIDER: S-EPMC6754681 | biostudies-literature | 2019 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validation of an mHealth App for Depression Screening and Monitoring (Psychologist in a Pocket): Correlational Study and Concurrence Analysis.

Ramos Roann Munoz RM Cheng Paula Glenda Ferrer PGF Jonas Stephan Michael SM

JMIR mHealth and uHealth 20190916 9

<h4>Background</h4>Mobile health (mHealth) is a fast-growing professional sector. As of 2016, there were more than 259,000 mHealth apps available internationally. Although mHealth apps are growing in acceptance, relatively little attention and limited efforts have been invested to establish their scientific integrity through statistical validation. This paper presents the external validation of Psychologist in a Pocket (PiaP), an Android-based mental mHealth app which supports traditional approa ...[more]

PMID: 31538946

Similar Datasets

Project description:BACKGROUND:After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users' feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE:The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS:An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS:In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS:The newly created mHealth app usability questionnaire-MAUQ-has the reliability and validity required to assess mHealth app usability.

Project description:BackgroundMobile health (mHealth) apps play an important role in delivering education, providing advice on treatment, and monitoring patients' health. Good usability of mHealth apps is essential to achieve the objectives of mHealth apps efficiently. To date, there are questionnaires available to assess the general system usability but not explicitly tailored to precisely assess the usability of mHealth apps. Hence, the mHealth App Usability Questionnaire (MAUQ) was developed with 4 versions according to the type of app (interactive or standalone) and according to the target user (patient or provider). Standalone MAUQ for patients comprises 3 subscales, which are ease of use, interface and satisfaction, and usefulness.ObjectiveThis study aimed to translate and validate the English version of MAUQ (standalone for patients) into a Malay version of MAUQ (M-MAUQ) for mHealth app research and usage in future in Malaysia.MethodsForward and backward translation and harmonization of M-MAUQ were conducted by Malay native speakers who also spoke English as their second language. The process began with a forward translation by 2 independent translators followed by harmonization to produce an initial translated version of M-MAUQ. Next, the forward translation was continued by another 2 translators who had never seen the original MAUQ. Lastly, harmonization was conducted among the committee members to resolve any ambiguity and inconsistency in the words and sentences of the items derived with the prefinal adapted questionnaire. Subsequently, content and face validations were performed with 10 experts and 10 target users, respectively. Modified kappa statistic was used to determine the interrater agreement among the raters. The reliability of the M-MAUQ was assessed by 51 healthy young adult mobile phone users. Participants needed to install the MyFitnessPal app and use it for 2 days for familiarization before completing the designated task and answer the M-MAUQ. The MyFitnessPal app was selected because it is one among the most popular installed mHealth apps globally available for iPhone and Android users and represents a standalone mHealth app.ResultsThe content validity index for the relevancy and clarity of M-MAUQ were determined to be 0.983 and 0.944, respectively, which indicated good relevancy and clarity. The face validity index for understandability was 0.961, which indicated that users understood the M-MAUQ. The kappa statistic for every item in M-MAUQ indicated excellent agreement between the raters (κ ranging from 0.76 to 1.09). The Cronbach α for 18 items was .946, which also indicated good reliability in assessing the usability of the mHealth app.ConclusionsThe M-MAUQ fulfilled the validation criteria as it revealed good reliability and validity similar to the original version. M-MAUQ can be used to assess the usability of mHealth apps in Malay in the future.

Project description:ObjectiveTo understand usage patterns of SMART (Self-Monitoring Activity Regulation and Relaxation Treatment) mHealth app among adolescents with acute mild traumatic brain injuries (mTBIs) and to identify individual characteristics that influenced app usage.MethodsSettingEmergency departments of tertiary care children's medical center.ParticipantsChildren aged 11 to 18 years with mTBI in the past 2 weeks, English-speaking, no evidence of severe TBI, and no preexisting neurological impairment.DesignNested cohort of the intervention arm of a randomized clinical trial (n = 34).Mhealth app interventionSMART was a month-long educational program on mTBI designed to promote self-monitoring and management of recovery. SMART included digital symptom and activity self-monitoring surveys, feedback on symptom changes, and 8 modules providing psychoeducation, strategies for symptom management, and training in active problem solving.Main measuresApp usage time, navigation, and interaction data were automatically collected. Usage involved inputting symptom ratings/activities and reviewing modules. Patterns of symptom/activity reporting and completion of learning modules data were analyzed. Predictors of app utilization, including individual characteristics, resilience (Connor-Davidson Resilience Scale), and coping (Coping Strategies Inventory-Short Form), were analyzed using Spearman correlations.ResultsParticipants completed symptom monitoring an average of 9 days over the month. Participants completed an average of 1.87 learning modules out of 7. Parent income and education, comorbid attention-deficit/hyperactivity disorder (ADHD), and emotional engagement coping style predicted symptom monitoring. Parental income, comorbid ADHD, and greater reliance on emotional engagement coping predicted module completion.Significant adverse eventsNone.ConclusionAdolescents of higher socioeconomic status and those who manage their emotions using active engagement spent more time on both components of the SMART program.

Project description:BackgroundMobile health (mHealth) interventions have the potential to transform the global health care landscape. The processing power of mobile devices continues to increase, and growth of mobile phone use has been observed worldwide. Uncertainty remains among key stakeholders and decision makers as to whether global health interventions can successfully tap into this trend. However, when correctly implemented, mHealth can reduce geographic, financial, and social barriers to quality health care.ObjectiveThe aim of this study was to design and test Beacon, a mobile phone-based tool for evaluating mHealth readiness in global health interventions. Here, we present the results of an application validation study designed to understand the mobile network landscape in and around Macha, Zambia, in 2019.MethodsBeacon was developed as an automated mobile phone app that continually collects spatiotemporal data and measures indicators of network performance. Beacon was used in and around Macha, Zambia, in 2019. Results were collected, even in the absence of network connectivity, and asynchronously uploaded to a database for further analysis.ResultsBeacon was used to evaluate three mobile phone networks around Macha. Carriers A and B completed 6820/7034 (97.0%) and 6701/7034 (95.3%) downloads and 1349/1608 (83.9%) and 1431/1608 (89.0%) uploads, respectively, while Carrier C completed only 62/1373 (4.5%) file downloads and 0/1373 (0.0%) file uploads. File downloads generally occurred within 4 to 12 seconds, and their maximum download speeds occurred between 2 AM and 5 AM. A decrease in network performance, demonstrated by increases in upload and download durations, was observed beginning at 5 PM and continued throughout the evening.ConclusionsBeacon was able to compare the performance of different cellular networks, show times of day when cellular networks experience heavy loads and slow down, and identify geographic "dead zones" with limited or no cellular service. Beacon is a ready-to-use tool that could be used by organizations that are considering implementing mHealth interventions in low- and middle-income countries but are questioning the feasibility of the interventions, including infrastructure and cost. It could also be used by organizations that are looking to optimize the delivery of an existing mHealth intervention with improved logistics management.

Project description:Background: Routine outcome monitoring (ROM) has been implemented across a range of addiction treatment services, settings and organisations. Mutual support groups are a notable exception. Innovative solutions are needed. SMART Track is a purpose built smartphone app designed to capture ROM data and provide tailored feedback to adults attending Australian SMART Recovery groups for addictive behaviour(s). Objective: Details regarding the formative stage of app development is essential, but often neglected. Improved consideration of the end-user is vital for curtailing app attrition and enhancing engagement. This paper provides a pragmatic example of how principles embedded in published frameworks can be operationalised to address these priorities during the design and development of the SMART Track app. Methods: Three published frameworks for creating digital health technologies ("Person-Based Approach," "BIT" Model and IDEAS framework) were integrated and applied across two stages of research to inform the development, design and content of SMART Track. These frameworks were chosen to ensure that SMART Track was informed by the needs and preferences of the end-user ("Person-Based"); best practise recommendations for mHealth development ("BIT" Model) and a collaborative, iterative development process between the multi-disciplinary research team, app developers and end-users (IDEAS framework). Results: Stage one of the research process generated in-depth knowledge to inform app development, including a comprehensive set of aims (clinical, research/organisation, and usage); clear articulation of the target behaviour (self-monitoring of recovery related behaviours and experiences); relevant theory (self-determination and social control); appropriate behavioural strategies (e.g., behaviour change taxonomy and process motivators) and key factors that may influence engagement (e.g., transparency, relevance and trust). These findings were synthesised into guiding principles that were applied during stage two in an iterative approach to app design, content and development. Conclusions: This paper contributes new knowledge on important person-centred and theoretical considerations that underpin a novel ROM and feedback app for people with addictive behaviour(s). Although person-centred design and best-practise recommendations were employed, further research is needed to determine whether this leads to improved usage outcomes. Clinical Trial Registration: Pilot Trial: http://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336.

Dataset Information

Validation of an mHealth App for Depression Screening and Monitoring (Psychologist in a Pocket): Correlational Study and Concurrence Analysis.

Background

Objective

Methods

Results

Conclusions

Publications

Validation of an mHealth App for Depression Screening and Monitoring (Psychologist in a Pocket): Correlational Study and Concurrence Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets