Dataset Information

A Questionnaire for Assessing User Satisfaction With Mobile Health Apps: Development Using Rasch Measurement Theory.

ABSTRACT: BACKGROUND:Mobile health (mHealth) apps offer great opportunities to deliver large-scale, cost-efficient digital solutions for implementing lifestyle changes. Furthermore, many mHealth apps act as medical devices. Yet, there is little research on how to assess user satisfaction with an mHealth solution. OBJECTIVE:This study presents the development of the mHealth Satisfaction Questionnaire and evaluates its measurement properties. METHODS:Respondents who took part in the Health Integrator Study and were randomized to use the Health Integrator smartphone app for lifestyle changes (n=112), with and without additional telephone coaching, rated their satisfaction with the app using the new 14-item mHealth Satisfaction Questionnaire. The ratings were given on a 5-point Likert scale and measurement properties were evaluated using Rasch measurement theory (RMT). RESULTS:Optimal scoring was reached when response options 2, 3, and 4 were collapsed, giving three response categories. After omitting two items that did not fit into the scale, fit residuals were within, or close to, the recommended range of ±2.5. There was no differential item functioning between intervention group, age group, or sex. The Person Separation Index was 0.79, indicating that the scale's ability to discriminate correctly between person leniency was acceptable for group comparisons but not for individual evaluations. The scale did not meet the criterion of unidimensionality; 16.1% (18/112) of the respondents were outside the desired range of -1.96 to 1.96. In addition, several items showed local dependency and three underlying dimensions emerged: negative experiences, positive experiences, and lifestyle consequences of using the mHealth solution. CONCLUSIONS:In times where mHealth apps and digital solutions are given more attention, the mHealth Satisfaction Questionnaire provides a new possibility to measure user satisfaction to ensure usability and improve development of new apps. Our study is one of only a few cases where RMT has been used to evaluate the usability of such an instrument. There is, though, a need for further development of the mHealth Satisfaction Questionnaire, including the addition of more items and consideration of further response options. The mHealth Satisfaction Questionnaire should also be evaluated in a larger sample and with other mHealth apps and in other contexts. TRIAL REGISTRATION:ClinicalTrials.gov NCT03579342; http://clinicaltrials.gov/ct2/show/NCT03579342.

SUBMITTER: Melin J

PROVIDER: S-EPMC7284402 | biostudies-literature | 2020 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Questionnaire for Assessing User Satisfaction With Mobile Health Apps: Development Using Rasch Measurement Theory.

Melin Jeanette J Bonn Stephanie Erika SE Pendrill Leslie L Trolle Lagerros Ylva Y

JMIR mHealth and uHealth 20200526 5

<h4>Background</h4>Mobile health (mHealth) apps offer great opportunities to deliver large-scale, cost-efficient digital solutions for implementing lifestyle changes. Furthermore, many mHealth apps act as medical devices. Yet, there is little research on how to assess user satisfaction with an mHealth solution.<h4>Objective</h4>This study presents the development of the mHealth Satisfaction Questionnaire and evaluates its measurement properties.<h4>Methods</h4>Respondents who took part in the He ...[more]

PMID: 32452817

Similar Datasets

Project description:Consumers are living longer, creating more pressure on the health system and increasing their requirement for self-care of chronic conditions. Despite rapidly-increasing numbers of mobile health applications ('apps') for consumers' self-care, there is a paucity of research into consumer engagement with electronic self-monitoring. This paper presents a qualitative exploration of how health consumers use apps for health monitoring, their perceived benefits from use of health apps, and suggestions for improvement of health apps.'Health app' was defined as any commercially-available health or fitness app with capacity for self-monitoring. English-speaking consumers aged 18 years and older using any health app for self-monitoring were recruited for interview from the metropolitan area of Perth, Australia. The semi-structured interview guide comprised questions based on the Technology Acceptance Model, Health Information Technology Acceptance Model, and the Mobile Application Rating Scale, and is the only study to do so. These models also facilitated deductive thematic analysis of interview transcripts. Implicit and explicit responses not aligned to these models were analyzed inductively.Twenty-two consumers (15 female, seven male) participated, 13 of whom were aged 26-35 years. Eighteen participants reported on apps used on iPhones. Apps were used to monitor diabetes, asthma, depression, celiac disease, blood pressure, chronic migraine, pain management, menstrual cycle irregularity, and fitness. Most were used approximately weekly for several minutes per session, and prior to meeting initial milestones, with significantly decreased usage thereafter. Deductive and inductive thematic analysis reduced the data to four dominant themes: engagement in use of the app; technical functionality of the app; ease of use and design features; and management of consumers' data.The semi-structured interviews provided insight into usage, benefits and challenges of health monitoring using apps. Understanding the range of consumer experiences and expectations can inform design of health apps to encourage persistence in self-monitoring.

Project description:BackgroundHypertension is a chronic disease that is considered to be a public health problem and requires efforts by patients to manage themselves. The global growth in the use of mobile phones and tablets has been accompanied by the increased use of health apps. Many of these apps support the self-management of hypertension and, therefore, they have the potential benefits of lowering blood pressure. Despite this, there is currently a lack of evidence for their effectiveness, usability, and patient satisfaction with their use.ObjectiveA systematic review was conducted to assess the effectiveness of apps in lowering blood pressure, as well as their usability and patients' satisfaction with their use.MethodsWe conducted searches in the following databases: MEDLINE (OVID), EMBASE (OVID), PsycINFO (OVID), CINAHL, the Cochrane Central Register of Controlled Trials (CENTRAL, The Cochrane Library), IEEE Xplore ASSIAN, Google Scholar and the main Arabic databases Al Manhal, AskZad, and Mandumah. We looked for studies that used apps in the self-management of hypertension from 2008-2016. We also checked the reference lists of the review papers and all the primary studies for additional references.ResultsA total of 21 studies with a total of 3112 participants were included in the review. Of the 14 studies that assessed the effectiveness of the apps in lowering blood pressure, 10 (71.4%) studies (6 RCTs and 4 nonrandomized studies) reported that using the apps led to significant decreases in blood pressure and seemed to be effective in the self-management of hypertension. Of these 10, only 2 (20%) RCTs and 3 (30%) nonrandomized studies had a low-moderate risk of bias. The results of this review are inconclusive regarding which combinations of functionalities would be most effective in lowering blood pressure because of variation in the studies' quality, but the data suggest that apps incorporating more comprehensive functionalities are likely to be more effective. In all the studies that assessed the usability of the apps and users' acceptance of them, all the apps seemed to be accepted and easy to use.ConclusionsMost of the studies reported that apps might be effective in lowering blood pressure and are accepted by users. However, these findings should be interpreted with caution, as most of the studies had a high risk of bias. More well-designed, large-scale studies are required to evaluate the real effect of using apps in lowering blood pressure and to identify the most effective functionality combinations for lowering blood pressure.

Project description:BACKGROUND:Evaluating the quality of mobile health apps for weight loss and weight management is important to understand whether these can be used for obesity prevention and treatment. Recent reviews call for more research on multidimensional aspects of app quality, especially involving end users, as there are already many expert reviews on this domain. However, no quantitative study has investigated how laypersons see popular apps for weight management and perceive different dimensions of app quality. OBJECTIVE:This study aimed to explore how laypersons evaluate the quality of 6 free weight management apps (My Diet Coach, SparkPeople, Lark, MyFitnessPal, MyPlate, and My Diet Diary), which achieved the highest quality ratings in a related and recent expert review. METHODS:A user-centered study was conducted with 36 employees of a Lebanese university. Participants enrolled in the study on a rolling basis between October 2016 and March 2017. Participants were randomly assigned an app to use for 2 weeks. App quality was evaluated at the end of the trial period using the Mobile App Rating Scale user version (uMARS). uMARS assesses the dimensions of engagement, functionality, aesthetics, information, and subjective quality on 5-point scales. Internal consistency and interrater agreement were examined. The associations between uMARS scores and users' demographic characteristics were also explored using nonparametric tests. Analyses were completed in November 2017. RESULTS:Overall, the 6 apps were of moderately good quality (median uMARS score 3.6, interquartile range [IQR] 0.3). The highest total uMARS scores were achieved by Lark (mean 4.0 [SD 0.5]) and MyPlate (mean 3.8 [SD 0.4]), which also achieved the highest subjective quality scores (Lark: mean 3.3 [SD 1.4]; MyPlate: mean 3.3 [SD 0.8]). Functionality was the domain with the highest rating (median 3.9, IQR 0.3), followed by aesthetics (median 3.7, IQR 0.5), information (median 3.7, IQR 0.1), and engagement (median 3.3, IQR 0.2). Subjective quality was judged low (median 2.5, IQR 0.9). Overall, subjective quality was strongly and positively related (P<.001) with total uMARS score (?=.75), engagement (?=.68), information, and aesthetics (?=.60) but not functionality (?=.40; P=.02). Higher engagement scores were reported among healthy (P=.003) and obese individuals (P=.03), who also showed higher total uMARS (P=.04) and subjective quality (P=.05) scores. CONCLUSIONS:Although the apps were considered highly functional, they were relatively weak in engagement and subjective quality scores, indicating a low propensity of using the apps in the future. As engagement was the subdomain most strongly associated with subjective quality, app developers and researchers should focus on creating engaging apps, holding constant the functionality, aesthetics, and information quality. The tested apps (in particular Lark and MyPlate) were perceived as more engaging and of higher quality among healthy, obese individuals, making them a promising mode of delivery for self-directed interventions promoting weight control among the sampled population or in similar and comparable settings.

Project description:BackgroundThere is a huge number of health-related apps available, and the numbers are growing fast. However, many of them have been developed without any kind of quality control. In an attempt to contribute to the development of high-quality apps and enable existing apps to be assessed, several guides have been developed.ObjectiveThe main aim of this study was to study the interrater reliability of a new guide - the Mobile App Development and Assessment Guide (MAG) - and compare it with one of the most used guides in the field, the Mobile App Rating Scale (MARS). Moreover, we also focused on whether the interrater reliability of the measures is consistent across multiple types of apps and stakeholders.MethodsIn order to study the interrater reliability of the MAG and MARS, we evaluated the 4 most downloaded health apps for chronic health conditions in the medical category of IOS and Android devices (ie, App Store and Google Play). A group of 8 reviewers, representative of individuals that would be most knowledgeable and interested in the use and development of health-related apps and including different types of stakeholders such as clinical researchers, engineers, health care professionals, and end users as potential patients, independently evaluated the quality of the apps using the MAG and MARS. We calculated the Krippendorff alpha for every category in the 2 guides, for each type of reviewer and every app, separately and combined, to study the interrater reliability.ResultsOnly a few categories of the MAG and MARS demonstrated a high interrater reliability. Although the MAG was found to be superior, there was considerable variation in the scores between the different types of reviewers. The categories with the highest interrater reliability in MAG were "Security" (α=0.78) and "Privacy" (α=0.73). In addition, 2 other categories, "Usability" and "Safety," were very close to compliance (health care professionals: α=0.62 and 0.61, respectively). The total interrater reliability of the MAG (ie, for all categories) was 0.45, whereas the total interrater reliability of the MARS was 0.29.ConclusionsThis study shows that some categories of MAG have significant interrater reliability. Importantly, the data show that the MAG scores are better than the ones provided by the MARS, which is the most commonly used guide in the area. However, there is great variability in the responses, which seems to be associated with subjective interpretation by the reviewers.

Project description:BACKGROUND:Birth satisfaction represents a complex construct of implicit and profound relevance to a woman's perceived birth experience. It correlates with the childbearing woman's experience of the quality of care received and stress during labor. This study aimed to examine the psychometric properties of the Malay language version of the Women's Views of Birth Labour Satisfaction Questionnaire (WOMBLSQ) on labor satisfaction using the Rasch rating scale model. METHODS:A cross-sectional study was conducted. The translated Malay version of the WOMBLSQ was completed by 200 postpartum women in a tertiary hospital. The Rasch model was applied to investigate the statistics, unidimensionality, item polarity and misfit, person misfit and person item distribution map. RESULTS:The Rasch analysis showed that the 27 items, in nine dimensions, had high item reliability and item separation at 0.98 and 7.65 respectively, while good person reliability and person separation were at 0.78 and 1.90, respectively. Item 6 ('My birth partner/husband couldn't have supported me any better') (outfit MnSq?=?1.74, outfit z-std?=?6.9, PtMea Corr?=?-?0.02) and Item 5 ('My birth partner/husband helped me to understand what was going on when I was in labor') (outfit MnSq?=?1.65, outfit z-std?=?2.9, PtMea Corr?=?0.13) are misfit. Item 6 needs to be re-examined for removal or rephrasing, while Item 5 correlates poorly with the construct. Eight persons have the most misfitting response strings based on Item 6 but extremely trivial differences were found in the parameter estimates after refitting the model. Ten items easily endorse satisfaction from the respondents. CONCLUSION:The WOMBLSQ tested among postpartum women has been shown to have a good person reliability index and a high item reliability index. Items 5 and 6 do not contribute in the construction of scale but not degrading and suggested for refining. The spread of item difficulty should be improved in the future modification of items.

Dataset Information

A Questionnaire for Assessing User Satisfaction With Mobile Health Apps: Development Using Rasch Measurement Theory.

Publications

A Questionnaire for Assessing User Satisfaction With Mobile Health Apps: Development Using Rasch Measurement Theory.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets