Dataset Information

A Questionnaire for Assessing User Satisfaction With Mobile Health Apps: Development Using Rasch Measurement Theory.

ABSTRACT: BACKGROUND:Mobile health (mHealth) apps offer great opportunities to deliver large-scale, cost-efficient digital solutions for implementing lifestyle changes. Furthermore, many mHealth apps act as medical devices. Yet, there is little research on how to assess user satisfaction with an mHealth solution. OBJECTIVE:This study presents the development of the mHealth Satisfaction Questionnaire and evaluates its measurement properties. METHODS:Respondents who took part in the Health Integrator Study and were randomized to use the Health Integrator smartphone app for lifestyle changes (n=112), with and without additional telephone coaching, rated their satisfaction with the app using the new 14-item mHealth Satisfaction Questionnaire. The ratings were given on a 5-point Likert scale and measurement properties were evaluated using Rasch measurement theory (RMT). RESULTS:Optimal scoring was reached when response options 2, 3, and 4 were collapsed, giving three response categories. After omitting two items that did not fit into the scale, fit residuals were within, or close to, the recommended range of ±2.5. There was no differential item functioning between intervention group, age group, or sex. The Person Separation Index was 0.79, indicating that the scale's ability to discriminate correctly between person leniency was acceptable for group comparisons but not for individual evaluations. The scale did not meet the criterion of unidimensionality; 16.1% (18/112) of the respondents were outside the desired range of -1.96 to 1.96. In addition, several items showed local dependency and three underlying dimensions emerged: negative experiences, positive experiences, and lifestyle consequences of using the mHealth solution. CONCLUSIONS:In times where mHealth apps and digital solutions are given more attention, the mHealth Satisfaction Questionnaire provides a new possibility to measure user satisfaction to ensure usability and improve development of new apps. Our study is one of only a few cases where RMT has been used to evaluate the usability of such an instrument. There is, though, a need for further development of the mHealth Satisfaction Questionnaire, including the addition of more items and consideration of further response options. The mHealth Satisfaction Questionnaire should also be evaluated in a larger sample and with other mHealth apps and in other contexts. TRIAL REGISTRATION:ClinicalTrials.gov NCT03579342; http://clinicaltrials.gov/ct2/show/NCT03579342.

SUBMITTER: Melin J

PROVIDER: S-EPMC7284402 | biostudies-literature | 2020 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Questionnaire for Assessing User Satisfaction With Mobile Health Apps: Development Using Rasch Measurement Theory.

Melin Jeanette J Bonn Stephanie Erika SE Pendrill Leslie L Trolle Lagerros Ylva Y

JMIR mHealth and uHealth 20200526 5

<h4>Background</h4>Mobile health (mHealth) apps offer great opportunities to deliver large-scale, cost-efficient digital solutions for implementing lifestyle changes. Furthermore, many mHealth apps act as medical devices. Yet, there is little research on how to assess user satisfaction with an mHealth solution.<h4>Objective</h4>This study presents the development of the mHealth Satisfaction Questionnaire and evaluates its measurement properties.<h4>Methods</h4>Respondents who took part in the He ...[more]

PMID: 32452817

Similar Datasets

Project description:BackgroundHypertension is a chronic disease that is considered to be a public health problem and requires efforts by patients to manage themselves. The global growth in the use of mobile phones and tablets has been accompanied by the increased use of health apps. Many of these apps support the self-management of hypertension and, therefore, they have the potential benefits of lowering blood pressure. Despite this, there is currently a lack of evidence for their effectiveness, usability, and patient satisfaction with their use.ObjectiveA systematic review was conducted to assess the effectiveness of apps in lowering blood pressure, as well as their usability and patients' satisfaction with their use.MethodsWe conducted searches in the following databases: MEDLINE (OVID), EMBASE (OVID), PsycINFO (OVID), CINAHL, the Cochrane Central Register of Controlled Trials (CENTRAL, The Cochrane Library), IEEE Xplore ASSIAN, Google Scholar and the main Arabic databases Al Manhal, AskZad, and Mandumah. We looked for studies that used apps in the self-management of hypertension from 2008-2016. We also checked the reference lists of the review papers and all the primary studies for additional references.ResultsA total of 21 studies with a total of 3112 participants were included in the review. Of the 14 studies that assessed the effectiveness of the apps in lowering blood pressure, 10 (71.4%) studies (6 RCTs and 4 nonrandomized studies) reported that using the apps led to significant decreases in blood pressure and seemed to be effective in the self-management of hypertension. Of these 10, only 2 (20%) RCTs and 3 (30%) nonrandomized studies had a low-moderate risk of bias. The results of this review are inconclusive regarding which combinations of functionalities would be most effective in lowering blood pressure because of variation in the studies' quality, but the data suggest that apps incorporating more comprehensive functionalities are likely to be more effective. In all the studies that assessed the usability of the apps and users' acceptance of them, all the apps seemed to be accepted and easy to use.ConclusionsMost of the studies reported that apps might be effective in lowering blood pressure and are accepted by users. However, these findings should be interpreted with caution, as most of the studies had a high risk of bias. More well-designed, large-scale studies are required to evaluate the real effect of using apps in lowering blood pressure and to identify the most effective functionality combinations for lowering blood pressure.

Project description:BackgroundEvaluating the quality of mobile health apps for weight loss and weight management is important to understand whether these can be used for obesity prevention and treatment. Recent reviews call for more research on multidimensional aspects of app quality, especially involving end users, as there are already many expert reviews on this domain. However, no quantitative study has investigated how laypersons see popular apps for weight management and perceive different dimensions of app quality.ObjectiveThis study aimed to explore how laypersons evaluate the quality of 6 free weight management apps (My Diet Coach, SparkPeople, Lark, MyFitnessPal, MyPlate, and My Diet Diary), which achieved the highest quality ratings in a related and recent expert review.MethodsA user-centered study was conducted with 36 employees of a Lebanese university. Participants enrolled in the study on a rolling basis between October 2016 and March 2017. Participants were randomly assigned an app to use for 2 weeks. App quality was evaluated at the end of the trial period using the Mobile App Rating Scale user version (uMARS). uMARS assesses the dimensions of engagement, functionality, aesthetics, information, and subjective quality on 5-point scales. Internal consistency and interrater agreement were examined. The associations between uMARS scores and users' demographic characteristics were also explored using nonparametric tests. Analyses were completed in November 2017.ResultsOverall, the 6 apps were of moderately good quality (median uMARS score 3.6, interquartile range [IQR] 0.3). The highest total uMARS scores were achieved by Lark (mean 4.0 [SD 0.5]) and MyPlate (mean 3.8 [SD 0.4]), which also achieved the highest subjective quality scores (Lark: mean 3.3 [SD 1.4]; MyPlate: mean 3.3 [SD 0.8]). Functionality was the domain with the highest rating (median 3.9, IQR 0.3), followed by aesthetics (median 3.7, IQR 0.5), information (median 3.7, IQR 0.1), and engagement (median 3.3, IQR 0.2). Subjective quality was judged low (median 2.5, IQR 0.9). Overall, subjective quality was strongly and positively related (P<.001) with total uMARS score (ρ=.75), engagement (ρ=.68), information, and aesthetics (ρ=.60) but not functionality (ρ=.40; P=.02). Higher engagement scores were reported among healthy (P=.003) and obese individuals (P=.03), who also showed higher total uMARS (P=.04) and subjective quality (P=.05) scores.ConclusionsAlthough the apps were considered highly functional, they were relatively weak in engagement and subjective quality scores, indicating a low propensity of using the apps in the future. As engagement was the subdomain most strongly associated with subjective quality, app developers and researchers should focus on creating engaging apps, holding constant the functionality, aesthetics, and information quality. The tested apps (in particular Lark and MyPlate) were perceived as more engaging and of higher quality among healthy, obese individuals, making them a promising mode of delivery for self-directed interventions promoting weight control among the sampled population or in similar and comparable settings.

Project description:BackgroundAppropriate dietary intake can have a significant influence on athletic performance. There is a growing consensus on sports nutrition and professionals working with athletes often provide dietary education. However, due to the limitations of existing sports nutrition knowledge questionnaires, previous reports of athletes' nutrition knowledge may be inaccurate.MethodsAn updated questionnaire has been developed based on a recent review of sports nutrition guidelines. The tool has been validated using a robust methodology that incorporates relevant techniques from classical test theory (CTT) and Item response theory (IRT), namely, Rasch analysis.ResultsThe final questionnaire has 89 questions and six sub-sections (weight management, macronutrients, micronutrients, sports nutrition, supplements, and alcohol). The content and face validity of the tool have been confirmed based on feedback from expert sports dietitians and university sports students, respectively. The internal reliability of the questionnaire as a whole is high (KR = 0.88), and most sub-sections achieved an acceptable internal reliability. Construct validity has been confirmed, with an independent T-test revealing a significant (p < 0.001) difference in knowledge scores of nutrition (64 ± 16%) and non-nutrition students (51 ± 19%). Test-retest reliability has been assured, with a strong correlation (r = 0.92, p < 0.001) between individuals' scores on two attempts of the test, 10 days to 2 weeks apart. Three of the sub-sections fit the Rasch Unidimensional Model.ConclusionsThe final version of the questionnaire represents a significant improvement over previous tools. Each nutrition sub-section is unidimensional, and therefore researchers and practitioners can use these individually, as required. Use of the questionnaire will allow researchers to draw conclusions about the effectiveness of nutrition education programs, and differences in knowledge across athletes of varying ages, genders, and athletic calibres.

Project description:Consumers are living longer, creating more pressure on the health system and increasing their requirement for self-care of chronic conditions. Despite rapidly-increasing numbers of mobile health applications ('apps') for consumers' self-care, there is a paucity of research into consumer engagement with electronic self-monitoring. This paper presents a qualitative exploration of how health consumers use apps for health monitoring, their perceived benefits from use of health apps, and suggestions for improvement of health apps.'Health app' was defined as any commercially-available health or fitness app with capacity for self-monitoring. English-speaking consumers aged 18 years and older using any health app for self-monitoring were recruited for interview from the metropolitan area of Perth, Australia. The semi-structured interview guide comprised questions based on the Technology Acceptance Model, Health Information Technology Acceptance Model, and the Mobile Application Rating Scale, and is the only study to do so. These models also facilitated deductive thematic analysis of interview transcripts. Implicit and explicit responses not aligned to these models were analyzed inductively.Twenty-two consumers (15 female, seven male) participated, 13 of whom were aged 26-35 years. Eighteen participants reported on apps used on iPhones. Apps were used to monitor diabetes, asthma, depression, celiac disease, blood pressure, chronic migraine, pain management, menstrual cycle irregularity, and fitness. Most were used approximately weekly for several minutes per session, and prior to meeting initial milestones, with significantly decreased usage thereafter. Deductive and inductive thematic analysis reduced the data to four dominant themes: engagement in use of the app; technical functionality of the app; ease of use and design features; and management of consumers' data.The semi-structured interviews provided insight into usage, benefits and challenges of health monitoring using apps. Understanding the range of consumer experiences and expectations can inform design of health apps to encourage persistence in self-monitoring.

Project description:BACKGROUND:Birth satisfaction represents a complex construct of implicit and profound relevance to a woman's perceived birth experience. It correlates with the childbearing woman's experience of the quality of care received and stress during labor. This study aimed to examine the psychometric properties of the Malay language version of the Women's Views of Birth Labour Satisfaction Questionnaire (WOMBLSQ) on labor satisfaction using the Rasch rating scale model. METHODS:A cross-sectional study was conducted. The translated Malay version of the WOMBLSQ was completed by 200 postpartum women in a tertiary hospital. The Rasch model was applied to investigate the statistics, unidimensionality, item polarity and misfit, person misfit and person item distribution map. RESULTS:The Rasch analysis showed that the 27 items, in nine dimensions, had high item reliability and item separation at 0.98 and 7.65 respectively, while good person reliability and person separation were at 0.78 and 1.90, respectively. Item 6 ('My birth partner/husband couldn't have supported me any better') (outfit MnSq?=?1.74, outfit z-std?=?6.9, PtMea Corr?=?-?0.02) and Item 5 ('My birth partner/husband helped me to understand what was going on when I was in labor') (outfit MnSq?=?1.65, outfit z-std?=?2.9, PtMea Corr?=?0.13) are misfit. Item 6 needs to be re-examined for removal or rephrasing, while Item 5 correlates poorly with the construct. Eight persons have the most misfitting response strings based on Item 6 but extremely trivial differences were found in the parameter estimates after refitting the model. Ten items easily endorse satisfaction from the respondents. CONCLUSION:The WOMBLSQ tested among postpartum women has been shown to have a good person reliability index and a high item reliability index. Items 5 and 6 do not contribute in the construction of scale but not degrading and suggested for refining. The spread of item difficulty should be improved in the future modification of items.

Project description:BackgroundClinical teaching evaluations are common in health profession education programs to ensure students are receiving a quality clinical education experience. Questionnaires students use to evaluate their clinical teachers have been developed in professions such as medicine and nursing. The development of a questionnaire that is specifically for the osteopathy on-campus, student-led clinic environment is warranted. Previous work developed the 30-item Osteopathy Clinical Teaching Questionnaire. The current study utilised Rasch analysis to investigate the construct validity of the Osteopathy Clinical Teaching Questionnaire and provide evidence for the validity argument through fit to the Rasch model.MethodsSenior osteopathy students at four institutions in Australia, New Zealand and the United Kingdom rated their clinical teachers using the Osteopathy Clinical Teaching Questionnaire. Three hundred and ninety-nine valid responses were received and the data were evaluated for fit to the Rasch model. Reliability estimations (Cronbach's alpha and McDonald's omega) were also evaluated for the final model.ResultsThe initial analysis demonstrated the data did not fit the Rasch model. Accordingly, modifications to the questionnaire were made including removing items, removing person responses, and rescoring one item. The final model contained 12 items and fit to the Rasch model was adequate. Support for unidimensionality was demonstrated through both the Principal Components Analysis/t-test, and the Cronbach's alpha and McDonald's omega reliability estimates. Analysis of the questionnaire using McDonald's omega hierarchical supported a general factor (quality of clinical teaching in osteopathy).ConclusionThe evidence for unidimensionality and the presence of a general factor support the calculation of a total score for the questionnaire as a sufficient statistic. Further work is now required to investigate the reliability of the 12-item Osteopathy Clinical Teaching Questionnaire to provide evidence for the validity argument.

Dataset Information

A Questionnaire for Assessing User Satisfaction With Mobile Health Apps: Development Using Rasch Measurement Theory.

Publications

A Questionnaire for Assessing User Satisfaction With Mobile Health Apps: Development Using Rasch Measurement Theory.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets