Dataset Information

Assessing Apps for Health Care Workers Using the ISYScore-Pro Scale: Development and Validation Study.

ABSTRACT:

Background

The presence of mobile phone and smart devices has allowed for the use of mobile apps to support patient care. However, there is a paucity in our knowledge regarding recommendations for mobile apps specific to health care professionals.

Objective

The aim of this study is to establish a validated instrument to assess mobile apps for health care providers and health systems. Our objective is to create and validate a tool that evaluates mobile health apps aimed at health care professionals based on a trust, utility, and interest scale.

Methods

A five-step methodology framework guided our approach. The first step consisted of building a scale to evaluate apps for health care professionals based on a literature review. This was followed with expert panel validation through a Delphi method of (rated) web-based questionnaires to empirically evaluate the inclusion and weight of the indicators identified through the literature review. Repeated iterations were followed until a consensus greater than 75% was reached. The scale was then tested using a pilot to assess reliability. Interrater agreement of the pilot was measured using a weighted Cohen kappa.

Results

Using a literature review, a first draft of the scale was developed. This was followed with two Delphi rounds between the local research group and an external panel of experts. After consensus was reached, the resulting ISYScore-Pro 17-item scale was tested. A total of 280 apps were originally identified for potential testing (140 iOS apps and 140 Android apps). These were categorized using International Statistical Classification of Diseases, Tenth Revision. Once duplicates were removed and they were downloaded to confirm their specificity to the target audience (ie, health care professionals), 66 remained. Of these, only 18 met the final criteria for inclusion in validating the ISYScore-Pro scale (interrator reliabilty 92.2%; kappa 0.840, 95% CI 0.834-0.847; P<.001).

Conclusions

We have developed a reproducible methodology to objectively evaluate mobile health apps targeted to health care professionals and providers, the ISYScore-Pro scale. Future research will be needed to adapt the scale to other languages and across other domains (eg, legal compliance or security).

SUBMITTER: Grau-Corral I

PROVIDER: S-EPMC8339980 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMobile health (mHealth) apps offer great opportunities to deliver large-scale, cost-efficient digital solutions for implementing lifestyle changes. Furthermore, many mHealth apps act as medical devices. Yet, there is little research on how to assess user satisfaction with an mHealth solution.ObjectiveThis study presents the development of the mHealth Satisfaction Questionnaire and evaluates its measurement properties.MethodsRespondents who took part in the Health Integrator Study and were randomized to use the Health Integrator smartphone app for lifestyle changes (n=112), with and without additional telephone coaching, rated their satisfaction with the app using the new 14-item mHealth Satisfaction Questionnaire. The ratings were given on a 5-point Likert scale and measurement properties were evaluated using Rasch measurement theory (RMT).ResultsOptimal scoring was reached when response options 2, 3, and 4 were collapsed, giving three response categories. After omitting two items that did not fit into the scale, fit residuals were within, or close to, the recommended range of ±2.5. There was no differential item functioning between intervention group, age group, or sex. The Person Separation Index was 0.79, indicating that the scale's ability to discriminate correctly between person leniency was acceptable for group comparisons but not for individual evaluations. The scale did not meet the criterion of unidimensionality; 16.1% (18/112) of the respondents were outside the desired range of -1.96 to 1.96. In addition, several items showed local dependency and three underlying dimensions emerged: negative experiences, positive experiences, and lifestyle consequences of using the mHealth solution.ConclusionsIn times where mHealth apps and digital solutions are given more attention, the mHealth Satisfaction Questionnaire provides a new possibility to measure user satisfaction to ensure usability and improve development of new apps. Our study is one of only a few cases where RMT has been used to evaluate the usability of such an instrument. There is, though, a need for further development of the mHealth Satisfaction Questionnaire, including the addition of more items and consideration of further response options. The mHealth Satisfaction Questionnaire should also be evaluated in a larger sample and with other mHealth apps and in other contexts.Trial registrationClinicalTrials.gov NCT03579342; http://clinicaltrials.gov/ct2/show/NCT03579342.

Project description:BackgroundThe last few decades have witnessed significant advances in the development of digital tools and applications for mental health care. Despite growing evidence for their effectiveness, acceptance and use of these tools in clinical practice remain low. Hence, a validated and easy-to-use instrument for assessing professionals' readiness to adopt eMental health (EMH) is necessary to gain further insights into the process of EMH adoption and facilitate future research on this topic.ObjectiveThe aim of this study is to develop and validate an instrument for assessing mental health care professionals' readiness to adopt EMH.MethodsItem generation was guided by literature and inputs from mental health care professionals and experts in survey development. Exploratory factor analyses were conducted on an initial set of 29 items completed by a sample of mental health care professionals (N=432); thereafter, the scale was reduced to 15 items in an iterative process. The factor structure thus obtained was subsequently tested using a confirmatory factor analysis with a second sample of mental health care professionals (N=363). The internal consistency, convergent validity, and predictive validity of the eMental Health Adoption Readiness (eMHAR) Scale were assessed.ResultsExploratory factor analysis resulted in a 3-factor solution with 15 items. The factors were analyzed and labeled as perceived benefits and applicability of EMH, EMH proactive innovation, and EMH self-efficacy. These factors were confirmed through a confirmatory factor analysis. The total scale and subscales showed a good internal consistency (Cronbach α=.73-.88) along with acceptable convergent and predictive relationships with related constructs.ConclusionsThe constructed eMHAR Scale showed a conceptually interpretable 3-factor structure having satisfactory characteristics and relationships with relevant concepts. Its ease of use allows for quick acquisition of data that can contribute to understanding and facilitating the process of adoption of EMH by clinical professionals.

Project description:BackgroundComplete blood count (CBC) and hemostatic screening tests are among the most commonly prescribed blood tests worldwide. All health care workers (nurse practitioners, pharmacists, dentists, midwives, and physicians) are expected to correctly interpret the results in their daily practice. Currently, the undergraduate hematology curriculum consists predominantly of lecture-based teaching. Because hematology combines basic science (blood cells and hemostasis physiology) and clinical skills, students report that they do not easily master hematology with only lecture-based teaching. Having interviewed students at the University of Lorraine, we considered it necessary to develop new teaching approaches and methods.ObjectiveWe aimed to develop and validate a serious game about CBC analysis for health care students. Our primary objective was to help students perceive hematology as being a playful and easy topic and for them to feel truly involved in taking care of their patients by analyzing blood tests. We considered that this game-based approach would be attractive to students as an addition to the classic lecture-based approach and improve their knowledge and skills in hematology.MethodsWe developed an adventure game called SUPER HEMO, a video game in which the player assumes the role of a protagonist in an interactive story driven by exploration and problem-solving tests. Following validation with beta testing by a panel of volunteer students, we used a novel, integrated teaching approach. We added 1.5 hours of gaming to the standard curriculum for a small group of volunteer students. Physician and pharmacy students in their third year at a single French university were invited to attend this extracurricular course. Pregame and postgame tests and satisfaction surveys were immediately recorded. Final hematology exam results were analyzed.ResultsA total of 86 of 324 physician students (26.5%) and 67 of 115 pharmacy students (58%) opted to participate. Median scores on the pre- and posttests were 6 out of 10 versus 7 out of 10, respectively, for the physician students, (P<.001) and 7.5 out of 10 versus 8 out of 10, respectively, for the pharmacy students (P<.001). At the final hematology evaluation, physician students who played SUPER HEMO had a slightly better median score than those who did not: 13 out of 20 versus 12 out of 20, respectively (P=.002). Pharmacy students who played SUPER HEMO had a median score of 21.75 out of 30; this was not significantly different from pharmacy students who did not play SUPER HEMO (20/30; P=.12). Among the participants who answered the survey (n=143), more than 86% (123/143) believed they had strengthened their knowledge and nearly 80% (114/143) of them had fun.ConclusionsFeedback from this game session provided evidence to support the integration of interactive teaching methods in undergraduate hematology teaching. The development of SUPER HEMO is intended to be completed so that it can become a support tool for continuing education.

Project description:BackgroundThe family environment is important for explaining individual health behaviour. While previous research mostly focused on influences among family members and dyadic interactions (parent-child), the purpose of this study was to develop a new measure, the Family Health Climate Scale (FHC-Scale), using a family-based approach. The FHC is an attribute of the whole family and describes an aspect of the family environment that is related to health and health behaviour. Specifically, a questionnaire measuring the FHC (a) for nutrition (FHC-NU) and (b) for activity behaviour (FHC-PA) was developed and validated.MethodsIn Study 1 (N=787) the FHC scales were refined and validated. The sample was randomly divided into two subsamples. With random sample I exploratory factor analyses were conducted and items were selected according to their psychometric quality. In a second step, confirmatory factor analyses were conducted using the random sample II. In Study 2 (N=210 parental couples) the construct validity was tested by correlating the FHC to self-determined motivation of healthy eating and physical activity as well as the families' food environment and joint physical activities.ResultsExploratory factor analyses with random sample I (Study 1) revealed a four (FHC-NU) and a three (FHC-PA) factor model. These models were cross-validated with random sample II and demonstrated an acceptable fit [FHC-PA: χ(2)=222.69, df=74, p<.01; χ(2)/df=3.01; CFI=.96; SRMR=.04; RMSEA=.07, CI .06/.08; FHC-NU: χ(2)=278.30, df=113, p<.01, χ(2)/df=2.46, CFI=.96; SRMR=.04; RMSEA=.06, CI .05/.07]. The perception of FHC correlated (p<.01) with the intrinsic motivation of healthy eating (r=.42) and physical activity (r=.56). Moreover, parental perceptions of FHC-NU correlated with household soft drink availability (r=-.31) and perceptions of FHC-PA with the frequency of joint physical activities with the child (r=.51). These patterns were found on the intraindividual and interindividual level.ConclusionsTwo valid instruments measuring the FHC within families were developed. The use of different informants' ratings demonstrated that the FHC is a family level variable. The results confirm the high relevance of the FHC for individuals' health behaviour. The FHC and the measurement instruments are useful for examining health-related aspects of the family environment.