Dataset Information

Methods and Measures Used to Evaluate Patient-Operated Mobile Health Interventions: Scoping Literature Review.

ABSTRACT: BACKGROUND:Despite the prevalence of mobile health (mHealth) technologies and observations of their impacts on patients' health, there is still no consensus on how best to evaluate these tools for patient self-management of chronic conditions. Researchers currently do not have guidelines on which qualitative or quantitative factors to measure or how to gather these reliable data. OBJECTIVE:This study aimed to document the methods and both qualitative and quantitative measures used to assess mHealth apps and systems intended for use by patients for the self-management of chronic noncommunicable diseases. METHODS:A scoping review was performed, and PubMed, MEDLINE, Google Scholar, and ProQuest Research Library were searched for literature published in English between January 1, 2015, and January 18, 2019. Search terms included combinations of the description of the intention of the intervention (eg, self-efficacy and self-management) and description of the intervention platform (eg, mobile app and sensor). Article selection was based on whether the intervention described a patient with a chronic noncommunicable disease as the primary user of a tool or system that would always be available for self-management. The extracted data included study design, health conditions, participants, intervention type (app or system), methods used, and measured qualitative and quantitative data. RESULTS:A total of 31 studies met the eligibility criteria. Studies were classified as either those that evaluated mHealth apps (ie, single devices; n=15) or mHealth systems (ie, more than one tool; n=17), and one study evaluated both apps and systems. App interventions mainly targeted mental health conditions (including Post-Traumatic Stress Disorder), followed by diabetes and cardiovascular and heart diseases; among the 17 studies that described mHealth systems, most involved patients diagnosed with cardiovascular and heart disease, followed by diabetes, respiratory disease, mental health conditions, cancer, and multiple illnesses. The most common evaluation method was collection of usage logs (n=21), followed by standardized questionnaires (n=18) and ad-hoc questionnaires (n=13). The most common measure was app interaction (n=19), followed by usability/feasibility (n=17) and patient-reported health data via the app (n=15). CONCLUSIONS:This review demonstrates that health intervention studies are taking advantage of the additional resources that mHealth technologies provide. As mHealth technologies become more prevalent, the call for evidence includes the impacts on patients' self-efficacy and engagement, in addition to traditional measures. However, considering the unstructured data forms, diverse use, and various platforms of mHealth, it can be challenging to select the right methods and measures to evaluate mHealth technologies. The inclusion of app usage logs, patient-involved methods, and other approaches to determine the impact of mHealth is an important step forward in health intervention research. We hope that this overview will become a catalogue of the possible ways in which mHealth has been and can be integrated into research practice.

SUBMITTER: Bradway M

PROVIDER: S-EPMC7226051 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Methods and Measures Used to Evaluate Patient-Operated Mobile Health Interventions: Scoping Literature Review.

Bradway Meghan M Gabarron Elia E Johansen Monika M Zanaboni Paolo P Jardim Patricia P Joakimsen Ragnar R Pape-Haugaard Louise L Årsand Eirik E

JMIR mHealth and uHealth 20200430 4

<h4>Background</h4>Despite the prevalence of mobile health (mHealth) technologies and observations of their impacts on patients' health, there is still no consensus on how best to evaluate these tools for patient self-management of chronic conditions. Researchers currently do not have guidelines on which qualitative or quantitative factors to measure or how to gather these reliable data.<h4>Objective</h4>This study aimed to document the methods and both qualitative and quantitative measures used ...[more]

PMID: 32352394

Similar Datasets

Project description:ObjectiveThis scoping review aims to characterize the current literature on electronic patient-reported outcome measures (ePROMs) in rheumatology and assess the feasibility and utility of ePROMs and mobile health technology in the management of rheumatic disease.IntroductionPatient-reported outcome measures (PROMs) are commonly used in rheumatology as they are important markers of disease activity and overall function, encourage shared decision-making, and are associated with high rates of patient satisfaction. With the widespread use of mobile devices, there is increasing interest in the use of mobile health technology to collect electronic PROMs (ePROM).Inclusion criteriaAll primary studies that involve the collection of ePROMs using mobile devices by individuals with a rheumatic disease were included. Articles were excluded if ePROMs were measured during clinic appointments.MethodsA scoping review was performed using Medline, Embase, PsycINFO, and CINAHL with index terms and key words related to "patient-reported outcome measures", "rheumatic diseases", and "mobile health technology".ResultsA total of 462 records were identified after duplicates were removed. Of the 70 studies selected for review, 43% were conference proceedings and 57% were journal articles, with the majority published in 2016 or later. Inflammatory arthritis was the most common rheumatic disease studied. Generic ePROMs were used over three times more often than disease-specific ePROMs. A total of 39 (56%) studies directly evaluated the feasibility of ePROMs in clinical practice, 19 (27%) were clinical trials that used ePROMs as study endpoints, 9 (13%) were focus groups or surveys on smartphone application development, and 3 (4%) did not fit into one defined category.ConclusionThe use of ePROMs in rheumatology is a growing area of research and shows significant utility in clinical practice, particularly in inflammatory arthritis. Further research is needed to better characterize the feasibility of ePROMs in rheumatology and their impact on patient outcomes.

Project description:BackgroundDialog agents (chatbots) have a long history of application in health care, where they have been used for tasks such as supporting patient self-management and providing counseling. Their use is expected to grow with increasing demands on health systems and improving artificial intelligence (AI) capability. Approaches to the evaluation of health care chatbots, however, appear to be diverse and haphazard, resulting in a potential barrier to the advancement of the field.ObjectiveThis study aims to identify the technical (nonclinical) metrics used by previous studies to evaluate health care chatbots.MethodsStudies were identified by searching 7 bibliographic databases (eg, MEDLINE and PsycINFO) in addition to conducting backward and forward reference list checking of the included studies and relevant reviews. The studies were independently selected by two reviewers who then extracted data from the included studies. Extracted data were synthesized narratively by grouping the identified metrics into categories based on the aspect of chatbots that the metrics evaluated.ResultsOf the 1498 citations retrieved, 65 studies were included in this review. Chatbots were evaluated using 27 technical metrics, which were related to chatbots as a whole (eg, usability, classifier performance, speed), response generation (eg, comprehensibility, realism, repetitiveness), response understanding (eg, chatbot understanding as assessed by users, word error rate, concept error rate), and esthetics (eg, appearance of the virtual agent, background color, and content).ConclusionsThe technical metrics of health chatbot studies were diverse, with survey designs and global usability metrics dominating. The lack of standardization and paucity of objective measures make it difficult to compare the performance of health chatbots and could inhibit advancement of the field. We suggest that researchers more frequently include metrics computed from conversation logs. In addition, we recommend the development of a framework of technical metrics with recommendations for specific circumstances for their inclusion in chatbot studies.

Project description:BackgroundCombination prevention is currently considered the best approach to combat HIV epidemic. It is based upon the combination of structural, behavioral, and biomedical interventions. Such interventions are frequently implemented in a health-promoting manner due to their aims, the approach that was adopted, and their complexity. The impact evaluation of these interventions often relies on methods inherited from the biomedical field. However, these methods have limitations and should be adapted to be relevant for these complex interventions. This systematic review aims to map the evidence-based methods used to quantify the impact of these interventions and analyze how these methods are implemented.MethodsThree databases (Web of Science, Scopus, PubMed) will be used to identify impact evaluation studies of health promotion interventions that aimed at reducing the incidence or prevalence of HIV infection. Only studies based on quantitative design assessing intervention impact on HIV prevalence or incidence will be included. Two reviewers will independently screen studies based on titles and abstracts and then on the full text. The information about study characteristics will be extracted to understand the context in which the interventions are implemented. The information specific to quantitative methods of impact evaluation will be extracted using items from the Mixed Methods Appraisal Tool (MMAT), the guidelines for reporting Statistical Analyses and Methods in the Published Literature (SAMPL), and the guidelines for Strengthening The Reporting of Empirical Simulation Studies (STRESS). This review will be conducted according to the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) statement.DiscussionThe impact evaluation of HIV prevention interventions is a matter of substantial importance given the growing need for evidence of the effectiveness of these interventions, whereas they are increasingly complex. These evaluations allow to identify the most effective strategies to be implemented to fight the epidemic. It is therefore relevant to map the methods to better implement them and adapt them according to the type of intervention to be evaluated.Systematic review registrationPROSPERO CRD42020210825.

Project description:BACKGROUND:Adherence to oral chemotherapy is crucial to maximize treatment outcomes and avoid health complications in cancer patients. Mobile phones are widely available worldwide, and evidence that this technology can be successfully employed to increase medication adherence for the treatment of other chronic diseases (eg, diabetes) is well established. However, the extent to which there is evidence that mobile phone-based interventions improve adherence to oral chemotherapy is unknown. OBJECTIVE:This scoping review aims to explore what is known about mobile phone-delivered interventions designed to enhance adherence to oral chemotherapy, to examine the reported findings on the utility of these interventions in increasing oral chemotherapy adherence, and to identify opportunities for development of future interventions. METHODS:This study followed Arksey and O'Malley's scoping review methodological framework. RESULTS:The review search yielded 5 studies reporting on 4 interventions with adults (aged >18 years) diagnosed with diverse cancer types. All interventions were considered acceptable, useful, and feasible. The following themes were evident: text messages and mobile apps were the main methods of delivering these interventions, the 2 most commonly employed oral chemotherapy adherence-enhancing strategies were management and reporting of drug-related symptoms and reminders to take medication, the importance of stakeholders' engagement in intervention design, and the overall positive perceptions of delivery features. Areas for future research identified by this review include the need for further studies to evaluate the impact of mobile phone-delivered interventions on adherence to oral chemotherapy as well as the relevance for future studies to incorporate design frameworks and economic evaluations and to explore the moderator effect of high anxiety, poor baseline adherence, and longer time taking prescribed drug on adherence to oral chemotherapy. CONCLUSIONS:Despite the increasing body of evidence on the use of mobile phones to deliver medication adherence-enhancing interventions in chronic diseases, literature on the oral chemotherapy context is lacking. This review showed that existing interventions are highly acceptable and useful to cancer patients. The engagement of stakeholders as well as the use of a design framework are important elements in the development of mobile phone-delivered interventions that can be translated into oncology settings.

Project description:BackgroundMastectomy is the first-line treatment approach for more than 90% of breast cancer patients. The numerous physical impairments associated with this surgical procedure negatively impact the patient's quality of life. To date, rehabilitation resources available for breast cancer patients undergoing mastectomy within the institutions affiliated to the Centre intégré universitaire de soins de santé et de services sociaux de la Mauricie-et-du-Centre-du-Québec (CIUSSS-MCQ) are lacking and do not always seem to reflect the particularities of breast cancer care pathways. The purpose of this review was to identify and describe the conservative interventions and the clinical outcome measures used in the perioperative physical rehabilitation of women with breast cancer who are awaiting or have undergone mastectomy. We also aimed to report on the barriers and facilitators to study participation and completion.MethodsMEDLINE, CINAHL, and the Cochrane Library were searched from inception to January 2021, and we updated the search on July 11, 2022. We included peer-reviewed English and French literature with quantitative designs, describing conservative interventions and clinical outcome measures used within rehabilitation programs designed for women who were awaiting or had undergone mastectomy. Paired reviewers independently reviewed all citations and articles using a two-phase screening process and independently extracted the data.ResultsOf the 6080 articles identified, 57 met the inclusion criteria. Most interventions were multimodal, which combined exercise with patient education, manual therapy, and/or lymphatic drainage. The most frequently used objective measures of physical function were shoulder range of motion, muscle strength, and signs of lymphedema. In contrast, the primary patient-reported outcome measures were quality of life, shoulder function, and pain. Undergoing another breast surgery, death, and cancer recurrence were the most reported barriers to study completion.ConclusionThis scoping review reports on the heterogeneity and wide range of conservative interventions and clinical outcome measures used in the physical rehabilitation of breast cancer patients who had undergone or were scheduled to undergo mastectomy. Tailoring interventions to breast cancer patients' needs and promoting outpatient rehabilitation interventions appear to be better suited to the particularities of breast cancer care pathways. Further research is needed to better identify barriers and facilitators to study participation and completion.

Project description:OBJECTIVES:Rehabilitation interventions for older adults are complex as they involve a number of interacting components, have multiple outcomes of interest and are influenced by a number of contextual factors. The importance of rigorous intervention development prior to formal evaluation has been acknowledged and a number of frameworks have been developed. This review explored which frameworks have been used to guide the development of rehabilitation interventions for older adults. DESIGN:Systematic scoping review. SETTING:Studies were not limited for inclusion based on setting. PARTICIPANTS:Studies were included that featured older adults (>65 years of age). INTERVENTIONS:Studies were included that reported the development of a rehabilitation intervention. PRIMARY AND SECONDARY OUTCOME MEASURES:Data were extracted on study population, setting, type of intervention developed and frameworks used. The primary outcome of interest was the type of intervention development framework. RESULTS:Thirty-five studies were included. There was a range of underlying medical conditions including mild cognitive impairment and dementia (n=5), cardiac (n=4), stroke (n=3), falls (n=3), hip fracture (n=2), diabetes (n=2), breast cancer (n=1), Parkinson's disease (n=1), depression (n=1), chronic health problems (n=1), osteoarthritis (n=1), leg ulcer (n=1), neck pain (n=1) and foot problems (n=1). The intervention types being developed included multicomponent, support based, cognitive, physical activities, nursing led, falls prevention and occupational therapy led. Twelve studies (34%) did not report using a framework. Five frameworks were reported with the Medical Research Council (MRC) framework for developing and evaluating complex interventions being the most frequently cited (77%, n=17). CONCLUSION:At present, the MRC framework is the most popular for developing rehabilitation interventions for older adults. Many studies do not report using a framework. Further, specific guidance to assist this complex field of rehabilitation research is required.

Dataset Information

Methods and Measures Used to Evaluate Patient-Operated Mobile Health Interventions: Scoping Literature Review.

Publications

Methods and Measures Used to Evaluate Patient-Operated Mobile Health Interventions: Scoping Literature Review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets