Dataset Information

Assessing the Implementation and Effectiveness of the Electronic Patient-Reported Outcome Tool for Older Adults With Complex Care Needs: Mixed Methods Study.

ABSTRACT:

Background

Goal-oriented care is being adopted to deliver person-centered primary care to older adults with multimorbidity and complex care needs. Although this model holds promise, its implementation remains a challenge. Digital health solutions may enable processes to improve adoption; however, they require evaluation to determine feasibility and impact.

Objective

This study aims to evaluate the implementation and effectiveness of the electronic Patient-Reported Outcome (ePRO) mobile app and portal system, designed to enable goal-oriented care delivery in interprofessional primary care practices. The research questions driving this study are as follows: Does ePRO improve quality of life and self-management in older adults with complex needs? What mechanisms are likely driving observed outcomes?

Methods

A multimethod, pragmatic randomized controlled trial using a stepped-wedge design and ethnographic case studies was conducted over a 15-month period in 6 comprehensive primary care practices across Ontario with a target enrollment of 176 patients. The 6 practices were randomized into either early (3-month control period; 12-month intervention) or late (6-month control period; 9-month intervention) groups. The primary outcome measure of interest was the Assessment of Quality of Life-4D (AQoL-4D). Data were collected at baseline and at 3 monthly intervals for the duration of the trial. Ethnographic data included observations and interviews with patients and providers at the midpoint and end of the intervention. Outcome data were analyzed using linear models conducted at the individual level, accounting for cluster effects at the practice level, and ethnographic data were analyzed using qualitative description and framework analysis methods.

Results

Recruitment challenges resulted in fewer sites and participants than expected; of the 176 target, only 142 (80.6%) patients were identified as eligible to participate because of lower-than-expected provider participation and fewer-than-expected patients willing to participate or perceived as ready to engage in goal-setting. Of the 142 patients approached, 45 (32%) participated. Patients set a variety of goals related to self-management, mental health, social health, and overall well-being. Owing to underpowering, the impact of ePRO on quality of life could not be definitively assessed; however, the intervention group, ePRO plus usual care (mean 15.28, SD 18.60) demonstrated a nonsignificant decrease in quality of life (t₂₄=-1.20; P=.24) when compared with usual care only (mean 21.76, SD 2.17). The ethnographic data reveal a complex implementation process in which the meaningfulness (or coherence) of the technology to individuals' lives and work acted as a key driver of adoption and tool appraisal.

Conclusions

This trial experienced many unexpected and significant implementation challenges related to recruitment and engagement. Future studies could be improved through better alignment of the research methods and intervention to the complex and diverse clinical settings, dynamic goal-oriented care process, and readiness of provider and patient participants.

Trial registration

ClinicalTrials.gov NCT02917954; https://clinicaltrials.gov/ct2/show/NCT02917954.

SUBMITTER: Steele Gray C

PROVIDER: S-EPMC8726765 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Patient-reported outcome measures (PROMs) provide an opportunity for meaningful patient engagement and shared decision-making. The objective of this research programme is to improve health outcomes for paediatric solid organ transplant patients by implementing PROMs into clinical care. The current study aims to create Voxe, a paediatric user-centred electronic PROM platform, by engaging patients and healthcare providers throughout the design and development process. The creation of Voxe will occur over two phases that build on previous research. The user interface design phase employs a 'user-centric' approach to identify end-users' needs and iteratively refine the look and layout of Voxe to meet these needs. Transplant recipients, aged 10-17, and healthcare providers will participate in three rounds of testing (24 participants total). Participants will: (1) complete task-based activities (outcomes-effectiveness and efficiency), (2) complete questionnaires (outcome-satisfaction) and (3) participate in a semi-structured interview. The following phase involves software development and Voxe usability testing. Transplant recipients, aged 8-17, and healthcare providers will participate in four rounds of iterative testing (24-40 participants total). The think-aloud technique will be employed, and participants will describe their thoughts and feelings while interacting with a Voxe prototype. Participants will: (1) log into Voxe and complete tasks (outcomes-time on task, successful task completion, frequency of critical and non-critical errors and error-free rate), (2) complete questionnaires (outcome-satisfaction) and (3) participate in a semi-structured interview. Findings will result in the creation and launch of a user-centred electronic PROM platform. Research ethics board approval has been provided by The Hospital for Sick Children. This research is critical to answering methodological and operational questions to inform Voxe implementation in paediatric clinical settings and facilitate PROM data collection. Future investigations will include an implementation-effectiveness evaluation.

Project description:BACKGROUND:Mobile health (mHealth) technologies are increasingly used in various medical fields. However, the potential of mHealth to improve patient care in radiotherapy by acquiring electronic patient reported outcome measures (ePROMs) during treatment has been poorly studied so far. OBJECTIVE:The aim of this study was to develop and implement a novel Web app (PROMetheus) for patients undergoing radiotherapy. Herein, we have reported our experience with a focus on feasibility, patient acceptance, and a correlation of ePROMs with the clinical course of the patients. METHODS:In the period between January and June 2018, 21 patients used PROMetheus to score side effects, symptoms, and quality of life-related parameters during and after their treatment. Items of the Patient Reported Outcome version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) were chosen based on the primary site of disease, 27 items for head and neck tumors, 21 items for thoracic tumors, and 24 items for pelvic tumors. RESULTS:In total, 17 out of the 21 patients (81%) regularly submitted ePROMs and more than 2500 data points were acquired. An average of 5.2, 3.5, and 3.3 min was required to complete the head and neck, thorax, and pelvis questionnaires, respectively. ePROMS were able to detect the occurrence of both expected and unexpected side effects during the treatment. In addition, a gradual increase in the severity of side effects over the course the treatment and their remission afterward could be observed with ePROMs. In total, 9 out of the 17 patients (53%), mostly those with head and neck and thoracic cancers, reported PRO-CTCAE grade III or IV fatigue with severe impairments of activities of daily life. CONCLUSIONS:This study shows the successful implementation of an ePROM system and a high patient acceptance. ePROMs have a great potential to improve patient care in radiotherapy by providing a comprehensive documentation of symptoms and side effects, especially of ones that are otherwise underreported.

Project description:BACKGROUND:In addition to delivering vital health care to millions of patients in the United States, community health centers (CHCs) provide needed health insurance outreach and enrollment support to their communities. We developed a health insurance enrollment tracking tool integrated within the electronic health record (EHR) and conducted a hybrid implementation-effectiveness trial in a CHC-based research network to assess tool adoption using two implementation strategies. METHODS:CHCs were recruited from the OCHIN practice-based research network. Seven health center systems (23 CHC clinic sites) were recruited and randomized to receive basic educational materials alone (Arm 1), or these materials plus facilitation (Arm 2) during the 18-month study period, September 2016-April 2018. Facilitation consisted of monthly contacts with clinic staff and utilized audit and feedback and guided improvement cycles. We measured total and monthly tool utilization from the EHR. We conducted structured interviews of CHC staff to assess factors associated with tool utilization. Qualitative data were analyzed using an immersion-crystallization approach with barriers and facilitators identified using the Consolidated Framework for Implementation Research. RESULTS:The majority of CHCs in both study arms adopted the enrollment tool. The rate of tool utilization was, on average, higher in Arm 2 compared to Arm 1 (20.0% versus 4.7%, p?<?0.01). However, by the end of the study period, the rate of tool utilization was similar in both arms; and observed between-arm differences in tool utilization were largely driven by a single, large health center in Arm 2. Perceived relative advantage of the tool was the key factor identified by clinic staff as driving tool utilization. Implementation climate and leadership engagement were also associated with tool utilization. CONCLUSIONS:Using basic education materials and low-intensity facilitation, CHCs quickly adopted an EHR-based tool to support critical outreach and enrollment activities aimed at improving access to health insurance in their communities. Though facilitation carried some benefit, a CHC's perceived relative advantage of the tool was the primary driver of decisions to implement the tool. TRIAL REGISTRATION:ClinicalTrials.gov: NCT02355262, Posted February 4, 2015.

Project description:OBJECTIVE:The aim of this paper is to describe the stages undertaken to generate the items and conceptual framework of a new electronic personal assessment questionnaire for vascular conditions. DESIGN:A mixed methods study: First a survey of vascular clinicians was completed to identify the most common conditions treated in vascular clinics and wards. Quantitative systematic reviews were done to identify validated patient-reported outcome measures (PROMs) for direct inclsuion in the new instrument. However, due to scarcity of validated PROMs, the items of the new instrument were mainly based on a large qualitative study of patients and systematic reviews of the qualitative evidence . This was followed by a quantitative clinicians' consensus study and, finally, a qualitative face validity study with patients. PARTICIPANTS:Vascular patients participated in the primary qualitative study and the face validity study. In the qualitative study, 55 patients were interviewed, and for the face validity, 19 patients gave feedback. Twelve clinicians completed the survey and 13 completed two cycles of the clinicians' consensus study. RESULTS:The items and scales in the electronic personal assessment questionnaire for vascular conditions (ePAQ-VAS) were generated based on the results of five systematic reviews evaluating existing PROMs for possible inclusion in ePAQ-VAS, five systematic reviews of qualitative evidence, a primary qualitative study involving 55 patients and clinicians' input. One hundred and sixty-eight items were initially generated, of which 59 were eliminated by the expert panel due to repetition. The instrument was divided into one generic and three disease-specific sections (abdominal aortic aneurysm, carotid artery disease and lower limb vascular conditions). In each section, items were grouped together into putative scales. Fifty-five items were grouped across eight scales; the remaining items were kept as individual items, because of relevance to service users. CONCLUSIONS:This multidimensional electronic questionnaire covers the most common vascular conditions. This is particularly important for patients presenting with mixed symptoms or multiple conditions. This tool captures symptomatology, health related quality of life (HRQoL) and other clinically relevant data, such as experience with services and comorbidities.

Project description:ObjectivesTo examine the acceptability and validity of two patient-reported outcome measures (PROMs) for adult acne, comparing them to the validated Acne-specific Quality of Life (Acne-QoL) measure.DesignMixed-methods validation study.SettingParticipants were recruited by (1) mail-out through primary care if they had ever consulted for acne and received a prescription for acne treatment within the last 6 months, (2) opportunistically in secondary care and (3) poster advertisement in community venues.Participants221 (204 quantitative and 17 qualitative) participants with acne, aged 18-50 years.Outcome measuresQuantitative sub-study participants completed Acne-QoL, Skindex-16 and Comprehensive Acne Quality of Life Scale (CompAQ) at baseline, 24 hours and 6 weeks. Qualitative sub-study participants took part in cognitive think-aloud interviews, while completing the same measures. Transcribed audio recordings were analysed using inductive thematic analysis.ResultsQuantitative analyses suggested high internal consistency (Cronbach's alpha 0.74-0.96) and reliability (intraclass correlation coefficient values 0.88-0.97) for both questionnaires. Both scales showed floor effects on some subdomains. Skindex-16 and CompAQ showed good evidence of construct validity when compared with Acne-QoL with Spearman's correlation coefficients 0.54-0.81, and good repeatability over 24 hours.Qualitative data uncovered wide-ranging views regarding usability and acceptability. Interviewees held strong but differing views about layout, question/response wording, redundant/similar questions and guidance notes. Similarly, interviewees differed in perceptions of acceptability of the different scales, particularly on relatability of questions and emotive reactions to scales.ConclusionsAll PROMs performed well in statistical analyses. No PROM showed superior usability and acceptability in the qualitative study. Any PROM should be acceptable for further research in adult acne but researchers should consider the different domains and whether they will measure only facial or facial and trunk acne before making a selection. A new PROM or further evaluation of novel PROMs may be beneficial.

Project description:OBJECTIVES:To develop outcome measures to assess practical management of primary surgical wounds and patient experience. DESIGN:Mixed methods, including qualitative interviews and data extraction from published randomised controlled trials (RCTs). SETTING:Two university-teaching NHS hospitals and three district NHS hospitals in the South West and Midlands regions of England. PARTICIPANTS:Sixty-four patients and 15 healthcare professionals from abdominal general surgical specialities and obstetrics (caesarean section). METHODS:Measures were developed according to standard guidelines to identify issues relevant to patients' experiences of surgical wounds and dressings, including analysis of existing RCT outcomes and semi-structured interviews. These were written into provisional questionnaire items for a single outcome measure. Cognitive interviews with patients and healthcare professionals assessed face validity, acceptability and relevance. Findings from interviews were regularly shared with the study team who suggested amendments to modify and reword items to improve understanding before further iterative testing with patients and healthcare professionals. RESULTS:Analyses of existing RCT outcomes and interviews produced a total of 69 issues. Pretesting and iterative revision established the need for two separate measures. One measure addresses healthcare professionals' experience of wound management in two key areas: exudate and its impact, and allergic reactions to the dressing. The other measure addresses patients' experience of wounds in seven key areas: wound comfort, dressing removal, dressings to protect the wound, impact on daily activities, ease of movement, anxiety about the wound and satisfaction with dressing. Each measure took less than five?min to complete and both were understood and acceptable to patients and healthcare professionals. CONCLUSION:This in-depth study has developed two measures to assess practical management of primary surgical wounds and patient experience. Further work to test their validity, reliability and application to other settings is now required. TRIAL REGISTRATION NUMBER:HTA - 12/200/04; Pre-results.

Project description:BackgroundPatient portals play an important role in connecting patients with their medical care team, which improves patient engagement in treatment plans, decreases unnecessary visits, and reduces costs. During natural disasters, patients' needs increase, whereas available resources, specifically access to care, become limited.ObjectiveThis study aims to examine patients' health needs during a natural crisis by analyzing the electronic messages sent during Hurricane Harvey to guide future disaster planning efforts.MethodsWe explored patient portal use data from a large Greater Houston area health care system focusing on the initial week of the Hurricane Harvey disaster, beginning with the date of landfall, August 25, 2017, to August 31, 2017. A mixed methods approach was used to assess patients' immediate health needs and concerns during the disruption of access to routine and emergent medical care. Quantitative analysis used logistic regression models to assess the predictive characteristics of patients using the portal during Hurricane Harvey. This study also included encounters by type (emergency, inpatient, observation, outpatient, and outpatient surgery) and time (before, during, and after Hurricane Harvey). For qualitative analysis, the content of these messages was examined using the constant comparative method to identify emerging themes found within the message texts.ResultsOut of a total of 557,024 patients, 4079 (0.73%) sent a message during Hurricane Harvey, whereas 31,737 (5.69%) used the portal. Age, sex, race, and ethnicity were predictive factors for using the portal and sending a message during the natural disaster. We found that prior use of the patient portal increased the likelihood of portal use during Hurricane Harvey (odds ratio 13.688, 95% CI 12.929-14.491) and of sending a portal message during the disaster (odds ratio 14.172, 95% CI 11.879-16.907). Having an encounter 4 weeks before or after Hurricane Harvey was positively associated with increased use of the portal and sending a portal message. Patients with encounters during the main Hurricane Harvey week had a higher increased likelihood of portal use across all five encounter types. Qualitative themes included: access, prescription requests, medical advice (chronic conditions, acute care, urgent needs, and Hurricane Harvey-related injuries), mental health, technical difficulties, and provider constraints.ConclusionsThe patient portal can be a useful tool for communication between patients and providers to address the urgent needs and concerns of patients as a natural disaster unfolds. This was the first known study to include encounter data to understand portal use compared with care provisioning. Prior use was predictive of both portal use and message sending during Hurricane Harvey. These findings could inform the types of demands that may arise in future disaster situations and can serve as the first step in intentionally optimizing patient portal usability for emergency health care management during natural disasters.

Project description:Background: Improving the mobility of hospitalized patients with an acute exacerbation of chronic obstructive pulmonary disease (AECOPD) is a priority of care. AECOPD-Mob is a clinical decision-making tool for physical therapists, especially those who are newly graduated or are new to caring for patients with AECOPDs in acute care settings. Although this tool has been available for several years, dissemination via publication is not sufficient to implement it in clinical practice.Objective: The primary objective of this study was to develop, implement, and evaluate different formats of AECOPD-Mob in an acute care setting.Methods: We used a mixed-methods, convergent parallel design. In addition to the paper format of AECOPD-Mob, we developed a smartphone app, a web-based learner module, and an in-service learning session. Newly graduated physical therapists (PTs) or PTs new to the practice area were recruited from urban acute care hospitals. Participants used the different formats for 3 weeks and then completed the Post-Study System Usability Questionnaire. User data were retrieved for the learning module. Participants participated in focus groups at 3 weeks and 3 months.Results: Eighteen (72% of eligible PTs, 100% female, 94% graduated within 3 yr) PTs participated. Post-Study System Usability Questionnaire scores for the learning module and smartphone indicated that participants were satisfied with these formats (median score 2.0 on 1-7 Likert Scale for both technology formats, lower scores indicating greater satisfaction). However, the participants reported in the focus group that the paper format was preferred over other formats. Concerns with the smartphone app included infection control and the perception of lack of professionalism when using a smartphone during clinical practice. The learning module and in-service were considered helpful as an introduction but not as an ongoing support. The paper format was seen as the most efficient way to access the necessary information and to facilitate communication between other members of the care team about the importance of mobility for hospitalized patients with AECOPDs.Conclusion: Newly graduated PTs strongly preferred the paper format of the AECOPD-Mob tool in the acute care setting. Future research will focus on knowledge translation strategies for other health disciplines.