Dataset Information

Improvement and Evaluation of the TOPCOP Taxonomy of Patient Portals: Taxonomy-Evaluation-Delphi (TED) Approach.

ABSTRACT:

Background

Patient portals have been introduced in many countries over the last 10 years, but many health information managers still feel they have too little knowledge of patient portals. A taxonomy can help them to better compare and select portals. This has led us to develop the TOPCOP taxonomy for classifying and comparing patient portals. However, the taxonomy has not been evaluated by users.

Objective

This study aimed to evaluate the taxonomy's usefulness to support health information managers in comparing, classifying, defining a requirement profile for, and selecting patient portals and to improve the taxonomy where needed.

Methods

We used a modified Delphi approach. We sampled a heterogeneous panel of 13 health information managers from 3 countries using the criterion sampling strategy. We conducted 4 anonymous survey rounds with qualitative and quantitative questions. In round 1, the panelists assessed the appropriateness of each dimension, and we collected new ideas to improve the dimensions. In rounds 2 and 3, the panelists iteratively evaluated the taxonomy that was revised based on round 1. In round 4, the panelists assessed the need for a taxonomy and the appropriateness of patient engagement as a distinguishing concept. Then, they compared 2 real portals with the final taxonomy and evaluated its usefulness for comparing portals, creating an initial requirement profile, and selecting patient portals. To determine group consensus, we applied the RAND/UCLA Appropriateness Method.

Results

The final taxonomy consists of 25 dimensions with 65 characteristics. Five new dimensions were added to the original taxonomy, with 8 characteristics added to already existing dimensions. Group consensus was achieved on the need for such a taxonomy to compare portals, on patient engagement as an appropriate distinguishing concept, and on the comprehensibility of the taxonomy's form. Further, consensus was achieved on the taxonomy's usefulness for classifying and comparing portals, assisting users in better understanding portals, creating a requirement profile, and selecting portals. This allowed us to test the usefulness of the final taxonomy with the intended users.

Conclusions

The TOPCOP taxonomy aims to support health information managers in comparing and selecting patient portals. By providing a standardized terminology to describe various aspects of patient portals independent of clinical setting or country, the taxonomy will also be useful for advancing research and evaluation of patient portals.

SUBMITTER: Gloggler M

PROVIDER: S-EPMC8527386 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveTaxonomies are classification systems used to reduce complexity and better understand a domain. The present research aims to develop a useful taxonomy for health information managers to classify and compare patient portals based on characteristics appropriate to promote patient engagement. As a result, the taxonomy should contribute to understanding the differences and similarities of the portals. Further, the taxonomy shall support health information managers to more easily define which general type and functionalities of patient portals they need and to select the most suitable solution offered on the market.MethodsWe followed the formal taxonomy-building method proposed by Nickerson et al. Based on a literature review, we created a preliminary taxonomy following the conceptional approach of the model. We then evaluated each taxa's appropriateness by analyzing and classifying 17 patient portals offered by software vendors and 11 patient portals offered by health care providers. After each iteration, we examined the achievement of the determined objective and subjective ending conditions.ResultsAfter two conceptional approaches to create our taxonomy, and two empirical approaches to evaluate it, the final taxonomy consists of 20 dimensions and 49 characteristics. To make the taxonomy easy to comprehend, we assigned to the dimensions seven aspects related to patient engagement. These aspects are (1) portal design, (2) management, (3) communication, (4) instruction, (5) self-management, (6) self-determination, and (7) data management. The taxonomy is considered finished and useful after all ending conditions that defined beforehand have been fulfilled. We demonstrated that the taxonomy serves to understand the differences and similarities by comparing patient portals. We call our taxonomy "Taxonomy of Patient Portals based on Characteristics of Patient Engagement (TOPCOP)."ConclusionWe developed the first useful taxonomy for health information managers to classify and compare patient portals. The taxonomy is based on characteristics promoting patient engagement. With 20 dimensions and 49 characteristics, our taxonomy is particularly suitable to discriminate among patient portals and can easily be applied to compare portals. The TOPCOP taxonomy enables health information managers to better understand the differences and similarities of patient portals. Further, the taxonomy may help them to define the type and general functionalities needed. But it also supports them in searching and comparing patient portals offered on the market to select the most suitable solution.

Project description:BACKGROUND:Theoretical models help to explain or predict the adoption of electronic health (eHealth) technology and illustrate the complexity of the adoption process. These models provide insights into general factors that influence the use of eHealth technology. However, they do not give hospitals much actionable knowledge on how to facilitate the adoption process. OBJECTIVE:Our study aims to provide insights into patient portal adoption processes among patients and hospital staff, including health care professionals (HCPs), managers, and administrative clerks. Studying the experiences and views of stakeholders answers the following question: How can hospitals encourage patients and HCPs to adopt a patient portal? METHODS:We conducted 22 semistructured individual and group interviews (n=69) in 12 hospitals and four focus groups with members of national and seminational organizations and patient portal suppliers (n=53). RESULTS:The effort hospitals put into adopting patient portals can be split into three themes. First, inform patients and HCPs about the portal. This communication strategy has four objectives: users should (1) know about the portal, (2) know how the portal works, (3) know that action on the portal is required, and (4) know where to find help with the portal. Second, embed the patient portal in the daily routine of HCPs and management. This involves three forms of support: (1) hospital policy, (2) management by monitoring the numbers, and (3) a structured implementation strategy that includes all staff of one department. Third, try to adjust the portal to meet patients' needs to optimize user-friendliness in two ways: (1) use patients' feedback and (2) focus on optimizing for patients with special needs (eg, low literacy and low digital skills). CONCLUSIONS:Asking stakeholders what they have learned from their efforts to stimulate patient portal use in hospitals elicited rich insights into the adoption process. These insights are missing in the theoretical models. Therefore, our findings help to translate the relatively abstract factors one finds in theoretical models to the everyday pragmatics of eHealth projects in hospitals.

Project description:BACKGROUND:Acceptance of Electronic patient portal (EPP) is instrumental for its success. Studies on users' acceptance in the Middle East region are scarce. This study aims to use the TAM as a framework to quantitatively describe potential users, diabetic and chronic high blood pressure patients and their providers, intention to use and factors influencing the intention to use EPP at AUBMC-FMC We concurrently test the internal construct validity and the reliability of the TAM. METHODS:A cross-sectional survey design and the vignette approach were used. For validation, we needed a minimum of 180 patients; all 35 attending physicians and 11 registered nurses were targeted. We used descriptive statistics to calculate the intention to use EPP and its determinants based on the TAM constructs. Exploratory factor analysis (EFA) and structural equation modeling (SEM) were employed to estimate significant path coefficients for patients only as the sample size of providers was too small. RESULTS:We had 199 patients, half intended to use EPP; 73% of providers (N = 17) intended to use EPP. Perceived ease of use and privacy concerns were significantly higher among providers than patients (Mean (M) = 0.77 vs M = 0.42 (CI: - 0.623; - 0.081)) and (M = 3.67 vs M = 2.13, CI: - 2.16; - 0.91) respectively; other constructs were not significantly different. Reliability of TAM revealed a Cronbach Alpha of α=.91. EFA showed that three components explained 73.48% of the variance: Behavioral Intention of Use (14.9%), Perceived Ease of Use (50.74%), Perceived Usefulness (7.84%). SEM found that perceived ease of use increased perceived usefulness (standardized regression weight = 0.49); perceived usefulness (0.51) had more predictive value than perceived ease of use (0.27) to explain the behavioral intention of use of the EPP. CONCLUSIONS:We found that providers valued the usefulness of EPP and were mostly intending to use it. This finding has yet to be tested in future studies testing actual use as intention and actual use may not be concordant. The intention to use among patients was lower than those reported in developed countries. We identified two factors that we need to address to increase use, namely perceived ease and usefulness, and proposed practical implications to address them; future research directions were also discussed.

Project description:BackgroundDespite extensive and continuing research in the area of patient portals, measuring the impact of patient portals remains a convoluted process.ObjectiveThis study aims to explore what is known about patient portal evaluations and to provide recommendations for future endeavors. The focus is on mapping the measures used to assess the impact of patient portals on the dimensions of the Quadruple Aim (QA) framework and the Canada Health Infoway's Benefits Evaluation (BE) framework.MethodsA scoping review was conducted using the methodological framework of Arksey and O'Malley. Reporting was guided by the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) extension for scoping reviews. A systematic and comprehensive search was conducted using the Ovid platform, and the following databases were searched: Ovid MEDLINE (R) ALL (including epub ahead of print, in-process, and other nonindexed citations), EMBASE, and PsycINFO. CINAHL on the EBSCO platform and Web of Science were searched for studies published between March 2015 and June 2020. A systematic gray literature search was conducted using the Google search engine. Extracted data were tabulated based on a coding template developed to categorize the literature into themes and areas of interest.ResultsA total of 96 studies were included for data extraction. The studies were categorized based on the QA dimensions, with strict adherence to the definitions for each dimension. From the patients' perspective, it was determined that most evaluations focused on benefits and barriers to access, access to test results, medication adherence, condition management, medical notes, and secure messaging. From the population perspective, the evaluations focused on the increase in population outreach, decrease in disparities related to access to care services, and improvement in quality of care. From the health care workforce perspective, the evaluations focused on the impact of patients accessing medical records, impact on workflow, impact of bidirectional secure messaging, and virtual care. From the health system perspective, the evaluations focused on decreases in no-show appointments, impact on office visits and telephone calls, impact on admission and readmission rates and emergency department visits, and impact on health care use. Overall, 77 peer-reviewed studies were mapped on the expanded version of the BE framework. The mapping was performed using subdimensions to create a more precise representation of the areas that are currently explored when studying patient portals. Most of the studies evaluated more than one subdimension.ConclusionsThe QA and BE frameworks provide guidance in identifying gaps in the current literature by providing a way to show how an impact was assessed. This study highlights the need to appropriately plan how the impact will be assessed and how the findings will be translated into effective adaptations.

Project description:OBJECTIVES:Healthcare is a complex system, so quality improvement will commonly lead to unintended consequences which are rarely evaluated. In previous qualitative work, we proposed a framework for considering the range of these potential consequences, in terms of their desirability and the extent to which they were predictable or expected during planning. This paper elaborates on the previous findings, using consensus methods to examine what consequences should be identified, why and how to prioritise, evaluate and interpret all identified consequences, and what stakeholders should be involved throughout this process. DESIGN:Two-round modified Delphi consensus study. SETTING AND PARTICIPANTS:Both rounds were completed by 60 panellists from an academic, clinical or management background and experience in designing, implementing or evaluating quality improvement programmes. RESULTS:Panellists agreed that trade-offs (expected undesirable consequences) and unpleasant surprises (unexpected undesirable consequences) should be actively considered. Measurement of harmful consequences for patients, and those with high workload or financial impact was prioritised, and their evaluation could also involve the use of qualitative methods. Clinical teams were agreed as important to involve at all stages, from identifying potential consequences, prioritising which of those to systematically evaluate, undertaking appropriate evaluation and interpreting the findings. Patients were necessary in identifying consequences, managers in identifying and prioritising, and improvement advisors in interpreting the data. CONCLUSION:There was consensus that a balanced approach to considering all the consequences of improvement can be achieved by carefully considering predictable trade-offs from the outset and deliberately pausing after implementation to identify any unexpected surprises and make an informed decision as to whether quantitative or qualitative evaluation is needed and feasible. Stakeholders' roles in in the process of identifying, prioritising, evaluating and interpreting potential consequences should be explicitly addressed within planning and revisited during and after implementation.

Project description:BackgroundCompetency based curricula across the globe stress on the importance of effective physician patient communication. A variety of courses have been used to train physicians for this purpose. However, few of them link competencies with practice resulting in confusions in implementation and assessment. This issue can be resolved by treating certain specific patient communication related tasks as acts of entrustment or entrustable professional activities (EPAs). In this study, we aimed to define a competency-based framework for assessing patient physician communication using the language of EPAs.MethodsA modified Delphi study was conducted in three stages. The first stage was an extensive literature review to identify and elaborate communication related tasks which could be treated as EPAs. The second stage was content validation by medical education experts for clarity and representativeness. The third stage was three iterative rounds of modified Delphi with predefined consensus levels. The McNemar test was used to check response stability in the Delphi Rounds.ResultsExpert consensus resulted in development of 4 specific EPAs focused on physician-patient communication with their competencies and respective assessment strategies all aiming for level 5 of unsupervised practice. These include Providing information to the patient or their family about diagnosis or prognosis; Breaking Bad news to the patient or their family; Counseling a patient regarding their disease or illness; Resolving conflicts with patients or their families.ConclusionsThe EPAs for Physician-patient communication are a step toward an integrative, all-inclusive competency-based assessment framework for patient-centered care. They are meant to improve the quality of physician patient interaction by standardizing communication as a decision of entrustment. The EPAs can be linked to competency frameworks around the world and provide a useful assessment framework for effective training in patient communication. They can be integrated into any post graduate curriculum and can also serve as a self-assessment tool for postgraduate training programs across the globe to improve their patient communication curricula.