Dataset Information

Validation of a brief scale to assess ambulatory patients' perceptions of reading visit notes: a scale development study.

ABSTRACT:

Objectives

To develop and evaluate the validity of a scale to assess patients' perceived benefits and risks of reading ambulatory visit notes online (open notes).

Design

Four studies were used to evaluate the construct validity of a benefits and risks scale. Study 1 refined the items; study 2 evaluated underlying factor structure and identified the items; study 3 evaluated study 2 results in a separate sample; and study 4 examined factorial invariance of the developed scale across educational subsamples.

Setting

Ambulatory care in three large health systems in the USA.

Participants

Participants in three US health systems who responded to one of two online surveys asking about benefits and risks of reading visit notes: a psychometrics survey of primary care patients, and a large general survey of patients across all ambulatory specialties. Sample sizes: n=439 (study 1); n=439 (study 2); n=500 (study 3); and n=250 (study 4).

Primary and secondary outcome measures

Questionnaire items about patients' perceived benefits and risks of reading online visit notes.

Results

Study 1 resulted in the selection of a 10-point importance response option format over a 4-point agreement scale. Exploratory factor analysis (EFA) in study 2 resulted in two-factor solution: a four-item benefits factor with good reliability (alpha=0.83) and a three-item risks factor with poor reliability (alpha=0.52). The factor structure was confirmed in study 3, and confirmatory factor analysis of benefit items resulted in an excellent fitting model, X²(2)=2.949; confirmatory factor index=0.998; root mean square error of approximation=0.04 (0.00, 0.142); loadings 0.68-0.86; alpha=0.88. Study 4 supported configural, measurement and structural invariance for the benefits scale across high and low-education patient groups.

Conclusions

The findings suggest that the four-item benefits scale has excellent construct validity and preliminary evidence of generalising across different patient populations. Further scale development is needed to understand perceived risks of reading open notes.

SUBMITTER: Wright JA

PROVIDER: S-EPMC7577023 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validation of a brief scale to assess ambulatory patients' perceptions of reading visit notes: a scale development study.

Wright Julie A JA Leveille Suzanne G SG Chimowitz Hannah H Fossa Alan A Stametz Rebecca R Clarke Deserae D Walker Jan J

BMJ open 20201020 10

<h4>Objectives</h4>To develop and evaluate the validity of a scale to assess patients' perceived benefits and risks of reading ambulatory visit notes online (open notes).<h4>Design</h4>Four studies were used to evaluate the construct validity of a benefits and risks scale. Study 1 refined the items; study 2 evaluated underlying factor structure and identified the items; study 3 evaluated study 2 results in a separate sample; and study 4 examined factorial invariance of the developed scale across ...[more]

PMID: 33082176

Similar Datasets

Project description:BACKGROUND:Patient portals are widely adopted in the United States and allow millions of patients access to their electronic health records (EHRs), including their EHR clinical notes. A patient's ability to understand the information in the EHR is dependent on their overall health literacy. Although many tests of health literacy exist, none specifically focuses on EHR note comprehension. OBJECTIVE:The aim of this paper was to develop an instrument to assess patients' EHR note comprehension. METHODS:We identified 6 common diseases or conditions (heart failure, diabetes, cancer, hypertension, chronic obstructive pulmonary disease, and liver failure) and selected 5 representative EHR notes for each disease or condition. One note that did not contain natural language text was removed. Questions were generated from these notes using Sentence Verification Technique and were analyzed using item response theory (IRT) to identify a set of questions that represent a good test of ability for EHR note comprehension. RESULTS:Using Sentence Verification Technique, 154 questions were generated from the 29 EHR notes initially obtained. Of these, 83 were manually selected for inclusion in the Amazon Mechanical Turk crowdsourcing tasks and 55 were ultimately retained following IRT analysis. A follow-up validation with a second Amazon Mechanical Turk task and IRT analysis confirmed that the 55 questions test a latent ability dimension for EHR note comprehension. A short test of 14 items was created along with the 55-item test. CONCLUSIONS:We developed ComprehENotes, an instrument for assessing EHR note comprehension from existing EHR notes, gathered responses using crowdsourcing, and used IRT to analyze those responses, thus resulting in a set of questions to measure EHR note comprehension. Crowdsourced responses from Amazon Mechanical Turk can be used to estimate item parameters and select a subset of items for inclusion in the test set using IRT. The final set of questions is the first test of EHR note comprehension.

Project description:Patients are increasingly asking for their health data. Yet, little is known about what motivates patients to engage with the electronic health record (EHR). Furthermore, quality-focused mechanisms for patients to comment about their records are lacking.We aimed to learn more about patient experiences with reading and providing feedback on their visit notes.We developed a patient feedback tool linked to OpenNotes as part of a pilot quality improvement initiative focused on patient engagement. Patients who had appointments with members of 2 primary care teams piloting the program between August 2014-2015 were eligible to participate. We asked patients what they liked about reading notes and about using a feedback tool and analyzed all patient reports submitted during the pilot period. Two researchers coded the qualitative responses (κ=.74).Patients and care partners submitted 260 reports. Among these, 98.5% (256/260) of reports indicated that the reporting tool was valuable, and 68.8% (179/260) highlighted what patients liked about reading notes and the OpenNotes patient reporting tool process. We identified 4 themes describing what patients value about note content: confirm and remember next steps, quicker access and results, positive emotions, and sharing information with care partners; and 4 themes about both patients' use of notes and the feedback tool: accuracy and correcting mistakes, partnership and engagement, bidirectional communication and enhanced education, and importance of feedback.Patients and care partners who read notes and submitted feedback reported greater engagement and the desire to help clinicians improve note accuracy. Aspects of what patients like about using both notes as well as a feedback tool highlight personal, relational, and safety benefits. Future efforts to engage patients through the EHR may be guided by what patients value, offering opportunities to strengthen care partnerships between patients and clinicians.

Project description:ObjectiveThe main aim of this study is to develop a valid and reliable instrument to assess levels of knowledge and perceptions of predatory journals.MethodsThe current study employed successive methods framework including (1) item generation through a literature review and theoretical framework development, (2) validity testing in terms of face, content, and construct validity for perceptions construct as well as item analysis for knowledge scale, and (3) reliability testing in terms of Cronbach's alpha, Kuder-Richardson (KR-20), item-to-total correlations, corrected item-to-total correlations, Cronbach's alpha if item deleted, and test-retest reliability. A total of 304 participants were recruited from King Fahad Medical City (KFMC) in Riyadh, Saudi Arabia to evaluate its construct validity and reliability. This was established using exploratory factor analysis (EFA) with principal axis factoring (PFA) and varimax rotation as well as confirmatory factor analysis (CFA) for perception construct.ResultsAn instrument was developed from this study called the "Predatory Journals KP Assessment Questionnaire". The results of EFA and CFA confirmed the construct validity of the perception construct. Item analysis confirmed the construct validity of the knowledge scale. The internal consistency and test-retest reliability were achieved for the knowledge scale items, consisting of 13 items. The results of EFA confirmed the measured constructs of perceptions toward predatory journals. The results of EFA and CFA for perception construct resulted in only one factor with 9 items.ConclusionThis study has successfully developed a valid and reliable questionnaire to measure knowledge and perceptions of predatory journals among researchers in the clinical and health disciplines. This instrument serves as a valuable guide for future studies that aim to assess researcher's knowledge and perceptions about predatory journals and examine the differences in these measured constructs according to their demographic and professional characteristics.

Project description:BACKGROUND:Advances in medical treatment for HIV are driving major changes in HIV policy and practice, including the encouragement of intake and adherence to HIV antiretroviral treatment (ART) by people living with HIV (PLHIV) for both personal and public health benefits. However, there is increasing recognition that achieving these goals will require a concurrent focus on the broader psychological and social wellbeing of PLHIV. Increasingly calls are being been made to incorporate a stronger focus on quality of life (QoL) of PLHIV into HIV prevention policy. In order to achieve this goal, HIV community, support and healthcare services need a valid, short and practical way to evaluate QoL of PLHIV accessing their programs. Current QoL measures are either long, complex, restricted in their use, or expensive. To address these shortcomings, the PozQoL study aimed to develop, test and validate a short and freely available scale assessing QoL among PLHIV. METHODS:Drawing on a literature review, the prioritisation of domains and development of the initial pool of items was conducted in consultation with PLHIV community organisations in Australia. The items covered health concerns, psychological, social, and functional wellbeing. Testing involved a baseline and a follow-up survey of 465 adult Australians living with HIV. Participants were recruited through social media and various community organizations nationwide. The survey included the pilot PozQoL scale and other validated measures of health and wellbeing. RESULTS:Guided by an Exploratory Factor Analysis and conceptual considerations, a 13-item scale was developed. The PozQoL scale demonstrated high levels of fit in a Confirmatory Factor Analysis, very good internal consistency, test-retest reliability, and concurrent validity with other measures that approximated different aspects of QoL. CONCLUSION:The PozQoL scale has been tested in a diverse sample of adult PLHIV living in Australia, demonstrating very good reliability and validity. The insights from PLHIV and other stakeholders supported the balancing of statistical rigour and conceptual accuracy. The scale is now ready to be implemented and field-tested across a range of community, support and healthcare programs for PLHIV. This will make a significant contribution to the evaluation and enhancement of programs for PLHIV.

Dataset Information

Validation of a brief scale to assess ambulatory patients' perceptions of reading visit notes: a scale development study.

Objectives

Design

Setting

Participants

Primary and secondary outcome measures

Results

Conclusions

Publications

Validation of a brief scale to assess ambulatory patients' perceptions of reading visit notes: a scale development study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets