Dataset Information

Concordance Between Electronic Clinical Documentation and Physicians' Observed Behavior.

ABSTRACT:

Importance

Following the adoption of electronic health records into a regulatory environment designed for paper records, there has been little investigation into the accuracy of physician documentation.

Objective

To quantify the percentage of emergency physician documentation of the review of systems (ROS) and physical examination (PE) that observers can confirm.

Design, setting, and participants

This case series took place at emergency departments in 2 academic medical centers between 2016 and 2018. Participants' patient encounters were observed to compare real-time performance with clinical documentation.

Exposures

Resident physicians were shadowed by trained observers for 20 encounters (10 encounters per physician per site) to obtain real-time observational data; associated electronic health record data were subsequently reviewed.

Main outcomes and measures

Number of confirmed ROS systems (range, 0-14) divided by the number of documented ROS systems (range, 0-14), and number of confirmed PE systems (range, 0-14) divided by the number of documented PE systems (range, 0-14).

Results

The final study cohort included 9 licensed emergency medicine residents who evaluated a total of 180 patients (mean [SD] age, 48.7 [20.0] years; 91 [50.5%] women). For ROS, physicians documented a median (interquartile range [IQR]) of 14 (8-14) systems, while audio recordings confirmed a median (IQR) of 5 (3-6) systems. Overall, 755 of 1961 documented ROS systems (38.5%) were confirmed by audio recording data. For PE, resident physicians documented a median (IQR) of 8 (7-9) verifiable systems, while observers confirmed a median (IQR) of 5.5 (3-6) systems. Overall, 760 of 1429 verifiable documented PE systems (53.2%) were confirmed by concurrent observation. Interrater reliability for rating of ROS and PE was more than 90% for all measures.

Conclusions and relevance

In this study of 9 licensed year emergency medicine residents, there were inconsistencies between the documentation of ROS and PE findings in the electronic health record and observational reports. These findings raise the possibility that some documentation may not accurately represent physician actions. Further studies should be undertaken to determine whether this occurrence is widespread. However, because such studies are unlikely to be performed owing to institution-level barriers that exist nationwide, payers should consider removing financial incentives to generate lengthy documentation.

SUBMITTER: Berdahl CT

PROVIDER: S-EPMC6751766 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveTo understand emergency department (ED) physicians' use of electronic documentation in order to identify usability and workflow considerations for the design of future ED information system (EDIS) physician documentation modules.MethodsWe invited emergency medicine resident physicians to participate in a mixed methods study using task analysis and qualitative interviews. Participants completed a simulated, standardized patient encounter in a medical simulation center while documenting in the test environment of a currently used EDIS. We recorded the time on task, type and sequence of tasks performed by the participants (including tasks performed in parallel). We then conducted semi-structured interviews with each participant. We analyzed these qualitative data using the constant comparative method to generate themes.ResultsEight resident physicians participated. The simulation session averaged 17 minutes and participants spent 11 minutes on average on tasks that included electronic documentation. Participants performed tasks in parallel, such as history taking and electronic documentation. Five of the 8 participants performed a similar workflow sequence during the first part of the session while the remaining three used different workflows. Three themes characterize electronic documentation: (1) physicians report that location and timing of documentation varies based on patient acuity and workload, (2) physicians report a need for features that support improved efficiency; and (3) physicians like viewing available patient data but struggle with integration of the EDIS with other information sources.ConclusionWe confirmed that physicians spend much of their time on documentation (65%) during an ED patient visit. Further, we found that resident physicians did not all use the same workflow and approach even when presented with an identical standardized patient scenario. Future EHR design should consider these varied workflows while trying to optimize efficiency, such as improving integration of clinical data. These findings should be tested quantitatively in a larger, representative study.

Project description:Importance:Collection and analysis of up-to-date and accurate injury surveillance data are a key step in the maturation of trauma systems. Trauma registries have proven to be difficult to establish in low- and middle-income countries owing to the burden of trauma volume, cost, and complexity. Objective:To determine whether an electronic trauma health record (eTHR) used by physicians can serve as simultaneous clinical documentation and data acquisition tools. Design, Setting, and Participants:This 2-part quality improvement study included (1) preimplementation and postimplementation eTHR study with assessments of satisfaction by 41 trauma physicians, time to completion, and quality of data collected comparing paper and electronic charting; and (2) prospective ecologic study describing the burden of trauma seen at a Level I trauma center, using real-time data collected by the eTHR on consecutive patients during a 12-month study period. The study was conducted from October 1, 2010, to September 30, 2011, at Groote Schuur Hospital, Cape Town, South Africa. Data analysis was performed from October 15, 2011, to January 15, 2013. Main Outcomes and Measures:The primary outcome of part 1 was data field competition rates of pertinent trauma registry items obtained through electronic or paper documentation. The main measures of part 2 were to identify risk factors to trauma in Cape Town and quality indicators recommended for trauma system evaluation at Groote Schuur Hospital. Results:The 41 physicians included in the study found the electronic patient documentation to be more efficient and preferable. A total of 11?612 trauma presentations were accurately documented and promptly analyzed. Fields relevant to injury surveillance in the eTHR (n?=?11?612) had statistically significant higher completion rates compared with paper records (n?=?9236) (for all comparisons, P?<?.001). The eTHR successfully captured quality indicators recommended for trauma system evaluation which were previously challenging to collect in a timely and accurate manner. Of the 11?612 patient admissions over the study period, injury location was captured 11?075 times (95.4%), injury mechanism 11?135 times (95.9%), systolic blood pressure 11?106 times (95.6%), and Glasgow Coma Scale 11?140 times (95.9%). These fields were successfully captured with statistically higher rates than previous paper documentation. Epidemiologic analysis confirmed a heavy burden of violence-related injury (51.8% of all injuries) and motor vehicle crash injuries (14.3% of all injuries). Mapping analysis demonstrated clusters of injuries originating mainly from vulnerable and low-income neighborhoods and their respective referring trauma facilities, Mitchell's Plain Hospital (734 [10.1%]), Guguletu Community Health Center (654 [9.0%]), and New Somerset Hospital (400 [5.5%]). Conclusions and Relevance:Accurate capture and simultaneous analysis of trauma data in low-resource trauma settings are feasible through the integration of surveillance into clinical workflow and the timely analysis of electronic data.

Project description:ImportanceThe Press Ganey Outpatient Medical Practice Survey is used to measure the patient experience. An understanding of the patient- and physician-related determinants of the patient experience may help identify opportunities to improve health care delivery and physician ratings.ObjectiveTo evaluate the associations between the patient experience as measured by scores on the Press Ganey survey and patient-physician racial/ethnic and gender concordance.Design, setting, and participantsA cross-sectional analysis of Press Ganey surveys returned for outpatient visits within the University of Pennsylvania Health System between 2014 and 2017 was performed. Participants included adult patient and physician dyads for whom surveys were returned. Data analysis was performed from January to June 2019.ExposuresPatient-physician racial/ethnic and gender concordance.Main outcomes and measuresThe primary outcome was receipt of the maximum score for the "likelihood of your recommending this care provider to others" question in the Care Provider domain of the Press Ganey survey. Secondary outcomes included each of the remaining 9 questions in the Care Provider domain. Generalized estimating equations clustering on physicians with exchangeable intracluster correlations and cluster-robust standard errors were used to investigate associations between the outcomes and patient-physician racial/ethnic and gender concordance.ResultsIn total, 117 589 surveys were evaluated, corresponding to 92 238 unique patients (mean [SD] age, 57.7 [15.6] years; 37 002 men [40.1%]; 75 307 White patients [81.6%]) and 747 unique physicians (mean [SD] age 45.5 [10.6] years; 472 men [63.2%]; 533 White physicians [71.4%]). Compared with racially/ethnically concordant patient-physician dyads, discordance was associated with a lower likelihood of physicians receiving the maximum score (adjusted odds ratio [OR], 0.88; 95% CI, 0.82-0.94; P < .001). Black (adjusted OR, 0.73; 95% CI, 0.68-0.78; P < .001) and Asian (adjusted OR, 0.55; 95% CI, 0.50-0.60; P < .001) patient race were both associated with lower patient experience ratings. Patient-physician gender concordance was not associated with Press Ganey scores (adjusted OR, 1.00; 95% CI, 0.96-1.04; P = .90).Conclusions and relevanceIn this study, higher Press Ganey survey scores were associated with racial/ethnic concordance between patients and their physicians. Efforts to improve physician workforce diversity are imperative. Delivery of health care in a culturally mindful manner between racially/ethnically discordant patient-physician dyads is also essential. Furthermore, Press Ganey scores may differ by a physician's patient demographic mix; thus, care must be taken when publicly reporting or using Press Ganey scores to evaluate physicians on an individual level.