Dataset Information

Tools to Assess the Trustworthiness of Evidence-Based Point-of-Care Information for Health Care Professionals: Systematic Review.

ABSTRACT: BACKGROUND:User-friendly information at the point of care should be well structured, rapidly accessible, and comprehensive. Also, this information should be trustworthy, as it will be used by health care practitioners to practice evidence-based medicine. Therefore, a standard, validated tool to evaluate the trustworthiness of such point-of-care information resources is needed. OBJECTIVE:This systematic review sought to search for tools to assess the trustworthiness of point-of-care resources and to describe and analyze the content of these tools. METHODS:A systematic search was performed on three sources: (1) we searched online for initiatives that worked off of the trustworthiness of medical information; (2) we searched Medline (PubMed) until June 2019 for relevant literature; and (3) we scanned reference lists and lists of citing papers via Web of Science for each retrieved paper. We included all studies, reports, websites, or methodologies that reported on tools that assessed the trustworthiness of medical information for professionals. From the selected studies, we extracted information on the general characteristics of the tools. As no standard, risk-of-bias assessment instruments are available for these types of studies, we described how each tool was developed, including any assessments on reliability and validity. We analyzed the criteria used in the different tools and divided them into five categories: (1) author-related information; (2) evidence-based methodology; (3) website quality; (4) website design and usability; and (5) website interactivity. The percentage of tools in compliance with these categories and the different criteria were calculated. RESULTS:Included in this review was a total of 17 tools, all published between 1997 and 2018. The tools were developed for different purposes, from a general quality assessment of medical information to very detailed analyses, all specifically for point-of-care resources. However, the development process of the tools was poorly described. Overall, seven tools had a scoring system implemented, two were assessed for reliability only, and two other tools were assessed for both validity and reliability. The content analysis showed that all the tools assessed criteria related to an evidence-based methodology: 82% of the tools assessed author-related information, 71% assessed criteria related to website quality, 71% assessed criteria related to website design and usability, and 47% of the tools assessed criteria related to website interactivity. There was significant variability in criteria used, as some were very detailed while others were more broadly defined. CONCLUSIONS:The 17 included tools encompass a variety of items important for the assessment of the trustworthiness of point-of-care information. Overall, two tools were assessed for both reliability and validity, but they lacked some essential criteria for the assessment of the trustworthiness of medical information for use at the point-of-care. Currently, a standard, validated tool does not exist. The results of this review may contribute to the development of such an instrument, which may enhance the quality of point-of-care information in the long term. TRIAL REGISTRATION:PROSPERO CRD42019122565; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=122565.

SUBMITTER: Lenaerts G

PROVIDER: S-EPMC6996752 | biostudies-literature | 2020 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Tools to Assess the Trustworthiness of Evidence-Based Point-of-Care Information for Health Care Professionals: Systematic Review.

Lenaerts Gerlinde G Bekkering Geertruida E GE Goossens Martine M De Coninck Leen L Delvaux Nicolas N Cordyn Sam S Adriaenssens Jef J Vankrunkelsven Patrick P

Journal of medical Internet research 20200117 1

<h4>Background</h4>User-friendly information at the point of care should be well structured, rapidly accessible, and comprehensive. Also, this information should be trustworthy, as it will be used by health care practitioners to practice evidence-based medicine. Therefore, a standard, validated tool to evaluate the trustworthiness of such point-of-care information resources is needed.<h4>Objective</h4>This systematic review sought to search for tools to assess the trustworthiness of point-of-car ...[more]

PMID: 31951213

Similar Datasets

Project description:BackgroundUser-friendly information at the point of care for health care professionals should be well structured, rapidly accessible, comprehensive, and trustworthy. The reliability of information and the associated methodological process must be clear. There is no standard tool to evaluate the trustworthiness of such point-of-care (POC) information.ObjectiveWe aim to develop and validate a new tool for assessment of trustworthiness of evidence-based POC resources to enhance the quality of POC resources and facilitate evidence-based practice.MethodsWe designed the Critical Appraisal of Point-of-Care Information (CAPOCI) tool based on the criteria important for assessment of trustworthiness of POC information, reported in a previously published review. A group of health care professionals and methodologists (the authors of this paper) defined criteria for the CAPOCI tool in an iterative process of discussion and pilot testing until consensus was reached. In the next step, all criteria were subject to content validation with a Delphi study. We invited an international panel of 10 experts to rate their agreement with the relevance and wording of the criteria and to give feedback. Consensus was reached when 70% of the experts agreed. When no consensus was reached, we reformulated the criteria based on the experts' comments for a next round of the Delphi study. This process was repeated until consensus was reached for each criterion. In a last step, the interrater reliability of the CAPOCI tool was calculated with a 2-tailed Kendall tau correlation coefficient to quantify the agreement between 2 users who piloted the CAPOCI tool on 5 POC resources. Two scoring systems were tested: a 3-point ordinal scale and a 7-point Likert scale.ResultsAfter validation, the CAPOCI tool was designed with 11 criteria that focused on methodological quality and author-related information. The criteria assess authorship, literature search, use of preappraised evidence, critical appraisal of evidence, expert opinions, peer review, timeliness and updating, conflict of interest, and commercial support. Interrater agreement showed substantial agreement between 2 users for scoring with the 3-point ordinal scale (τ=.621, P<.01) and scoring with the 7-point Likert scale (τ=.677, P<.01).ConclusionsThe CAPOCI tool may support validation teams in the assessment of trustworthiness of POC resources. It may also provide guidance for producers of POC resources.

Project description:ObjectivePoint-of-care testing (POCT) has become an essential diagnostic technology for optimal patient care. Its implementation, however, still falls behind. This paper reviews the available evidence on the health economic impact of introducing POCT to assess if poor POCT uptake may be related to lacking evidence.Study designThe Scopus and PubMed databases were searched to identify publications describing a health economic evaluation of a point-of-care (POC) test. Data were extracted from the included publications, including general and methodological characteristics as well as the study results summarized in either cost, effects or an incremental cost-effectiveness ratio. Results were sorted into six groups according to the POC test's purpose (diagnosis, screening or monitoring) and care setting (primary care or secondary care). The reporting quality of the publications was determined using the CHEERS checklist.ResultsThe initial search resulted in 396 publications, of which 44 met the inclusion criteria. Most of the evaluations were performed in a primary care setting (n = 31; 70.5%) compared with a secondary care setting (n = 13; 29.5%). About two thirds of the evaluations were on POC tests implemented with a diagnostic purpose (n = 28; 63.6%). More than 75% of evaluations concluded that POCT is recommended for implementation, although in some cases only under specific circumstances and conditions. Compliance with the CHEERS checklist items ranged from 20.8% to 100%, with an average reporting quality of 72.0%.ConclusionThere were very few evaluations in this review that advised against the implementation of POCT. However, the uptake of POCT in many countries remains low. Even though the evaluations included in this review did not always include the full long-term benefits of POCT, it is clear that health economic evidence across a few dimensions of value already indicate the benefits of POCT. This suggests that the lack of evidence on POCT is not the primary barrier to its implementation and that the low uptake of these tests in clinical practice is due to (a combination of) other barriers. In this context, aspects around organization of care, support of clinicians and quality management may be crucial in the widespread implementation of POCT.

Project description:ObjectiveThis systematic review aimed to: (1) determine the prevalence and scope of existing research on human resource information systems (HRIS) in health organizations; (2) analyze, classify, and synthesize evidence on the processes and impacts of HRIS development, implementation, and adoption; and (3) generate recommendations for HRIS research, practice, and policy, with reference to the needs of different stakeholders.MethodsA structured search strategy was used to interrogate 10 electronic databases indexing research from the health, social, management, technology, and interdisciplinary sciences, alongside gray literature sources and reference lists of qualifying studies. There were no restrictions on language or publication year. Two reviewers screened publications, extracted data, and coded findings according to the innovation stages covered in the studies. The Critical Appraisal Skills Program checklist was adopted to assess study quality. The process of study selection was charted using a Preferred Items for Systematic Reviews and Meta-Analysis (PRISMA) diagram.ResultsOf the 6824 publications identified by the search strategy, 68, covering 42 studies, were included for final analysis. Research on HRIS in health was interdisciplinary, often atheoretical, conducted primarily in the hospital sector of high-income economies, and largely focused uncritically on use and realized benefits.Discussion and conclusionsWhile studies of HRIS in health exist, the overall lack of evaluative research raises unanswered questions about their capacity to improve quality and efficiency and enable learning health systems, as well as how sociotechnical complexity influences implementation and effectiveness. We offer this analysis to decision makers and managers considering or currently implementing an HRIS, and make recommendations for further research.Trial registrationInternational Prospective Register of Systematic Reviews (PROSPERO): CRD42015023581. http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42015023581#.VYu1BPlVjDU .

Project description:BackgroundDigitalization is not fully implemented in clinical practice, and several factors have been identified as possible barriers, including the competencies of health care professionals. However, no summary of the available evidence has been provided to date to depict digital health competencies that have been investigated among health care professionals, the tools used in assessing such competencies, and the effective interventions to improve them.ObjectiveThis review aims to summarize digital health competencies investigated to date and the tools used to assess them among health care professionals.MethodsA systematic review based on the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist was performed. The MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, and Scopus databases were accessed up to September 4, 2021. Studies assessing digital health competencies with quantitative designs, targeting health care professionals, and written in English were included. The methodological quality of included studies was evaluated using the Joanna Briggs Institute tools.ResultsA total of 26 studies, published from 1999 to 2021, met the inclusion criteria, and the majority were cross sectional in design, while only 2 were experimental study designs. Most studies were assessed with moderate to low methodological quality; 4 categories and 9 subcategories of investigated digital health competencies have been identified. The most investigated category was "Self-rated competencies," followed by "Psychological and emotional aspects toward digital technologies," "Use of digital technologies," and "Knowledge about digital technologies." In 35% (9/26) of the studies, a previously validated tool was used to measure the competencies assessed, while others developed ad hoc questionnaires.ConclusionsMainly descriptive studies with issues regarding methodology quality have been produced to date investigating 4 main categories of digital health competencies mostly with nonvalidated tools. Competencies investigated might be considered while designing curricula for undergraduate, postgraduate, and continuing education processes, whereas the methodological lacks detected might be addressed with future research. There is a need to expand research on psychological and emotional elements and the ability to use digital technology to self-learn and teach others.Trial registrationPROSPERO International Prospective Register of Systematic Reviews CRD42021282775; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=282775.

Project description:BACKGROUND:Technology-enhanced learning (TEL) programs are increasingly seen as the way in which education for health care professionals can be transformed, giving access to effective ongoing learning and training even where time or geographical barriers exist. Given the increasing emphasis on this mode of educational support for health care practitioners, it is vital that we can effectively evaluate and measure impact to ensure that TEL programs are effective and fit for purpose. This paper examines the current evidence base for the first time, in relation to the evaluation of TEL programs for health care professionals. OBJECTIVE:We conducted a systematic review of the current literature relating to the evaluation of TEL programs for health care professionals and critically appraised the quality of the studies. METHODS:This review employed specific search criteria to identify research studies that included evaluation of TEL for health care professionals. The databases searched included Medline Ovid, Cumulative Index of Nursing and Allied Health Literature Plus Advanced, Applied Social Sciences Index and Abstracts, ZETOC, Institute of Electrical and Electronics Engineers Explore Digital Library, Allied and Complementary Medicine, and Education Resources Information Center between January 2006 and January 2017. An additional hand search for relevant articles from reference lists was undertaken. Each of the studies identified was critically appraised for quality using the Crowe Critical Appraisal Tool. This approach produced a percentage total score for each study across specified categories. A proportion of the studies were independently assessed by an additional two reviewers. RESULTS:The review identified 21 studies that met the inclusion criteria. The studies included scored totals across eight categories within a range of 37%-95% and an average score of 68%. Studies that measured TEL using learner satisfaction surveys, or combined pretest and posttest knowledge score testing with learner satisfaction surveys, were found to be the most common types of TEL evaluations evident in the literature. The studies reviewed had low scores across reporting on ethical matters, design, and data collection categories. CONCLUSIONS:There continues to be a need to develop effective and standard TEL evaluation tools, and good quality studies that describe effective evaluation of TEL education for health care professionals. Studies often fail to provide sufficient detail to support transferability or direct future TEL health care education programs.

Project description:BackgroundAlthough the electronic health record system adoption rate has reached 96% in the United States, implementation and usage of health information exchange (HIE) is still lagging behind. Blockchain has come into the spotlight as a technology to solve this problem. However, there have been no studies assessing the perspectives of different stakeholders regarding blockchain-based patient-centered HIE.ObjectiveThe objective of this study was to analyze the awareness among patients, health care professionals, and information technology developers toward blockchain-based HIE, and compare their different perspectives related to the platform using a qualitative research methodology.MethodsIn this qualitative study, we applied grounded theory and the Promoting Action on Research Implementation in the Health Service (PARiHS) framework. We interviewed 7 patients, 7 physicians, and 7 developers, for a total of 21 interviewees.ResultsRegarding the leakage of health information, the patient group did not have concerns in contrast to the physician and developer groups. Physicians were particularly concerned about the fact that errors in the data cannot be easily fixed due to the nature of blockchain technology. Patients were not against the idea of providing information for clinical trials or research institutions. They wished to be provided with the results of clinical research rather than being compensated for providing data. The developers emphasized that blockchain must be technically mature before it can be applied to the health care scene, and standards of medical information to be exchanged must first be established.ConclusionsThe three groups' perceptions of blockchain were generally positive about the idea of patients having the control of sharing their own health information. However, they were skeptical about the cooperation among various institutions and implementation for data standardization in the establishment process, in addition to how the service will be employed in practice. Taking these factors into consideration during planning, development, and operation of a platform will contribute to establishing practical treatment plans and tracking in a more convenient manner for both patients and physicians. Furthermore, it will help expand the related research and health management industry based on blockchain.

Dataset Information

Tools to Assess the Trustworthiness of Evidence-Based Point-of-Care Information for Health Care Professionals: Systematic Review.

Publications

Tools to Assess the Trustworthiness of Evidence-Based Point-of-Care Information for Health Care Professionals: Systematic Review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets