Dataset Information

Prescribers' Knowledge and Skills for Interpreting Research Results: A Systematic Review.

ABSTRACT:

Introduction

Appropriate medication prescribing may be influenced by a prescriber's ability to understand and interpret medical research. The objective of this review was to synthesize the research related to prescribers' critical appraisal knowledge and skills-defined as the understanding of statistical methods, biases in studies, and relevance and validity of evidence.

Methods

We searched PubMed and other databases from January 1990 through September 2015. Two reviewers independently screened and selected studies of any design conducted in the United States, the United Kingdom, or Canada that involved prescribers and that objectively measured critical appraisal knowledge, skills, understanding, attitudes, or prescribing behaviors. Data were narratively synthesized.

Results

We screened 1204 abstracts, 72 full-text articles, and included 29 studies. Study populations included physicians. Physicians' extant knowledge and skills were in the low to middle of the possible score ranges and demonstrated modest increases in response to interventions. Physicians with formal education in epidemiology, biostatistics, and research demonstrated higher levels of knowledge and skills. In hypothetical scenarios presenting equivalent effect sizes, the use of relative effect measures was associated with greater perceptions of medication effectiveness and intent to prescribe, compared with the use of absolute effect measures. The evidence was limited by convenience samples and study designs that limit internal validity.

Discussion

Critical appraisal knowledge and skills are limited among physicians. The effect measure used can influence perceptions of treatment effectiveness and intent to prescribe. How critical appraisal knowledge and skills fit among the myriad of influences on prescribing behavior is not known.

SUBMITTER: Kahwati L

PROVIDER: S-EPMC8218608 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundGlobal interest in research skills in undergraduate medical education is growing. There is no consensus regarding expected research skills of medical students on graduation. We conducted a systematic review to determine the aims and intended learning outcomes (ILOs) of mandatory research components of undergraduate medical curricula incorporating the teaching, assessment, and evaluation methods of these programs.MethodsUsing the PRISMA protocol, MEDLINE and ERIC databases were searched with keywords related to "medical student research programs" for relevant articles published up until February 2020. Thematic analysis was conducted according to student experience/reactions, mentoring/career development, and knowledge/skill development.ResultsOf 4880 citations, 41 studies from 30 institutions met the inclusion criteria. Programs were project-based in 24 (80%) and coursework only-based in 6 (20%). Program aims/ILOs were stated in 24 programs (80%). Twenty-seven different aims/ILOs were identified: 19 focused on knowledge/skill development, 4 on experience/reactions, and 4 on mentoring/career development. Project-based programs aimed to provide an in-depth research experience, foster/increase research skills, and critically appraise scientific literature. Coursework-based programs aimed to foster/apply analytical skills for decision-making in healthcare and critically appraise scientific literature. Reporting of interventions was often incomplete, short term, and single institution. There was poor alignment between aims, teaching, assessment, and evaluation methods in most.ConclusionsThe diversity of teaching programs highlights challenges in defining core competencies in research skills for medical graduates. Incomplete reporting limits the evidence for effective research skills education; we recommend those designing and reporting educational interventions adopt recognized educational reporting criteria when describing their findings. Whether students learn by "doing", "proposing to do", or "critiquing", good curriculum design requires constructive alignment between teaching, assessment, and evaluation methods, aims, and outcomes. Peer-reviewed publications and presentations only evaluate one aspect of the student research experience.

Project description:BackgroundExperimental designs for evaluating knowledge translation (KT) interventions can provide strong estimates of effectiveness but offer limited insight into how the intervention worked. Consequently, process evaluations have been used to explore the causal mechanisms at work; however, there are limited standards to guide this work. This study synthesizes current evidence of KT process evaluations to provide future methodological recommendations.MethodsPeer-reviewed search strategies were developed by a health research librarian. Studies had to be in English, published since 1996, and were not excluded based on design. Studies had to (1) be a process evaluation of a KT intervention study in primary health, (2) be a primary research study, and (3) include a licensed healthcare professional delivering or receiving the intervention. A two-step, two-person hybrid screening approach was used for study inclusion with inter-rater reliability ranging from 94 to 95%. Data on study design, data collection, theoretical influences, and approaches used to evaluate the KT intervention, analysis, and outcomes were extracted by two reviewers. Methodological quality was assessed with the Mixed Methods Appraisal Tool (MMAT).ResultsOf the 20,968 articles screened, 226 studies fit our inclusion criteria. The majority of process evaluations used qualitative forms of data collection (43.4%) and individual interviews as the predominant data collection method. 72.1% of studies evaluated barriers and/or facilitators to implementation. 59.7% of process evaluations were stand-alone evaluations. The timing of data collection varied widely with post-intervention data collection being the most frequent (46.0%). Only 38.1% of the studies were informed by theory. Furthermore, 38.9% of studies had MMAT scores of 50 or less indicating poor methodological quality.ConclusionsThere is widespread acceptance that the generalizability of quantitative trials of KT interventions would be significantly enhanced through complementary process evaluations. However, this systematic review found that process evaluations are of mixed quality and lack theoretical guidance. Most process evaluation data collection occurred post-intervention undermining the ability to evaluate the process of implementation. Strong science and methodological guidance is needed to underpin and guide the design and execution of process evaluations in KT science.RegistrationThis study is not registered with PROSPERO.

Project description:Despite the plethora of empirical studies conducted to date, debate continues about whether and to what extent results should be returned to participants of genomic research. We aimed to systematically review the empirical literature exploring stakeholders' perspectives on return of individual research results (IRR) from genomic research. We examined preferences for receiving or willingness to return IRR, and experiences with either receiving or returning them. The systematic searches were conducted across five major databases in August 2018 and repeated in April 2020, and included studies reporting findings from primary research regardless of method (quantitative, qualitative, mixed). Articles that related to the clinical setting were excluded. Our search identified 221 articles that met our search criteria. This included 118 quantitative, 69 qualitative and 34 mixed methods studies. These articles included a total number of 118,874 stakeholders with research participants (85,270/72%) and members of the general public (40,967/35%) being the largest groups represented. The articles spanned at least 22 different countries with most (144/65%) being from the USA. Most (76%) discussed clinical research projects, rather than biobanks. More than half (58%) gauged views that were hypothetical. We found overwhelming evidence of high interest in return of IRR from potential and actual genomic research participants. There is also a general willingness to provide such results by researchers and health professionals, although they tend to adopt a more cautious stance. While all results are desired to some degree, those that have the potential to change clinical management are generally prioritized by all stakeholders. Professional stakeholders appear more willing to return results that are reliable and clinically relevant than those that are less reliable and lack clinical relevance. The lack of evidence for significant enduring psychological harm and the clear benefits to some research participants suggest that researchers should be returning actionable IRRs to participants.

Project description:BackgroundHealth systems worldwide are facing shortages in health professional workforce. Several studies have demonstrated the direct correlation between the availability of health workers, coverage of health services, and population health outcomes. To address this shortage, online eLearning is increasingly being adopted in health professionals' education. To inform policy-making, in online eLearning, we need to determine its effectiveness.MethodsWe performed a systematic review of the effectiveness of online eLearning through a comprehensive search of the major databases for randomised controlled trials that compared online eLearning to traditional learning or alternative learning methods. The search period was from January 2000 to August 2013. We included articles which primarily focused on students' knowledge, skills, satisfaction and attitudes toward eLearning and cost-effectiveness and adverse effects as secondary outcomes. Two reviewers independently extracted data from the included studies. Due to significant heterogeneity among the included studies, we presented our results as a narrative synthesis.FindingsFifty-nine studies, including 6750 students enrolled in medicine, dentistry, nursing, physical therapy and pharmacy studies, met the inclusion criteria. Twelve of the 50 studies testing knowledge gains found significantly higher gains in the online eLearning intervention groups compared to traditional learning, whereas 27 did not detect significant differences or found mixed results. Eleven studies did not test for differences. Six studies detected significantly higher skill gains in the online eLearning intervention groups, whilst 3 other studies testing skill gains did not detect differences between groups and 1 study showed mixed results. Twelve studies tested students' attitudes, of which 8 studies showed no differences in attitudes or preferences for online eLearning. Students' satisfaction was measured in 29 studies, 4 studies showed higher satisfaction for online eLearning and 20 studies showed no difference in satisfaction between online eLearning and traditional learning. Risk of bias was high for several of the included studies.ConclusionThe current evidence base suggests that online eLearning is equivalent, possibly superior to traditional learning. These findings present a potential incentive for policy makers to cautiously encourage its adoption, while respecting the heterogeneity among the studies.

Project description:BackgroundThe world is short of 7.2 million health-care workers and this figure is growing. The shortage of teachers is even greater, which limits traditional education modes. eLearning may help overcome this training need. Offline eLearning is useful in remote and resource-limited settings with poor internet access. To inform investments in offline eLearning, we need to establish its effectiveness in terms of gaining knowledge and skills, students' satisfaction and attitudes towards eLearning.MethodsWe conducted a systematic review of offline eLearning for students enrolled in undergraduate, health-related university degrees. We included randomised controlled trials that compared offline eLearning to traditional learning or an alternative eLearning method. We searched the major bibliographic databases in August 2013 to identify articles that focused primarily on students' knowledge, skills, satisfaction and attitudes toward eLearning, and health economic information and adverse effects as secondary outcomes. We also searched reference lists of relevant studies. Two reviewers independently extracted data from the included studies. We synthesized the findings using a thematic summary approach.FindingsForty-nine studies, including 4955 students enrolled in undergraduate medical, dentistry, nursing, psychology, or physical therapy studies, met the inclusion criteria. Eleven of the 33 studies testing knowledge gains found significantly higher gains in the eLearning intervention groups compared to traditional learning, whereas 21 did not detect significant differences or found mixed results. One study did not test for differences. Eight studies detected significantly higher skill gains in the eLearning intervention groups, whilst the other 5 testing skill gains did not detect differences between groups. No study found offline eLearning as inferior. Generally no differences in attitudes or preference of eLearning over traditional learning were observed. No clear trends were found in the comparison of different modes of eLearning. Most of the studies were small and subject to several biases.ConclusionsOur results suggest that offline eLearning is equivalent and possibly superior to traditional learning regarding knowledge, skills, attitudes and satisfaction. Although a robust conclusion cannot be drawn due to variable quality of the evidence, these results justify further investment into offline eLearning to address the global health care workforce shortage.

Project description:BackgroundWhole genome sequencing (WGS) is becoming an important part of epidemiological investigations of infectious diseases due to greater resolution and cost reductions compared to traditional typing approaches. Many public health and clinical teams will increasingly use WGS to investigate clusters of potential pathogen transmission, making it crucial to understand the benefits and assumptions of the analytical methods for investigating the data. We aimed to understand how different approaches affect inferences of transmission dynamics and outline limitations of the methods.MethodsWe comprehensively searched electronic databases for studies that presented methods used to interpret WGS data for investigating tuberculosis (TB) transmission. Two authors independently selected studies for inclusion and extracted data. Due to considerable methodological heterogeneity between studies, we present summary data with accompanying narrative synthesis rather than pooled analyses.ResultsTwenty-five studies met our inclusion criteria. Despite the range of interpretation tools, the usefulness of WGS data in understanding TB transmission often depends on the amount of genetic diversity in the setting. Where diversity is small, distinguishing re-infections from relapses may be impossible; interpretation may be aided by the use of epidemiological data, examining minor variants and deep sequencing. Conversely, when within-host diversity is large, due to genetic hitchhiking or co-infection of two dissimilar strains, it is critical to understand how it arose. Greater understanding of microevolution and mixed infection will enhance interpretation of WGS data.ConclusionsAs sequencing studies have sampled more intensely and integrated multiple sources of information, the understanding of TB transmission and diversity has grown, but there is still much to be learnt about the origins of diversity that will affect inferences from these data. Public health teams and researchers should combine epidemiological, clinical and WGS data to strengthen investigations of transmission.