Dataset Information

Developing a dashboard to meet Competence Committee needs: a design-based research project.

ABSTRACT: Background:Competency-based programs are being adopted in medical education around the world. Competence Committees must visualize learner assessment data effectively to support their decision-making. Dashboards play an integral role in decision support systems in other fields. Design-based research allows the simultaneous development and study of educational environments. Methods:We utilized a design-based research process within the emergency medicine residency program at the University of Saskatchewan to identify the data, analytics, and visualizations needed by its Competence Committee, and developed a dashboard incorporating these elements. Narrative data were collected from two focus groups, five interviews, and the observation of two Competence Committee meetings. Data were qualitatively analyzed to develop a thematic framework outlining the needs of the Competence Committee and to inform the development of the dashboard. Results:The qualitative analysis identified four Competence Committee needs (Explore Workplace-Based Assessment Data, Explore Other Assessment Data, Understand the Data in Context, and Ensure the Security of the Data). These needs were described with narratives and represented through visualizations of the dashboard elements. Conclusions:This work addresses the practical challenges of supporting data-driven decision making by Competence Committees and will inform the development of dashboards for programs, institutions, and learner management systems.

SUBMITTER: Thoma B

PROVIDER: S-EPMC7082472 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Developing a dashboard to meet Competence Committee needs: a design-based research project.

Thoma Brent B Bandi Venkat V Carey Robert R Mondal Debajyoti D Woods Rob R Martin Lynsey L Chan Teresa T

Canadian medical education journal 20200316 1

<h4>Background</h4>Competency-based programs are being adopted in medical education around the world. Competence Committees must visualize learner assessment data effectively to support their decision-making. Dashboards play an integral role in decision support systems in other fields. Design-based research allows the simultaneous development and study of educational environments.<h4>Methods</h4>We utilized a design-based research process within the emergency medicine residency program at the Un ...[more]

PMID: 32215140

Similar Datasets

Project description:BACKGROUND:A large quantity of data is collected during the delivery of cancer care. However, once collected, these data are difficult for health professionals to access to support clinical decision making and performance review. There is a need for innovative tools that make clinical data more accessible to support health professionals in these activities. One approach for providing health professionals with access to clinical data is to create the infrastructure and interface for a clinical dashboard to make data accessible in a timely and relevant manner. OBJECTIVE:This study aimed to develop and evaluate 2 prototype dashboards for displaying data on the identification and management of lymphedema. METHODS:The study used a co-design framework to develop 2 prototype dashboards for use by health professionals delivering breast cancer care. The key feature of these dashboards was an approach for visualizing lymphedema patient cohort and individual patient data. This project began with 2 focus group sessions conducted with members of a breast cancer multidisciplinary team (n=33) and a breast cancer consumer (n=1) to establish clinically relevant and appropriate data for presentation and the visualization requirements for a dashboard. A series of fortnightly meetings over 6 months with an Advisory Committee (n=10) occurred to inform and refine the development of a static mock-up dashboard. This mock-up was then presented to representatives of the multidisciplinary team (n=3) to get preliminary feedback about the design and use of such dashboards. Feedback from these presentations was reviewed and used to inform the development of the interactive prototypes. A structured evaluation was conducted on the prototypes, using Think Aloud Protocol and semistructured interviews with representatives of the multidisciplinary team (n=5). RESULTS:Lymphedema was selected as a clinically relevant area for the prototype dashboards. A qualitative evaluation is reported for 5 health professionals. These participants were selected from 3 specialties: surgery (n=1), radiation oncology (n=2), and occupational therapy (n=2). Participants were able to complete the majority of tasks on the dashboard. Semistructured interview themes were categorized into engagement or enthusiasm for the dashboard, user experience, and data quality and completeness. CONCLUSIONS:Findings from this study constitute the first report of a co-design process for creating a lymphedema dashboard for breast cancer health professionals. Health professionals are interested in the use of data visualization tools to make routinely collected clinical data more accessible. To be used effectively, dashboards need to be reliable and sourced from accurate and comprehensive data sets. While the co-design process used to develop the visualization tool proved effective for designing an individual patient dashboard, the complexity and accessibility of the data required for a cohort dashboard remained a challenge.

Project description:Long-term health consequences following acute SARS-CoV-2 infection, referred to as post-COVID-19 condition or Long COVID, are increasing, with population-based prevalence estimates for adults at around 20%. Persons affected by Long COVID report various health problems, yet evidence to guide clinical decision making remains scarce. The present study aimed to identify Long COVID research priorities using a citizen science approach and solely considering the needs of those affected. This citizen science study followed an iterative process of patient needs identification, evaluation and prioritisation. A Long COVID Citizen Science Board (21 persons with Long COVID, and seven with myalgic encephalomyelitis/chronic fatigue syndrome) and a Long COVID Working Group (25 persons with Long COVID, four patients with myalgic encephalomyelitis/chronic fatigue syndrome and one relative) were formed. The study included four activities: three remote meetings and one online survey. First, Board members identified the needs and research questions. Second, Working Group members and persons affected by Long COVID (241 respondents, 85.5% with Long COVID, 14.5% with myalgic encephalomyelitis/chronic fatigue syndrome and 7.1% relatives) evaluated the research questions on a 1-5 Likert scale using an online survey. Then the Board gave feedback on this evaluation. Finally, Board members set the priorities for research through voting and discussion. Sixty-eight research questions were generated by the Board and categorised into four research domains (medicine, healthcare services, socioeconomics and burden of disease) and 14 subcategories. Their average importance ratings were moderate to high and varied from 3.41 (standard deviation = 1.16) for sex-specific diagnostics to 4.86 (standard deviation = 0.41) for medical questions on treatment. Five topics were prioritised: "treatment, rehabilitation and chronic care management", "availability of interfaces for treatment continuity", "availability of healthcare structures", "awareness and knowledge among professionals" and "prevalence of Long COVID in children and adolescents". To our knowledge, this is the first study developing a citizen-driven, explicitly patient-centred research agenda with persons affected by Long COVID, setting it apart from existing multi-stakeholder efforts. The identified priorities could guide future research and funding allocation. Our methodology establishes a framework for citizen-driven research agendas, suitable for transfer to other diseases.

Project description:BackgroundCurrently the health research system in Lao PDR is fragmented and largely donor led. Capacity among national public health institutes is limited to select priority research questions for funding.ObjectiveThe objective of this capacity building and practice-oriented study is to describe the process and outcome of the first National Health Research Agenda for Lao PDR and how the agenda contributes to institutional capacity of the Ministry of Health, in order to contribute to evidence-informed public health policy making.MethodThis activity used a mixed-methods approach. The overall design is based on principles of the interactive Learning and Action approach and consists out of 6 phases: (1) identification of needs, (2) shared analysis and integration, (3) nation-wide prioritization of research domains, (4) exploring specific research questions, (5) prioritization of research avenues, (6) dialogue and planning for action. The process involved interviews with experts in health policy and research (n = 42), telephone-based survey with district, provincial and national health staff (n = 135), a two-round Delphi consultation with experts in health policy and research (n = 33), and a workshop with policymakers, researchers, international organisations and civil society (n = 45) were held to gather data and conduct shared analysis.Results11 research domains were identified and prioritised: Health-seeking behaviour; Health system research; Health service provision; Mother and child health (MCH); Sexual & reproductive health; Health education; Non-communicable diseases (NCDs); Irrational drug use; Communicable diseases (CDs); Road traffic accidents; Mental health. Within these domains over 200 unique research questions were identified.ConclusionOur approach led to a comprehensive, inclusive, public health agenda for Lao PDR to realise better informed health policies. Questions on the agenda are action-oriented, originating in a desire to understand the problem so that immediate improvements can be made. The agenda is used within the MoH as a tool to fund and approve research.

Project description:BackgroundChronic traumatic encephalopathy (CTE) is a neurodegenerative disease that has been neuropathologically diagnosed in brain donors exposed to repetitive head impacts, including boxers and American football, soccer, ice hockey, and rugby players. CTE cannot yet be diagnosed during life. In December 2015, the National Institute of Neurological Disorders and Stroke awarded a seven-year grant (U01NS093334) to fund the "Diagnostics, Imaging, and Genetics Network for the Objective Study and Evaluation of Chronic Traumatic Encephalopathy (DIAGNOSE CTE) Research Project." The objectives of this multicenter project are to: develop in vivo fluid and neuroimaging biomarkers for CTE; characterize its clinical presentation; refine and validate clinical research diagnostic criteria (i.e., traumatic encephalopathy syndrome [TES]); examine repetitive head impact exposure, genetic, and other risk factors; and provide shared resources of anonymized data and biological samples to the research community. In this paper, we provide a detailed overview of the rationale, design, and methods for the DIAGNOSE CTE Research Project.MethodsThe targeted sample and sample size was 240 male participants, ages 45-74, including 120 former professional football players, 60 former collegiate football players, and 60 asymptomatic participants without a history of head trauma or participation in organized contact sports. Participants were evaluated at one of four U.S. sites and underwent the following baseline procedures: neurological and neuropsychological examinations; tau and amyloid positron emission tomography; magnetic resonance imaging and spectroscopy; lumbar puncture; blood and saliva collection; and standardized self-report measures of neuropsychiatric, cognitive, and daily functioning. Study partners completed similar informant-report measures. Follow-up evaluations were intended to be in-person and at 3 years post-baseline. Multidisciplinary diagnostic consensus conferences are held, and the reliability and validity of TES diagnostic criteria are examined.ResultsParticipant enrollment and all baseline evaluations were completed in February 2020. Three-year follow-up evaluations began in October 2019. However, in-person evaluation ceased with the COVID-19 pandemic, and resumed as remote, 4-year follow-up evaluations (including telephone-, online-, and videoconference-based cognitive, neuropsychiatric, and neurologic examinations, as well as in-home blood draw) in February 2021.ConclusionsFindings from the DIAGNOSE CTE Research Project should facilitate detection and diagnosis of CTE during life, and thereby accelerate research on risk factors, mechanisms, epidemiology, treatment, and prevention of CTE.Trial registrationNCT02798185.

Dataset Information

Developing a dashboard to meet Competence Committee needs: a design-based research project.

Publications

Developing a dashboard to meet Competence Committee needs: a design-based research project.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets