The use and interpretation of quasi-experimental studies in medical informatics.
Ontology highlight
ABSTRACT:
SUBMITTER: Harris AD
PROVIDER: S-EPMC1380192 | biostudies-other | 2006 Jan-Feb
REPOSITORIES: biostudies-other
Publications
The use and interpretation of quasi-experimental studies in medical informatics.
Harris Anthony D AD McGregor Jessina C JC Perencevich Eli N EN Furuno Jon P JP Zhu Jingkun J Peterson Dan E DE Finkelstein Joseph J
Journal of the American Medical Informatics Association : JAMIA 20051012 1
Quasi-experimental study designs, often described as nonrandomized, pre-post intervention studies, are common in the medical informatics literature. Yet little has been written about the benefits and limitations of the quasi-experimental approach as applied to informatics studies. This paper outlines a relative hierarchy and nomenclature of quasi-experimental study designs that is applicable to medical informatics intervention studies. In addition, the authors performed a systematic review of tw ...[more]
Similar Datasets
Project description:BackgroundVideo-based teaching has been part of medical education for some time but 360° videos using a virtual reality (VR) device are a new medium that offer extended possibilities. We investigated whether adding a 360° VR video to the internship curriculum leads to an improvement of long-term recall of specific knowledge on a gentle Caesarean Sections (gCS) and on general obstetric knowledge.MethodsTwo weeks prior to their Obstetrics and Gynaecology (O&G) internship, medical students were divided in teaching groups, that did or did not have access to a VR-video of a gCS. Six weeks after their O&G internship, potentially having observed one or multiple real-life CSs, knowledge on the gCS was assessed with an open questionnaire, and knowledge on general obstetrics with a multiple-choice questionnaire. Furthermore we assessed experienced anxiety during in-person attendance of CSs, and we asked whether the interns would have wanted to attend more CSs in-person. The 360° VR video group was questioned about their experience directly after they watched the video. We used linear regression analyses to determine significant effects on outcomes.ResultsA total of 89 medical students participated, 41 in the 360° VR video group and 48 in the conventional study group. Watching the 360° VR video did not result in a difference in either specific or general knowledge retention between the intervention group and the conventional study group. This was both true for the grade received for the internship, the open-ended questions as well as the multiple-choice questions and this did not change after adjustment for confounding factors. Still, 83.4% of the 360° VR video-group reported that more videos should be used in training to prepare for surgical procedures. In the 360° VR video-group 56.7% reported side effects like nausea or dizziness. After adjustment for the number of attended CSs during the practical internship, students in the 360° VR video-group stated less often (p = 0.04) that they would have liked to attend more CSs in-person as compared to the conventional study group.ConclusionEven though the use of 360° VR video did not increase knowledge, it did offer a potential alternative for attending a CS in-person and a new way to prepare the students for their first operating room experiences.
| S-EPMC8035054 | biostudies-literature
Project description:BackgroundThe magnitude of the benefit associated with screening has been debated. We present a meta-analysis of quasi-experimental studies on the effects of mammography screening.MethodsWe searched MEDLINE/PubMed and Embase for articles published through January 31, 2013. Studies were included if they reported: 1) a population-wide breast cancer screening program using mammography with 5+ years of data post-implementation; 2) a comparison group with equal access to therapies; and 3) breast cancer mortality. Studies excluded were: RCTs, case-control, or simulation studies. We defined quasi-experimental as studies that compared either geographical, historical or birth cohorts with a screening program to an equivalent cohort without a screening program. Meta-analyses were conducted in Stata using the metan command, random effects. Meta-analyses were conducted separately for ages screened: under 50, 50 to 69 and over 70 and weighted by population and person-years.ResultsAmong 4,903 published papers that were retrieved, 19 studies matched eligibility criteria. Birth cohort studies reported a significant benefit for women screened <age 50, but not for women screened ages 50-69. Significant reductions in breast cancer mortality were observed in historical comparisons. For geographical comparisons, there was a significant 20% reduction in mortality for women <age 50 and a significant 21-22% reduction for women ages 50-69. Studies that tested the interaction of geographical and historical comparisons produced a pooled, significant 13-17% reduction in incident breast cancer mortality for women ages 50-69, but the effects in most individual studies were non-significant. All studies of women ages 70+ were non-significant.ConclusionsMammography screening may have modest effects on cancer mortality between the ages of 50 and 69 and non-significant effects for women older than age 70. Results are consistent with meta-analyses of RCTs. Effects on total mortality could not be assessed because of the limited number of studies.
| S-EPMC4041743 | biostudies-literature
Project description:Arts education in schools frequently experiences the pressure of being validated by demonstrating quantitative impact on academic outcomes. The quantitative evidence to date has been characterized by the application of largely correlational designs and frequently applies a narrow focus on instrumental outcomes such as academically relevant competencies. The present review aims to summarize quantitative evidence from quasi-experimental and experimental studies with pre-test post-test designs on the effects of school-based arts education on a broader range of competency outcomes, including intra- and interindividual competencies. A systematic literature search was conducted to identify relevant evaluation studies. Twenty-four articles reporting on 26 evaluation studies were eligible for inclusion, and their results were reviewed in terms of art domains and outcome categories. Whilst there is some evidence of beneficial effects on some competencies, for example of music education on arithmetic abilities, speech segmentation and processing speed, the evidence across arts domains and for different outcomes is limited due to small sample sizes, small number of studies, and a large range of effect sizes. The review highlights that sufficiently powered (quasi-)experimental studies with pre-test post-test designs evaluating arts education are sparse and that the "gold standard" of experimental research comes at the expense of a number of other study characteristics such as sample size, intervention and follow-up length. By summarizing the limitations of the current (quasi-)experimental research, the application of experimental designs is critically assessed and a combination with qualitative methods in mixed-method designs and choice of relevant outcomes discussed.
| S-EPMC8082240 | biostudies-literature
Project description:BACKGROUND:Medical coding is essential for standardized communication and integration of clinical data. The Unified Medical Language System by the National Library of Medicine is the largest clinical terminology system for medical coders and Natural Language Processing tools. However, the abundance of ambiguous codes leads to low rates of uniform coding among different coders. OBJECTIVE:The objective of our study was to measure uniform coding among different medical experts in terms of interrater reliability and analyze the effect on interrater reliability using an expert- and Web-based code suggestion system. METHODS:We conducted a quasi-experimental study in which 6 medical experts coded 602 medical items from structured quality assurance forms or free-text eligibility criteria of 20 different clinical trials. The medical item content was selected on the basis of mortality-leading diseases according to World Health Organization data. The intervention comprised using a semiautomatic code suggestion tool that is linked to a European information infrastructure providing a large medical text corpus of >300,000 medical form items with expert-assigned semantic codes. Krippendorff alpha (Kalpha) with bootstrap analysis was used for the interrater reliability analysis, and coding times were measured before and after the intervention. RESULTS:The intervention improved interrater reliability in structured quality assurance form items (from Kalpha=0.50, 95% CI 0.43-0.57 to Kalpha=0.62 95% CI 0.55-0.69) and free-text eligibility criteria (from Kalpha=0.19, 95% CI 0.14-0.24 to Kalpha=0.43, 95% CI 0.37-0.50) while preserving or slightly reducing the mean coding time per item for all 6 coders. Regardless of the intervention, precoordination and structured items were associated with significantly high interrater reliability, but the proportion of items that were precoordinated significantly increased after intervention (eligibility criteria: OR 4.92, 95% CI 2.78-8.72; quality assurance: OR 1.96, 95% CI 1.19-3.25). CONCLUSIONS:The Web-based code suggestion mechanism improved interrater reliability toward moderate or even substantial intercoder agreement. Precoordination and the use of structured versus free-text data elements are key drivers of higher interrater reliability.
| S-EPMC6231825 | biostudies-other
Project description:BackgroundExposure to air pollution, a leading contributor to the global burden of disease, can cause economic losses. Driven by clean air policies, the air quality in China, one of the most polluted countries, has improved rapidly since 2013. This has enabled a unique, quasi-experiment to assess the economic impact of air pollution empirically.Methods and findingsUsing a series of nation-scale longitudinal surveys in 2011, 2013, and 2015, we first examined the questionnaire-based medical expenditure changes before and after the policy intervention for air pollution. Using a state-of-the-art estimator of the historical concentration of particulate matters with diameter less than 2.5 μm (particulate matter (PM)2.5), we further quantified the association between household medical expenditure and PM2.5 using mixed-effect models of the repeated measurements from 26,511 households in 126 cities. Regression models suggest a robust linear association between reduced PM2.5 and saved medical expenditures, since the association did not vary significantly across models with different covariate adjustments, subregions, or subpopulations. Each 10 μg/m3 reduction in PM2.5 was associated with a saving of 251.6 (95% CI: 30.8, 472.3; p-value = 0.026) Yuan in per capita annual medical expenditure. However, due to limitations in data quality (e.g., self-reported expenditures), and imperfect control for unmeasured confounders or impact from concurrent healthcare reform in China, the causality underlying our findings should be further confirmed or refuted.ConclusionIn this study, we observed that compared with the PM2.5 reduction in 2013, the PM2.5 reduction in 2017 was associated with a saving of 552 (95% CI: 68, 1036) Yuan / (person × year), or approximately 736 billion Yuan (equivalent to 111 billion US dollar) per year nationally, which is equivalent to approximately 1% of the national gross domestic product of China.
| S-EPMC7787388 | biostudies-literature
Project description:BACKGROUND: Computer-aided diagnosis for screening utilizes computer-based analytical methodologies to process patient information. Glaucoma is the leading irreversible cause of blindness. Due to the lack of an effective and standard screening practice, more than 50% of the cases are undiagnosed, which prevents the early treatment of the disease. OBJECTIVE: To design an automatic glaucoma diagnosis architecture automatic glaucoma diagnosis through medical imaging informatics (AGLAIA-MII) that combines patient personal data, medical retinal fundus image, and patient's genome information for screening. MATERIALS AND METHODS: 2258 cases from a population study were used to evaluate the screening software. These cases were attributed with patient personal data, retinal images and quality controlled genome data. Utilizing the multiple kernel learning-based classifier, AGLAIA-MII, combined patient personal data, major image features, and important genome single nucleotide polymorphism (SNP) features. RESULTS AND DISCUSSION: Receiver operating characteristic curves were plotted to compare AGLAIA-MII's performance with classifiers using patient personal data, images, and genome SNP separately. AGLAIA-MII was able to achieve an area under curve value of 0.866, better than 0.551, 0.722 and 0.810 by the individual personal data, image and genome information components, respectively. AGLAIA-MII also demonstrated a substantial improvement over the current glaucoma screening approach based on intraocular pressure. CONCLUSIONS: AGLAIA-MII demonstrates for the first time the capability of integrating patients' personal data, medical retinal image and genome information for automatic glaucoma diagnosis and screening in a large dataset from a population study. It paves the way for a holistic approach for automatic objective glaucoma diagnosis and screening.
| S-EPMC3822106 | biostudies-literature
Project description:BACKGROUND:We sought to determine whether patients with a coordinated care plan developed using the Health Links model of care in the Hamilton Niagara Haldimand Brant Local Health Integration Network differed in their use of health care (no. of emergency department visits, inpatient admissions, length of inpatient stay) when compared with a matched control group of patients with no care plans. METHODS:We performed a propensity score-matched study of 12 months pre- and 12 months post-health care use. Patients who had a coordinated care plan that started between 2013 and 2015 were propensity score matched to patients in a control group. Patient information was obtained from Client Health and Related Information System, National Ambulatory Care Reporting System and Discharge Abstract Database. Differences in health care use pre- and post-index date were compared using the Wilcoxon signed-rank test. A negative binomial regression model was fit for each health care use outcome at 6 and 12 months post-index date. RESULTS:Six hundred coordinated care plan enrollees and 25 449 potential control patients were included in the matching algorithm, which resulted in 548 matched pairs (91.3%). Both groups showed decreases in health care use post-index date. Matched care plan enrollees had significantly fewer emergency department visits at 6 (incidence rate ratio [IRR] 0.81, 95% confidence interval [CI] 0.72-0.91, p < 0.01) and 12 months post-index date (IRR 0.88, 95% CI 0.79-0.99, p < 0.05) compared with the matched controls. Other use parameters were not significantly different between care plan enrollees and the control group. INTERPRETATION:Care plan enrollees show a decrease in the number of times they visit emergency departments, which may be attributed to integrated and coordinated care planning. This association should be examined to see whether these reductions persist for more than 1 year.
| S-EPMC5984145 | biostudies-literature
Project description:Low dose naltrexone (LDN) has become a popular off-label therapy for multiple sclerosis (MS). A few small, randomized studies indicate that LDN may have beneficial effects in MS and other autoimmune diseases. If proven efficacious, it would be a cheap and safe alternative to the expensive treatments currently recommended for MS. We investigated whether a sudden increase in LDN use in Norway in 2013 was followed by changes in dispensing of other medications used to treat MS. We performed a quasi-experimental before-and-after study based on population data from the Norwegian Prescription Database (NorPD). We included all patients that collected at least one LDN prescription in 2013, and had collected at least two medications with a reimbursement code for MS, or collected a medication with MS as the only indication in 2009 or 2010. Outcomes were differences in cumulative dispensed doses and incidence of users of disease modifying MS therapies, and medications used to treat MS symptoms two years before and two years after dispensing the initial LDN prescription. The eligible 341 patients collected 20 921 prescriptions in the observation period. Apart from changes in line with general trends in MS therapy in Norway, there was no difference in neither dispensed cumulative doses or number of prevalent users of MS specific medication. Initiation of LDN was not followed by reductions of other medications used to treat symptoms associated with MS.
| S-EPMC5669439 | biostudies-literature
Project description:Toward standards in clinical microbiome studies: comparison of DNA extraction methods and bioinformatic pipelines
| PRJEB34118 | ENA
Project description:Introduction:Depression is a frequent mood disorder among medical students that can lead to multiple negative consequences at individual and social level (such as academic achievement and interpersonal conflicts) as well as patient care performance. Therefore, the need of depression decreasing treatments in medical students is important. This study is designed to evaluate the effectiveness of the Behavioral Activation Treatment for Depression in a sample of Mexican medical students. Methods:This study will be performed under a quasi-experimental design to verify the effectiveness of the Behavioral Activation Treatment for Depression to reduce depressive symptoms in medical students from two public universities in northwestern Mexico. The participants will be assessed with the Center for Epidemiologic Studies Depression Scale, the Depression Anxiety Stress Scales, the Pittsburgh Sleep Quality Index, and the Plutchik Suicide Risk Scale. In addition to the psychometric assessment, there will be an electroencephalogram evaluation using the EMOTIV (v 1.1) device. Results:A pre-post intervention of 10 Behavioral Activation Treatment for Depression sessions will be implemented. The results of the effectiveness of the Behavioral Activation Treatment for Depression will be analyzed in five measures at pre-post intervention and two follow-ups of 3 and 6?months. Conclusions:This study looks for evidence regarding the efficacy and feasibility of the Behavioral Activation Treatment for Depression in a sample of medical students from two public universities in Mexico with high levels of depression along with stress and anxiety.
| S-EPMC7385827 | biostudies-literature