Dataset Information

Systematic review of the use of "magnitude-based inference" in sports science and medicine.

ABSTRACT: Magnitude-based inference (MBI) is a controversial statistical method that has been used in hundreds of papers in sports science despite criticism from statisticians. To better understand how this method has been applied in practice, we systematically reviewed 232 papers that used MBI. We extracted data on study design, sample size, and choice of MBI settings and parameters. Median sample size was 10 per group (interquartile range, IQR: 8-15) for multi-group studies and 14 (IQR: 10-24) for single-group studies; few studies reported a priori sample size calculations (15%). Authors predominantly applied MBI's default settings and chose "mechanistic/non-clinical" rather than "clinical" MBI even when testing clinical interventions (only 16 studies out of 232 used clinical MBI). Using these data, we can estimate the Type I error rates for the typical MBI study. Authors frequently made dichotomous claims about effects based on the MBI criterion of a "likely" effect and sometimes based on the MBI criterion of a "possible" effect. When the sample size is n = 8 to 15 per group, these inferences have Type I error rates of 12%-22% and 22%-45%, respectively. High Type I error rates were compounded by multiple testing: Authors reported results from a median of 30 tests related to outcomes; and few studies specified a primary outcome (14%). We conclude that MBI has promoted small studies, promulgated a "black box" approach to statistics, and led to numerous papers where the conclusions are not supported by the data. Amidst debates over the role of p-values and significance testing in science, MBI also provides an important natural experiment: we find no evidence that moving researchers away from p-values or null hypothesis significance testing makes them less prone to dichotomization or over-interpretation of findings.

SUBMITTER: Lohse KR

PROVIDER: S-EPMC7319293 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Systematic review of the use of "magnitude-based inference" in sports science and medicine.

Lohse Keith R KR Sainani Kristin L KL Taylor J Andrew JA Butson Michael L ML Knight Emma J EJ Vickers Andrew J AJ

PloS one 20200626 6

Magnitude-based inference (MBI) is a controversial statistical method that has been used in hundreds of papers in sports science despite criticism from statisticians. To better understand how this method has been applied in practice, we systematically reviewed 232 papers that used MBI. We extracted data on study design, sample size, and choice of MBI settings and parameters. Median sample size was 10 per group (interquartile range, IQR: 8-15) for multi-group studies and 14 (IQR: 10-24) for singl ...[more]

PMID: 32589653

Similar Datasets

Project description:BackgroundNetball is the one of the most popular women's sports in the world. Since gaining professional status in 2008 there has been a rapid growth in research in the applied sports science and medicine of the sport. A scoping review of the area would provide practitioners and researchers with an overview of the current scientific literature to support on-court performance, player welfare and reduce injury.ObjectiveThe primary objective was to identify the current research on the applied sports science and medicine of netball. Additionally, the article provides a brief summary of the research in each topic of sports science and medicine in netball and identifies gaps in the current research.MethodsSystematic searches of PubMed, SPORTDiscus, MEDLINE and CINAHL were undertaken from earliest record to Dec 2020 and reference lists were manually searched. The PRISMA-ScR protocol was followed. Studies were eligible for inclusion if they investigated netball as a sport or the applied sport science and medicine of netball athletes.Results962 studies were identified in the initial search, 150 of which met the inclusion criteria. Injury was the most highly investigated sport science and medicine topic (n = 45), followed by physical qualities (n = 37), match characteristics (n = 24), biomechanics (n = 15), psychology (n = 13), fatigue and recovery (n = 9), training load (n = 4) and nutrition (n = 3). A range of cohorts were used from school to elite and international standards. All cohorts were female netballers, except for one study. A rapid growth in studies over recent years was demonstrated with 65% of studies published in the last decade. There still remains gaps in the literature, with a low evidence base for nutrition, training load and fatigue and recovery.ConclusionThis scoping review summarises the current evidence base and key findings that can be used in practice to enhance the applied sport science and medical support to netball athletes across a range of playing standards, and support the growth of the sport. It is evident that netball as a sport is still under-researched.

Project description:ContextThe prescription of opioids after elective surgical procedures has been a contributing factor to the current opioid epidemic in North America.ObjectiveTo examine the opioid prescribing practices and rates of opioid consumption among patients undergoing common sports medicine procedures.Data sourcesA systematic review of the electronic databases EMBASE, MEDLINE, and PubMed was performed from database inception to December 2018.Study selectionTwo investigators independently identified all studies reporting on postoperative opioid prescribing practices and consumption after arthroscopic shoulder, knee, or hip surgery. A total of 119 studies were reviewed, with 8 meeting eligibility criteria.Study designSystematic review.Level of evidenceLevel 4.Data extractionThe quantity of opioids prescribed and used were converted to milligram morphine equivalents (MMEs) for standardized reporting. The quality of each eligible study was evaluated using the Methodological Index for Non-Randomized Studies.ResultsA total of 8 studies including 816 patients with a mean age of 43.8 years were eligible for inclusion. A mean of 610, 197, and 613 MMEs were prescribed to patients after arthroscopic procedures of the shoulder, knee, and hip, respectively. At final follow-up, 31%, 34%, and 64% of the prescribed opioids provided after shoulder, knee, and hip arthroscopy, respectively, still remained. The majority of patients (64%) were unaware of the appropriate disposal methods for surplus medication. Patients undergoing arthroscopic rotator cuff repair had the highest opioid consumption (471 MMEs), with 1 in 4 patients receiving a refill.ConclusionOpioids are being overprescribed for arthroscopic procedures of the shoulder, knee, and hip, with more than one-third of prescribed opioids remaining postoperatively. The majority of patients are unaware of the appropriate disposal techniques for surplus opioids. Appropriate risk stratification tools and evidence-based recommendations regarding pain management strategies after arthroscopic procedures are needed to help curb the growing opioid crisis.

Project description:BackgroundCore stability training has grown in popularity over 25 years, initially for back pain prevention or therapy. Subsequently, it developed as a mode of exercise training for health, fitness and sport. The scientific basis for traditional core stability exercise has recently been questioned and challenged, especially in relation to dynamic athletic performance. Reviews have called for clarity on what constitutes anatomy and function of the core, especially in healthy and uninjured people. Clinical research suggests that traditional core stability training is inappropriate for development of fitness for heath and sports performance. However, commonly used methods of measuring core stability in research do not reflect functional nature of core stability in uninjured, healthy and athletic populations. Recent reviews have proposed a more dynamic, whole body approach to training core stabilization, and research has begun to measure and report efficacy of these modes training. The purpose of this study was to assess extent to which these developments have informed people currently working and participating in sport.MethodsAn online survey questionnaire was developed around common themes on core stability training as defined in the current scientific literature and circulated to a sample population of people working and participating in sport. Survey results were assessed against key elements of the current scientific debate.ResultsPerceptions on anatomy and function of the core were gathered from a representative cohort of athletes, coaches, sports science and sports medicine practitioners (n = 241), along with their views on effectiveness of various current and traditional exercise training modes. Most popular method of testing and measuring core function was subjective assessment through observation (43%), while a quarter (22%) believed there was no effective method of measurement. Perceptions of people in sport reflect the scientific debate, and practitioners have adopted a more functional approach to core stability training. There was strong support for loaded, compound exercises performed upright, compared to moderate support for traditional core stability exercises. Half of the participants (50%) in the survey, however, still support a traditional isolation core stability training.ConclusionPerceptions in applied practice on core stability training for dynamic athletic performance are aligned to a large extent to the scientific literature.

Project description:BackgroundThe economic burden of musculoskeletal diseases is substantial and growing. Economic evaluations compare costs and health benefits of interventions simultaneously to help inform value-based care; thus, it is crucial to ensure that studies are using appropriate methodology to provide valid evidence on the cost-effectiveness of interventions. This is particularly the case in orthopaedic sports medicine, where several interventions of varying costs are available to treat common hip and knee conditions.PurposeTo summarize and evaluate the quality of economic evaluations in orthopaedic sports medicine for knee and hip interventions and identify areas for quality improvement.Study designSystematic review; Level of evidence, 3.MethodsThe Medline, AMED, OVID Health Star, and EMBASE databases were searched from inception to March 1, 2020, to identify economic evaluations that compared ≥2 interventions for hip and/or knee conditions in orthopaedic sports medicine. We assessed the quality of full economic evaluations using the Quality of Health Economic Studies (QHES) tool, which consists of 16 questions for a total score of 100. We classified studies into quartiles based on QHES score (extremely poor quality to high quality) and we evaluated the frequency of studies that addressed each of the 16 QHES questions.ResultsA total of 93 studies were included in the systematic review. There were 41 (44%) cost analyses, of which 21 (51%) inappropriately concluded interventions were cost-effective. Only 52 (56%) of the included studies were full economic evaluations, although 40 of these (77%) fell in the high-quality quartile. The mean QHES score was 83.2 ± 19. Authors consistently addressed 12 of the QHES questions; questions that were missed or unclear were related to statistical uncertainty, appropriateness of costing methodology, and discussion of potential biases. The most frequently missed question was whether the cost perspective of the analysis was stated and justified.ConclusionThe number of studies in orthopaedic sports medicine is small, despite their overall good quality. Yet, there are still many highly cited studies based on low-quality or partial economic evaluations that are being used to influence clinical decision-making. Investigators should follow international health economic guidelines for study design and critical appraisal of studies to further improve quality.

Project description:BackgroundArtificial intelligence (AI) is one of the most promising areas in medicine with many possibilities for improving health and wellness. Already today, diagnostic decision support systems may help patients to estimate the severity of their complaints. This fictional case study aimed to test the diagnostic potential of an AI algorithm for common sports injuries and pathologies.MethodsBased on a literature review and clinical expert experience, five fictional "common" cases of acute, and subacute injuries or chronic sport-related pathologies were created: Concussion, ankle sprain, muscle pain, chronic knee instability (after ACL rupture) and tennis elbow. The symptoms of these cases were entered into a freely available chatbot-guided AI app and its diagnoses were compared to the pre-defined injuries and pathologies.ResultsA mean of 25-36 questions were asked by the app per patient, with optional explanations of certain questions or illustrative photos on demand. It was stressed, that the symptom analysis would not replace a doctor's consultation. A 23-yr-old male patient case with a mild concussion was correctly diagnosed. An ankle sprain of a 27-yr-old female without ligament or bony lesions was also detected and an ER visit was suggested. Muscle pain in the thigh of a 19-yr-old male was correctly diagnosed. In the case of a 26-yr-old male with chronic ACL instability, the algorithm did not sufficiently cover the chronic aspect of the pathology, but the given recommendation of seeing a doctor would have helped the patient. Finally, the condition of the chronic epicondylitis in a 41-yr-old male was correctly detected.ConclusionsAll chosen injuries and pathologies were either correctly diagnosed or at least tagged with the right advice of when it is urgent for seeking a medical specialist. However, the quality of AI-based results could presumably depend on the data-driven experience of these programs as well as on the understanding of their users. Further studies should compare existing AI programs and their diagnostic accuracy for medical injuries and pathologies.

Dataset Information

Systematic review of the use of "magnitude-based inference" in sports science and medicine.

Publications

Systematic review of the use of "magnitude-based inference" in sports science and medicine.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets