Estimating the reproducibility of social learning research published between 1955 and 2018.
Ontology highlight
ABSTRACT:
SUBMITTER: Minocher R
PROVIDER: S-EPMC8441137 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:A study of 100 papers from five journals that make use of bioacoustic recordings shows that only a minority (21%) deposit any of the recordings in a repository, supplementary materials section or a personal website. This lack of deposition hinders re-use of the raw data by other researchers, prevents the reproduction of a project's analyses and confirmation of its findings and impedes progress within the broader bioacoustics community. We make some recommendations for researchers interested in depositing their data.
| S-EPMC6834726 | biostudies-literature
Project description:Psychologists are navigating an unprecedented period of introspection about the credibility and utility of their discipline. Reform initiatives emphasize the benefits of transparency and reproducibility-related research practices; however, adoption across the psychology literature is unknown. Estimating the prevalence of such practices will help to gauge the collective impact of reform initiatives, track progress over time, and calibrate future efforts. To this end, we manually examined a random sample of 250 psychology articles published between 2014 and 2017. Over half of the articles were publicly available (154/237, 65%, 95% confidence interval [CI] = [59%, 71%]); however, sharing of research materials (26/183; 14%, 95% CI = [10%, 19%]), study protocols (0/188; 0%, 95% CI = [0%, 1%]), raw data (4/188; 2%, 95% CI = [1%, 4%]), and analysis scripts (1/188; 1%, 95% CI = [0%, 1%]) was rare. Preregistration was also uncommon (5/188; 3%, 95% CI = [1%, 5%]). Many articles included a funding disclosure statement (142/228; 62%, 95% CI = [56%, 69%]), but conflict-of-interest statements were less common (88/228; 39%, 95% CI = [32%, 45%]). Replication studies were rare (10/188; 5%, 95% CI = [3%, 8%]), and few studies were included in systematic reviews (21/183; 11%, 95% CI = [8%, 16%]) or meta-analyses (12/183; 7%, 95% CI = [4%, 10%]). Overall, the results suggest that transparency and reproducibility-related research practices were far from routine. These findings establish baseline prevalence estimates against which future progress toward increasing the credibility and utility of psychology research can be compared.
| S-EPMC8785283 | biostudies-literature
Project description:ObjectiveThe current study sought to describe and compare study type, research design and translation phase of published research in nutrition and dietetic journals in 1998 and 2018.DesignThis was a repeat cross-sectional bibliographic analysis of Nutrition and Dietetics research. All eligible studies in the top eight Nutrition and Dietetics indexed journals in 1998 and 2018 were included. Two independent reviewers coded each study for research design (study type and study design) and translation phase (T0-T4) of the research using seminal texts in the field.SettingNot relevant.ParticipantsNot relevant.ResultsThe number of publications (1998, n 1030; 2018, n 1016) has not changed over time, but the research type, design and translation phases have. The proportion of intervention studies in 1998 (43·8 %) was significantly higher than 2018 (19·4 %). In 2018, more reviews (46·9 % v. 15·6 % in 1998) and less randomised trials (14·3 % v. 37·8 % in 1998) were published. In regard to translation phase, there was a higher proportion of T2-T4 research in 2018 (18·3 % v. 3·8 % in 1998); however, the proportion of T3/T4 (dissemination, implementation and population-level research) research was still low (<3 %). Our sensitivity analysis with the four journals that remained in the top eight journal across the two time periods found no differences in the research type, design and translation phases across time.ConclusionsThere was a reduction in intervention and T0 publications, alongside higher publication of clinical study designs over time; however, published T3/T4 research in Nutrition and Dietetics is low. A greater focus on publishing interventions and dissemination and implementation may be needed.
| S-EPMC8063610 | biostudies-literature
Project description:This is the fifth yearly article in the Tourette Syndrome Research Highlights series, summarizing research from 2018 relevant to Tourette syndrome and other tic disorders. The authors briefly summarize reports they consider most important or interesting. The highlights from 2019 article is being drafted on the Authorea online authoring platform, and readers are encouraged to add references or give feedback on our selections using the comments feature on that page. After the calendar year ends, the article is submitted as the annual update for the Tics collection on F1000Research.
| S-EPMC6719747 | biostudies-other
Project description:IntroductionPublic health investigations, including research, in refugee populations are necessary to inform evidence-based interventions and care. The unique challenges refugees face (displacement, limited political protections, economic hardship) can make them especially vulnerable to harm, burden, or undue influence. Acute survival needs, fear of stigma or persecution, and history of trauma may present challenges to ensuring meaningful informed consent and establishing trust. We examined the recently published literature to understand the application of ethics principles in investigations involving refugees.MethodsWe conducted a preliminary review of refugee health literature (research and non-research data collections) published from 2015 through 2018 available in PubMed. Article inclusion criteria were: participants were refugees, topic was health-related, and methods used primary data collection. Information regarding type of investigation, methods, and reported ethics considerations was abstracted.ResultsWe examined 288 articles. Results indicated 33% of investigations were conducted before resettlement, during the displacement period (68% of these were in refugee camps). Common topics included mental health (48%) and healthcare access (8%). The majority (87%) of investigations obtained consent. Incentives were provided less frequently (23%). Most authors discussed the ways in which community stakeholders were engaged (91%), yet few noted whether refugee representatives had an opportunity to review investigational protocols (8%). Cultural considerations were generally limited to gender and religious norms, and 13% mentioned providing some form of post-investigation support.ConclusionsOur analysis is a preliminary assessment of the application of ethics principles reported within the recently published refugee health literature. From this analysis, we have proposed a list of best practices, which include stakeholder engagement, respect for cultural norms, and post-study support. Investigations conducted among refugees require additional diligence to ensure respect for and welfare of the participants. Development of a refugee-specific ethics framework with ethics and refugee health experts that addresses the need for stakeholder involvement, appropriate incentive use, protocol review, and considerations of cultural practices may help guide future investigations in this population.
| S-EPMC7305588 | biostudies-literature
Project description:BackgroundSocial media has substantially changed how people confront health issues. However, a comprehensive understanding of how social media has altered the foci and methods in public health research remains lacking.ObjectiveThis study aims to examine research themes, the role of social media, and research methods in social media-based public health research published from 2000 to 2018.MethodsA dataset of 3419 valid studies was developed by searching a list of relevant keywords in the Web of Science and PubMed databases. In addition, this study employs an unsupervised text-mining technique and topic modeling to extract research themes of the published studies. Moreover, the role of social media and research methods adopted in those studies were analyzed.ResultsThis study identifies 25 research themes, covering different diseases, various population groups, physical and mental health, and other significant issues. Social media assumes two major roles in public health research: produce substantial research interest for public health research and furnish a research context for public health research. Social media provides substantial research interest for public health research when used for health intervention, human-computer interaction, as a platform of social influence, and for disease surveillance, risk assessment, or prevention. Social media acts as a research context for public health research when it is mere reference, used as a platform to recruit participants, and as a platform for data collection. While both qualitative and quantitative methods are frequently used in this emerging area, cutting edge computational methods play a marginal role.ConclusionsSocial media enables scholars to study new phenomena and propose new research questions in public health research. Meanwhile, the methodological potential of social media in public health research needs to be further explored.
| S-EPMC7453331 | biostudies-literature
Project description:BackgroundThe objective of this study was to evaluate the nature and extent of reproducible and transparent research practices in neurology publications.MethodsThe NLM catalog was used to identify MEDLINE-indexed neurology journals. A PubMed search of these journals was conducted to retrieve publications over a 5-year period from 2014 to 2018. A random sample of publications was extracted. Two authors conducted data extraction in a blinded, duplicate fashion using a pilot-tested Google form. This form prompted data extractors to determine whether publications provided access to items such as study materials, raw data, analysis scripts, and protocols. In addition, we determined if the publication was included in a replication study or systematic review, was preregistered, had a conflict of interest declaration, specified funding sources, and was open access.ResultsOur search identified 223,932 publications meeting the inclusion criteria, from which 400 were randomly sampled. Only 389 articles were accessible, yielding 271 publications with empirical data for analysis. Our results indicate that 9.4% provided access to materials, 9.2% provided access to raw data, 0.7% provided access to the analysis scripts, 0.7% linked the protocol, and 3.7% were preregistered. A third of sampled publications lacked funding or conflict of interest statements. No publications from our sample were included in replication studies, but a fifth were cited in a systematic review or meta-analysis.ConclusionsCurrently, published neurology research does not consistently provide information needed for reproducibility. The implications of poor research reporting can both affect patient care and increase research waste. Collaborative intervention by authors, peer reviewers, journals, and funding sources is needed to mitigate this problem.
| S-EPMC7049215 | biostudies-literature
Project description:Serious concerns about research quality have catalysed a number of reform initiatives intended to improve transparency and reproducibility and thus facilitate self-correction, increase efficiency and enhance research credibility. Meta-research has evaluated the merits of some individual initiatives; however, this may not capture broader trends reflecting the cumulative contribution of these efforts. In this study, we manually examined a random sample of 250 articles in order to estimate the prevalence of a range of transparency and reproducibility-related indicators in the social sciences literature published between 2014 and 2017. Few articles indicated availability of materials (16/151, 11% [95% confidence interval, 7% to 16%]), protocols (0/156, 0% [0% to 1%]), raw data (11/156, 7% [2% to 13%]) or analysis scripts (2/156, 1% [0% to 3%]), and no studies were pre-registered (0/156, 0% [0% to 1%]). Some articles explicitly disclosed funding sources (or lack of; 74/236, 31% [25% to 37%]) and some declared no conflicts of interest (36/236, 15% [11% to 20%]). Replication studies were rare (2/156, 1% [0% to 3%]). Few studies were included in evidence synthesis via systematic review (17/151, 11% [7% to 16%]) or meta-analysis (2/151, 1% [0% to 3%]). Less than half the articles were publicly available (101/250, 40% [34% to 47%]). Minimal adoption of transparency and reproducibility-related research practices could be undermining the credibility and efficiency of social science research. The present study establishes a baseline that can be revisited in the future to assess progress.
| S-EPMC7062098 | biostudies-literature
Project description:Systematic reviews were conducted in the nineties and early 2000's on online learning research. However, there is no review examining the broader aspect of research themes in online learning in the last decade. This systematic review addresses this gap by examining 619 research articles on online learning published in twelve journals in the last decade. These studies were examined for publication trends and patterns, research themes, research methods, and research settings and compared with the research themes from the previous decades. While there has been a slight decrease in the number of studies on online learning in 2015 and 2016, it has then continued to increase in 2017 and 2018. The majority of the studies were quantitative in nature and were examined in higher education. Online learning research was categorized into twelve themes and a framework across learner, course and instructor, and organizational levels was developed. Online learner characteristics and online engagement were examined in a high number of studies and were consistent with three of the prior systematic reviews. However, there is still a need for more research on organization level topics such as leadership, policy, and management and access, culture, equity, inclusion, and ethics and also on online instructor characteristics.
| S-EPMC7480742 | biostudies-literature
Project description:Background This study aimed to investigate how social networks are associated with cognitive function in the middle-aged and elderly Korean population. Methods A total of 7,704 individuals over the age of 50 were included from the baseline recruitment of the Cardiovascular and Metabolic Diseases Etiology Research Center cohort from the years 2013 to 2018. Egocentric social network characteristics including network size, intimacy, and frequency of face-to-face meetings were measured as exposures, and the Korean version of Mini-Mental State Examination (K-MMSE) score was measured to reflect general cognitive function as an outcome. We also stratified the analysis by income level into tertiles, with income caps of 42,000 thousand won and 72,000 thousand won. A general linear regression model was used, adjusting for age, gender, socioeconomic factors, lifestyle factors, depressive symptoms, and study settings. Results Social network properties were positively associated with cognitive function in both men and women. However, the specific estimates varied according to gender and income level. In men, frequency was most significantly associated with cognitive function (standardized β = 0.093, p-value <0 .0001). In women, the strength of the association with cognitive function was found in size (standardized β = 0.055, p-value = 0.001). The effect modification of income level could be seen in the association between frequency and cognitive function. The strongest association between frequency and cognitive function was found in the middle income group in men (standardized β = 0.114, p-value = 0.0063), and the low income group in women (standardized β = 0.076, p-value = 0.0039). Conclusion There were positive associations between social network properties (i.e., size, intimacy, and frequency of face-to-face meetings) and cognitive function. The degree of association varied according to social network properties, gender, and income level. Overall, among social network properties, social network size was an important factor in the cognition of women, whereas frequency was important in the cognition of men.
| S-EPMC9207251 | biostudies-literature