The Question of Data Integrity in Article-Level Metrics.
Ontology highlight
ABSTRACT:
SUBMITTER: Gordon G
PROVIDER: S-EPMC4546647 | biostudies-other | 2015 Aug
REPOSITORIES: biostudies-other
Publications
The Question of Data Integrity in Article-Level Metrics.
Gordon Gregg G Lin Jennifer J Cave Richard R Dandrea Ralph R
PLoS biology 20150821 8
Interest in and use of article-level metrics (ALMs) has grown rapidly amongst the research community, by researchers, publishers, funders, and research institutions. As this happens, it is critical to ensure secure and reliable data that is trustworthy and can be used by all. Two case studies are presented, which illustrate different approaches to establishing ALM data integrity. ...[more]
Similar Datasets
Project description:Article-level metrics (ALMs) provide a wide range of metrics about the uptake of an individual journal article by the scientific community after publication. They include citations, usage statistics, discussions in online comments and social media, social bookmarking, and recommendations. In this essay, we describe why article-level metrics are an important extension of traditional citation-based journal metrics and provide a number of example from ALM data collected for PLOS Biology.
| S-EPMC3805468 | biostudies-literature
Project description:The presence of web-based communities is a distinctive signature of Web 2.0. The web-based feature means that information propagation within each community is highly facilitated, promoting complex collective dynamics in view of information exchange. In this work, we focus on a community of scientists and study, in particular, how the awareness of a scientific paper is spread. Our work is based on the web usage statistics obtained from the PLoS Article Level Metrics dataset compiled by PLoS. The cumulative number of HTML views was found to follow a long tail distribution which is reasonably well-fitted by a lognormal one. We modeled the diffusion of information by a random multiplicative process, and thus extracted the rates of information spread at different stages after the publication of a paper. We found that the spread of information displays two distinct decay regimes: a rapid downfall in the first month after publication, and a gradual power law decay afterwards. We identified these two regimes with two distinct driving processes: a short-term behavior driven by the fame of a paper, and a long-term behavior consistent with citation statistics. The patterns of information spread were found to be remarkably similar in data from different journals, but there are intrinsic differences for different types of web usage (HTML views and PDF downloads versus XML). These similarities and differences shed light on the theoretical understanding of different complex systems, as well as a better design of the corresponding web applications that is of high potential marketing impact.
| S-EPMC3095621 | biostudies-literature
Project description:ObjectivesTo determine if the origin of article published in Gynecologic Oncology ("Journal") is correlated with quality of the article when measured per US institution and per country, using an index of citation (IOC) metric as a stand-in for article quality.MethodsPubMed was used to query the Journal from 2005 to 2020. Articles not deemed original research were excluded. A US-only cohort ("US-Only") was evaluated separately from the entire cohort ("Whole"). The IOC for each article was calculated by dividing the number of citations listed in PubMed by the days from the publication date to 9/1/2021. The IOC per US institution was summarized by the median value. All articles were hand reviewed for correctness. The Whole cohort included all countries with 3 or more publications (including all of the US-Only cohort) and underwent similar analysis. Correlation coefficients were estimated using Pearson's correlation after log-transformation.ResultsIn the US-only cohort, 2733 articles from 276 institutions within the US contributed original articles to the Journal. The association between the number of publications per institution and the median IOC was not well correlated (Pearson's Correlation coeffeicient r = 0.16, p = 0.009). In the Whole cohort, 5,848 original research articles were published from 40 countries. There was no difference between median IOC for articles from US compared to non-US institutions was (0.0026 vs 0.0027, p = 0.287). The US median IOC was ranked 17/40. The US accounted for just over half (51.2%) of publications, and there was a trend of decreasing Non-US publications over time (p = 0.0004).ConclusionsThe Journal was fairly consistent in the quality of articles published over the 15-year study period when using the IOC as a surrogate for quality, regardless of the article's country or US institution of origin.
| S-EPMC8933665 | biostudies-literature
Project description:SummaryBisulfite sequencing data provide value beyond the straightforward methylation assessment by analyzing single-read patterns. Over the past years, various metrics have been established to explore this layer of information. However, limited compatibility with alignment tools, reference genomes or the measurements they provide present a bottleneck for most groups to routinely perform read-level analysis. To address this, we developed RLM, a fast and scalable tool for the computation of several frequently used read-level methylation statistics. RLM supports standard alignment tools, works independently of the reference genome and handles most sequencing experiment designs. RLM can process large input files with a billion reads in just a few hours on common workstations.Availability and implementationhttps://github.com/sarahet/RLM.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC8686677 | biostudies-literature
Project description:Given the vast scale of the modern scientific enterprise, it can be difficult for scientists to make judgments about the work of others through careful analysis of the entirety of the relevant literature. This has led to a reliance on metrics that are mathematically flawed and insufficiently diverse to account for the variety of ways in which investigators contribute to scientific progress. An urgent, critical first step in solving this problem is replacing the Journal Impact Factor with an article-level alternative. The Relative Citation Ratio (RCR), a metric that was designed to serve in that capacity, measures the influence of each publication on its respective area of research. RCR can serve as one component of a multifaceted metric that provides an effective data-driven supplement to expert opinion. Developing validated methods that quantify scientific progress can help to optimize the management of research investments and accelerate the acquisition of knowledge that improves human health.
| S-EPMC5449139 | biostudies-other
Project description:Background and purposeAlong with cortical abnormalities, white matter microstructural changes such as axonal loss and myelin breakdown are implicated in the pathogenesis of Alzheimer disease. Recently, a white matter model was introduced that relates non-Gaussian diffusional kurtosis imaging metrics to characteristics of white matter tract integrity, including the axonal water fraction, the intra-axonal diffusivity, and the extra-axonal axial and radial diffusivities.Materials and methodsThis study reports these white matter tract integrity metrics in subjects with amnestic mild cognitive impairment (n = 12), Alzheimer disease (n = 14), and age-matched healthy controls (n = 15) in an effort to investigate their sensitivity, diagnostic accuracy, and associations with white matter changes through the course of Alzheimer disease.ResultsWith tract-based spatial statistics and region-of-interest analyses, increased diffusivity in the extra-axonal space (extra-axonal axial and radial diffusivities) in several white matter tracts sensitively and accurately discriminated healthy controls from those with amnestic mild cognitive impairment (area under the receiver operating characteristic curve = 0.82-0.95), while widespread decreased axonal water fraction discriminated amnestic mild cognitive impairment from Alzheimer disease (area under the receiver operating characteristic curve = 0.84). Additionally, these white matter tract integrity metrics in the body of the corpus callosum were strongly correlated with processing speed in amnestic mild cognitive impairment (r = |0.80-0.82|, P < .001).ConclusionsThese findings have implications for the course and spatial progression of white matter degeneration in Alzheimer disease, suggest the mechanisms by which these changes occur, and demonstrate the viability of these white matter tract integrity metrics as potential neuroimaging biomarkers of the earliest stages of Alzheimer disease and disease progression.
| S-EPMC3962262 | biostudies-literature
Project description:The ability to categorize information is essential to everyday tasks such as identifying the cause of an event given a set of likely explanations or pinpointing the correct from a set of possible diagnoses by sequentially probing questions. In three studies, we investigated how the level of inclusiveness at which objects are presented (basic-level vs. subordinate-level) influences children's (7- and 10-year-olds) and adults' performance in a sequential binary categorization task. Study 1 found a robust facilitating effect of basic-level objects on the ability to ask effective questions in a computerized version of the Twenty Questions game. Study 2 suggested that this facilitating effect might be due to the kinds of object-differentiating features participants generate when provided with basic-level as compared to subordinate-level objects. Study 3 ruled out the alternative hypothesis that basic-level objects facilitate the selection of the most efficient among a given set of features.
| S-EPMC4498020 | biostudies-literature
Project description:Estimates of changes in the frequency or height of contemporary extreme sea levels (ESLs) under various climate change scenarios are often used by climate and sea level scientists to help communicate the physical basis for societal concern regarding sea level rise. Changes in ESLs (i.e., the hazard) are often represented using various metrics and indicators that, when anchored to salient impacts on human systems and the natural environment, provide useful information to policy makers, stakeholders, and the general public. While changes in hazards are often anchored to impacts at local scales, aggregate global summary metrics generally lack the context of local exposure and vulnerability that facilitates translating hazards into impacts. Contextualizing changes in hazards is also needed when communicating the timing of when projected ESL frequencies cross critical thresholds, such as the year in which ESLs higher than the design height benchmark of protective infrastructure (e.g., the 100-year water level) are expected to occur within the lifetime of that infrastructure. We present specific examples demonstrating the need for such contextualization using a simple flood exposure model, local sea level rise projections, and population exposure estimates for 414 global cities. We suggest regional and global climate assessment reports integrate global, regional, and local perspectives on coastal risk to address hazard, vulnerability and exposure simultaneously.Supplementary informationThe online version contains supplementary material available at 10.1007/s10584-021-03288-6.
| S-EPMC8847277 | biostudies-literature
Project description: Not available
| S-EPMC5624567 | biostudies-literature
Project description:Pollination syndromes and their predictive power regarding actual plant-animal interactions have been controversially discussed in the past. We investigate pollination syndromes in Balsaminaceae, utilizing quantitative respectively categorical data sets of flower morphometry, signal and reward traits for 86 species to test for the effect of different types of data on the test patterns retrieved. Cluster Analyses of the floral traits are used in combination with independent pollinator observations. Based on quantitative data we retrieve seven clusters, six of them corresponding to plausible pollination syndromes and one additional, well-supported cluster comprising highly divergent floral architectures. This latter cluster represents a non-syndrome of flowers not segregated by the specific data set here used. Conversely, using categorical data we obtained only a rudimentary resolution of pollination syndromes, in line with several earlier studies. The results underscore that the use of functional, exactly quanitified trait data has the power to retrieve pollination syndromes circumscribed by the specific data used. Data quality can, however, not be replaced by sheer data volume. With this caveat, it is possible to identify pollination syndromes from large datasets and to reliably extrapolate them for taxa for which direct observations are unavailable.
| S-EPMC5642891 | biostudies-literature