Dataset Information

Cross-evaluation of metrics to estimate the significance of creative works.

ABSTRACT: In a world overflowing with creative works, it is useful to be able to filter out the unimportant works so that the significant ones can be identified and thereby absorbed. An automated method could provide an objective approach for evaluating the significance of works on a universal scale. However, there have been few attempts at creating such a measure, and there are few "ground truths" for validating the effectiveness of potential metrics for significance. For movies, the US Library of Congress's National Film Registry (NFR) contains American films that are "culturally, historically, or aesthetically significant" as chosen through a careful evaluation and deliberation process. By analyzing a network of citations between 15,425 United States-produced films procured from the Internet Movie Database (IMDb), we obtain several automated metrics for significance. The best of these metrics is able to indicate a film's presence in the NFR at least as well or better than metrics based on aggregated expert opinions or large population surveys. Importantly, automated metrics can easily be applied to older films for which no other rating may be available. Our results may have implications for the evaluation of other creative works such as scientific research.

SUBMITTER: Wasserman M

PROVIDER: S-EPMC4321294 | biostudies-literature | 2015 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Cross-evaluation of metrics to estimate the significance of creative works.

Wasserman Max M Zeng Xiao Han T XH Amaral Luís A Nunes LA

Proceedings of the National Academy of Sciences of the United States of America 20150120 5

In a world overflowing with creative works, it is useful to be able to filter out the unimportant works so that the significant ones can be identified and thereby absorbed. An automated method could provide an objective approach for evaluating the significance of works on a universal scale. However, there have been few attempts at creating such a measure, and there are few "ground truths" for validating the effectiveness of potential metrics for significance. For movies, the US Library of Congre ...[more]

PMID: 25605881

Similar Datasets

Project description:Resting-state functional MRI (R-fMRI) research has recently entered the era of "big data", however, few studies have provided a rigorous validation of the physiological underpinnings of R-fMRI indices. Although studies have reported that various neuropsychiatric disorders exhibit abnormalities in R-fMRI measures, these "biomarkers" have not been validated in differentiating structural lesions (brain tumors) as a concept proof. We enrolled 60 patients with intracranial tumors located in the unilateral cranialcavity and 60 matched normal controls to test whether R-fMRI indices can differentiate tumors, which represents a prerequisite for adapting such indices as biomarkers for neuropsychiatric disorders. Common R-fMRI indices of tumors and their counterpart control regions, which were defined as the contralateral normal areas (for amplitude of low frequency fluctuations (ALFF), fractional ALFF (fALFF), regional homogeneity (ReHo) and degree centrality (DC)) and ipsilateral regions surrounding the tumors (for voxel-mirrored homotopic connectivity (VMHC)), were comprehensively assessed. According to robust paired t-tests with a Bonferroni correction, only VMHC (Fisher's r-to-z transformed) could successfully differentiate substantial tumors from their counterpart normal regions in patients. Furthermore, ALFF and DC were not able to differentiate tumor from normal unless Z-standardization was employed. To validate the lower power of the between-subject design compared to the within-subject design, each metric was calculated in a matched control group, and robust two-sample t-tests were used to compare the patient tumors and the normal controls at the same place. Similarly, only VMHC succeeded in differentiating significant differences between tumors and the sham tumor areas of normal controls. This study tested the premise of R-fMRI biomarkers for differentiating lesions, and brings a new understanding to physical significance of the Z-standardization.

Dataset Information

Cross-evaluation of metrics to estimate the significance of creative works.

Publications

Cross-evaluation of metrics to estimate the significance of creative works.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets