Dataset Information

An annotated video dataset for computing video memorability.

ABSTRACT: Using a collection of publicly available links to short form video clips of an average of 6 seconds duration each, 1275 users manually annotated each video multiple times to indicate both long-term and short-term memorability of the videos. The annotations were gathered as part of an online memory game and measured a participant's ability to recall having seen the video previously when shown a collection of videos. The recognition tasks were performed on videos seen within the previous few minutes for short-term memorability and within the previous 24 to 72 hours for long-term memorability. Data includes the reaction times for each recognition of each video. Associated with each video are text descriptions (captions) as well as a collection of image-level features applied to 3 frames extracted from each video (start, middle and end). Video-level features are also provided. The dataset was used in the Video Memorability task as part of the MediaEval benchmark in 2020.

SUBMITTER: Kiziltepe RS

PROVIDER: S-EPMC8661480 | biostudies-literature | 2021 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An annotated video dataset for computing video memorability.

Kiziltepe Rukiye Savran RS Sweeney Lorin L Constantin Mihai Gabriel MG Doctor Faiyaz F García Seco de Herrera Alba A Demarty Claire-Héléne CH Healy Graham G Ionescu Bogdan B Smeaton Alan F AF

Data in brief 20211204

Using a collection of publicly available links to short form video clips of an average of 6 seconds duration each, 1275 users manually annotated each video multiple times to indicate both long-term and short-term memorability of the videos. The annotations were gathered as part of an online memory game and measured a participant's ability to recall having seen the video previously when shown a collection of videos. The recognition tasks were performed on videos seen within the previous few minut ...[more]

PMID: 34934785

Similar Datasets

Project description:Corals are colonial animals within the Phylum Cnidaria that form coral reefs, playing a significant role in marine environments by providing habitat for fish, mollusks, crustaceans, sponges, algae, and other organisms. Global climate changes are causing more intense and frequent thermal stress events, leading to corals losing their color due to the disruption of a symbiotic relationship with photosynthetic endosymbionts. Given the importance of corals to the marine environment, monitoring coral reefs is critical to understanding their response to anthropogenic impacts. Most coral monitoring activities involve underwater photographs, which can be costly to generate on large spatial scales and require processing and analysis that may be time-consuming. The Marine Ecology Laboratory (LECOM) at the Federal University of Rio Grande do Norte (UFRN) developed the project "#DeOlhoNosCorais" which encourages users to post photos of coral reefs on their social media (Instagram) using this hashtag, enabling people without previous scientific training to contribute to coral monitoring. The laboratory team identifies the species and gathers information on coral health along the Brazilian coast by analyzing each picture posted on social media. To optimize this process, we conducted baseline experiments for image classification and semantic segmentation. We analyzed the classification results of three different machine learning models using the Local Interpretable Model-agnostic Explanations (LIME) algorithm. The best results were achieved by combining EfficientNet for feature extraction and Logistic Regression for classification. Regarding semantic segmentation, the U-Net Pix2Pix model produced a pixel-level accuracy of 86%. Our results indicate that this tool can enhance image selection for coral monitoring purposes and open several perspectives for improving classification performance. Furthermore, our findings can be expanded by incorporating other datasets to create a tool that streamlines the time and cost associated with analyzing coral reef images across various regions.

Project description:The real-time detection of multinational banknotes remains an ongoing research challenge within the academic community. Numerous studies have been conducted to address the need for rapid and accurate banknote recognition, counterfeit detection, and identification of damaged banknotes [1], [2], [3]. State-of-the-art techniques, such as machine learning (ML) and deep learning (DL), have supplanted traditional digital image processing methods in banknote recognition and classification. However, the success of ML or DL projects critically hinges on the size and comprehensiveness of the datasets employed. Existing datasets suffer from several limitations. Firstly, there is a notable absence of a Peruvian banknote dataset suitable for training ML or DL models. Second, the lack of annotated data with specific labels and metadata for Peruvian currency hinders the development of effective supervised learning models for banknote recognition and classification. Lastly, datasets from different regions may not align with the unique characteristics, design, and security features of Peruvian banknotes, limiting the accuracy and applicability of models in a Peruvian context [4] To address these limitations, we have meticulously curated a comprehensive dataset comprising a total of 9,315 images of Peruvian banknotes, encompassing both old and new denominations from 2011 (old) and 2019 (new) [5]. The Peruvian banknote dataset includes denominations of 10, 20, 50, and 100 Peruvian soles. Importantly, as indicated by [5], both the 2011 and 2019 families of banknotes are currently in circulation, further enhancing the dataset's relevance for real-world applications in currency recognition and verification. This dataset serves as a vital resource for addressing the challenges in real-time multinational banknote detection. By offering a comprehensive collection of images of Peruvian banknotes, both old and new, this dataset fills a critical gap in the field of banknote recognition. Researchers can utilize it to train and evaluate advanced machine learning and deep learning models, ultimately enhancing the accuracy of banknote processing systems.

Dataset Information

An annotated video dataset for computing video memorability.

Publications

An annotated video dataset for computing video memorability.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets