Dataset Information

Semantic Pooling for Complex Event Analysis in Untrimmed Videos.

ABSTRACT: Pooling plays an important role in generating a discriminative video representation. In this paper, we propose a new semantic pooling approach for challenging event analysis tasks (e.g., event detection, recognition, and recounting) in long untrimmed Internet videos, especially when only a few shots/segments are relevant to the event of interest while many other shots are irrelevant or even misleading. The commonly adopted pooling strategies aggregate the shots indifferently in one way or another, resulting in a great loss of information. Instead, in this work we first define a novel notion of semantic saliency that assesses the relevance of each shot with the event of interest. We then prioritize the shots according to their saliency scores since shots that are semantically more salient are expected to contribute more to the final event analysis. Next, we propose a new isotonic regularizer that is able to exploit the constructed semantic ordering information. The resulting nearly-isotonic support vector machine classifier exhibits higher discriminative power in event analysis tasks. Computationally, we develop an efficient implementation using the proximal gradient algorithm, and we prove new and closed-form proximal steps. We conduct extensive experiments on three real-world video datasets and achieve promising improvements.

SUBMITTER: Xiaojun Chang

PROVIDER: S-EPMC5570670 | biostudies-literature | 2017 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Semantic Pooling for Complex Event Analysis in Untrimmed Videos.

Xiaojun Chang Yao-Liang Yu Yi Yang Xing Eric P EP

IEEE transactions on pattern analysis and machine intelligence 20160913 8

Pooling plays an important role in generating a discriminative video representation. In this paper, we propose a new semantic pooling approach for challenging event analysis tasks (e.g., event detection, recognition, and recounting) in long untrimmed Internet videos, especially when only a few shots/segments are relevant to the event of interest while many other shots are irrelevant or even misleading. The commonly adopted pooling strategies aggregate the shots indifferently in one way or anothe ...[more]

PMID: 28113653

Similar Datasets

Project description:Electroencephalography (EEG)-derived event-related potentials (ERPs) provide information about a variety of brain functions, but often suffer from low inherent signal-to-noise ratio (SNR). To overcome the low SNR, techniques that pool data from multiple sensors have been applied. However, such pooling implicitly assumes that the SNR among sensors is equal, which is not necessarily valid. This study presents a novel approach for signal pooling that accounts for differential SNR among sensors. The new technique involves pooling together signals from multiple EEG channels weighted by their respective SNRs relative to the overall SNR of all channels. We compared ERP responses derived using this new technique with those derived using both individual channels as well as traditional averaged-based channel pooling. The outcomes were evaluated in both simulated data and real data from healthy adult volunteers (n = 37). Responses corresponding to a range of ERP components indexing auditory sensation (N100), attention (P300) and language processing (N400) were evaluated. Simulation results demonstrate that, compared to traditional pooling technique, the new SNR-weighted channel pooling technique improved ERP response effect size in cases of unequal noise among channels (p's < 0.001). Similarly, results from real-world experimental data showed that the new technique resulted in significantly greater ERP effect sizes compared to either traditional pooling or individual channel approach for all three ERP components (p's < 0.001). Furthermore, the new channel pooling approach also resulted in larger ERP signal amplitudes as well as greater differences among experimental conditions (p's < 0.001). These results suggest that the new technique improves the capture of ERP responses relative to traditional techniques. As such, SNR-weighted channel pooling can further enable widespread applications of ERP techniques, especially those that require rapid assessments in noisy out-of-laboratory environments.

Project description:Memories compete for retrieval when they are related to a common retrieval cue. Previous research has shown that retrieval of a target memory may lead to subsequent retrieval-induced forgetting (RIF) of currently irrelevant competing memories. In the present study, we investigated the time course of competitive semantic retrieval and examined the neurocognitive mechanisms underlying RIF. We contrasted two theoretical accounts of RIF by examining a critical aspect of this memory phenomenon, namely the extent to which it depends on successful retrieval of the target memory. Participants first studied category-exemplar word-pairs (e.g. Fruit-Apple). Next, we recorded electrophysiological measures of brain activity while the participants performed a competitive semantic cued-recall task. In this task, the participants were provided with the studied categories but they were instructed to retrieve other unstudied exemplars (e.g. Fruit-Ma__?). We investigated the event-related potential (ERP) correlates of retrieval success by comparing ERPs from successful and failed retrieval trials. To isolate the ERP correlates of continuous retrieval attempts from the ERP correlates of retrieval success, we included an impossible retrieval condition, with incompletable word-stem cues (Drinks-Wy__) and compared it with a non-retrieval presentation baseline condition (Occupation-Dentist). The participants' memory for all the studied exemplars was tested in the final phase of the experiment. Taken together, the behavioural results suggest that RIF is independent of target retrieval. Beyond investigating the mechanisms underlying RIF, the present study also elucidates the temporal dynamics of semantic cued-recall by isolating the ERP correlates of retrieval attempt and retrieval success. The ERP results revealed that retrieval attempt is reflected in a late posterior negativity, possibly indicating construction of candidates for completing the word-stem cue and retrieval monitoring whereas retrieval success was reflected in an anterior positive slow wave.

Dataset Information

Semantic Pooling for Complex Event Analysis in Untrimmed Videos.

Publications

Semantic Pooling for Complex Event Analysis in Untrimmed Videos.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets