Dataset Information

Pupillometry shows the effort of auditory attention switching.

ABSTRACT: Successful speech communication often requires selective attention to a target stream amidst competing sounds, as well as the ability to switch attention among multiple interlocutors. However, auditory attention switching negatively affects both target detection accuracy and reaction time, suggesting that attention switches carry a cognitive cost. Pupillometry is one method of assessing mental effort or cognitive load. Two experiments were conducted to determine whether the effort associated with attention switches is detectable in the pupillary response. In both experiments, pupil dilation, target detection sensitivity, and reaction time were measured; the task required listeners to either maintain or switch attention between two concurrent speech streams. Secondary manipulations explored whether switch-related effort would increase when auditory streaming was harder. In experiment 1, spatially distinct stimuli were degraded by simulating reverberation (compromising across-time streaming cues), and target-masker talker gender match was also varied. In experiment 2, diotic streams separable by talker voice quality and pitch were degraded by noise vocoding, and the time alloted for mid-trial attention switching was varied. All trial manipulations had some effect on target detection sensitivity and/or reaction time; however, only the attention-switching manipulation affected the pupillary response: greater dilation was observed in trials requiring switching attention between talkers.

SUBMITTER: McCloy DR

PROVIDER: S-EPMC5848839 | biostudies-other | 2017 Apr

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Pupillometry shows the effort of auditory attention switching.

McCloy Daniel R DR Lau Bonnie K BK Larson Eric E Pratt Katherine A I KAI Lee Adrian K C AKC

The Journal of the Acoustical Society of America 20170401 4

Successful speech communication often requires selective attention to a target stream amidst competing sounds, as well as the ability to switch attention among multiple interlocutors. However, auditory attention switching negatively affects both target detection accuracy and reaction time, suggesting that attention switches carry a cognitive cost. Pupillometry is one method of assessing mental effort or cognitive load. Two experiments were conducted to determine whether the effort associated wit ...[more]

PMID: 28464660

Similar Datasets

Project description:In multistability, a constant stimulus induces alternating perceptual interpretations. For many forms of visual multistability, the transition from one interpretation to another ("perceptual switch") is accompanied by a dilation of the pupil. Here we ask whether the same holds for auditory multistability, specifically auditory streaming. Two tones were played in alternation, yielding four distinct interpretations: the tones can be perceived as one integrated percept (single sound source), or as segregated with either tone or both tones in the foreground. We found that the pupil dilates significantly around the time a perceptual switch is reported ("multistable condition"). When participants instead responded to actual stimulus changes that closely mimicked the multistable perceptual experience ("replay condition"), the pupil dilated more around such responses than in multistability. This still held when data were corrected for the pupil response to the stimulus change as such. Hence, active responses to an exogeneous stimulus change trigger a stronger or temporally more confined pupil dilation than responses to an endogenous perceptual switch. In another condition, participants randomly pressed the buttons used for reporting multistability. In Study 1, this "random condition" failed to sufficiently mimic the temporal pattern of multistability. By adapting the instructions, in Study 2 we obtained a response pattern more similar to the multistable condition. In this case, the pupil dilated significantly around the random button presses. Albeit numerically smaller, this pupil response was not significantly different from the multistable condition. While there are several possible explanations-related, e.g., to the decision to respond-this underlines the difficulty to isolate a purely perceptual effect in multistability. Our data extend previous findings from visual to auditory multistability. They highlight methodological challenges in interpreting such data and suggest possible approaches to meet them, including a novel stimulus to simulate the experience of perceptual switches in auditory streaming.

Project description:Purpose Pupillary responses captured via pupillometry (measurement of pupillary dilation and constriction during the performance of a cognitive task) are psychophysiological indicators of cognitive effort, attention, arousal, and resource engagement. Pupillometry may be a promising tool for enhancing our understanding of the relationship between cognition and language in people with and without aphasia. Interpretation of pupillary responses is complex. This study was designed as a stepping-stone for future pupillometric studies involving people with aphasia. Asking comprehension questions is common in language processing research involving people with and without aphasia. However, the influence of comprehension questions on pupillometric indices of task engagement (tonic responses) and cognitive effort (task-evoked responses of the pupil [TERPs]) is unknown. We tested whether asking comprehension questions influenced pupillometric results of adults without aphasia during a syntactic processing task. Method Forty adults without aphasia listened to easy (canonical) and difficult (noncanonical) sentences in two conditions: one that contained an explicit comprehension task (question condition) and one that did not (no-question condition). The influence of condition and canonicity on pupillary responses was examined. Results The influence of canonicity was only significant in the question condition: TERPs for difficult sentences were larger than TERPs for easy sentences. Tonic responses did not differ between conditions. Conclusions Although participants had similar levels of attentiveness in both conditions, increases in indices of cognitive effort during syntactic processing were significant only when participants expected comprehension questions. Results contribute to a body of evidence indicating the importance of task design and careful linguistic stimulus control when using pupillometry to study language processing. Supplemental Material https://doi.org/10.23641/asha.13480368.

Project description:Current evidence demonstrates that even though some non-native listeners can achieve native-like performance for speech perception tasks in quiet, the presence of a background noise is much more detrimental to speech intelligibility for non-native compared to native listeners. Even when performance is equated across groups, it is likely that greater listening effort is required for non-native listeners. Importantly, the added listening effort might result in increased fatigue and a reduced ability to successfully perform multiple tasks simultaneously. Task-evoked pupil responses have been demonstrated to be a reliable measure of cognitive effort and can be useful in clarifying those aspects. In this study we compared the pupil response for 23 native English speakers and 27 Italian speakers of English as a second language. Speech intelligibility was tested for sentences presented in quiet and in background noise at two performance levels that were matched across groups. Signal-to-noise levels corresponding to these sentence intelligibility levels were pre-determined using an adaptive intelligibility task. Pupil response was significantly greater in non-native compared to native participants across both intelligibility levels. Therefore, for a given intelligibility level, a greater listening effort is required when listening in a second language in order to understand speech in noise. Results also confirmed that pupil response is sensitive to speech intelligibility during language comprehension, in line with previous research. However, contrary to our predictions, pupil response was not differentially modulated by intelligibility levels for native and non-native listeners. The present study corroborates that pupillometry can be deemed as a valid measure to be used in speech perception investigation, because it is sensitive to differences both across participants, such as listener type, and across conditions, such as variations in the level of speech intelligibility. Importantly, pupillometry offers us the possibility to uncover differences in listening effort even when those do not emerge in the performance level of individuals.

Dataset Information

Pupillometry shows the effort of auditory attention switching.

Publications

Pupillometry shows the effort of auditory attention switching.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets