The role of cochlear place coding in the perception of frequency modulation.
Ontology highlight
ABSTRACT:
SUBMITTER: Whiteford KL
PROVIDER: S-EPMC7556860 | biostudies-literature | 2020 Sep
REPOSITORIES: biostudies-literature
Publications
The role of cochlear place coding in the perception of frequency modulation.
Whiteford Kelly L KL Kreft Heather A HA Oxenham Andrew J AJ
eLife 20200930
Natural sounds convey information via frequency and amplitude modulations (FM and AM). Humans are acutely sensitive to the slow rates of FM that are crucial for speech and music. This sensitivity has long been thought to rely on precise stimulus-driven auditory-nerve spike timing (time code), whereas a coarser code, based on variations in the cochlear place of stimulation (place code), represents faster FM rates. We tested this theory in listeners with normal and impaired hearing, spanning a wid ...[more]
Similar Datasets
Project description:ObjectivesThe spatial position of a cochlear implant (CI) electrode array affects the spectral cues provided to the recipient. Differences in cochlear size and array length lead to substantial variability in angular insertion depth (AID) across and within array types. For CI-alone users, the variability in AID results in varying degrees of frequency-to-place mismatch between the default electric frequency filters and cochlear place of stimulation. For electric-acoustic stimulation (EAS) users, default electric frequency filters also vary as a function of residual acoustic hearing in the implanted ear. The present study aimed to (1) investigate variability in AID associated with lateral wall arrays, (2) determine the subsequent frequency-to-place mismatch for CI-alone and EAS users mapped with default frequency filters, and (3) examine the relationship between early speech perception for CI-alone users and two aspects of electrode position: frequency-to-place mismatch and angular separation between neighboring contacts, a metric associated with spectral selectivity at the periphery.DesignOne hundred one adult CI recipients (111 ears) with MED-EL Flex24 (24 mm), Flex28 (28 mm), and FlexSOFT/Standard (31.5 mm) arrays underwent postoperative computed tomography to determine AID. A subsequent comparison was made between AID, predicted spiral ganglion place frequencies, and the default frequency filters for CI-alone (n = 84) and EAS users (n = 27). For CI-alone users with complete insertions who listened with maps fit with the default frequency filters (n = 48), frequency-to-place mismatch was quantified at 1500 Hz and angular separation between neighboring contacts was determined for electrodes in the 1 to 2 kHz region. Multiple linear regression was used to examine how frequency-to-place mismatch and angular separation of contacts influence consonant-nucleus-consonant (CNC) scores through 6 months postactivation.ResultsFor CI recipients with complete insertions (n = 106, 95.5%), the AID (mean ± standard deviation) of the most apical contact was 428° ± 34.3° for Flex24 (n = 11), 558° ± 65.4° for Flex28 (n = 48), and 636° ± 42.9° for FlexSOFT/Standard (n = 47) arrays. For CI-alone users, default frequency filters aligned closely with the spiral ganglion map for deeply inserted lateral wall arrays. For EAS users, default frequency filters produced a range of mismatches; absolute deviations of ≤ 6 semitones occurred in only 37% of cases. Participants with shallow insertions and minimal or no residual hearing experienced the greatest mismatch. For CI-alone users, both smaller frequency-to-place mismatch and greater angular separation between contacts were associated with better CNC scores during the initial 6 months of device use.ConclusionsThere is significant variability in frequency-to-place mismatch among CI-alone and EAS users with default frequency filters, even between individuals implanted with the same array. When using default frequency filters, mismatch can be minimized with longer lateral wall arrays and insertion depths that meet the edge frequency associated with residual hearing for CI-alone and EAS users, respectively. Smaller degrees of frequency-to-place mismatch and decreased peripheral masking due to more widely spaced contacts may independently support better speech perception with longer lateral wall arrays in CI-alone users.
| S-EPMC8407755 | biostudies-literature
Project description:Cochlear filtering results in earlier responses to high than to low frequencies. This study examined potential perceptual correlates of cochlear delays by measuring the perception of relative timing between tones of different frequencies. A brief 250-Hz tone was combined with a brief 1-, 2-, 4-, or 6-kHz tone. Two experiments were performed, one involving subjective judgments of perceived synchrony, the other involving asynchrony detection and discrimination. The functions relating the proportion of "synchronous" responses to the delay between the tones were similar for all tone pairs. Perceived synchrony was maximal when the tones in a pair were gated synchronously. The perceived-synchrony function slopes were asymmetric, being steeper on the low-frequency-leading side. In the second experiment, asynchrony-detection thresholds were lower for low-frequency rather than for high-frequency leading pairs. In contrast with previous studies, but consistent with the first experiment, thresholds did not depend on frequency separation between the tones, perhaps because of the elimination of within-channel cues. The results of the two experiments were related quantitatively using a decision-theoretic model, and were found to be highly correlated. Overall the results suggest that frequency-dependent cochlear group delays are compensated for at higher processing stages, resulting in veridical perception of timing relationships across frequency.
| S-EPMC3272712 | biostudies-other
Project description:Spectrotemporal modulation (STM) detection performance was examined for cochlear implant (CI) users. The test involved discriminating between an unmodulated steady noise and a modulated stimulus. The modulated stimulus presents frequency modulation patterns that change in frequency over time. In order to examine STM detection performance for different modulation conditions, two different temporal modulation rates (5 and 10 Hz) and three different spectral modulation densities (0.5, 1.0, and 2.0 cycles/octave) were employed, producing a total 6 different STM stimulus conditions. In order to explore how electric hearing constrains STM sensitivity for CI users differently from acoustic hearing, normal-hearing (NH) and hearing-impaired (HI) listeners were also tested on the same tasks. STM detection performance was best in NH subjects, followed by HI subjects. On average, CI subjects showed poorest performance, but some CI subjects showed high levels of STM detection performance that was comparable to acoustic hearing. Significant correlations were found between STM detection performance and speech identification performance in quiet and in noise. In order to understand the relative contribution of spectral and temporal modulation cues to speech perception abilities for CI users, spectral and temporal modulation detection was performed separately and related to STM detection and speech perception performance. The results suggest that that slow spectral modulation rather than slow temporal modulation may be important for determining speech perception capabilities for CI users. Lastly, test-retest reliability for STM detection was good with no learning. The present study demonstrates that STM detection may be a useful tool to evaluate the ability of CI sound processing strategies to deliver clinically pertinent acoustic modulation information.
| S-EPMC4617902 | biostudies-literature
Project description:Unlike vision, the mechanisms underlying auditory motion perception are poorly understood. Here we describe an auditory motion illusion revealing a novel cue to auditory speed perception: the temporal frequency of amplitude modulation (AM-frequency), typical for rattling sounds. Naturally, corrugated objects sliding across each other generate rattling sounds whose AM-frequency tends to directly correlate with speed. We found that AM-frequency modulates auditory speed perception in a highly systematic fashion: moving sounds with higher AM-frequency are perceived as moving faster than sounds with lower AM-frequency. Even more interestingly, sounds with higher AM-frequency also induce stronger motion aftereffects. This reveals the existence of specialized neural mechanisms for auditory motion perception, which are sensitive to AM-frequency. Thus, in spatial hearing, the brain successfully capitalizes on the AM-frequency of rattling sounds to estimate the speed of moving objects. This tightly parallels previous findings in motion vision, where spatio-temporal frequency of moving displays systematically affects both speed perception and the magnitude of the motion aftereffects. Such an analogy with vision suggests that motion detection may rely on canonical computations, with similar neural mechanisms shared across the different modalities.
| S-EPMC5524496 | biostudies-literature
Project description:The goals of the present study were to measure acoustic temporal modulation transfer functions (TMTFs) in cochlear implant listeners and examine the relationship between modulation detection and speech recognition abilities. The effects of automatic gain control, presentation level and number of channels on modulation detection thresholds (MDTs) were examined using the listeners' clinical sound processor. The general form of the TMTF was low-pass, consistent with previous studies. The operation of automatic gain control had no effect on MDTs when the stimuli were presented at 65 dBA. MDTs were not dependent on the presentation levels (ranging from 50 to 75 dBA) nor on the number of channels. Significant correlations were found between MDTs and speech recognition scores. The rates of decay of the TMTFs were predictive of speech recognition abilities. Spectral-ripple discrimination was evaluated to examine the relationship between temporal and spectral envelope sensitivities. No correlations were found between the two measures, and 56% of the variance in speech recognition was predicted jointly by the two tasks. The present study suggests that temporal modulation detection measured with the sound processor can serve as a useful measure of the ability of clinical sound processing strategies to deliver clinically pertinent temporal information.
| S-EPMC3155593 | biostudies-other
Project description:RationalePrevious cochlear implant (CI) studies have shown that single-channel amplitude modulation frequency discrimination (AMFD) can be improved when coherent modulation is delivered to additional channels. It is unclear whether the multi-channel advantage is due to increased loudness, multiple envelope representations, or to component channels with better temporal processing. Measuring envelope interference may shed light on how modulated channels can be combined.MethodsIn this study, multi-channel AMFD was measured in CI subjects using a 3-alternative forced-choice, non-adaptive procedure ("which interval is different?"). For the reference stimulus, the reference AM (100 Hz) was delivered to all 3 channels. For the probe stimulus, the target AM (101, 102, 104, 108, 116, 132, 164, 228, or 256 Hz) was delivered to 1 of 3 channels, and the reference AM (100 Hz) delivered to the other 2 channels. The spacing between electrodes was varied to be wide or narrow to test different degrees of channel interaction.ResultsResults showed that CI subjects were highly sensitive to interactions between the reference and target envelopes. However, performance was non-monotonic as a function of target AM frequency. For the wide spacing, there was significantly less envelope interaction when the target AM was delivered to the basal channel. For the narrow spacing, there was no effect of target AM channel. The present data were also compared to a related previous study in which the target AM was delivered to a single channel or to all 3 channels. AMFD was much better with multiple than with single channels whether the target AM was delivered to 1 of 3 or to all 3 channels. For very small differences between the reference and target AM frequencies (2-4 Hz), there was often greater sensitivity when the target AM was delivered to 1 of 3 channels versus all 3 channels, especially for narrowly spaced electrodes.ConclusionsBesides the increased loudness, the present results also suggest that multiple envelope representations may contribute to the multi-channel advantage observed in previous AMFD studies. The different patterns of results for the wide and narrow spacing suggest a peripheral contribution to multi-channel temporal processing. Because the effect of target AM frequency was non-monotonic in this study, adaptive procedures may not be suitable to measure AMFD thresholds with interfering envelopes. Envelope interactions among multiple channels may be quite complex, depending on the envelope information presented to each channel and the relative independence of the stimulated channels.
| S-EPMC4592255 | biostudies-literature
Project description:ObjectiveOur aim was to determine the effect of acute changes in cochlear place of stimulation on cochlear implant (CI) sound quality.DesignIn Experiment 1, 5 single-sided deaf (SSD) listeners fitted with a long (28-mm) electrode array were tested. Basal shifts in place of stimulation were implemented by turning off the most apical electrodes and reassigning the filters to more basal electrodes. In Experiment 2, 2 SSD patients fitted with a shorter (16.5-mm) electrode array were tested. Both basal and apical shifts in place of stimulation were implemented. The apical shifts were accomplished by current steering and creating a virtual place of stimulation more apical that that of the most apical electrode.ResultsListeners matched basal shifts by shifting, in the normal-hearing ear, the overall spectrum up in frequency and/or increasing voice pitch (F0). Listeners matched apical shifts by shifting down the overall frequency spectrum in the normal-hearing ear.ConclusionOne factor determining CI voice quality is the location of stimulation along the cochlear partition.
| S-EPMC8091953 | biostudies-literature
Project description:ImportanceCochlear implant users generally display poor pitch perception. Flat-panel computed tomography (FPCT) has recently emerged as a modality capable of localizing individual electrode contacts within the cochlea in vivo. Significant place-pitch mismatch between the clinical implant processing settings given to patients and the theoretical maps based on FPCT imaging has previously been noted.ObjectiveTo assess whether place-pitch mismatch is associated with poor cochlear implant-mediated pitch perception through evaluation of an individualized, image-guided approach toward cochlear implant programming on speech and music perception among cochlear implant users.Design, setting, and participantsA prospective cohort study of 17 cochlear implant users with MED-EL electrode arrays was performed at a tertiary referral center. The study was conducted from June 2016 to July 2017.InterventionsTheoretical place-pitch maps using FPCT secondary reconstructions and 3-dimensional curved planar re-formation software were developed. The clinical map settings (eg, strategy, rate, volume, frequency band range) were modified to keep factors constant between the 2 maps and minimize confounding. The acclimation period to the maps was 30 minutes.Main outcomes and measuresParticipants performed speech perception tasks (eg, consonant-nucleus-consonant, Bamford-Kowal-Bench Speech-in-Noise, vowel identification) and a pitch-scaling task while using the image-guided place-pitch map (intervention) and the modified clinical map (control). Performance scores between the 2 interventions were measured.ResultsOf the 17 participants, 10 (58.8%) were women; mean (SD) was 59 (11.3) years. A significant median increase in pitch scaling accuracy was noted when using the experimental map compared with the control map (4 more correct answers; 95% CI, 0-8). Specifically, the number of pitch-scaling reversals for notes spaced at 1.65 semitones or greater decreased when an image-based approach to cochlear implant programming was used vs the modified clinical map (4 mistakes; 95% CI, 0.5-7). Although there was no observable median improvement in speech perception during use of an image-based map, the acute changes in frequency allocation and electrode channel deactivations used with the image-guided maps did not worsen consonant-nucleus-consonant (-1% correct phonemes, 95% CI, -2.5% to 6%) and Bamford-Kowal-Bench Speech-in-Noise (0.5-dB difference; 95% CI, -0.75 to 2.25 dB) median performance results relative to the clinical maps used by the patients.Conclusions and relevanceAn image-based approach toward ochlear implant mapping may improve pitch perception outcomes by reducing place-pitch mismatch. Studies using a longer acclimation period with chronic stimulation over months may help assess the full range of the benefits associated with personalized image-guided cochlear implant mapping.
| S-EPMC6440220 | biostudies-literature
Project description:Spatial frequency is a fundamental visual feature coded in primary visual cortex, relevant for perceiving textures, objects, hierarchical structures, and scenes, as well as for directing attention and eye movements. Temporal amplitude-modulation (AM) rate is a fundamental auditory feature coded in primary auditory cortex, relevant for perceiving auditory objects, scenes, and speech. Spatial frequency and temporal AM rate are thus fundamental building blocks of visual and auditory perception. Recent results suggest that crossmodal interactions are commonplace across the primary sensory cortices and that some of the underlying neural associations develop through consistent multisensory experience such as audio-visually perceiving speech, gender, and objects. We demonstrate that people consistently and absolutely (rather than relatively) match specific auditory AM rates to specific visual spatial frequencies. We further demonstrate that this crossmodal mapping allows amplitude-modulated sounds to guide attention to and modulate awareness of specific visual spatial frequencies. Additional results show that the crossmodal association is approximately linear, based on physical spatial frequency, and generalizes to tactile pulses, suggesting that the association develops through multisensory experience during manual exploration of surfaces.
| S-EPMC3298604 | biostudies-literature
Project description:The aim of this study was to relate the pitch of high-rate electrical stimulation delivered to individual cochlear implant electrodes to electrode insertion depth and insertion angle. The patient (CH1) was able to provide pitch matches between electric and acoustic stimulation because he had auditory thresholds in his nonimplanted ear ranging between 30 and 60 dB HL over the range, 250 Hz to 8 kHz. Electrode depth and insertion angle were measured from high-resolution computed tomography (CT) scans of the patient's temporal bones. The scans were used to create a 3D image volume reconstruction of the cochlea, which allowed visualization of electrode position within the scala. The method of limits was used to establish pitch matches between acoustic pure tones and electric stimulation (a 1,652-pps, unmodulated, pulse train). The pitch matching data demonstrated that, for insertion angles of greater than 450 degrees or greater than approximately 20 mm insertion depth, pitch saturated at approximately 420 Hz. From 20 to 15 mm insertion depth pitch estimates were about one-half octave lower than the Greenwood function. From 13 to 3 mm insertion depth the pitch estimates were approximately one octave lower than the Greenwood function. The pitch match for an electrode only 3.4 mm into the cochlea was 3,447 Hz. These data are consistent with other reports, e.g., Boëx et al. (2006), of a frequency-to-place map for the electrically stimulated cochlea in which perceived pitches for stimulation on individual electrodes are significantly lower than those predicted by the Greenwood function for stimulation at the level of the hair cell.
| S-EPMC2441831 | biostudies-other