Dataset Information

Perceptual Restoration of Temporally Distorted Speech in L1 vs. L2: Local Time Reversal and Modulation Filtering.

ABSTRACT: Speech is intelligible even when the temporal envelope of speech is distorted. The current study investigates how native and non-native speakers perceptually restore temporally distorted speech. Participants were native English speakers (NS), and native Japanese speakers who spoke English as a second language (NNS). In Experiment 1, participants listened to "locally time-reversed speech" where every x-ms of speech signal was reversed on the temporal axis. Here, the local time reversal shifted the constituents of the speech signal forward or backward from the original position, and the amplitude envelope of speech was altered as a function of reversed segment length. In Experiment 2, participants listened to "modulation-filtered speech" where the modulation frequency components of speech were low-pass filtered at a particular cut-off frequency. Here, the temporal envelope of speech was altered as a function of cut-off frequency. The results suggest that speech becomes gradually unintelligible as the length of reversed segments increases (Experiment 1), and as a lower cut-off frequency is imposed (Experiment 2). Both experiments exhibit the equivalent level of speech intelligibility across six levels of degradation for native and non-native speakers respectively, which poses a question whether the regular occurrence of local time reversal can be discussed in the modulation frequency domain, by simply converting the length of reversed segments (ms) into frequency (Hz).

SUBMITTER: Ishida M

PROVIDER: S-EPMC6156149 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Perceptual Restoration of Temporally Distorted Speech in L1 vs. L2: Local Time Reversal and Modulation Filtering.

Ishida Mako M Arai Takayuki T Kashino Makio M

Frontiers in psychology 20180919

Speech is intelligible even when the temporal envelope of speech is distorted. The current study investigates how native and non-native speakers perceptually restore temporally distorted speech. Participants were native English speakers (NS), and native Japanese speakers who spoke English as a second language (NNS). In Experiment 1, participants listened to "locally time-reversed speech" where every x-ms of speech signal was reversed on the temporal axis. Here, the local time reversal shifted th ...[more]

PMID: 30283390

Similar Datasets

Project description:Multi-word expressions (MWEs) are fixed, conventional phrases often used by native speakers of a given language (L1). The type of MWEs investigated in this study were collocations. For bilinguals who have intensive contact with the second language (L2), collocational patterns can be transferred from the L2 to the L1 as a result of cross-linguistic influence (CLI). For example, bilingual migrants can accept collocations from their L2 translated to their L1 as correct. In this study, we asked whether such CLI is possible in native speakers living in the L1 environment and whether it depends on their L2 English proficiency. To this end, we created three lists of expressions in Polish: (1) well-formed Polish verb-noun collocations (e.g., ma sens - ∗has sense), (2) collocational calques from English (loan translations), where the English verb was replaced by a Polish translation equivalent (e.g., ∗ robi sens - makes sense), and, as a reference (3) absurd verb-noun expression, where the verb did not collocate with the noun (e.g., ∗ zjada sens - ∗eats sense). We embedded the three types of collocations in sentences and presented them to L1 Polish participants of varying L2 English proficiency in two experiments. We investigated whether L2 calques would (1) be explicitly judged as non-native in the L1; (2) whether they would evoke differential brain response than native L1 Polish equivalents in the event-related potentials (ERPs). We also explored whether the sensitivity to CLI in calques depended on participants' level of proficiency in L2 English. The results indicated that native speakers of Polish assessed the calques from English as less acceptable than the correct Polish collocations. Still, there was no difference in online processing of correct and calques collocations as measured by the ERPs. This suggests a dissociation between explicit offline judgments and indices of online language processing. Interestingly, English L2 proficiency did not modulate these effects. The results indicate that the influence of English on Polish is so pervasive that collocational calques from this language are likely to become accepted and used by Poles.

Project description:IntroductionWe examined which brain areas are involved in the comprehension of acoustically distorted speech using an experimental paradigm where the same distorted sentence can be perceived at different levels of intelligibility. This change in intelligibility occurs via a single intervening presentation of the intact version of the sentence, and the effect lasts at least on the order of minutes. Since the acoustic structure of the distorted stimulus is kept fixed and only intelligibility is varied, this allows one to study brain activity related to speech comprehension specifically.MethodsIn a functional magnetic resonance imaging (fMRI) experiment, a stimulus set contained a block of six distorted sentences. This was followed by the intact counterparts of the sentences, after which the sentences were presented in distorted form again. A total of 18 such sets were presented to 20 human subjects.ResultsThe blood oxygenation level dependent (BOLD)-responses elicited by the distorted sentences which came after the disambiguating, intact sentences were contrasted with the responses to the sentences presented before disambiguation. This revealed increased activity in the bilateral frontal pole, the dorsal anterior cingulate/paracingulate cortex, and the right frontal operculum. Decreased BOLD responses were observed in the posterior insula, Heschl's gyrus, and the posterior superior temporal sulcus.ConclusionsThe brain areas that showed BOLD-enhancement for increased sentence comprehension have been associated with executive functions and with the mapping of incoming sensory information to representations stored in episodic memory. Thus, the comprehension of acoustically distorted speech may be associated with the engagement of memory-related subsystems. Further, activity in the primary auditory cortex was modulated by prior experience, possibly in a predictive coding framework. Our results suggest that memory biases the perception of ambiguous sensory information toward interpretations that have the highest probability to be correct based on previous experience.

Dataset Information

Perceptual Restoration of Temporally Distorted Speech in L1 vs. L2: Local Time Reversal and Modulation Filtering.

Publications

Perceptual Restoration of Temporally Distorted Speech in L1 vs. L2: Local Time Reversal and Modulation Filtering.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets