Dataset Information

Associative Learning of New Word Forms in a First Language (L1) and Haptic Referents in a Single-Day Experiment

ABSTRACT: This study focused on the associative learning of new word forms in the first language and haptic stimuli. In this study, healthy Japanese participants performed three-step tasks. First, participants made nine subjective evaluations of haptic stimuli using five-point semantic differential scales (e.g., regarding stickiness, scored from 1 (not sticky) to 5 (sticky)). Second, the participants carried out learning and recognition tasks for associative pairs of new (meaningless) word forms in their first language (Japanese) and haptic stimulus (H condition), and performed learning and recognition tasks for new (meaningless) word forms only (W condition). The order of conditions was counterbalanced among participants. Third, participants performed free recall tasks. The results of the recognition tasks showed that the proportions and response times of the W condition were better and faster, respectively, than those of the H condition. Furthermore, preference of haptic features negatively correlated with free recall scores of the H condition; however, there was no significant difference between the free recall scores of the H and W conditions. Our results suggest that new word forms were learned better than associative pairs of new word forms and haptic stimuli in a single day of learning. Furthermore, the free recall performance of word forms associated with haptic features could also be affected by their subjective evaluation (preference).

SUBMITTER: Yang Y

PROVIDER: S-EPMC8314365 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:The advent of humanoid robots has enabled a new approach to investigating the acquisition of language, and we report on the development of robots able to acquire rudimentary linguistic skills. Our work focuses on early stages analogous to some characteristics of a human child of about 6 to 14 months, the transition from babbling to first word forms. We investigate one mechanism among many that may contribute to this process, a key factor being the sensitivity of learners to the statistical distribution of linguistic elements. As well as being necessary for learning word meanings, the acquisition of anchor word forms facilitates the segmentation of an acoustic stream through other mechanisms. In our experiments some salient one-syllable word forms are learnt by a humanoid robot in real-time interactions with naive participants. Words emerge from random syllabic babble through a learning process based on a dialogue between the robot and the human participant, whose speech is perceived by the robot as a stream of phonemes. Numerous ways of representing the speech as syllabic segments are possible. Furthermore, the pronunciation of many words in spontaneous speech is variable. However, in line with research elsewhere, we observe that salient content words are more likely than function words to have consistent canonical representations; thus their relative frequency increases, as does their influence on the learner. Variable pronunciation may contribute to early word form acquisition. The importance of contingent interaction in real-time between teacher and learner is reflected by a reinforcement process, with variable success. The examination of individual cases may be more informative than group results. Nevertheless, word forms are usually produced by the robot after a few minutes of dialogue, employing a simple, real-time, frequency dependent mechanism. This work shows the potential of human-robot interaction systems in studies of the dynamics of early language acquisition.

Project description:Spoken word recognition involves a perceptual tradeoff between the reliance on the incoming acoustic signal and knowledge about likely sound categories and their co-occurrences as words. This study examined how adult second language (L2) learners navigate between acoustic-based and knowledge-based spoken word recognition when listening to highly variable, multi-talker truncated speech, and whether this perceptual tradeoff changes as L2 listeners gradually become more proficient in their L2 after multiple months of structured classroom learning. First language (L1) Mandarin Chinese listeners and L1 English-L2 Mandarin adult listeners took part in a gating experiment. The L2 listeners were tested twice - once at the start of their intermediate/advanced L2 language class and again 2 months later. L1 listeners were only tested once. Participants were asked to identify syllable-tone words that varied in syllable token frequency (high/low according to a spoken word corpus) and syllable-conditioned tonal probability (most probable/least probable in speech given the syllable). The stimuli were recorded by 16 different talkers and presented at eight gates ranging from onset-only (gate 1) through onset +40 ms increments (gates 2 through 7) to the full word (gate 8). Mixed-effects regression modeling was used to compare performance to our previous study which used single-talker stimuli (Wiener et al., 2019). The results indicated that multi-talker speech caused both L1 and L2 listeners to rely greater on knowledge-based processing of tone. L1 listeners were able to draw on distributional knowledge of syllable-tone probabilities in early gates and switch to predominantly acoustic-based processing when more of the signal was available. In contrast, L2 listeners, with their limited experience with talker range normalization, were less able to effectively transition from probability-based to acoustic-based processing. Moreover, for the L2 listeners, the reliance on such distributional information for spoken word recognition appeared to be conditioned by the nature of the acoustic signal. Single-talker speech did not result in the same pattern of probability-based tone processing, suggesting that knowledge-based processing of L2 speech may only occur under certain acoustic conditions, such as multi-talker speech.

Dataset Information

Associative Learning of New Word Forms in a First Language (L1) and Haptic Referents in a Single-Day Experiment

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets