Building a responsive teacher: how temporal contingency of gaze interaction influences word learning with virtual tutors.
Ontology highlight
ABSTRACT:
SUBMITTER: Lee H
PROVIDER: S-EPMC4448798 | biostudies-other | 2015 Jan
REPOSITORIES: biostudies-other
Publications
Building a responsive teacher: how temporal contingency of gaze interaction influences word learning with virtual tutors.
Lee Hanju H Kanakogi Yasuhiro Y Hiraki Kazuo K
Royal Society open science 20150114 1
Animated pedagogical agents are lifelike virtual characters designed to augment learning. A review of developmental psychology literature led to the hypothesis that the temporal contingency of such agents would promote human learning. We developed a Pedagogical Agent with Gaze Interaction (PAGI), an experimental animated pedagogical agent that engages in gaze interaction with students. In this study, university students learned words of a foreign language, with temporally contingent PAGI (live g ...[more]
Similar Datasets
Project description:It is easier to indicate the ink color of a color-neutral noun when it is presented in the color in which it has frequently been shown before, relative to print colors in which it has been shown less often. This phenomenon is known as color-word contingency learning. It remains unclear whether participants actually learn semantic (word-color) associations and/or response (word-button) associations. We present a novel variant of the paradigm that can disentangle semantic and response learning, because word-color and word-button associations are manipulated independently. In four experiments, each involving four daily sessions, pseudowords-such as enas, fatu or imot-were probabilistically associated with either a particular color, a particular response-button position, or both. Neutral trials without color-pseudoword association were also included, and participants' awareness of the contingencies was manipulated. The data showed no influence of explicit contingency awareness, but clear evidence both for response learning and for semantic learning, with effects emerging swiftly. Deeper processing of color information, with color words presented in black instead of color patches to indicate response-button positions, resulted in stronger effects, both for semantic and response learning. Our data add a crucial piece of evidence lacking so far in color-word contingency learning studies: Semantic learning effectively takes place even when associations are learned in an incidental way.
| S-EPMC6502354 | biostudies-literature
Project description:BackgroundMany children with autism spectrum disorders (ASD) struggle to understand familiar words and learn unfamiliar words. We explored the extent to which these problems reflect deficient use of probabilistic gaze in the extra-linguistic context.MethodThirty children with ASD and 43 with typical development (TD) participated in a spoken word recognition and mapping task. They viewed photographs of a woman behind three objects and simultaneously heard a word. For word recognition, the objects and words were familiar and the woman gazed ahead (neutral), toward the named object (facilitative), or toward an un-named object (contradictory). For word mapping, the objects and words were unfamiliar and only the neutral and facilitative conditions were employed. The children clicked on the named object, registering accuracy and reaction time.ResultsSpeed of word recognition did not differ between groups but varied with gaze such that responses were fastest in the facilitative condition and slowest in the contradictory condition. Only the ASD group responded slower to low frequency than high-frequency words. Accuracy of word mapping did not differ between groups, but accuracy varied with gaze with higher performance in the facilitative than neutral condition. Both groups scored above single-trial chance levels in the neutral condition by tracking cross-situational information. Only in the ASD group did mapping vary with receptive vocabulary.ConclusionsUnder laboratory conditions, children with ASD can monitor gaze and judge its reliability as a cue to word meaning as well as typical peers. The use of cross-situational statistics to support word learning may be problematic for those who have weak language abilities.
| S-EPMC4232219 | biostudies-literature
Project description:To navigate the social world, humans heavily rely on gaze for non-verbal communication as it conveys information in a highly dynamic and complex, yet concise manner: For instance, humans utilize gaze effortlessly to direct and infer the attention of a possible interaction partner. Many traditional paradigms in social gaze research though rely on static ways of assessing gaze interaction, e.g., by using images or prerecorded videos as stimulus material. Emerging gaze contingent paradigms, in which algorithmically controlled virtual characters can respond flexibly to the gaze behavior of humans, provide high ecological validity. Ideally, these are based on models of human behavior which allow for precise, parameterized characterization of behavior, and should include variable interactive settings and different communicative states of the interacting agents. The present study provides a complete definition and empirical description of a behavioral parameter space of human gaze behavior in extended gaze encounters. To this end, we (i) modeled a shared 2D virtual environment on a computer screen in which a human could interact via gaze with an agent and simultaneously presented objects to create instances of joint attention and (ii) determined quantitatively the free model parameters (temporal and probabilistic) of behavior within this environment to provide a first complete, detailed description of the behavioral parameter space governing joint attention. This knowledge is essential to enable the modeling of interacting agents with a high degree of ecological validity, be it for cognitive studies or applications in human-robot interaction.
| S-EPMC8377250 | biostudies-literature
Project description:Communication with young children is often multimodal in nature, involving, for example, language and actions. The simultaneous presentation of information from both domains may boost language learning by highlighting the connection between an object and a word, owing to temporal overlap in the presentation of multimodal input. However, the overlap is not merely temporal but can also covary in the extent to which particular actions co-occur with particular words and objects, e.g. carers typically produce a hopping action when talking about rabbits and a snapping action for crocodiles. The frequency with which actions and words co-occurs in the presence of the referents of these words may also impact young children's word learning. We, therefore, examined the extent to which consistency in the co-occurrence of particular actions and words impacted children's learning of novel word-object associations. Children (18 months, 30 months and 36-48 months) and adults were presented with two novel objects and heard their novel labels while different actions were performed on these objects, such that the particular actions and word-object pairings always co-occurred (Consistent group) or varied across trials (Inconsistent group). At test, participants saw both objects and heard one of the labels to examine whether participants recognized the target object upon hearing its label. Growth curve models revealed that 18-month-olds did not learn words for objects in either condition, and 30-month-old and 36- to 48-month-old children learned words for objects only in the Consistent condition, in contrast to adults who learned words for objects independent of the actions presented. Thus, consistency in the multimodal input influenced word learning in early childhood but not in adulthood. In terms of a dynamic systems account of word learning, our study shows how multimodal learning settings interact with the child's perceptual abilities to shape the learning experience.
| S-EPMC6731739 | biostudies-literature
Project description:Movements and behavior synchronize during social interaction at many levels, often unintentionally. During smooth conversation, for example, participants adapt to each others' speech rates. Here we aimed to find out to which extent speakers adapt their turn-taking rhythms during a story-building game. Nine sex-matched dyads of adults (12 males, 6 females) created two 5-min stories by contributing to them alternatingly one word at a time. The participants were located in different rooms, with audio connection during one story and audiovisual during the other. They were free to select the topic of the story. Although the participants received no instructions regarding the timing of the story building, their word rhythms were highly entrained (øverlineR = 0.70, p < 0.001) even though the rhythms as such were unstable (øverlineR = 0.14 for pooled data). Such high entrainment in the absence of steady word rhythm occurred in every individual story, independently of whether the subjects were connected via audio-only or audiovisual link. The observed entrainment was of similar strength as typical entrainment in finger-tapping tasks where participants are specifically instructed to synchronize their behavior. Thus, speech seems to spontaneously induce strong entrainment between the conversation partners, likely reflecting automatic alignment of their semantic and syntactic processes.
| S-EPMC4464109 | biostudies-literature
Project description:Previous research on associative learning has uncovered detailed aspects of the process, including what types of things are learned, how they are learned, and where in the brain such learning occurs. However, perceptual processes, such as stimulus recognition and identification, take time to unfold. Previous studies of learning have not addressed when, during the course of these dynamic recognition processes, learned representations are formed and updated. If learned representations are formed and updated while recognition is ongoing, the result of learning may incorporate spurious, partial information. For example, during word recognition, words take time to be identified, and competing words are often active in parallel. If learning proceeds before this competition resolves, representations may be influenced by the preliminary activations present at the time of learning. In three experiments using word learning as a model domain, we provide evidence that learning reflects the ongoing dynamics of auditory and visual processing during a learning event. These results show that learning can occur before stimulus recognition processes are complete; learning does not wait for ongoing perceptual processing to complete.
| S-EPMC5344795 | biostudies-literature
Project description:Higher education in the 21st century faces the challenge of changing the way in which knowledge is conveyed and how teachers and students interact in the teaching-learning process. The current pandemic caused by SARS-CoV-2 has hastened the need to face up to this challenge and has furthered the need to approach the issue from the perspective of digitalisation. To achieve this, it is necessary to design training programmes geared towards teaching staff and which address both the use of technology and instructional design aimed at promoting the development of self-regulated learning (SRL) and automatic feedback systems. In this study, work was carried out with 23 teachers (8 inexperienced and 15 experienced teachers) in a training programme conducted through Moodle. The aims were: (1) to test whether there were any significant differences between the behaviour patterns of new teachers compared to experienced teachers, (2) to determine whether clusters of behaviour patterns corresponded to the type of teacher and (3) to ascertain whether the level of teacher satisfaction with the training activity in digital teaching will depend on the type of teacher. A quantitative as well as a qualitative design was applied. Differences were found in the behaviour patterns in the training activities for the development of rubrics and use of learning analytics systems in virtual learning environments. It was also found that the type of teacher did not correspond exactly to the behaviour cluster in the learning platform. In addition, no significant differences were found in the level of satisfaction between the two kinds of teacher. The main contribution this study makes is to provide a detailed description of the training stage as well as the materials required for its repetition. Further analytical studies are required on teacher perception of training programmes in digital teaching in order to provide personalised training proposals that lead to an effective use of teaching in digital environments.
| S-EPMC9000986 | biostudies-literature
Project description:During the grammatical encoding of spoken multiword utterances, various kinds of information must be used to determine the order of words. For example, whereas in adjective-noun utterances like "red car," word order can be determined on the basis of the word's grammatical class information, in noun-noun utterances like "... by car, bus, or ...," word order cannot be determined on the basis of a word's grammatical class information. We investigated whether a word's phonological properties play a role in grammatical encoding. In four experiments, participants produced multiword utterances in which the words' onset phonology was manipulated. Phonological-onset relatedness yielded inhibitory effects in noun-noun utterances, no effects in noun-adjective utterances, and facilitatory effects in adjective-noun, noun-verb, and adjective-adjective-noun utterances. These results cannot be explained by differences in the stimulus displays used to elicit the utterances and suggest that grammatical encoding is sensitive to the phonological properties of words.
| S-EPMC2761505 | biostudies-literature
Project description:ObjectiveTemporal lobe epilepsy (TLE) is a chronic condition classically characterized by recurrent unprovoked episodes of involuntary violent motion and behavior whose degree and nature often overshadow the more subtle interictal neuropsychiatric symptoms. The purpose of this research was to investigate further the nature of cognitive impairment seen in social interaction within the population with TLE.MethodsWe recorded the dynamics of real-time sensorimotor interaction in 10 pairs of control participants and ten pairs of participants with drug-resistantTLE using a minimalistic human-computer interface paradigm known as "perceptual crossing." We investigated whether TLE is associated with impaired detection of social contingency, i.e.,reduced sensitivity to their teammate's responsiveness to their behavior.ResultsOur analysis reveals that using a simplified, computer-mediated, embodied form of social interaction, people with TLE demonstrated a statistically significant decrease in identification accuracy ratio (p-value is 0.00084,p < 0.05), a decrease in turn-taking (p-value is 0.03216,p < 0.05), decrease in player-object discrimination specificity (p-value is 0.00695,p < 0.05), and a decrease time spend in contact both in absolute terms (p-value is 0.00181, p < 0.05) and as a percentage of time after first contact (p-value is 0.0268, p < 0.05) when compared with age-gender-matched controls.DiscussionWe found that coregulated interactions differed significantly between subjects with drug-resistantTLE and age-gender-matched controls consistent with prior meta-analysis observations regarding social cognition impairment in TLE. This is the first study to demonstrate social contingency impairment through dyadic interaction in the population with TLE.
| S-EPMC7484312 | biostudies-literature