Browse
Submit Data
Databases
API
Help

Dataset Information

7 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

GestuRe and ACtion Exemplar (GRACE) video database: stimuli for research on manners of human locomotion and iconic gestures.

ABSTRACT: Human locomotion is a fundamental class of events, and manners of locomotion (e.g., how the limbs are used to achieve a change of location) are commonly encoded in language and gesture. To our knowledge, there is no openly accessible database containing normed human locomotion stimuli. Therefore, we introduce the GestuRe and ACtion Exemplar (GRACE) video database, which contains 676 videos of actors performing novel manners of human locomotion (i.e., moving from one location to another in an unusual manner) and videos of a female actor producing iconic gestures that represent these actions. The usefulness of the database was demonstrated across four norming experiments. First, our database contains clear matches and mismatches between iconic gesture videos and action videos. Second, the male actors and female actors whose action videos matched the gestures in the best possible way, perform the same actions in very similar manners and different actions in highly distinct manners. Third, all the actions in the database are distinct from each other. Fourth, adult native English speakers were unable to describe the 26 different actions concisely, indicating that the actions are unusual. This normed stimuli set is useful for experimental psychologists working in the language, gesture, visual perception, categorization, memory, and other related domains.

SUBMITTER: Aussems S

PROVIDER: S-EPMC5990570 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Do gestures retain mental associations with their iconic origins, even after they become emblematic? An analysis of the middle-finger gesture among American English speakers.

Project description:What concepts and words do communicative gestures activate in the minds of people who view them? It's widely believed that many gestures grow from iconic origins-they look like what they mean-but also that at some point they may become emblematic-conventionalized as culturally agreed-upon symbols. How long do links between physical movements of the body and the things in the world they denote persist in the minds of gesture-users? A pair of experiments asks this question for the Middle-Finger, a cross-culturally recognized obscene gesture. The prevailing view is that the gesture originates in a phallic symbol. Yet it is now predominantly used as an emblematic gesture displaying contempt (among other things). It is currently unknown whether the iconic origins of gestures persist through the emblematic stage in the minds of gesture users. Two experiments tested the hypothesis that viewing the Middle-Finger primes thoughts about penises or the word penis. The results showed that the Middle-Finger induced no priming of penis compared with control, unlike another obscene penis-representing gesture (Finger-Bang), which did. This suggests that the Middle-Finger no longer activates thoughts of penises in the minds of contemporary American English speakers. Emblematic gestures with iconic origins may undergo historical change not just in the functions they serve but also in the effects they have on the minds of people who use them.

| S-EPMC6490901 | biostudies-literature

Iconic Gestures for Robot Avatars, Recognition and Integration with Speech.

Project description:Co-verbal gestures are an important part of human communication, improving its efficiency and efficacy for information conveyance. One possible means by which such multi-modal communication might be realized remotely is through the use of a tele-operated humanoid robot avatar. Such avatars have been previously shown to enhance social presence and operator salience. We present a motion tracking based tele-operation system for the NAO robot platform that allows direct transmission of speech and gestures produced by the operator. To assess the capabilities of this system for transmitting multi-modal communication, we have conducted a user study that investigated if robot-produced iconic gestures are comprehensible, and are integrated with speech. Robot performed gesture outcomes were compared directly to those for gestures produced by a human actor, using a within participant experimental design. We show that iconic gestures produced by a tele-operated robot are understood by participants when presented alone, almost as well as when produced by a human. More importantly, we show that gestures are integrated with speech when presented as part of a multi-modal communication equally well for human and robot performances.

| S-EPMC4756113 | biostudies-literature

Neural integration of iconic and unrelated coverbal gestures: a functional MRI study.

Project description:Gestures are an important part of interpersonal communication, for example by illustrating physical properties of speech contents (e.g., "the ball is round"). The meaning of these so-called iconic gestures is strongly intertwined with speech. We investigated the neural correlates of the semantic integration for verbal and gestural information. Participants watched short videos of five speech and gesture conditions performed by an actor, including variation of language (familiar German vs. unfamiliar Russian), variation of gesture (iconic vs. unrelated), as well as isolated familiar language, while brain activation was measured using functional magnetic resonance imaging. For familiar speech with either of both gesture types contrasted to Russian speech-gesture pairs, activation increases were observed at the left temporo-occipital junction. Apart from this shared location, speech with iconic gestures exclusively engaged left occipital areas, whereas speech with unrelated gestures activated bilateral parietal and posterior temporal regions. Our results demonstrate that the processing of speech with speech-related versus speech-unrelated gestures occurs in two distinct but partly overlapping networks. The distinct processing streams (visual versus linguistic/spatial) are interpreted in terms of "auxiliary systems" allowing the integration of speech and gesture in the left temporo-occipital region.

| S-EPMC6870774 | biostudies-literature

Progressive Reduction of Iconic Gestures Contributes to School-Aged Children's Increased Word Production.

Project description:The economic principle of communication, according to which successful communication can be reached by least effort, has been studied for verbal communication. With respect to nonverbal behavior, it implies that forms of iconic gestures change over the course of communication and become reduced in the sense of less pronounced. These changes and their effects on learning are currently unexplored in relevant literature. Addressing this research gap, we conducted a word learning study to test the effects of changing gestures on children's slow mapping. We applied a within-subject design and tested 51 children, aged 6.7 years (SD = 0.4), who learned unknown words from a story. The storyteller acted on the basis of two conditions: In one condition, in which half of the target words were presented, the story presentation was enhanced with progressively reduced iconic gestures (PRG); in the other condition, half of the target words were accompanied by fully executed iconic gestures (FEG). To ensure a reliable gesture presentation, children were exposed to a recorded person telling a story in both conditions. We tested the slow mapping effects on children's productive and receptive word knowledge three minutes as well as two to three days after being presented the story. The results suggest that children's production of the target words, but not their understanding thereof, was enhanced by PRG.

| S-EPMC8107226 | biostudies-literature

The Role of Iconic Gestures in Speech Comprehension: An Overview of Various Methodologies.

Project description:Iconic gesture-speech integration is a relatively recent field of investigation with numerous researchers studying its various aspects. The results obtained are just as diverse. The definition of iconic gestures is often overlooked in the interpretations of results. Furthermore, while most behavioral studies have demonstrated an advantage of bimodal presentation, brain activity studies show a diversity of results regarding the brain regions involved in the processing of this integration. Clinical studies also yield mixed results, some suggesting parallel processing channels, others a unique and integrated channel. This review aims to draw attention to the methodological variations in research on iconic gesture-speech integration and how they impact conclusions regarding the underlying phenomena. It will also attempt to draw together the findings from other relevant research and suggest potential areas for further investigation in order to better understand processes at play during speech integration process.

| S-EPMC8118122 | biostudies-literature

Frontal and temporal contributions to understanding the iconic co-speech gestures that accompany speech.

Project description:In everyday conversation, listeners often rely on a speaker's gestures to clarify any ambiguities in the verbal message. Using fMRI during naturalistic story comprehension, we examined which brain regions in the listener are sensitive to speakers' iconic gestures. We focused on iconic gestures that contribute information not found in the speaker's talk, compared with those that convey information redundant with the speaker's talk. We found that three regions-left inferior frontal gyrus triangular (IFGTr) and opercular (IFGOp) portions, and left posterior middle temporal gyrus (MTGp)--responded more strongly when gestures added information to nonspecific language, compared with when they conveyed the same information in more specific language; in other words, when gesture disambiguated speech as opposed to reinforced it. An increased BOLD response was not found in these regions when the nonspecific language was produced without gesture, suggesting that IFGTr, IFGOp, and MTGp are involved in integrating semantic information across gesture and speech. In addition, we found that activity in the posterior superior temporal sulcus (STSp), previously thought to be involved in gesture-speech integration, was not sensitive to the gesture-speech relation. Together, these findings clarify the neurobiology of gesture-speech integration and contribute to an emerging picture of how listeners glean meaning from gestures that accompany speech.

| S-EPMC3797208 | biostudies-literature

The role of caregiver gestures and gesture-related responses of toddlers with autism spectrum disorder

Project description:Autism spectrum disorder (ASD) is characterized by social communicative abnormalities. Deficits and delays in gestural communication are among the early deficits of ASD and also a major social modality in early caregiver-toddler interaction. Caregiver gestures have an important role in the cognitive and social development of children with ASD. Thus, it is urgent to further explore the role of caregiver gestures in early caregiver-toddler interaction. In this cross-sectional study, we observed the caregivers' gestures and responses of toddlers aged between 18 and 24 months during play (ASD = 44, TD = 29) and dining activities (ASD = 34, TD = 27). By observing the different frequencies and patterns of gestures by the caregiver-child interaction and the different proportions of children's responses to the caregiver's gestures, we found that, compared to caregivers of typically developing toddlers, caregivers of toddlers with ASD had fewer synchronized gestures and more unsynchronized gestures in the play activity and more supplementary gestures in dining activity. Toddlers with ASD produced more social responses to caregivers' synchronized gestures, whereas the use of synchronized gestures by the caregivers in caregiver-toddler interaction had a positive influence on social responses to toddlers with ASD. The findings suggest that effective use of gestures by caregivers during caregiver-toddler activities can improve children's social responses.

| S-EPMC9353329 | biostudies-literature

Classification Algorithm for Person Identification and Gesture Recognition Based on Hand Gestures with Small Training Sets.

Project description:Classification algorithms require training data initially labelled by classes to build a model and then to be able to classify the new data. The amount and diversity of training data affect the classification quality and usually the larger the training set, the better the accuracy of classification. In many applications only small amounts of training data are available. This article presents a new time series classification algorithm for problems with small training sets. The algorithm was tested on hand gesture recordings in tasks of person identification and gesture recognition. The algorithm provides significantly better classification accuracy than other machine learning algorithms. For 22 different hand gestures performed by 10 people and the training set size equal to 5 gesture execution records per class, the error rate for the newly proposed algorithm is from 37% to 75% lower than for the other compared algorithms. When the training set consists of only one sample per class the new algorithm reaches from 45% to 95% lower error rate. Conducted experiments indicate that the algorithm outperforms state-of-the-art methods in terms of classification accuracy in the problem of person identification and gesture recognition.

| S-EPMC7766068 | biostudies-literature

ICONIC

Project description:ICONIC

| PRJEB6008 | ENA

Pointing and pantomime in wild apes? Female bonobos use referential and iconic gestures to request genito-genital rubbing.

Project description:Referential and iconic gesturing provide a means to flexibly and intentionally share information about specific entities, locations, or goals. The extent to which nonhuman primates use such gestures is therefore of special interest for understanding the evolution of human language. Here, we describe novel observations of wild female bonobos (Pan paniscus) using referential and potentially iconic gestures to initiate genito-genital (GG) rubbing, which serves important functions in reducing social tension and facilitating cooperation. We collected data from a habituated community of bonobos at Luikotale, DRC, and analysed n?=?138 independent gesture bouts made by n?=?11 females. Gestures were coded in real time or from video. In addition to meeting the criteria for intentionality, in form and function these gestures resemble pointing and pantomime-two hallmarks of human communication-in the ways in which they indicated the relevant body part or action involved in the goal of GG rubbing. Moreover, the gestures led to GG rubbing in 83.3% of gesture bouts, which in turn increased tolerance in feeding contexts between the participants. We discuss how biologically relevant contexts in which individuals are motivated to cooperate may facilitate the emergence of language precursors to enhance communication in wild apes.

| S-EPMC4642555 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data