Dataset Information

Hierarchical temporal structure in music, speech and animal vocalizations: jazz is like a conversation, humpbacks sing like hermit thrushes.

ABSTRACT: Humans talk, sing and play music. Some species of birds and whales sing long and complex songs. All these behaviours and sounds exhibit hierarchical structure-syllables and notes are positioned within words and musical phrases, words and motives in sentences and musical phrases, and so on. We developed a new method to measure and compare hierarchical temporal structures in speech, song and music. The method identifies temporal events as peaks in the sound amplitude envelope, and quantifies event clustering across a range of timescales using Allan factor (AF) variance. AF variances were analysed and compared for over 200 different recordings from more than 16 different categories of signals, including recordings of speech in different contexts and languages, musical compositions and performances from different genres. Non-human vocalizations from two bird species and two types of marine mammals were also analysed for comparison. The resulting patterns of AF variance across timescales were distinct to each of four natural categories of complex sound: speech, popular music, classical music and complex animal vocalizations. Comparisons within and across categories indicated that nested clustering in longer timescales was more prominent when prosodic variation was greater, and when sounds came from interactions among individuals, including interactions between speakers, musicians, and even killer whales. Nested clustering also was more prominent for music compared with speech, and reflected beat structure for popular music and self-similarity across timescales for classical music. In summary, hierarchical temporal structures reflect the behavioural and social processes underlying complex vocalizations and musical performances.

SUBMITTER: Kello CT

PROVIDER: S-EPMC5665819 | biostudies-literature | 2017 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Hierarchical temporal structure in music, speech and animal vocalizations: jazz is like a conversation, humpbacks sing like hermit thrushes.

Kello Christopher T CT Bella Simone Dalla SD Médé Butovens B Balasubramaniam Ramesh R

Journal of the Royal Society, Interface 20171001 135

Humans talk, sing and play music. Some species of birds and whales sing long and complex songs. All these behaviours and sounds exhibit hierarchical structure-syllables and notes are positioned within words and musical phrases, words and motives in sentences and musical phrases, and so on. We developed a new method to measure and compare hierarchical temporal structures in speech, song and music. The method identifies temporal events as peaks in the sound amplitude envelope, and quantifies event ...[more]

PMID: 29021158

Similar Datasets

Project description:A fundamental question regarding music processing is its degree of independence from speech processing, in terms of their underlying neuroanatomy and influence of cognitive traits and abilities. Although a straight answer to that question is still lacking, a large number of studies have described where in the brain and in which contexts (tasks, stimuli, populations) this independence is, or is not, observed. We examined the independence between music and speech processing using functional magnetic resonance imagining and a stimulation paradigm with different human vocal sounds produced by the same voice. The stimuli were grouped as Speech (spoken sentences), Hum (hummed melodies), and Song (sung sentences); the sentences used in Speech and Song categories were the same, as well as the melodies used in the two musical categories. Each category had a scrambled counterpart which allowed us to render speech and melody unintelligible, while preserving global amplitude and frequency characteristics. Finally, we included a group of musicians to evaluate the influence of musical expertise. Similar global patterns of cortical activity were related to all sound categories compared to baseline, but important differences were evident. Regions more sensitive to musical sounds were located bilaterally in the anterior and posterior superior temporal gyrus (planum polare and temporale), the right supplementary and premotor areas, and the inferior frontal gyrus. However, only temporal areas and supplementary motor cortex remained music-selective after subtracting brain activity related to the scrambled stimuli. Speech-selective regions mainly affected by intelligibility of the stimuli were observed on the left pars opecularis and the anterior portion of the medial temporal gyrus. We did not find differences between musicians and non-musicians Our results confirmed music-selective cortical regions in associative cortices, independent of previous musical training.

Project description:Background and aimsHumans communicate primarily through spoken language and speech perception is a core function of the human auditory system. Among the autistic community, atypical sensory reactivity and social communication difficulties are pervasive, yet the research literature lacks in-depth self-report data on speech perception in this population. The present study aimed to elicit detailed first-person accounts of autistic individuals' abilities and difficulties perceiving the spoken word.MethodsSemi-structured interviews were conducted with nine autistic adults. The interview schedule addressed interviewees' experiences of speech perception, factors influencing those experiences, and responses to those experiences. Resulting interview transcripts underwent thematic analysis. The six-person study team included two autistic researchers, to reduce risk of neurotypical 'overshadowing' of autistic voices.ResultsMost interviewees reported pronounced difficulties perceiving speech in the presence of competing sounds. They emphasised that such listening difficulties are distinct from social difficulties, though the two can add and interact. Difficulties were of several varieties, ranging from powerful auditory distraction to drowning out of voices by continuous sounds. Contributing factors encompassed not only features of the soundscape but also non-acoustic factors such as multisensory processing and social cognition. Participants also identified compounding factors, such as lack of understanding of listening difficulties. Impacts were diverse and sometimes disabling, affecting socialising, emotions, fatigue, career, and self-image. A wide array of coping mechanisms was described.ConclusionsThe first in-depth qualitative investigation of autistic speech-perception experiences has revealed diverse and widespread listening difficulties. These can combine with other internal, interpersonal, and societal factors to induce profound impacts. Lack of understanding of such listening difficulties - by the self, by communication partners, by institutions, and especially by clinicians - appears to be a crucial exacerbating factor. Many autistic adults have developed coping strategies to lessen speech-perception difficulties or mitigate their effects, and these are generally self-taught due to lack of clinical support.ImplicationsThere is a need for carefully designed, adequately powered confirmatory research to verify, quantify, and disentangle the various forms of listening difficulty, preferably using large samples to explore heterogeneity. More immediate benefit might be obtained through development of self-help and clinical guidance materials, and by raising awareness of autistic listening experiences and needs, among the autistic community, communication partners, institutions, and clinicians.

Dataset Information

Hierarchical temporal structure in music, speech and animal vocalizations: jazz is like a conversation, humpbacks sing like hermit thrushes.

Publications

Hierarchical temporal structure in music, speech and animal vocalizations: jazz is like a conversation, humpbacks sing like hermit thrushes.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets