Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Quantifying the qualities of language.

ABSTRACT: We here quantify the qualities of language. Specifically, we derive numerical values, and associated variability scores for statements of general probability as well as for anchor terms commonly expressed on Likert-type scales. Our results show significant inter-responder variability in the understanding of such terms. We also demonstrate scale compression such that average estimates are poorly aligned to the a priori expectations of equal response spacing in commonly used verbal response instruments. Terms further show intriguing propensities such that people agree more about statements of agreement, but manifestly disagree more about statements of disagreement. The valence of these terms is thus systematically related to their degree of common understanding. The accuracy of language, especially when used in conjunction with modern advanced technologies, proves vital for effective communication. Our work demonstrates that the tool of language still remains a fairly blunt one, but one that can be sharpened by systematic quantitative evaluation, as we demonstrate here.

SUBMITTER: Hancock PA

PROVIDER: S-EPMC7199931 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Quantifying the qualities of language.

Hancock P A PA Volante William G WG

PloS one 20200505 5

We here quantify the qualities of language. Specifically, we derive numerical values, and associated variability scores for statements of general probability as well as for anchor terms commonly expressed on Likert-type scales. Our results show significant inter-responder variability in the understanding of such terms. We also demonstrate scale compression such that average estimates are poorly aligned to the a priori expectations of equal response spacing in commonly used verbal response instru ...[more]

PMID: 32369526

Similar Datasets

Quantifying the evolutionary dynamics of language.

Project description:Human language is based on grammatical rules. Cultural evolution allows these rules to change over time. Rules compete with each other: as new rules rise to prominence, old ones die away. To quantify the dynamics of language evolution, we studied the regularization of English verbs over the past 1,200 years. Although an elaborate system of productive conjugations existed in English's proto-Germanic ancestor, Modern English uses the dental suffix, '-ed', to signify past tense. Here we describe the emergence of this linguistic rule amidst the evolutionary decay of its exceptions, known to us as irregular verbs. We have generated a data set of verbs whose conjugations have been evolving for more than a millennium, tracking inflectional changes to 177 Old-English irregular verbs. Of these irregular verbs, 145 remained irregular in Middle English and 98 are still irregular today. We study how the rate of regularization depends on the frequency of word usage. The half-life of an irregular verb scales as the square root of its usage frequency: a verb that is 100 times less frequent regularizes 10 times as fast. Our study provides a quantitative analysis of the regularization process by which ancestral forms gradually yield to an emerging linguistic rule.

| S-EPMC2460562 | biostudies-literature

The Language Exposure Assessment Tool: Quantifying Language Exposure in Infants and Children.

Project description:PurposeThe aim of this study was to develop the Language Exposure Assessment Tool (LEAT) and to examine its cross-linguistic validity, reliability, and utility. The LEAT is a computerized interview-style assessment that requests parents to estimate language exposure. The LEAT yields an automatic calculation of relative language exposure and captures qualitative aspects of early language experience.MethodRelative language exposure as reported on the LEAT and vocabulary size at 17 months of age were measured in a group of bilingual language learners with varying levels of exposure to French and English or Spanish and English.ResultsThe LEAT demonstrates high internal consistency and criterion validity. In addition, the LEAT's calculation of relative language exposure explains variability in vocabulary size above a single overall parent estimate.ConclusionsThe LEAT is a valid and efficient tool for characterizing early language experience across cultural settings and levels of language exposure. The LEAT could be a useful tool in clinical contexts to aid in determining whether assessment and intervention should be conducted in one or more languages.

| S-EPMC5399762 | biostudies-literature

Quantifying the visual-sensory landscape qualities that contribute to cultural ecosystem services using social media and LiDAR.

Project description:Landscapes are increasingly recognized for providing valuable cultural ecosystem services with numerous non-material benefits by serving as places of rest, relaxation, and inspiration that ultimately improve overall mental health and physical well-being. Maintaining and enhancing these valuable benefits through targeted management and conservation measures requires understanding the spatial and temporal determinants of perceived landscape values. Content contributed through mobile technologies and the web are emerging globally, providing a promising data source for localizing and assessing these landscape benefits. These georeferenced data offer rich in situ qualitative information through photos and comments that capture valued and special locations across large geographic areas. We present a novel method for mapping and modeling landscape values and perceptions that leverages viewshed analysis of georeferenced social media data. Using a high resolution LiDAR (Light Detection and Ranging) derived digital surface model, we are able to evaluate landscape characteristics associated with the visual-sensory qualities of outdoor recreationalists. Our results show the importance of historical monuments and attractions in addition to specific environmental features which are appreciated by the public. Evaluation of photo-image content highlights the opportunity of including temporally and spatially variable visual-sensory qualities in cultural ecosystem services (CES) evaluation like the sights, sounds and smells of wildlife and weather phenomena.

| S-EPMC6104849 | biostudies-literature

Quantifying gender bias towards politicians in cross-lingual language models.

Project description:Recent research has demonstrated that large pre-trained language models reflect societal biases expressed in natural language. The present paper introduces a simple method for probing language models to conduct a multilingual study of gender bias towards politicians. We quantify the usage of adjectives and verbs generated by language models surrounding the names of politicians as a function of their gender. To this end, we curate a dataset of 250k politicians worldwide, including their names and gender. Our study is conducted in seven languages across six different language modeling architectures. The results demonstrate that pre-trained language models' stance towards politicians varies strongly across analyzed languages. We find that while some words such as dead, and designated are associated with both male and female politicians, a few specific words such as beautiful and divorced are predominantly associated with female politicians. Finally, and contrary to previous findings, our study suggests that larger language models do not tend to be significantly more gender-biased than smaller ones.

| S-EPMC10684026 | biostudies-literature

Quantifying depression-related language on social media during the COVID-19 pandemic.

Project description:IntroductionThe COVID-19 pandemic had clear impacts on mental health. Social media presents an opportunity for assessing mental health at the population level.Objectives1) Identify and describe language used on social media that is associated with discourse about depression. 2) Describe the associations between identified language and COVID-19 incidence over time across several geographies.MethodsWe create a word embedding based on the posts in Reddit's /r/Depression and use this word embedding to train representations of active authors. We contrast these authors against a control group and extract keywords that capture differences between the two groups. We filter these keywords for face validity and to match character limits of an information retrieval system, Elasticsearch. We retrieve all geo-tagged posts on Twitter from April 2019 to June 2021 from Seattle, Sydney, Mumbai, and Toronto. The tweets are scored with BM25 using the keywords. We call this score rDD. We compare changes in average score over time with case counts from the pandemic's beginning through June 2021.ResultsWe observe a pattern in rDD across all cities analyzed: There is an increase in rDD near the start of the pandemic which levels off over time. However, in Mumbai we also see an increase aligned with a second wave of cases.ConclusionsOur results are concordant with other studies which indicate that the impact of the pandemic on mental health was highest initially and was followed by recovery, largely unchanged by subsequent waves. However, in the Mumbai data we observed a substantial rise in rDD with a large second wave. Our results indicate possible un-captured heterogeneity across geographies, and point to a need for a better understanding of this differential impact on mental health.

| S-EPMC9052361 | biostudies-literature

Quantifying Interpreting Types: Language Sequence Mirrors Cognitive Load Minimization in Interpreting Tasks.

Project description:Most interpreting theories claim that different interpreting types should involve varied processing mechanisms and procedures. However, few studies have examined their underlying differences. Even though some previous results based on quantitative approaches show that different interpreting types yield outputs of varying lexical and syntactic features, the grammatical parsing approach is limited. Language sequences that form without relying on parsing or processing with a specific linguistic approach or grammar excel other quantitative approaches at revealing the sequential behavior of language production. As a non-grammatically-bound unit of language sequences, frequency motif can visualize the local distribution of content and function words, and can also statistically classify languages and identify text types. Thus, the current research investigates the distribution, length and position-dependent properties of frequency motifs across different interpreting outputs in pursuit of the sequential generation behaviors. It is found that the distribution, the length and certain position-dependent properties of the specific language sequences differ significantly across simultaneous interpreting and consecutive interpreting output. The features of frequency motifs manifest that both interpreting output is produced in the manner that abides by the least effort principle. The current research suggests that interpreting types can be differentiated through this type of language sequential unit and offers evidence for how the different task features mediate the sequential organization of interpreting output under different demand to achieve cognitive load minimization.

| S-EPMC6387939 | biostudies-literature

Question-based computational language approach outperforms rating scales in quantifying emotional states.

Project description:Psychological constructs are commonly quantified with closed-ended rating scales. However, recent advancements in natural language processing (NLP) enable the quantification of open-ended language responses. Here we demonstrate that descriptive word responses analyzed using NLP show higher accuracy in categorizing emotional states compared to traditional rating scales. One group of participants (N = 297) generated narratives related to depression, anxiety, satisfaction, or harmony, summarized them with five descriptive words, and rated them using rating scales. Another group (N = 434) evaluated these narratives (with descriptive words and rating scales) from the author's perspective. The descriptive words were quantified using NLP, and machine learning was used to categorize the responses into the corresponding emotional states. The results showed a significantly higher number of accurate categorizations of the narratives based on descriptive words (64%) than on rating scales (44%), questioning the notion that rating scales are more precise in measuring emotional states than language-based measures.

| S-EPMC11332055 | biostudies-literature

Unmasking and quantifying racial bias of large language models in medical report generation.

Project description:BackgroundLarge language models like GPT-3.5-turbo and GPT-4 hold promise for healthcare professionals, but they may inadvertently inherit biases during their training, potentially affecting their utility in medical applications. Despite few attempts in the past, the precise impact and extent of these biases remain uncertain.MethodsWe use LLMs to generate responses that predict hospitalization, cost and mortality based on real patient cases. We manually examine the generated responses to identify biases.ResultsWe find that these models tend to project higher costs and longer hospitalizations for white populations and exhibit optimistic views in challenging medical scenarios with much higher survival rates. These biases, which mirror real-world healthcare disparities, are evident in the generation of patient backgrounds, the association of specific diseases with certain racial and ethnic groups, and disparities in treatment recommendations, etc. CONCLUSIONS: Our findings underscore the critical need for future research to address and mitigate biases in language models, especially in critical healthcare applications, to ensure fair and accurate outcomes for all patients.

| S-EPMC11387737 | biostudies-literature

Quantifying cerebral asymmetries for language in dextrals and adextrals with random-effects meta analysis.

Project description:Speech and language-related functions tend to depend on the left hemisphere more than the right in most right-handed (dextral) participants. This relationship is less clear in non-right handed (adextral) people, resulting in surprisingly polarized opinion on whether or not they are as lateralized as right handers. The present analysis investigates this issue by largely ignoring methodological differences between the different neuroscientific approaches to language lateralization, as well as discrepancies in how dextral and adextral participants were recruited or defined. Here we evaluate the tendency for dextrals to be more left hemisphere dominant than adextrals, using random effects meta analyses. In spite of several limitations, including sample size (in the adextrals in particular), missing details on proportions of groups who show directional effects in many experiments, and so on, the different paradigms all point to proportionally increased left hemispheric dominance in the dextrals. These results are analyzed in light of the theoretical importance of these subtle differences for understanding the cognitive neuroscience of language, as well as the unusual asymmetry in most adextrals.

| S-EPMC4219560 | biostudies-literature