In Search of the Factors Behind Naive Sentence Judgments: A State Trace Analysis of Grammaticality and Acceptability Ratings.
Ontology highlight
ABSTRACT:
SUBMITTER: Langsford S
PROVIDER: S-EPMC6934035 | biostudies-literature | 2019
REPOSITORIES: biostudies-literature
Publications
In Search of the Factors Behind Naive Sentence Judgments: A State Trace Analysis of Grammaticality and Acceptability Ratings.
Langsford Steven S Stephens Rachel G RG Dunn John C JC Lewis Richard L RL
Frontiers in psychology 20191220
We present a state-trace analysis of sentence ratings elicited by asking participants to evaluate the overall acceptability of a sentence and those elicited by asking participants to focus on structural well-formedness only. Appealing to literature on "grammatical illusion" sentences, we anticipated that a simple instruction manipulation might prompt people to apply qualitatively different kinds of judgment in the two conditions. Although differences consistent with the subjective experience of ...[more]
Similar Datasets
Project description:This preregistered study tested three theoretical proposals for how children form productive yet restricted linguistic generalizations, avoiding errors such as *The clown laughed the man, across three age groups (5-6?years, 9-10?years, adults) and five languages (English, Japanese, Hindi, Hebrew and K'iche'). Participants rated, on a five-point scale, correct and ungrammatical sentences describing events of causation (e.g., *Someone laughed the man; Someone made the man laugh; Someone broke the truck; ?Someone made the truck break). The verb-semantics hypothesis predicts that, for all languages, by-verb differences in acceptability ratings will be predicted by the extent to which the causing and caused event (e.g., amusing and laughing) merge conceptually into a single event (as rated by separate groups of adult participants). The entrenchment and preemption hypotheses predict, for all languages, that by-verb differences in acceptability ratings will be predicted by, respectively, the verb's relative overall frequency, and frequency in nearly-synonymous constructions (e.g., X made Y laugh for *Someone laughed the man). Analysis using mixed effects models revealed that entrenchment/preemption effects (which could not be distinguished due to collinearity) were observed for all age groups and all languages except K'iche', which suffered from a thin corpus and showed only preemption sporadically. All languages showed effects of event-merge semantics, except K'iche' which showed only effects of supplementary semantic predictors. We end by presenting a computational model which successfully simulates this pattern of results in a single discriminative-learning mechanism, achieving by-verb correlations of around r?=?0.75 with human judgment data.
| S-EPMC7397526 | biostudies-literature
Project description:Musical rhythm and the grammatical structure of language share a surprising number of characteristics that may be intrinsically related in child development. The current study aimed to understand the potential influence of musical rhythmic priming on subsequent spoken grammar task performance in children with typical development who were native speakers of English. Participants (ages 5-8?years) listened to rhythmically regular and irregular musical sequences (within-participants design) followed by blocks of grammatically correct and incorrect sentences upon which they were asked to perform a grammaticality judgment task. Rhythmically regular musical sequences improved performance in grammaticality judgment compared with rhythmically irregular musical sequences. No such effect of rhythmic priming was found in two nonlinguistic control tasks, suggesting a neural overlap between rhythm processing and mechanisms recruited during grammar processing. These findings build on previous research investigating the effect of rhythmic priming by extending the paradigm to a different language, testing a younger population, and employing nonlanguage control tasks. These findings of an immediate influence of rhythm on grammar states (temporarily augmented grammaticality judgment performance) also converge with previous findings of associations between rhythm and grammar traits (stable generalized grammar abilities) in children. Taken together, the results of this study provide additional evidence for shared neural processing for language and music and warrant future investigations of potentially beneficial effects of innovative musical material on language processing.
| S-EPMC5986615 | biostudies-literature
Project description:Individuals with autism spectrum disorders (ASD) tend to make inadequate social judgments, particularly when the nonverbal and verbal emotional expressions of other people are incongruent. Although previous behavioral studies have suggested that ASD individuals have difficulty in using nonverbal cues when presented with incongruent verbal-nonverbal information, the neural mechanisms underlying this symptom of ASD remain unclear. In the present functional magnetic resonance imaging study, we compared brain activity in 15 non-medicated adult males with high-functioning ASD to that of 17 age-, parental-background-, socioeconomic-, and intelligence-quotient-matched typically-developed (TD) male participants. Brain activity was measured while each participant made friend or foe judgments of realistic movies in which professional actors spoke with conflicting nonverbal facial expressions and voice prosody. We found that the ASD group made significantly less judgments primarily based on the nonverbal information than the TD group, and they exhibited significantly less brain activity in the right inferior frontal gyrus, bilateral anterior insula, anterior cingulate cortex/ventral medial prefrontal cortex (ACC/vmPFC), and dorsal medial prefrontal cortex (dmPFC) than the TD group. Among these five regions, the ACC/vmPFC and dmPFC were most involved in nonverbal-information-biased judgments in the TD group. Furthermore, the degree of decrease of the brain activity in these two brain regions predicted the severity of autistic communication deficits. The findings indicate that diminished activity in the ACC/vmPFC and dmPFC underlies the impaired abilities of individuals with ASD to use nonverbal content when making judgments regarding other people based on incongruent social information.
| S-EPMC3382122 | biostudies-literature
Project description:Acceptability judgments have been an important tool in language research. By asking a native speaker whether a linguistic token is acceptable, linguists and psycholinguists can collect negative evidence and directly test predictions by linguistic and psycholinguistic theories, which provide important insight into the human language capacity. In this paper, we first give a brief overview of this method including: (1) the linking hypothesis for this method, (2) the controversy about the test, and (3) limitations of the current analysis of the results. Then, we propose a new way of analyzing the data: Signal Detection Theory. Signal Detection Theory has been used in many other psychological research areas such as recognition memory and clinical assessments. In this paper, using two examples, we show how Signal Detection Theory can be applied to judgment data. The benefits of this approach are that it can: (1) show how well participants can differentiate the acceptable sentences from unacceptable ones and (2) describe the participant's bias in the judgment. We conclude with a discussion of remaining questions and future directions.
| S-EPMC7005104 | biostudies-literature
Project description:We investigated how information on a motive to lie impacts on the perceived content quality of a statement and its subsequent veracity rating. In an online study, 300 participants rated a statement about an alleged sexual harassment on a scale based on Criteria-based Content Analysis (CBCA) and judged its veracity. In a 3 × 3 between-subjects design, we varied prior information (motive to lie, no motive to lie, and no information on a motive), and presented three different statement versions of varying content quality (high, medium, and low). In addition to anticipating main effects of both independent variables (motive information and statement version), we predicted that the impact of motive information on both ratings would be highest for medium quality statements, because their assessment is especially ambiguous (interaction effect). Contrary to our hypotheses, results showed that participants were unaffected by motive information and accurately reproduced the manipulated quality differences between statement versions in their CBCA-based judgments. In line with the expected interaction effect, veracity ratings decreased in the motive-to-lie group compared to controls, but only when the medium- and the low-quality statements were rated (truth ratings dropped from approximately 80 to 50%). Veracity ratings in both the no-motive-to-lie group and controls did not differ across statement versions (?82% truth ratings). In sum, information on a motive to lie thus encouraged participants to consider content quality in their veracity judgments by being critical only of statements of medium and low quality. Otherwise, participants judged statements to be true irrespective of content quality.
| S-EPMC7457127 | biostudies-literature
Project description:BackgroundGlobal coherence rating scales have been used by a number of researchers to examine spoken discourse in populations with and without acquired neurogenic communication disorders. The 4-point global coherence (GC) scale in the current study has demonstrated reliability and convergent validity. However, we have not yet established how a global coherence rating corresponds to functional communication.AimsThe current study explores the clinical meaningfulness of the 4-point GC rating scale. Survey questions and ratings were developed to examine discourse quality and functional coherence as perceived by untrained listeners. Ratings by untrained listeners were compared to trained discourse ratings using the established 4-point GC scale.MethodsTwelve discourse samples, scored by a trained rater, were selected for the current study from a previously collected set of discourse transcripts. Transcripts were extended monologues in response to one of four possible open-ended questions that were re-recorded by the trained rater to remove any distracting features of the original recordings, such as articulatory errors. Twenty-four untrained listeners rated the discourse samples using a short questionnaire that included questions for each sample about: topic maintenance, inclusion of unnecessary information, and the listener level of interest and attention. Questions for untrained listeners were based on operational definitions of global coherence and discourse quality respectively. These untrained ratings were compared to trained ratings of global coherence. Outcome measures were compared using non-parametric tests and a Spearman Rank Order test was also used to examine relationships among variables.Outcomes and resultsUntrained listeners' ratings for topic maintenance and inclusion of unnecessary information were significantly different between trained low, medium, and high global coherence ratings. Topic maintenance and inclusion of unnecessary information were also both significantly correlated with global coherence. Untrained listeners' ratings of their level of interest and attention for a sample were significantly different between trained medium-high and low-high global coherence ratings. Interest and attention ratings were also significantly correlated with ratings of global coherence.ConclusionsUntrained raters did differentiate between levels of global coherence using ratings of topic maintenance, inclusion of unnecessary information, and their level of attention and interest. Global coherence was also significantly correlated with the untrained ratings. These findings provide preliminary external validity for the global coherence scale and support its clinical utility.
| S-EPMC7500540 | biostudies-literature
Project description:Effective interventions promoting healthier eating behavior among adolescents are urgently needed. One factor that has been shown to impact effectiveness is whether the target population accepts the intervention. While previous research has assessed adults' acceptance of eating-related interventions, research on the opinion of adolescents is lacking. The current study addressed this gap in the literature.Two thousand seven hundred sixty four adolescents (aged 10-17 years) from four European countries answered questions about individual characteristics (socio-demographics, anthropometrics, and average daily intake of healthy and unhealthy foods) and the acceptability of ten eating-related intervention strategies. These strategies varied in type (either promoting healthy eating or discouraging unhealthy eating), level of intrusiveness, setting (home, school, broader out-of-home environment), and change agent (parents, teacher, policy makers).Based on adolescents' acceptability ratings, strategies could be clustered into two categories, those promoting healthy eating and those discouraging unhealthy eating, with acceptability rated significantly higher for the former. Acceptability of intervention strategies was rated moderate on average, but higher among girls, younger, overweight and immigrant adolescents, and those reporting healthier eating. Polish and Portuguese adolescents were overall more accepting of strategies than UK and Dutch adolescents.Adolescents preferred intervention strategies that promote healthy eating over strategies that discourage unhealthy eating. Level of intrusiveness affected acceptability ratings for the latter type of strategies only. Various individual and behavioral characteristics were associated with acceptability. These findings provide practical guidance for the selection of acceptable intervention strategies to improve adolescents' eating behavior.
| S-EPMC4700578 | biostudies-other
Project description:This paper contributes to the task of defining the relationship between the results of production and rating experiments in the context of language variation. We address the following research question: how may the grammatical options available to a single speaker be distributed in the two domains of production and perception? We argue that previous studies comparing acceptability judgments and frequencies of occurrence suffer from significant limitations. We approach the correspondence of production and perception data by adopting an experimental design different from those used in previous research: (i) instead of using a corpus we use production data obtained experimentally from respondents who are later asked to make judgments, (ii) instead of pairwise phenomena we examine language variation, (iii) judgments are collected formally using the conditions and materials from the production experiment, (iv) we analyze the behavior of each participant across the production and acceptability judgment experiments. In particular, we examine three phenomena of variation in Russian: case variation in nominalizations, gender mismatch, and case variation in paucal constructions. Our results show that there is substantial alignment between acceptability ratings and frequency of occurrence. However, the distribution of frequencies and acceptability scores do not always correlate. Speakers are not consistent in choosing a single variant across the two types of experiment. Importantly, the types of inconsistency they display differ, which means that the variation can be characterized from this point of view. We conclude that the degree of coherence of the two experiments reflects the effects of the evolution of variation over time. Another result is that elicited production and acceptability judgments vary with respect to how they reveal variation in language. In the case of the development or disappearance of variants, production indicates this earlier than judgments, and the rating task has the effect of restricting the choices available to respondents. However, the production method should not thereby be considered more sensitive. We argue that only a combination of production and judgment data makes it possible to estimate the directionality of changes in variability and to see the full distribution of different variants.
| S-EPMC7136902 | biostudies-literature
Project description:OBJECTIVE:Fuzzy-trace theory is a dual-process model of memory, reasoning, judgment, and decision making that contrasts with traditional expectancy-value approaches. We review the literature applying fuzzy-trace theory to health with 3 aims: evaluating whether the theory's basic distinctions have been validated empirically in the domain of health; determining whether these distinctions are useful in assessing, explaining, and predicting health-related psychological processes; and determining whether the theory can be used to improve health judgments, decisions, or behaviors, especially compared to other approaches. METHOD:We conducted a literature review using PubMed, PsycINFO, and Web of Science to identify empirical peer-reviewed papers that applied fuzzy-trace theory, or central constructs of the theory, to investigate health judgments, decisions, or behaviors. RESULTS:Seventy nine studies (updated total is 94 studies; see Supplemental materials) were identified, over half published since 2012, spanning a wide variety of conditions and populations. Study findings supported the prediction that verbatim and gist representations are distinct constructs that can be retrieved independently using different cues. Although gist-based reasoning was usually associated with improved judgment and decision making, 4 sources of bias that can impair gist reasoning were identified. Finally, promising findings were reported from intervention studies that used fuzzy-trace theory to improve decision making and decrease unhealthy risk taking. CONCLUSIONS:Despite large gaps in the literature, most studies supported all 3 aims. By focusing on basic psychological processes that underlie judgment and decision making, fuzzy-trace theory provides insights into how individuals make decisions involving health risks and suggests innovative intervention approaches to improve health outcomes. (PsycINFO Database Record
| S-EPMC4979567 | biostudies-literature
Project description:BackgroundReceiving extraneous articles in response to a query submitted to MEDLINE/PubMed is common. When submitting a multi-word query (which is the majority of queries submitted), the presence of all query words within each article may be a necessary condition for retrieving relevant articles, but not sufficient. Ideally a relationship between the query words in the article is also required. We propose that if two words occur within an article, the probability that a relation between them is explained is higher when the words occur within adjacent sentences versus remote sentences. Therefore, sentence-level concurrence can be used as a surrogate for existence of the relationship between the words. In order to avoid the irrelevant articles, one solution would be to increase the search specificity. Another solution is to estimate a relevance score to sort the retrieved articles. However among the >30 retrieval services available for MEDLINE, only a few estimate a relevance score, and none detects and incorporates the relation between the query words as part of the relevance score.ResultsWe have developed "Relemed", a search engine for MEDLINE. Relemed increases specificity and precision of retrieval by searching for query words within sentences rather than the whole article. It uses sentence-level concurrence as a statistical surrogate for the existence of relationship between the words. It also estimates a relevance score and sorts the results on this basis, thus shifting irrelevant articles lower down the list. In two case studies, we demonstrate that the most relevant articles appear at the top of the Relemed results, while this is not necessarily the case with a PubMed search. We have also shown that a Relemed search includes not only all the articles retrieved by PubMed, but potentially additional relevant articles, due to the extended 'automatic term mapping' and text-word searching features implemented in Relemed.ConclusionBy using sentence-level matching, Relemed can deliver higher specificity, thus eliminating more false-positive articles. By introducing an appropriate relevance metric, the most relevant articles on which the user wishes to focus are listed first. Relemed also shrinks the displayed text, and hence the time spent scanning the articles.
| S-EPMC1780044 | biostudies-literature