Dataset Information

Beyond Percent Correct: Measuring Change in Individual Picture Naming Ability.

ABSTRACT:

Purpose

Meaningful changes in picture naming responses may be obscured when measuring accuracy instead of quality. A statistic that incorporates information about the severity and nature of impairments may be more sensitive to the effects of treatment.

Method

We analyzed data from repeated administrations of a naming test to 72 participants with stroke aphasia in a clinical trial for anomia therapy. Participants were divided into two groups for analysis to demonstrate replicability. We assessed reliability among response type scores from five raters. We then derived four summary statistics of naming ability and their changes over time for each participant: (a) the standard accuracy measure, (b) an accuracy measure adjusted for item difficulty, (c) an accuracy measure adjusted for item difficulty for specific response types, and (d) a distance measure adjusted for item difficulty for specific response types. While accuracy measures address the likelihood of a correct response, the distance measure reflects that different response types range in their similarity to the target. Model fit was assessed. The frequency of significant improvements and the average magnitude of improvements for each summary statistic were compared between treatment groups and a control group. Effect sizes for each model-based statistic were compared with the effect size for the standard accuracy measure.

Results

Interrater and intrarater reliability were near perfect, on average, though compromised somewhat by phonological-level errors. The effects of treatment were more evident, in terms of both frequency and magnitude, when using the distance measure versus the other accuracy statistics.

Conclusions

Consideration of item difficulty and response types revealed additional effects of treatment on naming scores beyond those observed for the standard accuracy measure. The results support theories that assume naming ability is decomposable into subabilities rather than being monolithic, suggesting new opportunities for measuring treatment outcomes.

Supplemental material

https://doi.org/10.23641/asha.17019515.

SUBMITTER: Walker GM

PROVIDER: S-EPMC9154021 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:The aim of the present study was to clarify the conditions under which anodal tDCS applied to left hemisphere language sites may facilitate picture naming latencies in healthy young adults. We built upon previous studies by directly testing for item-specific and generalized effects of tDCS through manipulation of item-familiarization and through testing for both online and offline effects of stimulation, in the same paradigm. In addition, we tested for the robustness of these effects by comparing two left hemisphere sites critical for lexical retrieval. Twenty-eight healthy young adults completed two testing sessions receiving either anodal (1.5 mA, 20 min) or sham stimulation (1.5 mA, 30 s) in each session. Half of the participants received tDCS over the left inferior frontal region and the other half over the left posterior superior temporal region. All participants were asked to a name a set of pictures and their response latencies were compared at three time points (before, during, and after the end of stimulation). The stimulus set was constructed so that some items were presented at all time points, some before and after stimulation, and some during stimulation only. A parsimonious linear mixed effects model (LMM) revealed robust repetition priming effects as latencies were reliably faster for previously named items in all conditions. However, active tDCS did not produce any additional facilitation in relation to sham, and even led to slower performance in the IFG group when the stimulated items differed from those tested at baseline and post-test. Our findings add to the present debate about the efficacy of single-session tDCS for modulation of lexical retrieval in healthy young adults. We conclude that future research should take a more systematic, step-wise approach to the application of tDCS to the study of language and that more sensitive experimental paradigms, which include a training element, are more adapted to the study of cognitive processes in populations with optimal levels of cortical excitability.