Dataset Information

Enhancing the Efficiency of Confrontation Naming Assessment for Aphasia Using Computer Adaptive Testing.

ABSTRACT: Purpose In this study, we investigated the agreement between the 175-item Philadelphia Naming Test (PNT; Roach, Schwartz, Martin, Grewal, & Brecher, 1996 ) and a 30-item computer adaptive PNT (PNT-CAT; Fergadiotis, Kellough, & Hula, 2015 ; Hula, Kellough, & Fergadiotis, 2015 ) created using item response theory (IRT) methods. Method The full PNT and the PNT-CAT were administered to 47 participants with aphasia in counterbalanced order. Latent trait-naming ability estimates for the 2 PNT versions were analyzed in a Bayesian framework, and the agreement between them was evaluated using correlation and measures of constant, variable, and total error. We also evaluated the extent to which individual pairwise differences were credibly greater than 0 and whether the IRT measurement model provided an adequate indication of the precision of individual score estimates. Results The agreement between the PNT and the PNT-CAT was strong, as indicated by high correlation ( r = .95, 95% CI [.92, .97]), negligible bias, and low variable and total error. The number of statistically robust pairwise score differences did not credibly exceed the Type I error rate, and the precision of individual score estimates was reasonably well predicted by the IRT model. Discussion The strong agreement between the full PNT and the PNT-CAT suggests that the latter is a suitable measurement of anomia in group studies. The relatively robust estimates of score precision also suggest that the PNT-CAT can be useful for the clinical assessment of anomia in individual cases. Finally, the IRT methods used to construct the PNT-CAT provide a framework for additional development to further reduce measurement error. Supplemental Material https://doi.org/10.23641/asha.8202176.

SUBMITTER: Fergadiotis G

PROVIDER: S-EPMC6808378 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Enhancing the Efficiency of Confrontation Naming Assessment for Aphasia Using Computer Adaptive Testing.

Fergadiotis Gerasimos G Hula William D WD Swiderski Alexander M AM Lei Chia-Ming CM Kellough Stacey S

Journal of speech, language, and hearing research : JSLHR 20190603 6

Purpose In this study, we investigated the agreement between the 175-item Philadelphia Naming Test (PNT; Roach, Schwartz, Martin, Grewal, & Brecher, 1996 ) and a 30-item computer adaptive PNT (PNT-CAT; Fergadiotis, Kellough, & Hula, 2015 ; Hula, Kellough, & Fergadiotis, 2015 ) created using item response theory (IRT) methods. Method The full PNT and the PNT-CAT were administered to 47 participants with aphasia in counterbalanced order. Latent trait-naming ability estimates for the 2 PNT versions ...[more]

PMID: 31158037

Similar Datasets

Project description:BackgroundItem response theory (IRT; Lord & Novick, 1968) is a psychometric framework that can be used to model the likelihood that an individual will respond correctly to an item. Using archival data (Mirman et al., 2010), Fergadiotis, Kellough, and Hula (2015) estimated difficulty parameters for the Philadelphia Naming Test (PNT; Roach, Schwartz, Martin, Grewal, & Brecher, 1996) using the 1-parameter logistic IRT model. Although the use of IRT in test development is advantageous, its reliance on sample sizes exceeding 200 participants make it difficult to implement in aphasiology. Therefore, alternate means of estimating the item difficulty of confrontation naming test items warrant investigation. In a preliminary study aimed at automatic item calibration, Swiderski, Fergadiotis, and Hula (2016) regressed the difficulty parameters from the PNT on word length, age of acquisition (Kuperman et al., 2012), lexical frequency as quantified by the Log10CD index (Brysbaert & New, 2009), and naming latency (Székely et al., 2003). Although this model successfully explained a substantial proportion of variance in the PNT difficulty parameters, a substantial proportion (20%) of the response time data were missing. Further, only 39% of the picture stimuli from Székely and colleagues (2003) were identical to those on the PNT. Given that the IRT sample size requirements limit traditional calibration approaches in aphasiology and that the initial attempts in predicting IRT difficulty parameters in our pilot study were based on incomplete response time data this study has two specific aims.AimsTo estimate naming latencies for the 175 items on the PNT, and assess the utility of psycholinguistic variables and naming latencies for predicting item difficulty.Methods and proceduresUsing a speeded picture naming task we estimated mean naming latencies for the 175 items of the Philadelphia Naming test in 44 cognitively healthy adults. We then re-estimated the model reported by Swiderski et al (2016) with the new naming latency data.ResultsThe predictor variables described above accounted for a substantial proportion of the variance in the item difficulty parameters (Adj. R 2 = .692).ConclusionsIn this study we demonstrated that word length, age of acquisition, lexical frequency, and naming latency from neurotypical young adults usefully predict picture naming item difficulty in people with aphasia. These variables are readily available or easily obtained and the regression model reported may be useful for estimating confrontation naming item difficulty without the need for collection of response data from large samples of people with aphasia.

Project description:BackgroundImpaired naming is a ubiquitous symptom in all types of aphasia, which often adversely impacts independence, quality of life, and recovery of affected individuals. Previous research has demonstrated that naming can be facilitated by phonological and semantic cueing strategies that are largely incorporated into the treatment of anomic disturbances. Beneficial effects of cueing, whereby naming becomes faster and more accurate, are often attributed to the priming mechanisms occurring within the distributed language network.ObjectiveWe proposed and explored two novel cueing techniques: (1) Silent Visuomotor Cues (SVC), which provided articulatory information of target words presented in the form of silent videos, and (2) Semantic Auditory Cues (SAC), which consisted of acoustic information semantically relevant to target words (ringing for "telephone"). Grounded in neurophysiological evidence, we hypothesized that both SVC and SAC might aid communicative effectiveness possibly by triggering activity in perceptual and semantic language regions, respectively.MethodsTen participants with chronic non-fluent aphasia were recruited for a longitudinal clinical intervention. Participants were split into dyads (i.e., five pairs of two participants) and required to engage in a turn-based peer-to-peer language game using the Rehabilitation Gaming System for aphasia (RGSa). The objective of the RGSa sessions was to practice communicative acts, such as making a request. We administered SVCs and SACs in a pseudorandomized manner at the moment when the active player selected the object to be requested from the interlocutor. For the analysis, we compared the times from selection to the reception of the desired object between cued and non-cued trials.ResultsNaming accuracy, as measured by a standard clinical scale, significantly improved for all stimuli at each evaluation point, including the follow-up. Moreover, the results yielded beneficial effects of both SVC and SAC cues on word naming, especially at the early intervention sessions when the exposure to the target lexicon was infrequent.ConclusionsThis study supports the efficacy of the proposed cueing strategies which could be integrated into the clinic or mobile technology to aid naming even at the chronic stages of aphasia. These findings are consistent with sensorimotor accounts of language processing, suggesting a coupling between language, motor, and semantic brain regions.Trial registrationNCT02928822 . Registered 30 May 2016.

Project description:BACKGROUND: Previous work indicates that single word intelligibility tests developed for dysarthria are sensitive to segmental production errors in aphasic individuals with and without apraxia of speech. However, potential listener learning effects and difficulties adapting elicitation procedures to coexisting language impairments limit their applicability to left hemisphere stroke survivors. AIMS: The main purpose of this study was to examine basic psychometric properties for a new monosyllabic intelligibility test developed for individuals with aphasia and/or AOS. A related purpose was to examine clinical feasibility and potential to standardize a computer-mediated administration approach. METHODS #ENTITYSTARTX00026; PROCEDURES: A 600-item monosyllabic single word intelligibility test was constructed by assembling sets of phonetically similar words. Custom software was used to select 50 target words from this test in a pseudo-random fashion and to elicit and record production of these words by 23 speakers with aphasia and 20 neurologically healthy participants. To evaluate test-retest reliability, two identical sets of 50-word lists were elicited by requesting repetition after a live speaker model. To examine the effect of a different word set and auditory model, an additional set of 50 different words was elicited with a pre-recorded model. The recorded words were presented to normal-hearing listeners for identification via orthographic and multiple-choice response formats. To examine construct validity, production accuracy for each speaker was estimated via phonetic transcription and rating of overall articulation. OUTCOMES #ENTITYSTARTX00026; RESULTS: Recording and listening tasks were completed in less than six minutes for all speakers and listeners. Aphasic speakers were significantly less intelligible than neurologically healthy speakers and displayed a wide range of intelligibility scores. Test-retest and inter-listener reliability estimates were strong. No significant difference was found in scores based on recordings from a live model versus a pre-recorded model, but some individual speakers favored the live model. Intelligibility test scores correlated highly with segmental accuracy derived from broad phonetic transcription of the same speech sample and a motor speech evaluation. Scores correlated moderately with rated articulation difficulty. CONCLUSIONS: We describe a computerized, single-word intelligibility test that yields clinically feasible, reliable, and valid measures of segmental speech production in adults with aphasia. This tool can be used in clinical research to facilitate appropriate participant selection and to establish matching across comparison groups. For a majority of speakers, elicitation procedures can be standardized by using a pre-recorded auditory model for repetition. This assessment tool has potential utility for both clinical assessment and outcomes research.

Project description:BackgroundPrevious attempts to investigate the effects of semantic tasks on picture naming in both healthy controls and people with aphasia have typically been confounded by inclusion of the phonological word form of the target item. As a result, it is difficult to isolate any facilitatory effects of a semantically-focused task to either lexical-semantic or phonological processing. This functional magnetic resonance imaging (fMRI) study examined the neurological mechanisms underlying short-term (within minutes) and long-term (within days) facilitation of naming from a semantic task that did not include the phonological word form, in both participants with aphasia and age-matched controls.ResultsBehavioral results showed that a semantic task that did not include the phonological word form can successfully facilitate subsequent picture naming in both healthy controls and individuals with aphasia. The whole brain neuroimaging results for control participants identified a repetition enhancement effect in the short-term, with modulation of activity found in regions that have not traditionally been associated with semantic processing, such as the right lingual gyrus (extending to the precuneus) and the left inferior occipital gyrus (extending to the fusiform gyrus). In contrast, the participants with aphasia showed significant differences in activation over both the short- and the long-term for facilitated items, predominantly within either left hemisphere regions linked to semantic processing or their right hemisphere homologues.ConclusionsFor control participants in this study, the short-lived facilitation effects of a prior semantic task that did not include the phonological word form were primarily driven by object priming and episodic memory mechanisms. However, facilitation effects appeared to engage a predominantly semantic network in participants with aphasia over both the short- and the long-term. The findings of the present study also suggest that right hemisphere involvement may be supportive rather than maladaptive, and that a large distributed perisylvian network in both cerebral hemispheres supports the facilitation of naming in individuals with aphasia.

Dataset Information

Enhancing the Efficiency of Confrontation Naming Assessment for Aphasia Using Computer Adaptive Testing.

Publications

Enhancing the Efficiency of Confrontation Naming Assessment for Aphasia Using Computer Adaptive Testing.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets