Dataset Information

Development of an IRT-Based Short Form to Assess Applied Cognitive Function in Outpatient Rehabilitation.

ABSTRACT: Item response theory and computerized adaptive testing methods allow the development of a large calibrated item bank from which different subsets of questions can be selected for administration and scored on a common scale. The objective of this study was to develop an outpatient rehabilitation self-report short form for the Activity Measure for Post-Acute Care Applied Cognition item bank.Using data from a convenience sample of 235 rehabilitation outpatients, item content and item response theory-based test information function parameters were used in item selection. Internal consistency reliability, intraclass correlation coefficient (ICC), and percentage at the lowest (floor) and highest (ceiling) scores were evaluated for the short form and full item bank.A 15-item short form was developed. The internal consistency of the short form was 0.86. The ICC3,1 for the short form and item bank was 0.97 (95% confidence interval, 0.94-0.98). No floor effects were noted, and ceiling effects were 27.66% (short form) and 26.38% (full item bank).The Applied Cognition outpatient short form demonstrated acceptable psychometric properties and provides a bridge to item response theory-based measurement for settings where point-of-care computing is not available.

SUBMITTER: McDonough CM

PROVIDER: S-EPMC4685010 | biostudies-literature | 2016 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of an IRT-Based Short Form to Assess Applied Cognitive Function in Outpatient Rehabilitation.

McDonough Christine M CM Ni Pengsheng P Coster Wendy J WJ Haley Stephen M SM Jette Alan M AM

American journal of physical medicine & rehabilitation 20160101 1

<h4>Objective</h4>Item response theory and computerized adaptive testing methods allow the development of a large calibrated item bank from which different subsets of questions can be selected for administration and scored on a common scale. The objective of this study was to develop an outpatient rehabilitation self-report short form for the Activity Measure for Post-Acute Care Applied Cognition item bank.<h4>Design</h4>Using data from a convenience sample of 235 rehabilitation outpatients, ite ...[more]

PMID: 26135369

Similar Datasets

Project description:Neurofeedback therapy (NFT) has been used within a number of populations however it has not been applied or thoroughly examined as a form of cognitive rehabilitation within a stroke population. Objectives for this systematic review included: i) identifying how NFT is utilized to treat cognitive deficits following stroke, ii) examining the strength and quality of evidence to support the use of NFT as a form of cognitive rehabilitation therapy (CRT) and iii) providing recommendations for future investigations. Searches were conducted using OVID (Medline, Health Star, Embase + Embase Classic) and PubMed databases. Additional searches were completed using the Cochrane Reviews library database, Google Scholar, the University of Toronto online library catalogue, ClinicalTrials.gov website and select journals. Searches were completed Feb/March 2015 and updated in June/July/Aug 2015. Eight studies were eligible for inclusion in this review. Studies were eligible for inclusion if they: i) were specific to a stroke population, ii) delivered CRT via a NFT protocol, iii) included participants who were affected by a cognitive deficit(s) following stroke (i.e. memory loss, loss of executive function, speech impairment etc.). NFT protocols were highly specific and varied within each study. The majority of studies identified improvements in participant cognitive deficits following the initiation of therapy. Reviewers assessed study quality using the Downs and Black Checklist for Measuring Study Quality tool; limited study quality and strength of evidence restricted generalizability of conclusions regarding the use of this therapy to the greater stroke population. Progression in this field requires further inquiry to strengthen methodology quality and study design. Future investigations should aim to standardize NFT protocols in an effort to understand the dose-response relationship between NFT and improvements in functional outcome. Future investigations should also place a large emphasis on long-term participant follow-up.

Project description:BackgroundFace-to-face outpatient cardiac rehabilitation (OCR) programs are an important and effective component in the management of cardiovascular disease. However, these programs have low participation rates, especially among patients who live rural or remote. Hence, there is a need to develop OCR programs that provide an alternative to face-to-face contact such as by using the Internet. Only a very limited number of Internet-based OCR programs have been developed and evaluated. Therefore, the purpose of this study was to identify issues that are relevant to the development of an Internet-based OCR intervention.MethodsA three-round Delphi study among cardiac rehabilitation experts was conducted. In the first round, 43 experts outlined opinions they had on the development of an online ORC platform into an open-ended electronic questionnaire. In the second round, 42 experts completed a structured (five-point scale) electronic questionnaire based on first round results, in which they scored items on their relevance. In the third round, the same experts were asked to re-rate the same items after feedback was given about the group median relevance score to establish a level of consensus.ResultsAfter the third round, high consensus was reached in 120 of 162 (74%) questionnaire items, of which 93 (57% of 162 items) also had high relevance according to the experts. The results indicate that experts strongly agreed on desired website content, data obtained from the patient, and level of interaction with patients that should be part of an Internet-based OCR intervention.ConclusionThe high rates of consensus and relevance observed among cardiac rehabilitation experts are an indication that they perceived the development and implementation of an Internet-based ORC intervention as feasible, and as a valuable alternative to face-to-face programs. In many ways the experts indicated that an Internet-based ORC program should mimic a traditional face-to-face program, and emphasize the crucial role of the cardiac rehabilitation manager who interacts with patients from a distance. The present study revealed practical insights into how Internet OCR interventions should be designed and opens the door for the development of such an intervention to be subsequently examined in a longitudinal and experimental study.

Project description:BackgroundThe Rapkin and Schwartz appraisal theory and measure provided a path toward documenting response-shift effects and describing individual differences in ways of thinking about quality of life (QOL) that distinguished people in different circumstances. Recent work developed and validated the QOL Appraisal Profileversion 2 (QOLAPv2), an 85-item measure that taps response-shift-detection domains of Frame of Reference, Standards of Comparison, Sampling of Experience, and Combinatory Algorithm. Recent theoretical work proposed that appraisal measurement constitutes a new class of measurement (idiometric), distinct from psychometric and clinimetric. To validate an idiometric measure, one would document that its items reflect different circumstances and population characteristics, and explain variance in QOL. The present work sought to develop idiometric short-forms of the QOLAPv2 item bank by examining which items were most informative, retaining the appraisal-domain structure.MethodsThis secondary analysis (n = 1481) included chronically-ill patients and their caregivers from a longitudinal web-based survey (mean follow-up 16.6 months). Data included the QOLAPv2, the Center for Disease Control Healthy Days Core Module, the PROMIS-10 Global Health, and demographic/medical variables. Appraisal items were measured at baseline (relevant to understanding cognitive appraisal processes); and with change scores (sensitive to response-shift effects). Multivariate analysis of covariance examined what demographic and health-status change variables were reflected by each of 85 appraisal items (in five sets), as dependent variables, and other demographic/medical variables. Multiple linear regression examined how appraisal items explained variance in global physical- and mental-health change, after covariate adjustment. A tally summarized item performance across all five sets of cross-sectional and longitudinal analyses.ResultsThe vast majority (i.e., 80%) of the QOLAPv2 items performed well across the analyses presented. Using a relatively strict criterion of explaining meaningful variance across 60% of analyses, one would retain 68 items. A more lenient criterion (40%) would retain 71.ConclusionsThe present study provides heuristics to support investigators' creating 'discretionary' QOLAPv2 short-forms to fit their study aim and amplifying individual differences in the cognitive processes underlying QOL. This approach enables adapting the measure to the study population, as per the expectation that respondent populations differ in the predominant cognitive processes used.

Project description:BackgroundCardiac distress may be viewed as a persistent negative emotional state that spans multiple psychosocial domains and challenges a patient's capacity to cope with living with their heart condition. The Cardiac Distress Inventory (CDI) is a disease-specific clinical assessment tool that captures the complexity of this distress. In busy settings such as primary care, cardiac rehabilitation, and counselling services, however, there is a need to administer briefer tools to aid in identification and screening. The aim of the present study was to develop a short, valid screening version of the CDI.MethodsA total of 405 participants reporting an acute coronary event in the previous 12 months was recruited from three hospitals, through social media and by direct enrolment on the study website. Participants completed an online survey which included the full version of the CDI and general distress measures including the Kessler K6, Patient Health Questionnaire-4, and Emotion Thermometers. Relationship of the CDI with these instruments, Rasch analysis model fit and clinical expertise were all used to select items for the short form (CDI-SF). Construct validity and receiver operating characteristics in relation to the Kessler K6 were examined.ResultsThe final 12 item CDI-SF exhibited excellent internal consistency indicative of unidimensionality and good convergent and discriminant validity in comparison to clinical status measures, all indicative of good construct validity. Using the K6 validated cutoff of ≥ 18 as the reference variable, the CDI-SF had a very high Area Under the Curve (AUC) (AUC = 0.913 (95% CI: 0.88 to 0.94). A CDI-SF score of ≥ 13 was found to indicate general cardiac distress which may warrant further investigation using the original CDI.ConclusionThe psychometric findings detailed here indicate that the CDI-SF provides a brief psychometrically sound screening measure indicative of general cardiac distress, that can be used in both clinical and research settings.

Dataset Information

Development of an IRT-Based Short Form to Assess Applied Cognitive Function in Outpatient Rehabilitation.

Publications

Development of an IRT-Based Short Form to Assess Applied Cognitive Function in Outpatient Rehabilitation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets