Dataset Information

Validation of PROMIS ® Physical Function computerized adaptive tests for orthopaedic foot and ankle outcome research.

ABSTRACT:

Background

In 2012, the American Orthopaedic Foot & Ankle Society(®) established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting.

Questions/purposes

We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System(®) (PROMIS(®)) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function.

Methods

After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS(®) Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map.

Results

Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ? 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect.

Conclusions

The PROMIS(®) PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS(®) item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment.

SUBMITTER: Hung M

PROVIDER: S-EPMC3792246 | biostudies-literature | 2013 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validation of PROMIS ® Physical Function computerized adaptive tests for orthopaedic foot and ankle outcome research.

Hung Man M Baumhauer Judith F JF Latt L Daniel LD Saltzman Charles L CL SooHoo Nelson F NF Hunt Kenneth J KJ

Clinical orthopaedics and related research 20131101 11

<h4>Background</h4>In 2012, the American Orthopaedic Foot & Ankle Society(®) established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting.<h4>Questions/purposes</h4>We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System(®) (PROMIS(®)) Physical Function (PF) item bank provide ...[more]

PMID: 23749433

Similar Datasets

Project description:BackgroundFor future etiologic cohort studies in runners it is important to identify whether (hyper)pronation of the foot, decreased ankle joint dorsiflexion (AJD) and the degree of the extension of the first Metatarsophalangeal joint (MTP1) are risk factors for running injuries and to determine possible sex differences.These parameters are frequently determined with the navicular drop test (NDT) Stance and Single Limb-Stance, the Ankle Joint Dorsiflexion-test, and the extension MTP1-test in a healthy population. The aim of this clinimetric study was to determine the reproducibility of these three orthopaedic tests in runners, using minimal equipment in order to make them applicable in large cohort studies. Furthermore, we aimed to determine possible sex differences of these tests.MethodsThe three orthopaedic tests were administered by two sports physiotherapists in a group of 42 (22 male and 20 female) recreational runners. The intra-class correlation (ICC) for interrater and intrarater reliability and the standard error of measurement (SEM) were calculated. Bland and Altman plots were used to determine the 95% limits of agreements (LOAs). Furthermore, the difference between female and male runners was determined.ResultsThe ICC's of the NDT were in the range of 0.37 to 0.45, with a SEM in the range of 2.5 to 5 mm. The AJD-test had an ICC of 0.88 and 0.86 (SEM 2.4° and 8.7°), with a 95% LOA of -6.0° to 6.3° and -5.3° to 7.9°, and the MTP1-test had an ICC of 0.42 and 0.62 (SEM 34.4° and 9.9°), with a 95% LOA of -30.9° to 20.7° and -20° to 17.8° for the interrater and intrarater reproducibility, respectively.Females had a significantly (p<0.05) lower navicular drop score and higher range of motion in extension of the MTP1, but no sex differences were found for ankle dorsiflexion (p ? 0.05).ConclusionThe reproducibility for the AJD test in runners is good, whereas that of the NDT and extension MTP1 was moderate or low. We found a difference in NDT and MTP1 mobility between female and male runners, however this needs to be established in a larger study with more reliable test procedures.

Project description:BackgroundThe growing social media presence in healthcare has provided physicians with new ways to engage with patients. However, foot and ankle orthopaedic surgeons have been found to underuse social media platforms despite their known benefits for patients and surgeons. Thus, this study sought to investigate the reasons for this phenomenon and to identify potential barriers to social media utilization in clinical practice.MethodsA 19-question survey was distributed to active attending physicians identified through the American Orthopaedic Foot & Ankle Society membership database. The survey included demographic, practice characteristics, and social media use questions assessed by a 5-point Likert scale. Logistic regression was used to identify predictors of positive attitudes toward social media.ResultsFifty-eight surgeons were included. Most respondents were male (n = 43, 74.1%), in private practice (n = 31, 53.5%), and described their practice to be greater than 51% elective procedures (n = 46, 79.4%). The average years in practice was 14.8 years (standard deviation, SD: 10.0 years). A total of 32.8% (n = 19) of surgeons reported using social media as part of their clinical practice. Facebook (n = 19, 32.8%), a professional website or blog (n = 18, 31.0%), and LinkedIn (n = 15, 25.9%) were the most used platforms-primarily for practice marketing or brand development (n = 19, 32.8%). A total of 58.6% (n = 34) of surgeons reported they did not use social media. The primary reasons were the time commitment (n = 31, 53.5%), concerns about obscuring professional boundaries (n = 22, 37.9%), and concerns regarding confidentiality (n = 11, 19.0%). Many surgeons reported that social media positively influences foot and ankle surgery (n = 23, 39.7%), although no individual predictors for these views could be identified.ConclusionsFoot and ankle orthopaedic surgeons tended to view social media use positively, but the time investment and concerns over professionalism and confidentiality pose challenges to its use. Given the influence of a surgeon's social media identity on patient satisfaction and practice building, efforts should be made to streamline social media use for foot and ankle surgeons to establish their online presence.Level of evidenceLevel IV, cross-sectional study.

Project description:ObjectivesThe American Orthopaedic Foot and Ankle Society (AOFAS) Ankle-Hindfoot Scale is among the most commonly used instruments for measuring outcome of treatment in patients who sustained a complex ankle or hindfoot injury. It consists of a patient-reported and a physician-reported part. A validated, Dutch version of this instrument is currently not available. The aim of this study was to translate the instrument into Dutch and to determine the measurement properties of the AOFAS Ankle-Hindfoot Scale Dutch language version (DLV) in patients with a unilateral ankle fracture.SettingMulticentre (two Dutch hospitals), prospective observational study.ParticipantsIn total, 142 patients with a unilateral ankle fracture were included. Ten patients were lost to follow-up.Primary and secondary outcome measuresPatients completed the subjective (patient-reported) part of the AOFAS Ankle-Hindfoot Scale-DLV. A physician or trained physician-assistant completed the physician-reported part. For comparison and evaluation of the measuring characteristics, the Foot Function Index and the Short Form-36 were completed by the patient. Descriptive statistics (including floor and ceiling effects), reliability (ie, internal consistency), construct validity, reproducibility (ie, test-retest reliability, agreement and smallest detectable change) and responsiveness were determined.ResultsThe AOFAS-DLV and its subscales showed good internal consistency (Cronbach's α >0.90). Construct validity and longitudinal validity were proven to be adequate (76.5% of predefined hypotheses were confirmed). Floor effects were not present. Ceiling effects were present from 6 months onwards, as expected. Responsiveness was adequate, with a smallest detectable change of 12.0 points.ConclusionsThe AOFAS-DLV is a reliable, valid and responsive measurement instrument for evaluating functional outcome in patients with a unilateral ankle fracture. This implies that the questionnaire is suitable to compare different treatment modalities within this population or to compare outcome across hospitals.Trial registrationThe Netherlands Trial Register (NTR5613; 05-jan-2016).

Project description:OBJECTIVES:The American Orthopaedic Foot and Ankle Society (AOFAS) Ankle-Hindfoot Scale is among the most used questionnaires for measuring functional recovery after a hindfoot injury. Recently, this instrument was translated and culturally adapted into a Dutch version. In this study, the measurement properties of the Dutch language version (DLV) were investigated in patients with a unilateral hindfoot fracture. DESIGN:Multicentre, prospective observational study. SETTING:This multicentre study was conducted in three Dutch hospitals. PARTICIPANTS:In total, 118 patients with a unilateral hindfoot fracture were included. Three patients were lost to follow-up. PRIMARY AND SECONDARY OUTCOME MEASURES:Patients were asked to complete the AOFAS-DLV, the Foot Function Index and the Short Form-36 on three occasions. Descriptive statistics (including floor and ceiling effects), reliability (ie, internal consistency), construct validity, reproducibility (ie, test-retest reliability, agreement and smallest detectable change (SDC)) and responsiveness were determined. RESULTS:Internal consistency was inadequate for the AOFAS-DLV total scale (?=0.585), but adequate for the function subscale (?=0.863). The questionnaire had adequate construct validity (82.4% of predefined hypotheses were confirmed), but inadequate longitudinal validity (70.6%). No floor effects were found, but ceiling effects were present in all AOFAS-DLV (sub)scales, most pronounced from 6 to 24 months after trauma onwards. Responsiveness was only adequate for the pain and alignment subscales, with a SDC of 1.7 points. CONCLUSIONS:The AOFAS Ankle-Hindfoot Scale DLV has adequate construct validity and is reliable, making it a suitable instrument for cross-sectional studies investigating functional outcome in patients with a hindfoot fracture. The inadequate longitudinal validity and responsiveness, however, hamper the use of the questionnaire in longitudinal studies and for assessing long-term functional outcome. TRIAL REGISTRATION NUMBER:NTR5613; Post-results.

Project description:BackgroundA crucial component to improving patient care is better clinician understanding of patients' health-related quality of life (HRQoL). In orthopaedic surgery, HRQoL assessment instruments such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), provide surgeons with a framework to assess how a treatment or medical condition is affecting each patient's HRQoL. PROMIS has been demonstrated as a valuable instrument in many diseases; however, the extent to which orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research is unclear.MethodsSystematic scoping methodology was used to investigate the characteristics of studies using PROMIS to assess HRQoL measures as orthopaedic surgical outcomes as well as studies validating computerized adaptive test (CAT) PROMIS physical health (PH) domains including: Physical Function (PF), Upper Extremity (UE), Lower Extremity (LE).ResultsA systematic search of PubMed identified 391 publications utilizing PROMIS in orthopaedics; 153 (39%) were PROMIS PH CAT validation publications. One-hundred publications were in Hand and Upper Extremity, 69 in Spine, 44 in Adult Reconstruction, 43 in Foot and Ankle, 43 in Sports, 37 in Trauma, 31 in General orthopaedics, and 24 in Tumor. From 2011 through 2020 there was an upward trend in orthopaedic PROMIS publications each year (range, 1-153) and an increase in studies investigating or utilizing PROMIS PH CAT domains (range, 1-105). Eighty-five percent (n = 130) of orthopaedic surgery PROMIS PH CAT validation publications (n = 153) analyzed PF; 30% (n = 46) analyzed UE; 3% (n = 4) analyzed LE.ConclusionsPROMIS utilization within orthopaedics as a whole has significantly increased within the past decade, particularly within PROMIS CAT domains. The existing literature reviewed in this scoping study demonstrates that PROMIS PH CAT domains (PF, UE, and LE) are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. The expanded use of PROMIS CATs in orthopaedic surgery highlights the potential for improved quality of patient care. While challenges of integrating PROMIS into electronic medical records exist, expanded use of PROMIS CAT measurement instruments throughout orthopaedic surgery should be performed. Plain english summary In orthopaedic surgery, health-related quality of life tools such as the NIH developed Patient Reported Outcomes Measurement Information System (PROMIS), offer patients an opportunity to better understand their medical condition and be involved in their own care. Additionally, PROMIS provides surgeons with a framework to assess how a treatment or medical condition is affecting each patient's functional status and quality of life. The efficacy of PROMIS has been demonstrated in many diseases; however, its application throughout orthopaedic care has yet to be depicted. This study sought to identify the extent to which all orthopaedic surgery subspecialties have used and validated PROMIS measures in peer-reviewed research in order to identify its potential as an applicable and valuable tool across specialties. We determined that PROMIS utilization has significantly increased within the past decade. The existing literature reviewed in this scoping study demonstrates that the PROMIS computerized adaptive test domains evaluating physical function status are reliable, responsive, and interpretable in most contexts of patient care throughout all orthopaedic surgery subspecialties. Based on these results, this study recommends the expanded and more uniform use of PROMIS computerized adaptive test measurement instruments in the clinical care of orthopaedic patients.

Dataset Information

Validation of PROMIS ® Physical Function computerized adaptive tests for orthopaedic foot and ankle outcome research.

Background

Questions/purposes

Methods

Results

Conclusions

Publications

Validation of PROMIS ® Physical Function computerized adaptive tests for orthopaedic foot and ankle outcome research.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets