Dataset Information

Reliability and validity of the Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP).

ABSTRACT:

Background

The Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) is a tool which is capable of both identifying the priorities of the individual patient and measuring the outcomes relevant to him/her, resulting in a Patient Benefit Index (PBI) with range 0-3, indicating how much benefit the patient had experienced from the admission. The aim of this study was to evaluate the reliability, validity, responsiveness and interpretability of the P-BAS HOP.

Methods

A longitudinal study among hospitalised older patients with a baseline interview during hospitalisation and a follow-up by telephone 3 months after discharge. Test-retest reliability of the baseline and follow-up questionnaire were tested. Percentage of agreement, Cohen's kappa with quadratic weighting and maximum attainable kappa were calculated per item. The PBI was calculated for both test and retest of baseline and follow-up and compared with Intraclass Correlation Coefficient (ICC). Construct validity was tested by evaluating pre-defined hypotheses comparing the priority of goals with experienced symptoms or limitations at admission and the achievement of goals with progression or deterioration of other constructs. Responsiveness was evaluated by correlating the PBI with the anchor question 'How much did you benefit from the admission?'. This question was also used to evaluate the interpretability of the PBI with the visual anchor-based minimal important change distribution method.

Results

Reliability was tested with 53 participants at baseline and 72 at follow-up. Mean weighted kappa of the baseline items was 0.38. ICC between PBI of the test and retest was 0.77. Mean weighted kappa of the follow-up items was 0.51. ICC between PBI of the test and retest was 0.62. For the construct validity, tested in 451 participants, all baseline hypotheses were confirmed. From the follow-up hypotheses, tested in 344 participants, five of seven were confirmed. The Spearman's correlation coefficient between the PBI and the anchor question was 0.51. The optimal cut-off point was 0.7 for 'no important benefit' and 1.4 points for 'important benefit' on the PBI.

Conclusions

Although the concept seems promising, the reliability and validity of the P-BAS HOP appeared to be not yet satisfactory. We therefore recommend adapting the P-BAS HOP.

SUBMITTER: van der Kluit MJ

PROVIDER: S-EPMC7923656 | biostudies-literature | 2021 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability and validity of the Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP).

van der Kluit Maria Johanna MJ Dijkstra Geke J GJ de Rooij Sophia E SE

BMC geriatrics 20210301 1

<h4>Background</h4>The Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) is a tool which is capable of both identifying the priorities of the individual patient and measuring the outcomes relevant to him/her, resulting in a Patient Benefit Index (PBI) with range 0-3, indicating how much benefit the patient had experienced from the admission. The aim of this study was to evaluate the reliability, validity, responsiveness and interpretability of the P-BAS HOP.<h4>Methods ...[more]

PMID: 33648447

Similar Datasets

Project description:ObjectivesTo support the shift from disease-oriented towards goal-oriented care, we aimed to develop a tool which is capable both to identify priorities of an individual older hospitalised patient and to measure the outcomes relevant to him.DesignMixed-methods design with open interviews, three step test interviews (TSTIs) and a quantitative field test.SettingUniversity teaching hospital and a regional teaching hospital.ParticipantsHospitalised patients ages 70 years and older.ResultsThe Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) consists of a baseline questionnaire and an evaluation questionnaire. Items were based on 15 qualitative interviews with hospitalised older patients. Feedback from a panel of four community-dwelling older persons resulted in some adaptations to wording and one additional item. Twenty-six hospitalised older patients participated in TSTIs with Version 1 of the baseline questionnaire, revealing indications for a good content validity and barriers in completion behaviour, global understanding and understanding of individual items, which were solved with several adaptations. Four additions were made by participants. After TSTIs with ten patients with the evaluation questionnaire, one adaptation was made. A field test with 91 hospitalised older patients revealed a small number of missing values.To enhance the feasibility, the number of items was reduced from 32 to 22, based on correlations and mean impact score. The field test was repeated with 104 other patients in a regional teaching hospital. To enhance the understanding, the tool was split into two phases. This version was tested with TSTIs with eight patients and appeared to be understandable. The final version was an interview-based tool and took about 11 min to complete.ConclusionsThe P-BAS HOP is a potentially suitable tool to identify priorities and relevant outcomes of the individual patient. Further research is needed to investigate its validity, reliability and responsiveness.

Project description:BackgroundThe Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) is a tool developed to both identify the priorities of the individual patient and to measure the outcomes relevant to him/her, resulting in a Patient Benefit Index (PBI), indicating how much benefit the patient had experienced from the hospitalisation. The reliability and the validity of the P-BAS HOP appeared to be not yet satisfactory and therefore the aims of this study were to adapt the P-BAS HOP and transform it into a picture version, resulting in the P-BAS-P, and to evaluate its feasibility, reliability, validity, responsiveness and interpretability.MethodsProcess of instrument development and evaluation performed among hospitalised older patients including pilot tests using Three-Step Test-Interviews (TSTI), test-retest reliability on baseline and follow-up, comparing the PBI with Intraclass Correlation Coefficient (ICC), and hypothesis testing to evaluate the construct validity. Responsiveness of individual P-BAS-P scores and the PBI with two different weighing schemes were evaluated using anchor questions. Interpretability of the PBI was evaluated with the visual anchor-based minimal important change (MIC) distribution method and computation of smallest detectable change (SDC) based on ICC.ResultsFourteen hospitalised older patients participated in TSTIs at baseline and 13 at follow-up after discharge. After several adaptations, the P-BAS-P appeared feasible with good interviewer's instructions. The pictures were considered relevant and helpful by the participants. Reliability was tested with 41 participants at baseline and 50 at follow-up. ICC between PBI1 and PBI2 of baseline test and retest was 0.76, respectively 0.73. At follow-up 0.86, respectively 0.85. For the construct validity, tested in 169 participants, hypotheses regarding importance of goals were confirmed. Regarding status of goals, only the follow-up status was confirmed, baseline and change were not. The responsiveness of the individual scores and PBI were weak, resulting in poor interpretability with many misclassifications. The SDC was larger than the MIC.ConclusionsThe P-BAS-P appeared to be a feasible instrument, but there were methodological barriers for the evaluation of the reliability, validity, and responsiveness. We therefore recommend further research into the P-BAS-P.

Project description:BackgroundFalls are a common and serious public health issue among older adults, contributing to the loss of independence, psychological distress, and incapability to engage in meaningful occupations, etc. However, there is a lack of abundant information about the fall risk self-evaluation scale for community-dwelling older people. Therefore, this study aimed to evaluate the preliminary reliability and validity of the fall risk self-assessment scale (FRSAS) among community-dwelling older adults.MethodsA cross-sectional study was conducted. A total of 230 individuals aged 65 years and over were recruited by a convenience sampling between October and December 2020 from three communities in Haidian district, Beijing. Eligible participants were required to fill in the general condition questionnaire and the fall risk self-assessment scale. The reliability and validity were analyzed by using SPSS 20.0.ResultsTwo hundred twenty-two participants completed the assessment as required (the completion rate was 96.52%). The most items of FRSAS were understood by older adults, which was completed in 10 min. Cronbach's α and intraclass correlation coefficient ICC (2,1) of the scale were 0.757 and 0.967 respectively, suggesting good internal consistency and test-retest reliability. Exploratory factor analysis yielded 14 factors that explained 61.744% of the variance. Five items failed to be categorized into any factors because the factor loading of these items was less than 0.4. A future large-sample study needs to be conducted to explore its construct validity. The total scores and dimensional scores except for C-dimension showed significant differences between participants who had experienced a fall in the previous 6 months and those who had not (P < 0.05), indicating good discriminant validity.ConclusionsThe fall risk self-assessment scale including 41 items demonstrated relatively high feasibility as well as satisfactory results in the internal consistency, test-retest reliability, and discriminant validity.Trial registrationRegistration number: ChiCTR2000038856 ; Date of registration: 7 Oct 2020.

Project description:OBJECTIVES:Although more than 1.8 million people survive snakebite envenomation each year, their recovery is understudied. Obtaining long-term follow-up is challenging in both high- and low-resource settings. The Patient-Specific Functional Scale (PSFS) is an easily administered, well-accepted patient-reported outcome that is validated for assessing limb recovery from snakebite envenomation. We studied whether the PSFS is valid and reliable when administered by telephone. METHODS:This is a secondary analysis of data from a randomized clinical trial. We analyzed the results of PSFS collected in-person on days 3, 7, 14, 21, and 28 and by telephone on days 10, 17, and 24. We assessed the following scale psychometric properties: (a) content validity (ceiling and floor effects), (b) internal structure and consistency (Cronbach's alpha), and (c) temporal and external validity using Intraclass Correlation Coefficient (ICC). Temporal stability was assessed using Spearman's correlation coefficient and agreement between adjacent in-person and telephonic assessments with Cohen's kappa. Bland Altman analysis was used to assess differential bias in low and high score results. RESULTS:Data from 74 patients were available for analysis. Floor effects were seen in the early post-injury time points (median: 3 (IQR: 0, 5) at 3 days post-enrollment) and ceiling effects in the late time points (median: 9 (IQR: 8, 10). Internal consistency was good to excellent with both in-person (Cronbach ?: 0.91 (95%CI 0.88, 0.95)) and telephone administration (0.81 (0.73, 0.89). Temporal stability was also good (ICC: 0.83 (0.72, 0.89) in-person, 0.80 (0.68, 0.88) telephone). A strong linear correlation was found between in-person and telephone administration (Spearman's ?: 0.83 (CI: 0.78, 0.84), consistency was assessed as excellent (Cohen's ? 0.81 (CI: 0.78, 0.84), and Bland Altman analysis showed no systematic bias. CONCLUSIONS:Telephone administration of the PSFS provides valid, reliable, and consistent data for the assessment of recovery from snakebite envenomation.

Dataset Information

Reliability and validity of the Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP).

Background

Methods

Results

Conclusions

Publications

Reliability and validity of the Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets