Dataset Information

Adaptation of the Patient Benefit Assessment Scale for Hospitalised Older Patients: development, reliability and validity of the P-BAS picture version.

ABSTRACT:

Background

The Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) is a tool developed to both identify the priorities of the individual patient and to measure the outcomes relevant to him/her, resulting in a Patient Benefit Index (PBI), indicating how much benefit the patient had experienced from the hospitalisation. The reliability and the validity of the P-BAS HOP appeared to be not yet satisfactory and therefore the aims of this study were to adapt the P-BAS HOP and transform it into a picture version, resulting in the P-BAS-P, and to evaluate its feasibility, reliability, validity, responsiveness and interpretability.

Methods

Process of instrument development and evaluation performed among hospitalised older patients including pilot tests using Three-Step Test-Interviews (TSTI), test-retest reliability on baseline and follow-up, comparing the PBI with Intraclass Correlation Coefficient (ICC), and hypothesis testing to evaluate the construct validity. Responsiveness of individual P-BAS-P scores and the PBI with two different weighing schemes were evaluated using anchor questions. Interpretability of the PBI was evaluated with the visual anchor-based minimal important change (MIC) distribution method and computation of smallest detectable change (SDC) based on ICC.

Results

Fourteen hospitalised older patients participated in TSTIs at baseline and 13 at follow-up after discharge. After several adaptations, the P-BAS-P appeared feasible with good interviewer's instructions. The pictures were considered relevant and helpful by the participants. Reliability was tested with 41 participants at baseline and 50 at follow-up. ICC between PBI₁ and PBI₂ of baseline test and retest was 0.76, respectively 0.73. At follow-up 0.86, respectively 0.85. For the construct validity, tested in 169 participants, hypotheses regarding importance of goals were confirmed. Regarding status of goals, only the follow-up status was confirmed, baseline and change were not. The responsiveness of the individual scores and PBI were weak, resulting in poor interpretability with many misclassifications. The SDC was larger than the MIC.

Conclusions

The P-BAS-P appeared to be a feasible instrument, but there were methodological barriers for the evaluation of the reliability, validity, and responsiveness. We therefore recommend further research into the P-BAS-P.

SUBMITTER: van der Kluit MJ

PROVIDER: S-EPMC8751090 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) is a tool which is capable of both identifying the priorities of the individual patient and measuring the outcomes relevant to him/her, resulting in a Patient Benefit Index (PBI) with range 0-3, indicating how much benefit the patient had experienced from the admission. The aim of this study was to evaluate the reliability, validity, responsiveness and interpretability of the P-BAS HOP.MethodsA longitudinal study among hospitalised older patients with a baseline interview during hospitalisation and a follow-up by telephone 3 months after discharge. Test-retest reliability of the baseline and follow-up questionnaire were tested. Percentage of agreement, Cohen's kappa with quadratic weighting and maximum attainable kappa were calculated per item. The PBI was calculated for both test and retest of baseline and follow-up and compared with Intraclass Correlation Coefficient (ICC). Construct validity was tested by evaluating pre-defined hypotheses comparing the priority of goals with experienced symptoms or limitations at admission and the achievement of goals with progression or deterioration of other constructs. Responsiveness was evaluated by correlating the PBI with the anchor question 'How much did you benefit from the admission?'. This question was also used to evaluate the interpretability of the PBI with the visual anchor-based minimal important change distribution method.ResultsReliability was tested with 53 participants at baseline and 72 at follow-up. Mean weighted kappa of the baseline items was 0.38. ICC between PBI of the test and retest was 0.77. Mean weighted kappa of the follow-up items was 0.51. ICC between PBI of the test and retest was 0.62. For the construct validity, tested in 451 participants, all baseline hypotheses were confirmed. From the follow-up hypotheses, tested in 344 participants, five of seven were confirmed. The Spearman's correlation coefficient between the PBI and the anchor question was 0.51. The optimal cut-off point was 0.7 for 'no important benefit' and 1.4 points for 'important benefit' on the PBI.ConclusionsAlthough the concept seems promising, the reliability and validity of the P-BAS HOP appeared to be not yet satisfactory. We therefore recommend adapting the P-BAS HOP.

Project description:ObjectivesTo support the shift from disease-oriented towards goal-oriented care, we aimed to develop a tool which is capable both to identify priorities of an individual older hospitalised patient and to measure the outcomes relevant to him.DesignMixed-methods design with open interviews, three step test interviews (TSTIs) and a quantitative field test.SettingUniversity teaching hospital and a regional teaching hospital.ParticipantsHospitalised patients ages 70 years and older.ResultsThe Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) consists of a baseline questionnaire and an evaluation questionnaire. Items were based on 15 qualitative interviews with hospitalised older patients. Feedback from a panel of four community-dwelling older persons resulted in some adaptations to wording and one additional item. Twenty-six hospitalised older patients participated in TSTIs with Version 1 of the baseline questionnaire, revealing indications for a good content validity and barriers in completion behaviour, global understanding and understanding of individual items, which were solved with several adaptations. Four additions were made by participants. After TSTIs with ten patients with the evaluation questionnaire, one adaptation was made. A field test with 91 hospitalised older patients revealed a small number of missing values.To enhance the feasibility, the number of items was reduced from 32 to 22, based on correlations and mean impact score. The field test was repeated with 104 other patients in a regional teaching hospital. To enhance the understanding, the tool was split into two phases. This version was tested with TSTIs with eight patients and appeared to be understandable. The final version was an interview-based tool and took about 11 min to complete.ConclusionsThe P-BAS HOP is a potentially suitable tool to identify priorities and relevant outcomes of the individual patient. Further research is needed to investigate its validity, reliability and responsiveness.

Project description:Background: A short version of the Posttraumatic Diagnostic Scale (PDS) comprising only re-experiencing symptom items has been recently validated on Japanese adults. This short-version-PDS had good psychometric properties among Japanese adults with and without posttraumatic stress disorder (PTSD). The aim of this study was to translate and culturally validate the short-version-PDS for the Brazilian sociolinguistic context. Methods: A translation of the short-version-PDS was performed based on established guidelines. We enrolled 53 patients with PTSD as a potential comorbidity. The translation and cross-cultural adaptation of the short-version-PDS included forward and back-translation by a Japanese Brazilian researcher and a certified translator; synthesis was achieved by consensus, backward translation, pilot test, and finalization. Content validity coefficient (CVC) was used to assess quality of adaptation. Internal consistency was calculated using Cronbach's alpha coefficient. Spearman correlations were between the new short-version-PDS and the Brazilian version of the posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5), and a receiver operating characteristic (ROC) curve was used to determine the best cut-off values for the short-version-PDS. Results: The short-version-PDS was well accepted by all subjects, none of the questions were experienced as inappropriate, and all questions of the 3 items were judged important. Item 1 presented CVCt = 0.92; item 2 had a CVCt = 0.87 and item 3 had a CVCt = 0.95. The internal consistency of the final version as measured by Cronbach's alpha was 0.78. The short-version-PDS scale correlated positively with the DSM-5 scale with a Spearman rho of 0.64 (95%CI [0.4-0.8], p < 0.001). The receiver operating characteristic (ROC) curve value was 0.97 (95%CI [0.9-1.0], p < 0.001). The cut-off score for a maximum Youden Index of 0.8 to distinguish moderate from severe from slight PTSD was > 31.0 with sensitivity and specificity are 86.4 and 93.5%, respectively. Conclusions: This Brazilian Portuguese version of the short-version-PDS had good psychometric properties among Brazilian adults with and without PTSD. Transferability and generalizability of the cut-off scores should be further analyzed.

Project description:Mediterranean Diet management for people with cardiovascular disease (CVD) or CVD risk is supported by evidence. However, there is no valid Chinese language instrument for the measurement of adherence to this diet. The objective of this study was to generate a Chinese version of the Mediterranean Diet Scale (MDS-Chinese) and to validate a self-administered version with Chinese participants with CVD or CVD risk. The MDS-Chinese was created by translation and cultural adaptation and tested for psychometric properties. A panel of 10 experts in the field, who evaluated the MDS-Chinese content, showed that the content validity index ranged from 0.88 to 1.00. Sixteen native Chinese speakers with CVD or CVD risk evaluated the clarity of the MDS-Chinese, and the resulting instruction and items clarity scores ranged from 9.2 to 10.0. A total of 326 participants completed the MDS-Chinese and a Chinese version of the Coronary Artery Disease Education Questionnaire-Short Version (CADE-Q SV). Analysis indicated that the MDS-Chinese has 4 factors, and the Pearson's correlation between the MDS-Chinese and CADE-Q SV was 0.73. Fifty randomly selected participants completed the MDS-Chinese again with a 1-week interval to assess reliability. Internal consistency was acceptable (Cronbach's α was 0.62) and the inter-class correlation reliability coefficients (ICC) for each item ranged from 0.73 to 0.88. This study showed that the MDS-Chinese has acceptable reliability and validity for use among those in the Chinese population with CVD or CVD risk. Given that diet is one of the key secondary prevention strategies for management in cardiac rehabilitation, the MDS-Chinese instrument may be a useful and convenient tool for use with those in the Chinese population with CVD or with high risk of CVD, to monitor the level of Mediterranean diet (MD) adherence, information which is important for clinical practice. In addition, the establishment of the MDS-Chinese gives a fundamental tool for diet-related CVD research in the Chinese population. Moreover, employment of the MDS-Chinese in the Chinese community may improve awareness of the importance of a healthy diet in CVD prevention and management. Clinical Trial Registration: http://www.chictr.org.cn/enIndex.aspx, identifier: ChiCTR2000032810.

Project description:BackgroundThe Exercise Adherence Rating Scale (EARS) is a commonly used outcome tool, which helps to identify the adherence rate of exercises and reasons for adherence and non-adherence. There is no evidence of the availability of any measurement tools to assess exercise adherence in the Nepalese context and cultural background. Therefore, we conducted a cross-cultural adaptation of the EARS into the Nepali language and investigated its reliability and validity.MethodsCross-cultural adaptation of the EARS was done based on Beaton guidelines. Psychometric properties were evaluated among 18 participants aged 18 years or older with pre-diabetes or confirmed diagnosis of any disease who were prescribed with home exercises by physiotherapists. Any disease that limited participants from doing exercise and individuals unwilling to participate were excluded. Reliability was evaluated through internal consistency, using Cronbach's alpha. Exploratory Factor Analysis (EFA) was performed to explore construct validity and confirm its unidimensionality. Receiver Operating Characteristic (ROC) curve was analyzed to identify cut-off score, sensitivity and specificity of the tool.ResultsThe Cronbach's alpha was 0.94 for EARS-adherence behavior. The EFA of 6-items adherence behavior revealed the presence of one factor with an eigenvalue exceeding one. The scree-plot suggested for extraction of only one factor with strong loading (75.84%). The Area Under the Curve was 0.91 with 95% confidence interval 0.77-1.00 at p = 0.004. The cutoff score was found 17.5 with 89% sensitivity and 78% specificity.ConclusionsThe EARS was cross-culturally adapted to the Nepali language. The reliability and construct validity of the Nepali version of the EARS were acceptable to assess exercise adherence in Nepali-speaking individuals. This validated tool might facilitate the evaluation of exercise-related interventions. Future studies could investigate other psychometric properties of the Nepali EARS.

Project description:BackgroundThe clinical relevance of resilience has received considerable attention in recent years. The aim of this study is to demonstrate the reliability and validity of the Japanese version of the Resilience Scale (RS) and short version of the RS (RS-14).FindingsThe original English version of RS was translated to Japanese and the Japanese version was confirmed by back-translation. Participants were 430 nursing and university psychology students. The RS, Center for Epidemiologic Studies Depression Scale (CES-D), Rosenberg Self-Esteem Scale (RSES), Social Support Questionnaire (SSQ), Perceived Stress Scale (PSS), and Sheehan Disability Scale (SDS) were administered. Internal consistency, convergent validity and factor loadings were assessed at initial assessment. Test-retest reliability was assessed using data collected from 107 students at 3 months after baseline. Mean score on the RS was 111.19. Cronbach's alpha coefficients for the RS and RS-14 were 0.90 and 0.88, respectively. The test-retest correlation coefficients for the RS and RS-14 were 0.83 and 0.84, respectively. Both the RS and RS-14 were negatively correlated with the CES-D and SDS, and positively correlated with the RSES, SSQ and PSS (all p < 0.05), although the correlation between the RS and CES-D was somewhat lower than that in previous studies. Factor analyses indicated a one-factor solution for RS-14, but as for RS, the result was not consistent with previous studies.ConclusionsThis study demonstrates that the Japanese version of RS has psychometric properties with high degrees of internal consistency, high test-retest reliability, and relatively low concurrent validity. RS-14 was equivalent to the RS in internal consistency, test-retest reliability, and concurrent validity. Low scores on the RS, a positive correlation between the RS and perceived stress, and a relatively low correlation between the RS and depressive symptoms in this study suggest that validity of the Japanese version of the RS might be relatively low compared with the original English version.