Dataset Information

Measuring the quality of patients' goals and action plans: development and validation of a novel tool.

ABSTRACT: The purpose of this study is to develop and test reliability, validity, and utility of the Goal-Setting Evaluation Tool for Diabetes (GET-D). The effectiveness of diabetes self-management is predicated on goal-setting and action planning strategies. Evaluation of self-management interventions is hampered by the absence of tools to assess quality of goals and action plans. To address this gap, we developed the GET-D, a criteria-based, observer rating scale that measures the quality of patients' diabetes goals and action plans.We conducted 3-stage development of GET-D, including identification of criteria for observer ratings of goals and action plans, rater training and pilot testing; and then performed psychometric testing of the GET-D.Trained raters could effectively rate the quality of patient-generated goals and action plans using the GET-D. Ratings performed by trained evaluators demonstrated good raw agreement (94.4%) and inter-rater reliability (Kappa = 0.66). Scores on the GET-D correlated well with measures theoretically associated with goal-setting, including patient activation (r=.252, P<.05), diabetes specific self-efficacy (r=.376, P<.001) and inverse relationship with depression (r= -.376, P<.01). Significant between group differences (P<.01) in GET-D scores between goal-setting intervention (mean = 7.33, standard deviation = 4.4) and education groups (mean = 4.93, standard deviation = 3.9) confirmed construct validity of the GET-D.The GET-D can reliably and validly rate the quality of goals and action plans. It holds promise as a measure of intervention fidelity for clinical interventions that promote diabetes self-management behaviors to improve clinical outcomes.Clinicaltrials.gov Identifier: NCT00481286.

SUBMITTER: Teal CR

PROVIDER: S-EPMC3544573 | biostudies-literature | 2012 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring the quality of patients' goals and action plans: development and validation of a novel tool.

Teal Cayla R CR Haidet Paul P Balasubramanyam Ajay S AS Rodriguez Elisa E Naik Aanand D AD

BMC medical informatics and decision making 20121227

<h4>Background</h4>The purpose of this study is to develop and test reliability, validity, and utility of the Goal-Setting Evaluation Tool for Diabetes (GET-D). The effectiveness of diabetes self-management is predicated on goal-setting and action planning strategies. Evaluation of self-management interventions is hampered by the absence of tools to assess quality of goals and action plans. To address this gap, we developed the GET-D, a criteria-based, observer rating scale that measures the qua ...[more]

PMID: 23270422

Similar Datasets

Project description:BACKGROUND: Anticoagulation can reduce quality of life, and different models of anticoagulation management might have different impacts on satisfaction with this component of medical care. Yet, to our knowledge, there are no scales measuring quality of life and satisfaction with anticoagulation that can be generalized across different models of anticoagulation management. We describe the development and preliminary validation of such an instrument - the Duke Anticoagulation Satisfaction Scale (DASS). METHODS: The DASS is a 25-item scale addressing the (a) negative impacts of anticoagulation (limitations, hassles and burdens); and (b) positive impacts of anticoagulation (confidence, reassurance, satisfaction). Each item has 7 possible responses. The DASS was administered to 262 patients currently receiving oral anticoagulation. Scales measuring generic quality of life, satisfaction with medical care, and tendency to provide socially desirable responses were also administered. Statistical analysis included assessment of item variability, internal consistency (Cronbach's alpha), scale structure (factor analysis), and correlations between the DASS and demographic variables, clinical characteristics, and scores on the above scales. A follow-up study of 105 additional patients assessed test-retest reliability. RESULTS: 220 subjects answered all items. Ceiling and floor effects were modest, and 25 of the 27 proposed items grouped into 2 factors (positive impacts, negative impacts, this latter factor being potentially subdivided into limitations versus hassles and burdens). Each factor had a high degree of internal consistency (Cronbach's alpha 0.78-0.91). The limitations and hassles factors consistently correlated with the SF-36 scales measuring generic quality of life, while the positive psychological impact scale correlated with age and time on anticoagulation. The intra-class correlation coefficient for test-retest reliability was 0.80. CONCLUSIONS: The DASS has demonstrated reasonable psychometric properties to date. Further validation is ongoing. To the degree that dissatisfaction with anticoagulation leads to decreased adherence, poorer INR control, and poor clinical outcomes, the DASS has the potential to help identify reasons for dissatisfaction (and positive satisfaction), and thus help to develop interventions to break this cycle. As an instrument designed to be applicable across multiple models of anticoagulation management, the DASS could be crucial in the scientific comparison between those models of care.

Project description:BackgroundMeasuring quality is essential to drive improvement initiatives in hospitals. An instrument that measures healthcare quality multidimensionally and integrates patients', kin's and professionals' perspectives is lacking. We aimed to develop and validate an instrument to measure healthcare quality multidimensionally from a multistakeholder perspective.MethodsA multi-method approach started by establishing content and face validity, followed by a multi-centre study in 17 Flemish (Belgian) hospitals to assess construct validity through confirmatory factor analysis, criterion validity through determining Pearson's correlations and reliability through Cronbach's alpha measurement. The instrument FlaQuM-Quickscan measures 'Healthcare quality for patients and kin' (part 1) and 'Healthcare quality for professionals' (part 2). This bipartite instrument mirrors 15 quality items and 3 general items (the overall quality score, recommendation score and intention-to-stay score). A process evaluation was organised to identify effective strategies in instrument distribution by conducting semi-structured interviews with quality managers.ResultsBy involving experts in the development of quality items and through pilot testing by a multi-stakeholder group, the content and face validity of instrument items was ensured. In total, 13,615 respondents (5,891 Patients/kin and 7,724 Professionals) completed the FlaQuM-Quickscan. Confirmatory factor analyses showed good to very good fit and correlations supported the associations between the quality items and general items for both instrument parts. Cronbach's alphas supported the internal consistency. The process evaluation revealed that supportive technical structures and approaching respondents individually were effective strategies to distribute the instrument.ConclusionsThe FlaQuM-Quickscan is a valid instrument to measure healthcare quality experiences multidimensionally from an integrated multistakeholder perspective. This new instrument offers unique and detailed data to design sustainable quality management systems in hospitals. Based on these data, hospital management and policymakers can set quality priorities for patients', kin's and professionals' care. Future research should investigate the transferability to other healthcare systems and examine between-stakeholders and between-hospitals variation.

Project description:BackgroundImproving the coordination of cancer care is a priority area for service improvement. However, quality improvement initiatives are hindered by the lack of accurate and reliable measures of this aspect of cancer care. This study was conducted to develop a questionnaire to measures patients' experience of cancer care coordination and to assess the psychometric properties of this instrument.MethodsQuestionnaire items were developed on the basis of literature review and qualitative research involving focus groups and interviews with cancer patients, carers and clinicians. The draft instrument was completed 686 patients who had been recently treated for a newly diagnosed cancer, including patients from metropolitan, regional and rural areas of New South Wales, Australia. To assess test-retest reliability, 119 patients completed the questionnaire twice. Unreliable items those with limited variability or high levels of missing data were eliminated. Exploratory factor analysis was conducted to define the underlying factor structure of the remaining items and subscales were constructed. Correlations between these and global measures of the experience of care coordination and the quality of care were assessed.ResultsOf 40 items included in the draft questionnaire, 20 were eliminated due to poor test-retest reliability (n = 4), limited response distributions (n = 8), failure to load onto a factor (n = 7) or detrimental effect on the internal consistency of the scale (n = 1). The remaining 20 items loaded onto two factors named 'Communication' and 'Navigation', which explained 91% of the common variance. Internal consistency was with high for the instrument (Cronbach's alpha 0.88) and each subscale (Cronbach's alpha 0.87 and 0.73 respectively). There was no apparent 'floor' or 'ceiling' effect for the total score or the Communication subscale, but evidence of a ceiling effect for the Navigation subscale with 21% of respondents achieving the highest possible score. There were moderate positive associations between the total score and global measures of care coordination (r = 0.57) and quality of care (r = 0.53).ConclusionsThe instrument developed in this study demonstrated consistency and robust psychometric properties. It may provide a useful tool to measure patients' experience of cancer care coordination in future surveys and intervention studies.

Project description:BackgroundThe use of health technology by older people is coming increasingly in focus with the demographic changes. Health information technology is generally perceived as an important factor in enabling increased quality of life and reducing the cost of care for this group. Age-appropriate design and facilitation of technology adoption are important to ensure functionality and removal of various barriers to usage. Development of assessment tools and instruments for evaluating older persons' technology adoption and usage as well as measuring the effects of the interventions are of high priority. Both usability and acceptance of a specific technology or service are important factors in evaluating the impact of a health information technology intervention. Psychometric measures are seldom included in evaluations of health technology. However, basic attitudes and sentiments toward technology (eg, technophilia) could be argued to influence both the level of satisfaction with the technology itself as well as the perception of the health intervention outcome.ObjectiveThe purpose of this study is to develop a reduced and refined instrument for measuring older people's attitudes and enthusiasm for technology based on relevant existing instruments for measuring technophilia. A requirement of the new instrument is that it should be short and simple to make it usable for evaluation of health technology for older people.MethodsInitial items for the TechPH questionnaire were drawn from a content analysis of relevant existing technophilia measure instruments. An exploratory factor analysis was conducted in a random selection of persons aged 65 years or older (N=374) on eight initial items. The scale was reduced to six items, and the internal consistency and reliability of the scale were examined. Further validation was made by a confirmatory factor analysis (CFA).ResultsThe exploratory factor analysis resulted in two factors. These factors were analyzed and labeled techEnthusiasm and techAnxiety. They demonstrated relatively good internal consistency (Cronbach alpha=.72 and .68, respectively). The factors were confirmed in the CFA and showed good model fit (χ28=21.2, χ2/df=2.65, comparative fit index=0.97, adjusted goodness-of-fit index=0.95, root mean square error of approximation=0.067, standardized root mean square residual=0.036).ConclusionsThe construed TechPH score showed expected relations to external real-world criteria, and the two factors showed interesting internal relations. Different technophilia personality traits distinguish clusters with different behaviors of adaptation as well as usage of new technology. Whether there is an independent association with the TechPH score against outcomes in health technology projects needs to be shown in further studies. The instrument must also be validated in different contexts, such as other countries.

Project description:BackgroundThe extensive availability and increasing use of mobile apps for nutrition-based health interventions makes evaluation of the quality of these apps crucial for integration of apps into nutritional counseling.ObjectiveThe goal of this research was the development, validation, and reliability testing of the app quality evaluation (AQEL) tool, an instrument for evaluating apps' educational quality and technical functionality.MethodsItems for evaluating app quality were adapted from website evaluations, with additional items added to evaluate the specific characteristics of apps, resulting in 79 initial items. Expert panels of nutrition and technology professionals and app users reviewed items for face and content validation. After recommended revisions, nutrition experts completed a second AQEL review to ensure clarity. On the basis of 150 sets of responses using the revised AQEL, principal component analysis was completed, reducing AQEL into 5 factors that underwent reliability testing, including internal consistency, split-half reliability, test-retest reliability, and interrater reliability (IRR). Two additional modifiable constructs for evaluating apps based on the age and needs of the target audience as selected by the evaluator were also tested for construct reliability. IRR testing using intraclass correlations (ICC) with all 7 constructs was conducted, with 15 dietitians evaluating one app.ResultsDevelopment and validation resulted in the 51-item AQEL. These were reduced to 25 items in 5 factors after principal component analysis, plus 9 modifiable items in two constructs that were not included in principal component analysis. Internal consistency and split-half reliability of the following constructs derived from principal components analysis was good (Cronbach alpha >.80, Spearman-Brown coefficient >.80): behavior change potential, support of knowledge acquisition, app function, and skill development. App purpose split half-reliability was .65. Test-retest reliability showed no significant change over time (P>.05) for all but skill development (P=.001). Construct reliability was good for items assessing age appropriateness of apps for children, teens, and a general audience. In addition, construct reliability was acceptable for assessing app appropriateness for various target audiences (Cronbach alpha >.70). For the 5 main factors, ICC (1,k) was >.80, with a P value of <.05. When 15 nutrition professionals evaluated one app, ICC (2,15) was .98, with a P value of <.001 for all 7 constructs when the modifiable items were specified for adults seeking weight loss support.ConclusionsOur preliminary effort shows that AQEL is a valid, reliable instrument for evaluating nutrition apps' qualities for clinical interventions by nutrition clinicians, educators, and researchers. Further efforts in validating AQEL in various contexts are needed.

Project description:OBJECTIVE:Medication-related burden (MRB) is a negative experience with medicine, which may impact on psychological, social, physical and financial well-being of an individual. This study describes the development and initial validation of an instrument specifically designed to measure MRB on functioning and well-being-the Medication-Related Burden Quality of Life (MRB-QoL) tool. METHODS:An initial pool of 76-items for MRB-QoL was generated. The link to MRB-QoL survey was sent to a sample of consumers living with at least one chronic medical condition and taking ?3?prescription medicines on a regular basis. Exploratory factor analysis (EFA) was used to determine the underlining factor structure. Internal consistency (Cronbach's ?) and construct validity were examined. The latter was examined through correlation with Medication Regimen Complexity Index (MRCI), Drug Burden Index (DBI) and Charlson's Comorbidity Index (CCI). RESULTS:367 consumers completed the survey (51.2% male). EFA resulted in a 31-item, five-factor solution explaining 72% of the total variance. The five subscales were labelled as 'Routine and Regimen Complexity' (11 items), 'Psychological Burden' (six items), 'Functional and Role Limitation' (seven items), 'Therapeutic Relationship' (three items) and 'Social Burden' (four items). All subscales showed good internal consistency (Cronbach's ? 0.87 to 0.95). Discriminant validity of MRB-QoL was demonstrated via its correlations with MRCI (Spearman's r -0.16 to 0.08), DBI (r 0.12 to 0.28) and CCI (r -0.23 to -0.15). Correlation between DBI and 'Functional and Role Limitation' subscale (r 0.36) indicated some evidence of convergent validity. Patients with polypharmacy, multiple morbidity and DBI >0 had higher median scores of MRB-QoL providing evidence for known group validity. CONCLUSIONS:The MRB-QoL V.1 has good construct validity and internal consistency. The MRB-QoL may be a useful humanistic measure for evaluating the impact of pharmaceutical care interventions on patients' quality of life. Future research is warranted to further examine additional psychometric properties of MRB-QoL V.1 and its utility in patient care.

Project description:This study describes the development of a new questionnaire to measure health-related quality of life (HRQoL) in patients with type 1 diabetes (the ViDa1 questionnaire) and provides information on its psychometric properties. For its development, open interviews with patients took place and topics relevant to patients' HRQoL were identified and items were generated. Qualitative analysis of items, expert review, and refinement of the questionnaire followed. A pilot study (N = 150) was conducted to explore the underlying structure of the 40-item ViDa1 questionnaire. A Principal Component Analysis (PCA) was performed and six of the items that did not load on any of the factors were eliminated. The results supported a four-dimensional structure for ViDa1, the dimensions being Interference of diabetes in everyday life, Self-care, Well-being, and Worry about the disease. Subsequently, the PCA was repeated in a larger sample (N = 578) with the reduced 34-item version of the questionnaire, and a Confirmatory Factor Analysis (CFA) was performed (N = 428). Overall fit indices obtained presented adequate values which supported the four-factor model initially proposed [([Formula: see text] 2601.93) (p < 0.001); Root Mean Square Error of Approximation = 0.060 (CI = 0.056 -0.064)]. As regards reliability, the four dimensions of the ViDa1 demonstrated good internal consistency, with Cronbach's alphas ranging between 0.71 and 0.86. Evidence of convergent-discriminant validity in the form of high correlations with another specific HRQoL questionnaire for diabetes and low correlations with other constructs such as self-efficacy, anxiety, and depression were presented. The ViDa1 also discriminated between different aspects of clinical interest such as type of insulin treatment, presence of chronic complications, and glycemic control, temporal stability, and sensitivity to change after an intervention. In conclusion, the ViDa1 questionnaire presents adequate psychometric properties and may represent a good alternative for the evaluation of HRQoL in type 1 diabetes.

Dataset Information

Measuring the quality of patients' goals and action plans: development and validation of a novel tool.

Publications

Measuring the quality of patients' goals and action plans: development and validation of a novel tool.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets