Dataset Information

Development and psychometric assessment of a novel survey to measure care coordination from the specialist's perspective.

ABSTRACT:

Objective

To develop an online survey of care coordination with primary care providers as experienced by medical specialists, evaluate its psychometric properties, and test its construct validity.

Data sources

Physicians (N = 633) from 13 medical specialties across the Veterans Health Administration.

Study design

We developed the survey based on prior work (literature review, specialist interviews) and by adapting existing measures and developing new items. Multitrait scaling analysis and confirmatory factor analysis were used to assess scale structure. We used multiple linear regression to examine the relationship of the final coordination scales to specialists' overall experience of care coordination.

Data collection

November 2016-December 2016.

Principal findings

Results suggest a 13-item, four-factor survey [Relationships (k = 4), Roles and Responsibilities (k = 4), Communication (k = 3), and Data Transfer (k = 2)] that measures the medical specialist experience of coordination with good internal consistency reliability, convergent validity, discriminant validity, and goodness of fit. Together, the four scales explained nearly 50 percent of the variance in specialists' overall experience of care coordination.

Conclusions

The 13-item Coordination of Specialty Care-Specialist Survey (CSC-Specialist) is the first of its kind. It can be used alone or embedded in other surveys to measure four domains of care coordination as experienced by medical specialists.

SUBMITTER: Vimalananda VG

PROVIDER: S-EPMC6505682 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and psychometric assessment of a novel survey to measure care coordination from the specialist's perspective.

Vimalananda Varsha G VG Fincke Benjamin Graeme BG Qian Shirley S Waring Molly E ME Seibert Ryan G RG Meterko Mark M

Health services research 20190402 3

<h4>Objective</h4>To develop an online survey of care coordination with primary care providers as experienced by medical specialists, evaluate its psychometric properties, and test its construct validity.<h4>Data sources</h4>Physicians (N = 633) from 13 medical specialties across the Veterans Health Administration.<h4>Study design</h4>We developed the survey based on prior work (literature review, specialist interviews) and by adapting existing measures and developing new items. Multitrait scali ...[more]

PMID: 30941764

Similar Datasets

Project description:ObjectiveTo assess the psychometric properties and construct validity of a survey of primary care providers' (PCPs') experience of specialty care coordination, which is a counterpart to our existing survey ("CSC-Specialist") that measures specialists' experience of specialty care coordination.Data sourcesWe surveyed PCPs from Veterans Health Administration medical centers and community-based outpatient clinics nationwide (N = 1576) in April 2018.Study designWe developed candidate items through literature review, existing surveys, PCP interviews, and expert opinion. We used exploratory and confirmatory factor analysis to develop scales and multivariable linear regression to determine their association with PCPs' overall experience of coordination.Data collectionThe online survey included 23 candidate scale items about specialty care coordination and a single item asking respondents to rate their overall experience of specialty care coordination on a 0-10 scale. All VA PCPs were eligible. We sent survey invitations to PCPs following local Section Chiefs' email introduction (N = 926) and by directly emailing two random samples (N = 400 and N = 6653), overall response rate across the three nonoverlapping samples = 24 percent.Principal findingsAnalyses identified 20 items forming 6 scales with strong psychometric properties and predictive power for overall coordination. Two scales are identical to CSC-Specialist scales: "Communication" (k = 3, α = 0.87) and "Data Transfer" (k = 2, α = 0.92); one is similar: "Relationships and Collaboration" (k = 6, α = 0.90). The three remaining scales address the PCP's unique perspective: "Role Clarity" (k = 3, α = 0.85), "Role Agreement" (k = 3, α = 0.75), and "Making Referrals" (k = 3, α = 0.75). The six scales together explained 67 percent of the variance in PCPs' overall coordination experience with specialists.ConclusionsThe Coordination of Specialty Care-Primary Care Provider Survey (CSC-PCP) is a novel 20-item survey that can be used in quality improvement or health services research, alone or in combination with the CSC-Specialist, to evaluate coordination of care as experienced by either or both participants.

Project description:BACKGROUND:Although the importance of care coordination (CC) is well-recognized, cancer patients often receive poorly coordinated care across varied care settings and different oncology providers. Efforts to improve cancer care are hampered by lack of adequate measures. In this two-part, mixed-method study, we describe the development, refinement, and validation of a new care coordination instrument (CCI) designed to assess cancer patients' perception of CC. METHODS:In Study 1, an initial CCI was developed incorporating questions based on literature review. The items were then modified following four field tests conducted in a large academic hospital with oncology nurses (n?=?20) and cancer patients (n?=?120). This modified instrument was used to determine whether the CCI was able to distinguish CC between two practices (30 GI and 30 myeloma patients) within the same hospital setting. In Study 2, 68 patients receiving community-based care participated in seven focus groups. Based on these discussions, the CCI items were again refined, and psychometric evaluation was conducted to assess the quality of the instrument. RESULTS:Based on field tests, 3 domains of the CCI, Communication, Navigation, and Operational, were defined as critical components of CC. The Operational domain evaluates efficiency of care and is unique to this CCI. The field test demonstrated that GI patients reported significantly better CC Overall and for the Communication and Navigation domains (all p?<?.05). In Study 2, patients expressed concordance with the CCI items and their CC experiences, establishing validity of the CCI. Qualitative analysis of the focus group discussions indicated that the items with the highest frequencies of participants' comments were related to the concepts of Navigator, Team, Survey, and Communication. Quantitative analysis identified items with a limited response range or high rates of "neutral" responses; accordingly, those items were removed. The final CCI survey is a 29 item, multiple-choice questionnaire with excellent reliability, Cronbach's ??=?.922. CONCLUSIONS:We developed a novel, patient-centered tool with excellent psychometric properties that can be utilized across varied practice settings to assess patients' perception of cancer care coordination. TRIAL REGISTRATION:Not required; retrospectively registered ClinicalTrials.gov NCT03594006 20 July 2018.

Project description:BACKGROUND:Successfully implementing eMental health (eMH) interventions in routine mental health care constitutes a major challenge. Reliable instruments to assess implementation progress are essential. The Normalization MeAsure Development (NoMAD) study developed a brief self-report questionnaire that could be helpful in measuring implementation progress. Based on the Normalization Process Theory, this instrument focuses on 4 generative mechanisms involved in implementation processes: coherence, cognitive participation, collective action, and reflexive monitoring. OBJECTIVE:The aim of this study was to translate the NoMAD questionnaire to Dutch and to confirm the factor structure in Dutch mental health care settings. METHODS:Dutch mental health care professionals involved in eMH implementation were invited to complete the translated NoMAD questionnaire. Confirmatory factor analysis (CFA) was conducted to verify interpretability of scale scores for 3 models: (1) the theoretical 4-factor structure, (2) a unidimensional model, and (3) a hierarchical model. Potential improvements were explored, and correlated scale scores with 3 control questions were used to assess convergent validity. RESULTS:A total of 262 professionals from mental health care settings in the Netherlands completed the questionnaire (female: 81.7%; mean age: 45 [SD=11]). The internal consistency of the 20-item questionnaire was acceptable (.62≤alpha≤.85). The theorized 4-factor model fitted the data slightly better in the CFA than the hierarchical model (Comparative Fit Index=0.90, Tucker Lewis Index=0.88, Root Mean Square Error of Approximation=0.10, Standardized Root Mean Square Residual=0.12, χ22=22.5, P≤.05). However, the difference is small and possibly not outweighing the practical relevance of a total score and subscale scores combined in one hierarchical model. One item was identified as weak (λCA.2=0.10). A moderate-to-strong convergent validity with 3 control questions was found for the Collective Participation scale (.47≤r≤.54, P≤.05). CONCLUSIONS:NoMAD's theoretical factor structure was confirmed in Dutch mental health settings to acceptable standards but with room for improvement. The hierarchical model might prove useful in increasing the practical utility of the NoMAD questionnaire by combining a total score with information on the 4 generative mechanisms. Future research should assess the predictive value and responsiveness over time and elucidate the conceptual interpretability of NoMAD in eMH implementation practices.

Project description:PurposeSpecialty care coordination relies on information flowing bidirectionally between all three participants in the "specialty care triad" - patients, primary care providers (PCPs), and specialists. Measures of coordination should strive to account for the perspectives of each. As we previously developed two surveys to measure coordination of specialty care as experienced by PCPs and specialists, this study aimed to develop and evaluate the psychometric properties of a related survey of specialty care coordination as experienced by the patient, thereby completing the suite of surveys among the triad.MethodsWe developed a draft survey based on literature review, patient interviews, adaptation of existing measures, and development of new items. Survey responses were collected via mail and online in two waves, August 2019-November 2019 and September 2020-May 2021, among patients (N=939) receiving medical specialty care and primary care in the Veterans Affairs health system. Exploratory and confirmatory factor analysis were used to assess scale structure. Multiple linear regression was used to examine the relationship of the final coordination scales to patients' overall experience of specialty care coordination.ResultsA 38-item measure representing 10 factors that assess the patient's experience of coordination in specialty care among the patient, PCP, and specialist was finalized. Scales demonstrated good internal consistency reliability and, together, explained 59% of the variance in overall coordination. Analyses revealed an unexpected construct describing organization of care between patient and specialist that accounted for patient goals and preferences; this 10-item scale was named Patient-Centered Care Coordination.ConclusionsThe final survey, Coordination of Specialty Care - Patient, or CSC-Patient for short, is a reliable instrument that can be used alone or with its companions (CSC-PCP, CSC-Specialist) to provide a detailed assessment of specialty care coordination and identify targets for coordination improvement.

Project description:Headache disorders are both common and burdensome but, given the many people affected, provision of health care to all is challenging. Structured headache services based in primary care are the most efficient, equitable and cost-effective solution but place responsibility for managing most patients on health-care providers with limited training in headache care. The development of practical management aids for primary care is therefore a purpose of the Global Campaign against Headache. This manuscript presents an outcome measure, the Headache Under-Response to Treatment (HURT) questionnaire, describing its purpose, development, psychometric evaluation and assessment for clinical utility. The objective was a simple-to-use instrument that would both assess outcome and provide guidance to improving outcome, having utility across the range of headache disorders, across clinical settings and across countries and cultures.After literature review, an expert consensus group drawn from all six world regions formulated HURT through item development and item reduction using item-response theory. Using the American Migraine Prevalence and Prevention Study's general-population respondent panel, two mailed surveys assessed the psychometric properties of HURT, comparing it with other instruments as external validators. Reliability was assessed in patients in two culturally-contrasting clinical settings: headache specialist centres in Europe (n = 159) and primary-care centres in Saudi Arabia (n = 40). Clinical utility was assessed in similar settings (Europe n = 201; Saudi Arabia n = 342).The final instrument, an 8-item self-administered questionnaire, addressed headache frequency, disability, medication use and effect, patients' perceptions of headache "control" and their understanding of their diagnoses. Psychometric evaluation revealed a two-factor model (headache frequency, disability and medication use; and medication efficacy and headache control), with scale properties apparently stable across disorders and correlating well and in the expected directions with external validators. The literature review found few instruments linking assessment to clinical advice or suggested actions: HURT appeared to fill this gap. In European specialist care, it showed utility as an outcome measure across headache disorders. In Saudi Arabian primary care, HURT (translated into Arabic) was reliable and responsive to clinical change.With demonstrated validity and clinical utility across disorders, cultures and settings, HURT is available for clinical and research purposes.

Dataset Information

Development and psychometric assessment of a novel survey to measure care coordination from the specialist's perspective.

Objective

Data sources

Study design

Data collection

Principal findings

Conclusions

Publications

Development and psychometric assessment of a novel survey to measure care coordination from the specialist's perspective.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets