Dataset Information

Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation.

ABSTRACT: Mixed methods are commonly used in health services research; however, data are not often integrated to explore complementarity of findings. A triangulation protocol is one approach to integrating such data. A retrospective triangulation protocol was carried out on mixed methods data collected as part of a process evaluation of a trial. The multi-country randomised controlled trial found that a web-based training in communication skills (including use of a patient booklet) and the use of a C-reactive protein (CRP) point-of-care test decreased antibiotic prescribing by general practitioners (GPs) for acute cough. The process evaluation investigated GPs' and patients' experiences of taking part in the trial.Three analysts independently compared findings across four data sets: qualitative data collected view semi-structured interviews with (1) 62 patients and (2) 66 GPs and quantitative data collected via questionnaires with (3) 2886 patients and (4) 346 GPs. Pairwise comparisons were made between data sets and were categorised as agreement, partial agreement, dissonance or silence.Three instances of dissonance occurred in 39 independent findings. GPs and patients reported different views on the use of a CRP test. GPs felt that the test was useful in convincing patients to accept a no-antibiotic decision, but patient data suggested that this was unnecessary if a full explanation was given. Whilst qualitative data indicated all patients were generally satisfied with their consultation, quantitative data indicated highest levels of satisfaction for those receiving a detailed explanation from their GP with a booklet giving advice on self-care. Both qualitative and quantitative data sets indicated higher patient enablement for those in the communication groups who had received a booklet.Use of CRP tests does not appear to engage patients or influence illness perceptions and its effect is more centred on changing clinician behaviour. Communication skills and the patient booklet were relevant and useful for all patients and associated with increased patient satisfaction. A triangulation protocol to integrate qualitative and quantitative data can reveal findings that need further interpretation and also highlight areas of dissonance that lead to a deeper insight than separate analyses.

SUBMITTER: Tonkin-Crine S

PROVIDER: S-EPMC4866290 | biostudies-other | 2016 May

REPOSITORIES: biostudies-other

ACCESS DATA

Similar Datasets

Project description:Methodologically sound mixed methods research can improve our understanding of health services by providing a more comprehensive picture of health services than either method can alone. This study describes the frequency of mixed methods in published health services research and compares the presence of methodological components indicative of rigorous approaches across mixed methods, qualitative, and quantitative articles.All empirical articles (n = 1,651) published between 2003 and 2007 from four top-ranked health services journals.All mixed methods articles (n = 47) and random samples of qualitative and quantitative articles were evaluated to identify reporting of key components indicating rigor for each method, based on accepted standards for evaluating the quality of research reports (e.g., use of p-values in quantitative reports, description of context in qualitative reports, and integration in mixed method reports). We used chi-square tests to evaluate differences between article types for each component.Mixed methods articles comprised 2.85 percent (n = 47) of empirical articles, quantitative articles 90.98 percent (n = 1,502), and qualitative articles 6.18 percent (n = 102). There was a statistically significant difference (?(2) (1) = 12.20, p = .0005, Cramer's V = 0.09, odds ratio = 1.49 [95% confidence interval = 1,27, 1.74]) in the proportion of quantitative methodological components present in mixed methods compared to quantitative papers (21.94 versus 47.07 percent, respectively) but no statistically significant difference (?(2) (1) = 0.02, p = .89, Cramer's V = 0.01) in the proportion of qualitative methodological components in mixed methods compared to qualitative papers (21.34 versus 25.47 percent, respectively).Few published health services research articles use mixed methods. The frequency of key methodological components is variable. Suggestions are provided to increase the transparency of mixed methods studies and the presence of key methodological components in published reports.

Project description:BackgroundSharing trial results with participants is an ethical imperative but often does not happen. We tested an Enhanced Webpage versus a Basic Webpage, Mailed Printed Summary versus no Mailed Printed Summary, and Email List Invitation versus no Email List Invitation to see which approach resulted in the highest patient satisfaction with how the results were communicated.Methods and findingsWe carried out a cluster randomised, 2 by 2 by 2 factorial, nonblinded study within a trial, with semistructured qualitative interviews with some patients (ISRCTN96189403). Each cluster was a UK hospital participating in the ICON8 ovarian cancer trial. Interventions were shared with 384 ICON8 participants who were alive and considered well enough to be contacted, at 43 hospitals. Hospitals were allocated to share results with participants through one of the 8 intervention combinations based on random permutation within blocks of 8, stratified by number of participants. All interventions contained a written plain English summary of the results. The Enhanced Webpage also contained a short video. Both the Enhanced Webpage and Email contained links to further information and support. The Mailed Printed Summary was opt-out. Follow-up questionnaires were sent 1 month after patients had been offered the interventions. Patients' reported satisfaction was measured using a 5-point scale, analysed by ordinal logistic regression estimating main effects for all 3 interventions, with random effects for site, restricted to those who reported receiving the results and assuming no interaction. Data collection took place in 2018 to 2019. Questionnaires were sent to 275/384 randomly selected participants and returned by 180: 90/142 allocated Basic Webpage, 90/133 Enhanced Webpage; 91/141 no Mailed Printed Summary, 89/134 Mailed Printed Summary; 82/129 no Email List Invitation, 98/146 Email List Invitation. Only 3 patients opted out of receiving the Mailed Printed Summary; no patients signed up to the email list. Patients' satisfaction was greater at sites allocated the Mailed Printed Summary, where 65/81 (80%) were quite or very satisfied compared to sites with no Mailed Printed Summary 39/64 (61%), ordinal odds ratio (OR) = 3.15 (1.66 to 5.98, p < 0.001). We found no effect on patient satisfaction from the Enhanced Webpage, OR = 1.47 (0.78 to 2.76, p = 0.235) or Email List Invitation, OR = 1.38 (0.72 to 2.63, p = 0.327). Interviewees described the results as interesting, important, and disappointing (the ICON8 trial found no benefit). Finding out the results made some feel their trial participation had been more worthwhile. Regardless of allocated group, patients who received results generally reported that the information was easy to understand and find, were glad and did not regret finding out the results. The main limitation of our study is the 65% response rate.ConclusionsNearly all respondents wanted to know the results and were glad to receive them. Adding an opt-out Mailed Printed Summary alongside a webpage yielded the highest reported satisfaction. This study provides evidence on how to share results with other similar trial populations. Further research is needed to look at different results scenarios and patient populations.Trial registrationISRCTN: ISRCTN96189403.

Project description:BACKGROUND:Dignity Therapy (DT) is a short-term intervention to reduce psychological suffering in end-of-life care. Its strength lies in evidenced-based development and investigation. The aim of the present study is to investigate the feasibility of DT at German palliative care units (PCU), as well as the acceptability and adaption of a German version of the DT question protocol (DTQP). METHOD:A clinical multicentre mixed methods study, whereby patients and relatives provided quantitative (feedback questionnaires) and qualitative (cognitive interviews) data on the DT intervention. Before using the DTQP on patients, healthcare professionals (HCP) were invited to participate in cognitive interviews to provide input on DT. Therefore 360° feedback was achieved. Finally, the conducted DT interviews were examined. The study took place at two German PCUs (Mainz and Würzburg). Participating HCPs were physicians, psychologists, nurses and chaplains. Patients admitted to the PCUs were eligible to participate if they had a terminal illness and a life expectancy ranging from 2 weeks to 12 months. RESULTS:Out of 410 admitted patients, 72 were eligible and 30 (7.3% of all patients and 41.7% of eligible patients) participated. On average, 9 questions from the DTQP were used per DT interview. Subsequent cognitive interviews with patients produced four main categories of feedback (on the title, the question protocol, wording, and the questions actually asked). Finally, of the 30 participants, 19 completed the feedback questionnaire, as did 26 relatives. Of those, 18 patients and 24 relatives evaluated DT as helpful. CONCLUSIONS:DT is feasible for German PCUs. Our research yielded a validated German translation of the DTQP following EORTC guidelines and findings were reported according to the COREQ checklist for qualitative design. TRIAL REGISTRATION:The study was registered retrospectively on the 22nd of December 2017 at the German Clinical Trials Register ( DRKS00013627 ).

Project description:BackgroundThe study of safety culture and its relationship to patient care have been challenged by variation in definition, dimensionality and methods of assessment. This systematic review aimed to map methods to assess safety culture in hospitals, analyse the prevalence of these methods in the published research literature and examine the dimensions of safety culture captured through these processes.MethodsWe included studies reporting on quantitative, qualitative and mixed methods to assess safety culture in hospitals. The review was conducted using four academic databases (PubMed, CINAHL, Scopus and Web of Science) with studies from January 2008 to May 2020. A formal quality appraisal was not conducted. Study purpose, type of method and safety culture dimensions were extracted from all studies, coded thematically, and summarised narratively and using descriptive statistics where appropriate.ResultsA total of 694 studies were included. A third (n=244, 35.2%) had a descriptive or exploratory purpose, 225 (32.4%) tested relationships among variables, 129 (18.6%) evaluated an intervention, while 13.8% (n=96) had a methodological focus. Most studies exclusively used surveys (n=663; 95.5%), with 88 different surveys identified. Only 31 studies (4.5%) used qualitative or mixed methods. Thematic analysis identified 11 themes related to safety culture dimensions across the methods, with 'Leadership' being the most common. Qualitative and mixed methods approaches were more likely to identify additional dimensions of safety culture not covered by the 11 themes, including improvisation and contextual pressures.DiscussionWe assessed the extent to which safety culture dimensions mapped to specific quantitative and qualitative tools and methods of assessing safety culture. No single method or tool appeared to measure all 11 themes of safety culture. Risk of publication bias was high in this review. Future attempts to assess safety culture in hospitals should consider incorporating qualitative methods into survey studies to evaluate this multi-faceted construct.

Project description:BackgroundAnopheles gambiae M and S molecular forms, the major malaria vectors in the Afro-tropical region, are ongoing a process of ecological diversification and adaptive lineage splitting, which is affecting malaria transmission and vector control strategies in West Africa. These two incipient species are defined on the basis of single nucleotide differences in the IGS and ITS regions of multicopy rDNA located on the X-chromosome. A number of PCR and PCR-RFLP approaches based on form-specific SNPs in the IGS region are used for M and S identification. Moreover, a PCR-method to detect the M-specific insertion of a short interspersed transposable element (SINE200) has recently been introduced as an alternative identification approach. However, a large-scale comparative analysis of four widely used PCR or PCR-RFLP genotyping methods for M and S identification was never carried out to evaluate whether they could be used interchangeably, as commonly assumed.ResultsThe genotyping of more than 400 A. gambiae specimens from nine African countries, and the sequencing of the IGS-amplicon of 115 of them, highlighted discrepancies among results obtained by the different approaches due to different kinds of biases, which may result in an overestimation of MS putative hybrids, as follows: i) incorrect match of M and S specific primers used in the allele specific-PCR approach; ii) presence of polymorphisms in the recognition sequence of restriction enzymes used in the PCR-RFLP approaches; iii) incomplete cleavage during the restriction reactions; iv) presence of different copy numbers of M and S-specific IGS-arrays in single individuals in areas of secondary contact between the two forms.ConclusionsThe results reveal that the PCR and PCR-RFLP approaches most commonly utilized to identify A. gambiae M and S forms are not fully interchangeable as usually assumed, and highlight limits of the actual definition of the two molecular forms, which might not fully correspond to the two A. gambiae incipient species in their entire geographical range. These limits are discussed and operational suggestions on the choice of the most convenient method for large-scale M- and S-form identification are provided, also taking into consideration technical aspects related to the epidemiological characteristics of different study areas.

Dataset Information

Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets