Dataset Information

Unintended consequences: a qualitative study exploring the impact of collecting implementation process data with phone interviews on implementation activities.

ABSTRACT: Background: Qualitative data are crucial for capturing implementation processes, and thus necessary for understanding implementation trial outcomes. Typical methods for capturing such data include observations, focus groups, and interviews. Yet little consideration has been given to how such methods create interactions between researchers and study participants, which may affect participants' engagement, and thus implementation activities and study outcomes. In the context of a clinical trial, we assessed whether and how ongoing telephone check-ins to collect data about implementation activities impacted the quality of collected data, and participants' engagement in study activities.

Methods: Researchers conducted regular phone check-ins with clinic staff serving as implementers in an implementation study. Approximately 1 year into this trial, 19 of these study implementers were queried about the impact of these calls on study engagement and implementation activities. The two researchers who collected implementation process data through phone check-ins with the study implementers were also interviewed about their perceptions of the impact of the check-ins.

Results: Study implementers' assessment of the check-ins' impact fell into three categories: (1) the check-ins had no effect on implementation activities, (2) the check-ins served as a reminder about study participation (without relating a clear impact on implementation activities), and (3) the check-ins caused changes in implementation activities. The researchers similarly perceived that the phone check-ins served as reminders and encouraged some implementers' engagement in implementation activities; their ongoing nature also created personal connections with study implementers that may have impacted implementation activities. Among some study implementers, anticipation of the check-in calls also improved their ability to recount implementation activities and positively affected quality of the data collected.

Conclusion: These results illustrate the potential impact of qualitative data collection on implementation activities during implementation science trials. Mitigating such effects may prove challenging, but acknowledging these consequences-or even embracing them, perhaps by designing data collection methods as implementation strategies-could enhance scientific rigor. This work is presented to stimulate debate about the complexities involved in capturing data on implementation processes using common qualitative data collection methods.

Trial registration: ClinicalTrials.gov, NCT02325531 . Registered 15 December 2014.

SUBMITTER: Gruß I

PROVIDER: S-EPMC7643400 | biostudies-literature | 2020 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Unintended consequences: a qualitative study exploring the impact of collecting implementation process data with phone interviews on implementation activities.

Gruß Inga I Bunce Arwen A Davis James J Gold Rachel R

Implementation science communications 20201104 1

<h4>Background</h4>Qualitative data are crucial for capturing implementation processes, and thus necessary for understanding implementation trial outcomes. Typical methods for capturing such data include observations, focus groups, and interviews. Yet little consideration has been given to how such methods create interactions between researchers and study participants, which may affect participants' engagement, and thus implementation activities and study outcomes. In the context of a clinical t ...[more]

PMID: 33292848

Similar Datasets

Project description:Background and objectivesCompared with non-Latino whites with advanced illness, Latinos are less likely to have an advance directive or to die with hospice services. To improve palliative care disparities, international ESRD guidelines call for increased research on culturally responsive communication of advance care planning (ACP). The objective of our study was to explore the preferences of Latino patients receiving dialysis regarding symptom management and ACP.Design, setting, participants, & measurementsQualitative study design using semistructured face-to-face interviews of 20 Latinos on hemodialysis between February and July of 2015. Data were analyzed using thematic analysis.ResultsFour themes were identified: Avoiding harms of medication (fear of addiction and damage to bodies, effective distractions, reliance on traditional remedies, fatalism: the sense that one's illness is deserved punishment); barriers and facilitators to ACP: faith, family, and home (family group decision-making, family reluctance to have ACP conversations, flexible decision-making conversations at home with family, ACP conversations incorporating trust and linguistic congruency, family-first and faith-driven decisions); enhancing wellbeing day-to-day (supportive relationships, improved understanding of illness leads to adherence, recognizing new self-value, maintaining a positive outlook); and distressing aspects of living with their illness (dietary restriction is culturally isolating and challenging for families, logistic challenges and socioeconomic disadvantage compounded by health literacy and language barriers, required rapid adjustments to chronic illness, demanding dialysis schedule).ConclusionsLatinos described unique cultural preferences such as avoidance of medications for symptom alleviation and a preference to have family group decision-making and ACP conversations at home. Understanding and integrating cultural values and preferences into palliative care offers the potential to improve disparities and achieve quality patient-centered care for Latinos with advanced illness.

Project description:Most of the world's women living with human immunodeficiency virus (HIV) reside in sub-Saharan Africa. Although efforts to reduce mother-to-child transmission are underway, obtaining complete and accurate data from rural clinical sites to track progress presents a major challenge.To describe the acceptability and feasibility of mobile phones as a tool for clinic-based face-to-face data collection with pregnant women living with HIV in South Africa.As part of a larger clinic-based trial, 16 interviewers were trained to conduct mobile phone-assisted personal interviews (MPAPI). These interviewers (participant group 1) completed the same short questionnaire based on items from the Technology Acceptance Model at 3 different time points. Questions were asked before training, after training, and 3 months after deployment to clinic facilities. In addition, before the start of the primary intervention trial in which this substudy was undertaken, 12 mothers living with HIV (MLH) took part in a focus group discussion exploring the acceptability of MPAPI (participant group 2). Finally, a sample of MLH (n=512) enrolled in the primary trial were asked to assess their experience of being interviewed by MPAPI (participant group 3).Acceptability of the method was found to be high among the 16 interviewers in group 1. Perceived usefulness was reported to be slightly higher than perceived ease of use across the 3 time points. After 3 months of field use, interviewer perceptions of both perceived ease of use and perceived usefulness were found to be higher than before training. The feasibility of conducting MPAPI interviews in this setting was found to be high. Network coverage was available in all clinics and hardware, software, cost, and secure transmission to the data center presented no significant challenges over the 21-month period. For the 12 MHL participants in group 2, anxiety about the multimedia capabilities of the phone was evident. Their concern centered on the possibility that their privacy may be invaded by interviewers using the mobile phone camera to photograph them. For participants in group 3, having the interviewer sit beside vs across from the interviewee during the MPAPI interview was received positively by 94.7% of MHL. Privacy (6.3%) and confidentiality (5.3%) concerns were low for group 3 MHL.Mobile phones were found both to be acceptable and feasible in the collection of maternal and child health data from women living with HIV in South Africa.Clinicaltrials.gov NCT00972699; http://clinicaltrials.gov/ct2/show/NCT00972699 (Archived by WebCite at http://clinicaltrials.gov/ct2/show/NCT00972699).

Project description:MethodologyThis paper uses regression adjustment and entropy matching to achieve an appropriate balance between the two groups. Having achieved this balance any difference in the overall performance between the two groups can then be attributed directly to the new language policy that has been implemented. Our results indicate, after matching, that a significant difference in performance between the two groups occurs with Black African Zulu home language speakers in particular not performing as well as students from the other race and language groups. The data came from the University of KwaZulu-Natal and the study has been approved by the University Ethics committee and Research committee.Results and conclusionsUsing a weighted mean of marks to measure performance, the ATT estimates that result indicate that students in the treated group would all perform significantly better had they been allowed instead to enrol in the non-treated group. Furthermore, Zulu home language speakers, who are not actually forced to take this course, are significantly underperforming whether they have chosen to take this course in Zulu or not. Surprisingly, their underperformance is worse in the treated group. Because one would expect them to be scoring a higher mark for Zulu in this treated group, forfeiting the chance to take another course in their chosen area of study is clearly affecting the type of mark they could be getting for their other courses had they chosen to remain in the non-treated group. With English being the medium of instruction at this university, should the university not also consider introducing a compulsory course in English for these Zulu home language speakers? Females are doing better than males in both groups. The effect being stronger in the treated group suggests that females appear to cope better with the learning of a new language. Significant college effects are also being observed, suggesting that this new language rule possibly needs to be adjusted for the college a student wants to study in.

Project description:BackgroundAlthough hospitals are increasingly held accountable for patients' post-discharge outcomes, giving them incentive to help patients choose high-performing home health agencies, little is known about how quality reports inform decision making.ObjectiveWe aimed to learn how quality reports are used when choosing home care in one northeast state (Rhode Island) .DesignThe study consisted of focus groups with home health consumers and structured interviews with hospital case managers.ParticipantsThirteen consumers and 28 case managers from five hospitals participated in the study.ApproachWe identified key themes and illustrative quotes by audiotaping each session, and then three independent reviewers conducted repeated examination and content analysis.Key resultsNo participants were aware of existing state or Medicare home health agency public reports. Case managers provided agency lists to consumers, who routinely asked case managers to tell them which agencies to choose or which were best; but case managers felt unable to directly respond to consumers' requests for help in making the choice, because they did not have additional information to provide and because they feared violating federal laws requiring freedom of patient choice. Case managers also felt that there was little difference in agency quality, although they acknowledged they might not be aware of problems related to post-hospital care.ConclusionsHome health consumers and hospital case managers were unaware of public reports about home health quality, which limited consumers' ability to make informed decisions and case managers' ability to assist them in that decision-making process. Case managers were otherwise prohibited from recommending specific providers to patients and viewed the 'patient choice' laws as restricting their ability to respond to patients' requests for help in choosing home health agencies. Public reports can be marketed as tools that case managers can use to help patients differentiate among providers, while supporting patient autonomy.

Project description:IntroductionThis study aimed to gain insight from patients with refractory Mycobacterium avium complex lung disease (MAC-LD) into strategies used to manage adverse events (AEs) associated with amikacin liposome inhalation suspension (ALIS).MethodsWe conducted semi-structured interviews with US patients with refractory MAC-LD prescribed ALIS in a real-world setting. Interview transcripts were analyzed and coded to identify patterns in participants' descriptions of their ALIS treatment experiences, including AEs and their disruptiveness, and AE mitigation strategies, including participants' ratings of strategies' effectiveness. Concept saturation was also assessed.ResultsTwenty participants (mean age 48.7 years; 80% women; mean ALIS duration 5.45 months) were interviewed. At the time of the interview, 15 participants (75%) had received ALIS for > 1 month and 13 (65%) were currently receiving ALIS. Participants described 44 unique AE mitigation strategies, which can be categorized into three groups: prepare for treatment; prevent increased emergence of AEs; and persist on treatment by mitigating AEs. Common strategies (reported by ≥ 50% of participants) included use of educational materials from the patient support program, localized management of throat irritation, and symptom management to reduce fatigue. Evidence of concept saturation was observed: no new strategies were identified in the last five interviews, which suggests the sample was robust enough to identify all mitigation strategies likely to be used by the broader patient population.ConclusionsThis real-world study identified a diverse set of potential AE mitigation strategies intended to help individual patients prepare for ALIS treatment, prevent the increased emergence of certain AEs, and mitigate the impact of AEs on treatment persistence. Developing a comprehensive accounting of the types of mitigation strategies in use among patients in real-world settings can inform future investigation of the effectiveness of such strategies, and support evidence-based recommendations for treatment management.

Project description:Controlling the spread of COVID-19 - even after a licensed vaccine is available - requires the effective use of non-pharmaceutical interventions, e.g., physical distancing, limits on group sizes, mask wearing, etc1-7. To date, such interventions have not been uniformly and/or systematically implemented across the United States of America (US)8. For example, even when under strict stay-at-home orders, numerous jurisdictions in the US granted exceptions and/or were in close proximity to locations with entirely different regulations in place. Here, we investigate the impact of such geographic inconsistencies in epidemic control policies by coupling high-resolution mobility, search, and COVID case data to a mathematical model of SARS-CoV-2 transmission. Our results show that while stay-at-home orders decrease contacts in most areas of the US, some specific activities and venues often see an increase in attendance. As an example, over the month of March 2020, between 10 and 30% of churches in the US saw increases in attendance; even as the total number of visits to churches declined nationally. This heterogeneity, where certain venues see substantial increases in attendance while others close, suggests that closure can cause individuals to find an open venue, even if that requires longer-distance travel. And, indeed, the average distance travelled to churches in the US rose by 13% over the same period, and over the summer, churches with more than 50 average weekly visitors saw an increase of 81% in distance visitors had to travel to attend. Strikingly, our mathematical model reveals that, across a broad range of model parameters, partial measures can often be worse than no measures at all. In the most severe cases, individuals not complying with policies by traveling to neighboring jurisdictions can create epidemics when the outbreak would otherwise have been contained. Indeed, using county-level COVID-19 data, we show that mobility from high-incidence to low-incidence associated with travel for venues like churches, parks, and gyms consistently precedes rising case numbers in the low-incidence counties. Taken together, our data analysis of nearly 120 million church visitors across 184,677 churches, 14 million grocery visitors across 7,662 grocery stores, 13.5 million gym visitors across 5,483 gyms, 7.7 million cases across 3,195 counties, and modeling results highlight the potential unintended consequences of inconsistent epidemic control policies and stress the importance of balancing the societal needs of a population with the risk of an outbreak growing into a large epidemic, and the urgent need for centralized implementation and enforcement of non-pharmaceutical interventions.

Dataset Information

Unintended consequences: a qualitative study exploring the impact of collecting implementation process data with phone interviews on implementation activities.

Publications

Unintended consequences: a qualitative study exploring the impact of collecting implementation process data with phone interviews on implementation activities.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets