Understanding Design Tradeoffs for Health Technologies: A Mixed-Methods Approach.
Ontology highlight
ABSTRACT:
SUBMITTER: O'Leary K
PROVIDER: S-EPMC5554065 | biostudies-other | 2015 Apr
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Although patients express an interest in using mobile health (mHealth) interventions to manage their health and chronic conditions, many current mHealth interventions are difficult to use. Usability testing is critical for the success of novel mHealth interventions. Researchers recognize the utility of using qualitative and quantitative approaches for usability testing, but many mHealth researchers lack the awareness of integration approaches from advances in mixed methods research that can add value to mHealth technology. As efficient usability testing proceeds iteratively, we introduce a novel mixed methods design developed specifically for mHealth researchers. The iterative convergent mixed methods design involves simultaneous qualitative and quantitative data collection and analysis that continues cyclically through multiple rounds of mixed methods data collection and analysis until the mHealth technology under evaluation is found to work to the satisfaction of the researcher. In cyclical iterations, early development is more qualitatively driven but progressively becomes more quantitatively driven. Using this design, mHealth researchers can leverage mixed methods integration procedures in the research question, data collection, data analysis, interpretation, and dissemination dimensions. This study demonstrates how the iterative convergent mixed methods design provides a novel framework for generating unique insights into multifaceted phenomena impacting mHealth usability. Understanding these practices can help developers and researchers leverage the strengths of an integrated mixed methods design.
| S-EPMC6658163 | biostudies-literature
Project description:BackgroundAlmost every patient admitted to hospital will receive medication during their stay. Medication errors are an important cause of patient morbidity and mortality, as well as an economic burden for healthcare institutions. Research suggests that current methods of storing medication on hospital wards are not fit for purpose, contributing to inefficiency and error.AimTo improve medication storage in inpatient areas, by exploring variation and challenges related to medication storage and designing a prototype solution.MethodsSet in four hospitals in an English teaching hospital trust, the study used a mixed methods approach comprising a quantitative descriptive survey of storage facilities and practices followed by mixed methods observations of medication rounds and interviews with patients, nurses and pharmacy staff. Quantitative data were presented descriptively and qualitative data analysed thematically and using a human-centered design approach.ResultsWe identified wide variation in medication storage facilities and practices across 77 wards. Observations and staff interviews in six wards revealed five problem areas: poor management of multiple storage facilities; lack of visibility and organisation of medication within trolleys; inadequate size of storage; lack of ownership and knowledge of standard practice; and use of key locks. Patients were largely satisfied with receiving their medication. Systematic and consistent physical organisation of medication in medication trolleys, and integrating and implementing principles of best practice, were identified as areas for intervention.Discussion and conclusionVariation in medication storage facilities and practices existed both across the organization and on individual wards. Multiple challenges were identified in how medication was stored, which if addressed may improve the efficiency and safety of medication administration and in turn, staff and patient experience. The use of design principles alongside a research approach resulted in a rapid, iterative process for developing and refining potential solutions to improve inpatient medication storage.
| S-EPMC8638963 | biostudies-literature
Project description:Efforts to mitigate the spread of COVID-19 rely on trust in public health organizations and practices. These practices include contact tracing, which requires people to share personal information with public health organizations. The central role of trust in these practices has gained more attention during the pandemic, resurfacing endemic questions about public trust and potential racial trust disparities, especially as they relate to participation in public health efforts. Using an explanatory mixed methods design, we conducted quantitative analysis of state-level survey data in the United States from a representative sample of Michigan residents (n = 1000) in May 2020. We used unadjusted and adjusted linear regressions to examine differences in trust in public health information and willingness to participate in public health efforts by race. From July to September 2020, we conducted qualitative interviews (n = 26) to further explain quantitative results. Using unadjusted linear regression, we observed higher willingness to participate in COVID-19 public health efforts among Black survey respondents compared to White respondents. In adjusted analysis, that difference disappeared, yielding no statistically significant difference between Black and White respondents in either trust in public health information sources or willingness to participate. Qualitative interviews were conducted to explain these findings, considering their contrast with assumptions that Black people would exhibit lower trust in public health organizations during COVID-19. Altruism, risk acknowledgement, trust in public health organizations during COVID-19, and belief in efficacy of public health efforts contributed to willingness to participate in public health efforts among interviewees. Our findings underscore the contextual nature of trust, and the importance of this context when analyzing protective health behaviors among communities disproportionately affected by COVID-19. Assumptions about mistrust among Black individuals and communities may be inaccurate because they overlook the specific context of the public health crisis. These findings are important because they indicate that Black respondents are exhibiting strategic trust during COVID-19 despite systemic, contemporary, and historic barriers to trust. Conceptual specificity rather than blanket generalizations is warranted, especially given the harms of stereotyping and discrimination.
| S-EPMC8425672 | biostudies-literature
Project description:INTRODUCTION:The anatomic variants of congenital heart disease (CHD) are multiple. The increased survival of these patients and disposition into communities has led to an increase in their acute presentation to non-CHD experts in primary care clinics and emergency departments. Given the vulnerability and fragility of these patients in the face of acute illness, new clinical decision support systems (CDSS) are urgently needed to better translate the best practice recommendations for the care of these patients. This study aims to understand the perceived confidence and macrocognitive processes of non-CHD experts (emergency medicine physicians) and CHD experts (paediatric cardiac intensivists) when treating children with CHD during acute illness and apply this to optimise the design of a CDSS (MyHeartPass™) for these patients. METHODS AND ANALYSIS:The first phase of the study involves a survey of non-CHD experts and CHD experts to understand their perceived confidence as it relates to treating acutely ill patients with CHD. The second phase is a qualitative cognitive task analysis using critical decision method to characterise and compare the macrocognitive processes used by non-CHD experts and CHD experts during the critical decision making. In phases 3 and 4, heuristic evaluation and usability testing of the CDSS will be completed. These results will be used to inform design changes to the chosen CDSS (MyHeartPass™). In the final phase, a within-participant simulation design will be used to study the effect of the CDSS on clinical decision making compared with baseline (without use of CDSS). ETHICS AND DISSEMINATION:Ethics approval from The Hospital for Sick Children in Toronto, Ontario, Canada has been obtained for all phases. Results will be published in peer-reviewed journals and presented at relevant conferences. On successful completion of these studies, it is anticipated that there will be a controlled implementation of the redesigned CDSS.
| S-EPMC7170622 | biostudies-literature
Project description:IntroductionAs hospitals and physician organizations increasingly vertically integrate, there is an important opportunity to use health systems to improve performance. Prior research has largely relied on secondary data sources, but little is known about how health systems are organized "on the ground" and what mechanisms are available to influence physician practice at the front line of care.MethodsWe collected in-depth information on eight health systems through key informant interviews, descriptive surveys, and document review. Qualitative data were systematically coded. We conducted analyses to identify organizational structures and mechanisms through which health systems influence practice.ResultsAs expected, we found that health systems vary on multiple dimensions related to organizational structure (e.g., size, complexity) which reflects history, market and mission. With regard to levers of influence, we observed within-system variation both in mechanisms (e.g., employment of physicians, system-wide EHR, standardization of service lines) and level of influence. Concepts such as "core" versus "peripheral" were more salient than "ownership" versus "contract."DiscussionData from secondary sources can help identify and map health systems, but they do not adequately describe them or the variation that exists within and across systems. To examine the degree to which health systems can influence performance, more detailed and nuanced information on health system characteristics is necessary.ConclusionThe mixed-methods data accrual approach used in this study provides granular qualitative data that enables researchers to describe multi-layered health systems, grasp the context in which they operate, and identify the key drivers of performance.
| S-EPMC6676926 | biostudies-literature
Project description:BackgroundAutistic individuals might be more likely to misuse substances than non-autistic individuals. Better understanding of these patterns can help clinicians identify strategies to reduce substance use, protecting physical and mental health. The aim of this study was to compare the experiences of substance use between autistic and non-autistic adolescents and adults.MethodsThis study is a mixed-methods study, including both quantitative (closed-ended questions) and qualitative (one open-ended question) online assessments. Data were collected as part of a larger study, the Autism and Physical Health Survey, in which we administered an anonymised, online questionnaire to autistic and non-autistic individuals aged 16-90 years. In the present study, we investigated data on substance use or misuse, using two overlapping but separate samples from the survey (one sample with complete quantitative responses and one sample with complete qualitative responses). Binary measures of substance use were investigated using unadjusted and adjusted binomial logistic regression models. Content analysis was used to compare experiences of autistic and non-autistic adolescents and adults. We used Fisher's exact tests to assess differences in frequency of reporting particular qualitative themes and subthemes.FindingsSurvey recruitment was done between Feb 7, 2018, and Aug 26, 2019. At the end of the recruitment, 3657 individuals had accessed the survey. After excluding duplicates as well as participants with missing or incomplete responses, we had data from 2386 participants (1183 autistic and 1203 non-autistic participants; 1571 female and 815 male participants) for the quantitative analyses and data from 919 participants (429 autistic and 490 non-autistic participants; 569 female and 350 male participants) in the qualitative analyses. The samples for the quantitative and qualitative analyses were predominantly composed of female individuals, White individuals, UK residents, and those without intellectual disability. Autistic individuals were less likely than non-autistic individuals to report consuming alcohol regularly (16·0% of autistic individuals vs 22·2% of non-autistic individuals; adjusted model: odds ratio [OR] 0·69, 95% CI 0·55-0·86; p=0·0022) or binge-drinking (3·8% vs 8·2%; adjusted model: OR 0·38, 0·26-0·56; p<0·0001). Autistic male participants were less likely than non-autistic male participants to report ever having smoked (50·8% of autistic male participants vs 64·6% of non-autistic male participants; adjusted OR 0·50; 0·32-0·76; p=0·0022) or ever using drugs (35·4% vs 52·7%; adjusted OR 0·53; 0·35-0·80; p=0·0022). Regarding our qualitative analyses, among participants who reported a specific motivation for drug use, compared with non-autistic individuals, autistic individuals were nearly nine times more likely to report using recreational substances to manage behaviour (OR 8·89, 2·05-81·12; p=0·0017) and more likely to report using recreational substances to manage mental health symptoms (OR 3·08, 1·18-9·08; p=0·032). Autistic individuals were also more likely to report vulnerability associated with substance use (OR 4·16, 1·90-10·05; p=0·00027), including childhood use of drugs and being forced or tricked into using drugs.InterpretationAutistic individuals might be less likely than non-autistic individuals to report engaging in substance misuse. They also report using drugs to self-medicate. Clinicians should be aware of vulnerability linked to substance use among autistic patients and should work cooperatively with patients to effectively manage autistic and comorbid symptoms.FundingAutism Research Trust, Rosetrees Trust, Cambridge and Peterborough NHS Foundation Trust.
| S-EPMC8310943 | biostudies-literature
Project description:BackgroundFamily planning is a key means to achieving many of the Sustainable Development Goals. Around the world, governments and partners have prioritized investments to increase access to and uptake of family planning methods. In Uttar Pradesh, India, the government and its partners have made significant efforts to increase awareness, supply, and access to modern contraceptives. Despite progress, uptake remains stubbornly low. This calls for systematic research into understanding the 'why'-why people are or aren't using modern methods, what drives their decisions, and who influences them.MethodsWe use a mixed-methods approach, analyzing three existing quantitative data sets to identify trends and geographic variation, gaps and contextual factors associated with family planning uptake and collecting new qualitative data through in-depth immersion interviews, journey mapping, and decision games to understand systemic and individual-level barriers to family planning use, household decision making patterns and community level barriers.ResultsWe find that reasons for adoption of family planning are complex-while access and awareness are critical, they are not sufficient for increasing uptake of modern methods. Although awareness is necessary for uptake, we found a steep drop-off (59%) between high awareness of modern contraceptive methods and its intention to use, and an additional but smaller drop-off from intention to actual use (9%). While perceived access, age, education and other demographic variables partially predict modern contraceptive intention to use, the qualitative data shows that other behavioral drivers including household decision making dynamics, shame to obtain modern contraceptives, and high-risk perception around side-effects also contribute to low intention to use modern contraceptives. The data also reveals that strong norms and financial considerations by couples are the driving force behind the decision to use and when to use family planning methods.ConclusionThe finding stresses the need to shift focus towards building intention, in addition to ensuring access of trained staff, and commodities drugs and equipment, and building capacities of health care providers.
| S-EPMC7806122 | biostudies-literature
Project description:BackgroundSeveral countries have notably reduced childhood stunting relative to economic growth over the past 15-20 y. The Exemplars in Stunting Reduction project, or "Exemplars," studies success factors among these countries with a lens toward replicability.ObjectivesThis paper details the standardized mixed-methods framework for studying determinants of childhood stunting reduction applied in Exemplars studies.MethodsAn expert technical advisory group (TAG), criteria for identifying Exemplar countries, evidence-based frameworks, mixed methodologies (quantitative, qualitative, policy, literature review), effective research partnerships, case study process and timeline, and data triangulation and corroboration are presented.ResultsExperts in health, nutrition, and evaluation methods were selected at the study outset to provide technical support to all phases of research (TAG). Exemplar countries were selected by the TAG, who considered quantitative data (e.g., annual rates of stunting change compared with economic growth, country population size) and qualitative insights (e.g., logistics of country work, political stability). Experienced country research partners were selected and an inception meeting with stakeholder consultations was held to launch research and garner support. Evidence-based conceptual frameworks underpinned all Exemplars research activities. A systematic review of published peer-reviewed and grey literature was undertaken, along with in-depth policy and program analysis of nutrition-specific and -sensitive investments. Both descriptive and advanced quantitative analysis was undertaken (e.g., equity analyses, difference-in-difference regression, Oaxaca-Blinder decomposition). Qualitative data collection using in-depth interviews and focus groups was conducted with national and community stakeholders (i.e., child care workers and mothers) to understand country experiences. The case study process was iterative, and all research outputs were triangulated to develop the stunting reduction narrative for each country. Findings were shared with country experts for weigh-in and corroboration through dissemination events.ConclusionsExemplars research uses a mixed-methods framework for studying positive outliers that can be applied across diverse health and development outcomes.
| S-EPMC7487431 | biostudies-literature
Project description:BACKGROUND:Recent discoveries in the fields of machine learning (ML), Ecological Momentary Assessment (EMA), computerized adaptive testing (CAT), digital phenotype, imaging, and biomarkers have brought about a new paradigm shift in medicine. OBJECTIVE:The aim of this study was to explore psychiatrists' perspectives on this paradigm through the prism of new clinical decision support systems (CDSSs). Our primary objective was to assess the acceptability of these new technologies. Our secondary objective was to characterize the factors affecting their acceptability. METHODS:A sample of psychiatrists was recruited through a mailing list. Respondents completed a Web-based survey. A quantitative study with an original form of assessment involving the screenplay method was implemented involving 3 scenarios, each featuring 1 of the 3 support systems, namely, EMA and CAT, biosensors comprising a connected wristband-based digital phenotype, and an ML-based blood test or magnetic resonance imaging (MRI). We investigated 4 acceptability domains based on International Organization for Standardization and Nielsen models (usefulness, usability, reliability, and risk). RESULTS:We recorded 515 observations. Regarding our primary objective, overall acceptability was moderate. MRI coupled with ML was considered to be the most useful system, and the connected wristband was considered the least. All the systems were described as risky (410/515, 79.6%). Regarding our secondary objective, acceptability was strongly influenced by socioepidemiological variables (professional culture), such as gender, age, and theoretical approach. CONCLUSIONS:This is the first study to assess psychiatrists' views on new CDSSs. Data revealed moderate acceptability, but our analysis shows that this is more the result of the lack of knowledge about these new technologies rather than a strong rejection. Furthermore, we found strong correspondences between acceptability profiles and professional culture profiles. Many medical, forensics, and ethical issues were raised, including therapeutic relationship, data security, data storage, and privacy risk. It is essential for psychiatrists to receive training and become involved in the development of new technologies.
| S-EPMC6315247 | biostudies-literature
Project description:With the increase in access to medical information, parents can acquire health information from multiple sources. An understanding of parents' reactions to a newborn infant's diagnosis of sickle cell anemia and how they acquire knowledge can identify parent beliefs and preferences about the process of sickle cell education. This study utilized a sequential exploratory mixed methods design. First, qualitative interviews were conducted with 8 parents of infants with sickle cell anemia to understand the process of health education. Second, quantitative surveys were conducted with 22 other parents to test qualitative findings. Parents of infants with sickle cell anemia expressed a high level of fear at the time of notification of a positive screen. Parents desired an understanding of how to identify acute complications of disease and how sickle cell will alter their child's life. Parents actively sought information at the time they were told their child had sickle cell disease. Sickle cell education should begin at time of notification of positive newborn screening results and address identified parent concerns. Health care providers should build trust with parents and provide them with immediate access to educational materials. Hematologists should work with primary care providers to develop complementary educational programs and resources.
| S-EPMC4505368 | biostudies-literature