Dataset Information

Young Adults' Perspectives on the Use of Symptom Checkers for Self-Triage and Self-Diagnosis: Qualitative Study.

ABSTRACT:

Background

Young adults often browse the internet for self-triage and diagnosis. More sophisticated digital platforms such as symptom checkers have recently become pervasive; however, little is known about their use.

Objective

The aim of this study was to understand young adults' (18-34 years old) perspectives on the use of the Google search engine versus a symptom checker, as well as to identify the barriers and enablers for using a symptom checker for self-triage and self-diagnosis.

Methods

A qualitative descriptive case study research design was used. Semistructured interviews were conducted with 24 young adults enrolled in a university in Ontario, Canada. All participants were given a clinical vignette and were asked to use a symptom checker (WebMD Symptom Checker or Babylon Health) while thinking out loud, and were asked questions regarding their experience. Interviews were audio-recorded, transcribed, and imported into the NVivo software program. Inductive thematic analysis was conducted independently by two researchers.

Results

Using the Google search engine was perceived to be faster and more customizable (ie, ability to enter symptoms freely in the search engine) than a symptom checker; however, a symptom checker was perceived to be useful for a more personalized assessment. After having used a symptom checker, most of the participants believed that the platform needed improvement in the areas of accuracy, security and privacy, and medical jargon used. Given these limitations, most participants believed that symptom checkers could be more useful for self-triage than for self-diagnosis. Interestingly, more than half of the participants were not aware of symptom checkers prior to this study and most believed that this lack of awareness about the existence of symptom checkers hindered their use.

Conclusions

Awareness related to the existence of symptom checkers and their integration into the health care system are required to maximize benefits related to these platforms. Addressing the barriers identified in this study is likely to increase the acceptance and use of symptom checkers by young adults.

SUBMITTER: Aboueid S

PROVIDER: S-EPMC7817365 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Young Adults' Perspectives on the Use of Symptom Checkers for Self-Triage and Self-Diagnosis: Qualitative Study.

Aboueid Stephanie S Meyer Samantha S Wallace James R JR Mahajan Shreya S Chaurasia Ashok A

JMIR public health and surveillance 20210106 1

<h4>Background</h4>Young adults often browse the internet for self-triage and diagnosis. More sophisticated digital platforms such as symptom checkers have recently become pervasive; however, little is known about their use.<h4>Objective</h4>The aim of this study was to understand young adults' (18-34 years old) perspectives on the use of the Google search engine versus a symptom checker, as well as to identify the barriers and enablers for using a symptom checker for self-triage and self-diagno ...[more]

PMID: 33404515

Similar Datasets

Project description:ObjectiveTo determine the diagnostic and triage accuracy of online symptom checkers (tools that use computer algorithms to help patients with self diagnosis or self triage).DesignAudit study.SettingPublicly available, free symptom checkers.Participants23 symptom checkers that were in English and provided advice across a range of conditions. 45 standardized patient vignettes were compiled and equally divided into three categories of triage urgency: emergent care required (for example, pulmonary embolism), non-emergent care reasonable (for example, otitis media), and self care reasonable (for example, viral upper respiratory tract infection).Main outcome measuresFor symptom checkers that provided a diagnosis, our main outcomes were whether the symptom checker listed the correct diagnosis first or within the first 20 potential diagnoses (n=770 standardized patient evaluations). For symptom checkers that provided a triage recommendation, our main outcomes were whether the symptom checker correctly recommended emergent care, non-emergent care, or self care (n=532 standardized patient evaluations).ResultsThe 23 symptom checkers provided the correct diagnosis first in 34% (95% confidence interval 31% to 37%) of standardized patient evaluations, listed the correct diagnosis within the top 20 diagnoses given in 58% (55% to 62%) of standardized patient evaluations, and provided the appropriate triage advice in 57% (52% to 61%) of standardized patient evaluations. Triage performance varied by urgency of condition, with appropriate triage advice provided in 80% (95% confidence interval 75% to 86%) of emergent cases, 55% (47% to 63%) of non-emergent cases, and 33% (26% to 40%) of self care cases (P<0.001). Performance on appropriate triage advice across the 23 individual symptom checkers ranged from 33% (95% confidence interval 19% to 48%) to 78% (64% to 91%) of standardized patient evaluations.ConclusionsSymptom checkers had deficits in both triage and diagnosis. Triage advice from symptom checkers is generally risk averse, encouraging users to seek care for conditions where self care is reasonable.

Project description:BackgroundSymptom checkers (SCs) are tools developed to provide clinical decision support to laypersons. Apart from suggesting probable diagnoses, they commonly advise when users should seek care (triage advice). SCs have become increasingly popular despite prior studies rating their performance as mediocre. To date, it is unclear whether SCs can triage better than those who might choose to use them.ObjectiveThis study aims to compare triage accuracy between SCs and their potential users (ie, laypersons).MethodsOn Amazon Mechanical Turk, we recruited 91 adults from the United States who had no professional medical background. In a web-based survey, the participants evaluated 45 fictitious clinical case vignettes. Data for 15 SCs that had processed the same vignettes were obtained from a previous study. As main outcome measures, we assessed the accuracy of the triage assessments made by participants and SCs for each of the three triage levels (ie, emergency care, nonemergency care, self-care) and overall, the proportion of participants outperforming each SC in terms of accuracy, and the risk aversion of participants and SCs by comparing the proportion of cases that were overtriaged.ResultsThe mean overall triage accuracy was similar for participants (60.9%, SD 6.8%; 95% CI 59.5%-62.3%) and SCs (58%, SD 12.8%). Most participants outperformed all but 5 SCs. On average, SCs more reliably detected emergencies (80.6%, SD 17.9%) than laypersons did (67.5%, SD 16.4%; 95% CI 64.1%-70.8%). Although both SCs and participants struggled with cases requiring self-care (the least urgent triage category), SCs more often wrongly classified these cases as emergencies (43/174, 24.7%) compared with laypersons (56/1365, 4.10%).ConclusionsMost SCs had no greater triage capability than an average layperson, although the triage accuracy of the five best SCs was superior to the accuracy of most participants. SCs might improve early detection of emergencies but might also needlessly increase resource utilization in health care. Laypersons sometimes require support in deciding when to rely on self-care but it is in that very situation where SCs perform the worst. Further research is needed to determine how to best combine the strengths of humans and SCs.

Project description:BackgroundWeb-based symptom checkers are promising tools that provide help to patients seeking guidance on health problems. Many health organizations have started using them to enhance triage. Patients use the symptom checker to report their symptoms online and submit the report to the health care center through the system. Health care professionals (registered nurse, practical nurse, general physician, physiotherapist, etc) receive patient inquiries with urgency rating, decide on actions to be taken, and communicate these to the patients. The success of the adoption, however, depends on whether the tools can efficiently support health care professionals' workflow and achieve their support.ObjectiveThis study explores the factors influencing health care professionals' support for a web-based symptom checker for triage.MethodsData were collected through a web-based survey of 639 health care professionals using either of the two most used web-based symptom checkers in the Finnish public primary care. Linear regression models were fitted to study the associations between the study variables and health care professionals' support for the symptom checkers. In addition, the health care professionals' comments collected via survey were qualitatively analyzed to elicit additional insights about the benefits and challenges of the clinical use of symptom checkers.ResultsResults show that the perceived beneficial influence of the symptom checkers on health care professionals' work and the perceived usability of the tools were positively associated with professionals' support. The perceived benefits to patients and organizational support for use were positively associated, and threat to professionals' autonomy was negatively associated with health care professionals' support. These associations were, however, not independent of other factors included in the models. The influences on professionals' work were both positive and negative; the tools streamlined work by providing preliminary information on patients and reduced the number of phone calls, but they also created extra work as the professionals needed to call patients and ask clarifying questions. Managing time between the use of symptom checkers and other tasks was also challenging. Meanwhile, according to health care professionals' experience, the symptom checkers benefited patients as they received help quickly with a lower threshold for care.ConclusionsThe efficient use of symptom checkers for triage requires usable solutions that support health care professionals' work. High-quality information about the patients' conditions and an efficient way of communicating with patients are needed. Using a new eHealth tool also requires that health organizations and teams reorganize their workflows and work distributions to support clinical processes.

Project description:ObjectivesIn England, the NHS111 service provides assessment and triage by telephone for urgent health problems. A digital version of this service has recently been introduced. We aimed to systematically review the evidence on digital and online symptom checkers and similar services.DesignSystematic review.Data sourcesWe searched Medline, Embase, the Cochrane Library, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Health Management Information Consortium, Web of Science and ACM Digital Library up to April 2018, supplemented by phrase searches for known symptom checkers and citation searching of key studies.Eligibility criteriaStudies of any design that evaluated a digital or online symptom checker or health assessment service for people seeking advice about an urgent health problem.Data extraction and synthesisData extraction and quality assessment (using the Cochrane Collaboration version of QUADAS for diagnostic accuracy studies and the National Heart, Lung and Blood Institute tool for observational studies) were done by one reviewer with a sample checked for accuracy and consistency. We performed a narrative synthesis of the included studies structured around pre-defined research questions and key outcomes.ResultsWe included 29 publications (27 studies). Evidence on patient safety was weak. Diagnostic accuracy varied between different systems but was generally low. Algorithm-based triage tended to be more risk averse than that of health professionals. There was very limited evidence on patients' compliance with online triage advice. Study participants generally expressed high levels of satisfaction, although in mainly uncontrolled studies. Younger and more highly educated people were more likely to use these services.ConclusionsThe English 'digital 111' service has been implemented against a background of uncertainty around the likely impact on important outcomes. The health system may need to respond to short-term changes and/or shifts in demand. The popularity of online and digital services with younger and more educated people has implications for health equity.Prospero registration numberCRD42018093564.

Project description:It is currently unknown which attitude-based profiles are associated with symptom checker use for self-triage. We sought to identify, among university students, attitude-based latent classes (population profiles) and the association between latent classes with the future use of symptom checkers for self-triage. Informed by the Technology Acceptance Model and a larger mixed methods study, a cross-sectional survey was developed and administered to students (aged between 18 and 34 years of age) at a University in Ontario. Latent class analysis (LCA) was used to identify attitude-based profiles that exist among the sample while general linear modeling was applied to identify the association between latent classes and future symptom checker use for self-triage. Of the 1,547 students who opened the survey link, 1,365 did not use a symptom checker in the past year and were thus identified as “non-users”. After removing missing data (remaining sample = n = 1,305), LCA revealed five attitude-based profiles: tech acceptors, tech rejectors, skeptics, tech seekers, and unsure acceptors. Tech acceptors and tech rejectors were the most and least prevalent classes, respectively. As compared to tech rejectors, tech seekers and unsure acceptors were the latent classes with the highest and lowest odds of future symptom checker use, respectively. After controlling for confounders, the effect of latent classes on symptom checker use remains significant (p-value < .0001) with the odds of future use in tech acceptors being 5.6 times higher than the odds of future symptom checker use in tech rejectors [CI: (3.458, 9.078); p-value < .0001]. Attitudes towards AI and symptom checker functionality result in different population profiles that have different odds of using symptom checkers for self-triage. Identifying a person’s or group’s membership to a population profile could help in developing and delivering tailored interventions aimed at maximizing use of validated symptom checkers.

Project description:BackgroundIn 2016, drug overdose deaths exceeded 64,000 in the United States, driven by a sixfold increase in deaths attributable to illicitly manufactured fentanyl. Rapid fentanyl test strips (FTS), used to detect fentanyl in illicit drugs, may help inform people who use drugs about their risk of fentanyl exposure prior to consumption. This qualitative study assessed perceptions of FTS among young adults.MethodsFrom May to September 2017, we recruited a convenience sample of 93 young adults in Rhode Island (age 18-35 years) with self-reported drug use in the past 30 days to participate in a pilot study aimed at better understanding perspectives of using take-home FTS for personal use. Participants completed a baseline quantitative survey, then completed a training to learn how to use the FTS. Participants then received ten FTS for personal use and were asked to return 2-4 weeks later to complete a brief quantitative and structured qualitative interview. Interviews were transcribed, coded, and double coded in NVivo (Version 11).ResultsOf the 81 (87%) participants who returned for follow-up, the majority (n = 62, 77%) used at least one FTS, and of those, a majority found them to be useful and straightforward to use. Positive FTS results led some participants to alter their drug use behaviors, including discarding their drug supply, using with someone else, and keeping naloxone nearby. Participants also reported giving FTS to friends who they felt were at high risk for fentanyl exposure.ConclusionThese findings provide important perspectives on the use of FTS among young adults who use drugs. Given the high level of acceptability and behavioral changes reported by study participants, FTS may be a useful harm reduction intervention to reduce fentanyl overdose risk among this population.Trial registrationThe study protocol is registered with the US National Library of Medicine, Identifier NCT03373825, 12/24/2017, registered retrospectively. https://clinicaltrials.gov/ct2/show/NCT03373825?id=NCT03373825&rank=1.

Project description:Online symptom checkers are increasingly popular health technologies that enable patients to input their symptoms to produce diagnoses and triage advice. However, there is concern regarding the performance and safety of symptom checkers in diagnosing and triaging patients with life-threatening conditions. This retrospective cross-sectional study aimed to evaluate and compare commercially available symptom checkers for performance in diagnosing and triaging myocardial infarctions (MI). Symptoms and biodata of MI patients were inputted into 8 symptom checkers identified through a systematic search. Anonymised clinical data of 100 consecutive MI patients were collected from a tertiary coronary intervention centre between 1st January 2020 to 31st December 2020. Outcomes included (1) diagnostic sensitivity as defined by symptom checkers outputting MI as the primary diagnosis (D1), or one of the top three (D3), or top five diagnoses (D5); and (2) triage sensitivity as defined by symptom checkers outputting urgent treatment recommendations. Overall D1 sensitivity was 48±31% and varied between symptom checkers (range: 6-85%). Overall D3 and D5 sensitivity were 73±20% (34-92%) and 79±14% (63-94%), respectively. Overall triage sensitivity was 83±13% (55-91%). 24±16% of atypical cases had a correct D1 though for female atypical cases D1 sensitivity was only 10%. Atypical MI D3 and D5 sensitivity were 44±21% and 48±24% respectively and were significantly lower than typical MI cases (p<0.01). Atypical MI triage sensitivity was significantly lower than typical cases (53±20% versus 84±15%, p<0.01). Female atypical cases had significantly lower diagnostic and triage sensitivity than typical female MI cases (p<0.01).Given the severity of the pathology, the diagnostic performance of symptom checkers for correctly diagnosing an MI is concerningly low. Moreover, there is considerable inter-symptom checker performance variation. Patients presenting with atypical symptoms were under-diagnosed and under-triaged, especially if female. This study highlights the need for improved clinical performance, equity and transparency associated with these technologies.

Project description:BackgroundThe persistence of cannabis use disorder (CUD) in young adults with first-episode psychosis (FEP) is associated with poor clinical and functional outcomes. Face-to-face psychological interventions are effective in treating CUD. However, their use in early intervention services (EISs) for psychosis is inconsistent because of barriers, including high workload and heterogeneity in training of clinicians and lack of motivation for treatment among patients. Tailoring new technology-based psychological interventions (TBPIs) to overcome these barriers is necessary to ensure their optimal acceptability.ObjectiveThe aim of this study is twofold: to explore psychological intervention practices and intervention targets that are relevant for treating CUD in individuals with early psychosis and to explore factors related to the development and implementation of a technology-assisted psychological intervention.MethodsA total of 10 patients undergoing treatment for FEP and CUD in EISs participated in a focus group in June 2019. Semistructured individual interviews were conducted with 10 clinicians working in first-episode clinics in the province of Québec, Canada. A hybrid inductive-deductive approach was used to analyze data. For the deductive analysis, we used categories of promoting strategies found in the literature shown to increase adherence to web-based interventions for substance use (ie, tailoring, reminders, delivery strategies, social support, and incentives). For the inductive analysis, we identified new themes through an iterative process of reviewing the data multiple times by two independent reviewers.ResultsData were synthesized into five categories of factors that emerged from data collection, and a narrative synthesis of commonalities and differences between patient and clinician perspectives was produced. The categories included attitudes and beliefs related to psychological interventions (eg, behavioral stage of change), strategies for psychological interventions (eg, motivational interviewing, cognitive behavioral therapy, psychoeducation, stress management), incentives (eg, contingency management), general interest in TBPIs (eg, facilitators and barriers of TBPIs), and tailoring of TBPIs (eg, application needs and preferences, outcome measures of interest for clinicians).ConclusionsThis study provides a comprehensive portrait of the multifaceted needs and preferences of patients and clinicians related to TBPIs. Our results can inform the development of smartphone- or web-based psychological interventions for CUD in young adults with early psychosis.

Project description:BackgroundMedical self-diagnostic tools (or symptom checkers) are becoming an integral part of digital health and our daily lives, whereby patients are increasingly using them to identify the underlying causes of their symptoms. As such, it is essential to rigorously investigate and comprehensively report the diagnostic performance of symptom checkers using standard clinical and scientific approaches.ObjectiveThis study aims to evaluate and report the accuracies of a few known and new symptom checkers using a standard and transparent methodology, which allows the scientific community to cross-validate and reproduce the reported results, a step much needed in health informatics.MethodsWe propose a 4-stage experimentation methodology that capitalizes on the standard clinical vignette approach to evaluate 6 symptom checkers. To this end, we developed and peer-reviewed 400 vignettes, each approved by at least 5 out of 7 independent and experienced primary care physicians. To establish a frame of reference and interpret the results of symptom checkers accordingly, we further compared the best-performing symptom checker against 3 primary care physicians with an average experience of 16.6 (SD 9.42) years. To measure accuracy, we used 7 standard metrics, including M1 as a measure of a symptom checker's or a physician's ability to return a vignette's main diagnosis at the top of their differential list, F1-score as a trade-off measure between recall and precision, and Normalized Discounted Cumulative Gain (NDCG) as a measure of a differential list's ranking quality, among others.ResultsThe diagnostic accuracies of the 6 tested symptom checkers vary significantly. For instance, the differences in the M1, F1-score, and NDCG results between the best-performing and worst-performing symptom checkers or ranges were 65.3%, 39.2%, and 74.2%, respectively. The same was observed among the participating human physicians, whereby the M1, F1-score, and NDCG ranges were 22.8%, 15.3%, and 21.3%, respectively. When compared against each other, physicians outperformed the best-performing symptom checker by an average of 1.2% using F1-score, whereas the best-performing symptom checker outperformed physicians by averages of 10.2% and 25.1% using M1 and NDCG, respectively.ConclusionsThe performance variation between symptom checkers is substantial, suggesting that symptom checkers cannot be treated as a single entity. On a different note, the best-performing symptom checker was an artificial intelligence (AI)-based one, shedding light on the promise of AI in improving the diagnostic capabilities of symptom checkers, especially as AI keeps advancing exponentially.

Dataset Information

Young Adults' Perspectives on the Use of Symptom Checkers for Self-Triage and Self-Diagnosis: Qualitative Study.

Background

Objective

Methods

Results

Conclusions

Publications

Young Adults' Perspectives on the Use of Symptom Checkers for Self-Triage and Self-Diagnosis: Qualitative Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets