Dataset Information

Open-ended interview questions and saturation.

ABSTRACT: Sample size determination for open-ended questions or qualitative interviews relies primarily on custom and finding the point where little new information is obtained (thematic saturation). Here, we propose and test a refined definition of saturation as obtaining the most salient items in a set of qualitative interviews (where items can be material things or concepts, depending on the topic of study) rather than attempting to obtain all the items. Salient items have higher prevalence and are more culturally important. To do this, we explore saturation, salience, sample size, and domain size in 28 sets of interviews in which respondents were asked to list all the things they could think of in one of 18 topical domains. The domains-like kinds of fruits (highly bounded) and things that mothers do (unbounded)-varied greatly in size. The datasets comprise 20-99 interviews each (1,147 total interviews). When saturation was defined as the point where less than one new item per person would be expected, the median sample size for reaching saturation was 75 (range = 15-194). Thematic saturation was, as expected, related to domain size. It was also related to the amount of information contributed by each respondent but, unexpectedly, was reached more quickly when respondents contributed less information. In contrast, a greater amount of information per person increased the retrieval of salient items. Even small samples (n = 10) produced 95% of the most salient ideas with exhaustive listing, but only 53% of those items were captured with limited responses per person (three). For most domains, item salience appeared to be a more useful concept for thinking about sample size adequacy than finding the point of thematic saturation. Thus, we advance the concept of saturation in salience and emphasize probing to increase the amount of information collected per respondent to increase sample efficiency.

SUBMITTER: Weller SC

PROVIDER: S-EPMC6010234 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Open-ended interview questions and saturation.

Weller Susan C SC Vickers Ben B Bernard H Russell HR Blackburn Alyssa M AM Borgatti Stephen S Gravlee Clarence C CC Johnson Jeffrey C JC

PloS one 20180620 6

Sample size determination for open-ended questions or qualitative interviews relies primarily on custom and finding the point where little new information is obtained (thematic saturation). Here, we propose and test a refined definition of saturation as obtaining the most salient items in a set of qualitative interviews (where items can be material things or concepts, depending on the topic of study) rather than attempting to obtain all the items. Salient items have higher prevalence and are mor ...[more]

PMID: 29924873

Similar Datasets

Project description:BackgroundCurrent depression, anxiety, and suicide screening techniques rely on retrospective patient reported symptoms to standardized scales. A qualitative approach to screening combined with the innovation of natural language processing (NLP) and machine learning (ML) methods have shown promise to enhance person-centeredness while detecting depression, anxiety, and suicide risk from in-the-moment patient language derived from an open-ended brief interview.ObjectiveTo evaluate the performance of NLP/ML models to identify depression, anxiety, and suicide risk from a single 5-10-min semi-structured interview with a large, national sample.MethodTwo thousand four hundred sixteen interviews were conducted with 1,433 participants over a teleconference platform, with 861 (35.6%), 863 (35.7%), and 838 (34.7%) sessions screening positive for depression, anxiety, and suicide risk, respectively. Participants completed an interview over a teleconference platform to collect language about the participants' feelings and emotional state. Logistic regression (LR), support vector machine (SVM), and extreme gradient boosting (XGB) models were trained for each condition using term frequency-inverse document frequency features from the participants' language. Models were primarily evaluated with the area under the receiver operating characteristic curve (AUC).ResultsThe best discriminative ability was found when identifying depression with an SVM model (AUC = 0.77; 95% CI = 0.75-0.79), followed by anxiety with an LR model (AUC = 0.74; 95% CI = 0.72-0.76), and an SVM for suicide risk (AUC = 0.70; 95% CI = 0.68-0.72). Model performance was generally best with more severe depression, anxiety, or suicide risk. Performance improved when individuals with lifetime but no suicide risk in the past 3 months were considered controls.ConclusionIt is feasible to use a virtual platform to simultaneously screen for depression, anxiety, and suicide risk using a 5-to-10-min interview. The NLP/ML models performed with good discrimination in the identification of depression, anxiety, and suicide risk. Although the utility of suicide risk classification in clinical settings is still undetermined and suicide risk classification had the lowest performance, the result taken together with the qualitative responses from the interview can better inform clinical decision-making by providing additional drivers associated with suicide risk.

Project description:BackgroundPatient satisfaction with in-person medical visits includes patient-clinician engagement. However, communication, empathy, and other relationship-centered care measures in virtual visits have not been adequately investigated.ObjectiveThis study aims to comprehensively consider patient experience, including relationship-centered care measures, to assess patient satisfaction during virtual visits.MethodsWe conducted a large survey study with open-ended questions to comprehensively assess patients' experiences with virtual visits in a diverse patient population. Adults with a virtual visit between June 21, 2017, and July 12, 2017, were invited to complete a survey of 21 Likert-scale items and textboxes for comments following their visit. Factor analysis of the survey items revealed three factors: experience with technology, patient-clinician engagement, and overall satisfaction. Multivariable logistic regression was used to test the associations among the three factors and patient demographics, clinician type, and prior relationship with the clinician. Using qualitative framework analysis, we identified recurrent themes in survey comments, quantitatively coded comments, and computed descriptive statistics of the coded comments.ResultsA total of 65.7% (426/648) of the patients completed the survey; 64.1% (273/426) of the respondents were women, and the average age was 46 (range 18-86) years. The sample was geographically diverse: 70.2% (299/426) from Ohio, 6.8% (29/426) from Florida, 4.2% (18/426) from Pennsylvania, and 18.7% (80/426) from other states. With regard to insurance coverage, 57.5% (245/426) were undetermined, 23.7% (101/426) had the hospital's employee health insurance, and 18.7% (80/426) had other private insurance. Types of virtual visits and clinicians varied. Overall, 58.4% (249/426) of patients had an on-demand visit, whereas 41.5% (177/426) had a scheduled visit. A total of 41.8% (178/426) of patients had a virtual visit with a family physician, 20.9% (89/426) with an advanced practice provider, and the rest had a visit with a specialist. Most patients (393/423, 92.9%) agreed that their virtual visit clinician was interested in them as a person, and their virtual visit made it easy to get the care they needed (383/421, 90.9%). A total of 81.9% (344/420) of respondents agreed or strongly agreed that their virtual visit was as good as an in-person visit by a clinician. Having a prior relationship with their virtual visit clinician was associated with less comfort and ease with virtual technology among patients (odds ratio 0.58, 95% CI 0.35-0.98). In terms of technology, patients found the interface easy to use (392/423, 92.7%) and felt comfortable using it (401/423, 94.8%). Technical difficulties were associated with lower odds of overall satisfaction (odds ratio 0.46, 95% CI 0.28-0.76).ConclusionsPatient-clinician engagement in virtual visits was comparable with in-person visits. This study supports the value and acceptance of virtual visits. Evaluations of virtual visits should include assessments of technology and patient-clinician engagement, as both are likely to influence patient satisfaction.

Project description:IntroductionIdentifying stakeholders' needs is crucial to informing decisions and policy development. This study aims to identify healthcare and social-related needs and effective strategies associated with COVID-19 from the first-person perspectives of patients and healthcare providers.MethodsCross-sectional online survey design including qualitative open-ended questions, conducted in primary care and hospital settings across Spain, with 12 out of 19 regions represented. Adults aged 18 years and older, who (a) resided in Spain and had a history of COVID-19 or (b) worked as healthcare providers delivering direct or indirect care for people with COVID-19 in Spanish primary care or hospitals during 2020 were eligible to participate. Recruitment was conducted via social-media networks (Twitter, LinkedIn, and WhatsApp) and communication channels of key organizations including patient and professional associations and groups. A total of 182 people were invited to complete the surveys and 76 people completed the surveys (71% women), of which 33 were home-isolated patients, 14 were hospitalized patients, 16 were primary care professionals, and 13 were hospital care professionals.ResultsA total of 327 needs and 86 effective strategies and positive aspects were identified across surveys and classified into the following overarching themes: (i) Accessibility, (ii) Basic needs, (iii) Clinical care, (iv) Person-and-family centered care, (v) Caring for the healthcare professional, (vi) Protocolization, information, health campaigns, and education, (vii) Resource availability, (viii) and Organizational needs/strategies.DiscussionFindings indicate the Spanish health and social care systems were generally unprepared to combat COVID-19. Implications for research, practice, and policy focus on integrating first-person perspectives as best practice to identify, prioritize and address needs to increase health and social care systems capacity and preparedness, as well as providing well-co-coordinated responses across government, healthcare, and non-government sectors to promote and protect the physical and mental health of all.

Dataset Information

Open-ended interview questions and saturation.

Publications

Open-ended interview questions and saturation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets