Best-worst scaling improves measurement of first impressions.
Ontology highlight
ABSTRACT:
SUBMITTER: Burton N
PROVIDER: S-EPMC6757072 | biostudies-literature | 2019 Sep
REPOSITORIES: biostudies-literature
Publications
Best-worst scaling improves measurement of first impressions.
Burton Nichola N Burton Michael M Rigby Dan D Sutherland Clare A M CAM Rhodes Gillian G
Cognitive research: principles and implications 20190923 1
A common goal in psychological research is the measurement of subjective impressions, such as first impressions of faces. These impressions are commonly measured using Likert ratings. Although these ratings are simple to administer, they are associated with response issues that can limit reliability. Here we examine best-worst scaling (BWS), a forced-choice method, as a potential alternative to Likert ratings for measuring participants' facial first impressions. We find that at the group level, ...[more]
Similar Datasets
Project description:IntroductionBest-worst scaling (BWS) is becoming increasingly popular to elicit preferences in health care. However, little is known about current practice and trends in the use of BWS in health care. This study aimed to identify, review and critically appraise BWS in health care, and to identify trends over time in key aspects of BWS.MethodsA systematic review was conducted, using Medline (via Pubmed) and EMBASE to identify all English-language BWS studies published up until April 2016. Using a predefined extraction form, two reviewers independently selected articles and critically appraised the study quality, using the Purpose, Respondents, Explanation, Findings, Significance (PREFS) checklist. Trends over time periods (?2010, 2011, 2012, 2013, 2014 and 2015) were assessed further.ResultsA total of 62 BWS studies were identified, of which 26 were BWS object case studies, 29 were BWS profile case studies and seven were BWS multi-profile case studies. About two thirds of the studies were performed in the last 2 years. Decreasing sample sizes and decreasing numbers of factors in BWS object case studies, as well as use of less complicated analytical methods, were observed in recent studies. The quality of the BWS studies was generally acceptable according to the PREFS checklist, except that most studies did not indicate whether the responders were similar to the non-responders.ConclusionUse of BWS object case and BWS profile case has drastically increased in health care, especially in the last 2 years. In contrast with previous discrete-choice experiment reviews, there is increasing use of less sophisticated analytical methods.
| S-EPMC5110583 | biostudies-literature
Project description:Epilepsy is a common, serious condition. Fortunately, seizure risk decreases with increasing seizure-free time on antiseizure medications (ASMs). Eventually, patients may consider whether to stop ASMs, which requires weighing treatment benefit versus burden. We developed a questionnaire to quantify patient preferences relevant to ASM decision-making. Respondents rated how concerning they would finding relevant items (e.g., seizure risks, side effects, cost) on a Visual Analogue Scale (VAS, 0-100) and then repeatedly chose the most and least concerning item from subsets (best-worst scaling, BWS). We pretested with neurologists, then recruited adults with epilepsy who were seizure-free at least one year. Primary outcomes were recruitment rate, and qualitative and Likert-based feedback. Secondary outcomes included VAS ratings and best-minus-worst scores. Thirty-one of 60 (52%) contacted patients completed the study. Most patients felt VAS questions were clear (28; 90%), easy to use (27; 87%), and assessed preferences well (25; 83%). Corresponding results for BWS questions were 27 (87%), 29 (97%), and 23 (77%). Physicians suggested adding a 'warmup' question showing a completed example and simplifying terminology. Patients suggested ways to clarify instructions. Cost, inconvenience of taking medication, and laboratory monitoring were the least concerning items. Cognitive side effects and a 50% seizure risk in the next year were the most concerning items. Twelve (39%) of patients made at least one 'inconsistent choice' for example ranking a higher seizure risk as lower concern compared with a lower seizure risk, though 'inconsistent choices' represented only 3% of all question blocks. Our recruitment rate was favorable, most patients agreed the survey was clear, and we describe areas for improvement. 'Inconsistent' responses may lead us to collapse seizure probability items into a single 'seizure' category. Evidence regarding how patients weigh benefits and harms may inform care and guideline development.
| S-EPMC9983827 | biostudies-literature
Project description:As exome sequencing expands as a diagnostic tool, patients and providers have voiced concerns about communicating the breadth and scope of potential results when obtaining informed consent. This study aimed to understand how genetic counselors prioritize essential components of the informed consent process and whether counselor factors influence these decisions. Development of a best-worst scaling experiment was informed by a systematic literature review and two focus groups. In all, 11 choice sets were created using a balanced incomplete block design, where participants selected the most and least important object in each set. Mean best-worst (BW) scores were calculated to summarize the relative importance of each object, and mediation analyses assessed whether responses were associated with genetic counselor factors and attitudes. In all, 342 members of the National Society of Genetic Counselors completed the online survey. Ranking of BW scores suggests that participants prioritize collaborative decision-making, assessing understanding and managing expectations, with the least emphasis placed on discussing technological complexities. Stratified analyses found that counselors more experienced with obtaining informed consent for exome sequencing and those reporting higher perceptions of patients' ability to manage information rated discussing variants of uncertain significance as significantly more important (p < .05). Our results suggest that genetic counselors report intentions to prioritize individual patient needs when obtaining informed consent for exome sequencing. Professional characteristics and attitudes may influence preemptive discussion of uncertain results.
| S-EPMC7422696 | biostudies-literature
Project description:OBJECTIVE:To quantitatively evaluate parental preferences for the various treatments for vesicoureteral reflux using crowd-sourced best-worst scaling, a novel technique in urologic preference estimation. METHODS:Preference data were collected from a community sample of parents via 2 best-worst scaling survey instruments published to Amazon's Mechanical Turk online community. Attributes and attribute levels were selected following extensive review of the reflux literature. Respondents completed an object case best-worst scaling exercise to prioritize general aspects of reflux treatments and multiprofile case best-worst scaling to elicit their preferences for the specific differences in reflux treatments. Data were analyzed using multinomial logistic regression. Results from the object-case provided probability scaled values (PSV) that reflected the order of importance of attributes. RESULTS:We analyzed data for 248 and 228 respondents for object and multiprofile case BWS, respectively. When prioritizing general aspects of reflux treatment, effectiveness (PSV?=?20.37), risk of future urinary tract infection (PSV?=?14.85), and complication rate (PSV?=?14.55) were most important to parents. Societal cost (PSV?=?1.41), length of hospitalization (PSV?=?1.09), and cosmesis (PSV?=?0.91) were least important. Parents perceived no difference in preference for the cosmetic outcome of open vs minimally invasive surgery (P?=?.791). Bundling attribute preference weights, parents in our study would choose open surgery 74.9% of the time. CONCLUSION:High treatment effectiveness was the most important and preferred attribute to parents. Alternatively, cost and cosmesis were among the least important. Our findings serve to inform shared parent-physician decision-making for vesicoureteral reflux.
| S-EPMC6525647 | biostudies-literature
Project description:Background and objectiveBest-worst scaling is a theory-driven method that can be used to prioritize objects in health. We sought to characterize all studies of best-worst scaling to prioritize objects in health, to assess trends of using best-worst scaling in prioritization over time, and to assess the relationship between a legacy measure of quality (PREFS) and a novel assessment of subjective quality and policy relevance.MethodsA systematic review identified studies published through to the end of 2021 that applied best-worst scaling to study priorities in health (PROSPERO CRD42020209745), updating a prior review published in 2016. The PubMed, EBSCOhost, Embase, Scopus, APA PsychInfo, Web of Science, and Google Scholar databases were used and were supplemented by a hand search. Data describing the application, development, design, administration/analysis, quality, and policy relevance were summarized and we tested for trends by comparing articles before and after 1 January, 2017. Multivariate statistics were then used to assess the relationships between PREFS, subjective quality, policy relevance, and other possible indicators.ResultsFrom a total of 2826 unique papers identified, 165 best-worst scaling studies were included in this review. Applications of best-worst scaling to study priorities in health have continued to grow (p < 0.01) and are now used in all regions of the world, most often to study the priorities of patients/consumers (67%). Several key trends can be observed over time: increased use of pretesting (p < 0.05); increased use of online administration (p < 0.01), and decreased use of paper self-administered surveys (p = 0.02); increased use of heterogeneity analysis (p = 0.02); an increase in having a clearly stated purpose (p < 0.01); and a decrease in comparing respondents to non-respondents (p = 0.01). The average sample size has more than doubled, from 228 to 472 respondents, but formal sample size justifications remain low (5.3%) and unchanged over time (p = 0.68). While the average PREFS score remained unchanged at 3.1/5, both subjective quality and policy relevance trended up, but changes were not statistically significant (p = 0.06 and p = 0.13). Most of the variation in subjective quality was driven by PREFS (R2 = 0.42), but it was also positively assosciated with policy relevance, heterogeneity analysis, and using a balanced incomplete block design, and was negatively associated with not using developmental methods and an increasing sample size.ConclusionsUsing best-worst scaling to prioritize objects is now commonly used around the world to assess the priorities of patients and other stakeholders in health. Best practices are clearly emerging for best-worst scaling. Although legacy measures (PREFS) to measure study quality are reasonable, there may need to be new tools to assess both study quality and policy relevance.
| S-EPMC9363399 | biostudies-literature
Project description:ContextAlthough patients with acute myeloid leukemia (AML) experience significant toxicities and poor outcomes, few studies have quantified patients' experience.MethodsA community-centered approach was used to develop an AML-specific best-worst scaling (BWS) instrument involving 13 items in four domains (psychological, physical, decision-making, and treatment delivery) to quantify patient worry. A survey of patients and caregivers was conducted using the instrument. Data were analyzed using conditional logistic regression.ResultsThe survey was completed by 832 patients and 237 caregivers. Patients were predominantly white (88%), married/partnered (72%), and in remission (95%). The median age was 55 years (range: 19-87). Median time since diagnosis was 8 years (range: 1-40). Patients worried most about "the possibility of dying from AML" (BWS score = 15.5, confidence interval [CI] [14.2-16.7]) and "long-term side effects of treatments" (14.0, CI [12.9-15.2]). Patients found these items more than twice as worrisome as all items within the domains of care delivery and decision-making. Patients were least worried about "communicating openly with doctors" (2.50, CI [1.97-3.04]) and "having access to the best medical care" (3.90, CI [3.28-4.61]). Caregiver reports were highly correlated to patients' (Spearman's ρ = 0.89) though noted significantly more worry about the possibility of dying and spending time in the hospital.ConclusionThis large convenience sample demonstrates that AML patients have two principal worries: dying from their disease and suffering long-term side effects from treatment. To better foster patient-centered care, therapeutic decision-making and drug development should reflect the importance of both potential outcomes. Further work should explore interventions to address these worries.
| S-EPMC10246445 | biostudies-literature
Project description:PurposeTo estimate patient preferences regarding potential adverse outcomes of local versus systemic corticosteroid therapies for noninfectious uveitis by using a best-worst scaling (BWS) approach.MethodsLocal and systemic therapies are alternatives for noninfectious uveitis that have different potential adverse outcomes. Patients participating in the Multicenter Uveitis Steroid Treatment Trial Follow-up Study (MUST FS) and additional patients with a history of noninfectious uveitis treated at two academic medical centers (Johns Hopkins University and University of Pennsylvania) were surveyed about their preferences regarding six adverse outcomes deemed important to patients. Using "case 1" BWS, patients were asked to repeatedly select the most and least worrying from a list of outcomes (in the survey three outcomes per task).ResultsEighty-two patients in the MUST FS and 100 patients treated at the academic medical centers completed the survey. According to BWS, patients were more likely to select vision not meeting the requirement for driving (individual BWS score: median = 3, interquartile range, 0-5), development of glaucoma (2, 1-4), and needing eye surgery (1, 0-3) as the most worrying outcomes as compared to needing medicine for high blood pressure/cholesterol (-2, -4 to 0), development of cataracts (-2, -3 to -1), or infection (sinusitis) (-3, -5 to 0). Larger BWS scores indicated the outcomes were more worrying to patients.ConclusionsPatients with noninfectious uveitis considered impaired vision, development of glaucoma, and need for eye surgery worrying adverse outcomes, which suggests that it is especially desirable to avoid these outcomes if possible. (ClinicalTrials.gov number, NCT00132691.)
| S-EPMC4627251 | biostudies-literature
Project description:ObjectiveThis study seeks to quantify the treatment goals of people recently diagnosed with schizophrenia and explore their impact on treatment plan.MethodsPeople aged 18-35 years with a confirmed diagnosis of schizophrenia within the past 5 years were surveyed in the UK, Germany, and Italy. Treatment goals were assessed via a validated best-worst scaling instrument, where participants evaluated subsets of 13 possible treatment goals identified using a balanced incomplete block design. Participants identified the most and least important goals within each task. Data were also collected on current treatment and preference for daily oral versus long-acting injectable (LAI) treatment. Hierarchical Bayes was used to identify preference weights for the goals, and latent class analysis was used to identify segments of people with similar goals. The segments were compared with the current treatment and preference for oral versus LAI treatment.ResultsAcross 100 participants, the average age was 26 years, 75% were male and 50% were diagnosed within 2 years ago. Overall, preferences were most favorable for reduced disease symptoms, think clearly, reduced hospitalizations, reduced anxiety, and take care of self. A total of 61% preferred oral medication and 39% LAI. Two groups were identified with different treatment goals; 50% of participants emphasized clinical goals, including reduced disease symptoms (preference weight =19.7%), reduced hospitalizations (15.5%), and reduced anxiety (10.5%). The other 50% emphasized functional goals, including improved relationships with family/friends (11.4%), increased interest in work (10.6%), experiencing a fuller range of emotions (8.4%), and ability to socialize (7.5%). Those emphasizing functional goals were more likely to be on LAI (44% versus 26%; p=0.059) and preferred LAI (46% versus 32%; p=0.151).ConclusionsPeople with recent-onset schizophrenia may focus more on clinical goals or functional goals, a discussion of which may help facilitate patient engagement.
| S-EPMC5757991 | biostudies-literature
Project description:Food safety is a global public health issue, which often arises from asymmetric information between consumers and suppliers. With the development of information technology in human life, building a food traceability information sharing platform is viewed as one of the best ways to overcome the trust crisis and resolve the problem of information asymmetry in China. However, among the myriad information available from the food supply chain, there is a lack of knowledge on consumer preference. Based on the best-worst scaling approach, this paper investigated consumer preferences for vegetable, pork, and dairy product traceability information. Specifically, this paper measured the relative importance that consumers place on the traceable information. The results indicate that consumers have varying priorities for information in different cases. "Pesticide/veterinary use," "picking/slaughtering date," and "fertilizer/feed use" are the most preferred traceable information for Chinese consumers in the case of vegetables, while "picking/slaughtering date" and "history of illness and taking protective measures" are the most preferred information in the case of pork. In the case of dairy products, consumers prefer "processing information," "environmental information of the origin," and "traceable tag certification information" most. The results of this study call for the direct involvement of the Chinese government in the food safety information sharing system as following. First, given consumers' diverse preferences, different types of traceable information should be recorded into the information sharing platform depending on food types. Second, the government could promote the step-by-step construction of such a platform based on the priority of consumers' preferences. Third, new technology should be applied to guarantee the reliability of traceable information. Finally, local preferences in terms of the way consumers receive and understand information should be taken into consideration.
| S-EPMC6214548 | biostudies-literature
Project description:This paper presents empirical findings from a combination of two elicitation techniques-discrete choice experiment (DCE) and best-worst scaling (BWS)-to provide information about the role of consumers' trust in food choice decisions in the case of credence attributes. The analysis was based on a sample of 459 Taiwanese consumers and focuses on red sweet peppers. DCE data were examined using latent class analysis to investigate the importance and the utility different consumer segments attach to the production method, country of origin, and chemical residue testing. The relevance of attitudinal and trust-based items was identified by BWS using a hierarchical Bayesian mixed logit model and was aggregated to five latent components by means of principal component analysis. Applying a multinomial logit model, participants' latent class membership (obtained from DCE data) was regressed on the identified attitudinal and trust components, as well as demographic information. Results of the DCE latent class analysis for the product attributes show that four segments may be distinguished. Linking the DCE with the attitudinal dimensions reveals that consumers' attitude and trust significantly explain class membership and therefore, consumers' preferences for different credence attributes. Based on our results, we derive recommendations for industry and policy.
| S-EPMC7023131 | biostudies-literature