Dataset Information

Making comparative performance information more comprehensible: an experimental evaluation of the impact of formats on consumer understanding.

ABSTRACT:

Study objectives

We aimed to investigate how different presentation formats influence comprehension and use of comparative performance information (CPI) among consumers.

Methods

An experimental between-subjects and within-subjects design with manipulations of CPI presentation formats. We enrolled both consumers with lower socioeconomic status (SES)/cognitive skills and consumers with higher SES/cognitive skills, recruited through an online access panel. Respondents received fictitious CPI and completed questions about interpretation and information use. Between subjects, we tested (1) displaying an overall performance score (yes/no); (2) displaying a small number of quality indicators (5 vs 9); and (3) displaying different types of evaluative symbols (star ratings, coloured dots and word icons vs numbers and bar graphs). Within subjects, we tested the effect of a reduced number of healthcare providers (5 vs 20). Data were analysed using descriptive analysis, analyses of variance and paired-sampled t tests.

Results

A total of 902 (43%) respondents participated. Displaying an overall performance score and the use of coloured dots and word icons particularly enhanced consumer understanding. Importantly, respondents provided with coloured dots most often correctly selected the top three healthcare providers (84.3%), compared with word icons (76.6% correct), star ratings (70.6% correct), numbers (62.0%) and bars (54.2%) when viewing performance scores of 20 providers. Furthermore, a reduced number of healthcare providers appeared to support consumers, for example, when provided with 20 providers, 69.5% correctly selected the top three, compared with 80.2% with five providers.

Discussion

Particular presentation formats enhanced consumer understanding of CPI, most importantly the use of overall performance scores, word icons and coloured dots, and a reduced number of providers displayed. Public report efforts should use these formats to maximise impact on consumers.

SUBMITTER: Damman OC

PROVIDER: S-EPMC5136725 | biostudies-literature | 2016 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Making comparative performance information more comprehensible: an experimental evaluation of the impact of formats on consumer understanding.

Damman Olga C OC De Jong Anco A Hibbard Judith H JH Timmermans Danielle R M DR

BMJ quality & safety 20151105 11

<h4>Study objectives</h4>We aimed to investigate how different presentation formats influence comprehension and use of comparative performance information (CPI) among consumers.<h4>Methods</h4>An experimental between-subjects and within-subjects design with manipulations of CPI presentation formats. We enrolled both consumers with lower socioeconomic status (SES)/cognitive skills and consumers with higher SES/cognitive skills, recruited through an online access panel. Respondents received fictit ...[more]

PMID: 26543066

Similar Datasets

Project description:BackgroundElectronic health resources are becoming prevalent. However, consumer medication information (CMI) is still predominantly text based. Incorporating multimedia into CMI (eg, images, narration) may improve consumers' memory of the information as well as their perceptions and preferences of these materials.ObjectiveThis study examined whether adding images and narration to CMI impacted patients' (1) memory, (2) perceptions of comprehensibility, utility, or design quality, and (3) overall preferences.MethodsWe presented 36 participants with CMI in 3 formats: (1) text, (2) text + images, and (3) narration + images, and subsequently asked them to recall information. After seeing all 3 CMI formats, participants rated the formats in terms of comprehensibility, utility, and design quality, and ranked them from most to least favorite.ResultsInterestingly, no significant differences in memory were observed (F2,70=0.1, P=0.901). Thus, this study did not find evidence to support multimedia or modality principles in the context of CMI. Despite the absence of effects on memory, the CMI format significantly impacted perceptions of the materials. Specifically, participants rated the text + images format highest in terms of comprehensibility (χ22=26.5, P<.001) and design quality (χ22=35.69, P<.001). Although the omnibus test suggested a difference in utility ratings as well (χ22=8.21, P=.016), no significant differences were found after correcting for multiple comparisons. Consistent with perception findings, the preference ranks yielded a significant difference (χ22=26.00, P<.001), whereby participants preferred the text + images format overall. Indeed, 75% (27/36) of participants chose the text + images format as their most favorite. Thus, although there were no objective memory differences between the formats, we observed subjective differences in comprehensibility, design quality, and overall preferences.ConclusionsThis study revealed that although multimedia did not appear to influence memory of CMI, it did impact participants' opinions about the materials. The lack of observed differences in memory may have been due to ceiling effects, memory rather than understanding as an index of learning, the fragmented nature of the information in CMI itself, or the size or characteristics of the sample (ie, young, educated subjects with adequate health literacy skills). The differences in the subjective (ie, perceptions and preferences) and objective (ie, memory) results highlight the value of using both types of measures. Moreover, findings from this study could be used to inform future research on how CMI could be designed to better suit the preferences of consumers and potentially increase the likelihood that CMI is used. Additional research is warranted to explore whether multimedia impacts memory of CMI under different conditions (eg, older participants, subjects with lower levels of health literacy, more difficult stimuli, or extended time for decay).

Project description:BackgroundMedication is the most common intervention in health care, and the number of online consumer information systems within the pharmaceutical sector is increasing. However, online consumer information systems can be a barrier for users, imposing information asymmetries between stakeholders.ObjectiveThe objective of this study was to quantify and compare the usability of an online consumer medication information system (OCMIS) against a reference implementation based on an interoperable information model for patients, physicians, and pharmacists.MethodsQuantitative and qualitative data were acquired from patients, physicians, and pharmacists in this online usability study. We administered 3 use cases and a post hoc questionnaire per user. Quantitative usability data including effectiveness (task success), efficiency (task time), and user satisfaction (system usability scale [SUS]) was complemented by qualitative and demographic data. Users evaluated 6 existing systems and 1 reference implementation of an OCMIS.ResultsA total of 137 patients, 81 physicians, and 68 pharmacists participated in this study. Task success varied from 84% to 92% in patients, 66% to 100% in physicians, and 50% to 91% in pharmacists. Task completion time decreased over the course of the study for all but 2 OCMIS within the patient group. Due to an assumed nonnormal distribution of SUS scores, within-group comparison was done using the Kruskal-Wallis test. Patients showed differences in SUS scores (P=.02) and task time (P=.03), while physicians did not have significant differences in SUS scores (P=.83) and task time (P=.72). For pharmacists, a significant difference in SUS scores (P<.001) and task time (P=.007) was detected.ConclusionsThe vendor-neutral reference implementation based on an interoperable information model was proven to be a promising approach that was not inferior to existing solutions for patients and physicians. For pharmacists, it exceeded user satisfaction scores compared to other OCMIS. This data-driven approach based on an interoperable information model enables the development of more user-tailored features to increase usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.

Project description:The increase in packaged food and beverage portion sizes has been identified as a potential factor implicated in the rise of the prevalence of obesity. In this context, the objective of this systematic scoping review was to investigate how healthy adults perceive and interpret serving size information on food packages and how this influences product perception and consumption. Such knowledge is needed to improve food labelling understanding and guide consumers toward healthier portion size choices. A search of seven databases (2010 to April 2019) provided the records for title and abstract screening, with relevant articles assessed for eligibility in the full-text. Fourteen articles met the inclusion criteria, with relevant data extracted by one reviewer and checked for consistency by a second reviewer. Twelve studies were conducted in North America, where the government regulates serving size information. Several studies reported a poor understanding of serving size labelling. Indeed, consumers interpreted the labelled serving size as a recommended serving for dietary guidelines for healthy eating rather than a typical consumption unit, which is set by the manufacturer or regulated in some countries such as in the U.S. and Canada. Not all studies assessed consumption; however, larger labelled serving sizes resulted in larger self-selected portion sizes in three studies. However, another study performed on confectionary reported the opposite effect, with larger labelled serving sizes leading to reduced consumption. The limited number of included studies showed that labelled serving size affects portion size selection and consumption, and that any labelled serving size format changes may result in increased portion size selection, energy intake and thus contribute to the rise of the prevalence of overweight and obesity. Research to test cross-continentally labelled serving size format changes within experimental and natural settings (e.g., at home) are needed. In addition, tailored, comprehensive and serving-size-specific food literacy initiatives need to be evaluated to provide recommendations for effective serving size labelling. This is required to ensure the correct understanding of nutritional content, as well as informing food choices and consumption, for both core foods and discretionary foods.

Project description:Background and significanceIt is increasingly recognized that some patients self-manage in the context of social networks rather than alone. Consumer health information technology (IT) designed to support socially embedded self-management must be responsive to patients' everyday communication practices. There is an opportunity to improve consumer health IT design by explicating how patients currently leverage social media to support health information communication.ObjectiveThe objective of this study was to determine types of health information communication patterns that typify Facebook users with chronic health conditions to guide consumer health IT design.Materials and methodsSeven hundred participants with type 2 diabetes were recruited through a commercial survey access panel. Cluster analysis was used to identify distinct approaches to health information communication both on and off Facebook. Analysis of variance (ANOVA) methods were used to identify demographic and behavioral differences among profiles. Secondary analysis of qualitative interviews ( n = 25) and analysis of open-ended survey questions were conducted to understand participant rationales for each profile.ResultsOur analysis yielded 7 distinct health information communication profiles. Five of 7 profiles had consistent patterns both on and off Facebook, while the remaining 2 demonstrated distinct practices, with no health information communication on Facebook but some off Facebook. One profile was distinct from all others in both health information communication practices and demographic composition. Rationales for following specific health information communication practices were categorized under 6 themes: altruism, instrumental support, social support, privacy and stigma, convenience, and Facebook knowledge.ConclusionFacebook has been widely adopted for health information communication; This study demonstrates that Facebook has been widely adopted for health information communication. It also shows that the ways in which patients communicate health information on and off Facebook are diverse.

Project description:BackgroundTechnology gains have improved tools for evaluating complex tasks by providing environmental supports (ES) that increase ease of use and improve performance outcomes through the use of information visualizations (info-vis). Complex info-vis emphasize the need to understand individual differences in abilities of target users, the key cognitive abilities needed to execute a decision task, and the graphical elements that can serve as the most effective ES. Older adults may be one such target user group that would benefit from increased ES to mitigate specific declines in cognitive abilities. For example, choosing a prescription drug plan is a necessary and complex task that can impact quality of life if the wrong choice is made. The decision to enroll in one plan over another can involve comparing over 15 plans across many categories. Within this context, the large amount of complex information and reduced working memory capacity puts older adults' decision making at a disadvantage. An intentionally designed ES, such as an info-vis that reduces working memory demand, may assist older adults in making the most effective decision among many options.ObjectiveThe objective of this study is to examine whether the use of an info-vis can lower working memory demands and positively affect complex decision-making performance of older adults in the context of choosing a Medicare prescription drug plan.MethodsParticipants performed a computerized decision-making task in the context of finding the best health care plan. Data included quantitative decision-making performance indicators and surveys examining previous history with purchasing insurance. Participants used a colored info-vis ES or a table (no ES) to perform the decision task. Task difficulty was manipulated by increasing the number of selection criteria used to make an accurate decision. A repeated measures analysis was performed to examine differences between the two table designs.ResultsTwenty-three older adults between the ages of 66 and 80 completed the study. There was a main effect for accuracy such that older adults made more accurate decisions in the color info-vis condition than the table condition. In the low difficulty condition, participants were more successful at choosing the correct answer when the question was about the gap coverage attribute in the info-vis condition. Participants also made significantly faster decisions in the info-vis condition than in the table condition.ConclusionsReducing the working memory demand of the task through the use of an ES can improve decision accuracy, especially when selection criteria is only focused on a single attribute of the insurance plan.

Dataset Information

Making comparative performance information more comprehensible: an experimental evaluation of the impact of formats on consumer understanding.

Study objectives

Methods

Results

Discussion

Publications

Making comparative performance information more comprehensible: an experimental evaluation of the impact of formats on consumer understanding.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets