Dataset Information

Comparing the use of open and closed questions for Web-based measures of the continued-influence effect.

ABSTRACT: Open-ended questions, in which participants write or type their responses, are used in many areas of the behavioral sciences. Although effective in the lab, they are relatively untested in online experiments, and the quality of responses is largely unexplored. Closed-ended questions are easier to use online because they generally require only single key- or mouse-press responses and are less cognitively demanding, but they can bias the responses. We compared the data quality obtained using open and closed response formats using the continued-influence effect (CIE), in which participants read a series of statements about an unfolding event, one of which is unambiguously corrected later. Participants typically continue to refer to the corrected misinformation when making inferential statements about the event. We implemented this basic procedure online (Exp. 1A, n = 78), comparing standard open-ended responses to an alternative procedure using closed-ended responses (Exp. 1B, n = 75). Finally, we replicated these findings in a larger preregistered study (Exps. 2A and 2B, n = 323). We observed the CIE in all conditions: Participants continued to refer to the misinformation following a correction, and their references to the target misinformation were broadly similar in number across open- and closed-ended questions. We found that participants' open-ended responses were relatively detailed (including an average of 75 characters for inference questions), and almost all responses attempted to address the question. The responses were faster, however, for closed-ended questions. Overall, we suggest that with caution it may be possible to use either method for gathering CIE data.

SUBMITTER: Connor Desai S

PROVIDER: S-EPMC6538818 | biostudies-other | 2019 Jun

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Comparing the use of open and closed questions for Web-based measures of the continued-influence effect.

Connor Desai Saoirse S Reimers Stian S

Behavior research methods 20190601 3

Open-ended questions, in which participants write or type their responses, are used in many areas of the behavioral sciences. Although effective in the lab, they are relatively untested in online experiments, and the quality of responses is largely unexplored. Closed-ended questions are easier to use online because they generally require only single key- or mouse-press responses and are less cognitively demanding, but they can bias the responses. We compared the data quality obtained using open ...[more]

PMID: 29943224

Similar Datasets

Project description:As pre-exposure prophylaxis (PrEP) effectiveness is strongly linked to adherence, we sought to determine if certain self-report measures could be used to inform objective PrEP adherence. We studied participants from the TAPIR study (a multicenter randomized study of daily text messages to support adherence to PrEP In At-Risk), a 48-week randomized controlled trial of HIV-uninfected men who have sex with men (MSM) randomized to receive text message to support adherence versus standard of care. Self-reported medication adherence was assessed using several validated measures modified for PrEP. Objective PrEP adherence was determined through dried blood spot (DBS) measurement of intracellular tenofovir diphosphate (TFV-DP) and emtricitabine triphosphate (FTC-TP). A summary of adherence was estimated using responses to the seven adherence items at weeks 12 and 48 using confirmatory factor analysis. Correlations between self-report questions and drug concentrations were estimated with Pearson's correlations for continuous outcomes and point-biserial correlations for dichotomous outcomes. Receiver operating characteristic (ROC) analyses were conducted to assess the performance of self-report measures in predicting protective or perfect TFV-DP concentrations. Of the 369 participants who completed week 12 or 48 visits, the mean age was 35 (standard deviation 9 years), with 79% White, 12% Black, and 29% Hispanic. Correlations between self-report measures of adherence (both individual items and the adherence factor) and quantifiable FTC-TP and continuous TFV-DP concentrations showed that all self-report measures were significantly associated with these objective measures. Compared to a summary measure of self-reported adherence, the 4-week percent taken question medication recall was the only self-report item similarly or more strongly associated with recent adherence and long-term protective and perfect adherence at weeks 12 and 48. ROC analysis also showed that 4-week percent taken question had a reasonable AUC (0.798 at week 12 and 0.758 at week 48) in predicting protective TFV-DP concentrations. All single-item self-report questions assessing PrEP adherence were significantly associated with biomarker quantification, with the 4-week percent taken question performing best. Therefore, in the absence of drug concentration measurements, a 4-week self-report percent taken question may be a good single-item measure of PrEP adherence.

Dataset Information

Comparing the use of open and closed questions for Web-based measures of the continued-influence effect.

Publications

Comparing the use of open and closed questions for Web-based measures of the continued-influence effect.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets