Dataset Information

Validating vignette and conjoint survey experiments against real-world behavior.

ABSTRACT: Survey experiments, like vignette and conjoint analyses, are widely used in the social sciences to elicit stated preferences and study how humans make multidimensional choices. However, there is a paucity of research on the external validity of these methods that examines whether the determinants that explain hypothetical choices made by survey respondents match the determinants that explain what subjects actually do when making similar choices in real-world situations. This study compares results from conjoint and vignette analyses on which immigrant attributes generate support for naturalization with closely corresponding behavioral data from a natural experiment in Switzerland, where some municipalities used referendums to decide on the citizenship applications of foreign residents. Using a representative sample from the same population and the official descriptions of applicant characteristics that voters received before each referendum as a behavioral benchmark, we find that the effects of the applicant attributes estimated from the survey experiments perform remarkably well in recovering the effects of the same attributes in the behavioral benchmark. We also find important differences in the relative performances of the different designs. Overall, the paired conjoint design, where respondents evaluate two immigrants side by side, comes closest to the behavioral benchmark; on average, its estimates are within 2% percentage points of the effects in the behavioral benchmark.

SUBMITTER: Hainmueller J

PROVIDER: S-EPMC4345583 | biostudies-literature | 2015 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validating vignette and conjoint survey experiments against real-world behavior.

Hainmueller Jens J Hangartner Dominik D Yamamoto Teppei T

Proceedings of the National Academy of Sciences of the United States of America 20150202 8

Survey experiments, like vignette and conjoint analyses, are widely used in the social sciences to elicit stated preferences and study how humans make multidimensional choices. However, there is a paucity of research on the external validity of these methods that examines whether the determinants that explain hypothetical choices made by survey respondents match the determinants that explain what subjects actually do when making similar choices in real-world situations. This study compares resul ...[more]

PMID: 25646415

Similar Datasets

Project description:Background and purposeMultiple large trials have established the non-inferiority of hypofractionated radiotherapy compared to conventional fractionation. This study will determine real-world hypofractionation adoption across different geographic regions for breast, prostate, cervical cancer, and bone metastases, and identify barriers and facilitators to its use.Materials and methodsAn anonymous, electronic survey was distributed from January 2018 through January 2019 to radiation oncologists through the ESTRO-GIRO initiative. Predictors of hypofractionation were identified in univariable and multivariable regression analyses.Results2316 radiation oncologists responded. Hypofractionation was preferred in node-negative breast cancer following lumpectomy (82·2% vs. 46·7% for node-positive; p < 0.001), and in low- and intermediate-risk prostate cancer (57·5% and 54·5%, respectively, versus 41·2% for high-risk (p < 0.001)). Hypofractionation was used in 32·3% of cervix cases in Africa, but <10% in other regions (p < 0.001). For palliative indications, hypofractionation was preferred by the majority of respondents. Lack of long-term data and concerns about local control and toxicity were the most commonly cited barriers. In adjusted analyses, hypofractionation was least common for curative indications amongst low- and lower-middle-income countries, Asia-Pacific, female respondents, small catchment areas, and in centres without access to intensity modulated radiotherapy.ConclusionSignificant variation was observed in hypofractionation across curative indications and between regions, with greater concordance in palliation. Using inadequate fractionation schedules may impede the delivery of affordable and accessible radiotherapy. Greater regionally-targeted and disease-specific education on evidence-based fractionation schedules is needed to improve utilization, along with best-case examples addressing practice barriers and supporting policy reform.

Project description:Introduction:Common approaches to measure health behaviors rely on participant responses and are subject to bias. Technology-based alternatives, particularly using GPS, address these biases while opening new channels for research. This study describes the development and implementation of a GPS-based approach to detect health facility visits in rural Pune district, India. Methods:Participants were mothers of under-five year old children within the Vadu Demographic Surveillance area. Participants received GPS-enabled smartphones pre-installed with a location-aware application to continuously record and transmit participant location data to a central server. Data were analyzed to identify health facility visits according to a parameter-based approach, optimal thresholds of which were calibrated through a simulation exercise. Lists of GPS-detected health facility visits were generated at each of six follow-up home visits and reviewed with participants through prompted recall survey, confirming visits which were correctly identified. Detected visits were analyzed using logistic regression to explore factors associated with the identification of false positive GPS-detected visits. Results:We enrolled 200 participants and completed 1098 follow-up visits over the six-month study period. Prompted recall surveys were completed for 694 follow-up visits with one or more GPS-detected health facility visits. While the approach performed well during calibration (positive predictive value (PPV) 78%), performance was poor when applied to participant data. Only 440 of 22?251 detected visits were confirmed (PPV 2%). False positives increased as participants spent more time in areas of high health facility density (odds ratio (OR)?=?2.29, 95% confidence interval (CI)?=?1.62-3.25). Visits detected at facilities other than hospitals and clinics were also more likely to be false positives (OR?=?2.78, 95% CI?=?1.65-4.67) as were visits detected to facilities nearby participant homes, with the likelihood decreasing as distance increased (OR?=?0.89, 95% CI?=?0.82-0.97). Visit duration was not associated with confirmation status. Conclusions:The optimal parameter combination for health facility visits simulated by field workers substantially overestimated health visits from participant GPS data. This study provides useful insights into the challenges in detecting health facility visits where providers are numerous, highly clustered within urban centers and located near residential areas of the population which they serve.

Dataset Information

Validating vignette and conjoint survey experiments against real-world behavior.

Publications

Validating vignette and conjoint survey experiments against real-world behavior.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure