You Know What I Know: Interviewer Knowledge Effects in Subjective Expectation Elicitation.
Ontology highlight
ABSTRACT:
SUBMITTER: Kerwin JT
PROVIDER: S-EPMC8041053 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Elicitation methods aim to build participants' distributions about a parameter of interest. In most elicitation studies this parameter is rarely known in advance and hinders an objective comparison between elicitation methods. In two experiments, participants were first presented with a fixed random sequence of images and numbers and subsequently their subjective distributions of percentages of one of those numbers was elicited. Importantly, the true percentage was set in advance. The first experiment tested whether receiving instructions as to the elicitation method would assist in estimating a true value more accurately than receiving no instructions and whether accuracy was determined by the numerical skills of the participants. The second experiment sought to compare the elicitation method used in the first experiment with a variation of a graphical elicitation method. The results indicate that (i) receiving instructions as to the elicitation method does assist in producing estimates closer to a true percentage value, (ii) the level of numerical skills does not play a part in the accuracy of the estimation (Experiment 1), and (iii) although the average estimates of the betting and graphical method are not significantly different, the betting method leads to more precise estimations than the graphical method (Experiment 2). Both studies featured statistical procedures (functional data analysis and a novel clustering technique) not considered in past research on the elicitation of subjective distributions. The implications of these results are discussed in relation to a recent key study.
| S-EPMC6489894 | biostudies-other
Project description:Surveys of egocentric networks are especially vulnerable to methods effects. This study combines a true experiment-random assignment of respondents to receive essentially identical questions from either an in-person interviewer or an online survey--with audio recordings of the in-person interviews. We asked over 850 respondents from a general population several different name-eliciting questions. Face-to-face interviews yielded more cooperation and higher quality data but fewer names than did the web surveys. Exploring several explanations, we determine that interviewer differences account for the mode difference: Interviewers who consistently prompted respondents elicited as many alters as did the web survey and substantially more than did less active interviewers. Although both methods effects substantially influenced the volume of alters listed, they did not substantially modify associations of other variables with volume.
| S-EPMC6748643 | biostudies-literature
Project description:We are presented with choices each day about how to invest our effort to achieve our goals. Critically, these decisions must frequently be made under conditions of incomplete information, where either the effort required or possible reward to be gained is uncertain. Such choices therefore require the development of potential value estimates to guide effortful goal-directed behavior. To date, however, the neural mechanisms for this expectation process are unknown. Here, we used computational fMRI during an effort-based decision-making task where trial-wise information about effort costs and reward magnitudes was presented separately over time, thereby allowing us to model distinct effort/reward computations as choice-relevant information unfolded. We found that ventromedial prefrontal cortex (vmPFC) encoded expected subjective value. Further, activity in dorsal anterior cingulate (dACC) and anterior insula (aI) reflected both effort discounting as well as a subjective value prediction error signal derived from trial history. While prior studies have identified these regions as being involved in effort-based decision making, these data demonstrate their specific role in the formation and maintenance of subjective value estimates as relevant information becomes available.
| S-EPMC5984520 | biostudies-literature
Project description:Abstract Live video (LV) communication tools (e.g., Zoom) have the potential to provide survey researchers with many of the benefits of in-person interviewing, while also greatly reducing data collection costs, given that interviewers do not need to travel and make in-person visits to sampled households. The COVID-19 pandemic has exposed the vulnerability of in-person data collection to public health crises, forcing survey researchers to explore remote data collection modes—such as LV interviewing—that seem likely to yield high-quality data without in-person interaction. Given the potential benefits of these technologies, the operational and methodological aspects of video interviewing have started to receive research attention from survey methodologists. Although it is remote, video interviewing still involves respondent–interviewer interaction that introduces the possibility of interviewer effects. No research to date has evaluated this potential threat to the quality of the data collected in video interviews. This research note presents an evaluation of interviewer effects in a recent experimental study of alternative approaches to video interviewing including both LV interviewing and the use of prerecorded videos of the same interviewers asking questions embedded in a web survey (“prerecorded video” interviewing). We find little evidence of significant interviewer effects when using these two approaches, which is a promising result. We also find that when interviewer effects were present, they tended to be slightly larger in the LV approach as would be expected in light of its being an interactive approach. We conclude with a discussion of the implications of these findings for future research using video interviewing.
| S-EPMC8690284 | biostudies-literature
Project description:There is a growing body of research focused on developing and evaluating behavioral training paradigms meant to induce enhancements in cognitive function. It has recently been proposed that one mechanism through which such performance gains could be induced involves participants' expectations of improvement. However, no work to date has evaluated whether it is possible to cause changes in cognitive function in a long-term behavioral training study by manipulating expectations. In this study, positive or negative expectations about cognitive training were both explicitly and associatively induced before either a working memory training intervention or a control intervention. Consistent with previous work, a main effect of the training condition was found, with individuals trained on the working memory task showing larger gains in cognitive function than those trained on the control task. Interestingly, a main effect of expectation was also found, with individuals given positive expectations showing larger cognitive gains than those who were given negative expectations (regardless of training condition). No interaction effect between training and expectations was found. Exploratory analyses suggest that certain individual characteristics (e.g., personality, motivation) moderate the size of the expectation effect. These results highlight aspects of methodology that can inform future behavioral interventions and suggest that participant expectations could be capitalized on to maximize training outcomes.
| S-EPMC9477404 | biostudies-literature
Project description: Not available
| S-EPMC11346660 | biostudies-literature
Project description:Fidelity to research protocol is critical. In a contingent valuation study in an informal urban settlement in Nairobi, Kenya, participants responded differently to the three trained interviewers. Interviewer effects were present during the survey pilot, then magnified at the start of the main survey after a seemingly slight adaptation of the survey sampling protocol allowed interviewers to speak with the "closest neighbor" in the event that no one was home at a selected household. This slight degree of interviewer choice led to inferred sampling bias. Multinomial logistic regression and post-estimation tests revealed that the three interviewers' samples differed significantly from one another according to six demographic characteristics. The two female interviewers were 2.8 and 7.7 times less likely to talk with respondents of low socio-economic status than the male interviewer. Systematic error renders it impossible to determine which of the survey responses might be "correct." This experience demonstrates why researchers must take care to strictly follow sampling protocols, consistently train interviewers, and monitor responses by interview to ensure similarity between interviewers' groups and produce unbiased estimates of the parameters of interest.
| S-EPMC4334207 | biostudies-other
Project description:Precision medicine requires the ability to predict the efficacies of different treatments for a given individual using high-dimensional genomic measurements. However, identifying predictive features remains a challenge when the sample size is small. Incorporating expert knowledge offers a promising approach to improve predictions, but collecting such knowledge is laborious if the number of candidate features is very large.We introduce a probabilistic framework to incorporate expert feedback about the impact of genomic measurements on the outcome of interest and present a novel approach to collect the feedback efficiently, based on Bayesian experimental design. The new approach outperformed other recent alternatives in two medical applications: prediction of metabolic traits and prediction of sensitivity of cancer cells to different drugs, both using genomic features as predictors. Furthermore, the intelligent approach to collect feedback reduced the workload of the expert to approximately 11%, compared to a baseline approach.Source code implementing the introduced computational methods is freely available at https://github.com/AaltoPML/knowledge-elicitation-for-precision-medicine.Supplementary data are available at Bioinformatics online.
| S-EPMC6022689 | biostudies-other
Project description:Background: The occupation expectation of medical students can predict the possibility of their future employment in the medical industry, and empathy is the special ability of medical students in their study and career, which affects the development of their occupation expectation. Objective: To explore the relationship between resilience and subjective well-being between medical students' empathy and occupation expectation and their internal mechanisms. Design: Data were collected from October 2020 to March 2021 using a paper questionnaire survey. Subjective: 586 medical students at a key medical university in Yunnan Province were invited to complete the survey. Main Measures: The Basic Empathy Scale, Connor-Davidson Resilience Scale, Subjective Well-Being Questionnaire, and Occupation Expectation Scale. Key Results: The empathy is intended to affect the occupation expectation of medical students through four paths. The direct path effect value is 0.073 (95% CI: 0.007∼0.217), the indirect path 1 effect value is 0.078 (95% CI: 0.022∼0.134), indirect path 2 effect value is 0.010 (95% CI: 0.005∼0.022), indirect path 3 effect value is 0.022 (95% CI: 0.0604∼0.039), all the confidence intervals do not contain 0, and the mediated effect ratio is 60.109%. Conclusion: Empathy has an impact on occupation expectation of medical students through the sequential mediating effects of resilience and subjective well-being. Medical colleges should fully consider the role of protective factors when cultivating and enhancing the occupation expectation of clinical medical students. Strengthening the intervention of emotional factors (empathy), self-regulating ability (psychological toughness) and cognitive factors (subjective well-being) is an important way to effectively establish professional values, improve occupation expectation of medical students and reduce the turnover rate of medical students.
| S-EPMC8503271 | biostudies-literature
Project description:Toxoplasmosis is a worldwide zoonotic infectious disease caused by Toxoplasma gondii. This infection is estimated to affect about a third of the world's population. The aim of this study was to evaluate the knowledge of Italian women about toxoplasmosis and its forms of transmission, clinical manifestations, diagnosis and prevention through two different modalities (e-research and traditional research). In a cross-sectional study, 808 Italian women were interviewed, using a self-administered questionnaire, through two different modalities: an e-research or web survey and a traditional paper research and 84% reported to have heard about toxoplasmosis, but from most of the sample, it resulted that the knowledge of the protozoan disease was superficial and incomplete.The assessment of the dimensionality related to the toxoplasmosis knowledge's instrument showed that the scale is composed by two stable and reliable factors which explain 58.6% of the variance: (a) the basic knowledge (α = 0.83), which explains the 45.2% of the variance and (b) the specialist knowledge (α = 0.71), which explains the 13.4% of the variance. The variance and the multiple linear regression data analysis showed significant predictors of correct basic knowledge of toxoplasmosis: the highest age, the highest degree of study, to have previously contracted illness or to know someone who had contracted it, to be working or to be housewives. In conclusion, this study showed limited awareness of toxoplasmosis and suggested the implementation of effective education and learning programs. The results also showed that online data collection, in academic research, might be a valid alternative to more traditional (paper-and-pencil) surveys.
| S-EPMC7689595 | biostudies-literature