Dataset Information

Mode differences in a mixed-mode health interview survey among adults.

ABSTRACT:

Background

Health interview surveys are important data sources for empirical research in public health. However, the diversity of methods applied, such as in the mode of data collection, make it difficult to compare results across surveys, time, or countries. The aim of this study was to explore whether the prevalence rates of health-related indicators amongst adults differ when self-administered paper mail questionnaires (SAQ-Paper), self-administered web surveys (SAQ-Web), and computer-assisted telephone interviews (CATI) are used for data collection in a health survey.

Methods

Data were obtained from a population-based mixed-mode health interview survey of adults in Germany carried out within the 'German Health Update' (GEDA) study. Data were collected either by SAQ-Paper (n?=?746), SAQ-Web (n?=?414), or CATI (n?=?411). Predictive margins from logistic regression models were used to estimate the prevalence rates of chronic conditions, subjective health, mental health, psychosocial factors, and health behaviours, adjusted for the socio-demographic characteristics of each mode group.

Results

Socio-demographic characteristics were found to differ significantly between study participants who responded by SAQ-Paper, SAQ-Web, and CATI. Crude prevalence rates for health-related indicators also showed significant variation across all three survey modes. After adjusting for socio-demographic factors though, significant differences in prevalence rates between the two self-administered modes (SAQ-Paper and SAQ-Web) were found in only 2 out of the 19 health-related indicators studied. The differences between CATI and the two self-administered modes remained significant however, especially for indicators of mental and psychosocial health and self-reported sporting activity.

Conclusions

The findings of this study indicate that prevalence rates obtained from health interview surveys can vary with the mode of data collection, primarily between interviewer and self-administered modes. Hence, the type of survey mode used should be considered when comparing results from different health surveys. Mixing self-administered modes, such as paper-based questionnaires and web surveys, may be a combination to minimize mode differences in mixed-mode health interview surveys.

SUBMITTER: Hoebel J

PROVIDER: S-EPMC4373057 | biostudies-literature | 2014

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Mode differences in a mixed-mode health interview survey among adults.

Hoebel Jens J von der Lippe Elena E Lange Cornelia C Ziese Thomas T

Archives of public health = Archives belges de sante publique 20141222 1

<h4>Background</h4>Health interview surveys are important data sources for empirical research in public health. However, the diversity of methods applied, such as in the mode of data collection, make it difficult to compare results across surveys, time, or countries. The aim of this study was to explore whether the prevalence rates of health-related indicators amongst adults differ when self-administered paper mail questionnaires (SAQ-Paper), self-administered web surveys (SAQ-Web), and computer ...[more]

PMID: 25810913

Similar Datasets

Project description:BACKGROUND:The implementation of an Internet option in an existing public health interview survey using a mixed-mode design is attractive because of lower costs and faster data availability. Additionally, mixed-mode surveys can increase response rates and improve sample composition. However, mixed-mode designs can increase the risk of measurement error (mode effects). OBJECTIVE:This study aimed to determine whether the prevalence rates or mean values of self- and parent-reported health indicators for children and adolescents aged 0-17 years differ between self-administered paper-based questionnaires (SAQ-paper) and self-administered Web-based questionnaires (SAQ-Web), as well as between a single-mode control group and different mixed-mode groups. METHODS:Data were collected for a methodological pilot of the third wave of the "German Health Interview and Examination Survey for Children and Adolescents". Questionnaires were completed by parents or adolescents. A population-based sample of 11,140 children and adolescents aged 0-17 years was randomly allocated to 4 survey designs-a single-mode control group with paper-and-pencil questionnaires only (n=970 parents, n=343 adolescents)-and 3 mixed-mode designs, all of which offered Web-based questionnaire options. In the concurrent mixed-mode design, both questionnaires were offered at the same time (n=946 parents, n=290 adolescents); in the sequential mixed-mode design, the SAQ-Web was sent first, followed by the paper questionnaire along with a reminder (n=854 parents, n=269 adolescents); and in the preselect mixed-mode design, both options were offered and the respondents were asked to request the desired type of questionnaire (n=698 parents, n=292 adolescents). In total, 3468 questionnaires of parents of children aged 0-17 years (SAQ-Web: n=708; SAQ-paper: n=2760) and 1194 questionnaires of adolescents aged 11-17 years (SAQ-Web: n=299; SAQ-paper: n=895) were analyzed. Sociodemographic characteristics and a broad range of health indicators for children and adolescents were compared by survey design and data collection mode by calculating predictive margins from regression models. RESULTS:There were no statistically significant differences in sociodemographic characteristics or health indicators between the single-mode control group and any of the mixed-mode survey designs. Differences in sociodemographic characteristics between SAQ-Web and SAQ-paper were found. Web respondents were more likely to be male, have higher levels of education, and higher household income compared with paper respondents. After adjusting for sociodemographic characteristics, only one of the 38 analyzed health indicators showed different prevalence rates between the data collection modes, with a higher prevalence rate for lifetime alcohol consumption among the online-responding adolescents (P<.001). CONCLUSIONS:These results suggest that mode bias is limited in health interview surveys for children and adolescents using a mixed-mode design with Web-based and paper questionnaires.

Project description:Background:Population-based surveys currently face the problem of decreasing response rates. Mixed-mode designs are now being implemented more often to account for this, to improve sample composition and to reduce overall costs. This study examines whether a concurrent or sequential mixed-mode design achieves better results on a number of indicators of survey quality. Methods:Data were obtained from a population-based health interview survey of adults in Germany that was conducted as a methodological pilot study as part of the German Health Update (GEDA). Participants were randomly allocated to one of two surveys; each of the surveys had a different design. In the concurrent mixed-mode design (n?=?617) two types of self-administered questionnaires (SAQ-Web and SAQ-Paper) and computer-assisted telephone interviewing were offered simultaneously to the respondents along with the invitation to participate. In the sequential mixed-mode design (n?=?561), SAQ-Web was initially provided, followed by SAQ-Paper, with an option for a telephone interview being sent out together with the reminders at a later date. Finally, this study compared the response rates, sample composition, health indicators, item non-response, the scope of fieldwork and the costs of both designs. Results:No systematic differences were identified between the two mixed-mode designs in terms of response rates, the socio-demographic characteristics of the achieved samples, or the prevalence rates of the health indicators under study. The sequential design gained a higher rate of online respondents. Very few telephone interviews were conducted for either design. With regard to data quality, the sequential design (which had more online respondents) showed less item non-response. There were minor differences between the designs in terms of their costs. Postage and printing costs were lower in the concurrent design, but labour costs were lower in the sequential design. No differences in health indicators were found between the two designs. Modelling these results for higher response rates and larger net sample sizes indicated that the sequential design was more cost and time-effective. Conclusions:This study contributes to the research available on implementing mixed-mode designs as part of public health surveys. Our findings show that SAQ-Paper and SAQ-Web questionnaires can be combined effectively. Sequential mixed-mode designs with higher rates of online respondents may be of greater benefit to studies with larger net sample sizes than concurrent mixed-mode designs.

Project description:BACKGROUND:Germany is a popular destination for immigrants, and migration has increased in recent years. It is therefore important to collect reliable data on migrants' health. The Robert Koch Institute, Berlin, Germany, has launched the Improving Health Monitoring in Migrant Populations (IMIRA) project to sustainably integrate migrant populations into health monitoring in Germany. OBJECTIVE:One of IMIRA's objectives is to implement a feasibility study (the IMIRA survey) that focuses on testing various interventions to increase the reachability of migrants with health interview surveys. Possible causes of nonresponse should be identified so as to increase participation in future surveys. METHODS:The survey target populations were Turkish, Polish, Romanian, Syrian, and Croatian migrants, who represent the biggest migrant groups living in Germany. We used probability sampling, using data from the registration offices in 2 states (Berlin and Brandenburg); we randomly selected 9068 persons by nationality in 7 sample points. We applied age (3 categories: 18-44, 45-64, and ?65 years) and sex strata. Modes and methods used to test their usability were culturally sensitive materials, online questionnaires, telephone interviews, personal contact, and personal interviews, using multilingual materials and interviewers. To evaluate the effectiveness of the interventions, we used an intervention group (group A) and a control group (group B). There were also focus groups with the interviewers to get more information about the participants' motivation. We used the European Health Interview Survey, with additional instruments on religious affiliation, experience of discrimination, and subjective social status. We evaluated results according to their final contact result (disposition code). RESULTS:We collected data from January to May 2018 in Berlin and Brandenburg, Germany. The survey had an overall response rate of 15.88% (1190/7494). However, final disposition codes varied greatly with regard to citizenship. In addition to the quantitative results, interviewers reported in the focus groups a "feeling of connectedness" to the participants due to the multilingual interventions. The interviewers were particularly positive about the home visits, because "if you are standing at the front door, you will be let in for sure." CONCLUSIONS:The IMIRA survey appraised the usability of mixed-mode or mixed-method approaches among migrant groups with a probability sample in 2 German states. When conducting the survey, we were confronted with issues regarding the translation of the questionnaire, as well as the validity of some instruments in the survey languages. A major result was that personal face-to-face contact was the most effective intervention to recruit our participants. We will implement the findings in the upcoming health monitoring study at the Robert Koch Institute.

Project description:BackgroundGermany has a long history of migration. In 2020, more than 1 person in every 4 people had a statistically defined, so-called migration background in Germany, meaning that the person or at least one of their parents was born with a citizenship other than German citizenship. People with a history of migration are not represented proportionately to the population within public health monitoring at the Robert Koch Institute, thus impeding differentiated analyses of migration and health. To develop strategies for improving the inclusion of people with a history of migration in health surveys, we conducted a feasibility study in 2018. The lessons learned were implemented in the health interview survey German Health Update (Gesundheit in Deutschland aktuell [GEDA]) Fokus, which was conducted among people with selected citizenships representing the major migrant groups in Germany.ObjectiveGEDA Fokus aimed to collect comprehensive data on the health status and social, migration-related, and structural factors among people with selected citizenships to enable differentiated explanations of the associations between migration-related aspects and their impact on migrant health.MethodsGEDA Fokus is an interview survey among people with Croatian, Italian, Polish, Syrian, or Turkish citizenship living in Germany aged 18-79 years, with a targeted sample size of 1200 participants per group. The gross sample of 33,436 people was drawn from the residents' registration offices of 99 German municipalities based on citizenship. Sequentially, multiple modes of administration were offered. The questionnaire was available for self-administration (web-based and paper-based); in larger municipalities, personal or phone interviews were possible later on. Study documents and the questionnaire were bilingual-in German and the respective translation language depending on the citizenship. Data were collected from November 2021 to May 2022.ResultsOverall, 6038 respondents participated in the survey, of whom 2983 (49.4%) were female. The median age was 39 years; the median duration of residence in Germany was 10 years, with 19.69% (1189/6038) of the sample being born in Germany. The overall response rate was 18.4% (American Association for Public Opinion Research [AAPOR] response rate 1) and was 6.8% higher in the municipalities where personal interviews were offered (19.3% vs 12.5%). Overall, 78.12% (4717/6038) of the participants self-administered the questionnaire, whereas 21.88% (1321/6038) took part in personal interviews. In total, 41.85% (2527/6038) of the participants answered the questionnaire in the German language only, 16.69% (1008/6038) exclusively used the translation.ConclusionsOffering different modes of administration, as well as multiple study languages, enabled us to recruit a heterogeneous sample of people with a history of migration. The data collected will allow differentiated analyses of the role and interplay of migration-related and social determinants of health and their impact on the health status of people with selected citizenships.International registered report identifier (irrid)DERR1-10.2196/43503.

Project description:IntroductionPoly-tobacco use (PTU), or the concomitant use of two or more nicotine and tobacco products, are a growing public health concern. Adults reporting increased psychological distress (PD) experience profound nicotine and tobacco health-related disparities. Sexual minority (SM) adults report more PTU and higher levels of PD than heterosexuals, yet little is known about patterns of nicotine and tobacco use and its relationship to PD in SM populations.Aims and methodsThe purpose of this study was to investigate sexual identity differences in PD and PTU. Data were drawn from the 2016-2018 National Health Interview Survey (N = 83 017), an annual cross-sectional survey of a nationally representative sample of U.S. adults. PD was assessed using the Kessler Psychological Distress Scale (K6). We fit sex-stratified, weighted, adjusted logistic models to compare PTU and PD by sexual identity.ResultsPTU was more prevalent in adults with higher K6 scores. Female adults and SM adults had significantly higher K6 scores and were significantly more likely to experience serious PD when compared to their male and heterosexual counterparts.ConclusionsThe current study provides a snapshot of trends in PTU in relation to PD, gender, and sexual identity. Findings suggest higher rates of both PD and PTU in SM adults. Further research examining the mechanisms underlying this disparity is critical to the development of effective intervention and prevention strategies.ImplicationsLittle is known about sex and sexual identity differences in the relations between patterns of tobacco product use and PD. This study is the first to examine the effect of gender and sexual identity on both PD and PTU. SMs reported higher rates of PD and were more likely to be poly-tobacco users. As new ways of engaging nicotine/tobacco continue to proliferate, health risks will endure especially for marginalized populations. An increased understanding of the psychological and social correlates of PTU in SMs is warranted.

Dataset Information

Mode differences in a mixed-mode health interview survey among adults.

Background

Methods

Results

Conclusions

Publications

Mode differences in a mixed-mode health interview survey among adults.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets