Dataset Information

Mode differences in a mixed-mode health interview survey among adults.

ABSTRACT:

Background

Health interview surveys are important data sources for empirical research in public health. However, the diversity of methods applied, such as in the mode of data collection, make it difficult to compare results across surveys, time, or countries. The aim of this study was to explore whether the prevalence rates of health-related indicators amongst adults differ when self-administered paper mail questionnaires (SAQ-Paper), self-administered web surveys (SAQ-Web), and computer-assisted telephone interviews (CATI) are used for data collection in a health survey.

Methods

Data were obtained from a population-based mixed-mode health interview survey of adults in Germany carried out within the 'German Health Update' (GEDA) study. Data were collected either by SAQ-Paper (n?=?746), SAQ-Web (n?=?414), or CATI (n?=?411). Predictive margins from logistic regression models were used to estimate the prevalence rates of chronic conditions, subjective health, mental health, psychosocial factors, and health behaviours, adjusted for the socio-demographic characteristics of each mode group.

Results

Socio-demographic characteristics were found to differ significantly between study participants who responded by SAQ-Paper, SAQ-Web, and CATI. Crude prevalence rates for health-related indicators also showed significant variation across all three survey modes. After adjusting for socio-demographic factors though, significant differences in prevalence rates between the two self-administered modes (SAQ-Paper and SAQ-Web) were found in only 2 out of the 19 health-related indicators studied. The differences between CATI and the two self-administered modes remained significant however, especially for indicators of mental and psychosocial health and self-reported sporting activity.

Conclusions

The findings of this study indicate that prevalence rates obtained from health interview surveys can vary with the mode of data collection, primarily between interviewer and self-administered modes. Hence, the type of survey mode used should be considered when comparing results from different health surveys. Mixing self-administered modes, such as paper-based questionnaires and web surveys, may be a combination to minimize mode differences in mixed-mode health interview surveys.

SUBMITTER: Hoebel J

PROVIDER: S-EPMC4373057 | biostudies-literature | 2014

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Mode differences in a mixed-mode health interview survey among adults.

Hoebel Jens J von der Lippe Elena E Lange Cornelia C Ziese Thomas T

Archives of public health = Archives belges de sante publique 20141222 1

<h4>Background</h4>Health interview surveys are important data sources for empirical research in public health. However, the diversity of methods applied, such as in the mode of data collection, make it difficult to compare results across surveys, time, or countries. The aim of this study was to explore whether the prevalence rates of health-related indicators amongst adults differ when self-administered paper mail questionnaires (SAQ-Paper), self-administered web surveys (SAQ-Web), and computer ...[more]

PMID: 25810913

Similar Datasets

Project description:BACKGROUND:The implementation of an Internet option in an existing public health interview survey using a mixed-mode design is attractive because of lower costs and faster data availability. Additionally, mixed-mode surveys can increase response rates and improve sample composition. However, mixed-mode designs can increase the risk of measurement error (mode effects). OBJECTIVE:This study aimed to determine whether the prevalence rates or mean values of self- and parent-reported health indicators for children and adolescents aged 0-17 years differ between self-administered paper-based questionnaires (SAQ-paper) and self-administered Web-based questionnaires (SAQ-Web), as well as between a single-mode control group and different mixed-mode groups. METHODS:Data were collected for a methodological pilot of the third wave of the "German Health Interview and Examination Survey for Children and Adolescents". Questionnaires were completed by parents or adolescents. A population-based sample of 11,140 children and adolescents aged 0-17 years was randomly allocated to 4 survey designs-a single-mode control group with paper-and-pencil questionnaires only (n=970 parents, n=343 adolescents)-and 3 mixed-mode designs, all of which offered Web-based questionnaire options. In the concurrent mixed-mode design, both questionnaires were offered at the same time (n=946 parents, n=290 adolescents); in the sequential mixed-mode design, the SAQ-Web was sent first, followed by the paper questionnaire along with a reminder (n=854 parents, n=269 adolescents); and in the preselect mixed-mode design, both options were offered and the respondents were asked to request the desired type of questionnaire (n=698 parents, n=292 adolescents). In total, 3468 questionnaires of parents of children aged 0-17 years (SAQ-Web: n=708; SAQ-paper: n=2760) and 1194 questionnaires of adolescents aged 11-17 years (SAQ-Web: n=299; SAQ-paper: n=895) were analyzed. Sociodemographic characteristics and a broad range of health indicators for children and adolescents were compared by survey design and data collection mode by calculating predictive margins from regression models. RESULTS:There were no statistically significant differences in sociodemographic characteristics or health indicators between the single-mode control group and any of the mixed-mode survey designs. Differences in sociodemographic characteristics between SAQ-Web and SAQ-paper were found. Web respondents were more likely to be male, have higher levels of education, and higher household income compared with paper respondents. After adjusting for sociodemographic characteristics, only one of the 38 analyzed health indicators showed different prevalence rates between the data collection modes, with a higher prevalence rate for lifetime alcohol consumption among the online-responding adolescents (P<.001). CONCLUSIONS:These results suggest that mode bias is limited in health interview surveys for children and adolescents using a mixed-mode design with Web-based and paper questionnaires.

Project description:Background:Population-based surveys currently face the problem of decreasing response rates. Mixed-mode designs are now being implemented more often to account for this, to improve sample composition and to reduce overall costs. This study examines whether a concurrent or sequential mixed-mode design achieves better results on a number of indicators of survey quality. Methods:Data were obtained from a population-based health interview survey of adults in Germany that was conducted as a methodological pilot study as part of the German Health Update (GEDA). Participants were randomly allocated to one of two surveys; each of the surveys had a different design. In the concurrent mixed-mode design (n?=?617) two types of self-administered questionnaires (SAQ-Web and SAQ-Paper) and computer-assisted telephone interviewing were offered simultaneously to the respondents along with the invitation to participate. In the sequential mixed-mode design (n?=?561), SAQ-Web was initially provided, followed by SAQ-Paper, with an option for a telephone interview being sent out together with the reminders at a later date. Finally, this study compared the response rates, sample composition, health indicators, item non-response, the scope of fieldwork and the costs of both designs. Results:No systematic differences were identified between the two mixed-mode designs in terms of response rates, the socio-demographic characteristics of the achieved samples, or the prevalence rates of the health indicators under study. The sequential design gained a higher rate of online respondents. Very few telephone interviews were conducted for either design. With regard to data quality, the sequential design (which had more online respondents) showed less item non-response. There were minor differences between the designs in terms of their costs. Postage and printing costs were lower in the concurrent design, but labour costs were lower in the sequential design. No differences in health indicators were found between the two designs. Modelling these results for higher response rates and larger net sample sizes indicated that the sequential design was more cost and time-effective. Conclusions:This study contributes to the research available on implementing mixed-mode designs as part of public health surveys. Our findings show that SAQ-Paper and SAQ-Web questionnaires can be combined effectively. Sequential mixed-mode designs with higher rates of online respondents may be of greater benefit to studies with larger net sample sizes than concurrent mixed-mode designs.

Project description:BACKGROUND:Germany is a popular destination for immigrants, and migration has increased in recent years. It is therefore important to collect reliable data on migrants' health. The Robert Koch Institute, Berlin, Germany, has launched the Improving Health Monitoring in Migrant Populations (IMIRA) project to sustainably integrate migrant populations into health monitoring in Germany. OBJECTIVE:One of IMIRA's objectives is to implement a feasibility study (the IMIRA survey) that focuses on testing various interventions to increase the reachability of migrants with health interview surveys. Possible causes of nonresponse should be identified so as to increase participation in future surveys. METHODS:The survey target populations were Turkish, Polish, Romanian, Syrian, and Croatian migrants, who represent the biggest migrant groups living in Germany. We used probability sampling, using data from the registration offices in 2 states (Berlin and Brandenburg); we randomly selected 9068 persons by nationality in 7 sample points. We applied age (3 categories: 18-44, 45-64, and ?65 years) and sex strata. Modes and methods used to test their usability were culturally sensitive materials, online questionnaires, telephone interviews, personal contact, and personal interviews, using multilingual materials and interviewers. To evaluate the effectiveness of the interventions, we used an intervention group (group A) and a control group (group B). There were also focus groups with the interviewers to get more information about the participants' motivation. We used the European Health Interview Survey, with additional instruments on religious affiliation, experience of discrimination, and subjective social status. We evaluated results according to their final contact result (disposition code). RESULTS:We collected data from January to May 2018 in Berlin and Brandenburg, Germany. The survey had an overall response rate of 15.88% (1190/7494). However, final disposition codes varied greatly with regard to citizenship. In addition to the quantitative results, interviewers reported in the focus groups a "feeling of connectedness" to the participants due to the multilingual interventions. The interviewers were particularly positive about the home visits, because "if you are standing at the front door, you will be let in for sure." CONCLUSIONS:The IMIRA survey appraised the usability of mixed-mode or mixed-method approaches among migrant groups with a probability sample in 2 German states. When conducting the survey, we were confronted with issues regarding the translation of the questionnaire, as well as the validity of some instruments in the survey languages. A major result was that personal face-to-face contact was the most effective intervention to recruit our participants. We will implement the findings in the upcoming health monitoring study at the Robert Koch Institute.

Project description:Cardiorespiratory fitness (CRF) is an established predictor of adverse health outcomes. The aim of this study is to investigate potential behavioral, interpersonal and socioeconomic correlates of CRF among men and women living in Germany using data from a population-based nationwide cross-sectional study. 1,439 men and 1,486 women aged 18-64 participated in the German Health Interview and Examination Survey (2008-2011) and completed a standardized sub-maximal cycle ergometer test. Maximal oxygen consumption ([Formula: see text]) in ml·min-1·kg-1 was estimated. Mean values of VO2max for various anthropometric, behavioral, interpersonal, and sociodemographic variables were estimated. Linear regression analyses using multiple imputations technique for missing values was performed to analyze the influence of potential correlates on CRF. Women with high alcohol consumption had higher [Formula: see text], (??=?2.20; 95% CI 0.98 to 3.42) than women with low alcohol consumption and women with high occupational status had higher [Formula: see text] (??=?1.83; 95% CI 0.21 to 3.44) in comparison to women with low occupational status. Among men, high fruit intake (??=?1.52; 95% CI 0.63 to 2.40), compared to low or medium fruit intake and performing at least 2.5?hours of total PA per week (??=?2.19; 95% CI 1.11 to 3.28), compared to less than 2.5?hours was associated with higher [Formula: see text]. Among both men and women, lower body mass index, lower waist circumference and higher levels of physical exercise were considerably associated with higher [Formula: see text]. Among women, those in higher age groups showed a considerably lower level of [Formula: see text] compared with those aged 18-24. Furthermore, mean estimated [Formula: see text] was higher among men (36.5; 95% CI 36.0 to 37.0) than among women (30.3; 95% CI 29.8 to 30.7). Despite the cross-sectional nature of the current study, we conclude that several behavioral, anthropometric, and sociodemographic factors are associated with CRF in the general adult population in Germany. These results can provide evidence to tailor prevention measures according to the needs of specific subgroups.

Project description:Importance:Thirty-five years ago, the Heckler Report described health disparities among minority populations in the US. Since then, policies have been implemented to address these disparities. However, a recent evaluation of progress towards improving the health and health equity among US adults is lacking. Objectives:To evaluate racial/ethnic disparities in the physical and mental health of US adults over the last 2 decades. Design:Cross-sectional. Setting:National Health Interview Survey data, years 1999-2018. Participants:Adults aged 18-85 years. Exposure:Race/ethnicity subgroups (non-Hispanic White, non-Hispanic Black, non-Hispanic Asian, Hispanic). Main outcome and measures:Proportion of adults reporting poor/fair health status, severe psychological distress, functional limitation, and insufficient sleep. We also estimated the gap between non-Hispanic White and the other subgroups for these four outcomes. Results:We included 596,355 adults (mean age 46 years, 51.8% women), of which 69.7%, 13.8%, 11.8% and 4.7% identified as non-Hispanic White, Hispanic, non-Hispanic Black, and non-Hispanic Asian, respectively. Between 1999 and 2018, Black individuals fared worse on most measures of health, with 18.7% (95% CI 17.1-20.4) and 41.1% (95% CI 38.7-43.5) reporting poor/fair health and insufficient sleep in 2018 compared with 11.1% (95% CI 10.5- 11.7) and 31.2% (95% CI 30.3-32.1) among White individuals. Notably, between 1999-2018, there was no significant decrease in the gap in poor/fair health status between White individuals and Black (-0.07% per year, 95% CI -0.16-0.01) and Hispanic (-0.03% per year, 95% CI -0.07- 0.02) individuals, and an increase in the gap in sleep between White individuals and Black (+0.2% per year, 95% CI 0.1-0.4) and Hispanic (+0.3% per year, 95% CI 0.1-0.4) individuals. Additionally, there was no significant decrease in adults reporting poor/fair health status and an increase in adults reporting severe psychological distress, functional limitation, and insufficient sleep. Conclusions and Relevance:The marked racial/ethnic disparities in health of US adults have not improved over the last 20 years. Moreover, the self-perceived health of US adults worsened during this time. These findings highlight the need to re-examine the initiatives seeking to promote health equity and improve health.

Dataset Information

Mode differences in a mixed-mode health interview survey among adults.

Background

Methods

Results

Conclusions

Publications

Mode differences in a mixed-mode health interview survey among adults.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure