Dataset Information

Mode Equivalence of Health Indicators Between Data Collection Modes and Mixed-Mode Survey Designs in Population-Based Health Interview Surveys for Children and Adolescents: Methodological Study.

ABSTRACT: BACKGROUND:The implementation of an Internet option in an existing public health interview survey using a mixed-mode design is attractive because of lower costs and faster data availability. Additionally, mixed-mode surveys can increase response rates and improve sample composition. However, mixed-mode designs can increase the risk of measurement error (mode effects). OBJECTIVE:This study aimed to determine whether the prevalence rates or mean values of self- and parent-reported health indicators for children and adolescents aged 0-17 years differ between self-administered paper-based questionnaires (SAQ-paper) and self-administered Web-based questionnaires (SAQ-Web), as well as between a single-mode control group and different mixed-mode groups. METHODS:Data were collected for a methodological pilot of the third wave of the "German Health Interview and Examination Survey for Children and Adolescents". Questionnaires were completed by parents or adolescents. A population-based sample of 11,140 children and adolescents aged 0-17 years was randomly allocated to 4 survey designs-a single-mode control group with paper-and-pencil questionnaires only (n=970 parents, n=343 adolescents)-and 3 mixed-mode designs, all of which offered Web-based questionnaire options. In the concurrent mixed-mode design, both questionnaires were offered at the same time (n=946 parents, n=290 adolescents); in the sequential mixed-mode design, the SAQ-Web was sent first, followed by the paper questionnaire along with a reminder (n=854 parents, n=269 adolescents); and in the preselect mixed-mode design, both options were offered and the respondents were asked to request the desired type of questionnaire (n=698 parents, n=292 adolescents). In total, 3468 questionnaires of parents of children aged 0-17 years (SAQ-Web: n=708; SAQ-paper: n=2760) and 1194 questionnaires of adolescents aged 11-17 years (SAQ-Web: n=299; SAQ-paper: n=895) were analyzed. Sociodemographic characteristics and a broad range of health indicators for children and adolescents were compared by survey design and data collection mode by calculating predictive margins from regression models. RESULTS:There were no statistically significant differences in sociodemographic characteristics or health indicators between the single-mode control group and any of the mixed-mode survey designs. Differences in sociodemographic characteristics between SAQ-Web and SAQ-paper were found. Web respondents were more likely to be male, have higher levels of education, and higher household income compared with paper respondents. After adjusting for sociodemographic characteristics, only one of the 38 analyzed health indicators showed different prevalence rates between the data collection modes, with a higher prevalence rate for lifetime alcohol consumption among the online-responding adolescents (P<.001). CONCLUSIONS:These results suggest that mode bias is limited in health interview surveys for children and adolescents using a mixed-mode design with Web-based and paper questionnaires.

SUBMITTER: Mauz E

PROVIDER: S-EPMC5859740 | biostudies-literature | 2018 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Mode Equivalence of Health Indicators Between Data Collection Modes and Mixed-Mode Survey Designs in Population-Based Health Interview Surveys for Children and Adolescents: Methodological Study.

Mauz Elvira E Hoffmann Robert R Houben Robin R Krause Laura L Kamtsiuris Panagiotis P Gößwald Antje A

Journal of medical Internet research 20180305 3

<h4>Background</h4>The implementation of an Internet option in an existing public health interview survey using a mixed-mode design is attractive because of lower costs and faster data availability. Additionally, mixed-mode surveys can increase response rates and improve sample composition. However, mixed-mode designs can increase the risk of measurement error (mode effects).<h4>Objective</h4>This study aimed to determine whether the prevalence rates or mean values of self- and parent-reported h ...[more]

PMID: 29506967

Similar Datasets

Project description:BACKGROUND:Germany is a popular destination for immigrants, and migration has increased in recent years. It is therefore important to collect reliable data on migrants' health. The Robert Koch Institute, Berlin, Germany, has launched the Improving Health Monitoring in Migrant Populations (IMIRA) project to sustainably integrate migrant populations into health monitoring in Germany. OBJECTIVE:One of IMIRA's objectives is to implement a feasibility study (the IMIRA survey) that focuses on testing various interventions to increase the reachability of migrants with health interview surveys. Possible causes of nonresponse should be identified so as to increase participation in future surveys. METHODS:The survey target populations were Turkish, Polish, Romanian, Syrian, and Croatian migrants, who represent the biggest migrant groups living in Germany. We used probability sampling, using data from the registration offices in 2 states (Berlin and Brandenburg); we randomly selected 9068 persons by nationality in 7 sample points. We applied age (3 categories: 18-44, 45-64, and ?65 years) and sex strata. Modes and methods used to test their usability were culturally sensitive materials, online questionnaires, telephone interviews, personal contact, and personal interviews, using multilingual materials and interviewers. To evaluate the effectiveness of the interventions, we used an intervention group (group A) and a control group (group B). There were also focus groups with the interviewers to get more information about the participants' motivation. We used the European Health Interview Survey, with additional instruments on religious affiliation, experience of discrimination, and subjective social status. We evaluated results according to their final contact result (disposition code). RESULTS:We collected data from January to May 2018 in Berlin and Brandenburg, Germany. The survey had an overall response rate of 15.88% (1190/7494). However, final disposition codes varied greatly with regard to citizenship. In addition to the quantitative results, interviewers reported in the focus groups a "feeling of connectedness" to the participants due to the multilingual interventions. The interviewers were particularly positive about the home visits, because "if you are standing at the front door, you will be let in for sure." CONCLUSIONS:The IMIRA survey appraised the usability of mixed-mode or mixed-method approaches among migrant groups with a probability sample in 2 German states. When conducting the survey, we were confronted with issues regarding the translation of the questionnaire, as well as the validity of some instruments in the survey languages. A major result was that personal face-to-face contact was the most effective intervention to recruit our participants. We will implement the findings in the upcoming health monitoring study at the Robert Koch Institute.

Project description:BackgroundHealth interview surveys are important data sources for empirical research in public health. However, the diversity of methods applied, such as in the mode of data collection, make it difficult to compare results across surveys, time, or countries. The aim of this study was to explore whether the prevalence rates of health-related indicators amongst adults differ when self-administered paper mail questionnaires (SAQ-Paper), self-administered web surveys (SAQ-Web), and computer-assisted telephone interviews (CATI) are used for data collection in a health survey.MethodsData were obtained from a population-based mixed-mode health interview survey of adults in Germany carried out within the 'German Health Update' (GEDA) study. Data were collected either by SAQ-Paper (n = 746), SAQ-Web (n = 414), or CATI (n = 411). Predictive margins from logistic regression models were used to estimate the prevalence rates of chronic conditions, subjective health, mental health, psychosocial factors, and health behaviours, adjusted for the socio-demographic characteristics of each mode group.ResultsSocio-demographic characteristics were found to differ significantly between study participants who responded by SAQ-Paper, SAQ-Web, and CATI. Crude prevalence rates for health-related indicators also showed significant variation across all three survey modes. After adjusting for socio-demographic factors though, significant differences in prevalence rates between the two self-administered modes (SAQ-Paper and SAQ-Web) were found in only 2 out of the 19 health-related indicators studied. The differences between CATI and the two self-administered modes remained significant however, especially for indicators of mental and psychosocial health and self-reported sporting activity.ConclusionsThe findings of this study indicate that prevalence rates obtained from health interview surveys can vary with the mode of data collection, primarily between interviewer and self-administered modes. Hence, the type of survey mode used should be considered when comparing results from different health surveys. Mixing self-administered modes, such as paper-based questionnaires and web surveys, may be a combination to minimize mode differences in mixed-mode health interview surveys.

Project description:Background:Population-based surveys currently face the problem of decreasing response rates. Mixed-mode designs are now being implemented more often to account for this, to improve sample composition and to reduce overall costs. This study examines whether a concurrent or sequential mixed-mode design achieves better results on a number of indicators of survey quality. Methods:Data were obtained from a population-based health interview survey of adults in Germany that was conducted as a methodological pilot study as part of the German Health Update (GEDA). Participants were randomly allocated to one of two surveys; each of the surveys had a different design. In the concurrent mixed-mode design (n?=?617) two types of self-administered questionnaires (SAQ-Web and SAQ-Paper) and computer-assisted telephone interviewing were offered simultaneously to the respondents along with the invitation to participate. In the sequential mixed-mode design (n?=?561), SAQ-Web was initially provided, followed by SAQ-Paper, with an option for a telephone interview being sent out together with the reminders at a later date. Finally, this study compared the response rates, sample composition, health indicators, item non-response, the scope of fieldwork and the costs of both designs. Results:No systematic differences were identified between the two mixed-mode designs in terms of response rates, the socio-demographic characteristics of the achieved samples, or the prevalence rates of the health indicators under study. The sequential design gained a higher rate of online respondents. Very few telephone interviews were conducted for either design. With regard to data quality, the sequential design (which had more online respondents) showed less item non-response. There were minor differences between the designs in terms of their costs. Postage and printing costs were lower in the concurrent design, but labour costs were lower in the sequential design. No differences in health indicators were found between the two designs. Modelling these results for higher response rates and larger net sample sizes indicated that the sequential design was more cost and time-effective. Conclusions:This study contributes to the research available on implementing mixed-mode designs as part of public health surveys. Our findings show that SAQ-Paper and SAQ-Web questionnaires can be combined effectively. Sequential mixed-mode designs with higher rates of online respondents may be of greater benefit to studies with larger net sample sizes than concurrent mixed-mode designs.

Project description:BACKGROUND:The majority of U.S. older adults consume alcoholic beverages. The older population is projected to almost double by 2050. Substantially more drinkers are likely. PURPOSE:To describe gender-specific trends (1997 to 2014) in prevalence of drinking status (lifetime abstention, former drinking, current drinking [including average volume], and binge drinking) among U.S. adults ages 60+ by age group and birth cohort. METHODS:In the 1997 to 2014 National Health Interview Surveys, 65,303 respondents ages 60+ (31,803 men, 33,500 women) were current drinkers; 6,570 men and 1,737 women were binge drinkers. Prevalence estimates and standard errors were computed by age group (60+, 60 to 64, 65 to 69, 70 to 74, 75 to 79, 80+) and birth cohort (<1925, 1925 to 1935, 1936 to 1945, 1946 to 1954). Trends were examined using joinpoint regression and described as average annual percent change (AAPC; overall change 1997 to 2014) and annual percent change (APC; in-between infection points). Primary analyses were unadjusted. All analyses (unadjusted and adjusted for demographics/lifestyle) were weighted to produce nationally representative estimates. Statistical procedures accounted for the complex survey design. RESULTS:Among men ages 60+, unadjusted prevalence of current drinking trended upward, on average, 0.7% per year (AAPC, p = 0.02); average volume and prevalence of binge drinking remained stable. Adjusted results were similar. Among women age 60+, unadjusted prevalence of current drinking trended upward, on average, 1.6% per year (AAPC, p < 0.0001), but average volume remained stable; prevalence of binge drinking increased, on average, 3.7% per year (AAPC, p < 0.0001). Adjusted results were similar. Trends varied by age group and birth cohort. Among men born 1946 to 1954, unadjusted prevalence of current drinking trended upward, on average, 2.4% per year (AAPC, p = 0.02); adjusted results were nonsignificant. CONCLUSIONS:Our finding of upward trends in drinking among adults ages 60+, particularly women, suggests the importance of public health planning to meet future needs for alcohol-related programs.

Project description:BackgroundThe capacity to use data linkage and artificial intelligence to estimate and predict health indicators varies across European countries. However, the estimation of health indicators from linked administrative data is challenging due to several reasons such as variability in data sources and data collection methods resulting in reduced interoperability at various levels and timeliness, availability of a large number of variables, lack of skills and capacity to link and analyze big data. The main objective of this study is to develop the methodological guidelines calculating population-based health indicators to guide European countries using linked data and/or machine learning (ML) techniques with new methods.MethodWe have performed the following step-wise approach systematically to develop the methodological guidelines: i. Scientific literature review, ii. Identification of inspiring examples from European countries, and iii. Developing the checklist of guidelines contents.ResultsWe have developed the methodological guidelines, which provide a systematic approach for studies using linked data and/or ML-techniques to produce population-based health indicators. These guidelines include a detailed checklist of the following items: rationale and objective of the study (i.e., research question), study design, linked data sources, study population/sample size, study outcomes, data preparation, data analysis (i.e., statistical techniques, sensitivity analysis and potential issues during data analysis) and study limitations.ConclusionsThis is the first study to develop the methodological guidelines for studies focused on population health using linked data and/or machine learning techniques. These guidelines would support researchers to adopt and develop a systematic approach for high-quality research methods. There is a need for high-quality research methodologies using more linked data and ML-techniques to develop a structured cross-disciplinary approach for improving the population health information and thereby the population health.

Dataset Information

Mode Equivalence of Health Indicators Between Data Collection Modes and Mixed-Mode Survey Designs in Population-Based Health Interview Surveys for Children and Adolescents: Methodological Study.

Publications

Mode Equivalence of Health Indicators Between Data Collection Modes and Mixed-Mode Survey Designs in Population-Based Health Interview Surveys for Children and Adolescents: Methodological Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets