Dataset Information

Mixing modes in a population-based interview survey: comparison of a sequential and a concurrent mixed-mode design for public health research.

ABSTRACT: Background:Population-based surveys currently face the problem of decreasing response rates. Mixed-mode designs are now being implemented more often to account for this, to improve sample composition and to reduce overall costs. This study examines whether a concurrent or sequential mixed-mode design achieves better results on a number of indicators of survey quality. Methods:Data were obtained from a population-based health interview survey of adults in Germany that was conducted as a methodological pilot study as part of the German Health Update (GEDA). Participants were randomly allocated to one of two surveys; each of the surveys had a different design. In the concurrent mixed-mode design (n?=?617) two types of self-administered questionnaires (SAQ-Web and SAQ-Paper) and computer-assisted telephone interviewing were offered simultaneously to the respondents along with the invitation to participate. In the sequential mixed-mode design (n?=?561), SAQ-Web was initially provided, followed by SAQ-Paper, with an option for a telephone interview being sent out together with the reminders at a later date. Finally, this study compared the response rates, sample composition, health indicators, item non-response, the scope of fieldwork and the costs of both designs. Results:No systematic differences were identified between the two mixed-mode designs in terms of response rates, the socio-demographic characteristics of the achieved samples, or the prevalence rates of the health indicators under study. The sequential design gained a higher rate of online respondents. Very few telephone interviews were conducted for either design. With regard to data quality, the sequential design (which had more online respondents) showed less item non-response. There were minor differences between the designs in terms of their costs. Postage and printing costs were lower in the concurrent design, but labour costs were lower in the sequential design. No differences in health indicators were found between the two designs. Modelling these results for higher response rates and larger net sample sizes indicated that the sequential design was more cost and time-effective. Conclusions:This study contributes to the research available on implementing mixed-mode designs as part of public health surveys. Our findings show that SAQ-Paper and SAQ-Web questionnaires can be combined effectively. Sequential mixed-mode designs with higher rates of online respondents may be of greater benefit to studies with larger net sample sizes than concurrent mixed-mode designs.

SUBMITTER: Mauz E

PROVIDER: S-EPMC5791202 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Mixing modes in a population-based interview survey: comparison of a sequential and a concurrent mixed-mode design for public health research.

Mauz Elvira E von der Lippe Elena E Allen Jennifer J Schilling Ralph R Müters Stephan S Hoebel Jens J Schmich Patrick P Wetzstein Matthias M Kamtsiuris Panagiotis P Lange Cornelia C

Archives of public health = Archives belges de sante publique 20180104

<h4>Background</h4>Population-based surveys currently face the problem of decreasing response rates. Mixed-mode designs are now being implemented more often to account for this, to improve sample composition and to reduce overall costs. This study examines whether a concurrent or sequential mixed-mode design achieves better results on a number of indicators of survey quality.<h4>Methods</h4>Data were obtained from a population-based health interview survey of adults in Germany that was conducted ...[more]

PMID: 29423220

Similar Datasets

Project description:BackgroundHealth interview surveys are important data sources for empirical research in public health. However, the diversity of methods applied, such as in the mode of data collection, make it difficult to compare results across surveys, time, or countries. The aim of this study was to explore whether the prevalence rates of health-related indicators amongst adults differ when self-administered paper mail questionnaires (SAQ-Paper), self-administered web surveys (SAQ-Web), and computer-assisted telephone interviews (CATI) are used for data collection in a health survey.MethodsData were obtained from a population-based mixed-mode health interview survey of adults in Germany carried out within the 'German Health Update' (GEDA) study. Data were collected either by SAQ-Paper (n = 746), SAQ-Web (n = 414), or CATI (n = 411). Predictive margins from logistic regression models were used to estimate the prevalence rates of chronic conditions, subjective health, mental health, psychosocial factors, and health behaviours, adjusted for the socio-demographic characteristics of each mode group.ResultsSocio-demographic characteristics were found to differ significantly between study participants who responded by SAQ-Paper, SAQ-Web, and CATI. Crude prevalence rates for health-related indicators also showed significant variation across all three survey modes. After adjusting for socio-demographic factors though, significant differences in prevalence rates between the two self-administered modes (SAQ-Paper and SAQ-Web) were found in only 2 out of the 19 health-related indicators studied. The differences between CATI and the two self-administered modes remained significant however, especially for indicators of mental and psychosocial health and self-reported sporting activity.ConclusionsThe findings of this study indicate that prevalence rates obtained from health interview surveys can vary with the mode of data collection, primarily between interviewer and self-administered modes. Hence, the type of survey mode used should be considered when comparing results from different health surveys. Mixing self-administered modes, such as paper-based questionnaires and web surveys, may be a combination to minimize mode differences in mixed-mode health interview surveys.

Project description:BACKGROUND:The implementation of an Internet option in an existing public health interview survey using a mixed-mode design is attractive because of lower costs and faster data availability. Additionally, mixed-mode surveys can increase response rates and improve sample composition. However, mixed-mode designs can increase the risk of measurement error (mode effects). OBJECTIVE:This study aimed to determine whether the prevalence rates or mean values of self- and parent-reported health indicators for children and adolescents aged 0-17 years differ between self-administered paper-based questionnaires (SAQ-paper) and self-administered Web-based questionnaires (SAQ-Web), as well as between a single-mode control group and different mixed-mode groups. METHODS:Data were collected for a methodological pilot of the third wave of the "German Health Interview and Examination Survey for Children and Adolescents". Questionnaires were completed by parents or adolescents. A population-based sample of 11,140 children and adolescents aged 0-17 years was randomly allocated to 4 survey designs-a single-mode control group with paper-and-pencil questionnaires only (n=970 parents, n=343 adolescents)-and 3 mixed-mode designs, all of which offered Web-based questionnaire options. In the concurrent mixed-mode design, both questionnaires were offered at the same time (n=946 parents, n=290 adolescents); in the sequential mixed-mode design, the SAQ-Web was sent first, followed by the paper questionnaire along with a reminder (n=854 parents, n=269 adolescents); and in the preselect mixed-mode design, both options were offered and the respondents were asked to request the desired type of questionnaire (n=698 parents, n=292 adolescents). In total, 3468 questionnaires of parents of children aged 0-17 years (SAQ-Web: n=708; SAQ-paper: n=2760) and 1194 questionnaires of adolescents aged 11-17 years (SAQ-Web: n=299; SAQ-paper: n=895) were analyzed. Sociodemographic characteristics and a broad range of health indicators for children and adolescents were compared by survey design and data collection mode by calculating predictive margins from regression models. RESULTS:There were no statistically significant differences in sociodemographic characteristics or health indicators between the single-mode control group and any of the mixed-mode survey designs. Differences in sociodemographic characteristics between SAQ-Web and SAQ-paper were found. Web respondents were more likely to be male, have higher levels of education, and higher household income compared with paper respondents. After adjusting for sociodemographic characteristics, only one of the 38 analyzed health indicators showed different prevalence rates between the data collection modes, with a higher prevalence rate for lifetime alcohol consumption among the online-responding adolescents (P<.001). CONCLUSIONS:These results suggest that mode bias is limited in health interview surveys for children and adolescents using a mixed-mode design with Web-based and paper questionnaires.

Project description:BackgroundOver the past two decades, genomics has evolved as a scientific research discipline. Genomics research was fueled initially by government and nonprofit funding sources, later augmented by private research and development (R&D) funding. Citizens and taxpayers of many countries have funded much of the research, and have expectations about access to the resulting information and knowledge. While access to knowledge gained from all publicly funded research is desired, access is especially important for fields that have broad social impact and stimulate public dialogue. Genomics is one such field, where public concerns are raised for reasons such as health care and insurance implications, as well as personal and ancestral identification. Thus, genomics has grown rapidly as a field, and attracts considerable interest.ResultsOne way to study the growth of a field of research is to examine its funding. This study focuses on public funding of genomics research, identifying and collecting data from major government and nonprofit organizations around the world, and updating previous estimates of world genomics research funding, including information about geographical origins. We initially identified 89 publicly funded organizations; we requested information about each organization's funding of genomics research. Of these organizations, 48 responded and 34 reported genomics research expenditures (of those that responded but did not supply information, some did not fund such research, others could not quantify it). The figures reported here include all the largest funders and we estimate that we have accounted for most of the genomics research funding from government and nonprofit sources.ConclusionAggregate spending on genomics research from 34 funding sources averaged around $2.9 billion in 2003-2006. The United States spent more than any other country on genomics research, corresponding to 35% of the overall worldwide public funding (compared to 49% US share of public health research funding for all purposes). When adjusted to genomics funding intensity, however, the United States dropped below Ireland, the United Kingdom, and Canada, as measured both by genomics research expenditure per capita and per Gross Domestic Product.

Project description:BACKGROUND:Germany is a popular destination for immigrants, and migration has increased in recent years. It is therefore important to collect reliable data on migrants' health. The Robert Koch Institute, Berlin, Germany, has launched the Improving Health Monitoring in Migrant Populations (IMIRA) project to sustainably integrate migrant populations into health monitoring in Germany. OBJECTIVE:One of IMIRA's objectives is to implement a feasibility study (the IMIRA survey) that focuses on testing various interventions to increase the reachability of migrants with health interview surveys. Possible causes of nonresponse should be identified so as to increase participation in future surveys. METHODS:The survey target populations were Turkish, Polish, Romanian, Syrian, and Croatian migrants, who represent the biggest migrant groups living in Germany. We used probability sampling, using data from the registration offices in 2 states (Berlin and Brandenburg); we randomly selected 9068 persons by nationality in 7 sample points. We applied age (3 categories: 18-44, 45-64, and ?65 years) and sex strata. Modes and methods used to test their usability were culturally sensitive materials, online questionnaires, telephone interviews, personal contact, and personal interviews, using multilingual materials and interviewers. To evaluate the effectiveness of the interventions, we used an intervention group (group A) and a control group (group B). There were also focus groups with the interviewers to get more information about the participants' motivation. We used the European Health Interview Survey, with additional instruments on religious affiliation, experience of discrimination, and subjective social status. We evaluated results according to their final contact result (disposition code). RESULTS:We collected data from January to May 2018 in Berlin and Brandenburg, Germany. The survey had an overall response rate of 15.88% (1190/7494). However, final disposition codes varied greatly with regard to citizenship. In addition to the quantitative results, interviewers reported in the focus groups a "feeling of connectedness" to the participants due to the multilingual interventions. The interviewers were particularly positive about the home visits, because "if you are standing at the front door, you will be let in for sure." CONCLUSIONS:The IMIRA survey appraised the usability of mixed-mode or mixed-method approaches among migrant groups with a probability sample in 2 German states. When conducting the survey, we were confronted with issues regarding the translation of the questionnaire, as well as the validity of some instruments in the survey languages. A major result was that personal face-to-face contact was the most effective intervention to recruit our participants. We will implement the findings in the upcoming health monitoring study at the Robert Koch Institute.

Project description:BackgroundWithin SPHERE (Strengthening Public Health Research in Europe), a collaborative study funded by the European Commission, we have assessed the support for public health research at ministry level in European countries.MethodsWe surveyed the health and science ministries in 25 EU countries and 3 EEA countries, using a broad definition of public-health research at population level. We made over 600 phone calls and emails to identify respondents and to gain answers. We gained formal replies from 42 out of 56 ministries (73% response) in 25 countries. There were 22 completed questionnaires (from 25 ministries), 6 short answers and 11 contacts declaring that their ministries were not responsible for public health research, while in 14 ministries (both ministries in three countries) no suitable ministry contact could be found.ResultsIn most European countries, ministries of health, or their devolved agencies, were regarded as the leading organizations. Most ministries were able to specify thematic areas for public-health research (from three to thirty), and others ministries referred to policy documents, health plans or public-health plans to define research priorities. Ministries and their agencies led on decisions for financial support of public-health research, with less involvement of other external organisations compared with the process of identifying priorities. However, the actual funds available for public health were not easily identifiable. Most ministries relied on general academic means for dissemination of results of public-health research, while ministries get information on the use of public-health research usually through informal means. Ministries made suggestions for strengthening public-health research through initiatives of their own countries and of the European Union: as well as more resources, improving coordination was most frequently suggested.ConclusionThere is no common approach to support for public-health research across Europe, and significant gaps in organisation and funding. Health ministries and national agencies value exchange between researchers and policy-makers, civil society organizations, and academic and public authorities, and the application of public-health research results. There would be benefits from better processes of priority setting and improved coordination for research, at regional, national and European levels.

Project description:BackgroundDigital health research repositories propose sharing longitudinal streams of health records and personal sensing data between multiple projects and researchers. Motivated by the prospect of personalizing patient care (precision medicine), these initiatives demand broad public acceptance and large numbers of data contributors, both of which are challenging.ObjectiveThis study investigates public attitudes toward possibly contributing to digital health research repositories to identify factors for their acceptance and to inform future developments.MethodsA cross-sectional online survey was conducted from March 2020 to December 2020. Because of the funded project scope and a multicenter collaboration, study recruitment targeted young adults in Denmark and Brazil, allowing an analysis of the differences between 2 very contrasting national contexts. Through closed-ended questions, the survey examined participants' willingness to share different data types, data access preferences, reasons for concern, and motivations to contribute. The survey also collected information about participants' demographics, level of interest in health topics, previous participation in health research, awareness of examples of existing research data repositories, and current attitudes about digital health research repositories. Data analysis consisted of descriptive frequency measures and statistical inferences (bivariate associations and logistic regressions).ResultsThe sample comprises 1017 respondents living in Brazil (1017/1600, 63.56%) and 583 in Denmark (583/1600, 36.44%). The demographics do not differ substantially between participants of these countries. The majority is aged between 18 and 27 years (933/1600, 58.31%), is highly educated (992/1600, 62.00%), uses smartphones (1562/1600, 97.63%), and is in good health (1407/1600, 87.94%). The analysis shows a vast majority were very motivated by helping future patients (1366/1600, 85.38%) and researchers (1253/1600, 78.31%), yet very concerned about unethical projects (1219/1600, 76.19%), profit making without consent (1096/1600, 68.50%), and cyberattacks (1055/1600, 65.94%). Participants' willingness to share data is lower when sharing personal sensing data, such as the content of calls and texts (1206/1600, 75.38%), in contrast to more traditional health research information. Only 13.44% (215/1600) find it desirable to grant data access to private companies, and most would like to stay informed about which projects use their data (1334/1600, 83.38%) and control future data access (1181/1600, 73.81%). Findings indicate that favorable attitudes toward digital health research repositories are related to a personal interest in health topics (odds ratio [OR] 1.49, 95% CI 1.10-2.02; P=.01), previous participation in health research studies (OR 1.70, 95% CI 1.24-2.35; P=.001), and awareness of examples of research repositories (OR 2.78, 95% CI 1.83-4.38; P<.001).ConclusionsThis study reveals essential factors for acceptance and willingness to share personal data with digital health research repositories. Implications include the importance of being more transparent about the goals and beneficiaries of research projects using and re-using data from repositories, providing participants with greater autonomy for choosing who gets access to which parts of their data, and raising public awareness of the benefits of data sharing for research. In addition, future developments should engage with and reduce risks for those unwilling to participate.

Project description:A public that is an informed partner in clinical research is important for ethical, methodological, and operational reasons. There are indications that the public is unaware or misinformed, and not sufficiently engaged in clinical research but studies on the topic are lacking. PARTAKE - Public Awareness of Research for Therapeutic Advancements through Knowledge and Empowerment is a program aimed at increasing public awareness and partnership in clinical research. The PARTAKE Survey is a component of the program.To study public knowledge and perceptions of clinical research.A 40-item questionnaire combining multiple-choice and open-ended questions was administered to 175 English- or Hindi-speaking individuals in 8 public locations representing various socioeconomic strata in New Delhi, India.Interviewees were 18-84 old (mean: 39.6, SD ± 16.6), 23.6% female, 68.6% employed, 7.3% illiterate, 26.3% had heard of research, 2.9% had participated and 58.9% expressed willingness to participate in clinical research. The following perceptions were reported (% true/% false/% not aware): 'research benefits society' (94.1%/3.5%/2.3%), 'the government protects against unethical clinical research' (56.7%/26.3%/16.9%), 'research hospitals provide better care' (67.2%/8.7%/23.9%), 'confidentiality is adequately protected' (54.1%/12.3%/33.5%), 'participation in research is voluntary' (85.3%/5.8%/8.7%); 'participants treated like 'guinea pigs'' (20.7%/53.2%/26.0%), and 'compensation for participation is adequate' (24.7%/12.9%/62.3%).Results suggest the Indian public is aware of some key features of clinical research (e.g., purpose, value, voluntary nature of participation), and supports clinical research in general but is unaware of other key features (e.g., compensation, confidentiality, protection of human participants) and exhibits some distrust in the conduct and reporting of clinical trials. Larger, cross-cultural surveys are required to inform educational programs addressing these issues.

Dataset Information

Mixing modes in a population-based interview survey: comparison of a sequential and a concurrent mixed-mode design for public health research.

Publications

Mixing modes in a population-based interview survey: comparison of a sequential and a concurrent mixed-mode design for public health research.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets