Interviewer effects on non-response propensity in longitudinal surveys: a multilevel modelling approach.
Ontology highlight
ABSTRACT:
SUBMITTER: Vassallo R
PROVIDER: S-EPMC4282753 | biostudies-literature | 2015 Jan
REPOSITORIES: biostudies-literature
Publications
Interviewer effects on non-response propensity in longitudinal surveys: a multilevel modelling approach.
Vassallo Rebecca R Durrant Gabriele B GB Smith Peter W F PW Goldstein Harvey H
Journal of the Royal Statistical Society. Series A, (Statistics in Society) 20140219 1
The paper investigates two different multilevel approaches, the multilevel cross-classified and the multiple-membership models, for the analysis of interviewer effects on wave non-response in longitudinal surveys. The models proposed incorporate both interviewer and area effects to account for the non-hierarchical structure, the influence of potentially more than one interviewer across waves and possible confounding of area and interviewer effects arising from the non-random allocation of interv ...[more]
Similar Datasets
Project description:BackgroundThe CQ Index for the elderly, a quality-of-care questionnaire administered by conducting interviews, is used to assess clients' experiences in Dutch nursing homes and homes for the elderly. This article describes whether inter-interviewer differences influence the perceived quality of healthcare services reported by residents, the size of this interviewer effect and the influence of the interviewer characteristics on CQ Index dimensions for public reporting.MethodsData from 4345 questionnaires was used. Correlations were calculated, reliability analyses were performed, and a multilevel analysis was used to calculate the degree of correlation between two interviewers within one health care institution. Five models were constructed and the Intra Class Correlation (ICC) was calculated. Healthcare institutions were given 1-5 stars on every quality dimensions (1 = worst and 5 = best), adjusted for resident and interviewer characteristics. The effect of these characteristics on the assignment of the stars was investigated.ResultsIn a multilevel approach, the ICC showed a significant amount of variance on five quality dimensions. Of the interviewer characteristics, only previous interviewing experience, the reason of interviewing and general knowledge of health care had a significant effect on the quality dimensions. Adjusting for interviewer characteristics did not affect the overall star assignment to the institutions regarding 7 of 12 quality dimensions. For the other five dimensions (Shared decision-making, Meals, Professional competency, Autonomy, and Availability of personnel) a minor effect was found.ConclusionsWe have shown that training, the use of experienced interviewers, written instructions, supervision and educational meetings do not automatically prevent interviewer effects. While the results of this study can be used to improve the quality of services provided by these institutions, several CQ index dimensions should be interpreted with caution for external purposes (accountability and transparency).
| S-EPMC2936930 | biostudies-literature
Project description:Antimicrobial resistance has become one of the greatest threats to global health. Over 80% of antibiotics are prescribed in primary care, with many prescriptions considered to be issued inappropriately. The aim of this study was to examine the association between prescribing rates and demographic, practice, geographic, and socioeconomic characteristics using a multilevel modelling approach. Antibiotic prescribing data by 320 GP surgeries in Northern Ireland were obtained from Business Services Organisation for the years 2014-2020. A linear mixed-effects model was used to identify factors influencing antibiotic prescribing rates. Overall, the number of antibacterial prescriptions decreased by 26.2%, from 1,564,707 items in 2014 to 1,155,323 items in 2020. Lower levels of antibiotic prescribing were associated with urban practices (p < 0.001) and practices in less deprived areas (p = 0.005). The overall decrease in antibacterial drug prescriptions over time was larger in less deprived areas (p = 0.03). Higher prescribing rates were linked to GP practices located in areas with a higher percentage of the population aged ≥65 (p < 0.001) and <15 years (p < 0.001). There were also significant regional differences in antibiotic prescribing. We advocate that any future antibiotic prescribing targets should account for local factors.
| S-EPMC8772723 | biostudies-literature
Project description:BackgroundPrevious studies reported varyingly positive, negative, or no relationships between caries and periodontitis. Therefore, the aim was to assess the potential co-occurrence of caries experience and periodontal inflammation on the same teeth.MethodsThis cross-sectional study used data from the Lithuanian National Oral Health Survey. The study included a stratified random sample of 1405 individuals aged 34-78, recruited from 5 Lithuanian cities and 10 peri-urban/rural areas (response rate 52%). Information about sociodemographic (age, sex, education, residence), behavioral (sugar-containing diet, tooth brushing frequency, use of interdental care products, last dental visit, smoking) and biological (systemic disease, use of medication and xerostomia) determinants was collected using the World Health Organization (WHO) Oral Health Questionnaire for Adults supplemented with additional questions. Clinical data were recorded using the WHO criteria and collected by one trained and calibrated examiner. Dental caries status was recorded as sound, decayed, missing, filled surfaces. Subsequently for the analyses, status was recorded at a tooth-level as decayed- and filled-teeth (DT and FT) including proximal, buccal, and oral surfaces. Two measures were used for periodontal status. The probing pocket depth (PPD) was measured at six sites and recorded at a tooth level into the absence of PPD or presence of PPD ≥ 4 mm. Bleeding on probing (BOP) was measured at the same six sites and was recorded as either present or absent at a tooth-level. Univariable and multivariable 2-level random intercept binary logistic regression analyses were utilized.ResultsPositive associations were found between DT and BOP (OR 1.42, 95% CI 1.20-1.67), FT and BOP (OR 2.07, 95% CI 1.82-2.23), DT and PPD (OR 1.38, 95% CI 1.15-1.67) and FT and PPD (OR 2.01, 95% CI 1.83-2.20).ConclusionsOur findings add evidence for the co-occurrence of periodontal inflammation and caries on the same teeth. This suggests the need for increased emphasis on a transdisciplinary approach in designing oral health interventions that target dental caries and periodontal disease simultaneously. In addition, longitudinal studies exploring the co-occurrence of caries and periodontal disease at the same sites, taking into consideration the levels of both conditions and genetic variation, are warranted.
| S-EPMC10832139 | biostudies-literature
Project description:BackgroundDepression in the perinatal period, during pregnancy or within 1 year of childbirth, imposes a high burden on women with rippling effects through her and her child's life course. Social support may be an important protective factor, but the complex bidirectional relationship with depression, alongside a paucity of longitudinal explorations, leaves much unknown about critical windows of social support exposure across the perinatal period and causal impacts on future depressive episodes.MethodsThis study leverages marginal structural models to evaluate associations between longitudinal patterns of perinatal social support and subsequent maternal depression at 6 and 12 months postpartum. In a cohort of women in rural Pakistan (n=780), recruited in the third trimester of pregnancy and followed up at 3, 6 and 12 months postpartum, we assessed social support using two well-validated measures: the Multidimensional Scale of Perceived Social Support (MSPSS) and the Maternal Social Support Index (MSSI). Major depressive disorder was assessed with the Structured Clinical Interview for Diagnostic and Statistical Manual of Mental Disorders (DSM IV).ResultsHigh and sustained scores on the MSPSS through the perinatal period were associated with a decreased risk of depression at 12 months postpartum (0.35, 95% CI: 0.19 to 0.63). Evidence suggests the recency of support also matters, but estimates are imprecise. We did not find evidence of a protective effect for support based on the MSSI.ConclusionsThis study highlights the protective effect of sustained social support, particularly emotional support, on perinatal depression. Interventions targeting, leveraging and maintaining this type of support may be particularly important for reducing postpartum depression.
| S-EPMC8434957 | biostudies-literature
Project description:ObjectivesThe analysis aimed to assess the scale of interviewer effects on abortion survey responses, to compare interviewer effects between different question wordings and between direct and indirect approaches, and to identify interviewer and interview characteristics that explain interviewer effects on abortion reporting.Setting2018 Performance Monitoring for Action nationally representative household surveys from Côte d'Ivoire, Nigeria and Rajasthan, India.ParticipantsSurvey data from 20 016 interviews with reproductive age (15-49) women, selected using multistage stratified cluster sampling. Data from self-administered interviewer surveys and from a sample of health service delivery points that serve the female survey participants were also included.Primary outcome measuresOutcomes were the respondent's own experience of ever 'removing a pregnancy', their closest confidante's experience of pregnancy removal and the respondent's own experience of period regulation.ResultsSubstantial interviewer effects were observed, ranging from 7% in Côte d'Ivoire to 24% in Nigeria for pregnancy removal. Interviewer effects for survey questions that were designed to ask about abortion in a less stigmatising way were either similar to (9%-26% for confidante-reporting) or higher than (17%-32% for a question about period regulation) the pregnancy removal question. Interviewer and interview characteristics associated with abortion reporting included respondent-interviewer familiarity, the language of interview and the interviewer's comfort asking questions about abortion.ConclusionThis study highlights that questions designed to be less stigmatising may increase interviewer effects due to lower comprehension among respondents. Further work is needed to assess question wordings for different contexts. Selecting and training interviewers to ensure comfort asking questions about abortion is important for reproductive health surveys. Challenges for the use of 'insider' interviewers and the management of surveys in countries with high linguistic diversity are also identified.
| S-EPMC8606767 | biostudies-literature
Project description:BackgroundChronic periodontitis is a multifactorial polygenetic disease with an increasing number of associated factors that have been identified over recent decades. Longitudinal epidemiologic studies have demonstrated that the risk factors were related to the progression of the disease. A traditional multivariate regression model was used to find risk factors associated with chronic periodontitis. However, the approach requirement of standard statistical procedures demands individual independence. Multilevel modelling (MLM) data analysis has widely been used in recent years, regarding thorough hierarchical structuring of the data, decomposing the error terms into different levels, and providing a new analytic method and framework for solving this problem. The purpose of our study is to investigate the relationship of clinical periodontal index and the risk factors in chronic periodontitis through MLM analysis and to identify high-risk individuals in the clinical setting.MethodsFifty-four patients with moderate to severe periodontitis were included. They were treated by means of non-surgical periodontal therapy, and then made follow-up visits regularly at 3, 6, and 12 months after therapy. Each patient answered a questionnaire survey and underwent measurement of clinical periodontal parameters.ResultsCompared with baseline, probing depth (PD) and clinical attachment loss (CAL) improved significantly after non-surgical periodontal therapy with regular follow-up visits at 3, 6, and 12 months after therapy. The null model and variance component models with no independent variables included were initially obtained to investigate the variance of the PD and CAL reductions across all three levels, and they showed a statistically significant difference (P < 0.001), thus establishing that MLM data analysis was necessary. Site-level had effects on PD and CAL reduction; those variables could explain 77-78% of PD reduction and 70-80% of CAL reduction at 3, 6, and 12 months. Other levels only explain 20-30% of PD and CAL reductions. Site-level had the greatest effect on PD and CAL reduction.ConclusionsNon-surgical periodontal therapy with regular follow-up visits had a remarkable curative effect. All three levels had a substantial influence on the reduction of PD and CAL. Site-level had the largest effect on PD and CAL reductions.
| S-EPMC5603071 | biostudies-literature
Project description:Surveys of egocentric networks are especially vulnerable to methods effects. This study combines a true experiment-random assignment of respondents to receive essentially identical questions from either an in-person interviewer or an online survey--with audio recordings of the in-person interviews. We asked over 850 respondents from a general population several different name-eliciting questions. Face-to-face interviews yielded more cooperation and higher quality data but fewer names than did the web surveys. Exploring several explanations, we determine that interviewer differences account for the mode difference: Interviewers who consistently prompted respondents elicited as many alters as did the web survey and substantially more than did less active interviewers. Although both methods effects substantially influenced the volume of alters listed, they did not substantially modify associations of other variables with volume.
| S-EPMC6748643 | biostudies-literature
Project description:BackgroundTwo probability surveys, conducted in the same districts of Bihar, India (Aurangabad and Gopalganj) at approximately the same time in 2016 using identical questionnaires and similar survey methods, produced significantly different responses for 37.2% (58/156) of the indicator comparisons. Interviewers for one survey were men while for the other they were women. Respondents were mothers of children aged 0-59 months living in a traditional rural setting. We examined the influence of interviewer gender on mothers' survey responses and their implications for interpreting survey results.MethodsWe used qualitative methods including 10 focus group discussions (FGDs) and 33 in-depth interviews (IDIs) in the same locations as the 2016 surveys. FGD participants were purposefully selected mothers with children 0-59 months, husbands and other in-law family members. IDIs were carried out with frontline health-workers, enumerators and supervisors from the two previous household surveys.ResultsFindings revealed a preference for female interviewers for household surveys in study districts as they facilitated access to mothers and reduced their discomfort as survey participants. However, this gender preference was related to the survey question. Regardless of age, caste and educational level, most mothers were not permitted to communicate with men (aside from husbands) about female-specific health topics, including birth preparedness, delivery, menstrual cycles, contraception, breastfeeding, sexual behaviour, sexually transmitted disease, and domestic violence. Mothers in higher castes perceived these social restrictions more acutely than mothers in lower castes. There was no systematic direction of the resulting error. Mothers were willing to discuss child health issues with interviewers of either gender.ConclusionsInterviewer gender is an important consideration when designing survey protocols for maternal and reproductive health studies and when selecting and training enumerators. Female interviewers are optimal for traditional settings in Bihar as they are more likely to obtain accurate data on sensitive topics and reduce the potential for non-sampling error due to their reduced social distance with maternal respondents.
| S-EPMC8208568 | biostudies-literature
Project description:Flexible multilevel models are proposed to allow for cluster-specific smooth estimation of growth curves in a mixed-effects modeling format that includes subject-specific random effects on the growth parameters. Attention is then focused on models that examine between-cluster comparisons of the effects of an ecologic covariate of interest (e.g. air pollution) on nonlinear functionals of growth curves (e.g. maximum rate of growth). A Gibbs sampling approach is used to get posterior mean estimates of nonlinear functionals along with their uncertainty estimates. A second-stage ecologic random-effects model is used to examine the association between a covariate of interest (e.g. air pollution) and the nonlinear functionals. A unified estimation procedure is presented along with its computational and theoretical details. The models are motivated by, and illustrated with, lung function and air pollution data from the Southern California Children's Health Study.
| S-EPMC2733176 | biostudies-literature
Project description:We derive regression estimators that can compare longitudinal treatments using only the longitudinal propensity scores as regressors. These estimators, which assume knowledge of the variables used in the treatment assignment, are important for reducing the large dimension of covariates for two reasons. First, if the regression models on the longitudinal propensity scores are correct, then our estimators share advantages of correctly specified model-based estimators, a benefit not shared by estimators based on weights alone. Second, if the models are incorrect, the misspecification can be more easily limited through model checking than with models based on the full covariates. Thus, our estimators can also be better when used in place of the regression on the full covariates. We use our methods to compare longitudinal treatments for type II diabetes mellitus.
| S-EPMC4593705 | biostudies-literature