Dataset Information

Does mobile phone survey method matter? Reliability of computer-assisted telephone interviews and interactive voice response non-communicable diseases risk factor surveys in low and middle income countries.

ABSTRACT: INTRODUCTION:Increased mobile phone subscribership in low- and middle-income countries (LMICs) provides novel opportunities to track population health. The objective of this study was to examine reliability of data in comparing participant responses collected using two mobile phone survey (MPS) delivery modalities, computer assisted telephone interviews (CATI) and interactive voice response (IVR) in Bangladesh (BGD) and Tanzania (TZA). METHODS:Using a cross-over design, we used random digit dialing (RDD) to call randomly generated mobile phone numbers and recruit survey participants to receive either a CATI or IVR survey on non-communicable disease (NCD) risk factors, followed 7 days later by the survey mode not received during first contact; either IVR or CATI. Respondents who received the first survey were designated as first contact (FC) and those who consented to being called a second time and subsequently answered the call were designated as follow-up (FU). We used the same questionnaire for both contacts, with response options modified to suit the delivery mode. Reliability of responses was analyzed using the Cohen's kappa statistic for percent agreement between two modes. RESULTS:Self-reported data on demographic characteristics and NCD behavioral risk factors were collected from 482 (CATI-FC) and 653 (IVR-FC) age-eligible and consenting respondents in BGD, and from 387 (CATI-FC) and 674 (IVR-FC) respondents in TZA respectively. Survey follow-up rates were 30.7% (n = 482) for IVR-FU and 53.8% (n = 653) for CATI-FU in BGD; and 42.4% (n = 387) for IVR-FU and 49.9% (n = 674) for CATI-FU in TZA respectively. Overall, there was high consistency between delivery modalities for alcohol consumption in the past 30 days in both countries (kappa = 0.64 for CATI?IVR (BGD), kappa = 0.54 for IVR?CATI (BGD); kappa = 0.66 for CATI?IVR (TZA), kappa = 0.76 for IVR?CATI (TZA)), and current smoking (kappa = 0.68 for CATI?IVR (BGD), kappa = 0.69 for IVR?CATI (BGD); kappa = 0.39 for CATI?IVR (TZA), kappa = 0.50 for IVR?CATI (TZA)). There was moderate to substantial consistency in both countries for history of checking for hypertension and diabetes with kappa statistics ranging from 0.43 to 0.67. There was generally lower consistency in both countries for physical activity (vigorous and moderate) with kappa statistics ranging from 0.10 to 0.41, weekly fruit and vegetable with kappa ranging from 0.08 to 0.45, consumption of foods high in salt and efforts to limit salt with kappa generally below 0.3. CONCLUSIONS:The study found that when respondents are re-interviewed, the reliability of answers to most demographic and NCD variables is similar whether starting with CATI or IVR. The study underscores the need for caution when selecting questions for mobile phone surveys. Careful design can help ensure clarity of questions to minimize cognitive burden for respondents, many of whom may not have prior experience in taking automated surveys. Further research should explore possible differences and determinants of survey reliability between delivery modes and ideally compare both IVR and CATI surveys to in-person face-to-face interviews. In addition, research is needed to better understand factors that influence survey cooperation, completion, refusal and attrition rates across populations and contexts.

SUBMITTER: Pariyo GW

PROVIDER: S-EPMC6457489 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Does mobile phone survey method matter? Reliability of computer-assisted telephone interviews and interactive voice response non-communicable diseases risk factor surveys in low and middle income countries.

Pariyo George W GW Greenleaf Abigail R AR Gibson Dustin G DG Ali Joseph J Selig Hannah H Labrique Alain B AB Al Kibria Gulam Muhammed GM Khan Iqbal Ansary IA Masanja Honorati H Flora Meerjady Sabrina MS Ahmed Saifuddin S Hyder Adnan A AA

PloS one 20190410 4

<h4>Introduction</h4>Increased mobile phone subscribership in low- and middle-income countries (LMICs) provides novel opportunities to track population health. The objective of this study was to examine reliability of data in comparing participant responses collected using two mobile phone survey (MPS) delivery modalities, computer assisted telephone interviews (CATI) and interactive voice response (IVR) in Bangladesh (BGD) and Tanzania (TZA).<h4>Methods</h4>Using a cross-over design, we used ra ...[more]

PMID: 30969975

Similar Datasets

Project description:BackgroundThis is the first study to examine the costs of conducting a mobile phone survey (MPS) through interactive voice response (IVR) to collect information on risk factors for noncommunicable diseases (NCD) in three low- and middle-income countries (LMIC); Bangladesh, Colombia, and Uganda.MethodsThis is a micro-costing study conducted from the perspective of the payer/funder with a 1-year horizon. The study evaluates the fixed costs and variable costs of implementing one nationally representative MPS for NCD risk factors of the adult population. In this costing study, we estimated the sample size of calls required to achieve a population-representative survey and associated incentives. Cost inputs were obtained from direct economic costs incurred by a central study team, from country-specific collaborators, and from platform developers who participated in the deployment of these MPS during 2017. Costs were reported in US dollars (USD). A sensitivity analysis was conducted assessing different scenarios of pricing and incentive strategies. Also, costs were calculated for a survey deployed targeting only adults younger than 45 years.ResultsWe estimated the fixed costs ranging between $47,000 USD and $74,000 USD. Variable costs were found to be between $32,000 USD and $129,000 USD per nationally representative survey. The main cost driver was the number of calls required to meet the sample size, and its variability largely depends on the extent of mobile phone coverage and access in the country. Therefore, a larger number of calls were estimated to survey specific harder-to-reach sub-populations.ConclusionMobile phone surveys have the potential to be a relatively less expensive and timely method of collecting survey information than face-to-face surveys, allowing decision-makers to deploy survey-based monitoring or evaluation programs more frequently than it would be possible having only face-to-face contact. The main driver of variable costs is survey time, and most of the variability across countries is attributable to the sampling differences associated to reaching out to population subgroups with low mobile phone ownership or access.

Project description:BackgroundThere is need for more timely data to inform interventions that address the growing noncommunicable disease (NCD) epidemic. With a global increase in mobile phone ownership, mobile phone surveys can bridge this gap.ObjectiveThis study aimed to explore the acceptability and use of interactive voice response (IVR) surveys for surveillance of NCD behavioral risk factors in rural Uganda.MethodsThis qualitative study employed user group testing (UGT) with community members. The study was conducted at the Iganga-Mayuge Health and Demographic Surveillance Site (IM-HDSS) in Eastern Uganda. We conducted four UGTs which consisted of different categories of HDSS members: females living in urban areas, males living in urban areas, females living in rural areas, and males living in rural areas. Participants were individually sent an IVR survey, then were brought in for a group discussion using a semistructured guide. Data were analyzed thematically using directed content analysis.ResultsParticipants perceived that IVR surveys may be useful in promoting confidentiality, saving costs, and raising awareness on NCD behavioral risk factors. Due to the clarity and delivery of questions in the local language, the IVR survey was perceived as easy to use. Community members suggested scheduling surveys on specific days and sending reminders as ways to improve their use for surveillance. Social issues such as domestic violence and perceptions toward unknown calls, technological factors including poor network connections and inability to use phones, and personal issues such as lack of access to phones and use of multiple networks were identified as barriers to the acceptability and use of mobile phone surveys. However, incentives were reported to motivate people to complete the survey.ConclusionsCommunity members reflected on contextual and sociological implications of using mobile phones for surveillance of NCD behavioral risk factors. The opportunities and challenges that affect acceptability and use of IVR surveys should be considered in designing and implementing surveillance programs for NCD risk factors.

Project description:Background:The global proliferation of mobile phones offers opportunity for improved non-communicable disease (NCD) data collection by interviewing participants using interactive voice response (IVR) surveys. We assessed whether airtime incentives can improve cooperation and response rates for an NCD IVR survey in Bangladesh and Uganda. Methods:Participants were randomised to three arms: a) no incentive, b) 1X incentive or c) 2X incentive, where X was set to airtime of 50 Bangladesh Taka (US$0.60) and 5000 Ugandan Shillings (UGX; US$1.35). Adults aged 18 years and older who had a working mobile phone were sampled using random digit dialling. The primary outcomes, cooperation and response rates as defined by the American Association of Public Opinion Research, were analysed using log-binomial regression model. Results:Between 14 June and 14 July 2017, 440?262 phone calls were made in Bangladesh. The cooperation and response rates were, respectively, 28.8% (353/1227) and 19.2% (580/3016) in control, 39.2% (370/945) and 23.9% (507/2120) in 50 Taka and 40.0% (362/906) and 24.8% (532/2148) in 100 Taka incentive groups. Cooperation and response rates, respectively, were significantly higher in both the 50 Taka (risk ratio (RR) 1.36, 95%?CI 1.21 to 1.53) and (RR 1.24, 95%?CI 1.12 to 1.38), and 100 Taka groups (RR 1.39, 95% CI 1.23 to 1.56) and (RR 1.29, 95%?CI 1.16 to 1.43), as compared with the controls. In Uganda, 174?157 phone calls were made from 26 March to 22 April 2017. The cooperation and response rates were, respectively, 44.7% (377/844) and 35.2% (552/1570) in control, 57.6% (404/701) and 39.3% (508/1293) in 5000 UGX and 58.8% (421/716) and 40.3% (535/1328) in 10?000 UGX groups. Cooperation and response rates were significantly higher, respectively in the 5000 UGX (RR 1.29, 95% CI 1.17 to 1.42) and (RR 1.12, 95%?CI 1.02 to 1.23), and 10?000 UGX groups (RR 1.32, 95% CI 1.19 to 1.45) and (RR 1.15, 95%?CI 1.04 to 1.26), as compared with the control group. Conclusion:In two diverse settings, the provision of an airtime incentive significantly improved both the cooperation and response rates of an IVR survey, with no significant difference between the two incentive amounts. Trial registration number:NCT03768323.

Project description:BackgroundNational and subnational level surveys are important for monitoring disease burden, prioritizing resource allocation, and evaluating public health policies. As mobile phone access and ownership become more common globally, mobile phone surveys (MPSs) offer an opportunity to supplement traditional public health household surveys.ObjectiveThe objective of this study was to systematically review the current landscape of MPSs to collect population-level estimates in low- and middle-income countries (LMICs).MethodsPrimary and gray literature from 7 online databases were systematically searched for studies that deployed MPSs to collect population-level estimates. Titles and abstracts were screened on primary inclusion and exclusion criteria by two research assistants. Articles that met primary screening requirements were read in full and screened for secondary eligibility criteria. Articles included in review were grouped into the following three categories by their survey modality: (1) interactive voice response (IVR), (2) short message service (SMS), and (3) human operator or computer-assisted telephone interviews (CATI). Data were abstracted by two research assistants. The conduct and reporting of the review conformed to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement.ResultsA total of 6625 articles were identified through the literature review. Overall, 11 articles were identified that contained 19 MPS (CATI, IVR, or SMS) surveys to collect population-level estimates across a range of topics. MPSs were used in Latin America (n=8), the Middle East (n=1), South Asia (n=2), and sub-Saharan Africa (n=8). Nine articles presented results for 10 CATI surveys (10/19, 53%). Two articles discussed the findings of 6 IVR surveys (6/19, 32%). Three SMS surveys were identified from 2 articles (3/19, 16%). Approximately 63% (12/19) of MPS were delivered to mobile phone numbers collected from previously administered household surveys. The majority of MPS (11/19, 58%) were panel surveys where a cohort of participants, who often were provided a mobile phone upon a face-to-face enrollment, were surveyed multiple times.ConclusionsVery few reports of population-level MPS were identified. Of the MPS that were identified, the majority of surveys were conducted using CATI. Due to the limited number of identified IVR and SMS surveys, the relative advantages and disadvantages among the three survey modalities cannot be adequately assessed. The majority of MPS were sent to mobile phone numbers that were collected from a previously administered household survey. There is limited evidence on whether a random digit dialing (RDD) approach or a simple random sample of mobile network provided list of numbers can produce a population representative survey.

Project description:To evaluate the impact on the prevalence changes of risk factors for chronic diseases, published in the Surveillance System of Risk and Protection Factors for Chronic Diseases by Telephone Survey (Vigitel), after the inclusion of data from the population only with mobile phone.Our study used data from the 26 State capitals and Federal District of Brazil obtained by the National Survey on Health (PNS) and Vigitel, both held in 2013. In each capital, we added a subsample of 200 adults living in households with only mobile phones, extracted from PNS, to the Vigitel 2013 database, with approximately 1,900 households, named Vigitel dual frame.Vigitel results showed absolute relative biases between 0.18% and 14.85%. The system underestimated the frequency of adult smokers (10.77%), whole milk consumption (52.82%), and soft drink consumption (22.22%). Additionally, it overestimated the prevalence of hypertension (25.46%). In the simulations using Vigitel dual frame, with inclusion of the sample of adults living in households with only mobile phones, the bias of estimates was reduced in five out of eight analyzed indicators, with greater effects in regions with lower rates of landline coverage. In comparing regions, we observed negative correlation (ρ = -0.91) between the percentage of indicators with presence of bias and the percentage of households with only mobile phone.The results of this study indicate the benefits of including a subsample of 200 adults with only mobile phone on the Vigitel sample, especially in the capitals of the North and Northeast regions.Avaliar o impacto nas mudanças das prevalências de fatores de risco de doenças crônicas, divulgadas no Vigitel, após a inclusão de dados provenientes da população com somente telefone celular.O estudo utilizou os dados das capitais obtidos da Pesquisa Nacional de Saúde e do Vigitel, que foram realizados em 2013. Em cada capital, acrescentou-se uma subamostra de 200 adultos residentes em domicílios com somente celular, extraída da PNS, à base de dados do Vigitel 2013, com aproximadamente 1.900 domicílios, denominado Vigitel cadastro duplo.Os resultados do Vigitel mostraram vícios relativos absolutos entre 0,18% e 14,85%. O sistema subestimou a frequência de adultos fumantes (10,77%), o consumo de leite com teor integral de gordura (52,82%) e o consumo de refrigerante (22,22%). Adicionalmente, superestimou a prevalência de hipertensão (25,46%). Nas simulações utilizando o Vigitel cadastro duplo, com inclusão da amostra de adultos residentes em domicílios com somente celular, o vício das estimativas foi reduzido em cinco de oito indicadores analisados, com maiores efeitos nas regiões com menores taxas de cobertura de telefonia fixa. Na comparação entre as regiões, observa-se correlação negativa (ρ = -0,91) entre o percentual de indicadores com presença de vício e o percentual de cobertura de domicílios com somente celular.Os resultados do presente estudo indicam os benefícios da inclusão de uma subamostra de 200 adultos com somente celular na amostra do Vigitel, especialmente nas capitais das regiões Norte e Nordeste.

Dataset Information

Does mobile phone survey method matter? Reliability of computer-assisted telephone interviews and interactive voice response non-communicable diseases risk factor surveys in low and middle income countries.

Publications

Does mobile phone survey method matter? Reliability of computer-assisted telephone interviews and interactive voice response non-communicable diseases risk factor surveys in low and middle income countries.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets