Dataset Information

Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project.

ABSTRACT: OBJECTIVE:To test the reliability, validity, acceptability, and practicality of short message service (SMS) messaging for collection of research data. MATERIALS AND METHODS:The studies were carried out in a cohort of recently delivered women in Tayside, Scotland, UK, who were asked about their current infant feeding method and future feeding plans. Reliability was assessed by comparison of their responses to two SMS messages sent 1 day apart. Validity was assessed by comparison of their responses to text questions and the same question administered by phone 1 day later, by comparison with the same data collected from other sources, and by correlation with other related measures. Acceptability was evaluated using quantitative and qualitative questions, and practicality by analysis of a researcher log. RESULTS:Reliability of the factual SMS message gave perfect agreement. Reliabilities for the numerical question were reasonable, with ? between 0.76 (95% CI 0.56 to 0.96) and 0.80 (95% CI 0.59 to 1.00). Validity for data compared with that collected by phone within 24 h (? =0.92 (95% CI 0.84 to 1.00)) and with health visitor data (? =0.85 (95% CI 0.73 to 0.97)) was excellent. Correlation validity between the text responses and other related demographic and clinical measures was as expected. Participants found the method a convenient and acceptable way of providing data. For researchers, SMS text messaging provided an easy and functional method of gathering a large volume of data. CONCLUSION:In this sample and for these questions, SMS was a reliable and valid method for capturing research data.

SUBMITTER: Whitford HM

PROVIDER: S-EPMC3422836 | biostudies-literature | 2012 Sep-Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project.

Whitford Heather M HM Donnan Peter T PT Symon Andrew G AG Kellett Gillian G Monteith-Hodge Ewa E Rauchhaus Petra P Wyatt Jeremy C JC

Journal of the American Medical Informatics Association : JAMIA 20120426 5

<h4>Objective</h4>To test the reliability, validity, acceptability, and practicality of short message service (SMS) messaging for collection of research data.<h4>Materials and methods</h4>The studies were carried out in a cohort of recently delivered women in Tayside, Scotland, UK, who were asked about their current infant feeding method and future feeding plans. Reliability was assessed by comparison of their responses to two SMS messages sent 1 day apart. Validity was assessed by comparison of ...[more]

PMID: 22539081

Similar Datasets

Project description:BackgroundMobile health technologies can be useful for providing disease self-management information and support to people with inflammatory bowel disease (IBD).ObjectiveThe aim of this study was to test a self-management SMS text messaging intervention for people with IBD. Our goal was to examine intervention feasibility, acceptability, and engagement and to preliminarily evaluate improvements in certain self-reported health outcomes among participants.MethodsWe developed an SMS text messaging program called Text4IBD. The program sent daily support messages and resources about disease self-management over the course of a 2-week, single-group, pretest-posttest intervention to participants (N=114) diagnosed with IBD. We examined intervention feasibility, acceptability, and engagement through Text4IBD message topic recall and use of resources (ie, visiting supplemental websites recommended by the Text4IBD program). We also assessed pretest-posttest measures of IBD-related distress, self-efficacy, perceived support, use of coping strategies, and medication adherence. Analyses examined participants' evaluations of the intervention and compared pretest-posttest changes in secondary outcomes using paired-samples statistics.ResultsApproximately all participants who completed the intervention (n=105) were receptive to Text4IBD and viewed the program as feasible and acceptable. In addition, most participants (103/105, 98.1%) recalled at least one of the message topics sent by the program, and 79% (83/105) of them self-reported engaging with at least one of the external self-management resources recommended by the Text4IBD program. Pretest-posttest results showed reduced IBD-related distress (mean 3.33, SD 0.68 vs mean 2.86, SD 0.73; P<.001) and improvements in most other secondary outcomes.ConclusionsFindings from this study highlight the value of SMS text messaging as a useful digital medium for providing support to people with IBD, particularly to those who may struggle with disease-related distress. Text4IBD was highly feasible and acceptable and may help people self-manage their IBD. Future studies should aim to evaluate this program in a randomized controlled trial in clinical settings.

Project description:BackgroundRapid weight gain and overweight in infancy are associated with childhood obesity. Thus, effective, accessible interventions to promote healthy infant feeding practices to prevent early obesity are essential.MethodsThis mixed-methods study involved diverse parents of infants in an urban, low-income pediatric clinic. Qualitative interviews explored parental attitudes towards feeding, early obesity, and communication with the pediatrician. A pilot, randomized controlled trial (RCT) informed by feedback provided by clinic parents compared text messages delivered for 12 months promoting healthy feeding practices to usual care to prevent early pediatric obesity. A computer-generated randomization schedule with balanced distribution for sex was used to place infants into groups. Weight-for-length percentiles and z-scores and feeding practices were measured at 0-2 weeks (baseline), 2-4 months, 6-9 months, and 12 months. Interviews were recorded, transcribed, and coded using thematic analysis. Weight for length percentile, Weight for length z scores, and feeding practices were compared between groups using repeated measures mixed analysis of variance (ANOVA).ResultsParticipants in the interviews were 15 parents of infants less than 1 month old. RCT participants were 38 parents of newborns (17 control; 21 intervention). Most parents in the qualitative evaluation viewed breastfeeding positively but also discussed barriers. Most also wanted practical information regarding infant feeding. There were no differences in weight-for-length percentile (F=0.52; P=0.60) or z-scores (F=0.7922; P=0.79), breastfeeding persistence χ2[1] =1.45, P=0.23, or age of introduction of solids in the intervention (statistical analysis not possible due to low counts) compared to the control group; however, low response to surveys limited the study's power.ConclusionsText messaging has potential to extend the healthcare provider's communication beyond clinic. However, texting interventions should be flexible to mitigate barriers such as loss of phone service and challenges customizing messages to parent needs.

Project description:IntroductionTraditional methods for obtaining outcomes for patients after acute stroke are resource-intensive. This study aimed to examine the feasibility, reliability, cost, and acceptability of collecting outcomes after acute stroke with a short message service (SMS)-text messaging program.MethodsPatients were enrolled in an SMS-text messaging program at acute stroke hospitalization discharge. Participants were prompted to complete assessments including the modified Rankin scale (mRS) and Patient-Reported Outcomes Measurement (PROM) Information System Global-10 at 30, 60, and 90 days postdischarge via SMS-text. Agreement and cost of SMS-text data collection were compared to those obtained from traditional follow-up methods (via phone or in the clinic). Participant satisfaction was surveyed upon program conclusion.ResultsOf the 350 patients who agreed to receive SMS texts, 40.5% responded to one or more assessments. Assessment responders were more likely to have English listed as their preferred language (p = 0.009), have a shorter length of hospital stay (p = 0.01), lower NIH stroke scale upon admission (p < 0.001), and be discharged home (p < 0.001) as compared to nonresponders. Weighted Cohen's kappa revealed that the agreement between SMS texting and traditional methods was almost perfect for dichotomized (good vs. poor) (κ = 0.8) and ordinal levels of the mRS score (κ = 0.8). Polychoric correlations revealed a significant association for PROM scores ( ρ = 0.4, p < 0.01 and ρ = 0.4, p < 0.01). A cost equation showed that gathering outcomes via SMS texting would be less costly than phone follow-up for cohorts with more than 181 patients. Nearly all participants (91%) found the program acceptable and not burdensome (94%), and most (53%) felt it was helpful. Poststroke outcome data collection via SMS texting is feasible, reliable, low-cost, and acceptable. Reliability was higher for functional outcomes as compared to PROMs.ConclusionsWhile further validation is required, our findings suggest that SMS texting is a feasible method for gathering outcomes after stroke at scale to evaluate the efficacy of acute stroke treatments.

Project description:BackgroundMobile health strategies for smoking cessation (eg, SMS text messaging-based interventions) have been shown to be effective in helping smokers quit. However, further research is needed to better understand user experiences with these platforms.ObjectiveThis qualitative study aims to explore the experiences of real-world users of a publicly available smoking cessation program (SmokefreeTXT).MethodsSemistructured phone interviews were conducted with 36 SmokefreeTXT users between March and July 2014. Of these 36 participants, 50% (18/36) of participants completed the SmokefreeTXT program (ie, did not opt out of the program before the 6- to 8-week completion period), and 50% (18/36) did not complete the program (ie, requested to opt out of the program before the completion period). Interview questions focused on smoking behaviors, quitting history, opinions on the program's content and structure, answering assessment questions, using keywords, reasons for opting out, and perceived usefulness of the program for quitting smoking. A thematic content analysis was conducted, with a focus on themes to increase program engagement and optimization.ResultsThe findings highlighted features of the program that participants found beneficial, as well as some elements that showed opportunities for improvement to boost program retention and successful cessation. Specifically, most participants found the SmokefreeTXT program to be convenient and supportive of cessation; however, some found the messages to be repetitive and reported a desire for more flexibility based on their readiness to quit and cessation progress. We also found that program completion did not necessarily indicate successful smoking cessation and that program opt out, which might be interpreted as a less positive outcome, may occur because of successful cessation. Finally, several participants reported using SmokefreeTXT together with other evidence-based cessation methods or non-evidence-based strategies.ConclusionsQualitative interviews with real-world SmokefreeTXT users showed high program acceptability, engagement with program features, and perceived utility for smoking cessation. Our findings directly informed several program updates, such as adding an adaptive quit date feature and offering supplemental information on live support services for users who prefer human interaction during the cessation process. The study has implications for other digital tobacco cessation interventions and highlights important topics that warrant future research, such as the relationship between program engagement (eg, opt out and retention) and successful cessation.

Project description:Interventions to support people with hypertension in attending clinics and taking their medication have potential to improve outcomes, but delivery on a wide scale and at low cost is challenging. Some trials evaluating clinical interventions using short message service (SMS) text-messaging systems have shown important outcomes, although evidence is limited. We have developed a novel SMS system integrated with clinical care for use by people with hypertension in a low-resource setting. We aim to test the efficacy of the system in improving blood pressure control and treatment adherence compared to usual care.The SMS Text-message Adherence suppoRt trial (StAR) is a pragmatic individually randomised three-arm parallel group trial in adults treated for hypertension at a single primary care centre in Cape Town, South Africa. The intervention is a structured programme of clinic appointment, medication pick-up reminders, medication adherence support and hypertension-related education delivered remotely using an automated system with either informational or interactive SMS text-messages. Usual care is supplemented by infrequent non-hypertension related SMS text-messages. Participants are 1:1:1 individually randomised, to usual care or to one of the two active interventions using minimisation to dynamically adjust for gender, age, baseline systolic blood pressure, years with hypertension, and previous clinic attendance. The primary outcome is the change in mean systolic blood pressure at 12-month follow-up from baseline measured with research staff blinded to trial allocation. Secondary outcomes include the proportion of patients with 80% or more of days medication available, proportion of participants achieving a systolic blood pressure less than 140 mmHg and a diastolic blood pressure less than 90 mmHg, hospital admissions, health status, retention in clinical care, satisfaction with treatment and care, and patient related quality of life. Anonymised demographic data are collected on non-participants.The StAR trial uses a novel, low cost system based on widely available mobile phone technology to deliver the SMS-based intervention, manage communication with patients, and measure clinically relevant outcomes. The results will inform implementation and wider use of mobile phone based interventions for health care delivery in a low-resource setting.NCT02019823.

Project description:BackgroundLimited access to mental health care services due to provider shortages, geographic limitations, and cost has driven the area of mobile health (mHealth) care to address these access gaps. Reports from the Cohen Veterans Network and National Council for Behavioral Health show that in states where mental health care is more accessible, 38% of people still do not receive the care they need. mHealth strategies help to provide care to individuals experiencing these barriers at lower cost and greater convenience, making mHealth a great resource to bridge the gaps.ObjectiveWe present a mixed methods study to evaluate user experiences with the mental mHealth service, Cope Notes. Specifically, we aimed to investigate the following research questions: How do users perceive the service in relation to stigma, impact of the intervention, and perceived usefulness? How do users rate the Cope Notes service and SMS text messaging along various dimensions of acceptability? What is the relationship between Cope Notes SMS text message ratings, user personality, and coping strategies? What are user perspectives of leveraging ubiquitous sensing technologies to improve delivery and provide tailored content?MethodsWe performed qualitative interviews with Cope Notes users (N=14) who have used the service for at least 30 days to evaluate their experiences and usefulness of the service. These interviews were coded by 2 raters (SLK and JL), and the interrater reliability was calculated with SPSS (IBM Corp) at 61.8%. In addition, participants completed quantitative measures, including a user experiences survey, personality inventory (Big Five Inventory-10), and coping assessment (Brief Coping Orientation to Problems Experienced).ResultsWe derived 7 themes from our qualitative interviews: Likes or Perceived Benefits, Dislikes or Limitations, Suggested Changes, Stigma or Help Seeking, Perceptions of Ubiquitous Sensing, Cultural Sensitivity, and Alternative mHealth Resources. Exploratory analyses between acceptability ratings of Cope Notes and personality factors showed statistically significant positive relationships between seeing oneself as someone who is generally trusting and acceptability items, the most significant being item 7 (I fully understood the sentiment behind Cope Notes Messages) with (rs(10)=0.82, P=.001). We also found statistically significant relationships between acceptability and Brief Coping Orientation to Problems Experienced items, with the strongest positive correlation between participants strongly endorsing coping by accepting the reality that an event has happened and acceptability item 7 (rs(8)=0.86, P=.001).ConclusionsOur study found that Cope Notes subscribers appreciate the service for reframing their mental wellness with statistically significant correlations between personality and acceptability of the service. We found that some users prefer a more personalized experience with neutral to positive reactions to a potential companion app that continuously monitors user behavior via smartphone sensors to provide just-in-time interventions when users need it most.

Project description:BACKGROUND:Engagement in self-care behaviors that are essential to optimize diabetes care is challenging for many patients with diabetes. mHealth interventions have been shown to be effective in improving health care outcomes in diabetes. However, more research is needed on patient perceptions to support these interventions, especially in resource settings in low- and middle-income countries. OBJECTIVE:The goal of the research was to explore perceptions and acceptability of a short message service (SMS) text messaging intervention for diabetes care in underserved people with diabetes in Argentina. METHODS:A qualitative exploratory methodology was adopted as part of the evaluation of a program to strengthen diabetes services in primary care clinics located in low-resource settings. The diabetes program included a text messaging intervention for people with diabetes. A total of 24 semistructured telephone interviews were conducted with people with diabetes. RESULTS:Twenty-four middle-aged persons with diabetes were interviewed. Acceptability was considered adequate in terms of its actual use, frequency, and the role of texts as a reminder. We found that text messages could be a mediating device in the patient's learning processes. Also, being exposed to the texts seemed to help bring about changes in risk perception and care practices and to function as psychosocial support. Another relevant finding was the role of text messaging as a potential facilitator in diabetes care. In this sense, we observed a strong association between receiving text messages and having a better patient-physician relationship. Additionally, social barriers that affect diabetes care such as socioeconomic and psychosocial vulnerability were identified. CONCLUSIONS:Our findings show positive contributions of a text messaging intervention for the care of people with diabetes. We consider that an SMS strategy has potential to be replicated in other contexts. However, further studies are needed to explore its sustainability and long-term impact from the perspective of patients.

Dataset Information

Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project.

Publications

Evaluating the reliability, validity, acceptability, and practicality of SMS text messaging as a tool to collect research data: results from the Feeding Your Baby project.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets