Dataset Information

Methodological Challenges in Randomized Controlled Trials on Smartphone-Based Treatment in Psychiatry: Systematic Review.

ABSTRACT:

Background

Smartphone-based technology is developing at high speed, and many apps offer potential new ways of monitoring and treating a range of psychiatric disorders and symptoms. However, the effects of most available apps have not been scientifically investigated. Within medicine, randomized controlled trials (RCTs) are the standard method for providing the evidence of effects. However, their rigidity and long time frame may contrast with the field of information technology research. Therefore, a systematic review of methodological challenges in designing and conducting RCTs within mobile health is needed.

Objective

This systematic review aimed to (1) identify and describe RCTs investigating the effect of smartphone-based treatment in adult patients with a psychiatric diagnosis, (2) discuss methodological challenges in designing and conducting individual trials, and (3) suggest recommendations for future trials.

Methods

A systematic search in English was conducted in PubMed, PsycINFO, and EMBASE up to August 12, 2019. The search terms were (1) psychiatric disorders in broad term and for specific disorders AND (2) smartphone or app AND (3) RCT. The Consolidated Standards of Reporting Trials electronic health guidelines were used as a template for data extraction. The focus was on trial design, method, and reporting. Only trials having sufficient information on diagnosis and acceptable diagnostic procedures, having a smartphone as a central part of treatment, and using an RCT design were included.

Results

A total of 27 trials comprising 3312 patients within a range of psychiatric diagnoses were included. Among them, 2 trials were concerning drug or alcohol abuse, 3 psychosis, 10 affective disorders, 9 anxiety and posttraumatic stress disorder, 1 eating disorder, and 1 attention-deficit/hyperactivity disorder. In addition, 1 trial used a cross-diagnostic design, 7 trials included patients with a clinical diagnosis that was subsequently assessed and validated by the researchers, and 11 trials had a sample size above 100. Generally, large between-trial heterogeneity and multiple approaches to patient recruitment, diagnostic procedures, trial design, comparator, outcome measures, and analyses were identified. Only 5 trials published a trial protocol. Furthermore, 1 trial provided information regarding technological updates, and only 18 trials reported on the conflicts of interest. No trial addressed the ethical aspects of using smartphones in treatment.

Conclusions

This first systematic review of the methodological challenges in designing and conducting RCTs investigating smartphone-based treatment in psychiatric patients suggests an increasing number of trials but with a lower quality compared with classic medical RCTs. Heterogeneity and methodological issues in individual trials limit the evidence. Methodological recommendations are presented.

SUBMITTER: Tonning ML

PROVIDER: S-EPMC6914239 | biostudies-literature | 2019 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Methodological Challenges in Randomized Controlled Trials on Smartphone-Based Treatment in Psychiatry: Systematic Review.

Tønning Morten Lindbjerg ML Kessing Lars Vedel LV Bardram Jakob Eivind JE Faurholt-Jepsen Maria M

Journal of medical Internet research 20191027 10

<h4>Background</h4>Smartphone-based technology is developing at high speed, and many apps offer potential new ways of monitoring and treating a range of psychiatric disorders and symptoms. However, the effects of most available apps have not been scientifically investigated. Within medicine, randomized controlled trials (RCTs) are the standard method for providing the evidence of effects. However, their rigidity and long time frame may contrast with the field of information technology research. ...[more]

PMID: 31663859

Similar Datasets

Project description:BackgroundClinical significance in a randomized controlled trial (RCT) can be determined using the minimal clinically important difference (MCID), which should inform the delta value used to determine sample size. The primary objective was to assess clinical significance in the pediatric oncology randomized controlled trial (RCT) treatment literature by evaluating: (1) the relationship between the treatment effect and the delta value as reported in the sample size calculation, and (2) the concordance between statistical and clinical significance. The secondary objective was to evaluate the reporting of methodological attributes related to clinical significance.MethodsRCTs of pediatric cancer treatments, where a sample size calculation with a delta value was reported or could be calculated, were systematically reviewed. MEDLINE, EMBASE, and the Cochrane Childhood Cancer Group Specialized Register through CENTRAL were searched from inception to July 2016.ResultsRCTs (77 overall; 11 and 66), representing 95 (13 and 82) randomized questions were included for non-inferiority and superiority RCTs (herein, respectively). The minority (22.1% overall; 76.9 and 13.4%) of randomized questions reported conclusions based on clinical significance, and only 4.2% (15.4 and 2.4%) explicitly based the delta value on the MCID. Over half (67.4% overall; 92.3 and 63.4%) reported a confidence interval or standard error for the primary outcome experimental and control values and 12.6% (46.2 and 7.3%) reported the treatment effect, respectively. Of the 47 randomized questions in superiority trials that reported statistically non-significant findings, 25.5% were possibly clinically significant. Of the 24 randomized questions in superiority trials that were statistically significant, only 8.3% were definitely clinically significant.ConclusionsA minority of RCTs in the pediatric oncology literature reported methodological attributes related to clinical significance and a notable portion of statistically insignificant studies were possibly clinically significance.

Project description:Osteopathic manipulative treatment (OMT) is a distinctive modality commonly used by osteopathic physicians to complement their conventional treatment of musculoskeletal disorders. Previous reviews and meta-analyses of spinal manipulation for low back pain have not specifically addressed OMT and generally have focused on spinal manipulation as an alternative to conventional treatment. The purpose of this study was to assess the efficacy of OMT as a complementary treatment for low back pain.Computerized bibliographic searches of MEDLINE, EMBASE, MANTIS, OSTMED, and the Cochrane Central Register of Controlled Trials were supplemented with additional database and manual searches of the literature. Six trials, involving eight OMT vs control treatment comparisons, were included because they were randomized controlled trials of OMT that involved blinded assessment of low back pain in ambulatory settings. Data on trial methodology, OMT and control treatments, and low back pain outcomes were abstracted by two independent reviewers. Effect sizes were computed using Cohen's d statistic and meta-analysis results were weighted by the inverse variance of individual comparisons. In addition to the overall meta-analysis, stratified meta-analyses were performed according to control treatment, country where the trial was conducted, and duration of follow-up. Sensitivity analyses were performed for both the overall and stratified meta-analyses.Overall, OMT significantly reduced low back pain (effect size, -0.30; 95% confidence interval, -0.47 - -0.13; P = .001). Stratified analyses demonstrated significant pain reductions in trials of OMT vs active treatment or placebo control and OMT vs no treatment control. There were significant pain reductions with OMT regardless of whether trials were performed in the United Kingdom or the United States. Significant pain reductions were also observed during short-, intermediate-, and long-term follow-up.OMT significantly reduces low back pain. The level of pain reduction is greater than expected from placebo effects alone and persists for at least three months. Additional research is warranted to elucidate mechanistically how OMT exerts its effects, to determine if OMT benefits are long lasting, and to assess the cost-effectiveness of OMT as a complementary treatment for low back pain.

Project description:BackgroundThis systematic review evaluated the effectiveness of process interventions (education for clinicians, parent presence, education of parents [before and on day of vaccination], and education of patients on day of vaccination) on reducing vaccination pain, fear, and distress and increasing the use of interventions during vaccination.Design/methodsDatabases were searched using a broad search strategy to identify relevant randomized and quasi-randomized controlled trials. Critical outcomes were pain, fear, distress (when applicable), and use of pain management interventions. Data were extracted according to procedure phase (preprocedure, acute, recovery, combinations of these) and pooled using established methods. Analyses were conducted using standardized mean differences (SMD) and risk ratios (RR).ResultsThirteen studies were included. Results were generally mixed. On the basis of low to very low-quality evidence, the following specific critical outcomes showed significant effects suggesting: (1) clinicians should be educated about vaccine injection pain management (use of interventions: SMD 0.66; 95% confidence interval [CI]: 0.47, 0.85); (2) parents should be present (distress preprocedure: SMD -0.85; 95% CI: -1.35, -0.35); (3) parents should be educated before the vaccination day (use of intervention preprocedure: SMD 0.83; 95% CI: 0.25, 1.41 and RR, 2.08; 95% CI: 1.51, 2.86; distress acute: SMD, -0.35; 95% CI: -0.57, -0.13); (4) parents should be educated on the vaccination day (use of interventions: SMD 1.02; 95% CI: 0.22, 1.83 and RR, 2.42; 95% CI: 1.47, 3.99; distress preprocedure+acute+recovery: SMD -0.48; 95% CI: -0.82, -0.15); and (5) individuals 3 years of age and above should be educated on the day of vaccination (fear preprocedure: SMD -0.67; 95% CI: -1.28, -0.07).ConclusionsEducating individuals involved in the vaccination procedure (clinicians, parents of children being vaccinated; individuals above 3 y of age) is beneficial to increase use of pain management strategies, reduce distress surrounding with vaccination, and to reduce fear. When possible, parent presence is also recommended for children undergoing vaccination.

Dataset Information

Methodological Challenges in Randomized Controlled Trials on Smartphone-Based Treatment in Psychiatry: Systematic Review.

Background

Objective

Methods

Results

Conclusions

Publications

Methodological Challenges in Randomized Controlled Trials on Smartphone-Based Treatment in Psychiatry: Systematic Review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets