Dataset Information

Usability and acceptability of four systematic review automation software packages: a mixed method design.

ABSTRACT:

Aim

New software packages help to improve the efficiency of conducting a systematic review through automation of key steps in the systematic review. The aim of this study was to gather qualitative data on the usability and acceptability of four systematic review automation software packages (Covidence, SRA-Helper for EndNote, Rayyan and RobotAnalyst) for the citation screening step of a systematic review.

Methods

We recruited three volunteer systematic reviewers and asked them to use allocated software packages during citation screening. They then completed a 12-item online questionnaire which was tailored to capture data for the software packages used.

Findings

All four software packages were reported to be easy or very easy to learn and use. SRA-Helper for EndNote was most favoured by participants for screening citations and Covidence for resolving conflicts. Overall, participants reported that SRA-Helper for EndNote would be their software package of choice, primarily due to its efficiency.

Conclusion

This study identified a number of considerations which systematic reviewers can use as a basis of their decision which software to use when performing the citation screening and dispute resolution steps of a systematic review.

SUBMITTER: Cleo G

PROVIDER: S-EPMC6587262 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Usability and acceptability of four systematic review automation software packages: a mixed method design.

Cleo Gina G Scott Anna Mae AM Islam Farhana F Julien Blair B Beller Elaine E

Systematic reviews 20190620 1

<h4>Aim</h4>New software packages help to improve the efficiency of conducting a systematic review through automation of key steps in the systematic review. The aim of this study was to gather qualitative data on the usability and acceptability of four systematic review automation software packages (Covidence, SRA-Helper for EndNote, Rayyan and RobotAnalyst) for the citation screening step of a systematic review.<h4>Methods</h4>We recruited three volunteer systematic reviewers and asked them to ...[more]

PMID: 31221212

Similar Datasets

Project description:BackgroundAlthough research continues to support task-shifting as an effective model of delivering evidence-based practices (EBPs), little scholarship has focused how to scale up and sustain task-shifting in low- and middle-income countries, including how to sustainably supervise lay counselors. Ongoing supervision is critical to ensure EBPs are delivered with fidelity; however, the resources and expertise required to provide ongoing supervision may limit the potential to scale up and sustain task shifting. Opportunities may exist to leverage mobile technology to replace or supplement in-person supervision in low-resource contexts, but contextual variables, such as network connectivity and lay counselor preferences surrounding mobile technology, must be examined and considered when designing and implementing mobile technology supervision.MethodsThis study builds from an existing randomized trial in Kenya, wherein teachers and community health volunteers have been trained to provide trauma-focused cognitive behavioral therapy as lay counselors. The study will use an iterative and mixed methods approach, with qualitative interviews and a Human-Centered Design (HCD) workshop informing a non-randomized pilot trial. Semi-structured interviews will be conducted with lay counselors and supervisors to understand how mobile technology is currently being used for supervision and determine the barriers and facilitators to mobile technology supervision. Data from these interviews will inform an HCD workshop, where lay counselors and supervisors "re-design" supervision to most effectively leverage mobile technology. Workshop participants will also participate in focus groups to gather perceptions on the use of HCD techniques. The final outcome of the workshop will be a set of refined workflows, which will be tested in a mixed method, nonrandomized pilot with newly trained lay counselors and existing supervisors. The pilot trial will evaluate the acceptability, feasibility, and usability of mobile technology supervision through self-report questionnaires as well as perceptions of effectiveness through qualitative interviews with a subset of lay counselors and all supervisors.DiscussionThis study will provide a launching point for future research on supervision and methods to engage stakeholders to design and tailor interventions and implementation supports to fit low-resourced contexts.Trial registrationThe parent trial from which this study builds was registered on ClinicalTrials.gov on August 9, 2017 ( NCT03243396 ).

Project description:IntroductionOver 25% of Dutch young people are psychologically unhealthy. Individual and societal consequences that follow from having mental health complaints at this age are substantial. Young people need care which is often unavailable. ENgage YOung people earlY (ENYOY) is a moderated digital social therapy-platform that aims to help youngsters with emerging mental health complaints. Comprehensive research is being conducted into the effects and to optimize and implement the ENYOY-platform throughout the Netherlands. The aim of this study is to explore the usability and user experience of the ENYOY-platform.MethodsA user-centered mixed-method design was chosen. 26 young people aged 16-25 with emerging mental health complaints participated. Semi-structured interviews were conducted to explore usability, user-friendliness, impact, accessibility, inclusivity, and connection (Phase 1). Phase 2 assessed usability problems using the concurrent and retrospective Think Aloud-method. User experience and perceived helpfulness were assessed using a 10-point rating scale and semi-structured interviews (Phase 3). The Health Information Technology Usability Evaluation Scale (Health-ITUES; Phase 1) and System Usability Scale (SUS; Phase 2 and 3) were administered. Qualitative data was analyzed using thematic analysis. Task completion rate and time were tracked and usability problems were categorized using the Nielsen's rating scale (Phase 2).ResultsAdequate to high usability was found (Phase 1 Health-ITUES 4.0(0.34); Phase 2 SUS 69,5(13,70); Phase 3 SUS 71,6(5,63)). Findings from Phase 1 (N = 10) indicated that users viewed ENYOY as a user-friendly, safe, accessible, and inclusive initiative which helped them reduce their mental health complaints and improve quality of life. Phase 2 (N = 10) uncovered 18 usability problems of which 5 of major severity (e.g. troubles accessing the platform). Findings from Phase 3 (N = 6) suggested that users perceived the coaching calls the most helpful [9(0.71)] followed by the therapy content [6.25(1.41)]. Users liked the social networking aspect but rated it least helpful [6(2.1)] due to inactivity.ConclusionThe ENYOY-platform has been found to have adequate to high usability and positive user experiences were reported. All findings will be transferred to the developmental team to improve the platform. Other evaluation methods and paring these with quantitative outcomes could provide additional insight in future research.

Project description:BackgroundAs research on the use of mobile technology to deliver mental health support grows, the research from China is still very limited. How to design an acceptable and usable mobile mental health service model suitable for China's social and cultural environment remains to be studied.ObjectiveTo understand the acceptability and usability of a WeChat-based intervention among Chinese patients with depression, and to provide insights to promote future development of user-centered mobile mental health services design.MethodsThe research team developed a multi-theoretical intervention that includes seven modules: recovery lessons, recovery journal, coaching sessions, mindfulness, personalized support, regular assessments and feedback collection. Forty-two patients diagnosed with depressive disorder were recruited, with a mixed sample of patients who were using an antidepressant medication (n = 29) and patients who were not using an antidepressant medication (n = 13). A single-arm mixed-methods study was conducted to understand engagement, satisfaction, usability and potential clinical effectiveness of the intervention.ResultsThere was a retention rate of 83.33% - 22 participants who used an antidepressant medication and 13 participants who did not use an antidepressant medication completed the final assessments. The median (upper quartile-lower quartile) of the completed 60 recovery journals and 7 coaching sessions was 56 (59-46) and 6 (7-4) times, respectively. Participants' satisfaction regarding their recovery progress, and on perceived helpfulness on different modules were high. The overall score of the user version of the Mobile Application Rating Scale was 4.23 (SD 0.44, range 1-5), indicating high acceptability and usability. Qualitative feedback identified three key themes: an efficient access to professional help, a personalized source of social support, and a facilitator of cognitive and behavioral change.ConclusionsThis study demonstrated that a WeChat-based intervention for depression was acceptable, and has the potential to promote personal recovery. More studies are needed to understand the efficacy and implementation of this model in real world.

Project description:BACKGROUND:Taxation of sugar-sweetened beverages (SSBs), as a component of a comprehensive strategy, has emerged as an apparent effective intervention to counteract the rising prevalence of overweight and obesity. Insight into the political and public acceptability may help adoption and implementation in countries with governments that are considering an SSBs tax. Hence, we aimed to conduct a systematic review and meta-analysis to synthesize the existing qualitative and quantitative literature on political and public acceptability of an SSBs tax. METHODS:Four electronic databases (PubMed, Embase, Scopus, Web of Science) were searched until November 2018. The methodological quality of the included studies was assessed using the Mixed Methods Appraisal Tool. Qualitative studies were analyzed using a thematic synthesis. Quantitative studies were analyzed using a random-effects meta-analysis for the pooling of proportions. RESULTS:Thirty-seven articles reporting on forty studies were eligible for inclusion. Five themes derived from the thematic synthesis: (i) beliefs about effectiveness and cost-effectiveness, (ii) appropriateness, (iii) economic and socioeconomic benefit, (iv) policy adoption and implementation, and (v) public mistrust of the industry, government and public health experts. Results of the meta-analysis indicated that of the public 42% (95% CI?=?0.38-0.47) supports an SSBs tax, 39% (0.29-0.50) supports an SSBs tax as a strategy to reduce obesity, and 66% (0.60-0.72) supports an SSBs tax if revenue is used for health initiatives. CONCLUSIONS:Beliefs about effectiveness and cost-effectiveness, appropriateness, economic and socioeconomic benefit, policy adoption and implementation, and public mistrust of the industry, government and public health experts have important implications for the political and public acceptability of an SSBs tax. We provide recommendations to increase acceptability and enhance successful adoption and implementation of an SSBs tax: (i) address inconsistencies between identified beliefs and scientific literature, (ii) use raised revenue for health initiatives, (iii) communicate transparently about the true purpose of the tax, and (iv) generate political priority for solutions to the challenges to implementation.

Dataset Information

Usability and acceptability of four systematic review automation software packages: a mixed method design.

Aim

Methods

Findings

Conclusion

Publications

Usability and acceptability of four systematic review automation software packages: a mixed method design.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets