Dataset Information

Evaluating an app-guided self-test for influenza: lessons learned for improving the feasibility of study designs to evaluate self-tests for respiratory viruses.

ABSTRACT:

Background

Seasonal influenza leads to significant morbidity and mortality. Rapid self-tests could improve access to influenza testing in community settings. We aimed to evaluate the diagnostic accuracy of a mobile app-guided influenza rapid self-test for adults with influenza like illness (ILI), and identify optimal methods for conducting accuracy studies for home-based assays for influenza and other respiratory viruses.

Methods

This cross-sectional study recruited adults who self-reported ILI online. Participants downloaded a mobile app, which guided them through two low nasal swab self-samples. Participants tested the index swab using a lateral flow assay. Test accuracy results were compared to the reference swab tested in a research laboratory for influenza A/B using a molecular assay.

Results

Analysis included 739 participants, 80% were 25-64 years of age, 79% female, and 73% white. Influenza positivity was 5.9% based on the laboratory reference test. Of those who started their test, 92% reported a self-test result. The sensitivity and specificity of participants' interpretation of the test result compared to the laboratory reference standard were 14% (95%CI 5-28%) and 90% (95%CI 87-92%), respectively.

Conclusions

A mobile app facilitated study procedures to determine the accuracy of a home based test for influenza, however, test sensitivity was low. Recruiting individuals outside clinical settings who self-report ILI symptoms may lead to lower rates of influenza and/or less severe disease. Earlier identification of study subjects within 48 h of symptom onset through inclusion criteria and rapid shipping of tests or pre-positioning tests is needed to allow self-testing earlier in the course of illness, when viral load is higher.

SUBMITTER: Zigman Suchsland ML

PROVIDER: S-EPMC8240430 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Depression and anxiety is a major public health problem, in Sweden and internationally. Internet-based interventions are increasingly acknowledged as promising approaches for individuals with varying degrees of mental health problems. We present findings from the implementation of myCompass, a fully automated self-guided intervention of Australian origin, in a Swedish context. METHODS:We (i) share our experience of the E-health study platform (i.e., regarding security aspects, functionality) to which the myCompass intervention was linked, and (ii) report findings from the empirical evaluation of myCompass (i.e., prerequisites, execution, study outcomes), in a community sample of individuals (N?=?837) reporting mild-to-moderate levels of depression, anxiety and stress. Outcomes were calculated with repeated measures ANOVA and linear mixed models. RESULTS:The E-health study platform proved to be an efficient tool enabling randomization, informed consent and evaluation to be administered in a fully automated manner. The study rendered substantial interest initially with 1207 individuals enrolling, however it failed to maintain engagement of those enrolled with only few participants logging in more than once or twice following registration. A smaller subgroup of "active users" (n?=?35) had a markedly higher activity in the program, however their treatment results were not significantly better than those of the control group. CONCLUSION:Based on the large number of dropouts and also modest use of the intervention overall, only tentative speculations can be made regarding its effectiveness in a Swedish context. The number of individuals remaining active in the intervention is much more limited that the number of individuals initially signing up. Moreover, the transportation of interventions across countries and cultures may need more careful consideration, and pilot-trials before attempting large-scale trials are recommended. TRIAL REGISTRATION:MyCompass was retrospectively registered at ClinicalTrials.gov . NCT03659630 September 3rd 2018, and was given the protocol ID 2015/1268-31/2?+?2016/88.

Project description:BACKGROUND:To develop effective and sustainable simulation training programs in low-resource settings, it is critical that facilitators are thoroughly trained in debriefing, a critical component of simulation learning. However, large knowledge gaps exist regarding the best way to train and evaluate debrief facilitators in low-resource settings. METHODS:Using a mixed methods approach, this study explored the feasibility of evaluating the debriefing skills of nurse mentors in Bihar, India. Videos of obstetric and neonatal post-simulation debriefs were assessed using two known tools: the Center for Advanced Pediatric and Perinatal Education (CAPE) tool and Debriefing Assessment for Simulation in Healthcare (DASH). Video data was used to evaluate interrater reliability and changes in debriefing performance over time. Additionally, twenty semi-structured interviews with nurse mentors explored perceived barriers and enablers of debriefing in Bihar. RESULTS:A total of 73 debriefing videos, averaging 18?min each, were analyzed by two raters. The CAPE tool demonstrated higher interrater reliability than the DASH; 13 of 16 CAPE indicators and two of six DASH indicators were judged reliable (ICC >?0.6 or kappa >?0.40). All indicators remained stable or improved over time. The number of 'instructors questions,' the amount of 'trainee responses,' and the ability to 'organize the debrief' improved significantly over time (p?<?0.01, p?<?0.01, p?=?0.04). Barriers included fear of making mistakes, time constraints, and technical challenges. Enablers included creating a safe learning environment, using contextually appropriate debriefing strategies, and team building. Overall, nurse mentors believed that debriefing was a vital aspect of simulation-based training. CONCLUSION:Simulation debriefing and evaluation was feasible among nurse mentors in Bihar. Results demonstrated that the CAPE demonstrated higher interrater reliability than the DASH and that nurse mentors were able to maintain or improve their debriefing skills overtime. Further, debriefing was considered to be critical to the success of the simulation training. However, fear of making mistakes and logistical challenges must be addressed to maximize learning. Teamwork, adaptability, and building a safe learning environment enhanced the quality enhanced the quality of simulation-based training, which could ultimately help to improve maternal and neonatal health outcomes in Bihar.

Project description:Introduction"Big data" - including linked administrative data - can be exploited to evaluate interventions for maternal and child health, providing time- and cost-effective alternatives to randomised controlled trials. However, using these data to evaluate population-level interventions can be challenging.ObjectivesWe aimed to inform future evaluations of complex interventions by describing sources of bias, lessons learned, and suggestions for improvements, based on two observational studies using linked administrative data from health, education and social care sectors to evaluate the Family Nurse Partnership (FNP) in England and Scotland.MethodsWe first considered how different sources of potential bias within the administrative data could affect results of the evaluations. We explored how each study design addressed these sources of bias using maternal confounders captured in the data. We then determined what additional information could be captured at each step of the complex intervention to enable analysts to minimise bias and maximise comparability between intervention and usual care groups, so that any observed differences can be attributed to the intervention.ResultsLessons learned include the need for i) detailed data on intervention activity (dates/geography) and usual care; ii) improved information on data linkage quality to accurately characterise control groups; iii) more efficient provision of linked data to ensure timeliness of results; iv) better measurement of confounding characteristics affecting who is eligible, approached and enrolled.ConclusionsLinked administrative data are a valuable resource for evaluations of the FNP national programme and other complex population-level interventions. However, information on local programme delivery and usual care are required to account for biases that characterise those who receive the intervention, and to inform understanding of mechanisms of effect. National, ongoing, robust evaluations of complex public health evaluations would be more achievable if programme implementation was integrated with improved national and local data collection, and robust quasi-experimental designs.

Project description:BackgroundMalaria is a major public health problem in Uganda and the current policy recommends introduction of rapid diagnostic tests for malaria (RDTs) to facilitate effective case management. However, provision of RDTs in drug shops potentially raises a new set of issues, such as adherence to RDTs results, management of severe illnesses, referral of patients, and relationship with caretakers. The main objective of the study was to examine the impact of introducing RDTs in registered drug shops in Uganda and document lessons and policy implications for future scale-up of malaria control in the private health sector.MethodsA cluster-randomized trial introducing RDTs into registered drug shops was implemented in central Uganda from October 2010 to July 2012. An evaluation was undertaken to assess the impact and the processes involved with the introduction of RDTs into drug shops, the lessons learned and policy implications.ResultsIntroducing RDTs into drug shops was feasible. To scale-up this intervention however, drug shop practices need to be regulated since the registration process was not clear, supervision was inadequate and record keeping was poor. Although initially it was anticipated that introducing a new practice of record keeping would be cumbersome, but at evaluation this was not found to be a constraint. This presents an important lesson for introducing health management information system into drug shops. Involving stakeholders, especially the district health team, in the design was important for ownership and sustainability. The involvement of village health teams in community sensitization to the new malaria treatment and diagnosis policy was a success and this strategy is recommended for future interventions.ConclusionIntroducing RDTs into drug shops was feasible and it increased appropriate treatment of malaria with artemisinin-based combination therapy. It is anticipated that the lessons presented will help better implementation of similar interventions in the private sector.