Dataset Information

Practitioner review: Co-design of digital mental health technologies with children and young people.

ABSTRACT:

Background

There is increasing interest in digital technologies to help improve children and young people's mental health, and the evidence for the effectiveness for these approaches is rising. However, there is concern regarding levels of user engagement, uptake and adherence. Key guidance regarding digital health interventions stress the importance of early user input in the development, evaluation and implementation of technologies to help ensure they are engaging, feasible, acceptable and potentially effective. Co-design is a process of active involvement of stakeholders, requiring a change from the traditional approaches to intervention development. However, there is a lack of literature to inform the co-design of digital technologies to help child and adolescent mental health.

Methods

We reviewed the literature and practice in the co-design of digital mental health technologies with children and young people. We searched Medline, PsycInfo and Web of Science databases, guidelines, reviews and reference lists, contacted key authors for relevant studies, and extracted key themes on aspects of co-design relevant to practice. We supplemented this with case studies and methods reported by researchers working in the field.

Results

We identified 25 original articles and 30 digital mental health technologies that were designed/developed with children and young people. The themes identified were as follows: principles of co-design (including potential stakeholders and stages of involvement), methods of involving and engaging the range of users, co-designing the prototype and the challenges of co-design.

Conclusions

Co-design involves all relevant stakeholders throughout the life and research cycle of the programme. This review helps to inform practitioners and researchers interested in the development of digital health technologies for children and young people. Future work in this field will need to consider the changing face of technology, methods of engaging with the diversity in the user group, and the evaluation of the co-design process and its impact on the technology.

SUBMITTER: Bevan Jones R

PROVIDER: S-EPMC7611975 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundIndigenous young people worldwide possess unique protective factors that support wellbeing. However, they experience mental illness at higher rates than their non-indigenous counterparts. Digital mental health (dMH) resources can increase access to structured, timely, and culturally tailored mental health interventions by reducing structural and attitudinal barriers to accessing treatment. The involvement of Indigenous young people in dMH resource development is recommended, however, no guidelines exist on how this can best be facilitated.MethodsA scoping review examining processes to involve Indigenous young people in developing or evaluating dMH interventions was conducted. Studies reported between 1990 and 2023 involving Indigenous young people aged 12-24 years, originating from Canada, the USA, New Zealand, and Australia, in the development or evaluation of dMH interventions were eligible for inclusion. Following a three-step search process, four electronic databases were searched. Data were extracted, synthesized, and described under three categories: dMH intervention attributes, study design, and alignment with research best practice. Best practice recommendations for Indigenous research and participatory design principles derived from the literature were identified and synthesised. Included studies were assessed against these recommendations. Consultation with two Senior Indigenous Research Officers ensured Indigenous worldviews informed analysis.ResultsTwenty-four studies describing eleven dMH interventions met inclusion criteria. Studies included formative, design, pilot, and efficacy studies. Overall, most included studies demonstrated a high degree of Indigenous governance, capacity building, and community benefit. All studies adapted their research processes to ensure that local community protocols were followed and most aligned these within an Indigenous research paradigm. Formal agreements regarding existing and created intellectual property and implementation evaluations were rare. Outcomes were the primary focus of reporting, with limited detailed descriptions of governance and decision-making processes or strategies for managing predictable tensions between co-design stakeholders.ConclusionsThis study identified recommendations for undertaking participatory design with Indigenous young people and evaluated the current literature against these criteria. Common gaps were evident in the reporting of study processes. Consistent, in-depth reporting is needed to allow assessment of approaches for this hard-to-reach population. An emergent framework, informed by our findings, for guiding the involvement of Indigenous young people in the design and evaluation of dMH tools is presented.Trial registrationAvailable via osf.io/2nkc6.

Project description:Digital health interventions (DHIs) have frequently been highlighted as one way to respond to increasing levels of mental health problems in children and young people. Whilst many are developed to address existing mental health problems, there is also potential for DHIs to address prevention and early intervention. However, there are currently limitations in the design and reporting of the development, evaluation and implementation of preventive DHIs that can limit their adoption into real-world practice. This scoping review aimed to examine existing evidence-based DHI interventions and review how well the research literature described factors that researchers need to include in their study designs and reports to support real-world implementation. A search was conducted for relevant publications published from 2013 onwards. Twenty-one different interventions were identified from 30 publications, which took a universal (n = 12), selective (n = 3) and indicative (n = 15) approach to preventing poor mental health. Most interventions targeted adolescents, with only two studies including children aged ≤10 years. There was limited reporting of user co-design involvement in intervention development. Barriers and facilitators to implementation varied across the delivery settings, and only a minority reported financial costs involved in delivering the intervention. This review found that while there are continued attempts to design and evaluate DHIs for children and young people, there are several points of concern. More research is needed with younger children and those from poorer and underserved backgrounds. Co-design processes with children and young people should be recognised and reported as a necessary component within DHI research as they are an important factor in the design and development of interventions, and underpin successful adoption and implementation. Reporting the type and level of human support provided as part of the intervention is also important in enabling the sustained use and implementation of DHIs.

Project description:BackgroundIndigenous young people worldwide are at greater risk of developing mental health concerns due to ongoing inequity and disadvantage. Digital mental health (dMH) interventions are identified as a potential approach to improving access to mental health treatment for Indigenous youth. Although involvement in the development and evaluation of dMH resources is widely recommended, there is limited evidence to guide engagement of Indigenous young people in these processes. This scoping review aims to examine the methods used to involve Indigenous young people in the development or evaluation of dMH interventions.MethodsArticles published in English, involving Indigenous young people (aged 10-24 years) in the development or evaluation of dMH interventions, originating from Australia, New Zealand, Canada and the USA will be eligible for inclusion. PubMed, Scopus and EBSCOhost databases (Academic Search Premiere, Computer and Applied Science complete, CINAHL, MEDLINE, APA PsychArticles, Psychology and Behavioural Sciences collection, APA PsychInfo) will be searched to identify eligible articles (from January 1990 onwards). Infomit and Google Scholar (limited to 200 results) will be searched for grey literature. Two reviewers will independently screen citations, abstracts and full-text articles. Study methods, methodologies, dMH intervention details, participant information and engagement, and dissemination methods will be extracted, analysed (utilising content analysis), and qualitatively assessed for alignment with best practice ethical guidelines for undertaking Indigenous health research. A narrative summary of findings will be presented. Reporting will follow the Consolidated Criteria for Strengthening Reporting of Health Research involving Indigenous peoples (CONSIDER) and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews (PRISMA-ScR) guidelines.DiscussionTo date, there are no reviews which analyse engagement of Indigenous young people in the development and evaluation of dMH interventions. This review will appraise alignment of current practice with best practice guidelines to inform future research. It will highlight appropriate methods for the engagement of young people in study processes, providing guidance for health practitioners, policy makers, and researchers working in the field of Indigenous youth and dMH.Systematic review registrationOpen Science Framework ( osf.io/2nkc6 ).

Project description:BACKGROUND:There is a high prevalence of children and young people (CYP) experiencing mental health (MH) problems. Owing to accessibility, affordability, and scalability, an increasing number of digital health interventions (DHIs) have been developed and incorporated into MH treatment. Studies have shown the potential of DHIs to improve MH outcomes. However, the modes of delivery used to engage CYP in digital MH interventions may differ, with implications for the extent to which findings pertain to the level of engagement with the DHI. Knowledge of the various modalities could aid in the development of interventions that are acceptable and feasible. OBJECTIVE:This review aimed to (1) identify modes of delivery used in CYP digital MH interventions, (2) explore influencing factors to usage and implementation, and (3) investigate ways in which the interventions have been evaluated and whether CYP engage in DHIs. METHODS:A literature search was performed in the Cochrane Library, Excerpta Medica dataBASE (EMBASE), Medical Literature Analysis and Retrieval System Online (MEDLINE), and PsycINFO databases using 3 key concepts "child and adolescent mental health," "digital intervention," and "engagement." Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed using rigorous inclusion criteria and screening by at least two reviewers. The selected articles were assessed for quality using the mixed methods appraisal tool, and data were extracted to address the review aims. Data aggregation and synthesis were conducted and presented as descriptive numerical summaries and a narrative synthesis, respectively. RESULTS:This study identified 6 modes of delivery from 83 articles and 71 interventions for engaging CYP: (1) websites, (2) games and computer-assisted programs, (3) apps, (4) robots and digital devices, (5) virtual reality, and (6) mobile text messaging. Overall, 2 themes emerged highlighting intervention-specific and person-specific barriers and facilitators to CYP's engagement. These themes encompassed factors such as suitability, usability, and acceptability of the DHIs and motivation, capability, and opportunity for the CYP using DHIs. The literature highlighted that CYP prefer DHIs with features such as videos, limited text, ability to personalize, ability to connect with others, and options to receive text message reminders. The findings of this review suggest a high average retention rate of 79% in studies involving various DHIs. CONCLUSIONS:The development of DHIs is increasing and may be of interest to CYP, particularly in the area of MH treatment. With continuous technological advancements, it is important to know which modalities may increase engagement and help CYP who are facing MH problems. This review identified the existing modalities and highlighted the influencing factors from the perspective of CYP. This knowledge provides information that can be used to design and evaluate new interventions and offers important theoretical insights into how and why CYP engage in DHIs.

Project description:Introduction The COVID-19 pandemic increased public use of digital mental health technologies. However, little is known about changes in user engagement with these platforms during the pandemic. This study aims to assess engagement changes with a digital mental healthcare service during COVID-19. Methods A cohort study based on routinely collected service usage data from a digital mental health support service in the United Kingdom. Returning users aged 14–25 years that interacted for a maximum of two months were included. The study population was divided into pre-COVID and COVID cohorts. Demographic and usage information between cohorts were compared and usage clusters were identified within each cohort. Differences were tested using Chi-squared, two-sample Kolmogorov–Smirnov tests and logit regressions. Results Of the 624,103 users who joined the service between May 1, 2019, and October 1, 2021, 18,889 (32.81%) met the inclusion criteria: 5,048 in the pre-COVID cohort and 13,841 in the COVID cohort. The COVID cohort wrote more journals; maintained the same focus on messaging practitioners, posting discussions, commenting on posts, and having booked chats; and engaged less in writing journals, setting personal goals, posting articles, and having ad-hoc chats. Four usage profiles were identified in both cohorts: one relatively disengaged, one focused on contacting practitioners through chats/messages, and two broadly interested in writing discussions and comments within the digital community. Despite their broad similarities, usage patterns also exhibited differences between cohorts. For example, all four clusters had over 70% of users attempting to have ad-hoc chats with practitioners in the pre-COVID cohort, compared to one out of four clusters in the COVID cohort. Overall, engagement change patterns during the COVID-19 pandemic were not equal across clusters. Sensitivity analysis revealed varying strength of these defined clusters. Discussion Our study identified changes in user activity and engagement behavior within a digital mental healthcare service during the COVID-19 pandemic. These findings suggest that usage patterns within digital mental health services may be susceptible to change in response to external events such as a pandemic. Continuous monitoring of engagement patterns is important for informed design and personalized interventions.

Project description:IntroductionOver 25% of Dutch young people are psychologically unhealthy. Individual and societal consequences that follow from having mental health complaints at this age are substantial. Young people need care which is often unavailable. ENgage YOung people earlY (ENYOY) is a moderated digital social therapy-platform that aims to help youngsters with emerging mental health complaints. Comprehensive research is being conducted into the effects and to optimize and implement the ENYOY-platform throughout the Netherlands. The aim of this study is to explore the usability and user experience of the ENYOY-platform.MethodsA user-centered mixed-method design was chosen. 26 young people aged 16-25 with emerging mental health complaints participated. Semi-structured interviews were conducted to explore usability, user-friendliness, impact, accessibility, inclusivity, and connection (Phase 1). Phase 2 assessed usability problems using the concurrent and retrospective Think Aloud-method. User experience and perceived helpfulness were assessed using a 10-point rating scale and semi-structured interviews (Phase 3). The Health Information Technology Usability Evaluation Scale (Health-ITUES; Phase 1) and System Usability Scale (SUS; Phase 2 and 3) were administered. Qualitative data was analyzed using thematic analysis. Task completion rate and time were tracked and usability problems were categorized using the Nielsen's rating scale (Phase 2).ResultsAdequate to high usability was found (Phase 1 Health-ITUES 4.0(0.34); Phase 2 SUS 69,5(13,70); Phase 3 SUS 71,6(5,63)). Findings from Phase 1 (N = 10) indicated that users viewed ENYOY as a user-friendly, safe, accessible, and inclusive initiative which helped them reduce their mental health complaints and improve quality of life. Phase 2 (N = 10) uncovered 18 usability problems of which 5 of major severity (e.g. troubles accessing the platform). Findings from Phase 3 (N = 6) suggested that users perceived the coaching calls the most helpful [9(0.71)] followed by the therapy content [6.25(1.41)]. Users liked the social networking aspect but rated it least helpful [6(2.1)] due to inactivity.ConclusionThe ENYOY-platform has been found to have adequate to high usability and positive user experiences were reported. All findings will be transferred to the developmental team to improve the platform. Other evaluation methods and paring these with quantitative outcomes could provide additional insight in future research.

Project description:BackgroundThere is currently an increased interest in and acceptance of technology-enabled mental health care. To adequately harness this opportunity, it is critical that the design and development of digital mental health technologies be informed by the needs and preferences of end users. Despite young people and clinicians being the predominant users of such technologies, few studies have examined their perspectives on different digital mental health technologies.ObjectiveThis study aims to understand the technologies that young people have access to and use in their everyday lives and what applications of these technologies they are interested in to support their mental health. The study also explores the technologies that youth mental health clinicians currently use within their practice and what applications of these technologies they are interested in to support their clients' mental health.MethodsYouth mental health service users (aged 12-25 years) from both primary and specialist services, young people from the general population (aged 16-25 years), and youth mental health clinicians completed a web-based survey exploring technology ownership, use of, and interest levels in using different digital interventions to support their mental health or that of their clients.ResultsA total of 588 young people and 73 youth mental health clinicians completed the survey. Smartphone ownership or private access among young people within mental health services and the general population was universal (611/617, 99%), with high levels of access to computers and social media. Youth technology use was frequent, with 63.3% (387/611) using smartphones several times an hour. Clinicians reported using smartphones (61/76, 80%) and video chat (69/76, 91%) commonly in clinical practice and found them to be helpful. Approximately 50% (296/609) of the young people used mental health apps, which was significantly less than the clinicians (χ23=28.8, n=670; P<.001). Similarly, clinicians were significantly more interested in using technology for mental health support than young people (H3=55.90; P<.001), with 100% (73/73) of clinicians being at least slightly interested in technology to support mental health compared with 88% (520/591) of young people. Follow-up tests revealed no difference in interest between young people from the general population, primary mental health services, and specialist mental health services (all P>.23). Young people were most interested in web-based self-help, mobile self-help, and blended therapy.ConclusionsTechnology access is pervasive among young people within and outside of youth mental health services; clinicians are already using technology to support clinical care, and there is widespread interest in digital mental health technologies among these groups of end users. These findings provide important insights into the perspectives of young people and clinicians regarding the value of digital mental health interventions in supporting youth mental health.

Project description:BackgroundDigital health interventions, including apps and web-based services, are on the rise due to their facilitated access to target groups. The constant evolution of technology calls for participatory research methodologies to understand youth expectations and the use of technology. The creative and collaborative nature of co-design allows for the active integration of youth desires and may enhance acceptability when it comes to digital health tools.ObjectiveThe primary objective of this review is to assess the breadth of literature on digital health interventions that have been co-designed for and by young adults, including the types of available evidence, the identification of key characteristics relevant to young adult co-design, and the examination of research conduct in this space.MethodsThe proposed scoping review will be conducted in accordance with the Joanna Briggs Institute (JBI) Manual for Scoping Reviews. As well as the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) checklist for reporting scoping reviews, an adaptation of Arksey and O'Malley's 6-stage framework for scoping reviews will be referenced. Peer-reviewed primary research, where young adults (aged 15-35 years) were actively involved in the design and development process of digital health interventions, will be collated for analyses. Five databases, including MEDLINE (Ovid), Cochrane, CINAHL Plus, Google Scholar, and Scopus, will be searched for relevant papers. Search strategies will be comprehensive to identify both published and unpublished literature. Relevant gray literature and secondary research will be excluded but pooled for separate analysis and citation chaining. Results will be presented in one or multiple forms, including narrative, tabular, or diagrammatic.ResultsData collection commenced in October 2021. Following data extraction according to the JBI results extraction instrument and independent quality assurance of included studies, a narrative synthesis of each paper included in the final pool will allow for data charting. As of May 2022, 19 papers are included for analysis. We expect the results to be published by autumn 2022.ConclusionsThis protocol provides guidance for researchers who plan to conduct a similar style of investigation and promotes standardization of the scoping review process. We anticipate the provision of an overview of participatory digital health research involving young adults, highlighting any gaps in this research area, as well as potential areas for further study.International registered report identifier (irrid)DERR1-10.2196/38635.