Dataset Information

Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT).

ABSTRACT:

Background

The use of Information and Communication Technology (ICT) or e-Health is seen as essential for a modern, cost-effective health service. However, there are well documented problems with implementation of e-Health initiatives, despite the existence of a great deal of research into how best to implement e-Health (an example of the gap between research and practice). This paper reports on the development and formative evaluation of an e-Health Implementation Toolkit (e-HIT) which aims to summarise and synthesise new and existing research on implementation of e-Health initiatives, and present it to senior managers in a user-friendly format.

Results

The content of the e-HIT was derived by combining data from a systematic review of reviews of barriers and facilitators to implementation of e-Health initiatives with qualitative data derived from interviews of "implementers", that is people who had been charged with implementing an e-Health initiative. These data were summarised, synthesised and combined with the constructs from the Normalisation Process Model. The software for the toolkit was developed by a commercial company (RocketScience). Formative evaluation was undertaken by obtaining user feedback. There are three components to the toolkit--a section on background and instructions for use aimed at novice users; the toolkit itself; and the report generated by completing the toolkit. It is available to download from http://www.ucl.ac.uk/pcph/research/ehealth/documents/e-HIT.xls.

Conclusions

The e-HIT shows potential as a tool for enhancing future e-Health implementations. Further work is needed to make it fully web-enabled, and to determine its predictive potential for future implementations.

SUBMITTER: Murray E

PROVIDER: S-EPMC2967499 | biostudies-literature | 2010 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT).

Murray Elizabeth E May Carl C Mair Frances F

BMC medical informatics and decision making 20101018

<h4>Background</h4>The use of Information and Communication Technology (ICT) or e-Health is seen as essential for a modern, cost-effective health service. However, there are well documented problems with implementation of e-Health initiatives, despite the existence of a great deal of research into how best to implement e-Health (an example of the gap between research and practice). This paper reports on the development and formative evaluation of an e-Health Implementation Toolkit (e-HIT) which ...[more]

PMID: 20955594

Similar Datasets

Project description:BackgroundThe development of digital health solutions for current health care settings requires an understanding of the complexities of the health care system, organizational setting, and stakeholder groups and of the underlying interplay between stakeholders and the technology. The digital health solution was founded on the basis of an information and communication technology platform and point-of-care devices enabling home-based monitoring of disease progression and treatment outcome for patients with rheumatoid arthritis (RA).ObjectiveThe aim of this paper is to describe and discuss the applicability of an iterative evaluation process in guiding the development of a digital health solution as a technical and organizational entity in three different health care systems.MethodsThe formative evaluation comprised the methodologies of contextual understanding, participatory design, and feasibility studies and included patients, healthcare professionals, and hardware and software developers. In total, the evaluation involved 45 patients and 25 health care professionals at 3 clinical sites in Europe.ResultsThe formative evaluation served as ongoing and relevant input to the development process of the digital health solution. Through initial field studies key stakeholder groups were identified and knowledge obtained about the different health care systems, the professional competencies involved in routine RA treatment, the clinics' working procedures, and the use of communication technologies. A theory-based stakeholder evaluation achieved a multifaceted picture of the ideas and assumptions held by stakeholder groups at the three clinical sites, which also represented the diversity of three different language zones and cultures. Experiences and suggestions from the patients and health care professionals were sought through participatory design processes and real-life testing and actively used for adjusting the visual, conceptual, and practical design of the solution. The learnings captured through these activities aided in forming the solution and in developing a common understanding of the overall vision and aim of this solution. During this process, the 3 participating sites learned from each other's feed-back with the ensuing multicultural inspiration. Moreover, these efforts also enabled the consortium to identify a 'tipping point' during a pilot study, revealing serious challenges and a need for further development of the solution. We achieved valuable learning during the evaluation activities, and the remaining challenges have been clarified more extensively than a single-site development would have discovered. The further obstacles have been defined as has the need to resolve these before designing and conducting a real-life clinical test to assess the outcome from a digital health solution for RA treatment.ConclusionsA formative evaluation process with ongoing involvement of stakeholder groups from 3 different cultures and countries have helped to inform and influence the development of a novel digital health solution, and provided constructive input and feedback enabling the consortium to control the development process.

Project description:BACKGROUND:Health professionals have expressed unmet needs, including lacking the skills, confidence, training, and resources needed to properly attend to the psychological needs of people with diabetes. OBJECTIVE:Informed by needs assessments, this study aimed to develop practical, evidence-based resources to support health professionals to address the emotional needs of adults with type 1 or type 2 diabetes. METHODS:We developed a new handbook and toolkit informed by formative evaluation, including literature reviews, stakeholder consultation and review, and a qualitative study. In the qualitative study, health professionals participated in interviews after reading sections of the handbook and toolkit. RESULTS:The literature review uncovered that psychological problems are common among adults with diabetes, but health professionals lack resources to provide related support. We planned and drafted resources to fill this unmet need, guided by stakeholder consultation and an Expert Reference Group (ERG). Before finalizing the resources, we implemented feedback received from stakeholders (ERG, health professionals, academics, and people with diabetes). The resulting resources were the practical, evidence-based Diabetes and Emotional Health handbook and toolkit. A total of 19 health professionals took part in the qualitative study about the handbook and toolkit. They viewed the resources favorably, felt empowered to support people with diabetes experiencing psychological problems, and felt motivated to share the resources with others. Some gave examples of how they had used the handbook in clinical practice. A perceived highlight was the inclusion of a process model outlining 7 steps for identifying and supporting people with emotional problems: the 7 A's model. With funding from the National Diabetes Services Scheme (NDSS), more than 2400 copies of Diabetes and Emotional Health have been distributed. It is freely available on the Web. The NDSS is an initiative of the Australian Government administered with the assistance of Diabetes Australia. CONCLUSIONS:The new evidence-based resources are perceived by stakeholders as effective aids to assist health professionals in providing emotional support to adults with diabetes. The 7 A's model may have clinical utility for routine monitoring of other psychological and health-related problems, as part of person-centered clinical care.

Project description:BackgroundIn 2011, the Veterans Health Administration (VHA) released the Acute Ischemic Stroke (AIS) Directive, which mandated reorganization of acute stroke care, including self-designation of stroke centers as Primary (P), Limited Hours (LH), or Supporting (S).ObjectivesIn partnership with the VHA Offices of Emergency Medicine and Specialty Care Services, the VA Stroke QUERI conducted a formative evaluation in a national sample of three levels of stroke centers in order to understand barriers and facilitators.Design and approachThe evaluation consisted of a mixed-methods assessment that included a qualitative assessment of data from semi-structured interviews with key informants and a quantitative assessment of stroke quality-of-care data reporting practices by facility characteristics.ParticipantsThe final sample included 38 facilities (84 % participation rate): nine P, 24 LH, and five S facilities. In total, we interviewed 107 clinicians and 16 regional Veterans Integrated Service Network (VISN) leaders.ResultsAcross all three levels of stroke centers, stroke teams identified the specific need for systematic nurse training to triage and initiate stroke protocols. The most frequently reported barriers centered around quality-of-care data collection. A low number of eligible veterans arriving at the VAMC in a timely manner was another major impediment. The LH and S facilities reported some unique barriers: access to radiology and neurology services; EMS diverting stroke patients to nearby stroke centers, maintaining staff competency, and a lack of stroke clinical champions. Solutions that were applied included developing stroke order sets and templates to provide systematic decision support, implementing a stroke code in the facility for a coordinated response to stroke, and staff resource allocation and training. Data reporting by facility evaluation demonstrated that categorizing site volume did indicate a lower likelihood of reporting among VAMCs with 25-49 acute stroke admissions per year.ConclusionsThe AIS Directive brought focused attention to reorganizing stroke care across a wide range of facility types. Larger VA facilities tended to follow established practices for organizing stroke care, but the unique addition of the LH designation presented some challenges. S facilities tended to report a lack of a coordinated stroke team and champion to drive process changes.

Project description:BACKGROUND:Mobile health (mHealth) apps for pediatric chronic conditions are growing in availability and challenge investigators to conduct rigorous evaluations that keep pace with mHealth innovation. Traditional research methods are poorly suited to operationalize the agile, iterative trials required to evidence and optimize these digitally mediated interventions. OBJECTIVE:We sought to contribute a resource to support the quantification, analysis, and visualization of analytic indicators of effective engagement with mHealth apps for chronic conditions. METHODS:We applied user-centered design methods to design and develop an Analytics Platform to Evaluate Effective Engagement (APEEE) with consumer mHealth apps for chronic conditions and implemented the platform to analyze both retrospective and prospective data generated from a smartphone-based pain self-management app called iCanCope for young people with chronic pain. RESULTS:Through APEEE, we were able to automate the process of defining, operationalizing, and evaluating effective engagement with iCanCope. Configuring the platform to integrate with the app was feasible and provided investigators with a resource to consolidate, analyze, and visualize engagement data generated by participants in real time. Preliminary efforts to evaluate APEEE showed that investigators perceived the platform to be an acceptable evaluative resource and were satisfied with its design, functionality, and performance. Investigators saw potential in APEEE to accelerate and augment evidence generation and expressed enthusiasm for adopting the platform to support their evaluative practice once fully implemented. CONCLUSIONS:Dynamic, real-time analytic platforms may provide investigators with a powerful means to characterize the breadth and depth of mHealth app engagement required to achieve intended health outcomes. Successful implementation of APEEE into evaluative practice may contribute to the realization of effective and evidence-based mHealth care.

Project description:OBJECTIVES:Evaluation of the demonstrator phase and first wave roll-out of the National Health Service (NHS) Diabetes Prevention Programme (DPP) in England. To examine: (1) intervention design, provision and fidelity assessment procedures; (2) risk assessment and recruitment pathways and (3) data collection for monitoring and evaluation. To provide recommendations informing decision makers on programme quality, improvements and future evaluation. DESIGN:We reviewed programme documents, mapping against the NHS DPP specification and National Institute for Health and Care Excellence (NICE) public health guideline: Type 2 diabetes (T2D) prevention in people at high risk (PH38), conducted qualitative research using individual interviews and focus group discussions with stakeholders and examined recruitment, fidelity and data collection procedures. SETTING:Seven NHS DPP demonstrator sites and, subsequently, 27 first wave areas across England. INTERVENTIONS:Intensive behavioural intervention with weight loss, diet and physical activity goals. The national programme specifies at least 13 sessions over 9?months, delivered face to face to groups of 15-20 adults with non-diabetic hyperglycaemia, mainly recruited from primary care and NHS Health Checks. PARTICIPANTS:Participants for qualitative research were purposively sampled to provide a spread of stakeholder experience. Documents for review were provided via the NHS DPP Management Group. FINDINGS:The NHS DPP specification reflected current evidence with a clear framework for service provision. Providers, with national capacity to deliver, supplied intervention plans compliant with this framework. Stakeholders highlighted limitations in fidelity assessment and recruitment and retention challenges, especially in reach and equity, that could adversely impact on implementation. Risk assessment for first wave eligibility differed from NICE guidance. CONCLUSIONS:The NHS DPP provides an evidence-based behavioural intervention for prevention of T2D in adults at high risk, with capacity to deliver nationally. Framework specification allows for balance between consistency and contextual variation in intervention delivery, with session details devolved to providers. Limitations in fidelity assurance, data collection procedures and recruitment issues could adversely impact on intervention effectiveness and restrict evaluation.

Project description:BACKGROUND: Effective implementation of the patient-centered medical home (PCMH) in primary care practices requires training and other resources, such as online toolkits, to share strategies and materials. The Veterans Health Administration (VA) developed an online Toolkit of user-sourced tools to support teams implementing its Patient Aligned Care Team (PACT) medical home model. OBJECTIVE: To present findings from an evaluation of the PACT Toolkit, including use, variation across facilities, effect of social marketing, and factors influencing use. INNOVATION: The Toolkit is an online repository of ready-to-use tools created by VA clinic staff that physicians, nurses, and other team members may share, download, and adopt in order to more effectively implement PCMH principles and improve local performance on VA metrics. DESIGN: Multimethod evaluation using: (1) website usage analytics, (2) an online survey of the PACT community of practice's use of the Toolkit, and (3) key informant interviews. PARTICIPANTS: Survey respondents were PACT team members and coaches (n = 544) at 136 VA facilities. Interview respondents were Toolkit users and non-users (n = 32). MEASURES: For survey data, multivariable logistic models were used to predict Toolkit awareness and use. Interviews and open-text survey comments were coded using a "common themes" framework. The Consolidated Framework for Implementation Research (CFIR) guided data collection and analyses. KEY RESULTS: The Toolkit was used by 6,745 staff in the first 19 months of availability. Among members of the target audience, 80 % had heard of the Toolkit, and of those, 70 % had visited the website. Tools had been implemented at 65 % of facilities. Qualitative findings revealed a range of user perspectives from enthusiastic support to lack of sufficient time to browse the Toolkit. CONCLUSIONS: An online Toolkit to support PCMH implementation was used at VA facilities nationwide. Other complex health care organizations may benefit from adopting similar online peer-to-peer resource libraries.

Project description:BackgroundThe unprecedented number of youths engaged in nonmedical use of prescription opioids (POs), as well as the myriad negative consequences of such misuse, emphasizes the importance of prevention efforts targeting this public health crisis. Although there are several science-based, interactive drug abuse prevention programs focused on preventing the use of nonprescription drugs in youths, to our knowledge, there are no science-based interactive programs that focus on the prevention of PO abuse among adolescents.ObjectiveThe aim of this study was to develop and conduct a formative evaluation of a science-based interactive Web-based program focused on the prevention of PO abuse among adolescents aged 12 to 17 years (Pop4Teens). This study was conducted to prepare for a randomized controlled trial designed to evaluate the effectiveness of Pop4Teens compared with an active control website, JustThinkTwice.com (Drug Enforcement Administration), in impacting knowledge and attitudes about POs and perceptions of risk associated with the abuse of POs, as well as intentions to use and actual use of POs.MethodsWe conducted 6 focus groups with 30 youths (a mean of 5 per group: the eligibility being aged 12-19 years) along a continuum of exposure to POs (in treatment for opioid use disorder, in general treatment for other substance use disorder, prescribed an opioid, and opioid-naïve) and writing sessions with 30 youths in treatment for opioid use disorder (12-19 years) to inform the development of the Web-based prevention tool. Feasibility and acceptability of a prototype of the Web-based intervention were then assessed through individual feedback sessions with 57 youths (drawn from the same populations as the focus groups).ResultsWe successfully completed the development of a Web-based PO abuse prevention program (Pop4Teens). Analyses of focus group transcripts informed the development of the program (eg, quiz content/format, script writing, and story editing). Selected writing session narratives anchored the planned scientific content by lending credibility and informing the development of compelling storylines intended to motivate the youth to engage with the program. Feedback session data indicated that the Web-based tool could be potentially useful and acceptable. In addition, feedback session participants demonstrated significant increases in their knowledge of key topics related to the prevention of PO abuse after the exposure to sections of the Web-based program.ConclusionsThe opioid crisis is predicted to get worse before it gets better. An effective response will likely require a multipronged strategy inclusive of effective evidence-based prevention programs acceptable to, and accessible by, a majority of youths.

Dataset Information

Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT).

Background

Results

Conclusions

Publications

Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets