Dataset Information

Pragmatic Application of the RE-AIM Framework to Evaluate the Implementation of Tobacco Cessation Programs Within NCI-Designated Cancer Centers.

ABSTRACT: Tobacco cessation after cancer diagnosis leads to better patient outcomes. However, tobacco treatment services are frequently unavailable in cancer care settings, and multilevel implementation challenges can impede uptake of new programs. The National Cancer Institute (NCI) dedicated Cancer Moonshot funding through the Cancer Center Cessation Initiative (C3I) for NCI-Designated Cancer Centers to implement or enhance the implementation of tobacco treatment services. We examined a pragmatic application of the RE-AIM framework (reach, effectiveness, adoption, implementation, and maintenance) to evaluate tobacco treatment programs implemented within Cancer Centers funded through C3I. Using three C3I-funded Centers as examples, we describe how each RE-AIM construct was operationalized to evaluate the implementation of a wide range of cessation services (e.g., tobacco use screening, counseling, Quitline referral, pharmacotherapy) in this heterogeneous group of cancer care settings. We discuss the practical challenges encountered in assessing RE-AIM constructs in real world situations, including using the electronic health record (EHR) to aid in assessment. Reach and effectiveness evaluation required that Centers define the setting(s) where cessation services were implemented (to determine the "denominator"), enumerate the patient population, report current patient tobacco use, patient engagement in tobacco treatment, and 6-month cessation outcomes. To reduce site heterogeneity, increase data accuracy, and reduce burden, reach was frequently captured via standardized EHR enhancements that improved the identification of current smokers and tobacco treatment referrals. Effectiveness was determined by cessation outcomes (30-day point prevalence abstinence at 6-months post-engagement) assessed through a variety of data collection approaches. Adoption was measured by the characteristics and proportion of targeted cancer care settings and clinicians engaged in cessation service delivery. Implementation was assessed by examining the delivery of tobacco screening assessments and intervention components across sites, and provider-level implementation consistency. Maintenance assessments identified whether tobacco treatment services continued in the setting after implementation and documented the sustainability plan and organizational commitment to continued delivery. In sum, this paper demonstrates a pragmatic approach to using RE-AIM as an evaluation framework that yields relevant outcomes on common implementation metrics across widely differing tobacco treatment approaches and settings.

SUBMITTER: D'Angelo H

PROVIDER: S-EPMC7304341 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Pragmatic Application of the RE-AIM Framework to Evaluate the Implementation of Tobacco Cessation Programs Within NCI-Designated Cancer Centers.

D'Angelo Heather H Ramsey Alex T AT Rolland Betsy B Chen Li-Shiun LS Bernstein Steven L SL Fucito Lisa M LM Webb Hooper Monica M Adsit Robert R Pauk Danielle D Rosenblum Marika S MS Cinciripini Paul M PM Joseph Anne A Ostroff Jamie S JS Warren Graham W GW Fiore Michael C MC Baker Timothy B TB

Frontiers in public health 20200612

Tobacco cessation after cancer diagnosis leads to better patient outcomes. However, tobacco treatment services are frequently unavailable in cancer care settings, and multilevel implementation challenges can impede uptake of new programs. The National Cancer Institute (NCI) dedicated Cancer Moonshot funding through the Cancer Center Cessation Initiative (C3I) for NCI-Designated Cancer Centers to implement or enhance the implementation of tobacco treatment services. We examined a pragmatic applic ...[more]

PMID: 32596200

Similar Datasets

Project description:BackgroundThe Cancer Center Cessation Initiative (C3I) is a National Cancer Institute (NCI) Cancer Moonshot Program that supports NCI-designated cancer centers developing tobacco treatment programs for oncology patients who smoke. C3I-funded centers implement evidence-based programs that offer various smoking cessation treatment components (e.g., counseling, Quitline referrals, access to medications). While evaluation of implementation outcomes in C3I is guided by evaluation of reach and effectiveness (via RE-AIM), little is known about technical efficiency-i.e., how inputs (e.g., program costs, staff time) influence implementation outcomes (e.g., reach, effectiveness). This study demonstrates the application of data envelopment analysis (DEA) as an implementation science tool to evaluate technical efficiency of C3I programs and advance prioritization of implementation resources.MethodsDEA is a linear programming technique widely used in economics and engineering for assessing relative performance of production units. Using data from 16 C3I-funded centers reported in 2020, we applied input-oriented DEA to model technical efficiency (i.e., proportion of observed outcomes to benchmarked outcomes for given input levels). The primary models used the constant returns-to-scale specification and featured cost-per-participant, total full-time equivalent (FTE) effort, and tobacco treatment specialist effort as model inputs and reach and effectiveness (quit rates) as outcomes.ResultsIn the DEA model featuring cost-per-participant (input) and reach/effectiveness (outcomes), average constant returns-to-scale technical efficiency was 25.66 (SD = 24.56). When stratified by program characteristics, technical efficiency was higher among programs in cohort 1 (M = 29.15, SD = 28.65, n = 11) vs. cohort 2 (M = 17.99, SD = 10.16, n = 5), with point-of-care (M = 33.90, SD = 28.63, n = 9) vs. no point-of-care services (M = 15.59, SD = 14.31, n = 7), larger (M = 33.63, SD = 30.38, n = 8) vs. smaller center size (M = 17.70, SD = 15.00, n = 8), and higher (M = 29.65, SD = 30.99, n = 8) vs. lower smoking prevalence (M = 21.67, SD = 17.21, n = 8).ConclusionMost C3I programs assessed were technically inefficient relative to the most efficient center benchmark and may be improved by optimizing the use of inputs (e.g., cost-per-participant) relative to program outcomes (e.g., reach, effectiveness). This study demonstrates the appropriateness and feasibility of using DEA to evaluate the relative performance of evidence-based programs.

Project description:IntroductionThe COVID-19 pandemic disrupted cancer screening and treatment delivery, but COVID-19's impact on tobacco cessation treatment for cancer patients who smoke has not been widely explored.MethodsWe conducted a sequential cross-sectional analysis of data collected from 34 NCI-designated cancer centers participating in NCI's Cancer Center Cessation Initiative (C3I), across three reporting periods: one prior to COVID-19 (January-June 2019) and two during the pandemic (January-June 2020, January-June 2021). Using McNemar's Test of Homogeneity, we assessed changes in services offered and implementation activities over time.ResultsThe proportion of centers offering remote treatment services increased each year for Quitline referrals (56%, 68%, and 91%; p=.000), telephone counseling (59%, 79%, and 94%; p=.002), and referrals to Smokefree TXT (27%, 47%, and 56%; p=.006). Centers offering video-based counseling increased from 2020 to 2021 (18% to 59%; p=.006), Fewer than 10% of centers reported laying off tobacco treatment staff. Compared to early 2020, in 2021 C3I centers reported improvements in their ability to maintain staff and clinician morale, refer to external treatment services, train providers to deliver tobacco treatment, and modify clinical workflows.DiscussionThe COVID-19 pandemic necessitated rapid transition to new telehealth program delivery of tobacco treatment for patients with cancer. C3I cancer centers adjusted rapidly to challenges presented by the pandemic, with improvements reported in staff morale and ability to train providers, refer patients to tobacco treatment, and modify clinical workflows. These factors enabled C3I centers to sustain evidence-based tobacco treatment implementation during and beyond the COVID-19 pandemic.ImplicationsThis work describes how NCI-designated cancer centers participating in the Cancer Center Cessation Initiative (C3I) adapted to challenges to sustain evidence-based tobacco use treatment programs during the COVID-19 pandemic. This work offers a model for resilience and rapid transition to remote tobacco treatment services delivery and proposes a policy and research agenda for telehealth services as an approach to sustaining evidence-based tobacco treatment programs.

Project description:Background: Explored the role of public health centers in the delivery of physical activity programs to older Brazilians. Methods: Total of 114 older adults (81% women) from public health centers across the city of Florianopolis, Brazil, were randomized into three groups: behavior change group (n = 36), traditional exercise group (n = 52), and control group (n = 26). The behavioral change group included 12 weekly meetings (2 h each). The traditional exercise group offered a 12-week exercise class. Individuals in the control group participated only in measurements. Program evaluation included a mixed-methods approach following the RE-AIM framework (reach, effectiveness, adoption, implementation, and maintenance). Trained interviewers conducted 12 focus groups and 32 interviews with participants in the program, professionals delivering the programs, community health workers, and local and city administrators overseeing public health centers. Participants completed health, quality of life, and fitness assessments at four time points. Results: The study reached 11.5% of the eligible population in the community. Older adults' resistance to change and limited understanding of behavior change science by public health center staff hindered program reach. Physician encouraging patient participation and personal invitations by community health workers were perceived as favorable factors. Results of program effectiveness and maintenance suggest that behavior change strategies may be better suited than traditional exercise classes for decreasing sedentary time and increasing moderate-to-vigorous physical activity, as well as improving participants' quality of life. Only 14% of public health centers in the city adopted the programs. Heavy workload of health educators delivering the programs and limited physical space for program delivery were barriers for adoption. The fidelity of program delivery was high and indicates that the programs are culturally-appropriate for the Brazilian context and feasible for implementation by local health educators. Conclusions: Our findings support the potential for dissemination of behavior change and traditional exercise programs to older adults through public health centers in Brazil. REBEC: RBR-9pkxn2 (retrospectively registered) Register April 20, 2019.

Project description:BackgroundThe legal climate for cannabis use has dramatically changed with an increasing number of states passing legislation legalizing access for medical and recreational use. Among cancer patients, cannabis is often used to ameliorate adverse effects of cancer treatment. Data are limited on the extent and type of use among cancer patients during treatment and the perceived benefits and harms. This multicenter survey was conducted to assess the use of cannabis among cancer patients residing in states with varied legal access to cannabis.MethodsA total of 12 NCI-Designated Cancer Centers, across states with varied cannabis-access legal status, conducted surveys with a core questionnaire to assess cannabis use among recently diagnosed cancer patients. Data were collected between September 2021 and August 2023 and pooled across 12 cancer centers. Frequencies and 95% confidence intervals for core survey measures were calculated, and weighted estimates are presented for the 10 sites that drew probability samples.ResultsOverall reported cannabis use since cancer diagnosis among survey respondents was 32.9% (weighted), which varied slightly by state legalization status. The most common perceived benefits of use were for pain, sleep, stress and anxiety, and treatment side effects. Reported perceived risks were less common and included inability to drive, difficulty concentrating, lung damage, addiction, and impact on employment. A majority reported feeling comfortable speaking to health-care providers though, overall, only 21.5% reported having done so. Among those who used cannabis since diagnosis, the most common modes were eating in food, smoking, and pills or tinctures, and the most common reasons were for sleep disturbance, followed by pain and stress and anxiety with 60%-68% reporting improved symptoms with use.ConclusionThis geographically diverse survey demonstrates that patients use cannabis regardless of its legal status. Addressing knowledge gaps concerning benefits and harms of cannabis use during cancer treatment is critical to enhance patient-provider communication.

Project description:IntroductionEarly access to specialty palliative care is associated with better quality of life, less intensive end-of-life treatment and improved outcomes for patients with advanced cancer. However, significant variation exists in implementation and integration of palliative care. This study compares the organizational, sociocultural, and clinical factors that support or hinder palliative care integration across three U.S. cancer centers using an in-depth mixed methods case study design and proposes a middle range theory to further characterize specialty palliative care integration.MethodsMixed methods data collection included document review, semi-structured interviews, direct clinical observation, and context data related to site characteristics and patient demographics. A mixed inductive and deductive approach and triangulation was used to analyze and compare sites' palliative care delivery models, organizational structures, social norms, and clinician beliefs and practices.ResultsSites included an urban center in the Midwest and two in the Southeast. Data included 62 clinician and 27 leader interviews, observations of 410 inpatient and outpatient encounters and seven non-encounter-based meetings, and multiple documents. Two sites had high levels of "favorable" organizational influences for specialty palliative care integration, including screening, policies, and other structures facilitating integration of specialty palliative care into advanced cancer care. The third site lacked formal organizational policies and structures for specialty palliative care, had a small specialty palliative care team, espoused an organizational identity linked to treatment innovation, and demonstrated strong social norms for oncologist primacy in decision making. This combination led to low levels of specialty palliative care integration and greater reliance on individual clinicians to initiate palliative care.ConclusionIntegration of specialty palliative care services in advanced cancer care was associated with a complex interaction of organization-level factors, social norms, and individual clinician orientation. The resulting middle range theory suggests that formal structures and policies for specialty palliative care combined with supportive social norms are associated with greater palliative care integration in advanced cancer care, and less influence of individual clinician preferences or tendencies to continue treatment. These results suggest multi-faceted efforts at different levels, including social norms, may be needed to improve specialty palliative care integration for advanced cancer patients.

Project description:ImportanceCongress has exempted 11 specialized cancer centers in the United States from the Prospective Payment System (PPS). These centers are also exempt from reporting many of the process-of-care and outcome measures to the Centers for Medicare & Medicaid Services that are required for hospitals in the PPS. It is not known how hospitals affiliated with PPS-exempt cancer centers differ from other hospitals affiliated with National Cancer Institute cancer centers (NCI-CCs) or other US hospitals that provide cancer care.ObjectiveTo examine differences between hospitals affiliated with PPS-exempt cancer centers, other hospitals affiliated with NCI-CCs, and other hospitals that provide cancer care on metrics that could be used in public reporting.Design, setting, and participantsThis retrospective cohort study compared hospital characteristics and cancer-related services using data from the American Hospital Association Annual Survey and US News Best Hospitals rankings. With a 100% sample of Medicare beneficiaries who underwent 1 of 9 cancer operations (brain tumor resection, colorectal resection, cystectomy, esophagectomy, gastrectomy, liver resection, lung resection, pancreatic resection, prostatectomy) from January 1, 2011, to May 31, 2015, we used hierarchical logistic regression methods to compare differences in 18 postoperative outcomes. Data analysis was conducted from February 2018 to August 2018.Main outcomes and measuresThis study evaluated hospital characteristics, including cancer-specific services, patient comorbidity burden, and cancer surgery postoperative outcomes, from PPS-exempt cancer centers, NCI-affiliated cancer centers, and other US hospitals that provide cancer care.ResultsHospitals affiliated with PPS-exempt cancer centers (n = 15) and NCI-CCs (n = 54) were similar in hospital characteristics, basic cancer-related services, and patient comorbidity burden. Compared with NCI-CCs, PPS-exempt cancer centers had significantly higher US News reputation scores (mean [SD], 17.5 [24.0] vs 2.6 [4.8]; P < .001) but no differences in oncology patient volume, patient safety ratings, comorbidity burden, nurse staffing, US News total cancer scores, or US News survival scores. Hospitals affiliated with PPS-exempt cancer centers and NCI-CCs had similar adjusted postoperative outcomes for 15 of 18 measures, including mortality, readmission, and surgical site infections. Compared with hospitals affiliated with PPS-exempt cancer centers, patients treated at NCI-CCs were more likely to have postoperative sepsis (3.1% vs 1.7%; P = .002), acute renal failure (6.2% vs 3.9%; P = .01), and urinary tract infection (6.4% vs 4.0%; P = .002). Compared with the other hospitals that provide cancer care (n = 3578), PPS-exempt cancer center status was associated with improved outcomes for 7 of 18 measures, including mortality, sepsis, acute renal failure, pulmonary failure, and failure to rescue.Conclusions and relevanceHospitals affiliated with PPS-exempt cancer centers and NCI-CCs had generally similar hospital characteristics, patient comorbidity burden, and cancer surgery outcomes. These findings raise questions about why some cancer centers are designated as PPS-exempt and why most hospitals are not required to publicly report cancer-specific quality metrics.

Project description:BackgroundThe RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework is a useful tool for evaluating the impact of programs in community settings. RE-AIM has been applied to evaluate individual programs but seldom used to evaluate the collective impact of community-based, public health programming developed and delivered by multiple autonomous organizations. The purposes of this paper were to (a) demonstrate how RE-AIM can be operationalized and applied to evaluate the collective impact of similar autonomous programs that promote health and well-being and (b) provide preliminary data on the collective impact of Canadian spinal cord injury (SCI) peer mentorship programs on the delivery of peer mentorship services.MethodsCriteria from all five RE-AIM dimensions were operationalized to evaluate multiple similar community-based programs. For this study, nine provincial organizations that serve people with SCI were recruited from across Canada. Organizations completed a structured self-report questionnaire and participated in a qualitative telephone interview to examine different elements of their peer mentorship program. Data were analyzed using summary statistics.ResultsHaving multiple indicators to assess RE-AIM dimensions provided a broad evaluation of the impact of Canadian SCI peer mentorship programs. Peer mentorship programs reached 1.63% of the estimated Canadian SCI population. The majority (67%) of organizations tracked the effectiveness of peer mentorship through testimonials and reports. Setting-level adoption rates were high with 100% of organizations offering peer mentorship in community and hospital settings. On average, organizations allocated 10.4% of their operating budget and 9.8% of their staff to implement peer mentorship and 89% had maintained their programming for over 10 years. Full interpretation of the collective impact of peer mentorship programs was limited as complete data were only collected for 52% of survey questions.ConclusionsThe lack of available organizational data highlights a significant challenge when using RE-AIM to evaluate the collective impact of multiple programs that promote health and well-being. Although researchers are encouraged to use RE-AIM to evaluate the collective impact of programs delivered by different organizations, documenting limitations and providing recommendations should be done to further the understanding of how best to operationalize RE-AIM in these contexts.

Dataset Information

Pragmatic Application of the RE-AIM Framework to Evaluate the Implementation of Tobacco Cessation Programs Within NCI-Designated Cancer Centers.

Publications

Pragmatic Application of the RE-AIM Framework to Evaluate the Implementation of Tobacco Cessation Programs Within NCI-Designated Cancer Centers.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets