Dataset Information

A systematic evaluation of payback of publicly funded health and health services research in Hong Kong.

ABSTRACT:

Background

The Health and Health Services Research Fund (HHSRF) is dedicated to support research related to all aspects of health and health services in Hong Kong. We evaluated the fund's outcomes and explored factors associated with the translation of research findings to changes in health policy and provider behaviour.

Methods

A locally suitable questionnaire was developed based on the "payback" evaluation framework and was sent to principal investigators of the completed research projects supported by the fund since 1993. Research "payback" in six outcome areas was surveyed, namely knowledge production, use of research in the research system, use of research project findings in health system policy/decision making, application of the research findings through changed behaviour, factors influencing the utilization of research, and health/health service/economic benefits.

Results

Principal investigators of 178 of 205 (87%) completed research projects returned the questionnaire. Investigators reported research publications in 86.5% (mean = 5.4 publications per project), career advancement 34.3%, acquisition of higher qualifications 38.2%, use of results in policy making 35.4%, changed behaviour in light of findings 49.4%, evidence of health service benefit 42.1% and generated subsequent research in 44.9% of the projects. Payback outcomes were positively associated with the amount of funding awarded. Multivariate analysis found participation of investigators in policy committees and liaison with potential users were significantly associated with reported health service benefit (odds ratio [OR]participation = 2.86, 95% confidence interval [CI] 1.28-6.40; ORliaison = 2.03, 95% CI 1.05-3.91), policy and decision-making (ORparticipation = 10.53, 95% CI 4.13-26.81; ORliaison = 2.52, 95% CI 1.20-5.28), and change in behavior (ORparticipation = 3.67, 95% CI 1.53-8.81).

Conclusion

The HHSRF has produced substantial outcomes and compared favourably with similar health research funds in other developed economies. Further studies are needed to better understand the factors and pathways associated with the translation of research findings into practice.

SUBMITTER: Kwan P

PROVIDER: S-EPMC1952059 | biostudies-literature | 2007 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A systematic evaluation of payback of publicly funded health and health services research in Hong Kong.

Kwan Patrick P Johnston Janice J Fung Anne Y K AY Chong Doris S Y DS Collins Richard A RA Lo Su V SV

BMC health services research 20070730

<h4>Background</h4>The Health and Health Services Research Fund (HHSRF) is dedicated to support research related to all aspects of health and health services in Hong Kong. We evaluated the fund's outcomes and explored factors associated with the translation of research findings to changes in health policy and provider behaviour.<h4>Methods</h4>A locally suitable questionnaire was developed based on the "payback" evaluation framework and was sent to principal investigators of the completed resear ...[more]

PMID: 17662157

Similar Datasets

Project description:ObjectiveTo evaluate how the availability of contraceptive services was associated with a change in the abortion rate before and after Texas' legislative changes to the family planning budget in 2011 and abortion access in 2013.MethodsIn this cross-sectional study, we obtained 2010 and 2015 data on contraceptive provision (number of publicly funded clinics and number of contraceptive clients served per 1,000 reproductive-aged women) from the Guttmacher Institute and county-level abortion data from the Texas Department of State Health Services. We categorized counties as having an abortion rate that increased or declined less than the national rate between 2010 and 2015 ( low-decline counties ) compared with those having an abortion rate that declined equal to or greater than the national rate between 2010 and 2015 ( high-decline counties ). We evaluated differences in contraceptive provision between high-decline and low-decline counties and evaluated county characteristics (racial and ethnic composition, unemployment, poverty, uninsured, education, distance to an abortion clinic, deliveries covered by Medicaid, and Catholic hospital marketplace dominance) as potential confounders.ResultsOf 157 counties that had at least one contraceptive clinic in either 2010 or 2015, 49 were low-decline counties and 108 were high-decline counties. Although the total number of publicly funded family planning clinics increased by 10.8%, there was a 4.7% decrease in the total number of contraceptive clients served statewide. Compared with low-decline counties, high-decline counties had a higher median number of contraceptive clients served per 1,000 women aged 18-44 years (31.9 vs 60.7, P <.05) in 2015. Between 2010 and 2015, the abortion rate decreased 19.7% for each 1.0% increase in contraceptive clients served.ConclusionTexas counties with higher abortion-rate declines had more publicly funded contraceptive clinics and served more contraceptive clients than counties with lower declines, which may indicate the importance of greater access to publicly funded contraceptive services.

Project description:BackgroundBuilding on an approach applied to cardiovascular and cancer research, we estimated the economic returns from United Kingdom public- and charitable-funded musculoskeletal disease (MSD) research that arise from the net value of the improved health outcomes in the United Kingdom.MethodsTo calculate the economic returns from MSD-related research in the United Kingdom, we estimated (1) the public and charitable expenditure on MSD-related research in the United Kingdom between 1970 and 2013; (2) the net monetary benefit (NMB), derived from the health benefit in quality adjusted life years (QALYs) valued in monetary terms (using a base-case value of a QALY of £25,000) minus the cost of delivering that benefit, for a prioritised list of interventions from 1994 to 2013; (3) the proportion of NMB attributable to United Kingdom research; and (4) the elapsed time between research funding and health gain. The data collected from these four key elements were used to estimate the internal rate of return (IRR) from MSD-related research investments on health benefits. We analysed the uncertainties in the IRR estimate using a one-way sensitivity analysis.ResultsExpressed in 2013 prices, total expenditure on MSD-related research from 1970 to 2013 was £3.5 billion, and for the period used to estimate the rate of return, 1978-1997, was £1.4 billion. Over the period 1994-2013 the key interventions analysed produced 871,000 QALYs with a NMB of £16 billion, allowing for the net NHS costs resulting from them and valuing a QALY at £25,000. The proportion of benefit attributable to United Kingdom research was 30% and the elapsed time between funding and impact of MSD treatments was 16 years. Our best estimate of the IRR from MSD-related research was 7%, which is similar to the 9% for CVD and 10% for cancer research.ConclusionsOur estimate of the IRR from the net health gain to public and charitable funding of MSD-related research in the United Kingdom is substantial, and justifies the research investments made between 1978 and 1997. We also demonstrated the applicability of the approach previously used in assessing the returns from cardiovascular and cancer research. Inevitably, with a study of this kind, there are a number of important assumptions and caveats that we highlight, and these can inform future research.

Project description:BackgroundIn cluster randomised controlled trials (cRCTs), groups of individuals (rather than individuals) are randomised to minimise the risk of contamination and/or efficiently use limited resources or solve logistic and administrative problems. A major concern in the primary analysis of cRCT is the use of appropriate statistical methods to account for correlation among outcomes from a particular group/cluster. This review aimed to investigate the statistical methods used in practice for analysing the primary outcomes in publicly funded cluster randomised controlled trials, adherence to the CONSORT (Consolidated Standards of Reporting Trials) reporting guidelines for cRCTs and the recruitment abilities of the cluster trials design.MethodsWe manually searched the United Kingdom's National Institute for Health Research (NIHR) online Journals Library, from 1 January 1997 to 15 July 2021 chronologically for reports of cRCTs. Information on the statistical methods used in the primary analyses was extracted. One reviewer conducted the search and extraction while the two other independent reviewers supervised and validated 25% of the total trials reviewed.ResultsA total of 1942 reports, published online in the NIHR Journals Library were screened for eligibility, 118 reports of cRCTs met the initial inclusion criteria, of these 79 reports containing the results of 86 trials with 100 primary outcomes analysed were finally included. Two primary outcomes were analysed at the cluster-level using a generalized linear model. At the individual-level, the generalized linear mixed model was the most used statistical method (80%, 80/100), followed by regression with robust standard errors (7%) then generalized estimating equations (6%). Ninety-five percent (95/100) of the primary outcomes in the trials were analysed with appropriate statistical methods that accounted for clustering while 5% were not. The mean observed intracluster correlation coefficient (ICC) was 0.06 (SD, 0.12; range, - 0.02 to 0.63), and the median value was 0.02 (IQR, 0.001-0.060), although 42% of the observed ICCs for the analysed primary outcomes were not reported.ConclusionsIn practice, most of the publicly funded cluster trials adjusted for clustering using appropriate statistical method(s), with most of the primary analyses done at the individual level using generalized linear mixed models. However, the inadequate analysis and poor reporting of cluster trials published in the UK is still happening in recent times, despite the availability of the CONSORT reporting guidelines for cluster trials published over a decade ago.

Project description:BackgroundBuilding on an approach developed to assess the economic returns to cardiovascular research, we estimated the economic returns from UK public and charitable funded cancer-related research that arise from the net value of the improved health outcomes.MethodsTo assess these economic returns from cancer-related research in the UK we estimated: 1) public and charitable expenditure on cancer-related research in the UK from 1970 to 2009; 2) net monetary benefit (NMB), that is, the health benefit measured in quality adjusted life years (QALYs) valued in monetary terms (using a base-case value of a QALY of GB£25,000) minus the cost of delivering that benefit, for a prioritised list of interventions from 1991 to 2010; 3) the proportion of NMB attributable to UK research; 4) the elapsed time between research funding and health gain; and 5) the internal rate of return (IRR) from cancer-related research investments on health benefits. We analysed the uncertainties in the IRR estimate using sensitivity analyses to illustrate the effect of some key parameters.ResultsIn 2011/12 prices, total expenditure on cancer-related research from 1970 to 2009 was £15 billion. The NMB of the 5.9 million QALYs gained from the prioritised interventions from 1991 to 2010 was £124 billion. Calculation of the IRR incorporated an estimated elapsed time of 15 years. We related 17% of the annual NMB estimated to be attributable to UK research (for each of the 20 years 1991 to 2010) to 20 years of research investment 15 years earlier (that is, for 1976 to 1995). This produced a best-estimate IRR of 10%, compared with 9% previously estimated for cardiovascular disease research. The sensitivity analysis demonstrated the importance of smoking reduction as a major source of improved cancer-related health outcomes.ConclusionsWe have demonstrated a substantive IRR from net health gain to public and charitable funding of cancer-related research in the UK, and further validated the approach that we originally used in assessing the returns from cardiovascular research. In doing so, we have highlighted a number of weaknesses and key assumptions that need strengthening in further investigations. Nevertheless, these cautious estimates demonstrate that the returns from past cancer research have been substantial, and justify the investments made during the period 1976 to 1995.

Dataset Information

A systematic evaluation of payback of publicly funded health and health services research in Hong Kong.

Background

Methods

Results

Conclusion

Publications

A systematic evaluation of payback of publicly funded health and health services research in Hong Kong.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets