Dataset Information

Comparative case study of two biomedical research collaboratories.

ABSTRACT:

Background

Working together efficiently and effectively presents a significant challenge in large-scale, complex, interdisciplinary research projects. Collaboratories are a nascent method to help meet this challenge. However, formal collaboratories in biomedical research centers are the exception rather than the rule.

Objective

The main purpose of this paper is to compare and describe two collaboratories that used off-the-shelf tools and relatively modest resources to support the scientific activity of two biomedical research centers. The two centers were the Great Lakes Regional Center for AIDS Research (HIV/AIDS Center) and the New York University Oral Cancer Research for Adolescent and Adult Health Promotion Center (Oral Cancer Center).

Methods

In each collaboratory, we used semistructured interviews, surveys, and contextual inquiry to assess user needs and define the technology requirements. We evaluated and selected commercial software applications by comparing their feature sets with requirements and then pilot-testing the applications. Local and remote support staff cooperated in the implementation and end user training for the collaborative tools. Collaboratory staff evaluated each implementation by analyzing utilization data, administering user surveys, and functioning as participant observers.

Results

The HIV/AIDS Center primarily required real-time interaction for developing projects and attracting new participants to the center; the Oral Cancer Center, on the other hand, mainly needed tools to support distributed and asynchronous work in small research groups. The HIV/AIDS Center's collaboratory included a center-wide website that also served as the launch point for collaboratory applications, such as NetMeeting, Timbuktu Conference, PlaceWare Auditorium, and iVisit. The collaboratory of the Oral Cancer Center used Groove and Genesys Web conferencing. The HIV/AIDS Center was successful in attracting new scientists to HIV/AIDS research, and members used the collaboratory for developing and implementing new research studies. The Oral Cancer Center successfully supported highly distributed and asynchronous research, and the collaboratory facilitated real-time interaction for analyzing data and preparing publications.

Conclusions

The two collaboratory implementations demonstrated the feasibility of supporting biomedical research centers using off-the-shelf commercial tools, but they also identified several barriers to successful collaboration. These barriers included computing platform incompatibilities, network infrastructure complexity, variable availability of local versus remote IT support, low computer and collaborative software literacy, and insufficient maturity of available collaborative software. Factors enabling collaboratory use included collaboration incentives through funding mechanism, a collaborative versus competitive relationship of researchers, leadership by example, and tools well matched to tasks and technical progress. Integrating electronic collaborative tools into routine scientific practice can be successful but requires further research on the technical, social, and behavioral factors influencing the adoption and use of collaboratories.

SUBMITTER: Schleyer TK

PROVIDER: S-EPMC1408071 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundVariable selection for regression models plays a key role in the analysis of biomedical data. However, inference after selection is not covered by classical statistical frequentist theory, which assumes a fixed set of covariates in the model. This leads to over-optimistic selection and replicability issues.MethodsWe compared proposals for selective inference targeting the submodel parameters of the Lasso and its extension, the adaptive Lasso: sample splitting, selective inference conditional on the Lasso selection (SI), and universally valid post-selection inference (PoSI). We studied the properties of the proposed selective confidence intervals available via R software packages using a neutral simulation study inspired by real data commonly seen in biomedical studies. Furthermore, we present an exemplary application of these methods to a publicly available dataset to discuss their practical usability.ResultsFrequentist properties of selective confidence intervals by the SI method were generally acceptable, but the claimed selective coverage levels were not attained in all scenarios, in particular with the adaptive Lasso. The actual coverage of the extremely conservative PoSI method exceeded the nominal levels, and this method also required the greatest computational effort. Sample splitting achieved acceptable actual selective coverage levels, but the method is inefficient and leads to less accurate point estimates. The choice of inference method had a large impact on the resulting interval estimates, thereby necessitating that the user is acutely aware of the goal of inference in order to interpret and communicate the results.ConclusionsDespite violating nominal coverage levels in some scenarios, selective inference conditional on the Lasso selection is our recommended approach for most cases. If simplicity is strongly favoured over efficiency, then sample splitting is an alternative. If only few predictors undergo variable selection (i.e. up to 5) or the avoidance of false positive claims of significance is a concern, then the conservative approach of PoSI may be useful. For the adaptive Lasso, SI should be avoided and only PoSI and sample splitting are recommended. In summary, we find selective inference useful to assess the uncertainties in the importance of individual selected predictors for future applications.

Project description:Quantifying the value of investment in medical research can inform decision-making on the prioritisation of research programmes. Existing methodologies to estimate the rate of return of medical research are inappropriate for early-phase translational research due to censoring of health benefits and time lags. A strategy to improve the process of translational research for patient benefit has been initiated as part of the UK National Institute for Health Research (NIHR) investment in Biomedical Research Centres (BRCs) in England. By providing a platform for partnership between universities, NHS trusts and industry, successful BRCs should reduce time lags within translational research whilst also providing an impetus for local economic growth through industry collaboration. We present a novel contribution in the assessment of early-phase biomedical research by estimating the impact of the Oxford Biomedical Research Centre (OxBRC) on income and job creation following the initial NIHR investment. We adopt a macroeconomic assessment approach using Input-Output Analysis to estimate the value of medical research in terms of income and job creation during the early pathway towards translational biomedical research. Inter-industry linkages are assessed by building a model economy for the South East England region to estimate the return on investment of the OxBRC. The results from the input-output model estimate that the return on investment in biomedical research within the OxBRC is 46%. Each £1 invested in the OxBRC generates an additional £0.46 through income and job creation alone. Multiplicative employment effects following a marginal investment in the OxBRC of £98m during the period 2007-2017 result in an estimated additional 196 full time equivalent positions being created within the local economy on top of direct employment within OxBRC. Results from input-output analyses can be used to inform the prioritisation of biomedical research programmes when compared against national minimum thresholds of investment.

Project description:BackgroundThe quality of biomedical reporting is guided by statements of several organizations. Although not all journals adhere to these guidelines, those that do demonstrate "editorial leadership" in their author community. To investigate a possible relationship between editorial leadership and journal quality, research journals from two European countries, one Anglophone and one non-Anglophone, were studied and compared. Quality was measured on a panel of bibliometric parameters while editorial leadership was evaluated from journals' instructions to authors.Methodology/principal findingsThe study considered all 76 Italian journals indexed in Medline and 76 randomly chosen UK journals; only journals both edited and published in these countries were studied. Compared to UK journals, Italian journals published fewer papers (median, 60 vs. 93; p = 0.006), less often had online archives (43 vs. 74; p<0.001) and had lower median values of impact factor (1.2 vs. 2.7, p<0.001) and SCImago journal rank (0.09 vs. 0.25, p<0.001). Regarding editorial leadership, Italian journals less frequently required manuscripts to specify competing interests (p<0.001), authors' contributions (p = 0.005), funding (p<0.001), informed consent (p<0.001), ethics committee review (p<0.001). No Italian journal adhered to COPE or the CONSORT and QUOROM statements nor required clinical trial registration, while these characteristics were observed in 15%-43% of UK journals (p<0.001). At multiple regression, editorial leadership predicted 37.1%-49.9% of the variance in journal quality defined by citation statistics (p<0.0001); confounding variables inherent to a cross-cultural comparison had a relatively small contribution, explaining an additional 6.2%-13.8% of the variance.Conclusions/significanceJournals from Italy scored worse for quality and editorial leadership than did their UK counterparts. Editorial leadership predicted quality for the entire set of journals. Greater appreciation of international initiatives to improve biomedical reporting may help low-quality journals achieve higher status.

Project description:OBJECTIVE:To measure the frequency of adequate methods, inadequate methods and poor reporting in published randomised controlled trials (RCTs) and test potential factors associated with adequacy of methods and reporting. DESIGN:Retrospective analysis of RCTs included in Cochrane reviews. Time series describes the proportion of RCTs using adequate methods, inadequate methods and poor reporting. A multinomial logit model tests potential factors associated with methods and reporting, including funding source, first author affiliation, clinical trial registration status, study novelty, team characteristics, technology and geography. DATA:Risk of bias assessments for random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data and selective reporting, for each RCT, were mapped to bibliometric and funding data. OUTCOMES:Risk of bias on six methodological dimensions and RCT-level overall assessment of adequate methods, inadequate methods or poor reporting. RESULTS:This study analysed 20 571 RCTs. 5.7% of RCTs used adequate methods (N=1173). 59.3% used inadequate methods (N=12 190) and 35.0% were poorly reported (N=7208). The proportion of poorly reported RCTs decreased from 42.5% in 1990 to 30.2% in 2015. The proportion of RCTs using adequate methods increased from 2.6% in 1990 to 10.3% in 2015. The proportion of RCTs using inadequate methods increased from 54.9% in 1990 to 59.5% in 2015. Industry funding, top pharmaceutical company affiliation, trial registration, larger authorship teams, international teams and drug trials were associated with a greater likelihood of using adequate methods. National Institutes of Health funding and university prestige were not. CONCLUSION:Even though reporting has improved since 1990, the proportion of RCTs using inadequate methods is high (59.3%) and increasing, potentially slowing progress and contributing to the reproducibility crisis. Stronger incentives for the use of adequate methods are needed.

Project description:IntroductionHealthcare service redesign and improvement has become an important activity that health system leaders and clinicians realise must be nurtured and mastered, if the capacity issues that constrain healthcare delivery are to be solved. However, little is known about the critical success factors that are essential for sustaining and scaling up improvement initiatives. This situation limits the impact of these initiatives and undermines the general standing of redesign and improvement activity within healthcare systems. The conduct of the doctoral research detailed in this study protocol will be nested within a broader parent study that seeks to address this problem by drawing on the theory of 'institutional entrepreneurship'. The doctoral research will apply this idea to understanding the capacities and capabilities required at the organisation level to bring about transformational change in healthcare services.Methods and analysisThe parent study is predominantly qualitative, is multilevel in nature and has been codesigned with five partner healthcare organisations. The focus is a sector-wide attempt in an Australian state jurisdiction to transfer new redesign and improvement knowledge into the public healthcare system. The doctoral research will focus on the implementation of the sector-wide approach in one healthcare service in the jurisdiction. This research involves interviews with project team members and stakeholders involved in two improvement initiatives undertaken by the health service. It will involve interviews with redesign and improvement leaders and senior managers responsible for the overall health service improvement approach. The methods will also include immersive fieldwork, interviews and focus groups. Appropriate methods for coding and thematic extraction will be applied to the qualitative data.Ethics and disseminationEthical approval has been granted by the health service and Monash University Human Research Ethics Committee. Dissemination will be facilitated via academic publication, industry reports and workshops and dissemination events as part of the broader project.