Dataset Information

Data harmonization and data pooling from cohort studies: a practical approach for data management.

ABSTRACT: Data pooling from pre-existing datasets can be useful to increase study sample size and statistical power in order to answer a research question. However, individual datasets may contain variables that measure the same construct differently, posing challenges for data pooling. Variable harmonization, an approach that can generate comparable datasets from heterogeneous sources, can address this issue in some circumstances. As an illustrative example, this paper describes the data harmonization strategies that helped generate comparable datasets across two Canadian pregnancy cohort studies: All Our Families; and the Alberta Pregnancy Outcomes and Nutrition. Variables were harmonized considering multiple features across the datasets: the construct measured; question asked/response options; the measurement scale used; the frequency of measurement; timing of measurement, and the data structure. Completely matching, partially matching, and completely un-matching variables across the datasets were determined based on these features. Variables that were an exact match were pooled as is. Partially matching variables were harmonized or processed under a common format across the datasets considering the frequency of measurement, the timing of measurement, the measurement scale used, and response options. Variables that were completely unmatching could not be harmonized into a single variable. The variable harmonization strategies that were used to generate comparable cohort datasets for data pooling are applicable to other data sources. Future studies may employ or evaluate these strategies, which permit researchers to answer novel research questions in a statistically efficient, timely, and cost-efficient manner that could not be achieved using a single data source.

SUBMITTER: Adhikari K

PROVIDER: S-EPMC8631396 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundFactors influencing the health of populations are subjects of interdisciplinary study. However, datasets relevant to public health often lack interdisciplinary breath. It is difficult to combine data on health outcomes with datasets on potentially important contextual factors, like political violence or development, due to incompatible levels of geographic support; differing data formats and structures; differences in sampling procedures and wording; and the stability of temporal trends. We present a computational package to combine spatially misaligned datasets, and provide an illustrative analysis of multi-dimensional factors in health outcomes.MethodsWe rely on a new software toolkit, Sub-National Geospatial Data Archive (SUNGEO), to combine data across disciplinary domains and demonstrate a use case on vaccine hesitancy in Low and Middle-Income Countries (LMICs). We use data from the World Bank's High Frequency Phone Surveys (HFPS) from Kenya, Indonesia, and Malawi. We curate and combine these surveys with data on political violence, elections, economic development, and other contextual factors, using SUNGEO. We then develop a stochastic model to analyze the integrated data and evaluate 1) the stability of vaccination preferences in all three countries over time, and 2) the association between local contextual factors and vaccination preferences.ResultsIn all three countries, vaccine-acceptance is more persistent than vaccine-hesitancy from round to round: the long-run probability of staying vaccine-acceptant (hesitant) was 0.96 (0.65) in Indonesia, 0.89 (0.21) in Kenya, and 0.76 (0.40) in Malawi. However, vaccine acceptance was significantly less durable in areas exposed to political violence, with percentage point differences (ppd) in vaccine acceptance of -10 (Indonesia), -5 (Kenya), and -64 (Malawi). In Indonesia and Kenya, although not Malawi, vaccine acceptance was also significantly less durable in locations without competitive elections (-19 and -6 ppd, respectively) and in locations with more limited transportation infrastructure (-11 and -8 ppd).ConclusionWith SUNGEO, researchers can combine spatially misaligned and incompatible datasets. As an illustrative example, we find that vaccination hesitancy is correlated with political violence, electoral uncompetitiveness and limited access to public goods, consistent with past results that vaccination hesitancy is associated with government distrust.

Project description:BackgroundProper understanding of the roles of, and interactions between genetic, lifestyle, environmental and psycho-social factors in determining the risk of development and/or progression of chronic diseases requires access to very large high-quality databases. Because of the financial, technical and time burdens related to developing and maintaining very large studies, the scientific community is increasingly synthesizing data from multiple studies to construct large databases. However, the data items collected by individual studies must be inferentially equivalent to be meaningfully synthesized. The DataSchema and Harmonization Platform for Epidemiological Research (DataSHaPER; http://www.datashaper.org) was developed to enable the rigorous assessment of the inferential equivalence, i.e. the potential for harmonization, of selected information from individual studies.MethodsThis article examines the value of using the DataSHaPER for retrospective harmonization of established studies. Using the DataSHaPER approach, the potential to generate 148 harmonized variables from the questionnaires and physical measures collected in 53 large population-based studies (6.9 million participants) was assessed. Variable and study characteristics that might influence the potential for data synthesis were also explored.ResultsOut of all assessment items evaluated (148 variables for each of the 53 studies), 38% could be harmonized. Certain characteristics of variables (i.e. relative importance, individual targeted, reference period) and of studies (i.e. observational units, data collection start date and mode of questionnaire administration) were associated with the potential for harmonization. For example, for variables deemed to be essential, 62% of assessment items paired could be harmonized.ConclusionThe current article shows that the DataSHaPER provides an effective and flexible approach for the retrospective harmonization of information across studies. To implement data synthesis, some additional scientific, ethico-legal and technical considerations must be addressed. The success of the DataSHaPER as a harmonization approach will depend on its continuing development and on the rigour and extent of its use. The DataSHaPER has the potential to take us closer to a truly collaborative epidemiology and offers the promise of enhanced research potential generated through synthesized databases.

Dataset Information

Data harmonization and data pooling from cohort studies: a practical approach for data management.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets