Dataset Information

Differentially private distributed logistic regression using private and public data.

ABSTRACT:

Background

Privacy protecting is an important issue in medical informatics and differential privacy is a state-of-the-art framework for data privacy research. Differential privacy offers provable privacy against attackers who have auxiliary information, and can be applied to data mining models (for example, logistic regression). However, differentially private methods sometimes introduce too much noise and make outputs less useful. Given available public data in medical research (e.g. from patients who sign open-consent agreements), we can design algorithms that use both public and private data sets to decrease the amount of noise that is introduced.

Methodology

In this paper, we modify the update step in Newton-Raphson method to propose a differentially private distributed logistic regression model based on both public and private data.

Experiments and results

We try our algorithm on three different data sets, and show its advantage over: (1) a logistic regression model based solely on public data, and (2) a differentially private distributed logistic regression model based on private data under various scenarios.

Conclusion

Logistic regression models built with our new algorithm based on both private and public datasets demonstrate better utility than models that trained on private or public datasets alone without sacrificing the rigorous privacy guarantee.

SUBMITTER: Ji Z

PROVIDER: S-EPMC4101668 | biostudies-literature | 2014

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Differentially private distributed logistic regression using private and public data.

Ji Zhanglong Z Jiang Xiaoqian X Wang Shuang S Xiong Li L Ohno-Machado Lucila L

BMC medical genomics 20140508

<h4>Background</h4>Privacy protecting is an important issue in medical informatics and differential privacy is a state-of-the-art framework for data privacy research. Differential privacy offers provable privacy against attackers who have auxiliary information, and can be applied to data mining models (for example, logistic regression). However, differentially private methods sometimes introduce too much noise and make outputs less useful. Given available public data in medical research (e.g. fr ...[more]

PMID: 25079786

Similar Datasets

Project description:BackgroundThere is limited capacity to assess the comparative risks of medications after they enter the market. For rare adverse events, the pooling of data from multiple sources is necessary to have the power and sufficient population heterogeneity to detect differences in safety and effectiveness in genetic, ethnic and clinically defined subpopulations. However, combining datasets from different data custodians or jurisdictions to perform an analysis on the pooled data creates significant privacy concerns that would need to be addressed. Existing protocols for addressing these concerns can result in reduced analysis accuracy and can allow sensitive information to leak.ObjectiveTo develop a secure distributed multi-party computation protocol for logistic regression that provides strong privacy guarantees.MethodsWe developed a secure distributed logistic regression protocol using a single analysis center with multiple sites providing data. A theoretical security analysis demonstrates that the protocol is robust to plausible collusion attacks and does not allow the parties to gain new information from the data that are exchanged among them. The computational performance and accuracy of the protocol were evaluated on simulated datasets.ResultsThe computational performance scales linearly as the dataset sizes increase. The addition of sites results in an exponential growth in computation time. However, for up to five sites, the time is still short and would not affect practical applications. The model parameters are the same as the results on pooled raw data analyzed in SAS, demonstrating high model accuracy.ConclusionThe proposed protocol and prototype system would allow the development of logistic regression models in a secure manner without requiring the sharing of personal health information. This can alleviate one of the key barriers to the establishment of large-scale post-marketing surveillance programs. We extended the secure protocol to account for correlations among patients within sites through generalized estimating equations, and to accommodate other link functions by extending it to generalized linear models.

Project description:The objective of this work is to advance the understanding of helicopter accidents by examining and quantifying the association between helicopter-specific configurations (number of main rotor blades, number of engines, rotor diameter, and takeoff weight) and the likelihood of accidents. We leverage a dataset of 8,338 turboshaft helicopters in the U.S. civil fleet and 825 accidents from 2005 to 2015. We use the dataset to develop a logistic regression model using the method of purposeful selection, which we exploit for inferential purposes and highlight the novel insights it reveals. For example, one important question for the design and acquisition of helicopters is whether twin-engine turboshaft helicopters exhibit a smaller likelihood of accidents than their single-engine counterparts, all else being equal. The evidence-based result we derive indicates that the answer is contingent on other covariates, and that a tipping point exists in terms of the rotor diameter beyond which the likelihood of accidents of twin-engines is higher (worse) than that of their single-engine counterparts. Another important result derived here is the association between the number of main rotor blades and likelihood of accidents. We found that for single-engine turboshaft helicopters, the four-bladed ones are associated with the lowest likelihood of accidents. We also identified a clear coupling between the number of engines and the rotor diameter in terms of likelihood of accidents. In summary, we establish important relationships between the different helicopter configurations here considered and the likelihood of accident, but these are associations, not causal in nature. The causal pathway, if it exists, may be confounded or mediated by other variables not accounted for here. The results provided here lend themselves to a rich set of interpretive possibilities, and because of their significant safety implications they deserve careful attention from the rotorcraft community.

Dataset Information

Differentially private distributed logistic regression using private and public data.

Background

Methodology

Experiments and results

Conclusion

Publications

Differentially private distributed logistic regression using private and public data.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure