Privacy-preserving Learning via Deep Net Pruning

lib:c8e1fdf5a493c886 (v1.0.0)

Authors: Yangsibo Huang,Yushan Su,Sachin Ravi,Zhao Song,Sanjeev Arora,Kai Li
ArXiv: 2003.01876
Document:  PDF  DOI 
Abstract URL: https://arxiv.org/abs/2003.01876v1


This paper attempts to answer the question whether neural network pruning can be used as a tool to achieve differential privacy without losing much data utility. As a first step towards understanding the relationship between neural network pruning and differential privacy, this paper proves that pruning a given layer of the neural network is equivalent to adding a certain amount of differentially private noise to its hidden-layer activations. The paper also presents experimental results to show the practical implications of the theoretical finding and the key parameter values in a simple practical setting. These results show that neural network pruning can be a more effective alternative to adding differentially private noise for neural networks.

Relevant initiatives  

Related knowledge about this paper Reproduced results (crowd-benchmarking and competitions) Artifact and reproducibility checklists Common formats for research projects and shared artifacts Reproducibility initiatives

Comments  

Please log in to add your comments!
If you notice any inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!