Private Data Release via Learning Thresholds

Type: Preprint

Publication Date: 2012-01-17

Citations: 24

DOI: https://doi.org/10.1137/1.9781611973099.15

Download PDF

Abstract

This work considers computationally efficient privacy-preserving data release. We study the task of analyzing a database containing sensitive information about individual participants. Given a set of statistical queries on the data, we want to release approximate answers to the queries while also guaranteeing differential privacy—protecting each participant's sensitive data.Our focus is on computationally efficient data release algorithms; we seek algorithms whose running time is polynomial, or at least sub-exponential, in the data dimensionality. Our primary contribution is a computationally efficient reduction from differentially private data release for a class of counting queries, to learning thresholded sums of predicates from a related class.We instantiate this general reduction with algorithms for learning thresholds, obtaining new results for differentially private data release. As two examples, taking {0, 1}d to be the data domain (of dimension d), we obtain differentially private algorithms for:1.Releasing all k-way conjunction counting queries (or k-way contingency tables). For any given k, the resulting data release algorithm has bounded error as long as the database is of size at least (ignoring the dependence on other parameters). The running time is polynomial in the database size. The best sub-exponential time algorithms known prior to our work required a database of size Õ (dk/2) [Dwork McSherry Nissim and Smith 2006].2.Releasing any family of counting queries that is specified by a constant depth AC0 predicate. This algorithm releases accurate answers to a (1 − γ)-fraction of the queries in the family. For any γ ≥ quasipoly (1/d), the algorithm has bounded error as long as the database is of size at least quasipoly(d) (again ignoring the dependence on other parameters). The running time is quasipoly(d).The first learning algorithm uses techniques for representing thresholded sums of predicates as lowdegree polynomial threshold functions. The second learning algorithm is based on a result of Jackson Klivans and Servedio [JKS 2002], and utilizes Fourier analysis of the database viewed as a function mapping queries to answers.

Locations

  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ Private Data Release via Learning Thresholds 2011 Moritz Hardt
Guy N. Rothblum
Rocco A. Servedio
+ PDF Chat Privately Releasing Conjunctions and the Statistical Query Barrier 2013 Anupam Gupta
Moritz Hardt
Aaron Roth
Jonathan Ullman
+ Privately Releasing Conjunctions and the Statistical Query Barrier 2010 Anupam Gupta
Moritz Hardt
Aaron Roth
Jonathan Ullman
+ Privately Releasing Conjunctions and the Statistical Query Barrier 2010 Anupam Gupta
Moritz Hardt
Aaron Roth
Jonathan Ullman
+ PDF Chat Differentially Private Release and Learning of Threshold Functions 2015 Mark Bun
Kobbi Nissim
Uri Stemmer
Salil Vadhan
+ Differentially Private Release and Learning of Threshold Functions 2015 Mark Bun
Kobbi Nissim
Uri Stemmer
Salil Vadhan
+ Differentially Private Publication of Sparse Data 2011 Graham Cormode
Magda Procopiuc
Divesh Srivastava
Thanh T. L. Tran
+ A simple and practical algorithm for differentially private data release 2010 Moritz Hardt
Katrina Ligett
Frank McSherry
+ PDF Chat Answering $n^2+o(1)$ Counting Queries with Differential Privacy is Hard 2016 Jonathan Ullman
+ Privately releasing conjunctions and the statistical query barrier 2011 Anupam Gupta
Moritz Hardt
Aaron Roth
Jonathan Ullman
+ Fast Private Data Release Algorithms for Sparse Queries 2011 Avrim Blum
Aaron Roth
+ Practical Differentially Private Top-$k$ Selection with Pay-what-you-get Composition 2019 David Durfee
Ryan Rogers
+ Practical Differentially Private Top-$k$ Selection with Pay-what-you-get Composition 2019 David Durfee
Ryan Rogers
+ Differentially Private Data Structures under Continual Observation for Histograms and Related Queries 2023 Monika Henzinger
A. R. Sricharan
Teresa Anna Steiner
+ Differentially Private Set Union 2020 Sivakanth Gopi
Pankaj Gulhane
Janardhan Kulkarni
Judy Hanwen Shen
Milad Shokouhi
Sergey Yekhanin
+ Differentially Private Set Union 2020 Sivakanth Gopi
Pankaj Gulhane
Janardhan Kulkarni
Judy Hanwen Shen
Milad Shokouhi
Sergey Yekhanin
+ Efficient Algorithms for Privately Releasing Marginals via Convex Relaxations 2013 Cynthia Dwork
Aleksandar Nikolov
Kunal Talwar
+ Efficient Algorithms for Privately Releasing Marginals via Convex Relaxations 2013 Cynthia Dwork
Aleksandar Nikolov
Kunal Talwar
+ Answering n^{2+o(1)} Counting Queries with Differential Privacy is Hard 2012 Jonathan Ullman
+ PDF Chat One-sided Differential Privacy 2020 Ios Kotsogiannis
Stelios Doudalis
Sam Haney
Ashwin Machanavajjhala
Sharad Mehrotra