Coresets for Regressions with Panel Data

November 02, 2020 · Entered Twilight · 🏛 Neural Information Processing Systems

"Last commit was 5.0 years ago (≥5 year threshold)"

Evidence collected by the PWNC Scanner

Repo contents: README.md, coreset.py, emp1_realworld.csv, emp1_synthetic.csv, evaluation.py, generate.py, l2_regression.py, main_realworld.py, main_synthetic.py, optimization.py, readdata.py, realworld.npy, result1_realworld.csv, result1_synthetic_cauchy.csv, result1_synthetic_gaussian.csv, synthetic_cauchy.npy, synthetic_gaussian.npy

Authors Lingxiao Huang, K. Sudhir, Nisheeth K. Vishnoi arXiv ID 2011.00981 Category cs.LG: Machine Learning Cross-listed cs.CG, cs.DS, econ.EM, stat.ML Citations 13 Venue Neural Information Processing Systems Repository https://github.com/huanglx12/Coresets-for-regressions-with-panel-data Last Checked 1 month ago

Abstract

This paper introduces the problem of coresets for regression problems to panel data settings. We first define coresets for several variants of regression problems with panel data and then present efficient algorithms to construct coresets of size that depend polynomially on 1/$\varepsilon$ (where $\varepsilon$ is the error parameter) and the number of regression parameters - independent of the number of individuals in the panel data or the time units each individual is observed for. Our approach is based on the Feldman-Langberg framework in which a key step is to upper bound the "total sensitivity" that is roughly the sum of maximum influences of all individual-time pairs taken over all possible choices of regression parameters. Empirically, we assess our approach with synthetic and real-world datasets; the coreset sizes constructed using our approach are much smaller than the full dataset and coresets indeed accelerate the running time of computing the regression objective.