R.I.P.
👻
Ghosted
Exploring Generalization in Deep Learning
June 27, 2017 · Declared Dead · 🏛 Neural Information Processing Systems
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Behnam Neyshabur, Srinadh Bhojanapalli, David McAllester, Nathan Srebro
arXiv ID
1706.08947
Category
cs.LG: Machine Learning
Citations
1.4K
Venue
Neural Information Processing Systems
Last Checked
1 month ago
Abstract
With a goal of understanding what drives generalization in deep networks, we consider several recently suggested explanations, including norm-based control, sharpness and robustness. We study how these measures can ensure generalization, highlighting the importance of scale normalization, and making a connection between sharpness and PAC-Bayes theory. We then investigate how well the measures explain different observed phenomena.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
📜 Similar Papers
In the same crypt — Machine Learning
R.I.P.
👻
Ghosted
XGBoost: A Scalable Tree Boosting System
R.I.P.
👻
Ghosted
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
R.I.P.
👻
Ghosted
Semi-Supervised Classification with Graph Convolutional Networks
R.I.P.
👻
Ghosted
Proximal Policy Optimization Algorithms
R.I.P.
👻
Ghosted
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Died the same way — 👻 Ghosted
R.I.P.
👻
Ghosted
Language Models are Few-Shot Learners
R.I.P.
👻
Ghosted
You Only Look Once: Unified, Real-Time Object Detection
R.I.P.
👻
Ghosted
A Unified Approach to Interpreting Model Predictions
R.I.P.
👻
Ghosted