Monte Carlo Techniques for Addressing Large Errors and Missing Data in Simulation-based Inference
November 07, 2022 ยท Declared Dead ยท ๐ arXiv.org
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Bingjie Wang, Joel Leja, Ashley Villar, Joshua S. Speagle
arXiv ID
2211.03747
Category
astro-ph.IM
Cross-listed
astro-ph.GA,
cs.LG
Citations
2
Venue
arXiv.org
Last Checked
1 month ago
Abstract
Upcoming astronomical surveys will observe billions of galaxies across cosmic time, providing a unique opportunity to map the many pathways of galaxy assembly to an incredibly high resolution. However, the huge amount of data also poses an immediate computational challenge: current tools for inferring parameters from the light of galaxies take $\gtrsim 10$ hours per fit. This is prohibitively expensive. Simulation-based Inference (SBI) is a promising solution. However, it requires simulated data with identical characteristics to the observed data, whereas real astronomical surveys are often highly heterogeneous, with missing observations and variable uncertainties determined by sky and telescope conditions. Here we present a Monte Carlo technique for treating out-of-distribution measurement errors and missing data using standard SBI tools. We show that out-of-distribution measurement errors can be approximated by using standard SBI evaluations, and that missing data can be marginalized over using SBI evaluations over nearby data realizations in the training set. While these techniques slow the inference process from $\sim 1$ sec to $\sim 1.5$ min per object, this is still significantly faster than standard approaches while also dramatically expanding the applicability of SBI. This expanded regime has broad implications for future applications to astronomical surveys.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
๐ Similar Papers
In the same crypt โ astro-ph.IM
R.I.P.
๐ป
Ghosted
R.I.P.
๐ป
Ghosted
Deep Neural Networks to Enable Real-time Multimessenger Astrophysics
๐
๐
Old Age
Star-galaxy Classification Using Deep Convolutional Neural Networks
R.I.P.
๐ป
Ghosted
CosmoGAN: creating high-fidelity weak lensing convergence maps using Generative Adversarial Networks
R.I.P.
๐ป
Ghosted
Non-negative Matrix Factorization: Robust Extraction of Extended Structures
R.I.P.
๐
404 Not Found
Deep Recurrent Neural Networks for Supernovae Classification
Died the same way โ ๐ป Ghosted
R.I.P.
๐ป
Ghosted
Language Models are Few-Shot Learners
R.I.P.
๐ป
Ghosted
PyTorch: An Imperative Style, High-Performance Deep Learning Library
R.I.P.
๐ป
Ghosted
XGBoost: A Scalable Tree Boosting System
R.I.P.
๐ป
Ghosted