Speeding simulation analysis up with yt and Intel Distribution for Python
October 17, 2019 ยท Declared Dead ยท ๐ arXiv.org
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Salvatore Cielo, Luigi Iapichino, Fabio Baruffa
arXiv ID
1910.07855
Category
astro-ph.IM
Cross-listed
cs.DC,
cs.PF
Citations
2
Venue
arXiv.org
Last Checked
1 month ago
Abstract
As modern scientific simulations grow ever more in size and complexity, even their analysis and post-processing becomes increasingly demanding, calling for the use of HPC resources and methods. yt is a parallel, open source post-processing python package for numerical simulations in astrophysics, made popular by its cross-format compatibility, its active community of developers and its integration with several other professional Python instruments. The Intel Distribution for Python enhances yt's performance and parallel scalability, through the optimization of lower-level libraries Numpy and Scipy, which make use of the optimized Intel Math Kernel Library (Intel-MKL) and the Intel MPI library for distributed computing. The library package yt is used for several analysis tasks, including integration of derived quantities, volumetric rendering, 2D phase plots, cosmological halo analysis and production of synthetic X-ray observation. In this paper, we provide a brief tutorial for the installation of yt and the Intel Distribution for Python, and the execution of each analysis task. Compared to the Anaconda python distribution, using the provided solution one can achieve net speedups up to 4.6x on Intel Xeon Scalable processors (codename Skylake).
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
๐ Similar Papers
In the same crypt โ astro-ph.IM
R.I.P.
๐ป
Ghosted
R.I.P.
๐ป
Ghosted
Deep Neural Networks to Enable Real-time Multimessenger Astrophysics
๐
๐
Old Age
Star-galaxy Classification Using Deep Convolutional Neural Networks
R.I.P.
๐ป
Ghosted
CosmoGAN: creating high-fidelity weak lensing convergence maps using Generative Adversarial Networks
R.I.P.
๐ป
Ghosted
Non-negative Matrix Factorization: Robust Extraction of Extended Structures
R.I.P.
๐
404 Not Found
Deep Recurrent Neural Networks for Supernovae Classification
Died the same way โ ๐ป Ghosted
R.I.P.
๐ป
Ghosted
Language Models are Few-Shot Learners
R.I.P.
๐ป
Ghosted
PyTorch: An Imperative Style, High-Performance Deep Learning Library
R.I.P.
๐ป
Ghosted
XGBoost: A Scalable Tree Boosting System
R.I.P.
๐ป
Ghosted