Stable Attractors for Neural networks classification via Ordinary Differential Equations (SA-nODE)
November 17, 2023 Β· Declared Dead Β· π Machine Learning: Science and Technology
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Raffaele Marino, Lorenzo Giambagli, Lorenzo Chicchi, Lorenzo Buffoni, Duccio Fanelli
arXiv ID
2311.10387
Category
cond-mat.dis-nn
Cross-listed
cond-mat.stat-mech,
cs.AI,
cs.LG
Citations
8
Venue
Machine Learning: Science and Technology
Last Checked
6 months ago
Abstract
A novel approach for supervised classification is presented which sits at the intersection of machine learning and dynamical systems theory. At variance with other methodologies that employ ordinary differential equations for classification purposes, the untrained model is a priori constructed to accommodate for a set of pre-assigned stationary stable attractors. Classifying amounts to steer the dynamics towards one of the planted attractors, depending on the specificity of the processed item supplied as an input. Asymptotically the system will hence converge on a specific point of the explored multi-dimensional space, flagging the category of the object to be eventually classified. Working in this context, the inherent ability to perform classification, as acquired ex post by the trained model, is ultimately reflected in the shaped basin of attractions associated to each of the target stable attractors. The performance of the proposed method is here challenged against simple toy models crafted for the purpose, as well as by resorting to well established reference standards. Although this method does not reach the performance of state-of-the-art deep learning algorithms, it illustrates that continuous dynamical systems with closed analytical interaction terms can serve as high-performance classifiers.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
π Similar Papers
In the same crypt β cond-mat.dis-nn
R.I.P.
π»
Ghosted
R.I.P.
π»
Ghosted
Mutual Information, Neural Networks and the Renormalization Group
R.I.P.
π»
Ghosted
Machine learning meets network science: dimensionality reduction for fast and efficient embedding of networks in the hyperbolic space
R.I.P.
π»
Ghosted
Classification and Geometry of General Perceptual Manifolds
R.I.P.
π»
Ghosted
The jamming transition as a paradigm to understand the loss landscape of deep neural networks
R.I.P.
π»
Ghosted
Criticality in Formal Languages and Statistical Physics
Died the same way β π» Ghosted
R.I.P.
π»
Ghosted
Federated Learning: Strategies for Improving Communication Efficiency
R.I.P.
π»
Ghosted
In-Datacenter Performance Analysis of a Tensor Processing Unit
R.I.P.
π»
Ghosted
Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning
R.I.P.
π»
Ghosted