An Interventional Perspective on Identifiability in Gaussian LTI Systems with Independent Component Analysis
November 29, 2023 ยท Entered Twilight ยท ๐ CLEaR
Repo contents: .github, .gitignore, .gitmodules, .pre-commit-config.yaml, CITATION.cff, LICENSE, README.md, analysis, configs, lti_ica, requirements.txt, scripts, setup.cfg, setup.py, state_space_models, sweeps, tests
Authors
Goutham Rajendran, Patrik Reizinger, Wieland Brendel, Pradeep Ravikumar
arXiv ID
2311.18048
Category
cs.LG: Machine Learning
Cross-listed
cs.CE,
eess.SY,
stat.ME
Citations
9
Venue
CLEaR
Repository
https://github.com/rpatrik96/lti-ica
โญ 2
Last Checked
6 months ago
Abstract
We investigate the relationship between system identification and intervention design in dynamical systems. While previous research demonstrated how identifiable representation learning methods, such as Independent Component Analysis (ICA), can reveal cause-effect relationships, it relied on a passive perspective without considering how to collect data. Our work shows that in Gaussian Linear Time-Invariant (LTI) systems, the system parameters can be identified by introducing diverse intervention signals in a multi-environment setting. By harnessing appropriate diversity assumptions motivated by the ICA literature, our findings connect experiment design and representational identifiability in dynamical systems. We corroborate our findings on synthetic and (simulated) physical data. Additionally, we show that Hidden Markov Models, in general, and (Gaussian) LTI systems, in particular, fulfil a generalization of the Causal de Finetti theorem with continuous parameters.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
๐ Similar Papers
In the same crypt โ Machine Learning
๐ฎ
๐ฎ
The Ethereal
๐ฎ
๐ฎ
The Ethereal
Continuous control with deep reinforcement learning
๐
๐
Old Age
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
๐
๐
Old Age
Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor
๐
๐
Old Age
SGDR: Stochastic Gradient Descent with Warm Restarts
๐ฎ
๐ฎ
The Ethereal