๐
๐
The Cartographer
FLARE-AI: Flaw Reporting for AI
June 30, 2026 ยท Grace Period ยท ๐ ICML 2026
Authors
Shayne Longpre, Elaine Zhu, Carson Ezell, Avijit Ghosh, Sean McGregor, Kevin Paeth, Kevin Klyman, Sayash Kapoor, Rishi Bommasani, Ruth Appel, Gregory Strom, Lauren McIlvenny, Mark M. Jaycox, Peter Slattery, Nathan Butters, Arvind Narayanan, Percy Liang, Alex Pentland
arXiv ID
2606.31567
Category
cs.CY: Computers & Society
Cross-listed
cs.AI
Citations
0
Venue
ICML 2026
Abstract
Flaw reporting for deployed AI systems is fundamental to identifying system failures and improving AI safety. Yet the AI reporting ecosystem is fragmented: researchers who identify flaws often do not know what or where to report, and groups who receive reports rarely share them with other relevant stakeholders. As a result, good-faith reporters duplicate effort by submitting many different forms, and recipients lack standardized, triage-ready information. We audit 12 reporting systems published by AI developers, cybersecurity groups, and AI flaw aggregators, identifying five recurring design challenges spanning discoverability, scope, information collection, coordination, and guidance for strict-liability cases. Building on this analysis and feedback from 49 experts across 32 organizations representing developers, security researchers, and ecosystem coordinators, we introduce FLARE-AI, an open-source AI flaw reporting system designed for interoperability with existing systems. FLARE-AI streamlines flaw report creation by collecting triage-relevant information through conditional logic and early classification, then enables optional dissemination of standardized, machine-readable reports to multiple developers, coordinators, and incident registries from a single submission. By lowering barriers to reporting AI flaws and improving interoperability across stakeholders, FLARE-AI helps break down silos and accelerate remediation across the AI ecosystem.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
๐ Similar Papers
In the same crypt โ Computers & Society
R.I.P.
๐ป
Ghosted
Artificial Intelligence: the global landscape of ethics guidelines
R.I.P.
๐ป
Ghosted
The role of artificial intelligence in achieving the Sustainable Development Goals
R.I.P.
๐ป
Ghosted
Green AI
R.I.P.
๐ป
Ghosted
Principles alone cannot guarantee ethical AI
R.I.P.
๐ป
Ghosted