Exploring User Security and Privacy Attitudes and Concerns Toward the Use of General-Purpose LLM Chatbots for Mental Health
July 14, 2025 Β· Declared Dead Β· π USENIX Security Symposium
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Jabari Kwesi, Jiaxun Cao, Riya Manchanda, Pardis Emami-Naeini
arXiv ID
2507.10695
Category
cs.CY: Computers & Society
Cross-listed
cs.AI,
cs.CR,
cs.ET,
cs.HC
Citations
10
Venue
USENIX Security Symposium
Last Checked
4 months ago
Abstract
Individuals are increasingly relying on large language model (LLM)-enabled conversational agents for emotional support. While prior research has examined privacy and security issues in chatbots specifically designed for mental health purposes, these chatbots are overwhelmingly "rule-based" offerings that do not leverage generative AI. Little empirical research currently measures users' privacy and security concerns, attitudes, and expectations when using general-purpose LLM-enabled chatbots to manage and improve mental health. Through 21 semi-structured interviews with U.S. participants, we identified critical misconceptions and a general lack of risk awareness. Participants conflated the human-like empathy exhibited by LLMs with human-like accountability and mistakenly believed that their interactions with these chatbots were safeguarded by the same regulations (e.g., HIPAA) as disclosures with a licensed therapist. We introduce the concept of "intangible vulnerability," where emotional or psychological disclosures are undervalued compared to more tangible forms of information (e.g., financial or location-based data). To address this, we propose recommendations to safeguard user mental health disclosures with general-purpose LLM-enabled chatbots more effectively.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
π Similar Papers
In the same crypt β Computers & Society
π
π
The Cartographer
R.I.P.
π»
Ghosted
Artificial Intelligence: the global landscape of ethics guidelines
R.I.P.
π»
Ghosted
The role of artificial intelligence in achieving the Sustainable Development Goals
R.I.P.
π»
Ghosted
Green AI
R.I.P.
π»
Ghosted
Principles alone cannot guarantee ethical AI
R.I.P.
π»
Ghosted
Tackling Climate Change with Machine Learning
Died the same way β π» Ghosted
R.I.P.
π»
Ghosted
Federated Learning: Strategies for Improving Communication Efficiency
R.I.P.
π»
Ghosted
In-Datacenter Performance Analysis of a Tensor Processing Unit
R.I.P.
π»
Ghosted
Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning
R.I.P.
π»
Ghosted