AI & ML
Measuring Personal Information Exposure in Mental Health-Related Conversations with LLMs
arXiv cs.HC0 views
arXiv:2610.41045v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for informal mental health support, yet the privacy implications of conversational interaction remain poorly understood. Prior LLM privacy research has focused largely on model-side risks such as memorization and adversarial extraction, leaving personal information inferred from ordinary conversation understudied. We introduce a profile-recovery framework that measures personal information exposure by comparing user profiles with attributes inferred from conversation alone. We generate 240 synthetic multi-turn mental health conversations from profiles sampled from a nationally representative health survey and validate them against real counseling transcripts, finding comparable overall disclosure volume. Across 21 attributes, 33-41% of each profile is recoverable, with 76.5% first-inference and 94.3% any-of-3 accuracy. 239 of 240 conversations expose at least one sensitive mental health attribute, and 45.0\% expose all six. Our findings reveal a gap between disclosure and inferability, motivating HCI approaches to make inference risks legible and support privacy-aware interaction design.
Source:https://arxiv.org/abs/2610.41045PreviousRobot Navigation and Canine Welfare: A Pilot Study Surfacing Challenges for Cross-Species Legibility and Proxy Validity in Animal-Machine InteractionNextOut of sync: Accommodation, evaluation, and emergence in five weeks with an agentic AI teammate
Related posts
The model that wouldn't be forced
0dev.to

Kimi K3.1 Pro: 5,315 multilingual test results
0dev.to
Apple may try to increase revenue by doing…something with third-party AI apps
0TechCrunch
ChatGPT sent 116 people to one of our pages last week. The week before, it sent 7.
0dev.to
Wabi's features, in plain language: threads, mini-apps, widgets and shared chats
0dev.to
Exploring AIoT Applications in Commercial Construction
0dev.to