AI & ML
MemForm: Benchmarking Memory Formation Poisoning in LLM Agents
arXiv cs.CR0 views
arXiv:2610.14431v2 Announce Type: replace Abstract: Long-term memory enables LLM agents to learn from past interactions but exposes memory formation to adversarial influence. Existing studies primarily organize memory poisoning by attack channels, corruption patterns, or lifecycle stages, leaving formation interfaces insufficiently characterized. We formulate Memory Formation Poisoning as adversarial manipulation of the interfaces through which persistent agent memory is produced and committed, and introduce MemForm, a controlled diagnostic benchmark covering five interfaces: Content, Evidence, Scope, Selection, and Path Poisoning. We introduce Selection and Path Poisoning as controlled intervention categories that isolate retention and consolidation order effects, respectively. Each category pairs clean and poisoned conditions with interface-specific controls. Evaluations across six LLMs and two response formats reveal broad susceptibility at all five interfaces under the evaluated memory protocols and implementations. Crucially, authentic experiences with successful outcomes do not guarantee reliable behavior after memory formation: changes to contextual support, retention, or consolidation order can induce undesirable downstream behavior. In particular, consolidation order can alter behavior even with identical retained experiences, depending on the memory formation procedure. Additional analyses show that interface applicability depends on memory architecture and that Path Poisoning susceptibility depends on the updater. The evaluated defenses provide incomplete mitigation that varies by interface. These findings motivate protecting both what is committed to persistent memory and how memory is formed from experiences. Code and data are available at https://github.com/opanhw/memform-code.
Source:https://arxiv.org/abs/2610.14431PreviousUK AI Weekly: Claude Code’s privacy patch shows AI agents need privacy by defaultNextWhen appearance and motion disagree: evaluating class-motion consistency against disguised uncrewed surface vessels
Related posts

Warhammer 40,000: Dawn of War 4 creative director explains how core 40K tabletop features like ‘Armor of Contempt’ were adapted to the RTS — ‘It’s not the same mechanic, but it does kind of the same t
0TechRadar

'The progress is real': Deloitte report claims some firms are finally seeing return on AI investment — but still lack insight into what actually works
0TechRadar

Hideo Kojima says AI can’t replace human craftsmanship in video games
0TechRadar

Rogue AI tasked with renumbering pages accidentally deletes law professor's entire syllabus, one year of lecture notes
0Tom's Hardware

Nvidia wants to repurpose over 130 old telco buildings as tiny data centers, report claims
0Tom's Hardware

Apple confirms $7.5 billion bond sale following strong investor demand
09to5Mac