AI & ML
Learning to Be Monitored: Causal Bounds and Intervention-Aware Post-Training Recipes for Chain-of-Thought Monitorability
arXiv stat.ML0 views
arXiv:2610.31733v1 Announce Type: cross Abstract: Chain-of-thought (CoT) monitoring aims to detect potentially harmful behaviors in large language models (LLMs) from their CoTs. Intervention-based evaluations measure this property by asking whether a monitor can detect the role of an intervention from the CoT when the targeted behavior occurs, typically using minimal-criterion sensitivity ($\mathsf{TPR_{mc}}$) proposed by~\citep{guan2025monitoring}. However, a target behavior observed under intervention is not necessarily caused by it, and we show that this metric can overestimate how often a monitor detects target behaviors actually caused by the intervention. Specifically, we establish $\mathsf{TPR_{mc}}$ as an upper bound on this causal detection rate and derive a complementary lower bound, which provides a tighter evaluation framework for CoT monitorability. With this framework, we study whether LLMs can be trained to make their CoTs easier to monitor. We first construct a training dataset of paired control--intervention tasks spanning multiple intervention types. Using the dataset, we design and apply three intervention-specific training methods based on off-policy self-distillation, reinforcement learning, and on-policy self-distillation to train separate variants of each base model. Across various model-monitor configurations, all three methods generally improve CoT monitorability over the corresponding base models under our extended evaluation framework. Our code is available at https://github.com/xinyue-lxy/learning-to-be-monitored.
Source:https://arxiv.org/abs/2610.31733PreviousOperationalising Weaker Faithfulness: Recovery, Ambiguity and Computational LimitsNextBayesian Propensity Score Predictive Inference for Extending Trial Findings to Target Populations
Related posts

The new and four-star-rated Bose QuietComfort Headphones are already down to a record-low price ahead of Black Friday
0TechRadar

AI may be the future, but customer experience must meet the price-point
0TechRadar

The cassette player renaissance continues with this Bluetooth-toting high-tech Kickstarter model
0TechRadar

FBI confirms it thinks North Korean hackers hit Binance in record cryptocurrency heist
0TechRadar

These 3 hand-cranked radios are affordable and offer extra features
0TechRadar

This new Windows malware steals all your data, then uses AI to rank how valuable you are as a victim
0TechRadar