AI & ML
Secure Speculative Decoding for Large Language Models
arXiv cs.CR0 views
arXiv:2610.08678v1 Announce Type: new Abstract: Speculative decoding accelerates inference for a large language model (LLM), referred to as the \emph{target model}, by first using a smaller model, referred to as the \emph{draft model}, to generate candidate tokens and then verifying them with the target model for acceptance or rejection. Prior studies primarily focused on the efficiency-utility trade-off of speculative decoding, e.g., lossy speculative decoding, leaving its security implications largely unexplored. In this work, we bridge this gap by providing the \emph{first} systematic study of the security implications of speculative decoding. Through a large-scale measurement study, we reveal a pronounced security-utility asymmetry: across a wide range of lossy speculative decoding methods, improvements in inference efficiency come at a disproportionately high cost to security, with attack success rates for jailbreak and prompt injection attacks increasing much faster than utility degrades. We then propose SecureSD, a new theory-guided speculative decoding method that enhances security while maintaining efficiency and utility. Specifically, our theoretical analysis reveals that security degradation primarily originates from the early tokens generated by the draft model. Motivated by this insight, SecureSD applies a stricter verification criterion to draft-model tokens at early decoding positions. Extensive experiments on both security and utility benchmarks demonstrate that SecureSD significantly improves security while preserving efficiency and utility compared to existing speculative decoding methods.
Source:https://arxiv.org/abs/2610.08678PreviousSemantic Behavioral Watermarking: Paraphrase-Robust and Forgery-Resistant Provenance for LLM AgentsNextBARE-AI: Bit-Flip Attack Resilience in AI Hardware through Built-in Performance Monitors
Related posts
7.9% to 48.1%: LLM rewrote Qwen weights, no training
0dev.to
Spousal Open Work Permits in Canada: Who Qualifies in 2026 and What to Prepare
0dev.to
Reading ingredient lists from phone photos: a crop bug, a model bench, and why the AI never gives the verdict
0dev.to
Edital exige guardrail
0dev.to
Convert an SVG to a PNG in the Browser, Without Uploading the File
0dev.to
Generative Simulation Benchmarking for planetary geology survey missions for extreme data sparsity scenarios
0dev.to