Backend
HE-LRM: Encrypted Deep Learning Recommendation Models using Fully Homomorphic Encryption
arXiv cs.CR0 views
arXiv:2506.18150v5 Announce Type: replace Abstract: FHE inference systems primarily target models with dense inputs, while Deep Learning Recommendation Models (DLRMs) contain sparse categorical features that require lookups into embedding tables. Encrypted lookups are challenging because indexing is not natively supported and must be expressed using SIMD arithmetic. A direct one-hot formulation does not scale. Prior work addresses parts of this problem through embedding compression or compact encrypted queries. However, it does not address complete DLRM inference, leaving open how private lookup interacts with downstream computation and memory constraints. We present HE-LRM, the first end-to-end FHE system for private DLRM inference. We use deterministic compositional embedding compression with client-side digit decomposition, avoiding expensive homomorphic selector construction while consuming only one multiplicative level. We further develop a block-diagonal packing strategy that performs lookups across multiple embedding tables using optimized BSGS linear transformations and produces encrypted embeddings directly compatible with downstream inference. We extend Orion with a high-performance GPU backend and achieve 9 ms for single-inference embedding lookup. We also show that GPU memory capacity limits batching and therefore the latency-bound throughput in such systems. On Criteo, HE-LRM achieves complete encrypted inference with server-side latencies of 154-247 ms on a single GPU. We open-source HE-LRM at https://github.com/baahl-nyu/orion
Source:https://arxiv.org/abs/2506.18150PreviousPropose with the Gradient, Accept with the Loss: One Hedged Attack for Pixel-Sparse RobustnessNextPSM: Prompt Sensitivity Minimization via LLM-Guided Black-Box Optimization
Related posts
Your analytics export says more than you think (if you read it honestly)
0dev.to OpenSource
Tencent LoopForge: Turn Coding Agents Into Repeatable Software Delivery
0dev.to OpenSource
Your agent does not need more tools. It needs a checkpoint.
0dev.to OpenSource
NVIDIA SkillEvaluator 1.0.1: Test Agent Skills Before Shipping Them
0dev.to OpenSource
I routed Claude Code tasks to cheaper models. Here's what 15 requests saved. published: true tags: claudecode, ai, opensource, productivity
0dev.to OpenSource
Who Owns the Code AI Wrote?
0dev.to Programming