Open Source
Rendering-Free Event Frame Simulation for Fast Reinforcement Learning of Autonomous Robot Navigation
arXiv cs.RO0 views
arXiv:2610.37543v1 Announce Type: new Abstract: Event cameras offer low latency, high dynamic range, and milliwatt-level power consumption, making them ideal for agile robots such as tiny drones navigating through cluttered environments. However, existing simulators generally render photorealistic images before converting them into events, making large-scale reinforcement learning prohibitively slow. We propose an analytic event simulator that exploits what event cameras fundamentally measure - moving contrast edges - to synthesize event streams directly from scene geometry and ego-motion without visual rendering. Our simulator generates a 64x64 event observation in 17 microseconds on a single GPU - over 400x faster than a state-of-the-art rendering pipeline - enabling end-to-end reinforcement learning for goal-directed obstacle avoidance to converge in under 30 minutes - three orders of magnitude faster than training on rendered events. Policies transfer zero-shot to physically based event simulations (ray-traced Isaac Sim). Our policy reaches 83% success in cluttered courses unseen during training (mid-difficulty, traversability probability approx. 0.57), at 2.4 m/s average goal velocity, and retains 70% in a simulated texture-dense indoor hall. Furthermore, we quantized the policy to a 1.2 MB int8 network running fully onboard a 56-gram Crazyflie equipped with a Prophesee GenX320 event camera and an OpenMV N6 microcontroller board. Without any fine-tuning, external processing, or positioning, the policy achieves an average success rate of 82% (5/5, 5/6, 4/6 flights) across three real-world obstacle courses of increasing difficulty. Code: https://github.com/tudelft/rendering-free-event-nav
Source:https://arxiv.org/abs/2610.37543PreviousPredict the Swing, Match the Speed: Robotic Pipe Stabbing With Learned Stereo Vision and Residual Reinforcement LearningNextWhen, Where, and What to Correct: Human-Guided Adaptive Residual Correction for Robot Policies
Related posts
Show HN: 3D pixel-art basketball game – no deps, no build step
0Hacker News New
How Android Apps Leak Device Identifiers Across the Native–Web Boundary
0Hacker News New
Show HN: The DNA of DOOM – How code structure survives across 44 ports
0Hacker News New
Ask HN: Freelancer? Seeking freelancer? (November 2026)
0Hacker News Ask

'America hates data centers' — New data highlights public sentiment
0Tom's Hardware
Anime Expeditions Codes (November 2026)
0FOSS Bytes