Backend
Spectral Alignment in Forward-Backward Representations via Temporal Abstraction
arXiv cs.RO0 views
arXiv:2603.20103v5 Announce Type: replace-cross Abstract: Forward-backward (FB) representations provide a powerful framework for learning the successor representation (SR) in continuous spaces by enforcing a low-rank factorization. However, a fundamental spectral mismatch often exists between the high-rank transition dynamics of continuous environments and the low-rank bottleneck of the FB architecture, making accurate low-rank representation learning difficult. In this work, we analyze temporal abstraction as a mechanism to mitigate this mismatch. By characterizing the spectral properties of the transition operator, we show that temporal abstraction acts analogously to a low-pass filter that suppresses high-frequency spectral components. This suppression reduces the effective rank of the induced SR while preserving a formal bound on the resulting value function error. Empirically, we show that this alignment is a key factor for stable FB learning, particularly at high discount factors where bootstrapping becomes error-prone. Our results identify temporal abstraction as a principled mechanism for shaping the spectral structure of the underlying MDP and enabling effective long-horizon representations in continuous control.
Source:https://arxiv.org/abs/2603.20103PreviousDexHOT: Learning Hand-Object Configuration Transfer for Dexterous ManipulationNextBLaFA: Bridging Language to 3D Functional Affordances for Dexterous Robotic Grasping in Tool Use
Related posts

When "Not Found" Doesn't Mean "Never Happened"
0dev.to
Blameless Postmortems: A Leader’s Guide to Learning From Incidents
0dev.to

The Model Predicts Itself
0dev.to
Designing Clean REST APIs: Common Anti-Patterns and How to Fix Them
0dev.to

Dengan osFoundry Operator, agen menjalankan aplikasi dan setiap aksinya tercatat
0dev.to
Hold-Out Self-Validation Cannot Certify the Accuracy of Photogrammetric Reconstructions
0arXiv cs.RO