Backend
Bayesian Tensor Train Kernel Machines with Automatic Model Complexity Inference
arXiv stat.ML0 views
arXiv:2611.07129v1 Announce Type: new Abstract: Tensor Network (TN) kernel machines accelerate supervised learning by using low-rank TNs to reduce computation and memory. However, most TN-based methods are deterministic with manually tuned ranks and feature dimensions, while the existing Bayesian TN kernel machine is restricted to the CANDECOMP/PARAFAC decomposition (CPD), whose single rank is shared by all modes. We extend this framework to the tensor train (TT) and propose Bayesian Tensor Train Kernel Machines (BTT-KM), whose hierarchical ARD-type priors on the TT cores infer the TT ranks and feature dimensions from data. Since each TT core is coupled to the others only through its neighbors, its closed-form posterior update requires propagating the contributions of all other cores along the chain. Mean-field variational inference yields a Bayesian alternating least squares algorithm with the same computational complexity as its deterministic counterpart and a closed-form predictive distribution. A synthetic experiment illustrates that BTT-KM recovers the true TT ranks and feature dimensions from an over-parameterized initialization.
Source:https://arxiv.org/abs/2611.07129PreviousToroFit: Fitting Wedge Sums of Tori to High-Dimensional DataNextShapleyOG: Fast Adaptive Shapley Value Estimation with Odd Gaussian Processes
Related posts
In Zagreb, the company that owns the robotaxis chose the aggregator on day one
0dev.to AI
How we onboarded 1,580 local businesses onto a Google co-pilot — what we learned
0dev.to AI
Casting 83 audiobooks: how we matched a voice to every narrator
0dev.to AI
Building AI-Powered Applications: What Developers Should Consider Before Integration
0dev.to WebDev
How to Cut an MP3 and Make a Ringtone in Your Browser
0dev.to WebDev
How I Built a 3D Interactive Web App Showcase for Indie Builders
0dev.to WebDev