Backend
Twoblock clustering trees with coskewness-based dimension reduction: recovering piecewise multivariate linear regimes
arXiv stat.ML0 views
arXiv:2607.20760v2 Announce Type: replace-cross Abstract: The twoblock clustering tree (\tbtree) is introduced as a highly interpretable regression tree for multivariate responses. Twoblock trees are deterministic decision trees that have local multivariate linear models as their leaves and use dense or sparse twoblock dimension reduction as local leaf models and in the impurity. The resulting models are both computationally efficient and can be highly interpretable. The estimator's primary aim is an interpretable, regime-aligned piecewise-linear description of the data, with predictive competitiveness retained as a constraint through a split/leaf decoupling. Beyond proposing the decision tree estimator itself, this paper also introduces an estimator for the twoblock dimension reduced space based on maximizing coskewness, which facilitates identification of non-normal clusters in the data. The tree inherently produces a set of local linear models and is therefore apt to recover piecewise linear regimes, which is illustrated in a simulation. However, two real-world data examples illustrate that twoblock trees are also capable of modeling more complexly nonlinear dependencies and can perform on par with black-box modeling techniques, such as random forests. At each point, both the twoblock models that generate the splits, as well as the ones in the leaves, can be inspected and interpreted.
Source:https://arxiv.org/abs/2607.20760PreviousDirectly Optimizing Mean Demographic Parity for Nonlinear RegressionNextK\"ahler landscapes for complex neural network descents and guarantees including a search and destroy of the Calabi-Yau manifold
Related posts
All-in-one platform or a stack you assemble? Where do coaches and educators land?
0dev.to Discuss
I Wanted to Live on Coruscant. PAT Scared Me. Now My Alexa Lives on Mute.
0dev.to Discuss
Detect What You Can Name: PaliGemma 2 Object Detection with Transformers
0dev.to Machine Learning
When Should an LLM Router Stop Being Sticky? llm-d 1.0 Cache-Affinity Routing, Break-Even Math, and a Simulation
0dev.to Machine Learning

Understanding HackerTube: Karpathy’s Two-Hour Experiment in Better Recommendations
0dev.to Machine Learning
OpenAI Wants to Rename the Data Center. The Neighbours Are the Problem.
0dev.to Machine Learning