Backend
Masked and Predictive Self-Supervised Pretraining for Brain MRI: Effects of Objective Design on Disease Detection
arXiv eess.IV0 views
arXiv:2606.13315v2 Announce Type: replace-cross Abstract: MRI self-supervised learning (SSL) has largely emphasized segmentation and dense prediction, while controlled studies of how alternative pretraining objectives shape transferable representations for MRI-based disease detection remain limited. We compare reconstruction-based Masked Autoencoders (MAE) and latent-predictive Joint Embedding Predictive Architectures (JEPA) for 3D structural MRI. We further introduce a spectral-domain reconstruction loss for MAE to promote sensitivity to fine-grained anatomical structure and integrate variance-covariance regularization (VCR) into JEPA to encourage broader, less redundant latent representations. Models are pretrained on heterogeneous MRI datasets using individual single-contrast inputs. Across seven dataset-task settings spanning four clinical problem domains, downstream transfer depends on both the pretraining paradigm and how the representational bias induced by a specific objective aligns with the downstream task. Spectral regularization provides its clearest gains for Alzheimer's disease classification and tumor grading, while its benefit is smaller for NC vs. MCI and ASD. VCR yields its strongest improvements when discrimination appears to involve multiple sources of structural variation. Overall, MAE-based pretraining generally outperforms baseline JEPA, with SL-MAE providing the strongest gains in several disease-detection settings. Representation analyses show that fine-tuning reorganizes learned representations in an objective-, depth-, and task-dependent manner. VCR-JEPA maintains broader effective dimensionality across depth and greater cross-task representational alignment than baseline JEPA. We publicly release subject-level pretraining and downstream evaluation splits.
Source:https://arxiv.org/abs/2606.13315PreviousI built my first open-source project: Chickadee Studio — a desktop tool for detecting hidden and disguised advertising on websitesNextExplainable GeoAI for urban wildfire structure loss: vegetation and built environment in the 2025 Palisades Fire
Related posts
AWS Weekly Roundup: GPT-6.1 Terra on Bedrock, Step Functions as agent tools, and more (November 2, 2026)
0AWS Blog
How to Build Durable Chat Memory for RAG Using ScyllaDB and LangChain
0HackerNoon
SpaceX reportedly wants to buy Boost Mobile to compete with AT&T, T-Mobile, and Verizon
0TechCrunch
Laravel API Security Checklist 2026 for Mobile Apps
0dev.to

Part 2: From Five Stars to One Sentence: Semantics for Custom Compose Controls
0dev.to
A Four-Line Fix for a 9.8: Anatomy of Linux's TCP Handshake Use-After-Free
0dev.to