AI & ML
Synergistic Vision-Language Reinforcement Enables Scalable On-Demand Analysis across Diverse Clinical Tasks
arXiv eess.IV0 views
arXiv:2505.03380v3 Announce Type: replace-cross Abstract: Accurate segmentation of tumors and organs-at-risk is essential for oncology but remains time-consuming and expertise-intensive. Existing AI systems often require manual spatial prompts or task-specific retraining, while generic class labels provide limited guidance for heterogeneous disease targets. Here we present SyRe, a text-prompted segmentation foundation model based on Synergistic vision-language Reinforcement, which strengthens bidirectional interaction between visual and linguistic representations. We introduce Color Region Description (CRD) to generate region-level semantic supervision and construct SyReData, comprising 20 million image-mask-description triplets across 9 modalities and 229 segmentation tasks. Training with diversified prompt formats enables single-target, multi-target and open-ended segmentation, together with invalid-prompt rejection. SyRe achieves accurate segmentation across diverse clinical scenarios, with strong gains on disease-related targets. Evaluation on 28 unseen external datasets, including 17 cancer types, 3 non-cancer diseases and multinational in-house cohorts, demonstrates generalization under distribution shift. Beyond spatial overlap, SyRe-generated masks preserve quantitative pathology information. Across five retrospective tumor imaging cohorts spanning CT and MRI, radiomics derived from these masks stratify survival and improve prognostic modeling over clinical baselines. Clinician-in-the-loop refinement further supports case-level correction. These results establish SyRe as a generalizable framework for scalable quantitative oncology analysis and clinician-guided segmentation.
Source:https://arxiv.org/abs/2505.03380PreviousA$^3$PreCore: Robust Rigid Registration for Native FLAIR-Space Brain-Mask TransferNextMedical Imaging Classification with Cold-Atom Reservoir Computing using Auto-Encoders and Surrogate-Driven Training
Related posts

Keep Distributed Training Running with Automated Workload Recovery
0NVIDIA Developer Blog

Diagnose Distributed AI Workload Failures with NVIDIA Attribution
0NVIDIA Developer Blog
Alibaba Lab Cuts AI Upgrade Bills By Rewriting Core Numbers
0dev.to AI
Regalos para la persona que tiene un negocio pequeno, ensena, o crea cosas (en espanol)
0dev.to AI
CrowdStrike Expands Project QuiltWorks Across Europe
0dev.to AI
Lighthouse 13.6 Can Raise PageSpeed Insights Scores Without a Site Change
0dev.to AI