Backend
Observer Choice and Threshold Selection in Retinal Vessel Segmentation: A Subject-Separated Evaluation
arXiv eess.IV0 views
arXiv:2609.25597v2 Announce Type: replace-cross Abstract: The annotation used to select a segmentation threshold is part of the evaluation protocol, yet its effect is easily conflated with model quality. We examine this choice for retinal vessel segmentation using all 28 CHASE DB1 images and both human annotations. A fixed seven-fold protocol keeps both eyes of each of the 14 subjects together. Random forests and Extra Trees are fitted against observer 1 with three random seeds, yielding 42 fits. Five threshold policies share identical score maps: fixed 0.50, observer-1 tuning, observer-2 tuning, mean-observer tuning, and maximin tuning of the per-image lower observer Dice. For random forests, maximin changes the threshold in 19 of 21 fits, but worst-observer Dice decreases from 70.53 percent to 70.45 percent. The paired difference is -0.073 percentage points, with a conditional subject-bootstrap 95 percent interval of [-0.384, 0.238]. Extra Trees shows the same direction. Identical observer-1-tuned random-forest masks score 73.66 percent against observer 1 and 71.06 percent against observer 2. The results support explicit reporting of both the threshold-selection reference and evaluation reference; they do not support an accuracy benefit from maximin tuning in this cohort. All splits, raw predictions, metrics and code are supplied. AI assistance is disclosed.
Source:https://arxiv.org/abs/2609.25597PreviousFeature Space Analysis by Guided Diffusion ModelNextInitialization and Stopping Tolerance in CPU Dermoscopic Segmentation
Related posts
The Building Is a System: What Software Engineers Can Learn from Construction Site Failures
0dev.to

Part 4: When the Screen Changes Silently: Live Regions, Headings and Focus in Compose
0dev.to
FlatCake: Why Tiered KV Cache Storage Is Holding LLM Serving Back
0dev.to
Why Scrum is Not a Silver Bullet: 5 Structural Drawbacks and Fixes
0dev.to
Agentic Frameworks Compared: LangGraph, CrewAI & More
0dev.to
The Real-World Pain
0dev.to