Backend
TransGHOST: Real-Time, Synthesis-Free Reconstruction of Instrument-Occluded Regions in Ophthalmic Microsurgery
arXiv cs.RO0 views
arXiv:2611.13971v1 Announce Type: cross Abstract: Intraoperative scene perception in ophthalmic microsurgery is limited by instrument occlusion: when a tool enters the high-magnification field, it conceals tissue from both the surgeon and the perception components of robot-assisted systems that process the video. Generative inpainting can remove the occluder but replaces the missing image content with synthesis, which is unsuitable when visual provenance matters. Many video inpainters also depend on future frames and cannot operate online. We present TransGHOST, a causal reference-guided reconstruction pipeline whose non-generative safe mode operates in real time. Every restored value is obtained by resampling a recorded frame using geometric transforms fitted only to visible regions. The system provides per-pixel confidence and provenance and marks unsupported pixels as abstentions. We evaluate TransGHOST on a new veterinary clinical corpus of canine cataract surgery with pixel-level instrument and anatomy labels. Only the occluded region is scored, and each scoring target is verified to differ from the reference supplied to the system. Safe mode reaches 31.89 dB masked PSNR and 0.915 masked SSIM at 51.7 ms median and 85.5 ms 95th-percentile latency. On a pre-declared held-out cohort using instrument cutouts excluded from segmentation training, it reaches 29.83 dB masked PSNR, while matched-mask evaluation on validation shows a 3.45 dB advantage over LaMa. Region-aware reference selection improves masked PSNR by 3.60 dB over recency when candidate references can themselves be occluded. Reference-age analysis further defines the operating interval for the brief, repeated occlusions targeted by TransGHOST.
Source:https://arxiv.org/abs/2611.13971PreviousPersistent Metric-Semantic Maritime Scene Memory from Open-Vocabulary 3D Scene GraphsNextBadMoE: Backdooring Mixture-of-Experts LLMs via Routing-Aware Triggers and Task-Underutilized Experts
Related posts
SQLite 'database is locked' in 2ms: Why busy_timeout Didn't Help
0dev.to

How to Build an AI Agent That Fixes Bugs Reliably: Practice in Sharkly
0dev.to
Authentication Basics (JWT) & FastAPI Security: A Beginner-Friendly Guide 🔐
0dev.to
I tested breakeven and trailing stops on 1,509 closed bot trades. None of them helped
0dev.to
Choosing an Agent Memory Tool: Test a One-Field Update
0dev.to
Comparing 7 Chinese frontier models through one API — a field guide, not a benchmark
0dev.to