AI & ML
OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies
arXiv cs.GR0 views
arXiv:2606.08043v3 Announce Type: replace Abstract: Facial rigging--creating Facial Action Coding System (FACS) blendshapes and inner-mouth geometry (teeth, gums, and tongue)--remains a major bottleneck in 3D character production. We present OmniFaceRig, a fully automatic end-to-end pipeline that converts a static surface-only 3D character mesh, with no pre-modeled oral cavity, into an inner-mouth-aware FACS rig with up to 155 blendshapes, procedurally fitted teeth, gums, and tongue, and re-packed UV/texture. It supports humans, humanoids, and long- and short-muzzled animals with no manual landmarks, user-provided templates, or per-asset setup. OmniFaceRig combines a hybrid vision-language and computer vision riggability checker, a four-model face segmentation ensemble, keypoint-driven template registration, procedural inner-mouth construction, and collision-aware blendshape transfer. For non-human characters, it selects topology-specific templates with a nose-landmark-free design and uses as-rigid-as-possible deformation with signed-distance-field constraints to reduce teeth-face intersections. We also introduce Omni-Bench, an open-source benchmark of more than 1,000 biped 3D characters rigged with FACS blendshapes and inner-mouth geometry, spanning humans, humanoids, cats, dogs, and other animals. Experiments show high rigging success, nearly complete face detection recall, low inner-mouth penetration, and 20-30 s end-to-end latency per asset on a single A100 GPU.
Source:https://arxiv.org/abs/2606.08043PreviousHierarchical Incremental Beta Splatting for Online ReconstructionNextLSD-3D: Large-Scale 3D Driving Scene Generation with Geometry Grounding
Related posts
XDR - Experience Decision Records
0dev.to UX
VR에서 YouTube를 본다는 것: 약시(amblyopia) 사용자에게 몰입형 뷰 개편이 의미하는 것
0dev.to UX
Mercedes Put Depth in the Windshield. Depth Was Never Guaranteed for Everyone.
0dev.to UX
유나이티드 항공 좌석 등받이의 Spotify가 시각 훈련에 던지는 힌트
0dev.to UX
SteamVR's Image Quality Beta Is Really a Legibility Story — And That Matters If You Render Science
0dev.to UX
Meta beendet die Quest-2-Ära — und warum genau das für Sehtraining interessant ist
0dev.to Watercooler