AI & ML
VIRA-Bench: Diagnosing Pedagogical Contingency Understanding in Online Tutoring Videos
arXiv cs.HC0 views
arXiv:2610.29428v1 Announce Type: new Abstract: Understanding a one-to-one tutoring video requires more than recognizing its events. A model must connect a visible teacher intervention to the learner response it elicits and to the follow-up adjusted to that response. Existing video and educational-dialogue benchmarks typically emphasize event recognition, temporal reasoning, social-state inference, or transcript-based interaction, but rarely diagnose this action-response-adjustment relation. We introduce VIRA-Bench, a focused diagnostic benchmark for short-horizon pedagogical contingency in one-to-one online tutoring. VIRA-Bench contains 1,005 tutoring clips and 1,322 multiple-choice questions with researcher evidence audit and expert verification, organized into Observable Evidence Grounding (OEG), Interaction Contingency Reasoning (ICR), and Support-Response Modeling (SRM). Across 11 models, the best reaches 61.3%, well below the 91.0% human reference on a stratified subset, and ICR generally has the lowest layer accuracy among leading models. Under controlled input manipulations, removing video most strongly degrades OEG, whereas disrupting temporal order most strongly degrades ICR. Free-response, Stem+Options, and synchronized-shuffle controls show that response format, static question cues, and video-ASR mismatch do not explain these layer-specific patterns. The results identify distinct behavioral evidence dependencies without claiming an internal architectural mechanism. VIRA-Bench provides a focused evaluation resource for multimodal dialogue grounding, pedagogical discourse, and temporal reasoning in online tutoring.
Source:https://arxiv.org/abs/2610.29428PreviousA Stratified Multi-Rater Evaluation of LLM-Based Virtual Standardized Patients with a Deployed Data-Generation PlatformNextThe Serendiptionnaire: a Questionnaire for Measuring Experienced Serendipity
Related posts
Preparing our next security sprint to harden OpenAI
0OpenAI Blog
Rewarding defenders with bigger bug bounties
0OpenAI Blog
삼중 진화 시대: 암호화폐의 정치적 성숙, 비트코인의 거시경제 민감성, 그리고 AI 융합
0dev.to
My most popular app? Surprisingly, YuGPT! It backs up ChatGPT and Codex history locally and lets you search both with flexible options. I built it because the official apps couldn't do what I needed
0dev.to
Top Dev Tools and Tutorials Trending This Week (2026-11-03)
0dev.to GitHub

DeepSeek Super-Agent คืออะไร? แผนที่เปิดให้อ่าน กับโค้ดที่ตามแผนยังไม่ครบ
0dev.to GitHub