AI & ML
Refining LLM-based Directed Test Input Generation via Runtime Value Feedback
arXiv cs.SE0 views
arXiv:2608.07926v2 Announce Type: replace Abstract: Despite their remarkable capabilities, LLM-based directed input generation produces off-target test inputs when their underlying hypotheses on the target program's behaviors are incorrect. To effectively ground LLM-based directed input generation in actual program behaviors, we propose ReDig, a runtime feedback-guided framework for iterative refinement of LLM-based directed input generation. When a generated input fails to reach a given target code location, ReDig conducts a postmodern analysis to identify incorrect hypotheses by comparing expected runtime values and their actual runtime values observed in the off-target test execution. ReDig utilizes the postmortem analysis result as feedback to refine the inference context, guiding the subsequent test generations toward the target location. In this paper, we present our work-in-progress on ReDig. We illustrate how runtime feedback-guided refinement operates through four case studies with two real-world C/C++ programs (Poppler and Libsndfile). Furthermore, we report preliminary experiment results that show ReDig successfully generates crash-reproducing inputs for 24 out of the 59 CVEs collected from Sec-Bench.
Source:https://arxiv.org/abs/2608.07926PreviousAn Empirical Study of Gemini 3 for Detecting Natural Language Test Smells in Manual Test CasesNextShortcutting the Fix: Identifying and Categorizing Agentic Exploits in Software Engineering Benchmarks
Related posts
BeeTalk 群主必备:AI 群管机器人 AIGB 免费解决垃圾信息问题
0dev.to AI
I Open-Sourced a Free YouTube Shorts Factory. The Money Isn't in the Shorts.
0dev.to AI
Priced per TB/s, the H200 beats the H100 at 6 of 7 providers
0dev.to Python
Daily Dose of DevOps — Telemetry design: for platform operations teams
0dev.to DevOps

Israeli startup 42AI, which is developing a "behavioral world model" that tries to predict human behavior, emerges from stealth with a $62.5M seed (Ram Iyer/TechCrunch)
0Techmeme

Anthropic confirms new Claude Code limits "to steer it away from recreating someone else's specific game", saying IP infringement violates its usage policy (Bruno Ferreira/Tom's Hardware)
0Techmeme