AI & ML
Evidence-Grounded LLM-Assisted Android Mobile Forensic Reporting
arXiv cs.CR0 views
arXiv:2610.26946v1 Announce Type: new Abstract: Large language models can assist forensic report drafting, but fluent output does not ensure evidentiary reliability. This study presents an evidence-grounded framework for evaluating LLM-assisted Android forensic reports at the atomic-claim level. Gemini, Llama, and Qwen each generated reports for two controlled cases: a public Android 13 dataset and a physical LG device with a zero-reportable-fact boundary. The six accepted reports were decomposed into 612 claims and evaluated against frozen, human-reviewed authorities through content labeling, citation validation, fact-recall analysis, independent rechecking, and dispute resolution. The final corpus contained 424 supported, 163 unsupported, four contradicted, four overstated or incomplete, and 17 excluded claims. In the public case, all three models recovered all 27 authorized report-level facts. Citation validity nevertheless differed substantially: Gemini produced 168 valid citations from 189 required citations, Qwen produced 145 from 189, and Llama produced none from 135. In the physical device case, the models generated 65 claims despite the zero reportable-fact boundary, including 38 unsupported and one contradicted claim. These results show that evidence restriction and complete fact recall do not guarantee claim support or valid evidence attribution. The framework provides an auditable method for detecting unsupported content, preserving claim-to evidence lineage, and retaining investigator authority over final forensic reports.
Source:https://arxiv.org/abs/2610.26946PreviousHow Intervention History Changes AI Agent Sabotage on Subsequent TasksNextReliable Estimation of Differential Privacy under Selection Bias
Related posts
The Card-Update Page Gets One Visit. Design for That Visit.
0dev.to UX
SaaS Partner Scout: A Script for Identifying GitHub SaaS Project Contributors
0dev.to GitHub
WARN Act and Retaliation — Can Your Employer Punish You for Asking About a Layoff Notice?
0dev.to Data
WARN Act and Mental Health: What a Layoff Notice Does to Your Wellbeing, and Where to Get Support
0dev.to Data
Dimensionare un pallettizzatore dal lato del progettista: i tre numeri che non stanno nelle brochure
0dev.to Design
How to Choose the Best Stretch Tent Supplier for Your Next Purchase
0dev.to Design