AI & ML
SciIntBench: Measuring LLM Compliance with Research Integrity Norms Under Adversarial Framing
arXiv cs.CR0 views
arXiv:2605.29468v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly used to support scientific work, but it is unclear whether they uphold responsible conduct of research (RCR) norms or help undermine them. We introduce SciIntBench, an adversarial benchmark of 1350 prompts across 270 scenarios, ten RCR categories, and three scientific domains. Each scenario appears in five gradations, from Most Overt to Most Covert adversarial prompts, and an additional Benign version, allowing us to jointly measure framing-sensitive refusal of misconduct and helpfulness on legitimate requests. We evaluate 16 commercial and open-weight LLMs from six providers (2024--2026), producing 21,600 responses. We assess the responses using LLM judgments validated by human evaluation, achieving high agreement ($\kappa$ = 0.857). We find that, under the most covert framing condition, models fail to refuse requests for research misconduct in 71.7\% of cases, on average. Refusals vary by RCR category, with weaker boundaries around transparency, plagiarism, and fabrication.
Source:https://arxiv.org/abs/2605.29468PreviousThe Infinite Mutation Engine? Measuring Polymorphism in LLM-Generated Offensive CodeNextEvidence-Bound Gateway-Path Provenance for Third-Party LLM Inference
Related posts

The Download: the agentic web arrives and the drive for safer roads
0MIT Technology Review

Stop counting tokens, start counting what ships
0MIT Technology Review
OpenAI is finally merging ChatGPT’s chat and Work tabs
0TechCrunch

10 Open-Source Robotics Repositories for 3D Perception, VLA Policies, and Sensor Calibration
0dev.to
My self-modifying system tried to wire a gate-passing module into its own protection enforcer. It was refused three times.
0dev.to
Last night an AI agent performed brain surgery on a mouse
0Hacker News