AI has made finding potential vulnerabilities fast and cheap. Fixing them still takes human judgment, and in open source, that work falls to maintainers. Many are already flooded with AI-generated security findings, including duplicates and reports that aren’t vulnerabilities at all. Another raw scan doesn’t help them. Anyone pointing a new model at a project should ask its maintainers first and come with fixes, not just findings.

Maintainers are under intense pressure from this flood of reports. As Christian Grobmeier, a maintainer of Log4j, has put it, the AI defending open source has to be better than the AI attacking it.

AI shouldn’t add to maintainers’ workload. So, with maintainers, GitHub and Microsoft ran a pilot together: could AI help maintainers ship fixes instead of handing them more findings?

GitHub and Microsoft are using Codename MDASH, Microsoft’s multi-model agentic scanning harness, to find and fix security vulnerabilities in widely used open source software, strengthening the foundation that much of the world’s code is built on.

The process

Our pilot had two goals: send only findings that matter, and never send a maintainer an unverified finding. Here’s how it worked:

  1. Find. Codename MDASH, an AI system from Microsoft Security, scanned each project using Microsoft’s MAI Cyber model and suggested fixes for what it found.
  2. Filter. An AI triage agent from the GitHub Security Lab, built on tailored Copilot skills, removed duplicates, checked validity, and focused on high-impact bugs, so maintainers never had to review raw scan results.
  3. Verify. Researchers from Microsoft FORGE Lab checked every remaining finding by hand.
  4. Report privately. Reports reached maintainers through GitHub private vulnerability reporting, with a proof of concept and a suggested fix.
  5. Fix. Maintainers decided what to fix, how to fix it, and when.

Reports and fixes stayed on GitHub, where maintainers already work.

The result: Codename MDASH, using Microsoft’s MAI Cyber model, flagged thousands of possible issues across the six projects. After AI triage and hand review by seven Microsoft FORGE Lab researchers, maintainers received 99 private reports. As of November 15, they had fixed 55, and 14 of those fixes were already in a release.

Logos for AutoGPT, Caddy, Express, FastMCP, ImageMagick, and Netty.
Infographic titled ‘Codename MDASH Pilot: The Result.’ It shows 9,791 possible issues flagged across six open-source projects, leading to 99 private reports sent to maintainers after AI triage and human review—about one report for every 100 raw findings.

What we learned

These lessons come from what the six projects fixed and what their maintainers chose to share. Six projects is a small sample, so read them as early lessons.

1. Fixes matter more than findings

Fixing is where maintainers spend their time. So every report arrived already checked, with a suggested fix to review, adapt, and merge. Maintainers started from a well-scoped patch, not a raw finding.

The first fixes shipped about a week after the initial scan. Caddy’s maintainers fixed all 22 of the reports they received in a week or less. Maintainers used the suggested fixes, some as written and some with changes.

AutoGPT’s maintainers had recently shipped a new check, and it was broken. The report landed three days later and pointed at the right line. They took the fix further than the suggested patch, wrote it within a day, and had it in production less than a week later.

Finding vulnerabilities is no longer our bottleneck. Fixing them is the hard part, and that depends on maintainers.

Netty maintainer 

2. Codename MDASH, with researcher review, gave maintainers high-quality findings with fixes

Maintainers got a short list, not a flood. Express maintainers said the reports cut through the noise. Caddy maintainers said they surfaced obscure bugs and filled gaps that earlier reports had missed. For FastMCP, the scan went beyond what AI scanners had given them before. ImageMagick, maintained by a two-person team, received 22 reports.

AI did the finding, researchers did the checking, and maintainers stayed in charge.

One ImageMagick report looked like a kind of issue the maintainers had seen before. Its summary showed it wasn’t and pointed to the exact lines of code. They were able to push a fix in 15 minutes.

Normally, a security advisory would take us around 30 minutes to 1 hour on average to read, understand, and make a fix. It is a huge difference.

ImageMagick maintainer

Codename MDASH was able to find unknown, obscure security bugs in our project with succinct reports, and it filled in gaps from some prior reports that hadn’t been noticed.

Caddy maintainer

3. Open source still has gaps to close

The pilot worked because people did careful work at every step, and that work doesn’t scale yet. Seven researchers spent about two days per project checking findings by hand. Meanwhile, low-quality reports still reach maintainers every day.

For open source, fixes need to be delivered via private vulnerability reporting (PVR). Maintainers need to run CI/CD tests on private forks to verify those fixes. And to close the gap between defenders and attackers, maintainers need access to cyber-capable models to verify a proof of concept, before and after the fix.

The Codename MDASH scan provided unique insights into the security of our project above and beyond what AI scanners have provided us in the past

FastMCP maintainer

Why it matters

If you’re a maintainer, this approach changes what a security report costs you. A checked, private report that comes with a suggested fix takes less of your time. You shouldn’t have to triage a scanner’s output. That’s the sender’s job.

If you use AI to find vulnerabilities in open source, maintainers’ feedback points to this standard:

  • Check every finding before you send it, against what the project already knows and against its threat model and security policy.
  • Report it privately.
  • Include a suggested fix. Let maintainers set the pace.

Features are easier and easier to ship, but in the future maintaining software will probably come down to who cares enough to manage the security.

AutoGPT maintainer

Codename MDASH is very useful for cutting through the noise of vulnerability reports.

Express maintainer

What you can do today

  • If you maintain any open source project, turn on private vulnerability reporting so researchers can report security issues to you without making them public. If your project is on GitHub, turn on core security features in about two minutes with
    gh-secure.
  • If you build on open source, turn on Dependabot alerts so you know when a dependency you use needs a security update.
  • If you send AI-generated vulnerability reports to open source projects, hold them to the standard above before you send them.
  • Repositories using GitHub code security can use agentic autofix to help automatically remediate their alerts with Copilot

What happens next

  1. Fixes, where maintainers already work. GitHub is bringing these lessons into private vulnerability reporting and security advisories, where GitHub Security Lab is already investing to reduce the burden of low-quality reports on maintainers.
  2. MAI Cyber 2. Today Microsoft announced MAI Cyber 2. The Codename MDASH pilot ran on the earlier MAI Cyber model. GitHub and Microsoft will keep working together to help secure open source.
  3. Closing the gaps, starting with the GitHub Secure Open Source Fund. We’re working with Microsoft to scale researcher review without cutting corners. GitHub will offer every alumni project AI security scans, with findings checked before they’re reported privately. Alumni also get GitHub Copilot Max. We’ll bring this support to future sessions of the Fund.

Everyone downstream benefits from this system. When a maintainer publishes a security advisory on GitHub and it’s reviewed for the GitHub Advisory Database, Dependabot can alert the repositories that depend on that package. That’s the idea behind the GitHub Secure Open Source Fund: 216 projects so far, with more than 300 maintainers fixing more than 4,000 vulnerabilities in software downloaded more than 20 billion times a month.

Thank you

To the maintainers of AutoGPT, Caddy, Express, FastMCP, ImageMagick, and Netty: thank you for your time, your trust, and your feedback. Thank you also to the Codename MDASH team at Microsoft Security, the MAI Cyber team, the researchers of Microsoft FORGE Lab, and GitHub Security Lab.

Maintainers do the fixing. Our job is to make sure they never do it alone.

Hear from maintainers about their experience with Codename MDASH. 👇

About the GitHub Secure Open Source Fund

All six projects in this pilot are alumni of the GitHub Secure Open Source Fund, which gives each project $10,000 through GitHub Sponsors, plus security training and a supportive alumni community.

The GitHub Secure Open Source Fund, powered by GitHub Sponsors, funds open source projects that underpin the digital supply chain, catalyze innovation, and are critical to the AI stack. Want your company to help secure the open source it depends on? Become a funding partner through the Fund page. Learn more about the Fund or apply.

GitHub Secure Open Source Fund slide: ‘Fund one. Protect millions of users.’ It reports 216 projects improved their security, with 300+ maintainers, 20+ billion monthly downloads, 4,000+ vulnerabilities fixed, 850+ secret leaks prevented or resolved, and 1,500+ vulnerable dependencies updated. Figures are from a February 17, 2026 program report and current program data.

Through the Fund, maintainers receive security training and Azure credits from Microsoft for Startups. That support sits alongside Microsoft’s European Security Program and its Secure Future Initiative, whose principle is security above all else. Most organizations are downstream in the same way. If your software depends on open source, do the same: back the maintainers you rely on.

All alumni of the GitHub Secure Open Source Fund

AI, machine learning, and intelligent systems

ACI.dev • AlbumentationsX • ArviZ • AutoGPT/GravitasML • CAMEL-AI • Caracal • CocoIndex • Code-Graph-RAG • CodeCarbon • Cognee • Deep Agents • DIPY • DocsGPT • FastMCP • Jupyter • LadybugDB • LangChain • Matplotlib • n8n-MCP • Nasiko • NumPy • Ollama • ONNX • OpenBB Platform • OpenClaw • OpenCV • OpenMetadata • OpenSearch • PageIndex • pandas • Pydantic • PyMC • Ruby-OpenAI • Scenic • scikit-learn • SciPy • Serena • TokenOps • TraceRoot • Zeus

Build systems, supply chain, and release tooling

Apache Airflow • Babel • Bluefin • bootc • Browserslist • Changesets • Colima • Concourse • Cucumber • CycloneDX Python Library • Flux • Foundry • Gitoxide • golangci-lint • GoReleaser • hardhat-deploy • Jenkins • JReleaser • Jupyter Docker Stacks • NixOS/Nixpkgs • node-lru-cache • oapi-codegen • PostCSS • PyPI/Warehouse • rimraf • Task • Termux • Terra • Turborepo • Warpgate • webpack • zizmor

Core programming languages, runtimes, and foundational libraries

Apache Commons • Apache Groovy • Byte Buddy • core-js • CPython • FS2 • Gleam • Himmelblau • htmx • LLVM • NAPI-RS • Node.js • Pkl • Pyodide • Rustls • SQLite • termcolor • time-rs

Developer tools and productivity platforms

AirQo • API Dash • ArduPilot • AssertJ • AsyncAPI Initiative • Bevy • Bootstrap • calibre • Charset Normalizer • Cheerio • Ciphey • Cobra • CodeRunner • CSS Declaration Sorter • DataJourney • Diesel • DIGIT • Electron • ERPNext • fabric.js • GitPython • Hoppscotch • ImageMagick • jQuery • js-yaml • jsoup • JUnit • libyt • LORIS • MapStruct • Mastodon • Mathesar • Mautic • Mermaid • MessageFormat • Mockoon • NativeScript • Next.js • Nuxt • nvm • Oh My Zsh • p5.js • Path-to-RegExp • Pelias Geocoder • Pest • Pillow • Polly • Proyecto Respira • PypeIt • python-benedict • qs • React Starter Kit • Readest • Resolve • Rocket.Chat • Selenium • shadcn/ui • Sphinx • Spyder • ssh_config • StackQL • Stirling PDF • Svelte • Thunderbird for Android • ToolJet • Two.js • Viper • virtualenv • Vuetify • Wagmi • WebdriverIO • xyflow • YAML • Yii Framework • Yjs

Web, networking, APIs, and infrastructure services

actix-web • aiohttp • Apache APISIX • Apache Shiro • Apache Solr • Apache ZooKeeper • Arkime • Caddy • cmux • Cryptomator • curl • CycloneDX .NET Library • CycloneDX cdxgen • Ente • etcd • evcc • Express • external-secrets • FastAPI • Fastify • Haraka • Helmet.js • Home Assistant • Hummingbird • jose • Keycloak • Keyshade • kgateway • Log4j • mimetype • NetBird • Netty • Oauth2 (Ruby) • OAuthlib • openapi-stack • OpenWISP • PGPainless • quic-go • ScanAPI • ScanCode • Sniffnet • Social Auth App Django • Stalwart • Starlette • UAParser.js • urllib3 • Vapor • varlock • Veramo • WebAuthn (Go) • ZITADEL

The post Maintainers don’t need more AI bug reports. They need fixes.  appeared first on The GitHub Blog.