A Gemini model my project depended on was retired in the middle of the project. Nothing warned me until the calls started failing.

I lost days finding every place it was used, swapping it, and checking that nothing else broke. I build LLM agents for a living, so it wasn't the first time. It was the last straw.

The problem nobody's tools cover

AI vendors now retire models every few months, and SDKs ship breaking versions all the time. The tools we already have don't help much:

  • Dependabot and Renovate bump a version number. They don't rewrite the code that breaks, and a model ID isn't a package, it's a string in your code, so they never see it.
  • Coding agents will write a patch if you ask. But you have to know a change is coming, and then you still have to prove the patch is safe.

Writing the patch is the easy part now. Knowing what's changing, and proving the fix doesn't break anything, is the hard part.

What I built

Versyka watches your repositories for AI models and APIs that are retiring or changing. When one affects your code, it:

  1. finds every affected call, with file and line
  2. makes the change (an exact model swap is a plain find-and-replace, no AI involved)
  3. runs your own typecheck, lint, build and tests before and after the change
  4. opens a pull request only if nothing new fails, with the results attached

You review and merge.

The first month, honestly

Versyka launched in October. Today:

  • 6 users
  • 30 repositories connected
  • 50 pull requests opened, including security fixes and AI model replacements

A senior engineer at Kore.ai let it open security fixes on their code: 3 pull requests covering 39 vulnerabilities, two of them major version jumps. The one they merged would have taken about a day by hand.

Small numbers, but real ones.

What I learned

  • Proof beats promises. "Tests passed before and after" is what makes an engineer open the diff instead of closing the tab.
  • Not every fix needs AI. Swapping a retired model ID for its direct replacement is exact and free. AI is only worth it for breaking API changes.
  • Free tools earn trust first. A repository check that needs no account is how most people meet the product.

If your code calls AI models or third-party APIs, I'd really like to know: what's the last upgrade that broke something for you?