Clone agentest: run agentic AI checklist tests offline in CI

Shipping agents that plan → call tools → hand off → mutate state? Chat review and LLM-as-judge miss a lot of failures: false completion, wrong tool order, privacy leaks, biased labels, flaky plans.

agentest is an Apache-2.0 open-core runner for the Agentic AI Test Checklist 110. Clone it and run — no Hugging Face account required at runtime.

Quick start 

git clone https://github.com/srpadmanabhuni/agentest.git cd agentest python -m pip install -e ".[dev]" agentest samples agentest run --suite functional --agent golden agentest run --suite orchestration --agent golden agentest matrix

What you get

  • Suites: functional, privacy, explainability, bias_fairness, orchestration
  • 15 sample agents (10 green ladder + 5 expected-fail teaching scenarios)
  • Deterministic oracles against a mock tool gateway
  • ISO 42001 / assurance-taxonomy aligned checklist design (not certification)

Context

Author: Dr Srinivas Padmanabhuni · srinivas AT testAIng.com