Applied AI reliability
Agent Reliability Harness
- Problem
- Agents can complete tasks while violating tool, budget, safety, or grounding requirements.
- What I built
- A Python evaluator for schemas, budgets, safety patterns, citations, and CI-readable reports.
- Technical decision
- A standard-library runtime with independent checks, keeping CI adoption simple.
- Verified result
- 35 tests on Python 3.11 and 3.12 across passing and failing traces.
- Python
- Agent evaluation
- GitHub Actions