ZeroEval
ZeroEval facilitates the development of self-improving AI agents by utilizing calibrated LLM judges and automatic prompt optimization.
PaidWebPython SDKTypeScript SDK
Visit websitezeroeval.com
Compare with book-to-skillExplore ZeroEval alternativesOverview
ZeroEval facilitates the development of self-improving AI agents by utilizing calibrated LLM judges and automatic prompt optimization. The platform provides an SDK to automatically instrument LLM calls from providers like OpenAI and Anthropic without manual configuration. Users can define custom judges to evaluate agent outputs in production using rubrics or binary scoring. By correcting judges with feedback and analyzing failure patterns, ZeroEval automatically rewrites prompts to improve performance. This tool targets developers and AI engineers seeking to enhance agent reliability. Pricing information is not disclosed.
Key features
- Automatic instrumentation of LLM calls via SDK
- Creation of custom judges for production output scoring
- Judge calibration through user feedback and reasoning
- Automatic prompt rewriting and one-click deployment
Pricing
PaidStarting price: US$15/mo
Verified on:
Use cases
- Scoring agent outputs with pass/fail or rubrics in production
- Reducing response verbosity based on user complaints
- Improving prompt alignment through thumbs up/down calibration
Who it is for
AI DevelopersEngineering Teams
Integrations
OpenAIAnthropicLangChainLangGraphHugging FaceOpenTelemetryGoogle Gemini
How we verified this
Company, pricing, and feature details come from the primary sources below and our latest verification pass. When sources disagree, the official source and the most recent check win.
Last verified 09/06/2026Verified sources: 1
Alternatives
Tools you can use instead
book-to-skill
Converts technical books and document collections into structured, on-demand skills for AI coding agents.
★ 28.8KOpen source
Developer Tools
GPT-6 Astra
OpenAI frontier model for difficult end-to-end reasoning and professional work.
API
Developer Tools
