aionedge.Jev project · Evaluation & Observability
jev-eval
4esv/jev-eval
Compares Jev and OpenRouter models on labeled tasks for accuracy, calibration, latency and cost.
- GitHub stars
- 1 as of 2026-09-22
- Forks
- 0
- Language
- Python
- License
- Check upstream
- Created
- 2026-09-18
- Last updated on GitHub
- 2026-09-23
- Added to AionEdge
- 2026-09-18
Built by this developer
Axel StevensWhat Jev does in jev-eval
Collects judgments on matched tasks and computes confidence intervals and repeat-input stability.
Verification
Verified. We confirmed this repository through the GitHub API and located the code that calls Jev at a pinned commit: view the Jev code ↗. Upstream code changes over time, so check that the file still exists at the current commit before citing it.
How Evaluation & Observability projects use Jev
Tools for checking agent work and watching systems in production. They use Jev as a fast judge of whether conditions hold, so checks can run on every step instead of on a sample.
Related Jev projects in Evaluation & Observability
- jev-flash-reviewTheBous/jev-flash-reviewAn MCP review engine that evaluates Agent-supplied diffs against explicit rules.★ 1
TypeScript - hermes-jev-north-starpoponline63/hermes-jev-north-starA Hermes goal-checking skill that saves requirements, creates a run prompt and checks completion evidence.★ 1
Python - foreman-jevShifty-Eye-Games/foreman-jevAn experimental Jev supervisor for Codex workers with programmer-selected acceptance commands.★ 0
Python - jev-automation-testingvankhangfet/jev-automation-testingMobile UI testing pipeline combining deterministic rules, Jev judgments and optional vision descriptions.★ 0
Python - jev-playgroundmizchi/jev-playgroundA MoonBit and TypeScript Jev playground covering games, browsers, command risk and small languages.★ 19
TypeScript - goodwatch-monorepoalp82/goodwatch-monorepoA film-and-TV attribute-scoring experiment inside GoodWatch comparing Jev question designs and batch sizes.★ 38
Python