jevcal

What Jev does in jevcal

Runs fixed questions and measures accuracy, calibration, coverage and escalation rates.

Verification

Verified. We confirmed this repository through the GitHub API and located the code that calls Jev at a pinned commit: view the Jev code ↗. Upstream code changes over time, so check that the file still exists at the current commit before citing it.

Topics

• calibration
• confidence-thresholds
• jev
• llm-evals
• system-one
• typesafe

How Benchmarks & research projects use Jev

Benchmarks and research projects test Jev rather than just use it. They compare it with language models and other classifiers, check whether its probabilities are well calibrated, and explore where the decision-model approach breaks down.

Related Jev projects in Benchmarks & research

1. jev-lmy0usaf/jev-lmA word-level generation experiment that asks Jev to select words or verify locally drafted continuations.★ 6
   TypeScript
2. daf-jevdocxology/daf-jevA Python toolkit for Jev requests, batch evaluation, calibration and MCP access.★ 5
   Python
3. jev-little-airwayslbotinelly/jev-little-airwaysAn island-airport simulator using Jev for routes, yielding, emergency broadcasts and landing order.★ 5
   HTML
4. jev-does-not-play-diceKantaHayashiAI/jev-does-not-play-diceExperiments on Jev’s probability calibration, uncertainty reporting, and forecast probability preservation.★ 4
   JavaScript
5. jev-benchmarksAbdelStark/jev-benchmarksA benchmark comparing Jev and GLiNER on text classification, probability calibration and selective automation.★ 17
   Python
6. jev-for-engineersFoadsf/jev-for-engineersEight mechanical and electrical engineering experiments using Jev for task routing, log checks and component selection.★ 3
   Python

See all 107 Benchmarks & research projects →

Where we found it

• heyjunpenn/awesome-jev
• logicrw/awesome-jev-projects
• yibie/awesome-jev
• MrJev/awesome-jev