jev-harness

What Jev does in jev-harness

The project describes itself this way: Decision harness for TypeSafe Jev — confidence gates, shadow mode, recipes, and evals. Claude CLI 48.9s → Jev 1.3s on the same row-filter job. In the Benchmarks & research category, Jev typically decides labels and probabilities on fixed test sets, so accuracy, calibration and latency can be measured.

Verification

Verified. We confirmed this repository and its Jev relevance through the GitHub API and the source lists below. A specific file link has not been recorded yet.

Topics

• agents
• confidence
• decision
• evals
• harness
• jev
• llm
• system-one
• typesafe
• typescript

How Benchmarks & research projects use Jev

Benchmarks and research projects test Jev rather than just use it. They compare it with language models and other classifiers, check whether its probabilities are well calibrated, and explore where the decision-model approach breaks down.

Also listed in: CLI & Pipelines.

Related Jev projects in Benchmarks & research

1. jevcalabhixhek/jevcalA toolkit for evaluating Jev probabilities on labeled data, selecting confidence thresholds and checking model drift.★ 10
   Python
2. jev-lmy0usaf/jev-lmA word-level generation experiment that asks Jev to select words or verify locally drafted continuations.★ 6
   TypeScript
3. daf-jevdocxology/daf-jevA Python toolkit for Jev requests, batch evaluation, calibration and MCP access.★ 5
   Python
4. jev-little-airwayslbotinelly/jev-little-airwaysAn island-airport simulator using Jev for routes, yielding, emergency broadcasts and landing order.★ 5
   HTML
5. jev-does-not-play-diceKantaHayashiAI/jev-does-not-play-diceExperiments on Jev’s probability calibration, uncertainty reporting, and forecast probability preservation.★ 4
   JavaScript
6. jev-benchmarksAbdelStark/jev-benchmarksA benchmark comparing Jev and GLiNER on text classification, probability calibration and selective automation.★ 17
   Python

See all 107 Benchmarks & research projects →

Where we found it

• heyjunpenn/awesome-jev
• MrJev/awesome-jev