jev-behavior-study

What Jev does in jev-behavior-study

Sends controlled variants of fixed tasks and records choices, probabilities and raw request-response evidence.

Verification

Verified. We confirmed this repository through the GitHub API and located the code that calls Jev at a pinned commit: view the Jev code ↗. Upstream code changes over time, so check that the file still exists at the current commit before citing it.

How Benchmarks & research projects use Jev

Benchmarks and research projects test Jev rather than just use it. They compare it with language models and other classifiers, check whether its probabilities are well calibrated, and explore where the decision-model approach breaks down.

Related Jev projects in Benchmarks & research

1. jev-for-engineersFoadsf/jev-for-engineersEight mechanical and electrical engineering experiments using Jev for task routing, log checks and component selection.★ 3
   Python
2. jev-explorationSamuelSacco/jev-explorationA research repository tracking Jev claims and limitations, with calibration experiments and runnable examples.★ 3
   Python
3. jev-does-not-play-diceKantaHayashiAI/jev-does-not-play-diceExperiments on Jev’s probability calibration, uncertainty reporting, and forecast probability preservation.★ 4
   JavaScript
4. jev-agent-failure-benchmarkTokenTrim/jev-agent-failure-benchmarkA benchmark using Jev to attribute multi-Agent failures to an Agent, step and error type.★ 2
   Python
5. jev-medhallu-benchmarkstperic/jev-medhallu-benchmarkTypeSafe's Jev and four fast LLMs added to Stanford MedHELM's MedHallu results: harness, preregistered run plans and every run file.★ 2
   Python
6. decision-benchHanno-Labs/decision-benchOpen benchmark runtime for document-grounded decision models.★ 1
   Python

See all 107 Benchmarks & research projects →

Where we found it

• heyjunpenn/awesome-jev
• logicrw/awesome-jev-projects