aionedge.
Jev project · Benchmarks & research

typesafe-ai-benchmark

iammrduncan/typesafe-ai-benchmark

Compares Jev with other structured-output models on shared application tasks, recording errors, latency, Tokens, and estimated cost.

View on GitHub ↗See the Jev code ↗Project website ↗
Qwen on Cerebras vs. Jev — side-by-side benchmark demo
Demo from the project README · view README ↗
GitHub stars
38 as of 2026-09-22
Forks
5
Language
TypeScript
License
MIT
Created
2026-09-16
Last updated on GitHub
2026-09-19
Added to AionEdge
2026-09-19
Built by this organization
iamMrDuncan

What Jev does in typesafe-ai-benchmark

Maps the same tasks to Jev Choice/Noul questions and normalizes answers to a shared result format.

Verification

Verified. We confirmed this repository through the GitHub API and located the code that calls Jev at a pinned commit: view the Jev code ↗. Upstream code changes over time, so check that the file still exists at the current commit before citing it.

How Benchmarks & research projects use Jev

Benchmarks and research projects test Jev rather than just use it. They compare it with language models and other classifiers, check whether its probabilities are well calibrated, and explore where the decision-model approach breaks down.

Related Jev projects in Benchmarks & research

  1. jev-curateAkashPriyadarshii/jev-curateA Rust dataset-filtering experiment using Jev scores to keep or reject text records.★ 26
    Rust
  2. jevifyaltryne/jevifyAn Agent Skill for finding suitable Jev decision points and designing questions and comparison experiments.★ 24
    Python
  3. jev-benchmarksAbdelStark/jev-benchmarksA benchmark comparing Jev and GLiNER on text classification, probability calibration and selective automation.★ 17
    Python
  4. jevcalabhixhek/jevcalA toolkit for evaluating Jev probabilities on labeled data, selecting confidence thresholds and checking model drift.★ 10
    Python
  5. jev-lmy0usaf/jev-lmA word-level generation experiment that asks Jev to select words or verify locally drafted continuations.★ 6
    TypeScript
  6. daf-jevdocxology/daf-jevA Python toolkit for Jev requests, batch evaluation, calibration and MCP access.★ 5
    Python

See all 107 Benchmarks & research projects →

Where we found it