GPTCache

What Jev does in GPTCache

The project describes itself this way: A semantic cache for LLM calls that can use Jev to decide whether a cached answer can be reused. In the SDKs & clients category, Jev typically decides nothing on their own; they make it easy to send state and typed questions and parse the answers.

Verification

Verified. We confirmed this repository through the GitHub API and located the code that calls Jev at a pinned commit: view the Jev code ↗. Upstream code changes over time, so check that the file still exists at the current commit before citing it.

Topics

• aigc
• autogpt
• babyagi
• chatbot
• chatgpt
• chatgpt-api
• dolly
• gpt
• langchain
• llama
• llama-index
• llm
• memcache
• milvus

How SDKs & clients projects use Jev

Client libraries for calling Jev from different languages and runtimes. Use them when the official SDKs do not cover your stack, or when you want a thinner, more opinionated wrapper around typed questions and answers.

Related Jev projects in SDKs & clients

1. advocaatpithings/advocaatA small TypeScript client for asking Jev multiple typed questions about the same data.★ 89
   TypeScript
2. milvus-modelmilvus-io/milvus-modelMilvus's embedding and reranker model library, including a reranker that calls TypeSafe's System One endpoint.★ 61
   Python
3. ruby_decision_modelobie/ruby_decision_modelA Ruby decision-model client for Jev through TypeSafe’s native API or OpenRouter.★ 50
   Ruby
4. pi-typesafeDevMortimer/pi-typesafeA Pi Jev extension providing a decision tool, terminal playground commands and an API for other extensions.★ 41
   TypeScript
5. stuntdbladedevoff/stuntdLocal proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI compatible.★ 27
   Python
6. typesafe-aiTwister915/typesafe-aiA Rust TypeSafe client with asynchronous reqwest or blocking ureq backends and observable retries.★ 11
   Rust

See all 63 SDKs & clients projects →

Where we found it

• yibie/awesome-jev