Skip to content
JevDirectory.org
CommunityTools & IntegrationsArticle

Evaluate Agent Responses with Jev

Use Jev as a Braintrust judge scorer, then inspect selected answers, confidence, and probabilities alongside the scorer answer. Includes tracing for your own calls.

Category
Tools & Integrations
Published by
Community
Author
Braintrust
Added
2026-09-18
Tagscommunityevaluationobservabilityintegration

More like this

AI Gateway's evaluation modality: call Jev as `typesafe-ai/jev` through the AI SDK's experimental_evaluate API, with structured answers instead of free-form text.
Tools & IntegrationsDocs#community#vercel#integration
Community
LangChain's langchain-typesafe integration exposes Jev as a TypeSafeClassifier plus experimental model-routing and auto-mode middleware that screens risky tool calls before execution.
Tools & IntegrationsArticle#community#integration#python
Community
OpenRouter's beta announcement for Jev: state plus typed questions returns typed decisions with probabilities, so there is no JSON prompting, parsing layer, or output validation.
Tools & IntegrationsVideo#community#x#video
Community
Back to all resources

From the community

Posts from builders shipping with Jev right now.

Follow @typesafeai

LLM-as-a-judge, sped up

Jev has spoken. It picked which model is AGI. 20–200x faster. 40–400x cheaper. This could make things like LLM-as-a-judge insanely fast and nearly free. (I tried a bunch of prompts and still didn’t burn through $0.10.)

Image
Diogo Almeida
Diogo Almeida
TypeSafe AI
@CompleteSkeptic

After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x

Reply

Instant compaction with Jev

A Claude session from 1M to 86K tokens

This is actually insane. This uses @typesafeai Jev model, as a plugin in Claude to review all the un-nesseasary tool calls, and it takes 1s to run! Like, literally, 1 second to take my Claude session from nearly 1M to ... 86K tokens! 😮 Ask your claude to install it and be  Show more

Image
Image
tamara
tamara
@tamarajtran

found the perfect use case for @typesafeai Jev: instant compaction in 2026, why is compaction still a summarization prompt? Jev can make it instant by scoring every tool call and dropping what’s irrelevant

Reply

Vercel's fx safety reviewer, 18x faster

We're seeing extraordinary results from @typesafeai. Default mode in 𝚏𝚡 is auto, with a safety reviewer analyzing every command. That reviewer runs on GPT Luna today. Jev is up to 18x faster (p95) *and* more accurate. It's coming to @vercel AI Gateway and likely new default.

Pranit
Pranit
Vercel
@fazxes

We benchmarked fx auto mode (safety) classifier with @typesafeai's Jev. tl;dr: ~5-18x faster and more accurate than 𝚐𝚙𝚝-𝟻.𝟼-𝚕𝚞𝚗𝚊, our current top choice

Image
Reply

Jev lands on OpenRouter

700 leads scored for $0.09