Skip to content
JevDirectory.org
CommunityPractices & PatternsArticleVerified 2026-09-22

Testing TypeSafe Jev, Mistral and Gemini for local event validation

A use-case study comparing Jev, Mistral Small 4, and Gemini 3.5 Flash-Lite on rejecting unsuitable local-event listings, with individually tuned prompts, accuracy, response times, and costs.

Category
Practices & Patterns
Published by
Community
Author
Added
2026-09-22
Tagscommunityarticlebenchmarksevaluation

Highlights

  • Jev matched 48 of 50 expected decisions, ahead of Gemini 3.5 Flash-Lite at 43 and Mistral Small 4 at 42.
  • Jev rejected none of the 13 expected-valid events; Mistral rejected 5 and Gemini 1.
  • On the 21-record timing run, Jev's median response was 0.58s and total cost $0.000904 versus Gemini's 3.44s and $0.052421.
  • Cost per 1,000 decisions at list prices: Jev $0.043, Mistral $0.370, Gemini $2.496.
  • Prompts were tuned per provider across 132 cases, including 32 purpose-written cases covering policy boundaries.

Watch out

A use-case study by an events company rather than a general model ranking: samples are retained rejection cases, expected decisions were assistant-written, and the 21-record timing set was not a blind test.

More like this

208GitHub stars
A self-hosted implementation of TypeSafe's Jev System One API powered by the 400M-parameter GLiFormer encoder: it serves choice, score, and noul and drops into the official typesafe-sdk via TYPESAFE_BASE_URL, but trails Jev on reasoning-heavy tasks.
Practices & Patterns#community#python#open-models
Communityjeff
104GitHub stars
A personal-assistant agent with 100 mocked tools that measures how many steps a task takes when the LLM picks the tool versus when Jev picks it before every model step.
Practices & Patterns#community#typescript#agents
91GitHub stars
A comparison arena that runs the same batch of review comments through Jev and DeepSeek, showing processing time, cost, and per-label results with CSV/Excel import, replay, and offline reports.
Practices & Patterns#community#javascript#benchmarks
Communityjev-arena
Back to all resources

From the community

Posts from builders shipping with Jev right now.

Follow @typesafeai

Browser Use Ultrafast, powered by Jev

A really smart switch statement

hype-free explanation of jev: jev does not replace gpt / claude jev is just a *really* smart switch statement like if 2016 ml classifiers got 2026 levels of intelligence it's a new* type of tool that will make a lot of workloads insanely fast, cheap, and accurate * = and by Show more

Diogo Almeida
Diogo Almeida
TypeSafe AI
@CompleteSkeptic

After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x

Reply

When a designer gets Jev

Full Jev video tutorial

The case against Jev-scored compaction

This is a terrible compaction strategy that fundamentally doesn't understand how compaction and context management work. Seems like a lot of people are confused so let's break this down. 1. Compaction isn't a filter The role of compaction is to clean up history to keep the Show more

tamara
tamara
@tamarajtran

found the perfect use case for @typesafeai Jev: instant compaction in 2026, why is compaction still a summarization prompt? Jev can make it instant by scoring every tool call and dropping what’s irrelevant

Reply

Classifying rows in DuckDB