Skip to content
JevDirectory.org
Repos & SDKs#open-models#research#local#sdk

The Open Reimplementations: Local Models That Speak System One

Closed weights have not stopped the ecosystem from rebuilding the shape in the open. API-compatible servers, retrained heads on small models, and inference-time tricks that skip generation entirely.

Jev is a closed model, and that has not stopped the ecosystem from rebuilding its shape in the open. The projects fall into three groups, and knowing which group you are looking at tells you what the numbers mean.

API-compatible servers

The first group speaks the System One wire protocol, so the official SDKs work unchanged.

Kev releases 0.8B, 4B, and 9B weights on Hugging Face with training code and evaluation data, and its API matches TypeSafe's, so the official Python SDK can point at a local server. The 4B and 9B fit a 32 GB Mac in bf16, and a web playground permutes option order for testing. OpenJev takes the same approach with a documented limit worth reading: a Choice can carry at most 128 options against Jev's 255. openjev-sglang wraps the same interface around SGLang on a B200, with radix caching and breakable prefill graphs, and deploys to Modal with a scale-to-zero server. Simple Jev Project builds its JSON from next-token logits, so nothing is generated and output_tokens is always zero; its public demo needs no key, with a 2k-token context and 2 requests per second.

Retrained heads on small models

The second group keeps a small pretrained model and trains the decision interface on top.

NanoJev is built on Qwen3-0.6B with decision heads and one shared step-400 checkpoint across Maze, Snake, ViZDoom Basic, and Predict Position. On its held-out tests it scores 128/128 on ViZDoom Basic against 56/128 for Jev, and 27/128 against 11/128 on Predict Position, with checkpoints and data published. Laya uses ModernBERT-large (421M) for English and mmBERT-base (322M) for 100+ languages, answering in one forward pass at 33 ms for a single question and 7.2 ms per question batched on a T4. decider trains Qwen3.5-2B and 35B-A3B variants and states plainly that nothing was distilled from Jev; its v10 adds 384 steps of calibration-aware RL that lifted sampled browser play from 83% to 93%. OpenJev (Verdict) reports 77.10% against Laya's 76.60% and Jev's 72.70% on 2,000 held-out decisions, with inference-only fixes that cut hard-tier calibration error from 0.298 to 0.118.

Von is the smallest serious option at 395M parameters, answering in under 25 ms on CUDA, ROCm, MPS, or CPU — and its README is also the best reminder to read past the headline, since a 91.23% adversarial claim sits next to its own 49-task table reporting 72.0% macro. PocketJev pushes the same idea on-device: MLX plus Qwen3-VL-2B reads A/B/C logits on an iPhone for 2 to 26 choices, with no image-upload path.

Inference-time tricks

The third group changes nothing about the weights and everything about the decoding.

SemIf reads direct typed logits instead of generating: 21 binary criteria in 1.023 s versus 5.332 s and 111 output tokens for an autoregressive JSON array on one RTX 3090, with CUDA, llama.cpp, and Apple Silicon backends. JEVfire does the same on vLLM: a 28-field fresh-prefix task ran in 496.9 ms against 5,113.1 ms for constrained JSON on the same 27B model, 10.29x faster, and its browser Mario demo cleared World 1-1 at 71 ms mean inference on an M4 Max.

How to read the claims

  • Match the task. Browser play, ViZDoom kills, and JevBench tasks are not interchangeable.
  • Separate self-reported numbers from reproduced ones. Most of these READMEs say which they are; believe the ones that do.
  • Check the wire compatibility before porting. Option limits, score levels, and usage accounting differ.
  • Treat calibration claims as the hardest to reproduce. Accuracy is easier to move than calibration error.

The repos & SDKs category collects these projects alongside the client libraries for languages TypeSafe does not ship officially.

From the directory

The resources behind this article.

3.2kGitHub stars
Apache-licensed, locally runnable Jev-style decision models (0.8B, 4B, 9B on Qwen3.5) with released weights, training code, a System One-compatible server, frozen eval suites, and a playground.
Practices & Patterns#community#python#open-models
Communitykev
300GitHub stars
An Apache-licensed System One decision server that reads Choice, Score, and Noul probabilities from DiffusionGemma 26B-A4B through vLLM on NVIDIA or MLX on Apple silicon, so TypeSafe SDKs work unchanged.
Repos & SDKs#community#python#open-models
Communityopenjev
263GitHub stars
A server that implements the TypeSafe/Jev HTTP API with Qwen3.6-35B-A3B on SGLang 0.5.19, deployed on Modal with radix caching and breakable prefill CUDA graphs, plus a separate FastAPI process.
Repos & SDKs#community#python#open-models
475GitHub stars
A local server and Python package that runs open models with Hugging Face Transformers or PyTorch and returns Choice, Score, and Noul answers read from next-token logits instead of generated JSON.
Repos & SDKs#community#python#open-models
Communitysimple-jev
1.9kGitHub stars
An open 0.6B replica of Jev that turns states and questions into full probability distributions without decoding answer tokens, trained and evaluated on Maze, Snake, and ViZDoom.
Repos & SDKs#community#python#open-models
CommunityNanoJev
14.3kGitHub stars
Open multilingual System 1 decision models with published checkpoints for choice, score and noul questions, plus a router that dispatches each request to the right checkpoint in one forward pass.
Repos & SDKs#community#python#open-models
Communitylaya
296GitHub stars
An independent open reproduction of the System One model class: Qwen3.5-based 2B and 35B mixture-of-experts models that return typed Choice, Score, and Noul probabilities in one forward pass, with nothing distilled from Jev.
Practices & Patterns#community#python#open-models
Communitydecider
68GitHub stars
An encoder-side reproduction of Jev built on a retrained GLiClass ModernBERT base (151M): it evaluates multiple typed questions in one non-autoregressive forward pass, returning choices, ordinal scores, and probabilities under 35 ms.
Practices & Patterns#community#python#open-models
425GitHub stars
An open, non-autoregressive System One model with published weights and a TypeSafe-compatible /v1/systemone API; the 395M-parameter OptionMarker checkpoint scores discrete and ordinal questions locally.
Repos & SDKs#community#python#open-models
Communityvon
1GitHub stars
An experimental iOS app that turns an on-device Qwen3-VL model into a multiple-choice decision tool: it reads next-token logits for A/B/C and scores 2-26 supplied options without generating any text.
Cookbooks & Demos#community#swift#ios
CommunityPocketJev
3.6kGitHub stars
An independent baseline that reads typed option probabilities straight from a frozen Qwen3.5-4B's logits in one forward pass, reproducing Jev's interface pattern with open models rather than Jev's undisclosed model or training.
Practices & Patterns#community#python#open-models
CommunitySemIf
20GitHub stars
An independent CUDA and vLLM take on parallel typed decisions: it scores verified single-token labels with the model's own head and assembles JSON in code.
Practices & Patterns#community#python#javascript
Communityjevfire
Back to all articles

More articles

TypeSafe publishes evals, but the numbers that matter are the ones measured on your task. A tour of the independent benchmarks, field reports, and the recurring finding that question design dominates.
Practices & Patterns#benchmarks#evaluation#calibration
Read article
Every coding agent ships more than one model, and picking between them is a narrow decision. How the routers hand model choice, tool activation, and gateway policy to Jev without breaking the harness.
Tools & Integrations#routing#models#coding-agent
Read article

From the community

Posts from builders shipping with Jev right now.

Follow @typesafeai

Browser Use Ultrafast, powered by Jev

A really smart switch statement

hype-free explanation of jev: jev does not replace gpt / claude jev is just a *really* smart switch statement like if 2016 ml classifiers got 2026 levels of intelligence it's a new* type of tool that will make a lot of workloads insanely fast, cheap, and accurate * = and by Show more

Diogo Almeida
Diogo Almeida
TypeSafe AI
@CompleteSkeptic

After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x

Reply

When a designer gets Jev

Full Jev video tutorial

The case against Jev-scored compaction

This is a terrible compaction strategy that fundamentally doesn't understand how compaction and context management work. Seems like a lot of people are confused so let's break this down. 1. Compaction isn't a filter The role of compaction is to clean up history to keep the Show more

tamara
tamara
@tamarajtran

found the perfect use case for @typesafeai Jev: instant compaction in 2026, why is compaction still a summarization prompt? Jev can make it instant by scoring every tool call and dropping what’s irrelevant

Reply

Classifying rows in DuckDB