Skip to content
JevDirectory.org
CommunityTools & Integrations17 starsVerified 2026-09-22

slop-grader

A CLI that grades markdown and text files against plain-Markdown rulesets with Jev, running every rule against every line in parallel and caching unchanged lines to avoid repeat API calls.

Open github.comlukstei/slop-grader
Category
Tools & Integrations
Published by
Community
Author
lukstei
Added
2026-09-22
Tagscommunitytypescriptclievaluationlinting

Highlights

  • Groups lines into batches of up to 255 per rule and evaluates document-level rubrics in one request across the whole text.
  • Line evaluations are cached by content hash and rule criteria, so unchanged lines cost zero API calls; --no-cache bypasses the cache.
  • Built-in rulesets cover AI writing patterns, tech docs, grammar, and document scores, and rules validate offline with --check.
  • Checking a 16-line example against 53 rules costs roughly $0.0053, and results are available as terminal text or structured JSON.

Quickstart

bash
npx @lukstei/slop-grader@latest -r no-ai-slop examples/slop.md

Watch out

MIT-licensed. Needs Node.js and a TYPESAFE_API_KEY or OPENROUTER_API_KEY; flagged lines may be false positives that a human or agent pass is expected to filter.

More like this

AI CLI
811GitHub stars
Vercel Labs' terminal CLI for the AI SDK: its `ai evaluate` command answers named Boolean, Choice, and Score questions, with Jev as the default evaluation model and one unchanged input shared across all questions.
Tools & Integrations#community#typescript#cli
Communityai-cli
Jev Review
392GitHub stars
A staged code-review workflow that uses Jev for bounded judgments over Git diffs or whole codebases, with a local dashboard. Policy and thresholds stay in code while Jev screens five risk areas.
Tools & Integrations#community#typescript#code-review
Communityjev-review
jev-align
273GitHub stars
An experimental Sutro CLI that evaluates CSV, Parquet, and JSONL data with Jev, asks you to label ambiguous and random audit rows, and uses GEPA to propose improved function definitions.
Tools & Integrations#community#python#cli
Communityjev-align
Back to all resources

From the community

Posts from builders shipping with Jev right now.

Follow @typesafeai

LLM-as-a-judge, sped up

Yuchen Jin
Yuchen Jin
Databricks
@Yuchenj_UW
·

Jev has spoken. It picked which model is AGI. 20–200x faster. 40–400x cheaper. This could make things like LLM-as-a-judge insanely fast and nearly free. (I tried a bunch of prompts and still didn’t burn through $0.10.)

Image
Diogo Almeida
Diogo Almeida
TypeSafe AI
@CompleteSkeptic

After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x

Watch on X
Reply
Read 94 replies

Instant compaction with Jev

A Claude session from 1M to 86K tokens

Alex Volkov
Alex Volkov
CoreWeave
@altryne
·

This is actually insane. This uses @typesafeai Jev model, as a plugin in Claude to review all the un-nesseasary tool calls, and it takes 1s to run! Like, literally, 1 second to take my Claude session from nearly 1M to ... 86K tokens! 😮 Ask your claude to install it and be  Show more

Image
Image
tamara
tamara
@tamarajtran

found the perfect use case for @typesafeai Jev: instant compaction in 2026, why is compaction still a summarization prompt? Jev can make it instant by scoring every tool call and dropping what’s irrelevant

Watch on X
Reply
Read 164 replies

Vercel's fx safety reviewer, 18x faster

Guillermo Rauch
Guillermo Rauch
Vercel
@rauchg
·

We're seeing extraordinary results from @typesafeai. Default mode in 𝚏𝚡 is auto, with a safety reviewer analyzing every command. That reviewer runs on GPT Luna today. Jev is up to 18x faster (p95) *and* more accurate. It's coming to @vercel AI Gateway and likely new default.

Pranit
Pranit
Vercel
@fazxes

We benchmarked fx auto mode (safety) classifier with @typesafeai's Jev. tl;dr: ~5-18x faster and more accurate than 𝚐𝚙𝚝-𝟻.𝟼-𝚕𝚞𝚗𝚊, our current top choice

Image
Reply
Read 137 replies

Jev lands on OpenRouter

700 leads scored for $0.09