Skip to content
JevDirectory.org
OfficialCookbooks & DemosVerified 2026-09-20

Cookbook: Self-Consistency for Nouls

A 14-Noul claims-triage rubric over one insurance claim, repeated 15 times: mean probability standard deviation of 0.0102 at 111 ms per call, with a 0.30 to 0.70 band for human review.

Open docs.typesafe.ai
Category
Cookbooks & Demos
Published by
TypeSafe AI
Author
—
Added
2026-09-20
Tagsofficialcookbookconsistencyconfidencetriage

Highlights

  • 14 Noul questions across 15 repeats and 9 conditions; jev-1.13.0 ran at 111 ms and $0.000043 per rubric call.
  • The covered answers spanned 0.43 to 0.53, crossing the 0.5 threshold, while the other 13 questions stayed on one side.
  • A 0.30 to 0.70 band maps probabilities to no, uncertain, and yes for human review with no extra API call.

Watch out

The band is illustrative rather than calibrated, and values near its edges can still flip between uncertain and a hard answer.

More like this

Cookbook: Self-Consistency for Choices
A repeatability study: an 8-question moderation rubric run 15 times per condition shows a mean probability standard deviation of 0.0098, and a 0.60 uncertainty gate lifts agreement to 99.2%.
Cookbooks & Demos#official#cookbook#consistency
Official
Cookbook: Line-by-Line Search
Semantic search over GitHub's Terms of Service: one request ranks all 218 lines with a Choice while a Noul checks whether the document contains an answer at all, including when it should say no.
Cookbooks & Demos#official#cookbook#search
Official
Cookbook: SDE Cascade
A two-stage extraction cascade: a mini model extracts, a Noul battery verifies each field in one request, and a 0.7 gate escalates to a reasoning model, sitting on the cost/quality frontier.
Cookbooks & Demos#official#cookbook#extraction
Official
Back to all resources

From the community

Posts from builders shipping with Jev right now.

Beating Gemini Flash Lite on an eval

Browser Use Ultrafast, powered by Jev