Text
Around 2,000 tokens in the published measurement.
83 msModel profile · updated October 26, 2026
Jev-Omni
A decision classifier that reads pictures, sound and video — not just text.
Jev-Omni is an independent, open-weights model that borrows Jev's idea and extends it past text. You hand it a state, a question and a list of options; it hands back a probability for each option and writes nothing. What makes it worth knowing about is the input side: it also accepts images and video, which Jev does not. The model can also take audio, but we switched that off on Jev AI on 11 October 2026 after it stayed near chance on short speech and everyday sounds in our tests; audio runs on Clef-Omni instead.
Looking for OmniJev, the Qwen3.5-based project with 0.8B, 2B and 4B models? Read the OmniJev guide. It is a separate project from this Gemma-based Jev-Omni model. Compare OmniJev vs Jev-Omni.
- Base modelGemma 4 12B IT
- Parameters12B
- LicenceApache-2.0
- Authorakhilaaa3
Jev-Omni has been offline on Jev AI since 19 October 2026. The editor below runs Jev 1.14, the model we recommend today, which also reads images. Sign in to run live decisions.
Try it on this page
Run Jev 1.14 right here
Edit the example or paste your own text, then run it. Sign in to run: new accounts get 20 welcome credits, and a failed run costs nothing.
Jev-Omni has been offline since 19 October 2026, so this editor runs Jev 1.14, the model we recommend today. It also reads images.
Photo of an invoice · Jev 1.14
1 Input
A supplier sent this scan instead of a PDF: `scan`
2 Questions
- Yes / No Every line of the total is readable without guessing.
- Choice What kind of document is this?
- Score How badly does this need to be re-sent as a PDF?
- Box the total amount in `scan`
What it can read, and how fast
Warm H200, medians over 20 requests on an optimised backend. Preprocessing and network time are extra, and a smaller card will be slower.
Image
One image per request.
26 msAudio
Capped at 30 seconds in the model. Switched off on Jev AI: near chance on short speech and sounds in our tests; use Clef-Omni.
31 msVideo
Sampled as 16 frames.
504 msWhat Jev-Omni actually is
Independent work by akhilaaa3, not by TypeSafe.
It is Google's Gemma 4 12B IT with a classification head bolted on, fine-tuned across a 30,000-question decision run and published as a merged model. The head scores the options you supply and returns a distribution over them. No tokens are generated, so there is no prose to parse and no schema for the model to break.
The multimodal parts come from Gemma 4 itself: the loader pulls the original multimodal components down automatically the first time you use them. Audio is capped at 30 seconds and video is sampled down to 16 frames, so this is a model for short clips and single images rather than long recordings.
It is Apache-2.0, following Gemma 4's terms. The card notes separately that rights to the training dataset are not covered by that licence.
Published results
Both columns the card reports: an equal-weight average across scenarios or groups, and a micro average across all questions.
| Benchmark | Scope | Accuracy | Micro accuracy |
|---|---|---|---|
| DecisionBench Medium | 80 scenarios / 293 questions | 87.57% | 86.01% |
| JevBench (matched subset) | 195 groups / 231 decisions | 86.15% | 87.45% |
| MMAU | 1,000 questions | — | 63.10% |
| MVBench | 14 evaluated tasks / 2,786 questions | 53.10% | 53.09% |
That JevBench row is not the leaderboard. The card reports 86.15% on a matched subset — 195 groups and 231 decisions. Benchmark Heaven's JevBench v1.7.48, the ranking used on the comparison pages of this site, re-measured Jev-Omni on a new pool of 300 open and 1,200 sealed text decisions and ranks it #52 of 235 open-weights systems at 71; Jev, a hosted API, is an unranked reference row on that board at 71.4. On the benchmark’s headline Capability ranking, which leaves speed and cost out, Jev-Omni is #52 at 71.3 against Jev’s 77.1. Its intelligence score is 55.5, from 59.1 on the open half and 51.9 on the sealed one, and its calibration scores 87.0 against Jev's 90.6. The benchmark ran it on an RTX 6000. The two numbers are not comparable. See the full JevBench results.
On images, it placed #16. Benchmark Heaven's separate Image JevBench v0.3.0 scores 67 systems, 64 of them ranked, on a new pool of 2,441 items across 2,160 images, drawn as 300 public and 1,200 sealed decisions. Jev-Omni ranks #16 at 32.8, with intelligence 37.5, calibration 71.0 and a better cost score than every open-weights system above it. Those ahead of it include kettei-fat at 75.4, Wity-1 at 71.2, H2O-Lightning-4B v1.4.1 (image) at 66.6, Imajev-4B at 63.7, kettei-chub at 63.3, H2O-Lightning-31B (image) at 51.2, Sage 1.4 with images (beta) at 47.9, Drex Max at 44.6, Surogate Rune 26B-A4B v3 at 42.5, Autoloops on Gemma 4 31B IT at 41.4, basal-omni-1.0-ultra at 40.9, Celeris-1 Decision at 39.5, imajev 9B at 34.5, H2O-Lightning-4B (image) at 34.1 and Wity-1 with reasoning off at 33.1. It is #25 on that board’s Capability ranking at 54.3. No v0.3.0 score can be compared with a v0.1.5 one. Compare Imajev-4B vs Jev-Omni.
Calibration: the card reports a medium expected calibration error of 0.0400 over 10 bins, measured by its author.
How the card positions it against larger open models
Reproduced from the model card, which notes that the reference scores are officially reported by their own developers and may use different evaluation protocols.
| Model | Parameters | MMAU | MVBench | Modalities |
|---|---|---|---|---|
| Jev-Omni | 12B | 63.10% | 53.10% | Text, image, audio, video |
| Inkling | 975B total / 41B active | 77.20% | — | Text, image, audio |
| Qwen3.5-397B-A17B | 397B total / 17B active | — | 77.60% | Text, image, video |
Read honestly, this table is a size argument rather than a quality one: Jev-Omni trails both references on their own benchmarks, at a fraction of the parameters, and is the only one of the three covering all four modalities.
Running it
A CUDA GPU is required. The current checkpoint contains about 24 GB of BF16 weights. Our 48 GB deployment runs the hosted experience above; larger inputs require additional runtime memory. Audio input also needs ffmpeg.
pip install -r https://huggingface.co/akhilaaa3/Jev-Omni/resolve/main/requirements.txtfrom huggingface_hub import snapshot_download
path = snapshot_download("akhilaaa3/Jev-Omni")
import sys; sys.path.insert(0, path)
from jev_omni import load_jev_omni
classifier = load_jev_omni()
result = classifier.predict(
state="The meeting starts at 10 AM. It is now 9 AM.",
question="Has the meeting started?",
options=["Yes", "No"],
)
print(result)For other modalities, add media="/path/to/file" and modality="image", "audio" or "video".
Limits worth knowing first
- Twenty options, practically. The head accepts 256, but the card says quality above 20 is not established.
- Short media only. 16 frames of video; the model caps audio at 30 seconds, and audio is switched off on Jev AI.
- Weak on short or non-speech audio in our tests. Single spoken words under a second came out near chance unless padded with silence on both sides, and five-second environmental sounds (ESC-10) scored 10%. Longer read speech was fine. For audio, use Clef-Omni, also in the playground.
- It is a classifier. No generated output tokens, so no explanation of why it chose what it chose.
- Serious hardware. A CUDA GPU with enough memory for the BF16 checkpoint and runtime overhead. Published benchmark speeds were measured on an H200.
- Dataset rights are separate from the Apache-2.0 licence on the weights.
Jev-Omni or Jev?
Reach for Jev-Omni if
- The decision is about an image, a short voice clip or a few seconds of video.
- You have a CUDA GPU with room for a 12B multimodal model and want open weights you control.
- You are willing to validate accuracy and calibration on your own data before trusting the numbers.
Reach for Jev if
- Your state is text, which is most triage, moderation, routing and scoring work.
- You want calibrated probabilities from a hosted API with nothing to install and no GPU to keep running.
- You want native Jev’s text decision workflow and public API. For images on Jev AI, use Jev 1.14 in the editor above.
The text half of this you can test right now
If your decisions are text, the Jev AI playground runs Jev 1.14 on your own cases with free welcome credits, no setup and the full probability distribution on every answer. If they are not text, Jev-Omni is a genuine option and Jev is not — convert to text or use a model that takes pixels.
Jev-Omni FAQ
What is Jev-Omni?
An open-weights multimodal decision classifier by akhilaaa3, fine-tuned from Google's Gemma 4 12B IT on 30,000 decision questions. You give it a state, a question and a list of options; it returns a probability for each option and generates no text.
Is Jev-Omni made by TypeSafe, or related to Jev?
No. It is an independent model that borrows the Jev name and the typed-decision idea. TypeSafe's Jev is a closed hosted model; Jev-Omni is Apache-2.0 weights on Gemma 4 that you run yourself.
Does Jev-Omni appear in the JevBench ranking?
Yes, on two boards. Benchmark Heaven's text JevBench v1.7.48 ranks it #52 of 235 open-weights systems at 71, below Jev's 71.4 reference score, and #52 on its headline Capability ranking, with an intelligence score of 55.5. Its separate Image JevBench v0.3.0 ranks it #16 of 64 at 32.8. The card's own 86.15% is a different number, on a matched subset of 231 decisions, and the two cannot be compared.
What hardware does Jev-Omni need?
A CUDA GPU. The current checkpoint loads directly in BF16. Our 48 GB GPU deployment uses about 24 GB after small text and media tests; larger inputs need additional headroom. The published latencies were measured on a warm H200, so treat them as a ceiling rather than what you would see on a smaller card.
How many options can Jev-Omni handle?
The classification head accepts up to 256, but the card states it is best supported at 20 or fewer and that quality above 20 is not established. Test your own option counts before relying on them.
Can Jev read images the way Jev-Omni does?
No. Jev is text only: a string, a JSON object or an array. If your decision is about a photograph, a voice note or a clip, Jev cannot make it and a multimodal model like Jev-Omni can.
Sources
Model card read on September 22, 2026; both leaderboards read on October 26, 2026.
Jev-Omni, Gemma and every other product named on this page belongs to its respective owner and is not affiliated with Jev AI. Figures are quoted from the sources above as they read on the dates given and can change.