GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

prithivMLmods/JEV-27B-VL-GGUF overview

JEV 27B VL GGUF autotrust/JEV 27B VL is a vision capable extension of autotrust/JEV 27B https://huggingface.co/autotrust/JEV 27B , pairing the same calibrated …

transformersggufdecision-modeltext-generation-inferencellama-cppjevsystem-onesystem-twotyped-decisionscalibrated-probabilitiesmultimodalvisionzero-shotrecommendationloravllmqwen3_5image-text-to-textenbase_model:autotrust/JEV-27B-VLbase_model:quantized:autotrust/JEV-27B-VLlicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~888.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
382
Likes
2
Pipeline
image-text-to-text

Repository Files & Downloads

5 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
JEV-27B-VL.BF16.ggufGGUFGGUF50.11 GBDownload
JEV-27B-VL.Q3_K_M.ggufGGUFGGUF12.39 GBDownload
JEV-27B-VL.Q4_K_M.ggufGGUFGGUF15.41 GBDownload
JEV-27B-VL.Q5_K_M.ggufGGUFGGUF17.91 GBDownload
JEV-27B-VL.mmproj-bf16.ggufGGUFBF16888.0 MBDownload

Model Details

Model IDprithivMLmods/JEV-27B-VL-GGUF
AuthorprithivMLmods
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelautotrust/JEV-27B-VL
Last modified2026-10-07T15:33:04.000Z

Model README

---

base_model_relation: quantized

base_model:

  • autotrust/JEV-27B-VL

tags:

  • decision-model
  • text-generation-inference
  • llama-cpp
  • jev
  • system-one
  • system-two
  • typed-decisions
  • calibrated-probabilities
  • multimodal
  • vision
  • zero-shot
  • recommendation
  • lora
  • vllm
  • qwen3_5

license: apache-2.0

language:

  • en

pipeline_tag: image-text-to-text

library_name: transformers

---

JEV-27B-VL-GGUF

> autotrust/JEV-27B-VL is a vision-capable extension of autotrust/JEV-27B, pairing the same calibrated System 1 typed-decision interface (yes/no, pick-one-of-2–256-options, or 0–5 rating, returned as a probability distribution in a single forward pass) with the unmodified Qwen3.8-27B as System 2, now extended to accept images and multimodal prompts up to 256K tokens via a POST /v1/decide endpoint. Text-only decisions match the original JEV-27B almost exactly (mean probability difference 0.010 across 1,000 checks), while image-based System 1 decisions prove strong across a wide range of zero-shot applications: 75% success on a MuJoCo robot-arm pick-and-place task and 95% on 60 multi-step browser computer-use tasks (both the best or tied-best in the JEV family), an AUC of 0.727 for zero-shot short-video recommendation from thumbnail covers alone (matching collaborative filtering trained on 59,045 users' logs), 73.2% on Plan-RewardBench (top of that paper's leaderboard) and higher precision than all 16 AgentRewardBench leaderboard judges at matched recall, and 78.3% on VL-RewardBench (above every model on its 2025 leaderboard, including GPT-4o and Claude 3.5 Sonnet). It also extends choice questions to up to 256 options with no retraining via two-letter labels beyond the trained 16, and the card documents concrete prompt-writing guidance — one-line "use when" descriptions for similar options measurably help, while wording, JSON vs. plain text, and extra instructions do not. It's served via a patched vLLM server (serve_decide.py) requiring --max-num-seqs 8 for correct multimodal LoRA behavior, with image-decision calibration not yet systematically measured, and is released under Apache-2.0, built from the unchanged Qwen3.8-27B weights plus the JEV System 1 adapter and decision head.

Model Files

| File Name | Quant Type | File Size | File Link | Description |

|-----------|------------|-----------|-----------|-------------|

| JEV-27B-VL.BF16.gguf | BF16 | 53.8 GB | Link | Full BF16 weights. Highest quality, largest file size. |

| JEV-27B-VL.Q3_K_M.gguf | Q3_K_M | 13.3 GB | Link | Low quality. |

| JEV-27B-VL.Q4_K_M.gguf | Q4_K_M | 16.5 GB | Link | Good quality, default size for most use cases, recommended. |

| JEV-27B-VL.Q5_K_M.gguf | Q5_K_M | 19.2 GB | Link | High quality, recommended. |

| JEV-27B-VL.mmproj-bf16.gguf | mmproj-bf16 | 931 MB | Link | Multimodal projection file in BF16 format. Used for vision/language models. |

llama.cpp

LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp

Releases / v0.6.0 — https://github.com/ggml-org/llama.cpp/releases/tag/v0.6.0

Run prithivMLmods/JEV-27B-VL-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models