GraySoft
Download guIDE →
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

IFM/Jais-3-0.9B-GGUF overview

Jais 3 0.9B GGUF NOTE This repository contains GGUF versions of inception42/Jais 3 0.9B https://huggingface.co/inception42/Jais 3 0.9B for use with llama.cpp .…

transformersggufllama.cppjais-30.9bdensereasoningifmtext-generationarenbase_model:inception42/Jais-3-0.9Bbase_model:quantized:inception42/Jais-3-0.9Blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~635.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
187
Likes
1
Pipeline
text-generation
Author
IFM

Repository Files & Downloads

6 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Jais-3-0.9B-BF16.ggufGGUFBF162.01 GBDownload
Jais-3-0.9B-Q4_K_M.ggufGGUFQ4_K_M635.3 MBDownload
Jais-3-0.9B-Q5_0.ggufGGUFQ5_0722.3 MBDownload
Jais-3-0.9B-Q5_K_M.ggufGGUFQ5_K_M737.7 MBDownload
Jais-3-0.9B-Q6_K.ggufGGUFQ6_K846.4 MBDownload
Jais-3-0.9B-Q8_0.ggufGGUFQ8_01.07 GBDownload

Model Details

Model IDIFM/Jais-3-0.9B-GGUF
AuthorIFM
Pipelinetext-generation
Licenseapache-2.0
Base modelinception42/Jais-3-0.9B
Last modified2026-10-16T08:21:09.000Z

Model README

---

pipeline_tag: text-generation

library_name: transformers

model_name: Jais-3-0.9B

language:

  • ar
  • en

tags:

  • gguf
  • llama.cpp
  • jais-3
  • 0.9b
  • dense
  • reasoning
  • ifm

base_model:

  • inception42/Jais-3-0.9B

license: apache-2.0

---

Jais-3-0.9B-GGUF

> [!NOTE]

> This repository contains GGUF versions of inception42/Jais-3-0.9B for use with llama.cpp.

>

> Multiple precision and quantization variants are available: BF16, Q8_0, Q6_K, Q5_K_M, Q5_0, Q4_K_M.

> [!WARNING]

> Deployment notes: K2 Horizon architecture support is merged into llama.cpp

> (ggml-org/llama.cpp#29535). Use a recent llama.cpp build,

> build it yourself from master, or wait for the next official llama.cpp release. Start llama-server with --jinja so that reasoning and tool calls are parsed.

Jais-3-0.9B is the compact dense member of the Jais-3 family: a 0.9B-class decoder-only model with a 128K context window.

> [!TIP]

> Other formats are available in the IFM/Jais-3 collection:

> - MLX for Apple silicon:

> - IFM/Jais-3-0.9B-MLX-4bit

> - IFM/Jais-3-0.9B-MLX-8bit

> - IFM/Jais-3-0.9B-MLX-bf16

<p align="center">

<a href="https://huggingface.co/IFM/Jais-3-0.9B-GGUF/resolve/main/assets/jais-3-0.9b-benchmarks.png" target="_blank">

<img src="assets/jais-3-0.9b-benchmarks.png" alt="Jais-3-0.9B benchmark results" width="100%">

</a>

</p>

Benchmark Results

<!-- TABLE:START -->

<div style="font-family:-apple-system,BlinkMacSystemFont,'Segoe UI',Roboto,sans-serif;margin:0 auto;padding:8px 0 16px;overflow-x:auto"><table style="display:table;width:100%;table-layout:fixed;border-collapse:collapse;font-size:12px;margin:0"><thead><tr><th style="width:30%;border-bottom:none"></th><th style="border-bottom:none"></th><th colspan="4" style="padding:6px 4px 2px;text-align:center;font-size:11px;font-weight:600;letter-spacing:0.04em;text-transform:uppercase;opacity:0.65;border-bottom:1px solid rgba(128,128,128,0.25)">Reference models</th></tr><tr><th style="padding:10px 6px;text-align:left;border-bottom:2px solid #0b9573"></th><th style="padding:10px 3px;text-align:center;font-weight:600;border-bottom:2px solid #0b9573;font-size:12.5px;line-height:1.2;width:14.00%;overflow-wrap:anywhere;background:rgba(11,149,115,0.08);">Jais-3-0.9B</th><th style="padding:10px 3px;text-align:center;font-weight:600;border-bottom:2px solid #0b9573;font-size:12.5px;line-height:1.2;width:14.00%;overflow-wrap:anywhere;">Qwen3.5-2B</th><th style="padding:10px 3px;text-align:center;font-weight:600;border-bottom:2px solid #0b9573;font-size:12.5px;line-height:1.2;width:14.00%;overflow-wrap:anywhere;">Falcon-H1-1.5B-Deep-Instruct</th><th style="padding:10px 3px;text-align:center;font-weight:600;border-bottom:2px solid #0b9573;font-size:12.5px;line-height:1.2;width:14.00%;overflow-wrap:anywhere;">Hala 1.2B</th><th style="padding:10px 3px;text-align:center;font-weight:600;border-bottom:2px solid #0b9573;font-size:12.5px;line-height:1.2;width:14.00%;overflow-wrap:anywhere;">tiny-aya-global</th></tr></thead><tbody><tr><td style="padding:7px 4px 7px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;font-weight:600"># Params</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);">0.9B</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">2B</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">1.5B</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">1.2B</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">3B</td></tr><tr><td style="padding:7px 4px 7px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;font-weight:600"># Activated params</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);">0.9B</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">2B</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">1.5B</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">1.2B</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">3B</td></tr><tr><td style="padding:7px 4px 7px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;font-weight:600">Architecture</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);">Dense</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">Dense</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">Dense</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">Dense</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">Dense</td></tr><tr><td colspan="6" style="padding:9px 10px 7px;font-weight:700;font-size:11px;letter-spacing:0.05em;text-transform:uppercase;border-bottom:1px solid rgba(11,149,115,0.4);background:rgba(11,149,115,0.22)">Open-ended Generation</td></tr><tr><td colspan="6" style="padding:6px 10px;font-weight:600;font-size:12.5px;border-bottom:1px solid rgba(11,149,115,0.25);background:rgba(11,149,115,0.06)">AraGen</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">AraGen v3 (3C3H)</div><div style="margin-top:2px;font-size:10px;opacity:0.65">09-2025</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>32.7</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">15.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">12.2</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">25.0</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">21.4</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">Correctness</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>39.4</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">20.0</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">15.5</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">28.2</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">27.3</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">Completeness</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>38.6</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">19.3</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">15.0</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">27.1</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">25.2</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">Conciseness</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);">10.9</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">2.6</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">3.1</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;"><strong>14.4</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">6.5</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">Helpfulness</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>33.2</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">15.4</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">11.4</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">25.8</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">21.1</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">Honesty</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>35.8</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">15.4</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">13.1</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">26.8</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">22.1</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">Harmlessness</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>38.7</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">19.0</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">15.4</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">27.5</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">26.5</td></tr><tr><td colspan="6" style="padding:9px 10px 7px;font-weight:700;font-size:11px;letter-spacing:0.05em;text-transform:uppercase;border-bottom:1px solid rgba(11,149,115,0.4);background:rgba(11,149,115,0.22)">Knowledge & Reasoning</td></tr><tr><td colspan="6" style="padding:6px 10px;font-weight:600;font-size:12.5px;border-bottom:1px solid rgba(11,149,115,0.25);background:rgba(11,149,115,0.06)">General Knowledge & Comprehension</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Arabic MMLU</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>70.4</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">63.1</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">48.7</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">45.0</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">55.9</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Belebele</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>81.6</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">67.6</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">57.8</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">39.9</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">62.2</td></tr><tr><td colspan="6" style="padding:6px 10px;font-weight:600;font-size:12.5px;border-bottom:1px solid rgba(11,149,115,0.25);background:rgba(11,149,115,0.06)">STEM & Math</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">AraSTEM</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);">81.6</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;"><strong>83.9</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">62.5</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">48.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">58.5</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Arabic GSM8K</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>80.9</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">75.6</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">65.4</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">57.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">59.6</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">GATmath</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>87.4</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;"><strong>87.4</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">40.2</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">29.6</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">31.4</td></tr><tr><td colspan="6" style="padding:6px 10px;font-weight:600;font-size:12.5px;border-bottom:1px solid rgba(11,149,115,0.25);background:rgba(11,149,115,0.06)">Professional Domains</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">MedAraBench</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);">48.1</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;"><strong>54.3</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">32.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">32.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">39.5</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Arabic Legal (HELM)</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>58.7</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">49.1</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">48.8</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">41.1</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">52.2</td></tr><tr><td colspan="6" style="padding:9px 10px 7px;font-weight:700;font-size:11px;letter-spacing:0.05em;text-transform:uppercase;border-bottom:1px solid rgba(11,149,115,0.4);background:rgba(11,149,115,0.22)">Arabic Language & Culture</td></tr><tr><td colspan="6" style="padding:6px 10px;font-weight:600;font-size:12.5px;border-bottom:1px solid rgba(11,149,115,0.25);background:rgba(11,149,115,0.06)">Islamic Knowledge & Arab Culture</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">IslamicQA</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy (mean of the 4 below)</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>66.2</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">43.0</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">48.2</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">35.9</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">44.2</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">PaLM-X 2025-2</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>78.1</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">62.0</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">62.1</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">50.0</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">71.6</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">QIAS-1</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>61.1</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">26.1</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">32.1</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">16.2</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">23.1</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">QIAS-2</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>65.0</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">51.5</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">56.0</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">41.9</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">54.7</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">IslamicEval2025-1B</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>60.6</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">32.5</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">42.4</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">35.5</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">27.3</td></tr><tr><td data-detail="summary" style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Arab Culture</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy (mean of the 3 below)</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>73.3</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">54.8</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">54.4</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">46.9</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">61.5</td></tr><tr><td style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">ArabCulture</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>74.0</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">63.8</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">61.7</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">60.6</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">68.6</td></tr><tr><td style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">AraDiCE-Culture</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>72.6</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">46.9</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">49.2</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">30.7</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">55.3</td></tr><tr><td style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">Arabic Cuisine^</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>73.4</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">53.6</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">52.4</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">49.5</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">60.6</td></tr><tr><td colspan="6" style="padding:6px 10px;font-weight:600;font-size:12.5px;border-bottom:1px solid rgba(11,149,115,0.25);background:rgba(11,149,115,0.06)">Dialects</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Dialectal Arabic MMLU</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>63.7</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">59.5</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">42.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">40.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">47.7</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Dialect Identification (QADI)</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>65.9</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">24.2</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">23.4</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">23.0</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">38.8</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Alyah</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>73.8</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">53.2</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">54.8</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">53.2</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">68.1</td></tr><tr><td colspan="6" style="padding:6px 10px;font-weight:600;font-size:12.5px;border-bottom:1px solid rgba(11,149,115,0.25);background:rgba(11,149,115,0.06)">Linguistics & Literature</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Arabic MMLU with diacritics</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>65.1</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">49.4</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">34.7</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">31.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">45.6</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">FannOrFlop-MCQ</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>59.3</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">43.6</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">38.5</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">31.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">48.5</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Arabic Linguistics^</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy (mean of the 2 below)</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>85.5</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">54.7</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">33.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">32.6</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">38.2</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">Diacritization</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>83.6</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">65.1</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">26.0</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">32.9</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">36.7</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">Parsing</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>87.4</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">44.4</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">40.6</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">32.2</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">39.6</td></tr><tr><td colspan="6" style="padding:9px 10px 7px;font-weight:700;font-size:11px;letter-spacing:0.05em;text-transform:uppercase;border-bottom:1px solid rgba(11,149,115,0.4);background:rgba(11,149,115,0.22)">Assistant Capabilities</td></tr><tr><td colspan="6" style="padding:6px 10px;font-weight:600;font-size:12.5px;border-bottom:1px solid rgba(11,149,115,0.25);background:rgba(11,149,115,0.06)">Instruction Following</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Arabic IFBench^</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy (prompt-level strict)</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>91.1</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">33.1</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">16.2</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">14.6</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">21.5</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">Arabic IFEval</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>71.3</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">62.6</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">49.3</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">44.1</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">58.2</td></tr><tr><td colspan="6" style="padding:6px 10px;font-weight:600;font-size:12.5px;border-bottom:1px solid rgba(11,149,115,0.25);background:rgba(11,149,115,0.06)">Factuality & Hallucination</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">HalluScore</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Accuracy</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>28.0</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">25.8</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">6.0</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">10.1</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">20.1</td></tr><tr><td style="padding:6px 4px 6px 10px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:12.5px;font-weight:600;line-height:1.2;color:inherit">SimpleQA Verified (Ar)</div><div style="margin-top:2px;font-size:10px;opacity:0.65">Aggregate (2/3 F-score + 1/3 non-hallucination rate)</div></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>27.1</strong></td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">7.9</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">2.6</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">3.1</td><td style="padding:6px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:12.5px;line-height:1.2;">3.1</td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">F-score</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);">1.0</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">2.7</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">2.0</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;"><strong>3.1</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;"><strong>3.1</strong></td></tr><tr><td data-detail="detail" style="padding:5px 4px 5px 24px;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle"><div style="font-size:11.5px;font-weight:400;line-height:1.2;color:inherit">Non-hallucination rate</div></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;background:rgba(11,149,115,0.08);"><strong>79.3</strong></td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">18.2</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">3.8</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">3.2</td><td style="padding:5px 2px;text-align:center;border-bottom:1px solid rgba(128,128,128,0.15);vertical-align:middle;font-size:11.5px;line-height:1.2;">3.2</td></tr></tbody></table></div>

<!-- TABLE:END -->

> [!NOTE]

> Starred (\*) benchmarks have been audited for sample quality. Items with ambiguous questions, invalid answer options, or indefensible gold labels were excluded, since they can penalize a correct answer or reward a lucky guess. Scores on these benchmarks are reported on the cleaned sets. The audit methodology, the excluded samples and the verified benchmarks are available in the IFM/Arabic-Benchmark-Auditing collection.

> [!NOTE]

> Benchmarks marked with ^ will be released by IFM soon.

> [!NOTE]

> Scores above are for the BF16 source checkpoint. Quantized variants have not been separately evaluated yet.

Files

| File | Type | Size |

| --- | --- | --- |

| Jais-3-0.9B-BF16.gguf | BF16 | 2.16 GB |

| Jais-3-0.9B-Q8_0.gguf | Q8_0 | 1.15 GB |

| Jais-3-0.9B-Q6_K.gguf | Q6_K | 0.89 GB |

| Jais-3-0.9B-Q5_K_M.gguf | Q5_K_M | 0.77 GB |

| Jais-3-0.9B-Q5_0.gguf | Q5_0 | 0.76 GB |

| Jais-3-0.9B-Q4_K_M.gguf | Q4_K_M | 0.67 GB |

Quickstart

llama.cpp

cmake -B build -DGGML_CUDA=ON
cmake --build build -j --target llama-server
./build/bin/llama-server -hf IFM/Jais-3-0.9B-GGUF:Q8_0 --jinja -ngl 99 -c 32768

Pick a variant with :BF16, :Q8_0, :Q6_K, :Q5_K_M, :Q5_0 or :Q4_K_M, or pass a local file with -m. --jinja enables the embedded chat

template, which handles reasoning_effort and K2 Horizon tool calls; reasoning_content is returned separately from content.

API Usage

> [!TIP]

> Recommended settings: reasoning_effort="high", the sampling hyperparameters in the table below, and at least 32,768 output tokens.

> Reasoning depth is selected per request through chat_template_kwargs. Thinking is returned in reasoning_content and the answer in content.

| Parameter | Default | Thinking mode, English | Thinking mode, Arabic |

|---|---|---|---|

| temperature | 0.2 | 1.0 | 0.7 |

| top_p | 0.95 | 0.95 | 0.95 |

| top_k | 20 | 20 | 20 |

from openai import OpenAI
client = OpenAI(base_url="http://localhost:8080/v1", api_key="EMPTY")
response = client.chat.completions.create(
    model="Jais-3-0.9B",
    messages=[{"role": "user", "content": "لدينا عددان مجموعهما 50 وحاصل ضربهما 600. ما هما العددان؟ اشرح خطوات الحل."}],
    temperature=0.7,
    top_p=0.95,
    max_tokens=32768,
    extra_body={"top_k": 20, "chat_template_kwargs": {"reasoning_effort": "high"}},
)
message = response.choices[0].message
print("Reasoning:", getattr(message, "reasoning_content", None))
print("Answer:", message.content)

Best Practices

  1. Reasoning effort: always high. All reported results use high reasoning effort. Pass {"chat_template_kwargs": {"reasoning_effort": "high"}} on every request. No reasoning ({"reasoning_effort": "low"}) is not recommended except for research on reasoning efforts.
  2. Sampling parameters. Use the values in the table above: temperature=0.2, top_p=0.95, top_k=20 by default. In thinking mode, set temperature=1.0 for English and temperature=0.7 for Arabic. Keep min_p=0.0, presence_penalty=0.0 and repetition_penalty=1.0.
  3. Parsers. With --jinja, llama.cpp detects the K2 Horizon template and parses reasoning and tool calls itself; no parser flags are needed.

Intended Use and Limitations

Intended use: The model is designed for Arabic and English assistant and agentic applications, including reasoning and tool-use tasks, as well as for research and experimentation.

Out of scope: The model should not be used in ways that violate applicable laws or regulations. The following uses are also considered out of scope:

  • Harmful or malicious use: generating hateful, extremist, discriminatory, or deliberately misleading content, or using the model to support illegal or harmful activities.
  • Sensitive information: using the model to generate, expose, or infer personal, confidential, or otherwise sensitive information about individuals or organizations.
  • Unsupported languages: applications that depend on reliable performance in languages other than Arabic or English.
  • High-stakes decisions: relying on the model to make medical, legal, financial, or safety-critical decisions without appropriate human oversight.

Limitations: The model can produce inaccurate or made-up content and may reflect biases present in its training data. Evaluate it for your use case and add safeguards before deploying it.

Citation

@misc{jais3_2026,
  title  = {Jais 3: Introducing Arabic-centric Agentic AI},
  author = {{IFM Team, Inception42 Team, and Cerebras Team}},
  year   = {2026},
  url    = {https://ifm.ai/blog/jais3/},
}

Run IFM/Jais-3-0.9B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models