GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE β†’
Model Intelligence Sheet

wesjos/mario-html-v2-9B-GGUF overview

πŸ„ Mario HTML v2 9B V2: less html tag in Cot than v1. This is the GGUF build of wesjos/mario html v2 9B https://huggingface.co/wesjos/mario html v2 9B . The we…

llama.cppggufhtml-generationweb-designvisual-uivisual-question-answeringreasoningimage-text-to-textzero-system-promptcot-purityquantizedenzhdataset:wesjos/mario-html-sftbase_model:wesjos/mario-html-v2-9Bbase_model:quantized:wesjos/mario-html-v2-9Blicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~879.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
image-text-to-text
Author

Repository Files & Downloads

3 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.5-9B-HTML-v5-Q4_K_M.ggufGGUFQ4_K_M5.24 GBDownload
Qwen3.5-9B-HTML-v5-Q8_0.ggufGGUFQ8_08.87 GBDownload
mmproj-Qwen3.5-9B-BF16.ggufGGUFBF16879.0 MBDownload

Model Details

Model IDwesjos/mario-html-v2-9B-GGUF
Authorwesjos
Pipelineimage-text-to-text
Licenseapache-2.0
Base modelwesjos/mario-html-v2-9B
Last modified2026-10-16T06:06:18.000Z

Model README

---

license: apache-2.0

library_name: llama.cpp

pipeline_tag: image-text-to-text

base_model: wesjos/mario-html-v2-9B

language:

  • en
  • zh

tags:

  • html-generation
  • web-design
  • visual-ui
  • visual-question-answering
  • reasoning
  • image-text-to-text
  • zero-system-prompt
  • cot-purity
  • gguf
  • quantized

datasets:

  • wesjos/mario-html-sft

---

πŸ„ Mario-HTML-v2-9B

> V2: less html tag in Cot than v1.

> This is the GGUF build of wesjos/mario-html-v2-9B.

> The weights here are quantized; the card below and the demos are that model's, unchanged.

πŸ“¦ GGUF files

| File | Quant | Size | Notes |

|---|---|---|---|

| Qwen3.5-9B-HTML-v5-Q8_0.gguf | Q8_0 | 8.87 GiB | near-lossless |

| Qwen3.5-9B-HTML-v5-Q4_K_M.gguf | Q4_K_M | 5.24 GiB | smaller, faster |

| mmproj-Qwen3.5-9B-BF16.gguf | BF16 | 0.86 GiB | vision projector β€” required for image input |

  • Text β†’ HTML: one quant is enough, e.g. llama serve -hf wesjos/mario-html-v2-9B-GGUF:Q8_0 (the tag form the Hub generates for this repo).
  • Text + image β†’ HTML: add the projector explicitly β€” --mmproj mmproj-Qwen3.5-9B-BF16.gguf (it does follow the mmproj-* naming, but keeping it explicit costs nothing).
  • Manual form, equivalent: llama-server -m Qwen3.5-9B-HTML-v5-Q8_0.gguf --mmproj mmproj-Qwen3.5-9B-BF16.gguf -ngl 99 -c 65536.
  • Chat template default system: none (zero-prompt native).
  • If you reuse the 4B repo's WebUI config, its model_path points at the 4B quant β€” set it to ./Qwen3.5-9B-HTML-v5-Q8_0.gguf here.

| | |

|---|---|

| Base | Qwen/Qwen3.5-9B Β· 9.65 B (bf16) Β· 17.98 GiB |

| Architecture | Qwen3_5ForConditionalGeneration Β· 32 layers (24 linear + 8 full attention, interval 4) Β· hidden 4096 |

| Context | 262,144 native |

| Modalities | text β†’ HTML, text + image β†’ HTML |

---

πŸ–ΌοΈ Demo

All shots are the WebUI (shipped with the mario-html-v2-4B repo,

theme_preset: editorial) with the CoT toggle switched on β€” its webui/config.json ships

enable_thinking: false, which hides the reasoning panel entirely, so flip it if you want to see

the traces. The panel above each answer is the raw <think> stream; the page below it is the

unmodified render.

Microservices vs. Monolith β€” comparison grid

Compare Microservices vs Monolith architecture in a modern comparison grid

(two-card grid, callouts, metric tiles and a head-to-head table; reasoning panel collapsed)

<img src="demo/01-microservices-vs-monolith.png" alt="Architecture comparison demo: a verdict callout, a two-card Monolith vs Microservices grid with BEST FOR / RISK / OPS / TRADE-OFF bullets, metric tiles, and a head-to-head comparison table">

Step-by-step math, CoT expanded

Solve the linear equation: 2x + 5 = 17 step by step

(the <think> stream is pure plain-text planning β€” zero HTML tags β€” while the answer renders as

cards, code blocks and a stepper)

<img src="demo/02-solve-linear-equation-cot.png" alt="Math demo: reasoning panel expanded above the answer, showing plain-text planning followed by a rendered step-by-step solution with code blocks and a golden-rule callout">

Vision input

llama photo + what is this (image paste via Ctrl+V, answered as a llama-vs-alpaca breakdown)

<img src="demo/03-vision-llama.png" alt="Vision demo: an uploaded llama photo with the question 'what is this', answered with a two-card llama-vs-alpaca comparison, a feature table and characteristic tiles">

---

πŸ“€ Output Contract

One root element; everything else is an optional child. Class list verified against

webui/static/theme.css (shipped with the mario-html-v2-4B repo):

| Component | Markup |

|---|---|

| Root | <div class="ai-view"> |

| Summary | <div class="summary"> Β· <div class="summary-card"> Β· <p class="lead"> |

| Card | <div class="card"> |

| Grid | <div class="grid grid-2"> Β· <div class="grid grid-3"> |

| Metrics | <div class="metric-group"><div class="metric-card"><span class="metric-label">…</span><span class="metric-value">…</span><span class="metric-sub">…</span></div></div> |

| Stepper | <div class="stepper"><div class="step-item">…</div></div> |

| Callout | <div class="callout callout-info\|warning\|success\|danger"><div class="callout-header">…</div></div> |

| Badge | <span class="badge badge-info\|success\|warning\|danger\|accent"> |

| Table | <div class="table-container"><table class="modern-table">…</table></div> |

| Feature list | <div class="feature-list"><div class="feature-item">…</div></div> |

| Code block | <div class="code-box"><div class="code-header"><span class="code-title">…</span></div>…</div> |

<details>

<summary>Raw sample (<code>message.content</code> verbatim, v2 zero-system-prompt greedy)</summary>

<div class="ai-view">
<h3>δΈΊδ»€δΉˆε€©η©Ίζ˜―θ“θ‰²ηš„οΌŸ</h3>
<div class="summary">
<p class="lead">ι˜³ε…‰δΈ­ηš„θ“ε…‰θ’«ε€§ζ°”δΈ­ηš„εˆ†ε­"ζ•£ε°„"εˆ°ε››ι’ε…«ζ–ΉοΌŒθ€Œζˆ‘δ»¬ηš„ηœΌη›ε―Ήθ“ε…‰ζ›΄ζ•ζ„ŸοΌŒζ‰€δ»₯ζˆ‘δ»¬ηœ‹εˆ°ε€©η©Ίζ˜―θ“θ‰²ηš„γ€‚</p>
</div>
<div class="card">
<h4>δΈ‰ε₯θ―θ§£ι‡Š</h4>
<div class="step-list"><div class="step-item">…</div></div>
</div>
</div>

The <think> trace that precedes this sample contains zero HTML tags β€” pure plain-text planning

("a summary lead, then a three-item stepper..."). Two classes in the sample are content-only:

step-list and ai-view-header are not in theme.css, so they render with default block styling β€”

define your own if you want tighter control. (step-item itself is styled.)

</details>

---

🎨 WebUI

The WebUI ships with the sibling 4B repo β€” clone wesjos/mario-html-v2-4B, point webui/config.json at your serving endpoint for this model, and:

cd webui
pip install -r requirements.txt
python server.py --port 8791

Open http://localhost:8791. Dual-stream rendering (collapsible <think> + live HTML), clipboard

image paste (Ctrl+V), nine theme presets (default Β· apple Β· notion Β· cyber Β· editorial Β·

cards_rounded Β· glassmorphism Β· soft_shadows Β· compact) plus live custom CSS, and a

raw-source / copy-HTML view per message.

---

⚠️ Notes

  • The output is HTML, not Markdown. Feed it a Markdown renderer and you get raw tags.
  • Serve with a clear/absent system prompt β€” the zero-system-prompt path is the trained one.
  • The model picks from the class vocabulary above; arbitrary new CSS classes are not a contract.

Custom theme.css is the supported way to restyle.

  • Arithmetic is reliable but not bank-grade β€” check long decimal chains.
  • --reasoning-parser qwen3 needs a recent vLLM.

---

πŸ“„ License

Apache License 2.0.

Run wesjos/mario-html-v2-9B-GGUF with guIDE

Download guIDE β€” the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE β†’ Β· Browse 524k+ models Β· Compare models

Source: Hugging Face Β· Compare models