wesjos/mario-html-v2-9B-GGUF overview
π Mario HTML v2 9B V2: less html tag in Cot than v1. This is the GGUF build of wesjos/mario html v2 9B https://huggingface.co/wesjos/mario html v2 9B . The weβ¦
Runs locally from ~879.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
| Model ID | wesjos/mario-html-v2-9B-GGUF |
|---|---|
| Author | wesjos |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | wesjos/mario-html-v2-9B |
| Last modified | 2026-10-16T06:06:18.000Z |
Model README
---
license: apache-2.0
library_name: llama.cpp
pipeline_tag: image-text-to-text
base_model: wesjos/mario-html-v2-9B
language:
- en
- zh
tags:
- html-generation
- web-design
- visual-ui
- visual-question-answering
- reasoning
- image-text-to-text
- zero-system-prompt
- cot-purity
- gguf
- quantized
datasets:
- wesjos/mario-html-sft
---
π Mario-HTML-v2-9B
> V2: less html tag in Cot than v1.
> This is the GGUF build of wesjos/mario-html-v2-9B.
> The weights here are quantized; the card below and the demos are that model's, unchanged.
π¦ GGUF files
| File | Quant | Size | Notes |
|---|---|---|---|
| Qwen3.5-9B-HTML-v5-Q8_0.gguf | Q8_0 | 8.87 GiB | near-lossless |
| Qwen3.5-9B-HTML-v5-Q4_K_M.gguf | Q4_K_M | 5.24 GiB | smaller, faster |
| mmproj-Qwen3.5-9B-BF16.gguf | BF16 | 0.86 GiB | vision projector β required for image input |
- Text β HTML: one quant is enough, e.g.
llama serve -hf wesjos/mario-html-v2-9B-GGUF:Q8_0(the tag form the Hub generates for this repo). - Text + image β HTML: add the projector explicitly β
--mmproj mmproj-Qwen3.5-9B-BF16.gguf(it does follow themmproj-*naming, but keeping it explicit costs nothing). - Manual form, equivalent:
llama-server -m Qwen3.5-9B-HTML-v5-Q8_0.gguf --mmproj mmproj-Qwen3.5-9B-BF16.gguf -ngl 99 -c 65536. - Chat template default system: none (zero-prompt native).
- If you reuse the 4B repo's WebUI config, its
model_pathpoints at the 4B quant β set it to./Qwen3.5-9B-HTML-v5-Q8_0.ggufhere.
| | |
|---|---|
| Base | Qwen/Qwen3.5-9B Β· 9.65 B (bf16) Β· 17.98 GiB |
| Architecture | Qwen3_5ForConditionalGeneration Β· 32 layers (24 linear + 8 full attention, interval 4) Β· hidden 4096 |
| Context | 262,144 native |
| Modalities | text β HTML, text + image β HTML |
---
πΌοΈ Demo
All shots are the WebUI (shipped with the mario-html-v2-4B repo,
theme_preset: editorial) with the CoT toggle switched on β its webui/config.json ships
enable_thinking: false, which hides the reasoning panel entirely, so flip it if you want to see
the traces. The panel above each answer is the raw <think> stream; the page below it is the
unmodified render.
Microservices vs. Monolith β comparison grid
Compare Microservices vs Monolith architecture in a modern comparison grid
(two-card grid, callouts, metric tiles and a head-to-head table; reasoning panel collapsed)
<img src="demo/01-microservices-vs-monolith.png" alt="Architecture comparison demo: a verdict callout, a two-card Monolith vs Microservices grid with BEST FOR / RISK / OPS / TRADE-OFF bullets, metric tiles, and a head-to-head comparison table">
Step-by-step math, CoT expanded
Solve the linear equation: 2x + 5 = 17 step by step
(the <think> stream is pure plain-text planning β zero HTML tags β while the answer renders as
cards, code blocks and a stepper)
<img src="demo/02-solve-linear-equation-cot.png" alt="Math demo: reasoning panel expanded above the answer, showing plain-text planning followed by a rendered step-by-step solution with code blocks and a golden-rule callout">
Vision input
llama photo + what is this (image paste via Ctrl+V, answered as a llama-vs-alpaca breakdown)
<img src="demo/03-vision-llama.png" alt="Vision demo: an uploaded llama photo with the question 'what is this', answered with a two-card llama-vs-alpaca comparison, a feature table and characteristic tiles">
---
π€ Output Contract
One root element; everything else is an optional child. Class list verified against
webui/static/theme.css (shipped with the mario-html-v2-4B repo):
| Component | Markup |
|---|---|
| Root | <div class="ai-view"> |
| Summary | <div class="summary"> Β· <div class="summary-card"> Β· <p class="lead"> |
| Card | <div class="card"> |
| Grid | <div class="grid grid-2"> Β· <div class="grid grid-3"> |
| Metrics | <div class="metric-group"><div class="metric-card"><span class="metric-label">β¦</span><span class="metric-value">β¦</span><span class="metric-sub">β¦</span></div></div> |
| Stepper | <div class="stepper"><div class="step-item">β¦</div></div> |
| Callout | <div class="callout callout-info\|warning\|success\|danger"><div class="callout-header">β¦</div></div> |
| Badge | <span class="badge badge-info\|success\|warning\|danger\|accent"> |
| Table | <div class="table-container"><table class="modern-table">β¦</table></div> |
| Feature list | <div class="feature-list"><div class="feature-item">β¦</div></div> |
| Code block | <div class="code-box"><div class="code-header"><span class="code-title">β¦</span></div>β¦</div> |
<details>
<summary>Raw sample (<code>message.content</code> verbatim, v2 zero-system-prompt greedy)</summary>
<div class="ai-view">
<h3>δΈΊδ»δΉε€©η©Ίζ―θθ²ηοΌ</h3>
<div class="summary">
<p class="lead">ι³ε
δΈηθε
θ’«ε€§ζ°δΈηεε"ζ£ε°"ε°ει’ε
«ζΉοΌθζ们ηηΌηε―Ήθε
ζ΄ζζοΌζδ»₯ζ们ηε°ε€©η©Ίζ―θθ²ηγ</p>
</div>
<div class="card">
<h4>δΈε₯θ―θ§£ι</h4>
<div class="step-list"><div class="step-item">β¦</div></div>
</div>
</div>
The <think> trace that precedes this sample contains zero HTML tags β pure plain-text planning
("a summary lead, then a three-item stepper..."). Two classes in the sample are content-only:
step-list and ai-view-header are not in theme.css, so they render with default block styling β
define your own if you want tighter control. (step-item itself is styled.)
</details>
---
π¨ WebUI
The WebUI ships with the sibling 4B repo β clone wesjos/mario-html-v2-4B, point webui/config.json at your serving endpoint for this model, and:
cd webui
pip install -r requirements.txt
python server.py --port 8791
Open http://localhost:8791. Dual-stream rendering (collapsible <think> + live HTML), clipboard
image paste (Ctrl+V), nine theme presets (default Β· apple Β· notion Β· cyber Β· editorial Β·
cards_rounded Β· glassmorphism Β· soft_shadows Β· compact) plus live custom CSS, and a
raw-source / copy-HTML view per message.
---
β οΈ Notes
- The output is HTML, not Markdown. Feed it a Markdown renderer and you get raw tags.
- Serve with a clear/absent system prompt β the zero-system-prompt path is the trained one.
- The model picks from the class vocabulary above; arbitrary new CSS classes are not a contract.
Custom theme.css is the supported way to restyle.
- Arithmetic is reliable but not bank-grade β check long decimal chains.
--reasoning-parser qwen3needs a recent vLLM.
---
π License
Apache License 2.0.
Run wesjos/mario-html-v2-9B-GGUF with guIDE
Download guIDE β the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face Β· Compare models