---

pipeline_tag: image-text-to-text

language:

• multilingual

tags:

• baidu
• vision-language
• ocr
• custom_code

license: mit

library_name: CrispEmbed

---

Unlimited-OCR CrispEmbed GGUF

GGUF conversions of baidu/Unlimited-OCR for use with CrispEmbed.

Model

Unlimited-OCR is a 3.3B parameter VLM for full-page OCR. Architecture:

• SAM ViT-B (12 layers, 768d) — image encoder with windowed + global attention
• CLIP-L/14 (24 layers, 1024d) — receives SAM features as patch embeddings (dual-encoder "DeepLIP")
• Fusion — concat CLIP + SAM features (2048d) → linear projection (1280d)
• DeepSeek-V2 MoE decoder (12 layers, 1280d, 64 routed experts top-6, 2 shared experts, layer 0 dense)
• Tokenizer — GPT-2 BPE, 129,280 vocab

Files

| File | Quant | Size | Notes |

|------|-------|------|-------|

| unlimited-ocr-f16.gguf | F16 | 6.4 GB | Full precision, reference quality |

| unlimited-ocr-q8_0.gguf | Q8_0 | 3.5 GB | High quality, 2x compression |

| unlimited-ocr-q5_k.gguf | Q5_K | 2.4 GB | Best quantized quality (near-perfect pages) |

| unlimited-ocr-q4_k.gguf | Q4_K | 2.2 GB | Recommended — reads full pages, matches the HF model |

| unlimited-ocr-q3_k.gguf | Q3_K | 2.0 GB | Smaller; very good (slightly more char errors) |

All quantizations preserve the vision encoder (SAM v. + CLIP c.), the MoE

router (.mlp_gate.weight), the projector, the token embeddings, *and the

lm_head** at Q8_0 minimum. Keeping the lm_head at Q8_0 is essential: at Q4_K

the output projection flips a borderline greedy pick early in generation, which

snowballs into a hallucination — the full-page OCR fails. With it protected, the

q4_k file reads full document pages identically to the unquantized HF model.

Quality vs size (the protected Q8_0 tensors dominate, so smaller quants save

little): q5_k ≈ best, q4_k (this file) excellent, q3_k good, q2_k

not recommended (its 2-bit experts collapse into repetition on dense body text).

Usage with CrispEmbed

# Auto-download and run
crispembed --ocr-pipeline image.png --ocr-engine unlimited_ocr -m unlimited-ocr

# Or with explicit path
crispembed --ocr-pipeline image.png --ocr-engine unlimited_ocr \
  --ocr-rec /path/to/unlimited-ocr-q4_k.gguf \
  -m /path/to/unlimited-ocr-q4_k.gguf

License

MIT (same as the original model)

Credits

• Original model: Baidu
• GGUF conversion: CrispEmbed

Provenance and EU AI Act Art. 53 note

• Upstream model: baidu/Unlimited-OCR — published by baidu.
• Upstream licence: mit. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
• What was done here: format conversion and/or quantisation only (GGUF). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
• Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository. No training-content summary was found on the upstream model card at the time of writing; that documentation gap is upstream's and is not filled here.
• Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.