prithivMLmods/WeVisDoc-2B-GGUF overview
WeVisDoc 2B GGUF WeVisDoc 2B https://huggingface.co/tencent/WeVisDoc 2B is a compact end to end document parsing model developed by Tencent that converts page …
Runs locally from ~424.4 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| WeVisDoc-2B.BF16.gguf | GGUF | GGUF | 3.79 GB | Download |
| WeVisDoc-2B.F16.gguf | GGUF | GGUF | 3.79 GB | Download |
| WeVisDoc-2B.Q3_K_L.gguf | GGUF | GGUF | 1.06 GB | Download |
| WeVisDoc-2B.Q3_K_M.gguf | GGUF | GGUF | 1023.5 MB | Download |
| WeVisDoc-2B.Q4_K_M.gguf | GGUF | GGUF | 1.19 GB | Download |
| WeVisDoc-2B.Q4_K_S.gguf | GGUF | GGUF | 1.15 GB | Download |
| WeVisDoc-2B.Q5_K_M.gguf | GGUF | GGUF | 1.37 GB | Download |
| WeVisDoc-2B.Q5_K_S.gguf | GGUF | GGUF | 1.35 GB | Download |
| WeVisDoc-2B.Q6_K.gguf | GGUF | GGUF | 1.56 GB | Download |
| WeVisDoc-2B.Q8_0.gguf | GGUF | GGUF | 2.02 GB | Download |
| WeVisDoc-2B.mmproj-bf16.gguf | GGUF | BF16 | 784.4 MB | Download |
| WeVisDoc-2B.mmproj-f16.gguf | GGUF | F16 | 784.4 MB | Download |
| WeVisDoc-2B.mmproj-q8_0.gguf | GGUF | Q8_0 | 424.4 MB | Download |
Model Details
| Model ID | prithivMLmods/WeVisDoc-2B-GGUF |
|---|---|
| Author | prithivMLmods |
| Pipeline | image-text-to-text |
| License | apache-2.0 |
| Base model | tencent/WeVisDoc-2B |
| Last modified | 2026-09-18T12:24:51.000Z |
Model README
---
license: apache-2.0
base_model:
- tencent/WeVisDoc-2B
tags:
- text-generation-inference
- llama-cpp
- qwen3_vl
language:
- en
- zh
pipeline_tag: image-text-to-text
library_name: transformers
---
WeVisDoc-2B-GGUF
> WeVisDoc-2B is a compact end-to-end document parsing model developed by Tencent that converts page images directly into structured Markdown output, complete with LaTeX-formatted formulas and HTML tables. Fine-tuned from Qwen3-VL-2B-Instruct, it is purpose-built for document parsing rather than general vision-language tasks, and supports both English and Chinese. Despite its small 2B-parameter size, it delivers near state-of-the-art results, scoring 95.06 Overall on OmniDocBench v1.6—second only to its larger 4B sibling (95.38) and ahead of much bigger models like olmOCR-2-7B, dots.mocr, and Logics-Parsing-v2—while on PureDocBench it achieves a mean Overall score of 73.86 across the three tracks (79.36 Clean, 76.62 Digital Degraded, 65.60 Real Degraded), leading the Clean and Digital Degraded settings among compared parsers. Released under the Apache 2.0 license, it can be served via vLLM (requiring vLLM ≥0.11.1) or run locally with Transformers, and uses the same client tooling as the 4B variant, making it an attractive option for resource-constrained deployments that still require top-tier parsing accuracy.
Model Files
File Name | Quant Type | File Size | File Link |
|-----------|------------|-----------|-----------|
| WeVisDoc-2B.BF16.gguf | BF16 | 4.07 GB | Download |
| WeVisDoc-2B.F16.gguf | F16 | 4.07 GB | Download |
| WeVisDoc-2B.Q3_K_L.gguf | Q3_K_L | 1.14 GB | Download |
| WeVisDoc-2B.Q3_K_M.gguf | Q3_K_M | 1.07 GB | Download |
| WeVisDoc-2B.Q4_K_M.gguf | Q4_K_M | 1.28 GB | Download |
| WeVisDoc-2B.Q4_K_S.gguf | Q4_K_S | 1.24 GB | Download |
| WeVisDoc-2B.Q5_K_M.gguf | Q5_K_M | 1.47 GB | Download |
| WeVisDoc-2B.Q5_K_S.gguf | Q5_K_S | 1.44 GB | Download |
| WeVisDoc-2B.Q6_K.gguf | Q6_K | 1.67 GB | Download |
| WeVisDoc-2B.Q8_0.gguf | Q8_0 | 2.17 GB | Download |
| WeVisDoc-2B.mmproj-bf16.gguf | mmproj-bf16 | 823 MB | Download |
| WeVisDoc-2B.mmproj-f16.gguf | mmproj-f16 | 823 MB | Download |
| WeVisDoc-2B.mmproj-q8_0.gguf | mmproj-q8_0 | 445 MB | Download |
llama.cpp
LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp
Run prithivMLmods/WeVisDoc-2B-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models