GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

ngquocvinh/Spark-X2.5-1.7B-GGUF overview

Spark X2.5 1.7B GGUF Community GGUF quantizations of XHToken/Spark X2.5 1.7B https://huggingface.co/XHToken/Spark X2.5 1.7B . This repository contains nine qua…

llama.cppggufspark2_5quantizedtext-generationconversationalbase_model:XHToken/Spark-X2.5-1.7Bbase_model:quantized:XHToken/Spark-X2.5-1.7Blicense:apache-2.0endpoints_compatibleregion:usimatrix

Runs locally from ~1.8 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
2,204
Likes
1
Pipeline
text-generation

Repository Files & Downloads

12 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Spark-X2.5-1.7B-IQ1_M.ggufGGUFIQ1_M548.2 MBDownload
Spark-X2.5-1.7B-IQ2_XS.ggufGGUFIQ2_XS625.8 MBDownload
Spark-X2.5-1.7B-Q1_0.ggufGGUFQ1_0408.6 MBDownload
Spark-X2.5-1.7B-Q2_K.ggufGGUFQ2_K753.6 MBDownload
Spark-X2.5-1.7B-Q3_K_M.ggufGGUFQ3_K_M894.0 MBDownload
Spark-X2.5-1.7B-Q4_K_M.ggufGGUFQ4_K_M1.03 GBDownload
Spark-X2.5-1.7B-Q5_K_M.ggufGGUFQ5_K_M1.17 GBDownload
Spark-X2.5-1.7B-Q6_K.ggufGGUFQ6_K1.31 GBDownload
Spark-X2.5-1.7B-Q8_0.ggufGGUFQ8_01.70 GBDownload
reproducibility/spark25_1.7b_combined.imatrix.ggufGGUFGGUF1.8 MBDownload
reproducibility/spark25_1.7b_vn_code_agent.imatrix.ggufGGUFGGUF1.8 MBDownload
reproducibility/spark25_1.7b_wiki.imatrix.ggufGGUFGGUF1.8 MBDownload

Model Details

Model IDngquocvinh/Spark-X2.5-1.7B-GGUF
Authorngquocvinh
Pipelinetext-generation
Licenseapache-2.0
Base modelXHToken/Spark-X2.5-1.7B
Last modified2026-09-13T13:28:38.000Z

Model README

---

license: apache-2.0

base_model: XHToken/Spark-X2.5-1.7B

base_model_relation: quantized

library_name: llama.cpp

pipeline_tag: text-generation

tags:

  • gguf
  • llama.cpp
  • spark2_5
  • quantized
  • text-generation

---

Spark-X2.5-1.7B GGUF

Community GGUF quantizations of

XHToken/Spark-X2.5-1.7B.

This repository contains nine quantized files for local inference. No

training or fine-tuning was performed.

<div align="center" style="background-color:#f59e0b;color:#ffffff;padding:16px 20px;border-radius:10px;line-height:1.7;">

☕ If this GGUF made your day easier, a coffee would make mine.<br>

<a href="https://ko-fi.com/ngquocvinh" style="color:#ffffff;"><strong style="color:#ffffff;">Send a coffee ☕</strong></a><br>

I build and test these releases myself. Your coffee helps keep me going.<br>

Thank you for supporting this work.

</div>

Files

| Quantization | File size (GiB) | A10M generation token/s | Validation | Recommendation / Notes |

|---|---:|---:|---|---|

| Q8_0 | 1.70 | 175.54 | Load/generate pass | High quality. |

| Q6_K | 1.31 | 199.07 | Load/generate pass | High quality. |

| Q5_K_M | 1.17 | 223.04 | Load/generate pass | Daily use. |

| Q4_K_M | 1.03 | 241.87 | Load/generate pass | Recommended default. |

| Q3_K_M | 0.87 | 203.60 | Load/generate pass | Lower-memory profile. |

| Q2_K | 0.74 | 231.70 | Load/generate pass | Aggressive low-memory profile. |

| IQ2_XS | 0.61 | 245.03 | Load/generate pass | Experimental. |

| IQ1_M | 0.54 | 252.02 | Load/generate pass | Experimental. |

| Q1_0 | 0.40 | 336.65 | Load/generate pass | Experimental / legacy minimum-memory option. |

The A10M generation figures were measured with single-stream llama-bench on

an NVIDIA A10M.

Q1/Q2 and the IQ variants can lose instruction following, reasoning, and

tool-call reliability. Validate the chosen file on the workload that matters

to you.

License and attribution

The upstream model is released under Apache License 2.0. Preserve the

upstream attribution and license when redistributing these derivative files.

This is a community GGUF quantization, not an official XHToken/SparkLLM

release or endorsement.

Checksums are available in SHA256SUMS.txt.

Run ngquocvinh/Spark-X2.5-1.7B-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models