GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

silverdollar/Nova-CGT-Qwen3.5-GGUF overview

Nova CGT Qwen3.5 GGUF : GGUF This model was finetuned and converted to GGUF format using Unsloth https://github.com/unslothai/unsloth . Example usage : For tex…

ggufqwen2llama.cppunslothendpoints_compatibleregion:usconversational

Runs locally from ~641.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
97
Likes
0
Pipeline

Repository Files & Downloads

5 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen2.5-3B-Instruct.Q6_K.ggufGGUFGGUF2.36 GBDownload
Qwen2.5-3B-Instruct.Q8_0.ggufGGUFGGUF3.06 GBDownload
Qwen3.5-4B-base.F16-mmproj.ggufGGUFGGUF641.3 MBDownload
Qwen3.5-4B-base.Q6_K.ggufGGUFGGUF3.23 GBDownload
Qwen3.5-4B-base.Q8_0.ggufGGUFGGUF4.17 GBDownload

Model Details

Model IDsilverdollar/Nova-CGT-Qwen3.5-GGUF
Authorsilverdollar
Pipeline
License
Base model
Last modified2026-07-10T01:43:30.000Z

Model README

---

tags:

  • gguf
  • llama.cpp
  • unsloth

---

Nova-CGT-Qwen3.5-GGUF : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli -hf silverdollar/Nova-CGT-Qwen3.5-GGUF --jinja
  • For multimodal models: llama-mtmd-cli -hf silverdollar/Nova-CGT-Qwen3.5-GGUF --jinja

Available Model files:

  • Qwen2.5-3B-Instruct.Q8_0.gguf

Ollama

An Ollama Modelfile is included for easy deployment.

This was trained 2x faster with Unsloth

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>

Run silverdollar/Nova-CGT-Qwen3.5-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models