GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

reaperdoesntknow/Qwen3.5-2B-CyberSec-GGUF overview

Qwen3.5 2B CyberSec — GGUF GGUF exports of reaperdoesntknow/Qwen3.5 2B CyberSec https://huggingface.co/reaperdoesntknow/Qwen3.5 2B CyberSec for local inference…

ggufqwen3_5llama.cppunslothcybersecurityconversationalquantizedtext-generationbase_model:reaperdoesntknow/Qwen3.5-2B-CyberSecbase_model:quantized:reaperdoesntknow/Qwen3.5-2B-CyberSeclicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~640.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
2,131
Likes
0
Pipeline
text-generation

Repository Files & Downloads

4 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3.5-2B.BF16-mmproj.ggufGGUFGGUF640.3 MBDownload
Qwen3.5-2B.BF16.ggufGGUFGGUF3.63 GBDownload
Qwen3.5-2B.Q4_K_M.ggufGGUFGGUF1.22 GBDownload
Qwen3.5-2B.Q8_0.ggufGGUFGGUF1.93 GBDownload

Model Details

Model IDreaperdoesntknow/Qwen3.5-2B-CyberSec-GGUF
Authorreaperdoesntknow
Pipelinetext-generation
Licenseapache-2.0
Base modelreaperdoesntknow/Qwen3.5-2B-CyberSec
Last modified2026-08-18T13:16:44.000Z

Model README

---

license: apache-2.0

base_model:

  • reaperdoesntknow/Qwen3.5-2B-CyberSec

pipeline_tag: text-generation

library_name: gguf

tags:

  • gguf
  • llama.cpp
  • unsloth
  • qwen3_5
  • cybersecurity
  • conversational
  • quantized

---

Qwen3.5-2B-CyberSec — GGUF

GGUF exports of reaperdoesntknow/Qwen3.5-2B-CyberSec for local inference with llama.cpp-compatible runtimes.

The source model is associated with the Trendyol Cybersecurity Instruction Tuning Dataset. No benchmark or safety-evaluation results are published with this GGUF release.

Available files

| File | Reported size | Practical use |

|---|---:|---|

| Qwen3.5-2B.BF16.gguf | 3.90 GB | Highest-fidelity GGUF build |

| Qwen3.5-2B.Q8_0.gguf | 2.08 GB | High-quality quantized build |

| Qwen3.5-2B.Q4_K_M.gguf | 1.31 GB | Recommended local starting point |

| Qwen3.5-2B.BF16-mmproj.gguf | repository artifact | Multimodal projector; see caveat below |

Run locally

llama-cli \
  -hf reaperdoesntknow/Qwen3.5-2B-CyberSec-GGUF:Q4_K_M \
  --jinja

With Ollama:

ollama run hf.co/reaperdoesntknow/Qwen3.5-2B-CyberSec-GGUF:Q4_K_M

Multimodal note

A BF16 projector file is present, and the source-model configuration includes vision components. This release does not include a documented multimodal smoke-test receipt. Verify the projector, prompt format, runtime version, and image path before claiming multimodal support.

Intended use

  • Local qualitative evaluation of the source checkpoint.
  • CPU or consumer-GPU experimentation.
  • Comparison of BF16, Q8_0, and Q4_K_M output quality.

Limitations and safety

  • Quantization can change quality and behavior relative to the source checkpoint.
  • The release has no published benchmark, regression, or safety report.
  • Generated security instructions may be wrong, unsafe, or dual use.
  • Do not execute generated commands without review and isolation.
  • Do not rely on the model as an authoritative security control or decision-maker.

Lineage and license

Part of the CIx cybersecurity model collection.

<!-- cix-keeper-ts:2026-08-18T13:16:44Z -->

Run reaperdoesntknow/Qwen3.5-2B-CyberSec-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models