GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

juststhjust/Qwen3-4B-2507-Persona-GGUF overview

qwen finetune : GGUF This model was finetuned and converted to GGUF format using Unsloth https://github.com/unslothai/unsloth . Toned down the aggressive natur…

ggufqwen3llama.cppunslothtext-generationenbase_model:unsloth/Qwen3-4B-Instruct-2507base_model:quantized:unsloth/Qwen3-4B-Instruct-2507endpoints_compatibleregion:usconversational

Runs locally from ~2.69 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Qwen3-4B-2507-Persona-Q5_K_M.ggufGGUFQ5_K_M2.69 GBDownload

Model Details

Model IDjuststhjust/Qwen3-4B-2507-Persona-GGUF
Authorjuststhjust
Pipelinetext-generation
License
Base modelunsloth/Qwen3-4B-Instruct-2507
Last modified2026-08-18T15:56:10.000Z

Model README

---

tags:

  • gguf
  • llama.cpp
  • unsloth

language:

  • en

base_model:

  • unsloth/Qwen3-4B-Instruct-2507

pipeline_tag: text-generation

---

qwen_finetune : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Toned down the aggressive nature of the previous model.

Run juststhjust/Qwen3-4B-2507-Persona-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models