GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

vvnaren/book-qwen3-0.6b-finetuned-F16-GGUF overview

vvnaren/book qwen3 0.6b finetuned F16 GGUF This LoRA adapter was converted to GGUF format from gowribharat/book qwen3 0.6b finetuned https://huggingface.co/gow…

peftggufgenerated_from_trainerllama-cppgguf-my-lorabase_model:gowribharat/book-qwen3-0.6b-finetunedbase_model:adapter:gowribharat/book-qwen3-0.6b-finetunedlicense:apache-2.0region:us

Runs locally from ~4.4 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
Author

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
book-qwen3-0.6b-finetuned-f16.ggufGGUFF164.4 MBDownload

Model Details

Model IDvvnaren/book-qwen3-0.6b-finetuned-F16-GGUF
Authorvvnaren
Pipeline
Licenseapache-2.0
Base modelgowribharat/book-qwen3-0.6b-finetuned
Last modified2026-07-21T07:45:46.000Z

Model README

---

library_name: peft

license: apache-2.0

base_model: gowribharat/book-qwen3-0.6b-finetuned

tags:

  • generated_from_trainer
  • llama-cpp
  • gguf-my-lora

model-index:

  • name: book-qwen3-0.6b-finetuned

results: []

---

vvnaren/book-qwen3-0.6b-finetuned-F16-GGUF

This LoRA adapter was converted to GGUF format from gowribharat/book-qwen3-0.6b-finetuned via the ggml.ai's GGUF-my-lora space.

Refer to the original adapter repository for more details.

Use with llama.cpp

# with cli
llama-cli -m base_model.gguf --lora book-qwen3-0.6b-finetuned-f16.gguf (...other args)

# with server
llama-server -m base_model.gguf --lora book-qwen3-0.6b-finetuned-f16.gguf (...other args)

To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.

Run vvnaren/book-qwen3-0.6b-finetuned-F16-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models