---

library_name: transformers

tags:

• math
• lora
• science
• chemistry
• biology
• code
• text-generation-inference
• unsloth
• llama
• llama-cpp
• gguf-my-lora

license: apache-2.0

datasets:

• HuggingFaceTB/smoltalk

language:

• en
• de
• es
• fr
• it
• pt
• hi
• th

base_model: suayptalha/FastLlama-3.2-LoRA

---

theghost369/FastLlama-3.2-LoRA-F16-GGUF

This LoRA adapter was converted to GGUF format from suayptalha/FastLlama-3.2-LoRA via the ggml.ai's GGUF-my-lora space.

Refer to the original adapter repository for more details.

Use with llama.cpp

# with cli
llama-cli -m base_model.gguf --lora FastLlama-3.2-LoRA-f16.gguf (...other args)

# with server
llama-server -m base_model.gguf --lora FastLlama-3.2-LoRA-f16.gguf (...other args)

To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.