---

base_model: garamu/TinyLlama-1.1B-Chat-v1.0-lora

library_name: peft

pipeline_tag: text-generation

tags:

• base_model:adapter:TinyLlama/TinyLlama-1.1B-Chat-v1.0
• lora
• transformers
• llama-cpp
• gguf-my-lora

---

garamu/TinyLlama-1.1B-Chat-v1.0-lora-F16-GGUF

This LoRA adapter was converted to GGUF format from garamu/TinyLlama-1.1B-Chat-v1.0-lora via the ggml.ai's GGUF-my-lora space.

Refer to the original adapter repository for more details.

Use with llama.cpp

# with cli
llama-cli -m base_model.gguf --lora TinyLlama-1.1B-Chat-v1.0-lora-f16.gguf (...other args)

# with server
llama-server -m base_model.gguf --lora TinyLlama-1.1B-Chat-v1.0-lora-f16.gguf (...other args)

To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.