---

base_model: IAyamina/mistral7b_on_instruction_poems

library_name: peft

tags:

• llama-cpp
• gguf-my-lora

---

vvnaren/mistral7b_on_instruction_poems-Q8_0-GGUF

This LoRA adapter was converted to GGUF format from IAyamina/mistral7b_on_instruction_poems via the ggml.ai's GGUF-my-lora space.

Refer to the original adapter repository for more details.

Use with llama.cpp

# with cli
llama-cli -m base_model.gguf --lora mistral7b_on_instruction_poems-q8_0.gguf (...other args)

# with server
llama-server -m base_model.gguf --lora mistral7b_on_instruction_poems-q8_0.gguf (...other args)

To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.