---

library_name: peft

base_model: Rashik24/Mistral-Instruct-Bangla

datasets:

• iamshnoo/alpaca-cleaned-bengali

language:

• bn

tags:

• llama-cpp
• gguf-my-lora

---

xennonf4/Mistral-Instruct-Bangla-F16-GGUF

This LoRA adapter was converted to GGUF format from Rashik24/Mistral-Instruct-Bangla via the ggml.ai's GGUF-my-lora space.

Refer to the original adapter repository for more details.

Use with llama.cpp

# with cli
llama-cli -m base_model.gguf --lora Mistral-Instruct-Bangla-f16.gguf (...other args)

# with server
llama-server -m base_model.gguf --lora Mistral-Instruct-Bangla-f16.gguf (...other args)

To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.