---

tags:

• autotrain
• text-generation-inference
• text-generation
• peft
• llama-cpp
• gguf-my-lora

library_name: transformers

base_model: dekill/dekill-novelist-test1

widget:

• messages:

- role: user

content: What is your favorite condiment?

license: other

---

dekill/dekill-novelist-test1-F16-GGUF

This LoRA adapter was converted to GGUF format from dekill/dekill-novelist-test1 via the ggml.ai's GGUF-my-lora space.

Refer to the original adapter repository for more details.

Use with llama.cpp

# with cli
llama-cli -m base_model.gguf --lora dekill-novelist-test1-f16.gguf (...other args)

# with server
llama-server -m base_model.gguf --lora dekill-novelist-test1-f16.gguf (...other args)

To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.