GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

aanya23naik/sequretek-mistral-adapter-Q8_0-GGUF overview

aanya23naik/sequretek mistral adapter Q8 0 GGUF This LoRA adapter was converted to GGUF format from aanya23naik/sequretek mistral adapter https://huggingface.c…

transformersgguftext-generation-inferenceunslothmistraltrlllama-cppgguf-my-loraenbase_model:aanya23naik/sequretek-mistral-adapterbase_model:quantized:aanya23naik/sequretek-mistral-adapterlicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~62.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
92
Likes
0
Pipeline

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
sequretek-mistral-adapter-q8_0.ggufGGUFQ8_062.2 MBDownload

Model Details

Model IDaanya23naik/sequretek-mistral-adapter-Q8_0-GGUF
Authoraanya23naik
Pipeline
Licenseapache-2.0
Base modelaanya23naik/sequretek-mistral-adapter
Last modified2026-07-16T16:22:34.000Z

Model README

---

base_model: aanya23naik/sequretek-mistral-adapter

tags:

  • text-generation-inference
  • transformers
  • unsloth
  • mistral
  • trl
  • llama-cpp
  • gguf-my-lora

license: apache-2.0

language:

  • en

---

aanya23naik/sequretek-mistral-adapter-Q8_0-GGUF

This LoRA adapter was converted to GGUF format from aanya23naik/sequretek-mistral-adapter via the ggml.ai's GGUF-my-lora space.

Refer to the original adapter repository for more details.

Use with llama.cpp

# with cli
llama-cli -m base_model.gguf --lora sequretek-mistral-adapter-q8_0.gguf (...other args)

# with server
llama-server -m base_model.gguf --lora sequretek-mistral-adapter-q8_0.gguf (...other args)

To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.

Run aanya23naik/sequretek-mistral-adapter-Q8_0-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models