GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

Bigchilli1978/reggie-five-eyes-8b-GGUF overview

reggie five eyes 8b GGUF : GGUF This model was finetuned and converted to GGUF format using Unsloth https://github.com/unslothai/unsloth . Example usage : For …

ggufllamallama.cppunslothendpoints_compatibleregion:usconversational

Runs locally from ~4.58 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
97
Likes
0
Pipeline
—

Repository Files & Downloads

2 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Meta-Llama-3.1-8B-Instruct-abliterated.Q4_K_M.ggufGGUFGGUF4.58 GBDownload
Meta-Llama-3.1-8B-Instruct-abliterated.Q5_K_M.ggufGGUFGGUF5.34 GBDownload

Model Details

Model IDBigchilli1978/reggie-five-eyes-8b-GGUF
AuthorBigchilli1978
Pipeline—
License—
Base model—
Last modified2026-10-18T21:00:42.000Z

Model README

---

tags:

  • gguf
  • llama.cpp
  • unsloth

---

reggie-five-eyes-8b-GGUF : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli -hf Bigchilli1978/reggie-five-eyes-8b-GGUF --jinja
  • For multimodal models: llama-mtmd-cli -hf Bigchilli1978/reggie-five-eyes-8b-GGUF --jinja

Available Model files:

  • Meta-Llama-3.1-8B-Instruct-abliterated.Q5_K_M.gguf
  • Meta-Llama-3.1-8B-Instruct-abliterated.Q4_K_M.gguf

Note

The model's BOS token behavior was adjusted for GGUF compatibility.

This was trained 2x faster with Unsloth

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>

Run Bigchilli1978/reggie-five-eyes-8b-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models