GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

esalahterus/juicio-gguf overview

Juicio GGUF — Indonesian Legal QA Assistant Quantized GGUF quantized version of esalahterus/juicio https://huggingface.co/esalahterus/juicio , a Qwen2.5 7B mod…

ggufqwen2llama.cppunslothlegalindonesiantext-generationidmsenbase_model:esalahterus/juiciobase_model:quantized:esalahterus/juiciolicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~7.54 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
151
Likes
1
Pipeline
text-generation

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Juicio.Q8_0.ggufGGUFGGUF7.54 GBDownload

Model Details

Model IDesalahterus/juicio-gguf
Authoresalahterus
Pipelinetext-generation
Licenseapache-2.0
Base modelesalahterus/juicio
Last modified2026-08-02T08:22:37.000Z

Model README

---

base_model: esalahterus/juicio

tags:

  • gguf
  • llama.cpp
  • unsloth
  • qwen2
  • legal
  • indonesian

license: apache-2.0

language:

  • id
  • ms
  • en

pipeline_tag: text-generation

---

Juicio GGUF — Indonesian Legal QA Assistant (Quantized)

GGUF-quantized version of esalahterus/juicio, a Qwen2.5-7B model fine-tuned to answer questions about Indonesian law. Converted using Unsloth for fast, local inference with llama.cpp-compatible tools (llama.cpp, Ollama, LM Studio, etc.).

Available Model Files

| File | Quantization |

|---|---|

| Juicio.Q8_0.gguf | Q8_0 (near-full precision, largest file, highest fidelity) |

Example Usage

llama-cli -hf esalahterus/juicio-gguf --jinja

Ollama

An Ollama Modelfile is included in this repo for easy deployment — download the repo and run:

ollama create juicio -f Modelfile
ollama run juicio

Intended Use & Limitations

Same as the base esalahterus/juicio model: intended for general questions about Indonesian law for educational/informational purposes, not a substitute for professional legal advice. May hallucinate legal citations — always verify against primary legal sources.

Acknowledgements

This model was finetuned and converted to GGUF format using Unsloth.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>

Run esalahterus/juicio-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models