esalahterus/juicio-gguf overview
Juicio GGUF — Indonesian Legal QA Assistant Quantized GGUF quantized version of esalahterus/juicio https://huggingface.co/esalahterus/juicio , a Qwen2.5 7B mod…
Runs locally from ~7.54 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Juicio.Q8_0.gguf | GGUF | GGUF | 7.54 GB | Download |
Model Details
| Model ID | esalahterus/juicio-gguf |
|---|---|
| Author | esalahterus |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | esalahterus/juicio |
| Last modified | 2026-08-02T08:22:37.000Z |
Model README
---
base_model: esalahterus/juicio
tags:
- gguf
- llama.cpp
- unsloth
- qwen2
- legal
- indonesian
license: apache-2.0
language:
- id
- ms
- en
pipeline_tag: text-generation
---
Juicio GGUF — Indonesian Legal QA Assistant (Quantized)
GGUF-quantized version of esalahterus/juicio, a Qwen2.5-7B model fine-tuned to answer questions about Indonesian law. Converted using Unsloth for fast, local inference with llama.cpp-compatible tools (llama.cpp, Ollama, LM Studio, etc.).
Available Model Files
| File | Quantization |
|---|---|
| Juicio.Q8_0.gguf | Q8_0 (near-full precision, largest file, highest fidelity) |
Example Usage
llama-cli -hf esalahterus/juicio-gguf --jinja
Ollama
An Ollama Modelfile is included in this repo for easy deployment — download the repo and run:
ollama create juicio -f Modelfile
ollama run juicio
Intended Use & Limitations
Same as the base esalahterus/juicio model: intended for general questions about Indonesian law for educational/informational purposes, not a substitute for professional legal advice. May hallucinate legal citations — always verify against primary legal sources.
Acknowledgements
- Base fine-tuned model:
esalahterus/juicio - Original base model: Qwen2.5-7B-Instruct by Alibaba Cloud
- Training datasets:
fathurfrs/qna-hukum-indonesia,ShoAnn/legalqa_klinik_hukumonline - GGUF conversion accelerated with Unsloth
This model was finetuned and converted to GGUF format using Unsloth.
Run esalahterus/juicio-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models