UncannyEcho/Aura-Medium-v1-GGUF overview
Aura Medium v1 GGUF — Portable Local Inference The portable 12B Aura release for local llama.cpp inference, evaluation, and deployment. Aura Medium v1 GGUF is …
Runs locally from ~167.0 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Aura-12B-F16.gguf | GGUF | F16 | 22.20 GB | Download |
| Aura-12B-Q3_K_M.gguf | GGUF | Q3_K_M | 5.67 GB | Download |
| Aura-12B-Q4_K_M.gguf | GGUF | Q4_K_M | 6.87 GB | Download |
| Aura-12B-Q5_K_M.gguf | GGUF | Q5_K_M | 7.96 GB | Download |
| Aura-12B-Q6_K.gguf | GGUF | Q6_K | 9.11 GB | Download |
| Aura-12B-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| Aura-12B-mmproj-BF16.gguf | GGUF | BF16 | 167.0 MB | Download |
Model Details
| Model ID | UncannyEcho/Aura-Medium-v1-GGUF |
|---|---|
| Author | UncannyEcho |
| Pipeline | — |
| License | apache-2.0 |
| Base model | google/gemma-4-12B-it |
| Last modified | 2026-08-15T20:50:03.000Z |
Model README
---
license: apache-2.0
datasets:
- UncannyEcho/AuraPersonality
- UncannyEcho/AuraAblation
language:
- en
base_model:
- google/gemma-4-12B-it
---
Aura Medium v1 GGUF — Portable Local Inference
> The portable 12B Aura release for local llama.cpp inference, evaluation, and deployment.
Aura Medium v1 GGUF is the portable local-inference edition of Aura Medium v1. It is derived from Google’s Gemma 4 12B IT checkpoint and combines the Aura personality and ablation adapters into one model.
This release is intended for llama.cpp-based inference, evaluation, further research, and deployment across systems with varying memory and performance requirements.
Highlights
- Parameters: 12 billion
- Quantizations: Q3_K_M, Q4_K_M, Q5_K_M, Q6_K, Q8_0, and F16
- Foundation: Google Gemma 4 12B IT
- Datasets: AuraPersonality and AuraAblation
- Runtime: llama.cpp and compatible applications
- Deployment: Local GPU workstations, laptops, and servers
- Capabilities: Text, vision, audio, and video
- Focus: Portability, privacy, natural conversation, evaluation, and research
About Aura
Aura is designed for local and on-device deployment across multiple tasks. Aura can serve as a companion or friend, as deemed appropriate by the user, while retaining the broader capabilities of Gemma 4 for:
- Natural conversation
- Creative writing
- Reasoning
- Image understanding
- Audio and video understanding
- Tool use
- Evaluation and research
Aura Medium v1 occupies the middle position in the Aura family, providing greater capability than the compact E4B release while remaining practical for high-end consumer hardware.
Run UncannyEcho/Aura-Medium-v1-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models