GraySoft

Download guIDE →

Llama 3.1 Instruct 405B local alternatives

Cloud model by Meta. GGUF repos below are ranked by name match and downloads.

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF

GnLOLot · 68,714 downloads

DavidAU/L3.2-Rogue-Creative-Instruct-Uncensored-Abliterated-7B-GGUF

DavidAU · 5,681 downloads

Jackrong/Gemopus-4-26B-A4B-it-GGUF

Jackrong · 4,012 downloads

AEON-7/Step-3.7-Flash-AEON-Ultimate-Abliterated-GGUF

AEON-7 · 2,778 downloads

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-IQ4_XS

majentik · 1,453 downloads

majentik/gemma-4-E2B-it-RotorQuant-GGUF-IQ4_XS

majentik · 1,340 downloads

majentik/gemma-4-31B-it-RotorQuant-GGUF-IQ4_XS

majentik · 1,234 downloads

Jackrong/Gemopus-4-31B-it-GGUF

Jackrong · 1,009 downloads

mradermacher/Latxa-Llama-3.1-70B-Instruct-v2-i1-GGUF

mradermacher · 830 downloads

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q8_0

majentik · 817 downloads

mradermacher/Llama-3.1-8B-Instruct-Jbliterated-i1-GGUF

mradermacher · 794 downloads

EnlistedGhost/Ministral-3-8B-Instruct-2512-GGUF

EnlistedGhost · 767 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models