GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →

Claude 3 Sonnet local alternatives

Cloud model by Anthropic. GGUF repos below are ranked by name match and downloads.

mondk/claude-llama-8B-think-GGuf
mondk · 548 downloads
mradermacher/TQ3.5-27B-Musica-v1-GGUF
mradermacher · 475 downloads
mradermacher/G4-31B-Musica-v1-GGUF
mradermacher · 203 downloads
sillykiwi/Soren-1-Small-Q8_0-GGUF
sillykiwi · 0 downloads

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models