GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →

NonMiFrega author hub

NonMiFrega/gemma 2 9b Q4 K M GGUF This model was converted to GGUF format from google/gemma 2 9b https://huggingface.co/google/gemma 2 9b using llama.cpp via the ggml.ai's GGUF my repo https://huggingface.co/spaces/ggml org/gguf my repo space. Refer to the original model card ht…

Models
34
Downloads
0
NonMiFrega/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/Llama-3.2-1B-Instruct-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/gemma-2-9b-it-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/gemma-2-9b-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/gemma-2-2b-it-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/gemma-2-2b-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/Apertus-v1.1-4B-Instruct-Q8_0-GGUF
0 downloads · text-generation
NonMiFrega/Apertus-v1.1-4B-Q8_0-GGUF
0 downloads · text-generation
NonMiFrega/Apertus-v1.1-4B-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/Apertus-v1.1-1.5B-Q8_0-GGUF
0 downloads · text-generation
NonMiFrega/Apertus-v1.1-1.5B-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/Apertus-v1.1-0.5B-Q8_0-GGUF
0 downloads · text-generation
NonMiFrega/Apertus-v1.1-0.5B-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/Llama-3.1-8B-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/Apertus-8B-2509-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/Llama-3.1-8B-Instruct-Q4_K_M-GGUF
0 downloads · text-generation
NonMiFrega/SmolLM2-1.7B-Instruct-Q4_K_M-GGUF
0 downloads · text-generation

Run models locally with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models