Model Intelligence Sheet
ToastyPigeon/Gemma4-Test-GGUFs overview
ToastyPigeon/Gemma4-Test-GGUFs GGUF downloads for local AI inference with guIDE.
Runs locally from ~5.75 GB disk (8 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
84 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| 31B_linear_03_it_v02.Q4_K_M.gguf | GGUF | GGUF | 17.40 GB | Download |
| Gemma4-E4B-TIES-3mask-r64.Q6_K.gguf | GGUF | GGUF | 5.75 GB | Download |
| Gemma4-E4B-TIES-3mask-r64.bf16.gguf | GGUF | GGUF | 13.92 GB | Download |
| Gemma4-E4B-b200-mix-masked-r256.Q6_K.gguf | GGUF | GGUF | 5.75 GB | Download |
| Gemma4-E4B-b200-mix-masked-r256.bf16.gguf | GGUF | GGUF | 13.92 GB | Download |
| Marvin_2Ep_6K-12B-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| Marvin_Gutenberg_12B-12B-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| Marvin_Gutenberg_Rp_12-12B-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| Marvin_Gutenberg_Rp_V2-12B-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| Marvin_Only_Test_Merged-12B-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| Marvin_Rp_2Ep_6K-12B-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| Marvin_Rp_Two_Epoch-12B-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| e4b_allin_avg6.Q6_K.gguf | GGUF | GGUF | 5.79 GB | Download |
| e4b_allin_ties6_m05s10.Q6_K.gguf | GGUF | GGUF | 5.79 GB | Download |
| e4b_sd_svd_layer.Q6_K.gguf | GGUF | GGUF | 5.75 GB | Download |
| e4b_v3_avg_fisher_layer.Q6_K.gguf | GGUF | GGUF | 5.79 GB | Download |
| e4b_v3_glimmer_conv_r16.Q6_K.gguf | GGUF | GGUF | 5.75 GB | Download |
| e4b_v3_heal_slerp_a03.Q6_K.gguf | GGUF | GGUF | 5.79 GB | Download |
| fold_g04m10k04S.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| fold_g05m08k04S.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| fold_mm100s.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| fold_mmg05m08.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| g4-31b-it-truncated-vocab-Q4_K_M.gguf | GGUF | Q4_K_M | 16.99 GB | Download |
| g4_12b_glimmer_rp_v01.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| g4_12b_glimmer_rp_v02.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| g4_12b_glimmer_rp_v03.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| g4_12b_glimmer_rp_v04.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| g4_31b_jaxx_recipe_C.Q4_K_M.gguf | GGUF | GGUF | 17.40 GB | Download |
| g4_31b_recipe_E.Q4_K_M.gguf | GGUF | GGUF | 17.40 GB | Download |
| g4_31b_recipe_Gv3.Q4_K_M.gguf | GGUF | GGUF | 17.40 GB | Download |
| g4_31b_recipe_H.Q4_K_M.gguf | GGUF | GGUF | 17.40 GB | Download |
| g4_31b_recipe_I.Q4_K_M.gguf | GGUF | GGUF | 17.40 GB | Download |
| g4_31b_recipe_Lv4.Q4_K_M.gguf | GGUF | GGUF | 17.40 GB | Download |
| g4_31b_v2_equinox_meromero.Q4_K_M.gguf | GGUF | GGUF | 17.40 GB | Download |
| g4_31b_v2_gembrain_equinox.Q4_K_M.gguf | GGUF | GGUF | 17.40 GB | Download |
| g4_e4b_v3_heal_slerp_itmask_a03.Q6_K.gguf | GGUF | GGUF | 5.79 GB | Download |
| gemma-12B-marvin-rp-blorbo-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-heal-v5-2-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-heal-v5-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-real-v8-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-test-ep2-v8-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-test-v8-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-v10-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-v4-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-v5-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-v6-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-v7-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-marvin-rp-v9-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-12B-step1-gutenberg-only-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-31b-marvin-scotoma-q4ks.gguf | GGUF | Q4KS | 16.54 GB | Download |
| gemma-4-12B-delerp-merged-80-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-4-12B-delerp-merged-90-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-4-12B-delerp-merged-92-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-4-12B-marvin-delerp-92-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-4-12b-delerp-095.gguf | GGUF | GGUF | 11.80 GB | Download |
| gemma-4-12b-heretic-gutenberg.gguf | GGUF | GGUF | 11.80 GB | Download |
| gemma-4-31B-glimmer-rp-Q3_K_S.gguf | GGUF | Q3_K_S | 12.82 GB | Download |
| gemma-4-31B-glimmer-rp-Q4_K_S.gguf | GGUF | Q4_K_S | 16.54 GB | Download |
| gemma-4-31B-glimmer-rp-v0.2-50pct-Q4_K_S.gguf | GGUF | Q4_K_S | 16.54 GB | Download |
| gemma-4-31B-glimmer-rp-v0.2-Q4_K_S.gguf | GGUF | Q4_K_S | 16.54 GB | Download |
| gemma-4-31B-glimmer-rp-v0.3-Q4_K_S.gguf | GGUF | Q4_K_S | 16.54 GB | Download |
| gemma-4-31B-marvin1000-baseline-Q4_K_M.gguf | GGUF | Q4_K_M | 17.40 GB | Download |
| gemma-4-marvin-rp-12B-v2-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| gemma-gutenberg-test.gguf | GGUF | GGUF | 11.80 GB | Download |
| gemma-marvin-rp-step-300.gguf | GGUF | GGUF | 11.80 GB | Download |
| gemma-marvin-rp-step-500.gguf | GGUF | GGUF | 11.80 GB | Download |
| gemma-marvin-rp-step-final.gguf | GGUF | GGUF | 11.80 GB | Download |
| gemma-serenity-test.gguf | GGUF | GGUF | 11.80 GB | Download |
| gemma4-26B-A4B-attn-lora-marvin-Q4_K_M.gguf | GGUF | Q4_K_M | 15.64 GB | Download |
| gemma4-26B-A4B-marvin-attnmlp-full-8k-Q4_K_M.gguf | GGUF | Q4_K_M | 15.64 GB | Download |
| glimmer-v0.3-marvin-g05m08.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| glimmer-v0.3-marvin-mdom.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| heretic-gutenberg-v2-test.gguf | GGUF | GGUF | 11.80 GB | Download |
| heretic-gutenberg-v3-test.gguf | GGUF | GGUF | 11.80 GB | Download |
| heretic-igorls-gemma-test.gguf | GGUF | GGUF | 11.80 GB | Download |
| marvin-gutenberg-rp-31b-q4ks.gguf | GGUF | Q4KS | 16.54 GB | Download |
| marvin-gutenberg-rp-31b-v2-q4ks.gguf | GGUF | Q4KS | 16.54 GB | Download |
| marvin-gutenberg-rp-v2-step200-q4ks.gguf | GGUF | Q4KS | 16.54 GB | Download |
| marvin-rp-12B-v3-Q8_0.gguf | GGUF | Q8_0 | 11.80 GB | Download |
| marvin07_glim03.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| marvin_12b.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| marvin_glim_r64.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| marvin_um_full.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
| mechanics-v0.1.Q6_K.gguf | GGUF | GGUF | 9.11 GB | Download |
Model Details
| Model ID | ToastyPigeon/Gemma4-Test-GGUFs |
|---|---|
| Author | ToastyPigeon |
| Pipeline | — |
| License | — |
| Base model | — |
| Last modified | 2026-07-25T20:02:02.000Z |
Run ToastyPigeon/Gemma4-Test-GGUFs with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models