medoomem/gemma-4-e4b-it-the-deckard-v2-strong-heretic-uncensored-thinking-q4_k_m-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
medoomem/gemma-4-e4b-it-the-deckard-v2-strong-heretic-uncensored-thinking-q4_k_m-gguf overview
This model was converted to GGUF format from DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.
Downloads
226
Likes
0
Pipeline
any-to-any
Library
transformers
Visibility
Public
Access
Open
Repository Files & Downloads
1 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| gemma-4-e4b-it-the-deckard-v2-strong-heretic-uncensored-thinking-q4_k_m.gguf | GGUF | Q4_K_M | 4.97 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"base_model": "DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking",
"pipeline_tag": "any-to-any",
"library_name": "transformers",
"tags": [
"heretic",
"uncensored",
"aliterated",
"finetune",
"unsloth",
"all use cases",
"coder",
"creative",
"creative writing",
"fiction writing",
"plot generation",
"sub-plot generation",
"story generation",
"scene continue",
"storytelling",
"fiction story",
"science fiction",
"romance",
"all genres",
"story",
"writing",
"vivid prosing",
"vivid writing",
"fiction",
"roleplaying",
"bfloat16",
"llama-cpp",
"gguf-my-repo"
],
"frontmatter": {
"license": "apache-2.0",
"base_model": "DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking",
"pipeline_tag": "any-to-any",
"library_name": "transformers",
"tags": [
"heretic",
"uncensored",
"aliterated",
"finetune",
"unsloth",
"all use cases",
"coder",
"creative",
"creative writing",
"fiction writing",
"plot generation",
"sub-plot generation",
"story generation",
"scene continue",
"storytelling",
"fiction story",
"science fiction",
"romance",
"all genres",
"story",
"writing",
"vivid prosing",
"vivid writing",
"fiction",
"roleplaying",
"bfloat16",
"llama-cpp",
"gguf-my-repo"
]
},
"hero_image_url": "",
"summary": "This model was converted to GGUF format from DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\nbase_model: DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking\npipeline_tag: any-to-any\nlibrary_name: transformers\ntags:\n- heretic\n- uncensored\n- aliterated\n- finetune\n- unsloth\n- all use cases\n- coder\n- creative\n- creative writing\n- fiction writing\n- plot generation\n- sub-plot generation\n- story generation\n- scene continue\n- storytelling\n- fiction story\n- science fiction\n- romance\n- all genres\n- story\n- writing\n- vivid prosing\n- vivid writing\n- fiction\n- roleplaying\n- bfloat16\n- llama-cpp\n- gguf-my-repo\n---\n\n# medoomem/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking-Q4_K_M-GGUF\nThis model was converted to GGUF format from [`DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking`](https://huggingface.co/DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.\nRefer to the [original model card](https://huggingface.co/DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking) for more details on the model.\n\n## Use with llama.cpp\nInstall llama.cpp through brew (works on Mac and Linux)\n\n```bash\nbrew install llama.cpp\n\n```\nInvoke the llama.cpp server or the CLI.\n\n### CLI:\n```bash\nllama-cli --hf-repo medoomem/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking-Q4_K_M-GGUF --hf-file gemma-4-e4b-it-the-deckard-v2-strong-heretic-uncensored-thinking-q4_k_m.gguf -p \"The meaning to life and the universe is\"\n```\n\n### Server:\n```bash\nllama-server --hf-repo medoomem/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking-Q4_K_M-GGUF --hf-file gemma-4-e4b-it-the-deckard-v2-strong-heretic-uncensored-thinking-q4_k_m.gguf -c 2048\n```\n\nNote: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.\n\nStep 1: Clone llama.cpp from GitHub.\n```\ngit clone https://github.com/ggerganov/llama.cpp\n```\n\nStep 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).\n```\ncd llama.cpp && LLAMA_CURL=1 make\n```\n\nStep 3: Run inference through the main binary.\n```\n./llama-cli --hf-repo medoomem/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking-Q4_K_M-GGUF --hf-file gemma-4-e4b-it-the-deckard-v2-strong-heretic-uncensored-thinking-q4_k_m.gguf -p \"The meaning to life and the universe is\"\n```\nor\n```\n./llama-server --hf-repo medoomem/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking-Q4_K_M-GGUF --hf-file gemma-4-e4b-it-the-deckard-v2-strong-heretic-uncensored-thinking-q4_k_m.gguf -c 2048\n```\n",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"heretic",
"uncensored",
"aliterated",
"finetune",
"unsloth",
"all use cases",
"coder",
"creative",
"creative writing",
"fiction writing",
"plot generation",
"sub-plot generation",
"story generation",
"scene continue",
"storytelling",
"fiction story",
"science fiction",
"romance",
"all genres",
"story",
"writing",
"vivid prosing",
"vivid writing",
"fiction",
"roleplaying",
"bfloat16",
"llama-cpp",
"gguf-my-repo",
"any-to-any",
"base_model:DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking",
"base_model:quantized:DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking",
"license:apache-2.0",
"endpoints_compatible",
"region:us"
],
"likes": 0,
"downloads": 226,
"gated": false,
"private": false,
"last_modified": "2026-04-15T01:22:58.000Z",
"created_at": "2026-04-15T01:22:41.000Z",
"pipeline_tag": "any-to-any",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "69dee8619d1f89727a5e30c1",
"id": "medoomem/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking-Q4_K_M-GGUF",
"modelId": "medoomem/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking-Q4_K_M-GGUF",
"sha": "ac183b3dcbb3dc211f86eaf531227d388f742e99",
"createdAt": "2026-04-15T01:22:41.000Z",
"lastModified": "2026-04-15T01:22:58.000Z",
"author": "medoomem",
"downloads": 226,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "any-to-any",
"library_name": "transformers",
"siblings_count": 3
}