GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

nuofang/gemma4-e4b-mahou-nsfw-GGUF overview

Auto Quantized GGUF Model This repository contains automated GGUF quantization files for Pranavz/gemma4 e4b mahou nsfw https://huggingface.co/Pranavz/gemma4 e4…

ggufllama.cppquantizedimatrixbase_model:Pranavz/gemma4-e4b-mahou-nsfwbase_model:quantized:Pranavz/gemma4-e4b-mahou-nsfwendpoints_compatibleregion:usconversationalnot-for-all-audiences

Runs locally from ~4.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
1,488
Likes
1
Pipeline
Author

Repository Files & Downloads

7 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
gemma4-e4b-mahou-nsfw-IQ4_NL.ggufGGUFIQ4_NL4.81 GBDownload
gemma4-e4b-mahou-nsfw-IQ4_XS.ggufGGUFIQ4_XS4.69 GBDownload
gemma4-e4b-mahou-nsfw-Q4_K_M.ggufGGUFQ4_K_M4.94 GBDownload
gemma4-e4b-mahou-nsfw-Q4_K_S.ggufGGUFQ4_K_S4.82 GBDownload
gemma4-e4b-mahou-nsfw-Q5_K_M.ggufGGUFQ5_K_M5.33 GBDownload
gemma4-e4b-mahou-nsfw-Q5_K_S.ggufGGUFQ5_K_S5.26 GBDownload
imatrix.ggufGGUFGGUF4.2 MBDownload

Model Details

Model IDnuofang/gemma4-e4b-mahou-nsfw-GGUF
Authornuofang
Pipeline
License
Base modelPranavz/gemma4-e4b-mahou-nsfw
Last modified2026-07-04T03:10:36.000Z

Model README

---

base_model: Pranavz/gemma4-e4b-mahou-nsfw

tags:

  • llama.cpp
  • quantized
  • imatrix

---

Auto-Quantized GGUF Model

This repository contains automated GGUF quantization files for Pranavz/gemma4-e4b-mahou-nsfw.

The calibration data for the imatrix is targeted at Chinese novels and role-playing (RP), while preserving logic and common sense.

imatrix 的校准数据以中文的小说、角色扮演为目标,同时保留逻辑和常识。

📊 Perplexity Evaluation

(Tested against the provided calibration dataset)

  • Q5_K_S: PPL = 28.2787 +/- 0.30817

Run nuofang/gemma4-e4b-mahou-nsfw-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models