GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

yosoyalguien/gemma-4-E2B-it-GGUF-TQ4_1S overview

yosoyalguien/gemma 4 E2B it GGUF TQ4 1S TurboQuant TQ4 1S quantization of unsloth/gemma 4 E2B it GGUF https://huggingface.co/unsloth/gemma 4 E2B it GGUF . Deta…

ggufturboquantquantizationtq4_1sbase_model:unsloth/gemma-4-E2B-it-GGUFbase_model:quantized:unsloth/gemma-4-E2B-it-GGUFlicense:otherendpoints_compatibleregion:usimatrixconversational

Runs locally from ~3.24 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
gemma-4-E2B-it-UD-Q8_K_XL-tq4_1s.ggufGGUFQ8_K_XL3.24 GBDownload

Model Details

Model IDyosoyalguien/gemma-4-E2B-it-GGUF-TQ4_1S
Authoryosoyalguien
Pipeline
Licenseother
Base modelunsloth/gemma-4-E2B-it-GGUF
Last modified2026-07-09T22:34:10.000Z

Model README

---

base_model:

  • unsloth/gemma-4-E2B-it-GGUF

license: other

tags:

  • turboquant
  • gguf
  • quantization
  • tq4_1s

---

yosoyalguien/gemma-4-E2B-it-GGUF-TQ4_1S

TurboQuant (TQ4_1S) quantization of unsloth/gemma-4-E2B-it-GGUF.

Details

| Field | Value |

|---|---|

| Parent model | unsloth/gemma-4-E2B-it-GGUF |

| Quantization type | TQ4_1S |

| Quantization tool | turboquant-plus-tqp-v0.2.0 |

| File | gemma-4-E2B-it-UD-Q8_K_XL-tq4_1s.gguf |

Usage

Use with llama.cpp (TurboQuant fork) or any GGUF-compatible runtime that supports the TQ4_1S type.

llama-server -m gemma-4-E2B-it-UD-Q8_K_XL-tq4_1s.gguf --port 8080

Disclaimer

This model was quantized using TurboQuant, an experimental KV cache compression and quantization method. Quality may differ from the parent model. Refer to the parent model for licensing and usage terms.

Run yosoyalguien/gemma-4-E2B-it-GGUF-TQ4_1S with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models