---

license: other

license_name: nvidia-open-model-license

license_link: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/

base_model: nvidia/NVIDIA-Nemotron-Labs-3-Elastic-30B-A3B-NVFP4

base_model_relation: quantized

library_name: llama.cpp

pipeline_tag: text-generation

tags:

• gguf
• llama.cpp
• lm-studio
• lmstudio
• quantized
• 4-bit
• q4_k_s
• q4_k_m
• nemotron
• nvidia

---

NVIDIA Nemotron Labs 3 Elastic 23B A2.8B GGUF

A smaller, hacker-friendly GGUF build of NVIDIA Nemotron Elastic.

Built for llama.cpp, LM Studio, and other GGUF-compatible runtimes.

Files

| File | Notes | Rough VRAM target |

|---|---|---:|

| nemotron-elastic-12b-Q4_K_S.gguf | Smaller 4-bit quant | ~10GB VRAM |

| nemotron-elastic-12b-Q4_K_M.gguf | Better 4-bit quant | ~10GB+ VRAM |

Which one should I use?

Use Q4_K_S if you want the easier/smaller 4-bit file.

Use Q4_K_M if you want the better-quality 4-bit file and have a little more room.

Both files are intended for roughly 10GB VRAM class hardware, depending on context size, KV cache settings, and GPU offload.

LM Studio

Open LM Studio and search for:

HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-23B-A2.8B-GGUF