---

license: other

pipeline_tag: text-generation

tags:

• gguf
• quantized

base_model:

• nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

---

<div align="center">

<img src="./capa.jpeg" alt="2BKR_IQ4_NL_hybrid_NVIDIA-Nemotron-3.5-Lightning-30B-A3B" width="100%" style="border-radius: 12px; box-shadow: 0 10px 40px rgba(0,0,0,0.6);" />

⚡ 2BKR_IQ4_NL_hybrid_NVIDIA-Nemotron-3.5-Lightning-30B-A3B

</div>

Modelo Quantizado

• Arquivo: 2BKR_IQ4_NL_hybrid_NVIDIA-Nemotron-3.5-Lightning-30B-A3B.gguf

Comando sugerido (llama-server)

"/home/userk21/llama_server_VULLKAN_MIXED/build/bin/llama-server" \
  -m "/home/userk21/Área de trabalho/userk21/GGUFS/2BKR_IQ4_NL_hybrid_NVIDIA-Nemotron-3.5-Lightning-30B-A3B.gguf" \
  -ngl 16 \
  -c 50000 \
  -ctk q8_0 \
  -ctv q8_0 \
  -t 4 \
  -tb 4 \
  -b 2048 \
  -ub 1024 \
  -fa on \
  --cpu-strict 1 \
  --parallel 1 \
  --agent \
  --tools all \
  --reasoning auto \
  --kv-unified \
  --load-mode mmap \
  --cors-origins "*" \
  --webui-mcp-proxy \
  --threads-http -1 \
  --port 5173 \
  --host 127.0.0.1

Source models

• https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

<!--

• https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4
• https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-DFlash
• https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-DSpark

-->

TODOs

• add info

> [!IMPORTANT]

> This model is automatically converted using https://github.com/ggml-org/convert