wacomctl672/Nemotron-3-Nano-Omni-30B-Abliterated-MM-GGUF overview

---

license: other

license_name: nvidia-open-model-agreement

license_link: >-

https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-agreement/

base_model:

• divinetribe/Nemotron-3-Nano-Omni-30B-Abliterated-MM-bf16

---

GGUF Quantizations for divinetribe/Nemotron-3-Nano-Omni-30B-Abliterated-MM-bf16

tested multimodality with q8_0 mmproj from ggml-org

should run on anything that can run llama.cpp. tested under windows with cuda

Q4KM is 6.21 BPW because of fallback quantization.

Q8_0 is the usual 8.51 BPW

Disclaimer & Notice

• Uncensored / Abliterated: This model has had safety mitigations and refusal vectors modified or removed. It may generate offensive, unfiltered, or biased content. User discretion is advised.
• Governing Terms: Use and distribution of this model remain subject to the NVIDIA Open Model Agreement. Users are strictly responsible for ensuring their usage complies with all applicable laws and NVIDIA's Acceptable Use policies.
• Use at Your Own Risk: This model is provided "as is" without warranties of any kind, express or implied. You are solely responsible for how the model is deployed and for any outputs generated.
• No Liability: The uploader merely provides this quantized/converted format (GGUF) for research, developer evaluation, and local testing, and assumes no liability for damages, legal disputes, or downstream misuse.