NVIDIA-Nemotron-3.5-Super-VL-120B-A12B

Q: What is ggml-org/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF?

--- license: other pipeline_tag: image-text-to-text tags: - gguf - quantized base_model: - nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 --- # NVIDIA-Nemotron-3.5-Super-VL-120B-A12B Run it in the Llama app: https://llama.app Or from the terminal: ```bash llama serve -hf ggml-org/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF ``` ### Source models - https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 - https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-LiLiCorr - https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4 ### TODOs - add info > [!IMPORTANT] > This model is automatically converted using https://github.com/ggml-org/convert

Run it in the Llama app: https://llama.app

Or from the terminal:

llama serve -hf ggml-org/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF

Source models

https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16
https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-LiLiCorr
https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4

TODOs

add info

> [!IMPORTANT]

> This model is automatically converted using https://github.com/ggml-org/convert

Question 2

What license applies to ggml-org/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF?

Accepted Answer

License: other. Verify terms on Hugging Face before commercial use.

Question 3

How do I run ggml-org/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF locally?

Accepted Answer

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: image-text-to-text.

Question 4

How much VRAM or disk space does ggml-org/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF need?

Accepted Answer

Runs locally from ~922.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

File	Type	Quantization	Size	Link
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16.gguf	GGUF	BF16	224.93 GB	Download
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4.gguf	GGUF	GGUF	71.64 GB	Download
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Q4_0.gguf	GGUF	Q4_0	66.99 GB	Download
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Q8_0.gguf	GGUF	Q8_0	119.65 GB	Download
lilicorr-NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4.gguf	GGUF	GGUF	1.26 GB	Download
mmproj-NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16.gguf	GGUF	BF16	1.61 GB	Download
mmproj-NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Q8_0.gguf	GGUF	Q8_0	922.1 MB	Download
mtp-NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16.gguf	GGUF	BF16	7.49 GB	Download
mtp-NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Q4_0.gguf	GGUF	Q4_0	2.11 GB	Download
mtp-NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-Q8_0.gguf	GGUF	Q8_0	3.98 GB	Download

ggml-org/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF overview

Repository Files & Downloads

Model Details

Model README

NVIDIA-Nemotron-3.5-Super-VL-120B-A12B

Source models

TODOs

Run ggml-org/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF with guIDE

Model ID	ggml-org/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-GGUF
Author	ggml-org
Pipeline	image-text-to-text
License	other
Base model	nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16
Last modified	2026-10-19T15:35:02.000Z