roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q4_K_M-GGUF

Repo: roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q4_K_M-GGUF

Original Model: DeepSeek-R1-Distill-Llama-70B-Uncensored-v2

Quantized File: DeepSeek-R1-Distill-Llama-70B-Uncensored-v2.Q4_K_M.gguf

Quantization: GGUF

Quantization Method: Q4_K_M

Overview

This is a GGUF Q4_K_M quantized version of DeepSeek-R1-Distill-Llama-70B-Uncensored-v2

I often have idle GPUs while building/testing for the RP app, so I put them to use quantizing models.

I hope the community finds these quantizations useful.

Andrew Webby @ RolePlai.

Question 2

What license applies to td-builder/DeepSeek-R1-Distill-Llama-70B-v2-Q4_K_M-GGUF?

Accepted Answer

License: See model card. Verify terms on Hugging Face before commercial use.

Question 3

How do I run td-builder/DeepSeek-R1-Distill-Llama-70B-v2-Q4_K_M-GGUF locally?

Accepted Answer

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Question 4

How much VRAM or disk space does td-builder/DeepSeek-R1-Distill-Llama-70B-v2-Q4_K_M-GGUF need?

Accepted Answer

Runs locally from ~39.60 GB disk (32 GB+ VRAM class GPUs with llama.cpp / guIDE).

Model ID	td-builder/DeepSeek-R1-Distill-Llama-70B-v2-Q4_K_M-GGUF
Author	td-builder
Pipeline	text-generation
License	—
Base model	—
Last modified	2026-07-04T02:19:18.000Z