Model Intelligence Sheet
7ven7o/SmolLM2-135M-Base-GGUF overview
SmolLM2 135M Q4 K S Q4 K S GGUF of HuggingFaceTB/SmolLM2 135M https://huggingface.co/HuggingFaceTB/SmolLM2 135M , converted with llama.cpp. This is a pretraine…
Runs locally from ~97.3 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
1 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| SmolLM2-135M-Q4_K_S.gguf | GGUF | Q4_K_S | 97.3 MB | Download |
Model Details
Model README
---
license: apache-2.0
base_model: HuggingFaceTB/SmolLM2-135M
base_model_relation: quantized
library_name: gguf
quantized_by: 7ven7o
tags:
- gguf
- smollm2
- base-model
---
SmolLM2-135M-Q4_K_S
Q4_K_S GGUF of HuggingFaceTB/SmolLM2-135M, converted with llama.cpp.
This is a pretrained base model, not instruction-tuned.
Original model is Apache-2.0.
llama-cli -hf 7ven7o/SmolLM2-135M-Base-GGUFRun 7ven7o/SmolLM2-135M-Base-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models