nile-academy/smollm3-3b-gguf overview
smollm3 3b gguf Consumer supplied Wekala model library assets derived from the attributed official publisher. Models and this repository are distributed separa…
Runs locally from ~1.78 GB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| SmolLM3-3B-Q4_K_M.gguf | GGUF | Q4_K_M | 1.78 GB | Download |
Model Details
| Model ID | nile-academy/smollm3-3b-gguf |
|---|---|
| Author | nile-academy |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | HuggingFaceTB/SmolLM3-3B |
| Last modified | 2026-10-19T22:50:23.000Z |
Model README
---
license: apache-2.0
base_model:
- HuggingFaceTB/SmolLM3-3B
base_model_relation: quantized
library_name: gguf
pipeline_tag: text-generation
tags:
- wekala
- gguf
---
smollm3-3b-gguf
Consumer-supplied Wekala model-library assets derived from the attributed official publisher. Models and this repository are distributed separately from the Wekala SDK.
Origin and licence
| Field | Value |
| --- | --- |
| Original developer | Hugging Face SmolLM team |
| Original model | HuggingFaceTB/SmolLM3-3B |
| Pinned source revision | a07cc9a04f16550a088caea529712d1d335b0ac1 |
| Original publication | 2025-07-08 (day) |
| Date evidence | Publisher source |
| Licence | apache-2.0; preserved in LICENSE |
| Full source parameters | 3,075,098,624 (includes embeddings and source modalities) |
| Nile Academy role | Official artifact mirror or explicitly recorded format conversion; no additional training |
Original publisher cards and available notices are preserved in provenance/. The original model licence governs the weights; this repository grants no rights to the Wekala SDK.
Files and quantization
Q8_0 is the higher-precision comparison; Q6_K/Q5_K_M trade memory for precision; Q4_K_M needs paired task evaluation. No general quality-loss or 8GB-fit qualification yet.
| File | Quantization | Size (GB) | Origin |
| --- | --- | ---: | --- |
| SmolLM3-3B-Q4_K_M.gguf | Q4_K_M | 1.915 | existing Nile conversion; original lineage retained |
Exact file SHA-256 values, upstream paths/revisions and conversion receipts are recorded in model-metadata.json.
Published benchmarks
Publisher-reported source-model scores follow. They are not Wekala measurements of these quantized files. Harness, precision, reasoning settings and task versions differ; do not treat them as a normalized cross-model ranking.
| Benchmark | Score (%) | Mode / settings |
| --- | ---: | --- |
| IFEval | 76.7 | non-thinking; Publisher card protocol; cross-model scores are not normalized. |
| BFCL | 92.3 | non-thinking; Publisher card protocol; cross-model scores are not normalized. |
| GlobalMMLU | 53.5 | non-thinking; Publisher card protocol; cross-model scores are not normalized. |
| IFEval | 71.2 | thinking; Publisher card protocol; cross-model scores are not normalized. |
| BFCL | 88.8 | thinking; Publisher card protocol; cross-model scores are not normalized. |
Qualification and use
Existing Windows development routes have separate readiness observations. Broad quality, sustained device fit, mobile/browser and owner acceptance remain separate.
Wekala broad quantization-quality qualification: not qualified. No general “no significant quality loss” claim is made. Official QAT or publisher comparisons are attributed separately. Before recommendation, use paired reference/variant evaluation across instruction, knowledge, math, multilingual/Arabic and tool tasks under the registered Wekala campaign.
Device fit is separate: weight size excludes context state, scratch buffers and driver headroom. CPU and CUDA are execution backends for the same weight file, not separate models. Mobile/browser and sustained 8GB-VRAM operation require their own measured profiles.
Models can produce incorrect or unsafe outputs. Tool calls are proposals subject to the consuming application’s permissions and controller admission.
Run nile-academy/smollm3-3b-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models