mamelles/LFM2.5-350M-Wolof-Instruct-v3-GGUF overview
LFM2.5 350M Wolof Instruct v3 GGUF Private production artifact ongoing/experimental . Exact base: Tonic/LFM2.5 350M Wolof Instruct v3 Training stage: Instruct …
Runs locally from ~249.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| LFM2.5-350M-Wolof-Instruct-v3-BF16.gguf | GGUF | BF16 | 817.8 MB | Download |
| LFM2.5-350M-Wolof-Instruct-v3-Q4_0.gguf | GGUF | Q4_0 | 249.1 MB | Download |
| LFM2.5-350M-Wolof-Instruct-v3-Q4_K_M.gguf | GGUF | Q4_K_M | 258.6 MB | Download |
| LFM2.5-350M-Wolof-Instruct-v3-Q5_K_M.gguf | GGUF | Q5_K_M | 296.6 MB | Download |
| LFM2.5-350M-Wolof-Instruct-v3-Q6_K.gguf | GGUF | Q6_K | 336.9 MB | Download |
| LFM2.5-350M-Wolof-Instruct-v3-Q8_0.gguf | GGUF | Q8_0 | 435.6 MB | Download |
Model Details
| Model ID | mamelles/LFM2.5-350M-Wolof-Instruct-v3-GGUF |
|---|---|
| Author | mamelles |
| Pipeline | text-generation |
| License | — |
| Base model | Tonic/LFM2.5-350M-Wolof-Instruct-v3 |
| Last modified | 2026-10-08T09:29:32.000Z |
Model README
---
library_name: gguf
pipeline_tag: text-generation
tags:
- gguf
- llama.cpp
- wolof
- lfm2.5
- private-production-artifact
base_model: Tonic/LFM2.5-350M-Wolof-Instruct-v3
model-index:
- name: LFM2.5-350M-Wolof-Instruct-v3-GGUF
results:
- task:
type: text-generation
name: Wolof GGUF Q4_K_M
dataset:
type: wolof-clm-corpus-test
name: Wolof CLM corpus test (verbalized, gguf-llama-cpp)
split: test
metrics:
- type: perplexity
value: 5083.4158
name: llama.cpp perplexity (Q4_K_M)
- type: bleu
value: 0.06
name: BLEU via llama-completion
- type: chrf
value: 4.33
name: chrF via llama-completion
source:
name: GalsenAI LFM2.5 Wolof family eval
url: https://huggingface.co/Tonic/LFM2.5-350M-Wolof-Instruct-v3-GGUF/blob/main/metrics.json
language:
- wo
---
LFM2.5-350M-Wolof-Instruct-v3-GGUF
Private production artifact (ongoing/experimental).
- Exact base:
Tonic/LFM2.5-350M-Wolof-Instruct-v3 - Training stage:
Instruct(+ GGUF export) - Tokenizer family: see base model card
- Data caveat: Wolof CPT/SFT mixture; no public leakage claims
- Limitations: experimental; verify generation quality before downstream use
- Private production artifact for gated llama.cpp deployment
Files
GGUF quant matrix following LiquidAI parity: BF16, F16, Q8_0, Q6_K, Q5_K_M, Q4_K_M, Q4_0.
Run
llama-cli -hf <namespace>/LFM2.5-350M-Wolof-Instruct-v3-GGUF:Q4_K_M -p "Salaam aleekum"
<!-- FAMILY_EVAL_START -->
Evaluation
- Tokenizer family:
65k-ext - Protocol: HF
evaluate_clm.pyBPB is the cross-tokenizer gold metric. - Machine-readable copy:
metrics.json.
GGUF Q4_K_M (gguf-llama-cpp; not HF-BPB-equivalent)
| Metric | Value |
|---|---:|
| Perplexity | 5083.4158 |
| BLEU | 0.06 |
| chrF | 4.33 |
Compare GGUF PPL only within the same GGUF/tokenizer family. Use HF BPB for cross-model ranking.
HF reference (same verbalized corpus)
| Metric | Value |
|---|---:|
| BPB | 1.5566 |
| BLEU | 1.0 |
| chrF | 11.85 |
<!-- FAMILY_EVAL_END -->
Run mamelles/LFM2.5-350M-Wolof-Instruct-v3-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models