GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

mamelles/LFM2.5-350M-Wolof-Instruct-v3-GGUF overview

LFM2.5 350M Wolof Instruct v3 GGUF Private production artifact ongoing/experimental . Exact base: Tonic/LFM2.5 350M Wolof Instruct v3 Training stage: Instruct …

ggufllama.cppwoloflfm2.5private-production-artifacttext-generationwobase_model:Tonic/LFM2.5-350M-Wolof-Instruct-v3base_model:quantized:Tonic/LFM2.5-350M-Wolof-Instruct-v3model-indexendpoints_compatibleregion:usconversational

Runs locally from ~249.1 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
104
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

6 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
LFM2.5-350M-Wolof-Instruct-v3-BF16.ggufGGUFBF16817.8 MBDownload
LFM2.5-350M-Wolof-Instruct-v3-Q4_0.ggufGGUFQ4_0249.1 MBDownload
LFM2.5-350M-Wolof-Instruct-v3-Q4_K_M.ggufGGUFQ4_K_M258.6 MBDownload
LFM2.5-350M-Wolof-Instruct-v3-Q5_K_M.ggufGGUFQ5_K_M296.6 MBDownload
LFM2.5-350M-Wolof-Instruct-v3-Q6_K.ggufGGUFQ6_K336.9 MBDownload
LFM2.5-350M-Wolof-Instruct-v3-Q8_0.ggufGGUFQ8_0435.6 MBDownload

Model Details

Model IDmamelles/LFM2.5-350M-Wolof-Instruct-v3-GGUF
Authormamelles
Pipelinetext-generation
License—
Base modelTonic/LFM2.5-350M-Wolof-Instruct-v3
Last modified2026-10-08T09:29:32.000Z

Model README

---

library_name: gguf

pipeline_tag: text-generation

tags:

  • gguf
  • llama.cpp
  • wolof
  • lfm2.5
  • private-production-artifact

base_model: Tonic/LFM2.5-350M-Wolof-Instruct-v3

model-index:

  • name: LFM2.5-350M-Wolof-Instruct-v3-GGUF

results:

- task:

type: text-generation

name: Wolof GGUF Q4_K_M

dataset:

type: wolof-clm-corpus-test

name: Wolof CLM corpus test (verbalized, gguf-llama-cpp)

split: test

metrics:

- type: perplexity

value: 5083.4158

name: llama.cpp perplexity (Q4_K_M)

- type: bleu

value: 0.06

name: BLEU via llama-completion

- type: chrf

value: 4.33

name: chrF via llama-completion

source:

name: GalsenAI LFM2.5 Wolof family eval

url: https://huggingface.co/Tonic/LFM2.5-350M-Wolof-Instruct-v3-GGUF/blob/main/metrics.json

language:

  • wo

---

LFM2.5-350M-Wolof-Instruct-v3-GGUF

Private production artifact (ongoing/experimental).

  • Exact base: Tonic/LFM2.5-350M-Wolof-Instruct-v3
  • Training stage: Instruct (+ GGUF export)
  • Tokenizer family: see base model card
  • Data caveat: Wolof CPT/SFT mixture; no public leakage claims
  • Limitations: experimental; verify generation quality before downstream use
  • Private production artifact for gated llama.cpp deployment

Files

GGUF quant matrix following LiquidAI parity: BF16, F16, Q8_0, Q6_K, Q5_K_M, Q4_K_M, Q4_0.

Run

llama-cli -hf <namespace>/LFM2.5-350M-Wolof-Instruct-v3-GGUF:Q4_K_M -p "Salaam aleekum"

<!-- FAMILY_EVAL_START -->

Evaluation

  • Tokenizer family: 65k-ext
  • Protocol: HF evaluate_clm.py BPB is the cross-tokenizer gold metric.
  • Machine-readable copy: metrics.json.

GGUF Q4_K_M (gguf-llama-cpp; not HF-BPB-equivalent)

| Metric | Value |

|---|---:|

| Perplexity | 5083.4158 |

| BLEU | 0.06 |

| chrF | 4.33 |

Compare GGUF PPL only within the same GGUF/tokenizer family. Use HF BPB for cross-model ranking.

HF reference (same verbalized corpus)

| Metric | Value |

|---|---:|

| BPB | 1.5566 |

| BLEU | 1.0 |

| chrF | 11.85 |

<!-- FAMILY_EVAL_END -->

Run mamelles/LFM2.5-350M-Wolof-Instruct-v3-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models