aoiandroid/nllb-200-distilled-600m-unsloth-gguf-mirror falcon GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
aoiandroid/nllb-200-distilled-600m-unsloth-gguf-mirror overview
This is a personal mirror of AlaminI/nllb-200-distilled-600M-unsloth-GGUF on Hugging Face. Authorship, training, and conversion credit belong to the upstream publisher and Meta (base weights). License remains CC BY-NC 4.0 (same as the base model); keep attribution when redistributing. Snapshot note: When this mirror was created, the upstream Hub repo contained only the shared ggml-vocab-*.gguf files plus this README (no large NLLB-600M weight file in that snapshot). If you need the full quantized translation weights, confirm what is actually published on the upstream repo or use facebook/nllb-200-distilled-600M with Transformers. --- # NLLB-200-Distilled-600M Unsloth GGUF GGUF-quantized version of facebook/nllb-200-distilled-600M (No Language Left Behind) produced with Unsloth for efficient inference.
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| ggml-vocab-aquila.gguf | GGUF | — | 4.60 MB | Download |
| ggml-vocab-baichuan.gguf | GGUF | — | 1.28 MB | Download |
| ggml-vocab-bert-bge.gguf | GGUF | — | 0.60 MB | Download |
| ggml-vocab-command-r.gguf | GGUF | — | 10.37 MB | Download |
| ggml-vocab-deepseek-coder.gguf | GGUF | — | 1.10 MB | Download |
| ggml-vocab-deepseek-llm.gguf | GGUF | — | 3.79 MB | Download |
| ggml-vocab-falcon.gguf | GGUF | — | 2.18 MB | Download |
| ggml-vocab-gpt-2.gguf | GGUF | — | 1.68 MB | Download |
| ggml-vocab-gpt-neox.gguf | GGUF | — | 1.69 MB | Download |
| ggml-vocab-llama-bpe.gguf | GGUF | — | 7.46 MB | Download |
| ggml-vocab-llama-spm.gguf | GGUF | — | 0.69 MB | Download |
| ggml-vocab-mpt.gguf | GGUF | — | 1.69 MB | Download |
| ggml-vocab-nomic-bert-moe.gguf | GGUF | — | 6.51 MB | Download |
| ggml-vocab-phi-3.gguf | GGUF | — | 0.69 MB | Download |
| ggml-vocab-qwen2.gguf | GGUF | — | 5.65 MB | Download |
| ggml-vocab-refact.gguf | GGUF | — | 1.64 MB | Download |
| ggml-vocab-starcoder.gguf | GGUF | — | 1.64 MB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"language": [
"en",
"ha",
"multilingual"
],
"license": "cc-by-nc-4.0",
"tags": [
"translation",
"nllb",
"gguf",
"unsloth",
"eng_Latn",
"hau_Latn"
],
"datasets": [
"facebook/nllb"
],
"frontmatter": {
"language": [
"en",
"ha",
"multilingual"
],
"license": "cc-by-nc-4.0",
"tags": [
"translation",
"nllb",
"gguf",
"unsloth",
"eng_Latn",
"hau_Latn"
],
"datasets": [
"facebook/nllb"
]
},
"hero_image_url": "",
"summary": "This is a **personal mirror** of AlaminI/nllb-200-distilled-600M-unsloth-GGUF on Hugging Face. **Authorship, training, and conversion credit belong to the upstream publisher and Meta (base weights).** License remains **CC BY-NC 4.0** (same as the base model); keep attribution when redistributing. **Snapshot note:** When this mirror was created, the upstream Hub repo contained only the shared ggml-vocab-*.gguf files plus this README (no large NLLB-600M weight file in that snapshot). If you need the full quantized translation weights, confirm what is actually published on the upstream repo or use facebook/nllb-200-distilled-600M with Transformers. --- # NLLB-200-Distilled-600M Unsloth GGUF GGUF-quantized version of **facebook/nllb-200-distilled-600M** (No Language Left Behind) produced with Unsloth for efficient inference.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlanguage:\n - en\n - ha\n - multilingual\nlicense: cc-by-nc-4.0\ntags:\n - translation\n - nllb\n - gguf\n - unsloth\n - eng_Latn\n - hau_Latn\ndatasets:\n - facebook/nllb\n---\n\n# Mirror: NLLB-200-Distilled-600M Unsloth GGUF\n\nThis is a **personal mirror** of [AlaminI/nllb-200-distilled-600M-unsloth-GGUF](https://huggingface.co/AlaminI/nllb-200-distilled-600M-unsloth-GGUF) on Hugging Face. **Authorship, training, and conversion credit belong to the upstream publisher and Meta (base weights).** License remains **CC BY-NC 4.0** (same as the base model); keep attribution when redistributing.\n\n**Snapshot note:** When this mirror was created, the upstream Hub repo contained only the shared `ggml-vocab-*.gguf` files plus this README (no large NLLB-600M weight file in that snapshot). If you need the full quantized translation weights, confirm what is actually published on the upstream repo or use [facebook/nllb-200-distilled-600M](https://huggingface.co/facebook/nllb-200-distilled-600M) with Transformers.\n\n---\n\n# NLLB-200-Distilled-600M Unsloth GGUF\n\nGGUF-quantized version of **facebook/nllb-200-distilled-600M** (No Language Left Behind) produced with [Unsloth](https://github.com/unslothai/unsloth) for efficient inference.\n\n## Model\n\n- **Base**: [facebook/nllb-200-distilled-600M](https://huggingface.co/facebook/nllb-200-distilled-600M)\n- **Format**: GGUF (e.g. `fast_quantized` ~4-bit)\n- **Use case**: Multilingual translation (200+ languages), including English ↔ Hausa (`eng_Latn` ↔ `hau_Latn`)\n\n## How it was created\n\n1. Loaded the seq2seq model with Unsloth using `AutoModelForSeq2SeqLM`.\n2. Saved a merged 16-bit HF-format checkpoint.\n3. Converted that checkpoint to GGUF with Unsloth’s `save_pretrained_gguf` (e.g. `fast_quantized`).\n4. Uploaded the GGUF file(s) to this repo.\n\n## How to use\n\n- **GGUF runtimes**: Use [llama.cpp](https://github.com/ggerganov/llama.cpp) or any GGUF-compatible runtime that supports this architecture. Download the `.gguf` file(s) from this repo and run inference there.\n- **Hugging Face Transformers**: For 16-bit inference, use the base model `facebook/nllb-200-distilled-600M` with the standard NLLB pipeline; for translation, set `src_lang` and `tgt_lang` (e.g. `eng_Latn` → `hau_Latn`).\n\n## License\n\nSame as the base model (see [facebook/nllb-200-distilled-600M](https://huggingface.co/facebook/nllb-200-distilled-600M)).\n",
"related_quantizations": []
},
"tags": [
"gguf",
"translation",
"nllb",
"unsloth",
"eng_Latn",
"hau_Latn",
"en",
"ha",
"multilingual",
"dataset:facebook/nllb",
"license:cc-by-nc-4.0",
"endpoints_compatible",
"region:us"
],
"likes": 0,
"downloads": 191,
"gated": false,
"private": false,
"last_modified": "2026-03-24T19:03:48.000Z",
"created_at": "2026-03-24T19:03:42.000Z",
"pipeline_tag": "translation",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "69c2e00e658e7710df0ebcb6",
"id": "aoiandroid/nllb-200-distilled-600M-unsloth-GGUF-mirror",
"modelId": "aoiandroid/nllb-200-distilled-600M-unsloth-GGUF-mirror",
"sha": "1eed8035ca49b373038348b6388ed27362738bb4",
"createdAt": "2026-03-24T19:03:42.000Z",
"lastModified": "2026-03-24T19:03:48.000Z",
"author": "aoiandroid",
"downloads": 191,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "translation",
"library_name": "",
"siblings_count": 19
}