allenai/olmoe-1b-7b-0924-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
allenai/olmoe-1b-7b-0924-gguf overview
GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0924
Downloads
230
Likes
10
Pipeline
—
Library
gguf
Visibility
Public
Access
Open
Repository Files & Downloads
13 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| olmoe-1b-7b-0924-f16.gguf | GGUF | F16 | 12.89 GB | Download |
| olmoe-1b-7b-0924-q2_k.gguf | GGUF | Q2_K | 2.39 GB | Download |
| olmoe-1b-7b-0924-q3_k_l.gguf | GGUF | Q3_K_L | 3.36 GB | Download |
| olmoe-1b-7b-0924-q3_k_m.gguf | GGUF | Q3_K_M | 3.11 GB | Download |
| olmoe-1b-7b-0924-q3_k_s.gguf | GGUF | Q3_K_S | 2.82 GB | Download |
| olmoe-1b-7b-0924-q4_0.gguf | GGUF | — | 3.66 GB | Download |
| olmoe-1b-7b-0924-q4_k_m.gguf | GGUF | Q4_K_M | 3.92 GB | Download |
| olmoe-1b-7b-0924-q4_k_s.gguf | GGUF | Q4_K_S | 3.69 GB | Download |
| olmoe-1b-7b-0924-q5_0.gguf | GGUF | — | 4.45 GB | Download |
| olmoe-1b-7b-0924-q5_k_m.gguf | GGUF | Q5_K_M | 4.59 GB | Download |
| olmoe-1b-7b-0924-q5_k_s.gguf | GGUF | Q5_K_S | 4.45 GB | Download |
| olmoe-1b-7b-0924-q6_k.gguf | GGUF | Q6_K | 5.29 GB | Download |
| olmoe-1b-7b-0924-q8_0.gguf | GGUF | — | 6.85 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"language": [
"en"
],
"tags": [
"moe",
"olmo",
"olmoe"
],
"co2_eq_emissions": 1,
"datasets": [
"allenai/OLMoE-mix-0924"
],
"base_model": "allenai/OLMoE-1B-7B-0924",
"library_name": "gguf",
"frontmatter": {
"license": "apache-2.0",
"language": [
"en"
],
"tags": [
"moe",
"olmo",
"olmoe"
],
"co2_eq_emissions": "1",
"datasets": [
"allenai/OLMoE-mix-0924"
],
"base_model": "allenai/OLMoE-1B-7B-0924",
"library_name": "gguf"
},
"hero_image_url": "",
"summary": "GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0924 ``bibtex @misc{muennighoff2024olmoeopenmixtureofexpertslanguage, title={OLMoE: Open Mixture-of-Experts Language Models}, author={Niklas Muennighoff and Luca Soldaini and Dirk Groeneveld and Kyle Lo and Jacob Morrison and Sewon Min and Weijia Shi and Pete Walsh and Oyvind Tafjord and Nathan Lambert and Yuling Gu and Shane Arora and Akshita Bhagia and Dustin Schwenk and David Wadden and Alexander Wettig and Binyuan Hui and Tim Dettmers and Douwe Kiela and Ali Farhadi and Noah A. Smith and Pang Wei Koh and Amanpreet Singh and Hannaneh Hajishirzi}, year={2024}, eprint={2409.02060}, archivePrefix={arXiv}, primaryClass={cs.CL}, url={https://arxiv.org/abs/2409.02060}, } ``",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\nlanguage:\n- en\ntags:\n- moe\n- olmo\n- olmoe\nco2_eq_emissions: 1\ndatasets:\n- allenai/OLMoE-mix-0924\nbase_model: allenai/OLMoE-1B-7B-0924\nlibrary_name: gguf\n---\n\nGGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0924\n\n```bibtex\n@misc{muennighoff2024olmoeopenmixtureofexpertslanguage,\n title={OLMoE: Open Mixture-of-Experts Language Models}, \n author={Niklas Muennighoff and Luca Soldaini and Dirk Groeneveld and Kyle Lo and Jacob Morrison and Sewon Min and Weijia Shi and Pete Walsh and Oyvind Tafjord and Nathan Lambert and Yuling Gu and Shane Arora and Akshita Bhagia and Dustin Schwenk and David Wadden and Alexander Wettig and Binyuan Hui and Tim Dettmers and Douwe Kiela and Ali Farhadi and Noah A. Smith and Pang Wei Koh and Amanpreet Singh and Hannaneh Hajishirzi},\n year={2024},\n eprint={2409.02060},\n archivePrefix={arXiv},\n primaryClass={cs.CL},\n url={https://arxiv.org/abs/2409.02060}, \n}\n```\n\n",
"related_quantizations": []
},
"tags": [
"gguf",
"moe",
"olmo",
"olmoe",
"en",
"dataset:allenai/OLMoE-mix-0924",
"arxiv:2409.02060",
"base_model:allenai/OLMoE-1B-7B-0924",
"base_model:quantized:allenai/OLMoE-1B-7B-0924",
"license:apache-2.0",
"co2_eq_emissions",
"endpoints_compatible",
"region:us"
],
"likes": 10,
"downloads": 230,
"gated": false,
"private": false,
"last_modified": "2024-09-14T20:24:33.000Z",
"created_at": "2024-09-13T14:42:57.000Z",
"pipeline_tag": "",
"library_name": "gguf"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "66e44f71b8ea714541030094",
"id": "allenai/OLMoE-1B-7B-0924-GGUF",
"modelId": "allenai/OLMoE-1B-7B-0924-GGUF",
"sha": "70df85ed7132bf21b5acbcb33817f58e7d3cb949",
"createdAt": "2024-09-13T14:42:57.000Z",
"lastModified": "2024-09-14T20:24:33.000Z",
"author": "allenai",
"downloads": 230,
"likes": 10,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "gguf",
"siblings_count": 15
}