GraySoft
Projects Models About FAQ Contact Download guIDE →

allenai/olmoe-1b-7b-0924-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

allenai/olmoe-1b-7b-0924-gguf overview

GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0924

ggufmoeolmoolmoeendataset:allenai/OLMoE-mix-0924arxiv:2409.02060base_model:allenai/OLMoE-1B-7B-0924base_model:quantized:allenai/OLMoE-1B-7B-0924license:apache-2.0co2_eq_emissionsendpoints_compatibleregion:us
allenai/olmoe-1b-7b-0924-gguf visual
Downloads
230
Likes
10
Pipeline
Library
gguf
Visibility
Public
Access
Open

Repository Files & Downloads

13 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
olmoe-1b-7b-0924-f16.gguf GGUF F16 12.89 GB Download
olmoe-1b-7b-0924-q2_k.gguf GGUF Q2_K 2.39 GB Download
olmoe-1b-7b-0924-q3_k_l.gguf GGUF Q3_K_L 3.36 GB Download
olmoe-1b-7b-0924-q3_k_m.gguf GGUF Q3_K_M 3.11 GB Download
olmoe-1b-7b-0924-q3_k_s.gguf GGUF Q3_K_S 2.82 GB Download
olmoe-1b-7b-0924-q4_0.gguf GGUF 3.66 GB Download
olmoe-1b-7b-0924-q4_k_m.gguf GGUF Q4_K_M 3.92 GB Download
olmoe-1b-7b-0924-q4_k_s.gguf GGUF Q4_K_S 3.69 GB Download
olmoe-1b-7b-0924-q5_0.gguf GGUF 4.45 GB Download
olmoe-1b-7b-0924-q5_k_m.gguf GGUF Q5_K_M 4.59 GB Download
olmoe-1b-7b-0924-q5_k_s.gguf GGUF Q5_K_S 4.45 GB Download
olmoe-1b-7b-0924-q6_k.gguf GGUF Q6_K 5.29 GB Download
olmoe-1b-7b-0924-q8_0.gguf GGUF 6.85 GB Download

Model Details Live

Model Slug
allenai/olmoe-1b-7b-0924-gguf
Author
allenai
Pipeline Task
Library
gguf
Created
2024-09-13
Last Modified
2024-09-14
Gated
No
Private
No
HF SHA
70df85ed7132bf21b5acbcb33817f58e7d3cb949
License
apache-2.0
Language
en
Base Model
allenai/OLMoE-1B-7B-0924

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "apache-2.0",
    "language": [
      "en"
    ],
    "tags": [
      "moe",
      "olmo",
      "olmoe"
    ],
    "co2_eq_emissions": 1,
    "datasets": [
      "allenai/OLMoE-mix-0924"
    ],
    "base_model": "allenai/OLMoE-1B-7B-0924",
    "library_name": "gguf",
    "frontmatter": {
      "license": "apache-2.0",
      "language": [
        "en"
      ],
      "tags": [
        "moe",
        "olmo",
        "olmoe"
      ],
      "co2_eq_emissions": "1",
      "datasets": [
        "allenai/OLMoE-mix-0924"
      ],
      "base_model": "allenai/OLMoE-1B-7B-0924",
      "library_name": "gguf"
    },
    "hero_image_url": "",
    "summary": "GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0924 ``bibtex @misc{muennighoff2024olmoeopenmixtureofexpertslanguage, title={OLMoE: Open Mixture-of-Experts Language Models}, author={Niklas Muennighoff and Luca Soldaini and Dirk Groeneveld and Kyle Lo and Jacob Morrison and Sewon Min and Weijia Shi and Pete Walsh and Oyvind Tafjord and Nathan Lambert and Yuling Gu and Shane Arora and Akshita Bhagia and Dustin Schwenk and David Wadden and Alexander Wettig and Binyuan Hui and Tim Dettmers and Douwe Kiela and Ali Farhadi and Noah A. Smith and Pang Wei Koh and Amanpreet Singh and Hannaneh Hajishirzi}, year={2024}, eprint={2409.02060}, archivePrefix={arXiv}, primaryClass={cs.CL}, url={https://arxiv.org/abs/2409.02060}, } ``",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: apache-2.0\nlanguage:\n- en\ntags:\n- moe\n- olmo\n- olmoe\nco2_eq_emissions: 1\ndatasets:\n- allenai/OLMoE-mix-0924\nbase_model: allenai/OLMoE-1B-7B-0924\nlibrary_name: gguf\n---\n\nGGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0924\n\n```bibtex\n@misc{muennighoff2024olmoeopenmixtureofexpertslanguage,\n      title={OLMoE: Open Mixture-of-Experts Language Models}, \n      author={Niklas Muennighoff and Luca Soldaini and Dirk Groeneveld and Kyle Lo and Jacob Morrison and Sewon Min and Weijia Shi and Pete Walsh and Oyvind Tafjord and Nathan Lambert and Yuling Gu and Shane Arora and Akshita Bhagia and Dustin Schwenk and David Wadden and Alexander Wettig and Binyuan Hui and Tim Dettmers and Douwe Kiela and Ali Farhadi and Noah A. Smith and Pang Wei Koh and Amanpreet Singh and Hannaneh Hajishirzi},\n      year={2024},\n      eprint={2409.02060},\n      archivePrefix={arXiv},\n      primaryClass={cs.CL},\n      url={https://arxiv.org/abs/2409.02060}, \n}\n```\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "moe",
    "olmo",
    "olmoe",
    "en",
    "dataset:allenai/OLMoE-mix-0924",
    "arxiv:2409.02060",
    "base_model:allenai/OLMoE-1B-7B-0924",
    "base_model:quantized:allenai/OLMoE-1B-7B-0924",
    "license:apache-2.0",
    "co2_eq_emissions",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 10,
  "downloads": 230,
  "gated": false,
  "private": false,
  "last_modified": "2024-09-14T20:24:33.000Z",
  "created_at": "2024-09-13T14:42:57.000Z",
  "pipeline_tag": "",
  "library_name": "gguf"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "66e44f71b8ea714541030094",
  "id": "allenai/OLMoE-1B-7B-0924-GGUF",
  "modelId": "allenai/OLMoE-1B-7B-0924-GGUF",
  "sha": "70df85ed7132bf21b5acbcb33817f58e7d3cb949",
  "createdAt": "2024-09-13T14:42:57.000Z",
  "lastModified": "2024-09-14T20:24:33.000Z",
  "author": "allenai",
  "downloads": 230,
  "likes": 10,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "gguf",
  "siblings_count": 15
}