mradermacher/cosmos-reason2-8b-i1-gguf overview

{
  "metadata": {},
  "card_data": {
    "base_model": "nvidia/Cosmos-Reason2-8B",
    "extra_gated_button_content": "Submit",
    "extra_gated_fields": {
      "By clicking Submit below, I accept the terms of the NVIDIA Open Model License Agreement and acknowledge that I am an adult of legal age of majority in the country in which the Cosmos Models will be used and have authority to accept this Agreement": "checkbox"
    },
    "extra_gated_prompt": "# NVIDIA Open Model License Agreement\nVersion Release Date: September 23, 2025\nThis NVIDIA Open Model License Agreement (the “Agreement”) is a legal agreement between the Legal Entity You represent, or if no  entity is identified, You and NVIDIA Corporation and its Affiliates (“NVIDIA”) and governs Your use of the Models that NVIDIA provides  to You under this Agreement. NVIDIA and You are each a “party” and collectively the “parties.”  \nNVIDIA models released under this Agreement are intended to be used permissively and enable the further development of AI  technologies. Subject to the terms of this Agreement, NVIDIA confirms that: \n- Models are commercially usable.  - You are free to create and distribute Derivative Models.  - NVIDIA does not claim ownership to any outputs generated using the Models or Model Derivatives. \nBy using, reproducing, modifying, distributing, performing or displaying any portion or element of the Model or Derivative Model, or  otherwise accepting the terms of this Agreement, you agree to be bound by this Agreement.  \n## 1. Definitions\n1.1. **Derivative Model** means all (a) modifications to the Model, (b) works based on the Model, and (c) any other derivative  works of the Model. An output is not a Derivative Model.  \n1.2. **Legal Entity** means the union of the acting entity and all other entities that control, are controlled by, or are under common  control with that entity. For the purposes of this definition, “control” means (a) the power, direct or indirect, to cause the  direction or management of such entity, whether by contract or otherwise, or (b) ownership of fifty percent (50%) or more  of the outstanding shares, or (c) beneficial ownership of such entity. \n1.3. **Model** means the machine learning model, software, checkpoints, learnt weights, algorithms, parameters, configuration  files and documentation shared under this Agreement. \n1.4. **NVIDIA Cosmos Model** means a multimodal Model shared under this Agreement.  \n1.5. **Special-Purpose Model** means a Model that is only competent in a narrow set of purpose-specific tasks and should not be  used for unintended or general-purpose applications. \n1.6. **You** or **Your** means an individual or Legal Entity exercising permissions granted by this Agreement. \n## 2. Conditions for Use, License Grant, AI Ethics and IP Ownership\n### 2.1. Conditions for Use - The Model and any Derivative Model are subject to additional terms as described in Section 2 and Section 3 of this Agreement.   - If You institute copyright or patent litigation against any entity alleging that the Model or a Derivative Model constitutes infringement, then any licenses granted will terminate as of the date such litigation is filed.   - If You bypass or disable any technical limitation, safety guardrail, encryption, DRM, or authentication mechanism contained in the Model without a substantially similar Guardrail, your rights will terminate.   - NVIDIA may designate a Model as a Special-Purpose Model.   - NVIDIA may update this Agreement to comply with legal and regulatory requirements.  \n### 2.2. License Grant NVIDIA grants You a perpetual, worldwide, non-exclusive, no-charge, royalty-free, revocable license to publicly perform, publicly display, reproduce, use, create derivative works of, make, have made, sell, offer for sale, distribute, and import the Model.  \n### 2.3. AI Ethics Use of the Models must be consistent with NVIDIA’s [Trustworthy AI terms](https://www.nvidia.com/en-us/agreements/trustworthy-ai/terms/).  \n### 2.4. IP Ownership - NVIDIA owns the Model and any Model Derivatives it creates.   - You own your Model Derivatives.   - NVIDIA claims no ownership rights in outputs.   - Except as expressly granted, NVIDIA reserves all rights.  \n## 3. Redistribution\nYou may reproduce and distribute copies of the Model or Derivative Models in any medium, with or without modifications, provided that:  \n- **3.1.** You must provide recipients with a copy of this Agreement and include this attribution in a “Notice” text file:  \n  *“Licensed by NVIDIA Corporation under the NVIDIA Open Model License”*  \n\n- **3.2.** If distributing or making available a NVIDIA Cosmos Model, or products/services derived from it, you must include:  \n  *“Built on NVIDIA Cosmos”*  \n\n- **3.3.** You may add your own copyright statements and license terms for your modifications, provided use still complies with this Agreement.  \n## 4. Separate Components The Models may include components licensed under separate legal notices (e.g., Open Source Software Licenses). These terms apply, except where overridden by this Agreement unless required by third-party license terms.  \n## 5. Trademarks No permission is granted to use NVIDIA’s trade names, trademarks, or product names, except for reasonable descriptive use.  \n## 6. Disclaimer of Warranty The Model is provided **“AS IS”**, without warranties of any kind, including title, non-infringement, merchantability, or fitness for purpose. You assume risks associated with its use.  \n## 7. Limitation of Liability NVIDIA is not liable for damages (direct, indirect, incidental, or consequential) arising from use of the Model, unless required by law.  \n## 8. Indemnity You will indemnify and hold NVIDIA harmless against claims from third parties arising from your use or distribution of the Model, derivatives, or outputs.  \n## 9. Feedback NVIDIA may use any feedback you provide without restriction or compensation.  \n## 10. Governing Law This Agreement is governed by U.S. and Delaware law. Courts in Santa Clara County, California, have exclusive jurisdiction, except for urgent injunctive relief.  \n## 11. Trade and Compliance You must comply with all export, import, trade, and sanctions laws, including U.S. Export Administration Regulations and OFAC rules.",
    "language": [
      "en"
    ],
    "library_name": "transformers",
    "license": "other",
    "license_link": "https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license",
    "license_name": "nvidia-open-model-license",
    "mradermacher": {
      "readme_rev": 1
    },
    "quantized_by": "mradermacher",
    "tags": [
      "nvidia",
      "cosmos",
      "conversational"
    ],
    "frontmatter": {
      "base_model": "nvidia/Cosmos-Reason2-8B",
      "extra_gated_button_content": "Submit",
      "extra_gated_fields": [],
      "extra_gated_prompt": [
        "The Model and any Derivative Model are subject to additional terms as described"
      ],
      "language": [
        "en"
      ],
      "library_name": "transformers",
      "license": "other",
      "license_link": "https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license",
      "license_name": "nvidia-open-model-license",
      "mradermacher": [],
      "quantized_by": "mradermacher",
      "tags": [
        "nvidia",
        "cosmos",
        "conversational"
      ]
    },
    "hero_image_url": "https://www.nethype.de/huggingface_embed/quantpplgraph.png",
    "summary": "## About         weighted/imatrix quants of https://huggingface.co/nvidia/Cosmos-Reason2-8B  ***For a convenient overview and download list, visit our model page for this model.*** static quants are available at https://huggingface.co/mradermacher/Cosmos-Reason2-8B-GGUF **This is a vision model - mmproj files (if any) will be in the static repository.**",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: nvidia/Cosmos-Reason2-8B\nextra_gated_button_content: Submit\nextra_gated_fields:\n  ? By clicking Submit below, I accept the terms of the NVIDIA Open Model License\n    Agreement and acknowledge that I am an adult of legal age of majority in the country\n    in which the Cosmos Models will be used and have authority to accept this Agreement\n  : checkbox\nextra_gated_prompt: \"# NVIDIA Open Model License Agreement\\nVersion Release Date:\n  September 23, 2025\\nThis NVIDIA Open Model License Agreement (the “Agreement”) is\n  a legal agreement between the Legal Entity You represent, or if no  entity is identified,\n  You and NVIDIA Corporation and its Affiliates (“NVIDIA”) and governs Your use of\n  the Models that NVIDIA provides  to You under this Agreement. NVIDIA and You are\n  each a “party” and collectively the “parties.”  \\nNVIDIA models released under this\n  Agreement are intended to be used permissively and enable the further development\n  of AI  technologies. Subject to the terms of this Agreement, NVIDIA confirms that:\n  \\n- Models are commercially usable.  - You are free to create and distribute Derivative\n  Models.  - NVIDIA does not claim ownership to any outputs generated using the Models\n  or Model Derivatives. \\nBy using, reproducing, modifying, distributing, performing\n  or displaying any portion or element of the Model or Derivative Model, or  otherwise\n  accepting the terms of this Agreement, you agree to be bound by this Agreement.\n  \\ \\n## 1. Definitions\\n1.1. **Derivative Model** means all (a) modifications to\n  the Model, (b) works based on the Model, and (c) any other derivative  works of\n  the Model. An output is not a Derivative Model.  \\n1.2. **Legal Entity** means the\n  union of the acting entity and all other entities that control, are controlled by,\n  or are under common  control with that entity. For the purposes of this definition,\n  “control” means (a) the power, direct or indirect, to cause the  direction or management\n  of such entity, whether by contract or otherwise, or (b) ownership of fifty percent\n  (50%) or more  of the outstanding shares, or (c) beneficial ownership of such entity.\n  \\n1.3. **Model** means the machine learning model, software, checkpoints, learnt\n  weights, algorithms, parameters, configuration  files and documentation shared under\n  this Agreement. \\n1.4. **NVIDIA Cosmos Model** means a multimodal Model shared under\n  this Agreement.  \\n1.5. **Special-Purpose Model** means a Model that is only competent\n  in a narrow set of purpose-specific tasks and should not be  used for unintended\n  or general-purpose applications. \\n1.6. **You** or **Your** means an individual\n  or Legal Entity exercising permissions granted by this Agreement. \\n## 2. Conditions\n  for Use, License Grant, AI Ethics and IP Ownership\\n### 2.1. Conditions for Use\n  - The Model and any Derivative Model are subject to additional terms as described\n  in Section 2 and Section 3 of this Agreement.   - If You institute copyright or\n  patent litigation against any entity alleging that the Model or a Derivative Model\n  constitutes infringement, then any licenses granted will terminate as of the date\n  such litigation is filed.   - If You bypass or disable any technical limitation,\n  safety guardrail, encryption, DRM, or authentication mechanism contained in the\n  Model without a substantially similar Guardrail, your rights will terminate.   -\n  NVIDIA may designate a Model as a Special-Purpose Model.   - NVIDIA may update this\n  Agreement to comply with legal and regulatory requirements.  \\n### 2.2. License\n  Grant NVIDIA grants You a perpetual, worldwide, non-exclusive, no-charge, royalty-free,\n  revocable license to publicly perform, publicly display, reproduce, use, create\n  derivative works of, make, have made, sell, offer for sale, distribute, and import\n  the Model.  \\n### 2.3. AI Ethics Use of the Models must be consistent with NVIDIA’s\n  [Trustworthy AI terms](https://www.nvidia.com/en-us/agreements/trustworthy-ai/terms/).\n  \\ \\n### 2.4. IP Ownership - NVIDIA owns the Model and any Model Derivatives it creates.\n  \\  - You own your Model Derivatives.   - NVIDIA claims no ownership rights in outputs.\n  \\  - Except as expressly granted, NVIDIA reserves all rights.  \\n## 3. Redistribution\\nYou\n  may reproduce and distribute copies of the Model or Derivative Models in any medium,\n  with or without modifications, provided that:  \\n- **3.1.** You must provide recipients\n  with a copy of this Agreement and include this attribution in a “Notice” text file:\n  \\ \\n  *“Licensed by NVIDIA Corporation under the NVIDIA Open Model License”*  \\n\\n-\n  **3.2.** If distributing or making available a NVIDIA Cosmos Model, or products/services\n  derived from it, you must include:  \\n  *“Built on NVIDIA Cosmos”*  \\n\\n- **3.3.**\n  You may add your own copyright statements and license terms for your modifications,\n  provided use still complies with this Agreement.  \\n## 4. Separate Components The\n  Models may include components licensed under separate legal notices (e.g., Open\n  Source Software Licenses). These terms apply, except where overridden by this Agreement\n  unless required by third-party license terms.  \\n## 5. Trademarks No permission\n  is granted to use NVIDIA’s trade names, trademarks, or product names, except for\n  reasonable descriptive use.  \\n## 6. Disclaimer of Warranty The Model is provided\n  **“AS IS”**, without warranties of any kind, including title, non-infringement,\n  merchantability, or fitness for purpose. You assume risks associated with its use.\n  \\ \\n## 7. Limitation of Liability NVIDIA is not liable for damages (direct, indirect,\n  incidental, or consequential) arising from use of the Model, unless required by\n  law.  \\n## 8. Indemnity You will indemnify and hold NVIDIA harmless against claims\n  from third parties arising from your use or distribution of the Model, derivatives,\n  or outputs.  \\n## 9. Feedback NVIDIA may use any feedback you provide without restriction\n  or compensation.  \\n## 10. Governing Law This Agreement is governed by U.S. and\n  Delaware law. Courts in Santa Clara County, California, have exclusive jurisdiction,\n  except for urgent injunctive relief.  \\n## 11. Trade and Compliance You must comply\n  with all export, import, trade, and sanctions laws, including U.S. Export Administration\n  Regulations and OFAC rules.\"\nlanguage:\n- en\nlibrary_name: transformers\nlicense: other\nlicense_link: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license\nlicense_name: nvidia-open-model-license\nmradermacher:\n  readme_rev: 1\nquantized_by: mradermacher\ntags:\n- nvidia\n- cosmos\n- conversational\n---\n## About\n\n<!-- ### quantize_version: 2 -->\n<!-- ### output_tensor_quantised: 1 -->\n<!-- ### convert_type: hf -->\n<!-- ### vocab_type:  -->\n<!-- ### tags: nicoboss -->\n<!-- ### quants:  Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->\n<!-- ### quants_skip:  -->\n<!-- ### skip_mmproj:  -->\nweighted/imatrix quants of https://huggingface.co/nvidia/Cosmos-Reason2-8B\n\n<!-- provided-files -->\n\n***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Cosmos-Reason2-8B-i1-GGUF).***\n\nstatic quants are available at https://huggingface.co/mradermacher/Cosmos-Reason2-8B-GGUF\n\n**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-GGUF).**\n## Usage\n\nIf you are unsure how to use GGUF files, refer to one of [TheBloke's\nREADMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for\nmore details, including on how to concatenate multi-part files.\n\n## Provided Quants\n\n(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)\n\n| Link | Type | Size/GB | Notes |\n|:-----|:-----|--------:|:------|\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 |  |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 |  |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 |  |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 |  |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 |  |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 |  |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 |  |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q4_1.gguf) | i1-Q4_1 | 5.3 |  |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 |  |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 |  |\n| [GGUF](https://huggingface.co/mradermacher/Cosmos-Reason2-8B-i1-GGUF/resolve/main/Cosmos-Reason2-8B.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K |\n\nHere is a handy graph by ikawrakow comparing some lower-quality quant\ntypes (lower is better):\n\n![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)\n\nAnd here are Artefact2's thoughts on the matter:\nhttps://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9\n\n## FAQ / Model Request\n\nSee https://huggingface.co/mradermacher/model_requests for some answers to\nquestions you might have and/or if you want some other model quantized.\n\n## Thanks\n\nI thank my company, [nethype GmbH](https://www.nethype.de/), for letting\nme use its servers and providing upgrades to my workstation to enable\nthis work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.\n\n<!-- end -->\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "nvidia",
    "cosmos",
    "conversational",
    "en",
    "base_model:nvidia/Cosmos-Reason2-8B",
    "base_model:quantized:nvidia/Cosmos-Reason2-8B",
    "license:other",
    "endpoints_compatible",
    "region:us",
    "imatrix"
  ],
  "likes": 2,
  "downloads": 226,
  "gated": false,
  "private": false,
  "last_modified": "2026-02-22T06:51:31.000Z",
  "created_at": "2026-02-22T06:17:25.000Z",
  "pipeline_tag": "",
  "library_name": "transformers"
}

{
  "_id": "699a9f75f652864af0277374",
  "id": "mradermacher/Cosmos-Reason2-8B-i1-GGUF",
  "modelId": "mradermacher/Cosmos-Reason2-8B-i1-GGUF",
  "sha": "232e670867927ffb5f301ef7dc526f0eeb2c4754",
  "createdAt": "2026-02-22T06:17:25.000Z",
  "lastModified": "2026-02-22T06:51:31.000Z",
  "author": "mradermacher",
  "downloads": 226,
  "likes": 2,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "transformers",
  "siblings_count": 27
}