devquasar/nvidia.llama-3_1-nemotron-ultra-253b-v1-gguf overview

{
  "metadata": {},
  "card_data": {
    "base_model": [
      "nvidia/Llama-3_1-Nemotron-Ultra-253B-v1"
    ],
    "pipeline_tag": "text-generation",
    "frontmatter": {
      "base_model": [
        "nvidia/Llama-3_1-Nemotron-Ultra-253B-v1"
      ],
      "pipeline_tag": "text-generation"
    },
    "hero_image_url": "https://raw.githubusercontent.com/csabakecskemeti/devquasar/main/dq_logo_black-transparent.png",
    "summary": "Big thanks to ymcki for updating the llama.cpp code to support the 'dummy' layers. Use the llama.cpp branch from this PR: https://github.com/ggml-org/llama.cpp/pull/12843 if it hasn't been merged yet. Note the imatrix data used for the IQ quants has been produced from the Q4 quant! !image/png  'Make knowledge free for everyone' Quantized version of: nvidia/Llama-3_1-Nemotron-Ultra-253B-v1",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model:\n- nvidia/Llama-3_1-Nemotron-Ultra-253B-v1\npipeline_tag: text-generation\n---\n\nBig thanks to ymcki for updating the llama.cpp code to support the 'dummy' layers.\nUse the llama.cpp branch from this PR: https://github.com/ggml-org/llama.cpp/pull/12843 if it hasn't been merged yet.\n\nNote the imatrix data used for the IQ quants has been produced from the Q4 quant!\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e6d37e02dee9bcb9d9fa18/g07b9e-9UmPrfsvFBi-So.png)\n\n[<img src=\"https://raw.githubusercontent.com/csabakecskemeti/devquasar/main/dq_logo_black-transparent.png\" width=\"200\"/>](https://devquasar.com)\n\n'Make knowledge free for everyone'\n\nQuantized version of: [nvidia/Llama-3_1-Nemotron-Ultra-253B-v1](https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1)\n<a href='https://ko-fi.com/L4L416YX7C' target='_blank'><img height='36' style='border:0px;height:36px;' src='https://storage.ko-fi.com/cdn/kofi6.png?v=6' border='0' alt='Buy Me a Coffee at ko-fi.com' /></a>\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "text-generation",
    "base_model:nvidia/Llama-3_1-Nemotron-Ultra-253B-v1",
    "base_model:quantized:nvidia/Llama-3_1-Nemotron-Ultra-253B-v1",
    "endpoints_compatible",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 7,
  "downloads": 1006,
  "gated": false,
  "private": false,
  "last_modified": "2025-04-16T07:05:08.000Z",
  "created_at": "2025-04-08T03:39:20.000Z",
  "pipeline_tag": "text-generation",
  "library_name": ""
}

{
  "_id": "67f49a682389cdb04cb4dc1d",
  "id": "DevQuasar/nvidia.Llama-3_1-Nemotron-Ultra-253B-v1-GGUF",
  "modelId": "DevQuasar/nvidia.Llama-3_1-Nemotron-Ultra-253B-v1-GGUF",
  "sha": "fa034db97ae9c144e5d5a8fd8fc4fefdd363b8db",
  "createdAt": "2025-04-08T03:39:20.000Z",
  "lastModified": "2025-04-16T07:05:08.000Z",
  "author": "DevQuasar",
  "downloads": 1006,
  "likes": 7,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "",
  "siblings_count": 63
}