aaryank/solar-open-100b-gguf overview

{
  "metadata": {},
  "card_data": {
    "base_model": "upstage/Solar-Open-100B",
    "base_model_relation": "quantized",
    "language": [
      "en",
      "ko"
    ],
    "library_name": "gguf",
    "license": "other",
    "license_name": "solar-apache-2.0",
    "license_link": "https://huggingface.co/upstage/Solar-Open-100B/blob/main/LICENSE",
    "pipeline_tag": "text-generation",
    "tags": [
      "text-generation-inference",
      "upstage",
      "solar",
      "moe",
      "100b",
      "gguf"
    ],
    "frontmatter": {
      "base_model": "upstage/Solar-Open-100B",
      "base_model_relation": "quantized",
      "language": [
        "en",
        "ko"
      ],
      "library_name": "gguf",
      "license": "other",
      "license_name": "solar-apache-2.0",
      "license_link": "https://huggingface.co/upstage/Solar-Open-100B/blob/main/LICENSE",
      "pipeline_tag": "text-generation",
      "tags": [
        "text-generation-inference",
        "upstage",
        "solar",
        "moe",
        "100b",
        "gguf"
      ]
    },
    "hero_image_url": "https://huggingface.co/upstage/Solar-Open-100B/resolve/main/Solar-Open-100B.png",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: upstage/Solar-Open-100B\nbase_model_relation: quantized\nlanguage:\n  - en\n  - ko\nlibrary_name: gguf\nlicense: other\nlicense_name: solar-apache-2.0\nlicense_link: https://huggingface.co/upstage/Solar-Open-100B/blob/main/LICENSE\npipeline_tag: text-generation\ntags:\n  - text-generation-inference\n  - upstage\n  - solar\n  - moe\n  - 100b\n  - gguf\n---\n\n# Solar-Open-100B-GGUF\n\n<p align=\"center\">\n  <img src=\"https://huggingface.co/upstage/Solar-Open-100B/resolve/main/Solar-Open-100B.png\" alt=\"Solar Open Model\" width=\"100%\">\n</p>\n\n## Description\n\nThis repository contains **GGUF** format model files for [Upstage's Solar-Open-100B](https://huggingface.co/upstage/Solar-Open-100B).\n\n**Solar Open** is a massive **102B-parameter** Mixture-of-Experts (MoE) model trained from scratch on **19.7 trillion tokens**. Despite its large total size, it uses only **12B active parameters** during inference, offering a unique combination of massive knowledge capacity and efficient generation speed.\n\n\n\n*Note: Please check the specific file sizes in the \"Files and versions\" tab.*\n\n## How to Run (llama.cpp)\n\n**Recommended Parameters:**\nUpstage recommends the following sampling parameters for Solar Open:\n*   **Temperature:** `0.8`\n*   **Top-P:** `0.95`\n*   **Top-K:** `50`\n\n### CLI Example\n\n```bash\n./llama-cli -m Solar-Open-100B.Q4_K_M.gguf \\\n  -c 8192 \\\n  --temp 0.8 \\\n  --top-p 0.95 \\\n  --top-k 50 \\\n  -p \"User: Who are you?\\nAssistant:\" \\\n  -cnv\n```\n\n### Server Example\n\n```bash\n./llama-server -m Solar-Open-100B.Q4_K_M.gguf \\\n  --port 8080 \\\n  --host 0.0.0.0 \\\n  -c 8192 \\\n  -ngl 99\n```\n\n## License\n\nThe model weights are licensed under the **Solar-Apache License 2.0**.\nPlease review the full license terms here: [LICENSE](https://huggingface.co/upstage/Solar-Open-100B/blob/main/LICENSE)\n\n## Citation\n\nIf you use Solar Open in your research, please cite:\n\n```bibtex\n@misc{solar-open-2025,\n    title={Solar Open: Scaling Upstage's LLM Capabilities with MoE},\n    author={Upstage AI},\n    year={2025},\n    url={https://huggingface.co/Upstage/Solar-Open-100B}\n}\n```",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "text-generation-inference",
    "upstage",
    "solar",
    "moe",
    "100b",
    "text-generation",
    "en",
    "ko",
    "base_model:upstage/Solar-Open-100B",
    "base_model:quantized:upstage/Solar-Open-100B",
    "license:other",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 15,
  "downloads": 284,
  "gated": false,
  "private": false,
  "last_modified": "2026-01-01T23:00:54.000Z",
  "created_at": "2026-01-01T18:37:08.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "gguf"
}

{
  "_id": "6956bed4df172c4fd94049e0",
  "id": "AaryanK/Solar-Open-100B-GGUF",
  "modelId": "AaryanK/Solar-Open-100B-GGUF",
  "sha": "cfe3fc26a5bfa6401071c97126130bfd25d5ace5",
  "createdAt": "2026-01-01T18:37:08.000Z",
  "lastModified": "2026-01-01T23:00:54.000Z",
  "author": "AaryanK",
  "downloads": 284,
  "likes": 15,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "gguf",
  "siblings_count": 16
}