llmware/gemma-2-9b-instruct-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "gemma",
    "inference": false,
    "base_model": "google/gemma-2-9b-it",
    "base_model_relation": "quantized",
    "tags": [
      "green",
      "p9",
      "llmware-chat",
      "gguf",
      "emerald"
    ],
    "frontmatter": {
      "license": "gemma",
      "inference": "false",
      "base_model": "google/gemma-2-9b-it",
      "base_model_relation": "quantized",
      "tags": [
        "green",
        "p9",
        "llmware-chat",
        "gguf",
        "emerald"
      ]
    },
    "hero_image_url": "",
    "summary": "**gemma-2-9b-gguf** is a GGUF Q4_K_M int4 quantized version of Google's Gemma-2-9B with Instruct Training (IT), providing a very fast, very small inference implementation, optimized for AI PCs. **gemma-2-9b-gguf** is a leading open source foundation model from Google. ### Model Description",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: gemma\ninference: false\nbase_model: google/gemma-2-9b-it\nbase_model_relation: quantized \ntags:\n- green\n- p9\n- llmware-chat\n- gguf\n- emerald\n---\n\n# gemma-2-9b-gguf\n\n**gemma-2-9b-gguf** is a GGUF Q4_K_M int4 quantized version of Google's Gemma-2-9B with Instruct Training (IT), providing a very fast, very small inference implementation, optimized for AI PCs.    \n\n[**gemma-2-9b-gguf**](https://huggingface.co/google/gemma-2-9b-it) is a leading open source foundation model from Google.  \n\n\n### Model Description\n\n- **Developed by:** Google\n- **Model type:** gemma-2-9b  \n- **Parameters:** 9 billion\n- **Model Parent:** google/gemma-2-9b-it  \n- **Language(s) (NLP):** English  \n- **License:** Apache 2.0  \n- **Uses:** General purpose chat \n- **RAG Benchmark Accuracy Score:** NA  \n- **Quantization:** int4  \n  \n\n## Model Card Contact\n\n[llmware on github](https://www.github.com/llmware-ai/llmware)  \n\n[llmware on hf](https://www.huggingface.co/llmware)  \n\n[llmware website](https://www.llmware.ai)",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "gemma2",
    "green",
    "p9",
    "llmware-chat",
    "emerald",
    "base_model:google/gemma-2-9b-it",
    "base_model:quantized:google/gemma-2-9b-it",
    "license:gemma",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 1,
  "downloads": 174,
  "gated": false,
  "private": false,
  "last_modified": "2025-02-14T08:05:19.000Z",
  "created_at": "2025-02-09T18:22:32.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "67a8f268340cb7e3489a25c9",
  "id": "llmware/gemma-2-9b-instruct-gguf",
  "modelId": "llmware/gemma-2-9b-instruct-gguf",
  "sha": "9c165cca28a317f174aa789e24a8b8a6849391cf",
  "createdAt": "2025-02-09T18:22:32.000Z",
  "lastModified": "2025-02-14T08:05:19.000Z",
  "author": "llmware",
  "downloads": 174,
  "likes": 1,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 5
}