sayhan/mistral-7b-instruct-v0.2-turkish-gguf overview

{
  "metadata": {},
  "card_data": {
    "base_model": "malhajar/Mistral-7B-Instruct-v0.2-turkish",
    "language": [
      "tr",
      "en"
    ],
    "pipeline_tag": "text-generation",
    "license": "apache-2.0",
    "model_type": "mistral",
    "library_name": "transformers",
    "inference": false,
    "frontmatter": {
      "base_model": "malhajar/Mistral-7B-Instruct-v0.2-turkish",
      "language": [
        "tr",
        "en"
      ],
      "pipeline_tag": "text-generation",
      "license": "apache-2.0",
      "model_type": "mistral",
      "library_name": "transformers",
      "inference": "false"
    },
    "hero_image_url": "",
    "summary": "| quantization method | bits | size     | use case                                            | recommended | |---------------------|------|----------|-----------------------------------------------------|-------------| | Q2_K                | 2    | 2.72 GB  | smallest, significant quality loss  | ❌         | | Q3_K_S              | 3    | 3.16 GB  | very small, high quality loss                       | ❌         | | Q3_K_M              | 3    | 3.52 GB  | very small, high quality loss                       | ❌         | | Q3_K_L              | 3    | 3.82 GB  | small, substantial quality loss                     | ❌         | | Q4_0                | 4    | 4.11 GB  | legacy; small, very high quality loss  | ❌         | | Q4_K_S              | 4    | 4.14 GB  | small, greater quality loss                         | ❌         | | Q4_K_M              | 4    | 4.37 GB  | medium, balanced quality               | ✅         | | Q5_0                | 5    | 5.00 GB  | legacy; medium, balanced quality  | ❌         | | Q5_K_S              | 5    | 5.00 GB  | large, low quality loss                | ✅         | | Q5_K_M              | 5    | 5.13 GB  | large, very low quality loss           | ✅         | | Q6_K                | 6    | 5.94 GB  | very large, extremely low quality loss              | ❌         | | Q8_0                | 8    | 7.70 GB  | very large, extremely low quality loss   | ❌         | | FP16                | 16   | 14.5 GB  | enormous, minuscule quality loss  | ❌  |",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: malhajar/Mistral-7B-Instruct-v0.2-turkish\nlanguage:\n- tr\n- en\npipeline_tag: text-generation\nlicense: apache-2.0\nmodel_type: mistral\nlibrary_name: transformers\ninference: false\n---\n## Mistral 7B Instruct v0.2 Turkish\n- **Model creator:** [malhajar](https://huggingface.co/malhajar)\n- **Original model:** [Mistral-7B-Instruct-v0.2-turkish](https://huggingface.co/malhajar/Mistral-7B-Instruct-v0.2-turkish)\n\n<!-- description start -->\n## Description\nThis repo contains GGUF format model files for [malhajar's Mistral 7B Instruct v0.2 Turkish](https://huggingface.co/malhajar/Mistral-7B-Instruct-v0.2-turkish)\n\n## Original model\n- **Developed by:** [`Mohamad Alhajar`](https://www.linkedin.com/in/muhammet-alhajar/) \n- **Language(s) (NLP):** Turkish\n- **Finetuned from model:** [`mistralai/Mistral-7B-Instruct-v0.2`](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)\n\n# Quantization methods\n| quantization method | bits | size     | use case                                            | recommended |\n|---------------------|------|----------|-----------------------------------------------------|-------------|\n| Q2_K                | 2    | 2.72 GB  | smallest, significant quality loss  | ❌         |\n| Q3_K_S              | 3    | 3.16 GB  | very small, high quality loss                       | ❌         |\n| Q3_K_M              | 3    | 3.52 GB  | very small, high quality loss                       | ❌         |\n| Q3_K_L              | 3    | 3.82 GB  | small, substantial quality loss                     | ❌         |\n| Q4_0                | 4    | 4.11 GB  | legacy; small, very high quality loss  | ❌         |\n| Q4_K_S              | 4    | 4.14 GB  | small, greater quality loss                         | ❌         |\n| Q4_K_M              | 4    | 4.37 GB  | medium, balanced quality               | ✅         |\n| Q5_0                | 5    | 5.00 GB  | legacy; medium, balanced quality  | ❌         |\n| Q5_K_S              | 5    | 5.00 GB  | large, low quality loss                | ✅         |\n| Q5_K_M              | 5    | 5.13 GB  | large, very low quality loss           | ✅         |\n| Q6_K                | 6    | 5.94 GB  | very large, extremely low quality loss              | ❌         |\n| Q8_0                | 8    | 7.70 GB  | very large, extremely low quality loss   | ❌         |\n| FP16                | 16   | 14.5 GB  | enormous, minuscule quality loss  | ❌  |\n\n## Prompt Template\n```\n### Instruction:\n<prompt> (without the <>)\n### Response:\n```\n<!-- description end -->\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "text-generation",
    "tr",
    "en",
    "base_model:malhajar/Mistral-7B-Instruct-v0.2-turkish",
    "base_model:quantized:malhajar/Mistral-7B-Instruct-v0.2-turkish",
    "license:apache-2.0",
    "region:us",
    "conversational"
  ],
  "likes": 9,
  "downloads": 284,
  "gated": false,
  "private": false,
  "last_modified": "2024-02-16T19:55:52.000Z",
  "created_at": "2024-02-09T16:26:55.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}

{
  "_id": "65c6524f2dfd19ecf12d3ac1",
  "id": "sayhan/Mistral-7B-Instruct-v0.2-turkish-GGUF",
  "modelId": "sayhan/Mistral-7B-Instruct-v0.2-turkish-GGUF",
  "sha": "dc1fe923c9a54172baef0231b1150871400af3b3",
  "createdAt": "2024-02-09T16:26:55.000Z",
  "lastModified": "2024-02-16T19:55:52.000Z",
  "author": "sayhan",
  "downloads": 284,
  "likes": 9,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 14
}