afrideva/tinymistral-248m-sft-v4-gguf overview

{
  "metadata": {},
  "card_data": {
    "base_model": "Felladrin/TinyMistral-248M-SFT-v4",
    "datasets": [
      "OpenAssistant/oasst_top1_2023-08-25"
    ],
    "inference": false,
    "license": "apache-2.0",
    "model_creator": "Felladrin",
    "model_name": "TinyMistral-248M-SFT-v4",
    "pipeline_tag": "text-generation",
    "quantized_by": "afrideva",
    "tags": [
      "text-generation",
      "gguf",
      "ggml",
      "quantized",
      "q2_k",
      "q3_k_m",
      "q4_k_m",
      "q5_k_m",
      "q6_k",
      "q8_0"
    ],
    "widget": [
      {
        "text": "<|im_start|>user\nInvited some friends to come home today. Give me some ideas for games to play with them!<|im_end|>\n<|im_start|>assistant"
      },
      {
        "text": "<|im_start|>user\nHow do meteorologists predict how much air pollution will be produced in the next year?<|im_end|>\n<|im_start|>assistant"
      },
      {
        "text": "<|im_start|>user\nWho is Mona Lisa?<|im_end|>\n<|im_start|>assistant"
      },
      {
        "text": "<|im_start|>user\nHeya!<|im_end|>\n<|im_start|>assistant\nHi! How may I help you today?<|im_end|>\n<|im_start|>user\nI need to build a simple website. Where should I start learning about web development?<|im_end|>\n<|im_start|>assistant"
      },
      {
        "text": "<|im_start|>user\nWhat are some potential applications for quantum computing?<|im_end|>\n<|im_start|>assistant"
      },
      {
        "text": "<|im_start|>user\nWrite the specs of a game about dragons and warriors in a fantasy world.<|im_end|>\n<|im_start|>assistant"
      },
      {
        "text": "<|im_start|>user\nGot a question for you!<|im_end|>\n<|im_start|>assistant\nSure! What's it?<|im_end|>\n<|im_start|>user\nWhy do you love cats so much!? 🐈<|im_end|>\n<|im_start|>assistant"
      },
      {
        "text": "<|im_start|>user\nTell me about the pros and cons of social media.<|im_end|>\n<|im_start|>assistant"
      }
    ],
    "frontmatter": {
      "base_model": "Felladrin/TinyMistral-248M-SFT-v4",
      "datasets": [
        "OpenAssistant/oasst_top1_2023-08-25"
      ],
      "inference": "false",
      "license": "apache-2.0",
      "model_creator": "Felladrin",
      "model_name": "TinyMistral-248M-SFT-v4",
      "pipeline_tag": "text-generation",
      "quantized_by": "afrideva",
      "tags": [
        "text-generation",
        "gguf",
        "ggml",
        "quantized",
        "q2_k",
        "q3_k_m",
        "q4_k_m",
        "q5_k_m",
        "q6_k",
        "q8_0"
      ],
      "widget": [
        "text: '<|im_start|>user",
        "text: '<|im_start|>user",
        "text: '<|im_start|>user",
        "text: '<|im_start|>user",
        "text: '<|im_start|>user",
        "text: '<|im_start|>user",
        "text: \"<|im_start|>user\\nGot a question for you!<|im_end|>\\n<|im_start|>assistant\\nSure!",
        "text: '<|im_start|>user"
      ]
    },
    "hero_image_url": "",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: Felladrin/TinyMistral-248M-SFT-v4\ndatasets:\n- OpenAssistant/oasst_top1_2023-08-25\ninference: false\nlicense: apache-2.0\nmodel_creator: Felladrin\nmodel_name: TinyMistral-248M-SFT-v4\npipeline_tag: text-generation\nquantized_by: afrideva\ntags:\n- text-generation\n- gguf\n- ggml\n- quantized\n- q2_k\n- q3_k_m\n- q4_k_m\n- q5_k_m\n- q6_k\n- q8_0\nwidget:\n- text: '<|im_start|>user\n\n    Invited some friends to come home today. Give me some ideas for games to play\n    with them!<|im_end|>\n\n    <|im_start|>assistant'\n- text: '<|im_start|>user\n\n    How do meteorologists predict how much air pollution will be produced in the next\n    year?<|im_end|>\n\n    <|im_start|>assistant'\n- text: '<|im_start|>user\n\n    Who is Mona Lisa?<|im_end|>\n\n    <|im_start|>assistant'\n- text: '<|im_start|>user\n\n    Heya!<|im_end|>\n\n    <|im_start|>assistant\n\n    Hi! How may I help you today?<|im_end|>\n\n    <|im_start|>user\n\n    I need to build a simple website. Where should I start learning about web development?<|im_end|>\n\n    <|im_start|>assistant'\n- text: '<|im_start|>user\n\n    What are some potential applications for quantum computing?<|im_end|>\n\n    <|im_start|>assistant'\n- text: '<|im_start|>user\n\n    Write the specs of a game about dragons and warriors in a fantasy world.<|im_end|>\n\n    <|im_start|>assistant'\n- text: \"<|im_start|>user\\nGot a question for you!<|im_end|>\\n<|im_start|>assistant\\nSure!\n    What's it?<|im_end|>\\n<|im_start|>user\\nWhy do you love cats so much!? \\U0001F408<|im_end|>\\n<|im_start|>assistant\"\n- text: '<|im_start|>user\n\n    Tell me about the pros and cons of social media.<|im_end|>\n\n    <|im_start|>assistant'\n---\n# Felladrin/TinyMistral-248M-SFT-v4-GGUF\n\nQuantized GGUF model files for [TinyMistral-248M-SFT-v4](https://huggingface.co/Felladrin/TinyMistral-248M-SFT-v4) from [Felladrin](https://huggingface.co/Felladrin)\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [tinymistral-248m-sft-v4.fp16.gguf](https://huggingface.co/afrideva/TinyMistral-248M-SFT-v4-GGUF/resolve/main/tinymistral-248m-sft-v4.fp16.gguf) | fp16 | 497.75 MB  |\n| [tinymistral-248m-sft-v4.q2_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-SFT-v4-GGUF/resolve/main/tinymistral-248m-sft-v4.q2_k.gguf) | q2_k | 116.20 MB  |\n| [tinymistral-248m-sft-v4.q3_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-SFT-v4-GGUF/resolve/main/tinymistral-248m-sft-v4.q3_k_m.gguf) | q3_k_m | 131.01 MB  |\n| [tinymistral-248m-sft-v4.q4_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-SFT-v4-GGUF/resolve/main/tinymistral-248m-sft-v4.q4_k_m.gguf) | q4_k_m | 156.60 MB  |\n| [tinymistral-248m-sft-v4.q5_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-SFT-v4-GGUF/resolve/main/tinymistral-248m-sft-v4.q5_k_m.gguf) | q5_k_m | 180.16 MB  |\n| [tinymistral-248m-sft-v4.q6_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-SFT-v4-GGUF/resolve/main/tinymistral-248m-sft-v4.q6_k.gguf) | q6_k | 205.20 MB  |\n| [tinymistral-248m-sft-v4.q8_0.gguf](https://huggingface.co/afrideva/TinyMistral-248M-SFT-v4-GGUF/resolve/main/tinymistral-248m-sft-v4.q8_0.gguf) | q8_0 | 265.26 MB  |\n\n\n\n## Original Model Card:\n# Locutusque's TinyMistral-248M trained on OpenAssistant TOP-1 Conversation Threads\n\n- Base model: [Locutusque/TinyMistral-248M](https://huggingface.co/Locutusque/TinyMistral-248M)\n- Dataset: [OpenAssistant/oasst_top1_2023-08-25](https://huggingface.co/datasets/OpenAssistant/oasst_top1_2023-08-25)\n- Availability in other ML formats:\n  - GGUF: [Felladrin/gguf-TinyMistral-248M-SFT-v4](https://huggingface.co/Felladrin/gguf-TinyMistral-248M-SFT-v4)\n  - ONNX: [Felladrin/onnx-TinyMistral-248M-SFT-v4](https://huggingface.co/Felladrin/onnx-TinyMistral-248M-SFT-v4)\n\n## Recommended Prompt Format\n\n```\n<|im_start|>user\n{message}<|im_end|>\n<|im_start|>assistant\n```",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "text-generation",
    "ggml",
    "quantized",
    "q2_k",
    "q3_k_m",
    "q4_k_m",
    "q5_k_m",
    "q6_k",
    "q8_0",
    "dataset:OpenAssistant/oasst_top1_2023-08-25",
    "base_model:Felladrin/TinyMistral-248M-Chat-v4",
    "base_model:quantized:Felladrin/TinyMistral-248M-Chat-v4",
    "license:apache-2.0",
    "region:us"
  ],
  "likes": 0,
  "downloads": 177,
  "gated": false,
  "private": false,
  "last_modified": "2023-12-11T21:50:03.000Z",
  "created_at": "2023-12-11T21:48:36.000Z",
  "pipeline_tag": "text-generation",
  "library_name": ""
}

{
  "_id": "657783b44d989b0a68792d95",
  "id": "afrideva/TinyMistral-248M-SFT-v4-GGUF",
  "modelId": "afrideva/TinyMistral-248M-SFT-v4-GGUF",
  "sha": "186cf21dc11408f4e39a490bdf6ddb97d0de46bc",
  "createdAt": "2023-12-11T21:48:36.000Z",
  "lastModified": "2023-12-11T21:50:03.000Z",
  "author": "afrideva",
  "downloads": 177,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "",
  "siblings_count": 9
}