richarderkhov/nextnewchattingai_-_shark_tank_ai_7b_v2-gguf overview

{
  "metadata": {},
  "card_data": {
    "frontmatter": {},
    "hero_image_url": "",
    "summary": "Detailed results can be found here |             Metric              |Value| |---------------------------------|----:| |Avg.                             |66.55| |AI2 Reasoning Challenge (25-Shot)|67.75| |HellaSwag (10-Shot)              |87.06| |MMLU (5-Shot)                    |58.79| |TruthfulQA (0-shot)              |62.15| |Winogrande (5-shot)              |78.45| |GSM8k (5-shot)                   |45.11|",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "Quantization made by Richard Erkhov.\n\n[Github](https://github.com/RichardErkhov)\n\n[Discord](https://discord.gg/pvy7H8DZMG)\n\n[Request more models](https://github.com/RichardErkhov/quant_request)\n\n\nshark_tank_ai_7b_v2 - GGUF\n- Model creator: https://huggingface.co/NExtNewChattingAI/\n- Original model: https://huggingface.co/NExtNewChattingAI/shark_tank_ai_7b_v2/\n\n\n| Name | Quant method | Size |\n| ---- | ---- | ---- |\n| [shark_tank_ai_7b_v2.Q2_K.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q2_K.gguf) | Q2_K | 2.53GB |\n| [shark_tank_ai_7b_v2.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.IQ3_XS.gguf) | IQ3_XS | 2.81GB |\n| [shark_tank_ai_7b_v2.IQ3_S.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.IQ3_S.gguf) | IQ3_S | 2.96GB |\n| [shark_tank_ai_7b_v2.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q3_K_S.gguf) | Q3_K_S | 2.95GB |\n| [shark_tank_ai_7b_v2.IQ3_M.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.IQ3_M.gguf) | IQ3_M | 3.06GB |\n| [shark_tank_ai_7b_v2.Q3_K.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q3_K.gguf) | Q3_K | 3.28GB |\n| [shark_tank_ai_7b_v2.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q3_K_M.gguf) | Q3_K_M | 3.28GB |\n| [shark_tank_ai_7b_v2.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q3_K_L.gguf) | Q3_K_L | 3.56GB |\n| [shark_tank_ai_7b_v2.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.IQ4_XS.gguf) | IQ4_XS | 3.67GB |\n| [shark_tank_ai_7b_v2.Q4_0.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q4_0.gguf) | Q4_0 | 3.83GB |\n| [shark_tank_ai_7b_v2.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.IQ4_NL.gguf) | IQ4_NL | 3.87GB |\n| [shark_tank_ai_7b_v2.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q4_K_S.gguf) | Q4_K_S | 3.86GB |\n| [shark_tank_ai_7b_v2.Q4_K.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q4_K.gguf) | Q4_K | 4.07GB |\n| [shark_tank_ai_7b_v2.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q4_K_M.gguf) | Q4_K_M | 4.07GB |\n| [shark_tank_ai_7b_v2.Q4_1.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q4_1.gguf) | Q4_1 | 4.24GB |\n| [shark_tank_ai_7b_v2.Q5_0.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q5_0.gguf) | Q5_0 | 4.65GB |\n| [shark_tank_ai_7b_v2.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q5_K_S.gguf) | Q5_K_S | 4.65GB |\n| [shark_tank_ai_7b_v2.Q5_K.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q5_K.gguf) | Q5_K | 4.78GB |\n| [shark_tank_ai_7b_v2.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q5_K_M.gguf) | Q5_K_M | 4.78GB |\n| [shark_tank_ai_7b_v2.Q5_1.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q5_1.gguf) | Q5_1 | 5.07GB |\n| [shark_tank_ai_7b_v2.Q6_K.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q6_K.gguf) | Q6_K | 5.53GB |\n| [shark_tank_ai_7b_v2.Q8_0.gguf](https://huggingface.co/RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf/blob/main/shark_tank_ai_7b_v2.Q8_0.gguf) | Q8_0 | 7.17GB |\n\n\n\n\nOriginal model description:\n---\nlanguage:\n- en\nlicense: cc-by-nc-4.0\nmodel-index:\n- name: shark_tank_ai_7b_v2\n  results:\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: AI2 Reasoning Challenge (25-Shot)\n      type: ai2_arc\n      config: ARC-Challenge\n      split: test\n      args:\n        num_few_shot: 25\n    metrics:\n    - type: acc_norm\n      value: 67.75\n      name: normalized accuracy\n    source:\n      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=NExtNewChattingAI/shark_tank_ai_7b_v2\n      name: Open LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: HellaSwag (10-Shot)\n      type: hellaswag\n      split: validation\n      args:\n        num_few_shot: 10\n    metrics:\n    - type: acc_norm\n      value: 87.06\n      name: normalized accuracy\n    source:\n      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=NExtNewChattingAI/shark_tank_ai_7b_v2\n      name: Open LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: MMLU (5-Shot)\n      type: cais/mmlu\n      config: all\n      split: test\n      args:\n        num_few_shot: 5\n    metrics:\n    - type: acc\n      value: 58.79\n      name: accuracy\n    source:\n      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=NExtNewChattingAI/shark_tank_ai_7b_v2\n      name: Open LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: TruthfulQA (0-shot)\n      type: truthful_qa\n      config: multiple_choice\n      split: validation\n      args:\n        num_few_shot: 0\n    metrics:\n    - type: mc2\n      value: 62.15\n    source:\n      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=NExtNewChattingAI/shark_tank_ai_7b_v2\n      name: Open LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: Winogrande (5-shot)\n      type: winogrande\n      config: winogrande_xl\n      split: validation\n      args:\n        num_few_shot: 5\n    metrics:\n    - type: acc\n      value: 78.45\n      name: accuracy\n    source:\n      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=NExtNewChattingAI/shark_tank_ai_7b_v2\n      name: Open LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: GSM8k (5-shot)\n      type: gsm8k\n      config: main\n      split: test\n      args:\n        num_few_shot: 5\n    metrics:\n    - type: acc\n      value: 45.11\n      name: accuracy\n    source:\n      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=NExtNewChattingAI/shark_tank_ai_7b_v2\n      name: Open LLM Leaderboard\n---\nThis model is based on https://huggingface.co/AIDC-ai-business/Marcoroni-7B-v3 trained on internal data.\n---\nlicense: cc-by-nc-4.0\nlanguage:\n- en\n---\nChatbot is a highly advanced artificial intelligence designed to provide you with personalized assistance and support. With its natural language processing capabilities, it can understand and respond to a wide range of queries and requests, making it a valuable tool for both personal and professional use.\n\nThe chatbot is equipped with a vast knowledge base, allowing it to provide accurate and reliable information on a wide range of topics, from general knowledge to specific industry-related information. It can also perform tasks such as scheduling appointments, sending emails, and even ordering products online.\n\nOne of the standout features of this assistant chatbot is its ability to learn and adapt to your individual preferences and needs. Over time, it can become more personalized to your specific requirements, making it an even more valuable asset to your daily life.\n\nThe chatbot is also designed to be user-friendly and intuitive, with a simple and easy-to-use interface that allows you to interact with it in a natural and conversational way. Whether you're looking for information, need help with a task, or just want to chat, your assistant chatbot is always ready and available to assist you.\n# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)\nDetailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_NExtNewChattingAI__shark_tank_ai_7b_v2)\n\n|             Metric              |Value|\n|---------------------------------|----:|\n|Avg.                             |66.55|\n|AI2 Reasoning Challenge (25-Shot)|67.75|\n|HellaSwag (10-Shot)              |87.06|\n|MMLU (5-Shot)                    |58.79|\n|TruthfulQA (0-shot)              |62.15|\n|Winogrande (5-shot)              |78.45|\n|GSM8k (5-shot)                   |45.11|\n\n\n\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 0,
  "downloads": 448,
  "gated": false,
  "private": false,
  "last_modified": "2024-06-20T04:36:14.000Z",
  "created_at": "2024-06-19T23:20:42.000Z",
  "pipeline_tag": "",
  "library_name": ""
}

{
  "_id": "667367ca4f3d4b332772cf83",
  "id": "RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf",
  "modelId": "RichardErkhov/NExtNewChattingAI_-_shark_tank_ai_7b_v2-gguf",
  "sha": "9de5186e872e864636b8de25a6c4cd9b634cbea6",
  "createdAt": "2024-06-19T23:20:42.000Z",
  "lastModified": "2024-06-20T04:36:14.000Z",
  "author": "RichardErkhov",
  "downloads": 448,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 24
}