maziyarpanahi/poppy_porpoise-v0.6-l3-8b-gguf overview

{
  "metadata": {},
  "card_data": {
    "tags": [
      "quantized",
      "2-bit",
      "3-bit",
      "4-bit",
      "5-bit",
      "6-bit",
      "8-bit",
      "GGUF",
      "transformers",
      "safetensors",
      "llama",
      "text-generation",
      "merge",
      "mergekit",
      "conversational",
      "autotrain_compatible",
      "endpoints_compatible",
      "text-generation-inference",
      "region:us",
      "text-generation"
    ],
    "model_name": "Poppy_Porpoise-v0.6-L3-8B-GGUF",
    "base_model": "ChaoticNeutrals/Poppy_Porpoise-v0.6-L3-8B",
    "inference": false,
    "model_creator": "ChaoticNeutrals",
    "pipeline_tag": "text-generation",
    "quantized_by": "MaziyarPanahi",
    "frontmatter": {
      "tags": [
        "quantized",
        "2-bit",
        "3-bit",
        "4-bit",
        "5-bit",
        "6-bit",
        "8-bit",
        "GGUF",
        "transformers",
        "safetensors",
        "llama",
        "text-generation",
        "merge",
        "mergekit",
        "conversational",
        "autotrain_compatible",
        "endpoints_compatible",
        "text-generation-inference",
        "region:us",
        "text-generation"
      ],
      "model_name": "Poppy_Porpoise-v0.6-L3-8B-GGUF",
      "base_model": "ChaoticNeutrals/Poppy_Porpoise-v0.6-L3-8B",
      "inference": "false",
      "model_creator": "ChaoticNeutrals",
      "pipeline_tag": "text-generation",
      "quantized_by": "MaziyarPanahi"
    },
    "hero_image_url": "",
    "summary": "# MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\ntags:\n- quantized\n- 2-bit\n- 3-bit\n- 4-bit\n- 5-bit\n- 6-bit\n- 8-bit\n- GGUF\n- transformers\n- safetensors\n- llama\n- text-generation\n- merge\n- mergekit\n- conversational\n- autotrain_compatible\n- endpoints_compatible\n- text-generation-inference\n- region:us\n- text-generation\nmodel_name: Poppy_Porpoise-v0.6-L3-8B-GGUF\nbase_model: ChaoticNeutrals/Poppy_Porpoise-v0.6-L3-8B\ninference: false\nmodel_creator: ChaoticNeutrals\npipeline_tag: text-generation\nquantized_by: MaziyarPanahi\n---\n# [MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF](https://huggingface.co/MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF)\n- Model creator: [ChaoticNeutrals](https://huggingface.co/ChaoticNeutrals)\n- Original model: [ChaoticNeutrals/Poppy_Porpoise-v0.6-L3-8B](https://huggingface.co/ChaoticNeutrals/Poppy_Porpoise-v0.6-L3-8B)\n\n## Description\n[MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF](https://huggingface.co/MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF) contains GGUF format model files for [ChaoticNeutrals/Poppy_Porpoise-v0.6-L3-8B](https://huggingface.co/ChaoticNeutrals/Poppy_Porpoise-v0.6-L3-8B).\n\n### About GGUF\n\nGGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.\n\nHere is an incomplete list of clients and libraries that are known to support GGUF:\n\n* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.\n* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.\n* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.\n* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.\n* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.\n* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.\n* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.\n* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.\n* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.\n* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.\n\n## Special thanks\n\n🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "quantized",
    "2-bit",
    "3-bit",
    "4-bit",
    "5-bit",
    "6-bit",
    "8-bit",
    "GGUF",
    "safetensors",
    "llama",
    "text-generation",
    "merge",
    "mergekit",
    "conversational",
    "autotrain_compatible",
    "endpoints_compatible",
    "text-generation-inference",
    "region:us",
    "base_model:ChaoticNeutrals/Poppy_Porpoise-v0.6-L3-8B",
    "base_model:quantized:ChaoticNeutrals/Poppy_Porpoise-v0.6-L3-8B"
  ],
  "likes": 4,
  "downloads": 105,
  "gated": false,
  "private": false,
  "last_modified": "2024-04-24T08:21:54.000Z",
  "created_at": "2024-04-24T07:56:10.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}

{
  "_id": "6628bb1a9ede0b3649661460",
  "id": "MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF",
  "modelId": "MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF",
  "sha": "fc4e1c748be3c33a9ef58195d4f7df41a574af4c",
  "createdAt": "2024-04-24T07:56:10.000Z",
  "lastModified": "2024-04-24T08:21:54.000Z",
  "author": "MaziyarPanahi",
  "downloads": 105,
  "likes": 4,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 12
}