devsdocode/llama-3-8b-uncensored-q4_k_m-gguf overview

{
  "metadata": {},
  "card_data": {
    "library_name": "transformers",
    "tags": [
      "llama-cpp",
      "gguf-my-repo",
      "uncensored",
      "transformers",
      "llama",
      "llama-3",
      "unsloth",
      "llama-cpp",
      "gguf-my-repo"
    ],
    "language": [
      "en"
    ],
    "license": "apache-2.0",
    "pipeline_tag": "text-generation",
    "frontmatter": {
      "library_name": "transformers",
      "tags": [
        "llama-cpp",
        "gguf-my-repo",
        "uncensored",
        "transformers",
        "llama",
        "llama-3",
        "unsloth",
        "llama-cpp",
        "gguf-my-repo"
      ],
      "language": [
        "en"
      ],
      "license": "apache-2.0",
      "pipeline_tag": "text-generation"
    },
    "hero_image_url": "https://img.shields.io/badge/YouTube-FF0000?style=for-the-badge&logo=youtube&logoColor=white",
    "summary": "",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlibrary_name: transformers\ntags:\n- llama-cpp\n- gguf-my-repo\n- uncensored\n- transformers\n- llama\n- llama-3\n- unsloth\n- llama-cpp\n- gguf-my-repo\nlanguage:\n- en\nlicense: apache-2.0\npipeline_tag: text-generation\n---\n\n<div align=\"center\">\n  <!-- Replace `#` with your actual links -->\n  <a href=\"https://youtube.com/@devsdocode\"><img alt=\"YouTube\" src=\"https://img.shields.io/badge/YouTube-FF0000?style=for-the-badge&logo=youtube&logoColor=white\"></a>\n  <a href=\"https://t.me/devsdocode\"><img alt=\"Telegram\" src=\"https://img.shields.io/badge/Telegram-2CA5E0?style=for-the-badge&logo=telegram&logoColor=white\"></a>\n  <a href=\"https://www.instagram.com/sree.shades_/\"><img alt=\"Instagram\" src=\"https://img.shields.io/badge/Instagram-E4405F?style=for-the-badge&logo=instagram&logoColor=white\"></a>\n  <a href=\"https://www.linkedin.com/in/developer-sreejan/\"><img alt=\"LinkedIn\" src=\"https://img.shields.io/badge/LinkedIn-0077B5?style=for-the-badge&logo=linkedin&logoColor=white\"></a>\n  <a href=\"https://buymeacoffee.com/devsdocode\"><img alt=\"Buy Me A Coffee\" src=\"https://img.shields.io/badge/Buy%20Me%20A%20Coffee-FFDD00?style=for-the-badge&logo=buymeacoffee&logoColor=black\"></a>\n</div>\n\n## Crafted with ❤️ by Devs Do Code (Sree)\n\n### GGUF Technical Specifications \n\nDelve into the intricacies of GGUF, a meticulously crafted format that builds upon the robust foundation of the GGJT model. Tailored for heightened extensibility and user-centric functionality, GGUF introduces a suite of indispensable features:\n\n**Single-file Deployment:** Streamline distribution and loading effortlessly. GGUF models have been meticulously architected for seamless deployment, necessitating no external files for supplementary information.\n\n**Extensibility:** Safeguard the future of your models. GGUF seamlessly accommodates the integration of new features into GGML-based executors, ensuring compatibility with existing models.\n\n**mmap Compatibility:** Prioritize efficiency. GGUF models are purposefully engineered to support mmap, facilitating rapid loading and saving, thus optimizing your workflow.\n\n**User-Friendly:** Simplify your coding endeavors. Load and save models effortlessly, irrespective of the programming language used, obviating the dependency on external libraries.\n\n**Full Information:** A comprehensive repository in a single file. GGUF models encapsulate all requisite information for loading, eliminating the need for users to furnish additional data.\n\nThe differentiator between GGJT and GGUF lies in the deliberate adoption of a key-value structure for hyperparameters (now termed metadata). Bid farewell to untyped lists, and embrace a structured approach that seamlessly accommodates new metadata without compromising compatibility with existing models. Augment your model with supplementary information for enhanced inference and model identification.\n\n\n**QUANTIZATION_METHODS:**\n\n| Method | Quantization | Advantages | Trade-offs |\n|---|---|---|---|\n| q2_k | 2-bit integers | Significant model size reduction | Minimal impact on accuracy |\n| q3_k_l | 3-bit integers | Balance between model size reduction and accuracy preservation | Moderate impact on accuracy |\n| q3_k_m | 3-bit integers | Enhanced accuracy with mixed precision | Increased computational complexity |\n| q3_k_s | 3-bit integers | Improved model efficiency with structured pruning | Reduced accuracy |\n| q4_0 | 4-bit integers | Significant model size reduction | Moderate impact on accuracy |\n| q4_1 | 4-bit integers | Enhanced accuracy with mixed precision | Increased computational complexity |\n| q4_k_m | 4-bit integers | Optimized model size and accuracy with mixed precision and structured pruning | Reduced accuracy |\n| q4_k_s | 4-bit integers | Improved model efficiency with structured pruning | Reduced accuracy |\n| q5_0 | 5-bit integers | Balance between model size reduction and accuracy preservation | Moderate impact on accuracy |\n| q5_1 | 5-bit integers | Enhanced accuracy with mixed precision | Increased computational complexity |\n| q5_k_m | 5-bit integers | Optimized model size and accuracy with mixed precision and structured pruning | Reduced accuracy |\n| q5_k_s | 5-bit integers | Improved model efficiency with structured pruning | Reduced accuracy |\n| q6_k | 6-bit integers | Balance between model size reduction and accuracy preservation | Moderate impact on accuracy |\n| q8_0 | 8-bit integers | Significant model size reduction | Minimal impact on accuracy |\n\n\n\n<div align=\"center\">\n  <!-- Replace `#` with your actual links -->\n  <a href=\"https://youtube.com/@devsdocode\"><img alt=\"YouTube\" src=\"https://img.shields.io/badge/YouTube-FF0000?style=for-the-badge&logo=youtube&logoColor=white\"></a>\n  <a href=\"https://t.me/devsdocode\"><img alt=\"Telegram\" src=\"https://img.shields.io/badge/Telegram-2CA5E0?style=for-the-badge&logo=telegram&logoColor=white\"></a>\n  <a href=\"https://www.instagram.com/sree.shades_/\"><img alt=\"Instagram\" src=\"https://img.shields.io/badge/Instagram-E4405F?style=for-the-badge&logo=instagram&logoColor=white\"></a>\n  <a href=\"https://www.linkedin.com/in/developer-sreejan/\"><img alt=\"LinkedIn\" src=\"https://img.shields.io/badge/LinkedIn-0077B5?style=for-the-badge&logo=linkedin&logoColor=white\"></a>\n  <a href=\"https://buymeacoffee.com/devsdocode\"><img alt=\"Buy Me A Coffee\" src=\"https://img.shields.io/badge/Buy%20Me%20A%20Coffee-FFDD00?style=for-the-badge&logo=buymeacoffee&logoColor=black\"></a>\n</div>",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "llama-cpp",
    "gguf-my-repo",
    "uncensored",
    "llama",
    "llama-3",
    "unsloth",
    "text-generation",
    "en",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 7,
  "downloads": 409,
  "gated": false,
  "private": false,
  "last_modified": "2024-05-06T11:28:50.000Z",
  "created_at": "2024-05-06T09:45:53.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}

{
  "_id": "6638a6d18bd9205c32675ff3",
  "id": "DevsDoCode/LLama-3-8b-Uncensored-Q4_K_M-GGUF",
  "modelId": "DevsDoCode/LLama-3-8b-Uncensored-Q4_K_M-GGUF",
  "sha": "7298d6afded45746c31c3fdcbb4ca9405d5d2ee0",
  "createdAt": "2024-05-06T09:45:53.000Z",
  "lastModified": "2024-05-06T11:28:50.000Z",
  "author": "DevsDoCode",
  "downloads": 409,
  "likes": 7,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 3
}