osmapi/nidum-llama-3.2-3b-uncensored-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "apache-2.0",
    "base_model": [
      "nidum/Nidum-Llama-3.2-3B-Uncensored",
      "meta-llama/Llama-3.2-3B"
    ],
    "library_name": "adapter-transformers",
    "tags": [
      "chemistry",
      "biology",
      "legal",
      "code",
      "medical",
      "finance",
      "roleplay",
      "uncensored",
      "uncensored LLM"
    ],
    "pipeline_tag": "text-generation",
    "frontmatter": {
      "license": "apache-2.0",
      "base_model": [
        "nidum/Nidum-Llama-3.2-3B-Uncensored",
        "meta-llama/Llama-3.2-3B"
      ],
      "library_name": "adapter-transformers",
      "tags": [
        "chemistry",
        "biology",
        "legal",
        "code",
        "medical",
        "finance",
        "roleplay",
        "uncensored",
        "uncensored LLM"
      ],
      "pipeline_tag": "text-generation"
    },
    "hero_image_url": "https://upload.wikimedia.org/wikipedia/commons/thumb/9/95/Font_Awesome_5_brands_github.svg/232px-Font_Awesome_5_brands_github.svg.png",
    "summary": "### Nidum-Llama-3.2-3B-Uncensored ### Welcome to Nidum! At Nidum, we believe in pushing the boundaries of innovation by providing advanced and unrestricted AI models for every application. Dive into our world of possibilities and experience the freedom of **Nidum-Llama-3.2-3B-Uncensored**, tailored to meet diverse needs with exceptional performance. --- ![GitHub Icon](https://github.com/NidumAI-Inc) **Explore Nidum's Open-Source Projects on GitHub**: https://github.com/NidumAI-Inc --- ### Key Features 1. **Uncensored Responses**: Capable of addressing any query without content restrictions, offering detailed and uninhibited answers. 2. **Versatility**: Excels in diverse use cases, from complex technical queries to engaging casual conversations. 3. **Advanced Contextual Understanding**: Draws from an expansive knowledge base for accurate and context-aware outputs. 4. **Extended Context Handling**: Optimized for handling long-context interactions for improved continuity and depth. 5. **Customizability**: Adaptable to specific tasks and user preferences through fine-tuning. --- ### Use Cases --- ### How to Use To start using **Nidum-Llama-3.2-3B-Uncensored**, follow the sample code below: ``python import torch from transformers import pipeline pipe = pipeline( \"text-generation\", model=\"nidum/Nidum-Llama-3.2-3B-Uncensored\", model_kwargs={\"torch_dtype\": torch.bfloat16}, device=\"cuda\",  # replace with \"mps\" to run on a Mac device ) messages = [ {\"role\": \"user\", \"content\": \"Tell me something fascinating.\"}, ] outputs = pipe(messages, max_new_tokens=256) assistant_response = outputs[0][\"generated_text\"][-1][\"content\"].strip() print(assistant_response) `` --- #### Quantized Models Available for Download | **Quantized Model Version**                                                                                       | **Description**                                                                 | |-------------------------------------------------------------------------------------------------------------------|---------------------------------------------------------------------------------| | **Nidum-Llama-3.2-3B-Uncensored-F16.gguf** | Full 16-bit floating point precision for maximum accuracy on high-end GPUs.     | | **model-Q2_K.gguf**               | Optimized for minimal memory usage with lower precision, suitable for edge cases.| | **model-Q3_K_L.gguf**           | Balanced precision with enhanced memory efficiency for medium-range devices.    | | **model-Q3_K_M.gguf**           | Mid-range quantization for moderate precision and memory usage balance.         | | **model-Q3_K_S.gguf**           | Smaller quantization steps, offering moderate precision with reduced memory use.| | **model-Q4_0_4_4.gguf**       | Performance-optimized for low memory, ideal for lightweight deployment.         | | **model-Q4_0_4_8.gguf**       | Extended quantization balancing memory use and inference speed.                 | | **model-Q4_0_8_8.gguf**       | Advanced memory precision targeting larger contexts.                            | | **model-Q4_K_M.gguf**           | High-efficiency quantization for moderate GPU resources.                        | | **model-Q4_K_S.gguf**           | Optimized for smaller-scale operations with compact memory footprint.           | | **model-Q5_K_M.gguf**           | Balances performance and precision, ideal for robust inferencing environments.  | | **model-Q5_K_S.gguf**           | Moderate quantization targeting performance with minimal resource usage.        | | **model-Q6_K.gguf**               | High-precision quantization for accurate and stable inferencing tasks.          | | **model-TQ1_0.gguf**             | Experimental quantization for targeted applications in test environments.       | | **model-TQ2_0.gguf**             | High-performance tuning for experimental use cases and flexible precision.      | --- ### Datasets and Fine-Tuning The following fine-tuning datasets are leveraged to enhance specific model capabilities: --- ### Benchmarks After fine-tuning with **uncensored data**, **Nidum-Llama-3.2-3B** demonstrates **superior performance compared to the original LLaMA model**, particularly in accuracy and handling diverse, unrestricted scenarios. #### Benchmark Summary Table | **Benchmark**    | **Metric**                       | **LLaMA 3.2 3B** | **Nidum 3.2 3B** | **Observation**                                                                                     | |-------------------|-----------------------------------|--------------|--------------|-----------------------------------------------------------------------------------------------------| | **GPQA**         | Exact Match (Flexible)           | 0.3          | 0.5          | Nidum 3B demonstrates significant improvement, particularly in **generative tasks**.                | |                  | Accuracy                         | 0.4          | 0.5          | Consistent improvement, especially in **zero-shot** scenarios.                                      | | **HellaSwag**    | Accuracy                         | 0.3          | 0.4          | Better performance in **common sense reasoning** tasks.                                             | |                  | Normalized Accuracy              | 0.3          | 0.4          | Enhanced ability to understand and predict context in sentence completion.                          | |                  | Normalized Accuracy (Stderr)     | 0.15275      | 0.1633       | Slightly improved consistency in normalized accuracy.                                               | |                  | Accuracy (Stderr)                | 0.15275      | 0.1633       | Shows robustness in reasoning accuracy compared to LLaMA 3B.                                        | --- ### Insights: 1. **GPQA Results**: Fine-tuning on uncensored data has boosted **Nidum 3B's Exact Match and Accuracy**, particularly excelling in **generative** and **zero-shot** tasks involving domain-specific knowledge. 2. **HellaSwag Results**: **Nidum 3B** consistently outperforms **LLaMA 3B** in **common sense reasoning benchmarks**, indicating enhanced contextual and semantic understanding. --- ### Contributing We welcome contributions to improve and extend the model’s capabilities. Stay tuned for updates on how to contribute. --- ### Contact For inquiries, collaborations, or further information, please reach out to us at **info@nidum.ai**. --- ### Explore the Possibilities Dive into unrestricted creativity and innovation with **Nidum Llama 3.2 3B Uncensored**!",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: apache-2.0\nbase_model:\n- nidum/Nidum-Llama-3.2-3B-Uncensored\n- meta-llama/Llama-3.2-3B\nlibrary_name: adapter-transformers\ntags:\n- chemistry\n- biology\n- legal\n- code\n- medical\n- finance\n- roleplay\n- uncensored\n- uncensored LLM\npipeline_tag: text-generation\n---\n\n### Nidum-Llama-3.2-3B-Uncensored  \n\n### Welcome to Nidum!  \nAt Nidum, we believe in pushing the boundaries of innovation by providing advanced and unrestricted AI models for every application. Dive into our world of possibilities and experience the freedom of **Nidum-Llama-3.2-3B-Uncensored**, tailored to meet diverse needs with exceptional performance.\n\n---\n\n[![GitHub Icon](https://upload.wikimedia.org/wikipedia/commons/thumb/9/95/Font_Awesome_5_brands_github.svg/232px-Font_Awesome_5_brands_github.svg.png)](https://github.com/NidumAI-Inc)  \n**Explore Nidum's Open-Source Projects on GitHub**: [https://github.com/NidumAI-Inc](https://github.com/NidumAI-Inc)\n\n---\n### Key Features\n\n1. **Uncensored Responses**: Capable of addressing any query without content restrictions, offering detailed and uninhibited answers.\n2. **Versatility**: Excels in diverse use cases, from complex technical queries to engaging casual conversations.\n3. **Advanced Contextual Understanding**: Draws from an expansive knowledge base for accurate and context-aware outputs.\n4. **Extended Context Handling**: Optimized for handling long-context interactions for improved continuity and depth.\n5. **Customizability**: Adaptable to specific tasks and user preferences through fine-tuning.\n\n---\n\n### Use Cases\n\n- **Open-Ended Q&A**  \n- **Creative Writing and Ideation**  \n- **Research Assistance**  \n- **Educational Queries**  \n- **Casual Conversations**  \n- **Mathematical Problem Solving**  \n- **Long-Context Dialogues**  \n\n---\n\n### How to Use\n\nTo start using **Nidum-Llama-3.2-3B-Uncensored**, follow the sample code below:\n\n```python\nimport torch\nfrom transformers import pipeline\n\npipe = pipeline(\n    \"text-generation\",\n    model=\"nidum/Nidum-Llama-3.2-3B-Uncensored\",\n    model_kwargs={\"torch_dtype\": torch.bfloat16},\n    device=\"cuda\",  # replace with \"mps\" to run on a Mac device\n)\n\nmessages = [\n    {\"role\": \"user\", \"content\": \"Tell me something fascinating.\"},\n]\n\noutputs = pipe(messages, max_new_tokens=256)\nassistant_response = outputs[0][\"generated_text\"][-1][\"content\"].strip()\nprint(assistant_response)\n```\n\n---\n#### Quantized Models Available for Download\n\n| **Quantized Model Version**                                                                                       | **Description**                                                                 |\n|-------------------------------------------------------------------------------------------------------------------|---------------------------------------------------------------------------------|\n| [**Nidum-Llama-3.2-3B-Uncensored-F16.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/Nidum-Llama-3.2-3B-Uncensored-F16.gguf) | Full 16-bit floating point precision for maximum accuracy on high-end GPUs.     |\n| [**model-Q2_K.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q2_K.gguf)               | Optimized for minimal memory usage with lower precision, suitable for edge cases.|\n| [**model-Q3_K_L.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q3_K_L.gguf)           | Balanced precision with enhanced memory efficiency for medium-range devices.    |\n| [**model-Q3_K_M.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q3_K_M.gguf)           | Mid-range quantization for moderate precision and memory usage balance.         |\n| [**model-Q3_K_S.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q3_K_S.gguf)           | Smaller quantization steps, offering moderate precision with reduced memory use.|\n| [**model-Q4_0_4_4.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q4_0_4_4.gguf)       | Performance-optimized for low memory, ideal for lightweight deployment.         |\n| [**model-Q4_0_4_8.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q4_0_4_8.gguf)       | Extended quantization balancing memory use and inference speed.                 |\n| [**model-Q4_0_8_8.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q4_0_8_8.gguf)       | Advanced memory precision targeting larger contexts.                            |\n| [**model-Q4_K_M.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q4_K_M.gguf)           | High-efficiency quantization for moderate GPU resources.                        |\n| [**model-Q4_K_S.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q4_K_S.gguf)           | Optimized for smaller-scale operations with compact memory footprint.           |\n| [**model-Q5_K_M.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q5_K_M.gguf)           | Balances performance and precision, ideal for robust inferencing environments.  |\n| [**model-Q5_K_S.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q5_K_S.gguf)           | Moderate quantization targeting performance with minimal resource usage.        |\n| [**model-Q6_K.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-Q6_K.gguf)               | High-precision quantization for accurate and stable inferencing tasks.          |\n| [**model-TQ1_0.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-TQ1_0.gguf)             | Experimental quantization for targeted applications in test environments.       |\n| [**model-TQ2_0.gguf**](https://huggingface.co/nidum/Nidum-Llama-3.2-3B-Uncensored-GGUF/blob/main/model-TQ2_0.gguf)             | High-performance tuning for experimental use cases and flexible precision.      |\n\n---\n### Datasets and Fine-Tuning\n\nThe following fine-tuning datasets are leveraged to enhance specific model capabilities:\n\n- **Uncensored Data**: Enables unrestricted and uninhibited responses.\n- **RAG-Based Fine-Tuning**: Optimizes retrieval-augmented generation for knowledge-intensive tasks.\n- **Long Context Fine-Tuning**: Enhances the model's ability to process and maintain coherence in extended conversations.\n- **Math-Instruct Data**: Specially curated for precise and contextually accurate mathematical reasoning.\n\n---\n\n### Benchmarks  \n\nAfter fine-tuning with **uncensored data**, **Nidum-Llama-3.2-3B** demonstrates **superior performance compared to the original LLaMA model**, particularly in accuracy and handling diverse, unrestricted scenarios.\n\n#### Benchmark Summary Table\n\n| **Benchmark**    | **Metric**                       | **LLaMA 3.2 3B** | **Nidum 3.2 3B** | **Observation**                                                                                     |\n|-------------------|-----------------------------------|--------------|--------------|-----------------------------------------------------------------------------------------------------|\n| **GPQA**         | Exact Match (Flexible)           | 0.3          | 0.5          | Nidum 3B demonstrates significant improvement, particularly in **generative tasks**.                |\n|                  | Accuracy                         | 0.4          | 0.5          | Consistent improvement, especially in **zero-shot** scenarios.                                      |\n| **HellaSwag**    | Accuracy                         | 0.3          | 0.4          | Better performance in **common sense reasoning** tasks.                                             |\n|                  | Normalized Accuracy              | 0.3          | 0.4          | Enhanced ability to understand and predict context in sentence completion.                          |\n|                  | Normalized Accuracy (Stderr)     | 0.15275      | 0.1633       | Slightly improved consistency in normalized accuracy.                                               |\n|                  | Accuracy (Stderr)                | 0.15275      | 0.1633       | Shows robustness in reasoning accuracy compared to LLaMA 3B.                                        |\n\n---\n\n### Insights:\n1. **GPQA Results**: Fine-tuning on uncensored data has boosted **Nidum 3B's Exact Match and Accuracy**, particularly excelling in **generative** and **zero-shot** tasks involving domain-specific knowledge.\n2. **HellaSwag Results**: **Nidum 3B** consistently outperforms **LLaMA 3B** in **common sense reasoning benchmarks**, indicating enhanced contextual and semantic understanding.\n\n---\n\n### Contributing\n\nWe welcome contributions to improve and extend the model’s capabilities. Stay tuned for updates on how to contribute.\n\n---\n\n### Contact\n\nFor inquiries, collaborations, or further information, please reach out to us at **info@nidum.ai**.\n\n---\n\n### Explore the Possibilities\n\nDive into unrestricted creativity and innovation with **Nidum Llama 3.2 3B Uncensored**!",
    "related_quantizations": []
  },
  "tags": [
    "adapter-transformers",
    "gguf",
    "chemistry",
    "biology",
    "legal",
    "code",
    "medical",
    "finance",
    "roleplay",
    "uncensored",
    "uncensored LLM",
    "text-generation",
    "base_model:meta-llama/Llama-3.2-3B",
    "base_model:adapter:meta-llama/Llama-3.2-3B",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 40,
  "downloads": 4451,
  "gated": false,
  "private": false,
  "last_modified": "2024-12-17T09:21:37.000Z",
  "created_at": "2024-12-05T04:55:35.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "adapter-transformers"
}

{
  "_id": "67513247473936b9581e5d6e",
  "id": "osmapi/Nidum-Llama-3.2-3B-Uncensored-GGUF",
  "modelId": "osmapi/Nidum-Llama-3.2-3B-Uncensored-GGUF",
  "sha": "0676b4281cc36b2d42933584d769fb11a8900332",
  "createdAt": "2024-12-05T04:55:35.000Z",
  "lastModified": "2024-12-17T09:21:37.000Z",
  "author": "osmapi",
  "downloads": 4451,
  "likes": 40,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "adapter-transformers",
  "siblings_count": 17
}