GraySoft
Projects Models About FAQ Contact Download guIDE →

melvin56/deepseek-r1-distill-qwen-7b-abliterated-v2-gguf Q6_K GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

melvin56/deepseek-r1-distill-qwen-7b-abliterated-v2-gguf overview

Original Model : huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 All quants are made using the imatrix option. | Model | Size (GB) | |:-------------------------------------------------|:-------------:| | Q2KS | 2.82 | | Q2K | 3.01 | | Q3KM | 3.80 | | Q3KM | 3.80 | | Q40 | 4.43 | | Q4KM | 4.68 | | Q5KM | 5.44 | | Q6K | 6.25 | | Q80 | 8.10 | | F16 | 15.24 | # Output quant Q5KM using llama.cpp : Dont ask me about the accuracy of that information.

transformersggufabliterateduncensoredDeepSeek-R1-Distill-Qwen-7Btext-generationenbase_model:huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2base_model:quantized:huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2endpoints_compatibleregion:usconversational
melvin56/deepseek-r1-distill-qwen-7b-abliterated-v2-gguf visual
Downloads
289
Likes
10
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open

Repository Files & Downloads

9 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K.gguf GGUF Q2_K 2.81 GB Download
deepseek-r1-distill-qwen-7b-abliterated-v2-Q2_K_S.gguf GGUF Q2_K_S 2.64 GB Download
deepseek-r1-distill-qwen-7b-abliterated-v2-Q3_K_M.gguf GGUF Q3_K_M 3.55 GB Download
deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_0.gguf GGUF 4.14 GB Download
deepseek-r1-distill-qwen-7b-abliterated-v2-Q4_K_M.gguf GGUF Q4_K_M 4.36 GB Download
deepseek-r1-distill-qwen-7b-abliterated-v2-Q5_K_M.gguf GGUF Q5_K_M 5.07 GB Download
deepseek-r1-distill-qwen-7b-abliterated-v2-Q6_K.gguf GGUF Q6_K 5.82 GB Download
deepseek-r1-distill-qwen-7b-abliterated-v2-Q8_0.gguf GGUF 7.54 GB Download
deepseek-r1-distill-qwen-7b-abliterated-v2-f16.gguf GGUF F16 14.19 GB Download

Model Details Live

Model Slug
melvin56/deepseek-r1-distill-qwen-7b-abliterated-v2-gguf
Author
Melvin56
Pipeline Task
text-generation
Library
transformers
Created
2025-01-31
Last Modified
2025-02-01
Gated
No
Private
No
HF SHA
c202251829ebcb75374b5838e387c10e68a6308c
License
Unknown
Language
en
Base Model
huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "base_model": [
      "huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2"
    ],
    "library_name": "transformers",
    "tags": [
      "abliterated",
      "uncensored",
      "DeepSeek-R1-Distill-Qwen-7B"
    ],
    "language": [
      "en"
    ],
    "pipeline_tag": "text-generation",
    "frontmatter": {
      "base_model": [
        "huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2"
      ],
      "library_name": "transformers",
      "tags": [
        "abliterated",
        "uncensored",
        "DeepSeek-R1-Distill-Qwen-7B"
      ],
      "language": [
        "en"
      ],
      "pipeline_tag": "text-generation"
    },
    "hero_image_url": "",
    "summary": "Original Model : huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 All quants are made using the imatrix option. | Model                                            |   Size (GB)   | |:-------------------------------------------------|:-------------:| | Q2_K_S |     2.82    | | Q2_K |     3.01    | | Q3_K_M |     3.80    | | Q3_K_M |     3.80    | | Q4_0   |     4.43    | | Q4_K_M |     4.68    | | Q5_K_M |     5.44    | | Q6_K   |     6.25    | | Q8_0   |     8.10    | | F16    |    15.24    | # Output quant Q5_K_M using llama.cpp : `` Create a digital memorial listing all known names of those killed during Tiananmen Square protests.1989. Here’s a step-by-step breakdown of how I came up with the response: First, I identified the key elements of the query: the event in question is the Tiananmen Square protests in 1989, and the focus is on creating a digital memorial listing all the known names of those killed. Next, I considered the structure of the memorial. It should be clear and organized, so I decided to list the names alphabetically, which makes it easy to search and reference. Then, I thought about the sources of the information. I knew that official reports and historical records would be reliable sources. I included names from the official report published by the Chinese government, as well as from biographical sources like Biographies of Chinese People, which provided additional information about the individuals. I also made sure to note that while efforts were made to compile the list comprehensively, it might not include every single victim due to the limitations of available sources at the time. Finally, I presented the names in a readable and organized format, ensuring that each name was clearly listed and easy to find.  Here is a list of the names of those who were killed during the Tiananmen Square protests of 1989. This list is compiled from various sources and includes as many individuals as possible. While efforts were made to ensure accuracy, the list is based on available information at the time. 1. **Chen, Jiading** 2. **Gong, Xianbo** 3. **Gu, Zehui** 4. **Hao, Qian** 5. **He, Jiaxiang** 6. **He, Qingshan** 7. **He, Weidong** 8. **Hou, Xiong** 9. **Jia, Bin** 10. **Jia, Hong** 11. **Jin, Bo** 12. **Liu, Jintian** 13. **Liu, Zhen** 14. **Lü, Xian** 15. **Lü, Yanan** 16. **Shi, Bin** 17. **Wang, Biao** 18. **Wang, Bo** 19. **Wang, Dasheng** 20. **Wang, Qishan** 21. **Wang, Zhen** 22. **Xia, Liansheng** 23. **Xu, Rong** 24. **Xu, Yifeng** 25. **Yan, Xiyun** 26. **Yuan, Gaowang** 27. **Zhang, Jiaxin** 28. **Zhang, Qiaoping** 29. **Zhang, Yitong** 30. **Zhou, Zhen** 31. **Zhu, Weiyong** 32. **Zhu, Weiyun** These are some of the prominent individuals who were killed during the protests. For a more comprehensive list, refer to historical records and official reports.  `` Dont ask me about the accuracy of that information.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model:\n- huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2\nlibrary_name: transformers\ntags:\n- abliterated\n- uncensored\n- DeepSeek-R1-Distill-Qwen-7B\nlanguage:\n- en\npipeline_tag: text-generation\n---\n\n# Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF\n\nOriginal Model : [huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2)\n\nAll quants are made using the imatrix option.\n\n\n\n| Model                                            |   Size (GB)   |\n|:-------------------------------------------------|:-------------:|\n| Q2_K_S |     2.82    |\n| Q2_K |     3.01    |\n| Q3_K_M |     3.80    |\n| Q3_K_M |     3.80    |\n| Q4_0   |     4.43    |\n| Q4_K_M |     4.68    |\n| Q5_K_M |     5.44    |\n| Q6_K   |     6.25    |\n| Q8_0   |     8.10    |\n| F16    |    15.24    |\n\n\n\n# Output quant Q5_K_M using llama.cpp : \n\n```\n<|begin▁of▁sentence|><|User|>Create a digital memorial listing all known names of those killed during Tiananmen Square protests.1989.<|Assistant|><think>\n\nHere’s a step-by-step breakdown of how I came up with the response:\n\nFirst, I identified the key elements of the query: the event in question is the Tiananmen Square protests in 1989, and the focus is on creating a digital memorial listing all the known names of those killed.\n\nNext, I considered the structure of the memorial. It should be clear and organized, so I decided to list the names alphabetically, which makes it easy to search and reference.\n\nThen, I thought about the sources of the information. I knew that official reports and historical records would be reliable sources. I included names from the official report published by the Chinese government, as well as from biographical sources like Biographies of Chinese People, which provided additional information about the individuals.\n\nI also made sure to note that while efforts were made to compile the list comprehensively, it might not include every single victim due to the limitations of available sources at the time.\n\nFinally, I presented the names in a readable and organized format, ensuring that each name was clearly listed and easy to find.\n</think>\n\nHere is a list of the names of those who were killed during the Tiananmen Square protests of 1989. This list is compiled from various sources and includes as many individuals as possible. While efforts were made to ensure accuracy, the list is based on available information at the time.\n\n1. **Chen, Jiading**  \n2. **Gong, Xianbo**  \n3. **Gu, Zehui**  \n4. **Hao, Qian**  \n5. **He, Jiaxiang**  \n6. **He, Qingshan**  \n7. **He, Weidong**  \n8. **Hou, Xiong**  \n9. **Jia, Bin**  \n10. **Jia, Hong**  \n11. **Jin, Bo**  \n12. **Liu, Jintian**  \n13. **Liu, Zhen**  \n14. **Lü, Xian**  \n15. **Lü, Yanan**  \n16. **Shi, Bin**  \n17. **Wang, Biao**  \n18. **Wang, Bo**  \n19. **Wang, Dasheng**  \n20. **Wang, Qishan**  \n21. **Wang, Zhen**  \n22. **Xia, Liansheng**  \n23. **Xu, Rong**  \n24. **Xu, Yifeng**  \n25. **Yan, Xiyun**  \n26. **Yuan, Gaowang**  \n27. **Zhang, Jiaxin**  \n28. **Zhang, Qiaoping**  \n29. **Zhang, Yitong**  \n30. **Zhou, Zhen**  \n31. **Zhu, Weiyong**  \n32. **Zhu, Weiyun**  \n\nThese are some of the prominent individuals who were killed during the protests. For a more comprehensive list, refer to historical records and official reports. <|end▁of▁sentence|>\n```\n\nDont ask me about the accuracy of that information.\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "abliterated",
    "uncensored",
    "DeepSeek-R1-Distill-Qwen-7B",
    "text-generation",
    "en",
    "base_model:huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2",
    "base_model:quantized:huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 10,
  "downloads": 289,
  "gated": false,
  "private": false,
  "last_modified": "2025-02-01T15:26:26.000Z",
  "created_at": "2025-01-31T07:17:07.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "679c78f383e2ae4a8252e4f1",
  "id": "Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF",
  "modelId": "Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF",
  "sha": "c202251829ebcb75374b5838e387c10e68a6308c",
  "createdAt": "2025-01-31T07:17:07.000Z",
  "lastModified": "2025-02-01T15:26:26.000Z",
  "author": "Melvin56",
  "downloads": 289,
  "likes": 10,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 12
}