itlwas/llama-3.1-8b-lexi-uncensored-v2-q4_k_m-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
itlwas/llama-3.1-8b-lexi-uncensored-v2-q4_k_m-gguf overview
This model was converted to GGUF format from Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.
Downloads
127
Likes
0
Pipeline
—
Library
transformers
Visibility
Public
Access
Open
Repository Files & Downloads
1 files detected
Direct downloads for all repository files
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| llama-3.1-8b-lexi-uncensored-v2-q4_k_m.gguf | GGUF | Q4_K_M | 4.58 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "llama3.1",
"library_name": "transformers",
"base_model": "Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2",
"tags": [
"llama-cpp",
"gguf-my-repo"
],
"model-index": [
{
"name": "Llama-3.1-8B-Lexi-Uncensored-V2",
"results": [
{
"task": {
"type": "text-generation",
"name": "Text Generation"
},
"dataset": {
"name": "IFEval (0-Shot)",
"type": "HuggingFaceH4/ifeval",
"args": {
"num_few_shot": 0
}
},
"metrics": [
{
"type": "inst_level_strict_acc and prompt_level_strict_acc",
"value": 77.92,
"name": "strict accuracy",
"verified": false
}
],
"source": {
"url": "https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2",
"name": "Open LLM Leaderboard"
}
},
{
"task": {
"type": "text-generation",
"name": "Text Generation"
},
"dataset": {
"name": "BBH (3-Shot)",
"type": "BBH",
"args": {
"num_few_shot": 3
}
},
"metrics": [
{
"type": "acc_norm",
"value": 29.69,
"name": "normalized accuracy",
"verified": false
}
],
"source": {
"url": "https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2",
"name": "Open LLM Leaderboard"
}
},
{
"task": {
"type": "text-generation",
"name": "Text Generation"
},
"dataset": {
"name": "MATH Lvl 5 (4-Shot)",
"type": "hendrycks/competition_math",
"args": {
"num_few_shot": 4
}
},
"metrics": [
{
"type": "exact_match",
"value": 16.92,
"name": "exact match",
"verified": false
}
],
"source": {
"url": "https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2",
"name": "Open LLM Leaderboard"
}
},
{
"task": {
"type": "text-generation",
"name": "Text Generation"
},
"dataset": {
"name": "GPQA (0-shot)",
"type": "Idavidrein/gpqa",
"args": {
"num_few_shot": 0
}
},
"metrics": [
{
"type": "acc_norm",
"value": 4.36,
"name": "acc_norm",
"verified": false
}
],
"source": {
"url": "https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2",
"name": "Open LLM Leaderboard"
}
},
{
"task": {
"type": "text-generation",
"name": "Text Generation"
},
"dataset": {
"name": "MuSR (0-shot)",
"type": "TAUR-Lab/MuSR",
"args": {
"num_few_shot": 0
}
},
"metrics": [
{
"type": "acc_norm",
"value": 7.77,
"name": "acc_norm",
"verified": false
}
],
"source": {
"url": "https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2",
"name": "Open LLM Leaderboard"
}
},
{
"task": {
"type": "text-generation",
"name": "Text Generation"
},
"dataset": {
"name": "MMLU-PRO (5-shot)",
"type": "TIGER-Lab/MMLU-Pro",
"config": "main",
"split": "test",
"args": {
"num_few_shot": 5
}
},
"metrics": [
{
"type": "acc",
"value": 30.9,
"name": "accuracy",
"verified": false
}
],
"source": {
"url": "https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2",
"name": "Open LLM Leaderboard"
}
}
]
}
],
"frontmatter": {
"license": "llama3.1",
"library_name": "transformers",
"base_model": "Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2",
"tags": [
"llama-cpp",
"gguf-my-repo",
"name: Llama-3.1-8B-Lexi-Uncensored-V2",
"task:",
"type: inst_level_strict_acc and prompt_level_strict_acc",
"task:",
"type: acc_norm",
"task:",
"type: exact_match",
"task:",
"type: acc_norm",
"task:",
"type: acc_norm",
"task:",
"type: acc"
]
},
"hero_image_url": "",
"summary": "This model was converted to GGUF format from Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: llama3.1\nlibrary_name: transformers\nbase_model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2\ntags:\n- llama-cpp\n- gguf-my-repo\nmodel-index:\n- name: Llama-3.1-8B-Lexi-Uncensored-V2\n results:\n - task:\n type: text-generation\n name: Text Generation\n dataset:\n name: IFEval (0-Shot)\n type: HuggingFaceH4/ifeval\n args:\n num_few_shot: 0\n metrics:\n - type: inst_level_strict_acc and prompt_level_strict_acc\n value: 77.92\n name: strict accuracy\n source:\n url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2\n name: Open LLM Leaderboard\n - task:\n type: text-generation\n name: Text Generation\n dataset:\n name: BBH (3-Shot)\n type: BBH\n args:\n num_few_shot: 3\n metrics:\n - type: acc_norm\n value: 29.69\n name: normalized accuracy\n source:\n url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2\n name: Open LLM Leaderboard\n - task:\n type: text-generation\n name: Text Generation\n dataset:\n name: MATH Lvl 5 (4-Shot)\n type: hendrycks/competition_math\n args:\n num_few_shot: 4\n metrics:\n - type: exact_match\n value: 16.92\n name: exact match\n source:\n url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2\n name: Open LLM Leaderboard\n - task:\n type: text-generation\n name: Text Generation\n dataset:\n name: GPQA (0-shot)\n type: Idavidrein/gpqa\n args:\n num_few_shot: 0\n metrics:\n - type: acc_norm\n value: 4.36\n name: acc_norm\n source:\n url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2\n name: Open LLM Leaderboard\n - task:\n type: text-generation\n name: Text Generation\n dataset:\n name: MuSR (0-shot)\n type: TAUR-Lab/MuSR\n args:\n num_few_shot: 0\n metrics:\n - type: acc_norm\n value: 7.77\n name: acc_norm\n source:\n url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2\n name: Open LLM Leaderboard\n - task:\n type: text-generation\n name: Text Generation\n dataset:\n name: MMLU-PRO (5-shot)\n type: TIGER-Lab/MMLU-Pro\n config: main\n split: test\n args:\n num_few_shot: 5\n metrics:\n - type: acc\n value: 30.9\n name: accuracy\n source:\n url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2\n name: Open LLM Leaderboard\n---\n\n# AIronMind/Llama-3.1-8B-Lexi-Uncensored-V2-Q4_K_M-GGUF\nThis model was converted to GGUF format from [`Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2`](https://huggingface.co/Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.\nRefer to the [original model card](https://huggingface.co/Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2) for more details on the model.\n\n## Use with llama.cpp\nInstall llama.cpp through brew (works on Mac and Linux)\n\n```bash\nbrew install llama.cpp\n\n```\nInvoke the llama.cpp server or the CLI.\n\n### CLI:\n```bash\nllama-cli --hf-repo AIronMind/Llama-3.1-8B-Lexi-Uncensored-V2-Q4_K_M-GGUF --hf-file llama-3.1-8b-lexi-uncensored-v2-q4_k_m.gguf -p \"The meaning to life and the universe is\"\n```\n\n### Server:\n```bash\nllama-server --hf-repo AIronMind/Llama-3.1-8B-Lexi-Uncensored-V2-Q4_K_M-GGUF --hf-file llama-3.1-8b-lexi-uncensored-v2-q4_k_m.gguf -c 2048\n```\n\nNote: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.\n\nStep 1: Clone llama.cpp from GitHub.\n```\ngit clone https://github.com/ggerganov/llama.cpp\n```\n\nStep 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).\n```\ncd llama.cpp && LLAMA_CURL=1 make\n```\n\nStep 3: Run inference through the main binary.\n```\n./llama-cli --hf-repo AIronMind/Llama-3.1-8B-Lexi-Uncensored-V2-Q4_K_M-GGUF --hf-file llama-3.1-8b-lexi-uncensored-v2-q4_k_m.gguf -p \"The meaning to life and the universe is\"\n```\nor \n```\n./llama-server --hf-repo AIronMind/Llama-3.1-8B-Lexi-Uncensored-V2-Q4_K_M-GGUF --hf-file llama-3.1-8b-lexi-uncensored-v2-q4_k_m.gguf -c 2048\n```\n",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"llama-cpp",
"gguf-my-repo",
"base_model:Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2",
"base_model:quantized:Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2",
"license:llama3.1",
"model-index",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 0,
"downloads": 127,
"gated": false,
"private": false,
"last_modified": "2024-12-29T13:44:14.000Z",
"created_at": "2024-12-29T13:43:51.000Z",
"pipeline_tag": "",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "67715217c898937d4cd95efa",
"id": "itlwas/Llama-3.1-8B-Lexi-Uncensored-V2-Q4_K_M-GGUF",
"modelId": "itlwas/Llama-3.1-8B-Lexi-Uncensored-V2-Q4_K_M-GGUF",
"sha": "40ca52e4691d5040c7ead6347b31521be47690a3",
"createdAt": "2024-12-29T13:43:51.000Z",
"lastModified": "2024-12-29T13:44:14.000Z",
"author": "itlwas",
"downloads": 127,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "",
"library_name": "transformers",
"siblings_count": 3
}