GraySoft
Projects Models About FAQ Contact Download guIDE →

artefact2/mega-destroyer-8x7b-gguf Q5_K_S GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

artefact2/mega-destroyer-8x7b-gguf overview

These are GGUF quantized versions of FoxEngineAi/Mega-Destroyer-8x7B. The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw. Some model files above 50GB are split into smaller files. To concatenate them, use the cat command (on Windows, use PowerShell): cat foo-Q6K.gguf.* foo-Q6K.gguf What quant do I need? See https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 Want to steal my scripts? See https://gist.github.com/Artefact2/fd2254fc133906ac96b49b6947f0cd4a * Quant requests? Just open a discussion in the community tabs.

ggufenlicense:cc-by-4.0endpoints_compatibleregion:usconversational
artefact2/mega-destroyer-8x7b-gguf visual
Downloads
171
Likes
5
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

15 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Mega-Destroyer-8x7B-IQ1_S.gguf GGUF IQ1_S 9.15 GB Download
Mega-Destroyer-8x7B-IQ2_M.gguf GGUF IQ2_M 14.43 GB Download
Mega-Destroyer-8x7B-IQ2_S.gguf GGUF IQ2_S 13.16 GB Download
Mega-Destroyer-8x7B-IQ2_XS.gguf GGUF IQ2_XS 12.97 GB Download
Mega-Destroyer-8x7B-IQ2_XXS.gguf GGUF IQ2_XXS 11.69 GB Download
Mega-Destroyer-8x7B-IQ3_M.gguf GGUF IQ3_M 19.96 GB Download
Mega-Destroyer-8x7B-IQ3_S.gguf GGUF IQ3_S 19.03 GB Download
Mega-Destroyer-8x7B-IQ3_XS.gguf GGUF IQ3_XS 17.96 GB Download
Mega-Destroyer-8x7B-IQ3_XXS.gguf GGUF IQ3_XXS 16.99 GB Download
Mega-Destroyer-8x7B-IQ4_XS.gguf GGUF IQ4_XS 23.36 GB Download
Mega-Destroyer-8x7B-Q4_K_M.gguf GGUF Q4_K_M 26.49 GB Download
Mega-Destroyer-8x7B-Q4_K_S.gguf GGUF Q4_K_S 24.91 GB Download
Mega-Destroyer-8x7B-Q5_K_M.gguf GGUF Q5_K_M 30.95 GB Download
Mega-Destroyer-8x7B-Q5_K_S.gguf GGUF Q5_K_S 30.02 GB Download
Mega-Destroyer-8x7B-Q6_K.gguf GGUF Q6_K 35.74 GB Download

Model Details Live

Model Slug
artefact2/mega-destroyer-8x7b-gguf
Author
Artefact2
Pipeline Task
Library
Created
2024-03-14
Last Modified
2024-03-17
Gated
No
Private
No
HF SHA
19749fa0bcf930b0e9df558f9b0d2f77cc435388
License
cc-by-4.0
Language
en
Base Model
Unknown

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "language": [
      "en"
    ],
    "license": "cc-by-4.0",
    "frontmatter": {
      "language": [
        "en"
      ],
      "license": "cc-by-4.0"
    },
    "hero_image_url": "",
    "summary": "These are GGUF quantized versions of FoxEngineAi/Mega-Destroyer-8x7B. The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw. Some model files above 50GB are split into smaller files. To concatenate them, use the cat command (on Windows, use PowerShell): cat foo-Q6_K.gguf.* > foo-Q6_K.gguf * What quant do I need? See https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 * Want to steal my scripts? See https://gist.github.com/Artefact2/fd2254fc133906ac96b49b6947f0cd4a * Quant requests? Just open a discussion in the community tabs.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlanguage:\n- en\nlicense: cc-by-4.0\n---\n\nThese are GGUF quantized versions of [FoxEngineAi/Mega-Destroyer-8x7B](https://huggingface.co/FoxEngineAi/Mega-Destroyer-8x7B).\n\nThe importance matrix was trained for 100K tokens (200 batches of 512 tokens) using `wiki.train.raw`.\n\nSome model files above 50GB are split into smaller files. To concatenate them, use the `cat` command (on Windows, use PowerShell): `cat foo-Q6_K.gguf.* > foo-Q6_K.gguf`\n\n* What quant do I need? See https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9\n* Want to steal my scripts? See https://gist.github.com/Artefact2/fd2254fc133906ac96b49b6947f0cd4a\n* Quant requests? Just open a discussion in the community tabs.",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "en",
    "license:cc-by-4.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 5,
  "downloads": 171,
  "gated": false,
  "private": false,
  "last_modified": "2024-03-17T03:33:40.000Z",
  "created_at": "2024-03-14T11:18:53.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "65f2dd1d68c4a3ebd97afe11",
  "id": "Artefact2/Mega-Destroyer-8x7B-GGUF",
  "modelId": "Artefact2/Mega-Destroyer-8x7B-GGUF",
  "sha": "19749fa0bcf930b0e9df558f9b0d2f77cc435388",
  "createdAt": "2024-03-14T11:18:53.000Z",
  "lastModified": "2024-03-17T03:33:40.000Z",
  "author": "Artefact2",
  "downloads": 171,
  "likes": 5,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 18
}