GraySoft
Projects Models About FAQ Contact Download guIDE →

epiculous/fett-uccine-long-noodle-7b-120k-context-gguf Q5_1 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

epiculous/fett-uccine-long-noodle-7b-120k-context-gguf overview

Fett-uccine-Long-Noodle-7B-120k-Context This is a merge of pre-trained language models created using mergekit.

transformersggufmergekitmergeendpoints_compatibleregion:usconversational
epiculous/fett-uccine-long-noodle-7b-120k-context-gguf visual
Downloads
85
Likes
6
Pipeline
Library
transformers
Visibility
Public
Access
Open

Repository Files & Downloads

12 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Fett-uccine-Long-Noodle-7B-120k-Context-IQ3_K_M.gguf GGUF IQ3_K_M 3.28 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-IQ3_K_S.gguf GGUF IQ3_K_S 2.95 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-IQ3_K_XS.gguf GGUF IQ3_K_XS 2.79 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-Q3_K_L.gguf GGUF Q3_K_L 3.56 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-Q4_K_M.gguf GGUF Q4_K_M 4.07 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-Q4_K_S.gguf GGUF Q4_K_S 3.86 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-Q5_1.gguf GGUF 5.07 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-Q5_K_M.gguf GGUF Q5_K_M 4.78 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-Q5_K_S.gguf GGUF Q5_K_S 4.65 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-Q6_K.gguf GGUF Q6_K 5.53 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-Q8_0.gguf GGUF 7.17 GB Download
Fett-uccine-Long-Noodle-7B-120k-Context-fp16.gguf GGUF 13.49 GB Download

Model Details Live

Model Slug
epiculous/fett-uccine-long-noodle-7b-120k-context-gguf
Author
Epiculous
Pipeline Task
Library
transformers
Created
2024-02-07
Last Modified
2024-02-08
Gated
No
Private
No
HF SHA
3aeff314dd126cba3f33e3679b1d5dd97cca7e61
License
Unknown
Language
Unknown
Base Model
[]

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "base_model": [],
    "library_name": "transformers",
    "tags": [
      "mergekit",
      "merge"
    ],
    "frontmatter": {
      "base_model": "[]",
      "library_name": "transformers",
      "tags": [
        "mergekit",
        "merge"
      ]
    },
    "hero_image_url": "",
    "summary": "# Fett-uccine-Long-Noodle-7B-120k-Context This is a merge of pre-trained language models created using mergekit.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: []\nlibrary_name: transformers\ntags:\n- mergekit\n- merge\n\n---\n# Fett-uccine-Long-Noodle-7B-120k-Context\n\nThis is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).\n\n## Merge Details\nA merge with Fett-uccine and Mistral Yarn 120k ctx.\n\nCredit to Nitral for the merge script and idea.\n### Merge Method\n\nThis model was merged using the SLERP merge method.\n\n### Models Merged\n\nThe following models were included in the merge:\n* Z:\\ModelColdStorage\\Yarn-Mistral-7b-128k\n* Z:\\ModelColdStorage\\Fett-uccine-7B\n\n### Configuration\n\nThe following YAML configuration was used to produce this model:\n\n```yaml\nslices:\n  - sources:\n      - model: Z:\\ModelColdStorage\\Fett-uccine-7B\n        layer_range: [0, 32]\n      - model: Z:\\ModelColdStorage\\Yarn-Mistral-7b-128k\n        layer_range: [0, 32]\nmerge_method: slerp\nbase_model: Z:\\ModelColdStorage\\Fett-uccine-7B\nparameters:\n  t:\n    - filter: self_attn\n      value: [0, 0.5, 0.3, 0.7, 1]\n    - filter: mlp\n      value: [1, 0.5, 0.7, 0.3, 0]\n    - value: 0.5\ndtype: bfloat16\n```\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "mergekit",
    "merge",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 6,
  "downloads": 85,
  "gated": false,
  "private": false,
  "last_modified": "2024-02-08T00:28:38.000Z",
  "created_at": "2024-02-07T20:37:41.000Z",
  "pipeline_tag": "",
  "library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "65c3ea1509672feb8c90c4e6",
  "id": "Epiculous/Fett-uccine-Long-Noodle-7B-120k-Context-GGUF",
  "modelId": "Epiculous/Fett-uccine-Long-Noodle-7B-120k-Context-GGUF",
  "sha": "3aeff314dd126cba3f33e3679b1d5dd97cca7e61",
  "createdAt": "2024-02-07T20:37:41.000Z",
  "lastModified": "2024-02-08T00:28:38.000Z",
  "author": "Epiculous",
  "downloads": 85,
  "likes": 6,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "transformers",
  "siblings_count": 15
}