GraySoft
Projects Models About FAQ Contact Download guIDE →

brittlewis12/distilabeled-marcoro14-7b-slerp-full-gguf Q2_K GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

brittlewis12/distilabeled-marcoro14-7b-slerp-full-gguf overview

Original model: distilabeled-Marcoro14-7B-slerp-full Model creator: Argilla This repo contains GGUF format model files for Argilla’s distilabeled-Marcoro14-7B-slerp-full. As described on the original model card: This model is a new DPO fine-tune of our new open dataset argilla/distilabel-intel-orca-dpo-pairs, on the mlabonne/Marcoro14-7B-slerp model. You can find more information of the "distilabeled" dataset used at this repo argilla/distilabeled-Hermes-2.5-Mistral-7B, and visit distilabel. The difference between this model and argilla/distilabeled-Marcoro14-7B-slerp is that this model has been fine-tuned for a whole epoch instead instead of 200 steps, so it has seen the whole dataset. ### What is GGUF? GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 1879 (revision 3e5ca79) ### Prompt template: Unknown {{prompt}} ---

ggufdistilabeldporlaifrlhfmergemergekittext-generationendataset:argilla/distilabel-intel-orca-dpo-pairsbase_model:argilla/distilabeled-Marcoro14-7B-slerp-fullbase_model:quantized:argilla/distilabeled-Marcoro14-7B-slerp-fulllicense:apache-2.0region:us
brittlewis12/distilabeled-marcoro14-7b-slerp-full-gguf visual
Downloads
110
Likes
0
Pipeline
text-generation
Library
Visibility
Public
Access
Open

Repository Files & Downloads

8 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
distilabeled-marcoro14-7b-slerp-full.Q2_K.gguf GGUF Q2_K 2.52 GB Download
distilabeled-marcoro14-7b-slerp-full.Q3_K_L.gguf GGUF Q3_K_L 3.56 GB Download
distilabeled-marcoro14-7b-slerp-full.Q3_K_S.gguf GGUF Q3_K_S 2.95 GB Download
distilabeled-marcoro14-7b-slerp-full.Q4_K_M.gguf GGUF Q4_K_M 4.07 GB Download
distilabeled-marcoro14-7b-slerp-full.Q4_K_S.gguf GGUF Q4_K_S 3.86 GB Download
distilabeled-marcoro14-7b-slerp-full.Q5_K_M.gguf GGUF Q5_K_M 4.78 GB Download
distilabeled-marcoro14-7b-slerp-full.Q5_K_S.gguf GGUF Q5_K_S 4.65 GB Download
distilabeled-marcoro14-7b-slerp-full.Q6_K.gguf GGUF Q6_K 5.53 GB Download

Model Details Live

Model Slug
brittlewis12/distilabeled-marcoro14-7b-slerp-full-gguf
Author
brittlewis12
Pipeline Task
text-generation
Library
Created
2024-01-16
Last Modified
2024-01-21
Gated
No
Private
No
HF SHA
4298608856765e977e3ba8477813b56fe8bfd90f
License
apache-2.0
Language
en
Base Model
argilla/distilabeled-Marcoro14-7B-slerp-full

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "base_model": "argilla/distilabeled-Marcoro14-7B-slerp-full",
    "inference": false,
    "license": "apache-2.0",
    "language": [
      "en"
    ],
    "datasets": [
      "argilla/distilabel-intel-orca-dpo-pairs"
    ],
    "tags": [
      "distilabel",
      "dpo",
      "rlaif",
      "rlhf",
      "merge",
      "mergekit"
    ],
    "model_creator": "argilla",
    "model_name": "distilabeled-Marcoro14-7B-slerp-full",
    "model_type": "mistral",
    "pipeline_tag": "text-generation",
    "quantized_by": "brittlewis12",
    "frontmatter": {
      "base_model": "argilla/distilabeled-Marcoro14-7B-slerp-full",
      "inference": "false",
      "license": "apache-2.0",
      "language": [
        "en"
      ],
      "datasets": [
        "argilla/distilabel-intel-orca-dpo-pairs"
      ],
      "tags": [
        "distilabel",
        "dpo",
        "rlaif",
        "rlhf",
        "merge",
        "mergekit"
      ],
      "model_creator": "argilla",
      "model_name": "distilabeled-Marcoro14-7B-slerp-full",
      "model_type": "mistral",
      "pipeline_tag": "text-generation",
      "quantized_by": "brittlewis12"
    },
    "hero_image_url": "https://pbs.twimg.com/profile_images/1744049151241797632/0mIP-P9e_400x400.jpg",
    "summary": "Original model: distilabeled-Marcoro14-7B-slerp-full Model creator: Argilla This repo contains GGUF format model files for Argilla’s distilabeled-Marcoro14-7B-slerp-full. As described on the original model card: > This model is a new DPO fine-tune of our new open dataset argilla/distilabel-intel-orca-dpo-pairs, on the mlabonne/Marcoro14-7B-slerp model. You can find more information of the \"distilabeled\" dataset used at this repo argilla/distilabeled-Hermes-2.5-Mistral-7B, and visit distilabel. > > The difference between this model and argilla/distilabeled-Marcoro14-7B-slerp is that this model has been fine-tuned for a whole epoch instead instead of 200 steps, so it has seen the whole dataset. ### What is GGUF? GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 1879 (revision 3e5ca79) ### Prompt template: Unknown {{prompt}} ---",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: argilla/distilabeled-Marcoro14-7B-slerp-full\ninference: false\nlicense: apache-2.0\nlanguage:\n  - en\ndatasets:\n  - argilla/distilabel-intel-orca-dpo-pairs\ntags:\n  - distilabel\n  - dpo\n  - rlaif\n  - rlhf\n  - merge\n  - mergekit\nmodel_creator: argilla\nmodel_name: distilabeled-Marcoro14-7B-slerp-full\nmodel_type: mistral\npipeline_tag: text-generation\nquantized_by: brittlewis12\n---\n\n# distilabeled-Marcoro14-7B-slerp-full GGUF\n\nOriginal model: [distilabeled-Marcoro14-7B-slerp-full](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp-full)\nModel creator: [Argilla](https://huggingface.co/argilla)\n\nThis repo contains GGUF format model files for Argilla’s distilabeled-Marcoro14-7B-slerp-full.\n\nAs described on the original model card:\n> This model is a new DPO fine-tune of our new open dataset argilla/distilabel-intel-orca-dpo-pairs, on the mlabonne/Marcoro14-7B-slerp model. You can find more information of the \"distilabeled\" dataset used at this repo argilla/distilabeled-Hermes-2.5-Mistral-7B, and visit distilabel.\n> \n> The difference between this model and argilla/distilabeled-Marcoro14-7B-slerp is that this model has been fine-tuned for a whole epoch instead instead of 200 steps, so it has seen the whole dataset.\n\n\n\n### What is GGUF?\n\nGGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.\nConverted using llama.cpp build 1879 (revision [3e5ca79](https://github.com/ggerganov/llama.cpp/commit/3e5ca7931c68152e4ec18d126e9c832dd84914c8))\n\n### Prompt template: Unknown\n\n`{{prompt}}`\n\n---\n\n## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!\n\n![cnvrs.ai](https://pbs.twimg.com/profile_images/1744049151241797632/0mIP-P9e_400x400.jpg)\n\n[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:\n- create & save **Characters** with custom system prompts & temperature settings\n- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!\n- make it your own with custom **Theme colors**\n- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!\n- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!\n- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date\n\n---\n\n## Original Model Evaluations:\n\n|          Model          |AGIEval|GPT4ALL|TruthfulQA|Bigbench|Average|\n|-------------------------|------:|------:|---------:|-------:|------:|\n|[argilla/distilabeled-Marcoro14-7B-slerp-full](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp-full)|  45.17|  **76.59**|     64.68|   **48.15**|  **58.65**|\n|[argilla/distilabeled-Marcoro14-7B-slerp](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp)|   **45.4**|  76.47|     **65.46**|   47.19|  58.63|\n|[Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp)       |  44.66|  76.24|     64.15|   45.64|  57.67|\n|[argilla/distilabeled-Hermes-2.5-Mistral-7B](https://huggingface.co/argilla/distilabeled-Hermes-2.5-Mistral-7B)   |   44.64 |   73.35 |      55.96 |    42.21 |   54.04 |\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "distilabel",
    "dpo",
    "rlaif",
    "rlhf",
    "merge",
    "mergekit",
    "text-generation",
    "en",
    "dataset:argilla/distilabel-intel-orca-dpo-pairs",
    "base_model:argilla/distilabeled-Marcoro14-7B-slerp-full",
    "base_model:quantized:argilla/distilabeled-Marcoro14-7B-slerp-full",
    "license:apache-2.0",
    "region:us"
  ],
  "likes": 0,
  "downloads": 110,
  "gated": false,
  "private": false,
  "last_modified": "2024-01-21T04:43:58.000Z",
  "created_at": "2024-01-16T03:12:05.000Z",
  "pipeline_tag": "text-generation",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "65a5f4050a0bcd58962f0dec",
  "id": "brittlewis12/distilabeled-Marcoro14-7B-slerp-full-GGUF",
  "modelId": "brittlewis12/distilabeled-Marcoro14-7B-slerp-full-GGUF",
  "sha": "4298608856765e977e3ba8477813b56fe8bfd90f",
  "createdAt": "2024-01-16T03:12:05.000Z",
  "lastModified": "2024-01-21T04:43:58.000Z",
  "author": "brittlewis12",
  "downloads": 110,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "",
  "siblings_count": 10
}