brittlewis12/distilabeled-marcoro14-7b-slerp-full-gguf Q2_K GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
brittlewis12/distilabeled-marcoro14-7b-slerp-full-gguf overview
Original model: distilabeled-Marcoro14-7B-slerp-full Model creator: Argilla This repo contains GGUF format model files for Argilla’s distilabeled-Marcoro14-7B-slerp-full. As described on the original model card: This model is a new DPO fine-tune of our new open dataset argilla/distilabel-intel-orca-dpo-pairs, on the mlabonne/Marcoro14-7B-slerp model. You can find more information of the "distilabeled" dataset used at this repo argilla/distilabeled-Hermes-2.5-Mistral-7B, and visit distilabel. The difference between this model and argilla/distilabeled-Marcoro14-7B-slerp is that this model has been fine-tuned for a whole epoch instead instead of 200 steps, so it has seen the whole dataset. ### What is GGUF? GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 1879 (revision 3e5ca79) ### Prompt template: Unknown {{prompt}} ---
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| distilabeled-marcoro14-7b-slerp-full.Q2_K.gguf | GGUF | Q2_K | 2.52 GB | Download |
| distilabeled-marcoro14-7b-slerp-full.Q3_K_L.gguf | GGUF | Q3_K_L | 3.56 GB | Download |
| distilabeled-marcoro14-7b-slerp-full.Q3_K_S.gguf | GGUF | Q3_K_S | 2.95 GB | Download |
| distilabeled-marcoro14-7b-slerp-full.Q4_K_M.gguf | GGUF | Q4_K_M | 4.07 GB | Download |
| distilabeled-marcoro14-7b-slerp-full.Q4_K_S.gguf | GGUF | Q4_K_S | 3.86 GB | Download |
| distilabeled-marcoro14-7b-slerp-full.Q5_K_M.gguf | GGUF | Q5_K_M | 4.78 GB | Download |
| distilabeled-marcoro14-7b-slerp-full.Q5_K_S.gguf | GGUF | Q5_K_S | 4.65 GB | Download |
| distilabeled-marcoro14-7b-slerp-full.Q6_K.gguf | GGUF | Q6_K | 5.53 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"base_model": "argilla/distilabeled-Marcoro14-7B-slerp-full",
"inference": false,
"license": "apache-2.0",
"language": [
"en"
],
"datasets": [
"argilla/distilabel-intel-orca-dpo-pairs"
],
"tags": [
"distilabel",
"dpo",
"rlaif",
"rlhf",
"merge",
"mergekit"
],
"model_creator": "argilla",
"model_name": "distilabeled-Marcoro14-7B-slerp-full",
"model_type": "mistral",
"pipeline_tag": "text-generation",
"quantized_by": "brittlewis12",
"frontmatter": {
"base_model": "argilla/distilabeled-Marcoro14-7B-slerp-full",
"inference": "false",
"license": "apache-2.0",
"language": [
"en"
],
"datasets": [
"argilla/distilabel-intel-orca-dpo-pairs"
],
"tags": [
"distilabel",
"dpo",
"rlaif",
"rlhf",
"merge",
"mergekit"
],
"model_creator": "argilla",
"model_name": "distilabeled-Marcoro14-7B-slerp-full",
"model_type": "mistral",
"pipeline_tag": "text-generation",
"quantized_by": "brittlewis12"
},
"hero_image_url": "https://pbs.twimg.com/profile_images/1744049151241797632/0mIP-P9e_400x400.jpg",
"summary": "Original model: distilabeled-Marcoro14-7B-slerp-full Model creator: Argilla This repo contains GGUF format model files for Argilla’s distilabeled-Marcoro14-7B-slerp-full. As described on the original model card: > This model is a new DPO fine-tune of our new open dataset argilla/distilabel-intel-orca-dpo-pairs, on the mlabonne/Marcoro14-7B-slerp model. You can find more information of the \"distilabeled\" dataset used at this repo argilla/distilabeled-Hermes-2.5-Mistral-7B, and visit distilabel. > > The difference between this model and argilla/distilabeled-Marcoro14-7B-slerp is that this model has been fine-tuned for a whole epoch instead instead of 200 steps, so it has seen the whole dataset. ### What is GGUF? GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 1879 (revision 3e5ca79) ### Prompt template: Unknown {{prompt}} ---",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nbase_model: argilla/distilabeled-Marcoro14-7B-slerp-full\ninference: false\nlicense: apache-2.0\nlanguage:\n - en\ndatasets:\n - argilla/distilabel-intel-orca-dpo-pairs\ntags:\n - distilabel\n - dpo\n - rlaif\n - rlhf\n - merge\n - mergekit\nmodel_creator: argilla\nmodel_name: distilabeled-Marcoro14-7B-slerp-full\nmodel_type: mistral\npipeline_tag: text-generation\nquantized_by: brittlewis12\n---\n\n# distilabeled-Marcoro14-7B-slerp-full GGUF\n\nOriginal model: [distilabeled-Marcoro14-7B-slerp-full](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp-full)\nModel creator: [Argilla](https://huggingface.co/argilla)\n\nThis repo contains GGUF format model files for Argilla’s distilabeled-Marcoro14-7B-slerp-full.\n\nAs described on the original model card:\n> This model is a new DPO fine-tune of our new open dataset argilla/distilabel-intel-orca-dpo-pairs, on the mlabonne/Marcoro14-7B-slerp model. You can find more information of the \"distilabeled\" dataset used at this repo argilla/distilabeled-Hermes-2.5-Mistral-7B, and visit distilabel.\n> \n> The difference between this model and argilla/distilabeled-Marcoro14-7B-slerp is that this model has been fine-tuned for a whole epoch instead instead of 200 steps, so it has seen the whole dataset.\n\n\n\n### What is GGUF?\n\nGGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.\nConverted using llama.cpp build 1879 (revision [3e5ca79](https://github.com/ggerganov/llama.cpp/commit/3e5ca7931c68152e4ec18d126e9c832dd84914c8))\n\n### Prompt template: Unknown\n\n`{{prompt}}`\n\n---\n\n## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!\n\n\n\n[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:\n- create & save **Characters** with custom system prompts & temperature settings\n- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!\n- make it your own with custom **Theme colors**\n- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!\n- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!\n- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date\n\n---\n\n## Original Model Evaluations:\n\n| Model |AGIEval|GPT4ALL|TruthfulQA|Bigbench|Average|\n|-------------------------|------:|------:|---------:|-------:|------:|\n|[argilla/distilabeled-Marcoro14-7B-slerp-full](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp-full)| 45.17| **76.59**| 64.68| **48.15**| **58.65**|\n|[argilla/distilabeled-Marcoro14-7B-slerp](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp)| **45.4**| 76.47| **65.46**| 47.19| 58.63|\n|[Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp) | 44.66| 76.24| 64.15| 45.64| 57.67|\n|[argilla/distilabeled-Hermes-2.5-Mistral-7B](https://huggingface.co/argilla/distilabeled-Hermes-2.5-Mistral-7B) | 44.64 | 73.35 | 55.96 | 42.21 | 54.04 |\n",
"related_quantizations": []
},
"tags": [
"gguf",
"distilabel",
"dpo",
"rlaif",
"rlhf",
"merge",
"mergekit",
"text-generation",
"en",
"dataset:argilla/distilabel-intel-orca-dpo-pairs",
"base_model:argilla/distilabeled-Marcoro14-7B-slerp-full",
"base_model:quantized:argilla/distilabeled-Marcoro14-7B-slerp-full",
"license:apache-2.0",
"region:us"
],
"likes": 0,
"downloads": 110,
"gated": false,
"private": false,
"last_modified": "2024-01-21T04:43:58.000Z",
"created_at": "2024-01-16T03:12:05.000Z",
"pipeline_tag": "text-generation",
"library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
"_id": "65a5f4050a0bcd58962f0dec",
"id": "brittlewis12/distilabeled-Marcoro14-7B-slerp-full-GGUF",
"modelId": "brittlewis12/distilabeled-Marcoro14-7B-slerp-full-GGUF",
"sha": "4298608856765e977e3ba8477813b56fe8bfd90f",
"createdAt": "2024-01-16T03:12:05.000Z",
"lastModified": "2024-01-21T04:43:58.000Z",
"author": "brittlewis12",
"downloads": 110,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "",
"siblings_count": 10
}