cstr/salamandra-7b-instruct-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
cstr/salamandra-7b-instruct-gguf overview
Experimental GGUF quantization of BSC-LT/salamandra-7b-instruct from llama.cpp (older version b2750). Use with common ChatLM template. Below the start of the original Model Card, check it for more details. # Salamandra Model Card Salamandra comes in three different sizes — 2B, 7B and 40B parameters — with their respective base and instruction-tuned variants. This model card corresponds to the 7B instructed version. To visit the model cards of other Salamandra versions, please refer to the Model Index. The entire Salamandra family is released under a permissive Apache 2.0 license). Along with the open weights, all training scripts and configuration files are made publicly available in this GitHub repository. DISCLAIMER: This model is a first proof-of-concept designed to demonstrate the instruction-following capabilities of recently released base models. It has been optimized to engage in conversation but has NOT been aligned through RLHF to filter or avoid sensitive topics. As a result, it may generate harmful or inappropriate content. The team is actively working to enhance its performance through further instruction and alignment with RL techniques.
Repository Files & Downloads
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| salamandra-7b-instruct.Q4_K_M-f32.gguf | GGUF | Q4_K_M | 4.52 GB | Download |
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"license": "apache-2.0",
"library_name": "transformers",
"pipeline_tag": "text-generation",
"language": [
"bg",
"ca",
"code",
"cs",
"cy",
"da",
"de",
"el",
"en",
"es",
"et",
"eu",
"fi",
"fr",
"ga",
"gl",
"hr",
"hu",
"it",
"lt",
"lv",
"mt",
"nl",
"nn",
"no",
"oc",
"pl",
"pt",
"ro",
"ru",
"sh",
"sk",
"sl",
"sr",
"sv",
"uk"
],
"base_model": [
"BSC-LT/salamandra-7b-instruct"
],
"frontmatter": {
"license": "apache-2.0",
"library_name": "transformers",
"pipeline_tag": "text-generation",
"language": [
"bg",
"ca",
"code",
"cs",
"cy",
"da",
"de",
"el",
"en",
"es",
"et",
"eu",
"fi",
"fr",
"ga",
"gl",
"hr",
"hu",
"it",
"lt",
"lv",
"mt",
"nl",
"nn",
"'no'",
"oc",
"pl",
"pt",
"ro",
"ru",
"sh",
"sk",
"sl",
"sr",
"sv",
"uk"
],
"base_model": [
"BSC-LT/salamandra-7b-instruct"
]
},
"hero_image_url": "",
"summary": "Experimental GGUF quantization of BSC-LT/salamandra-7b-instruct from llama.cpp (older version b2750). Use with common ChatLM template. Below the start of the original Model Card, check it for more details. # Salamandra Model Card Salamandra comes in three different sizes — 2B, 7B and 40B parameters — with their respective base and instruction-tuned variants. This model card corresponds to the 7B instructed version. To visit the model cards of other Salamandra versions, please refer to the Model Index. The entire Salamandra family is released under a permissive Apache 2.0 license). Along with the open weights, all training scripts and configuration files are made publicly available in this GitHub repository. > [!WARNING] > **DISCLAIMER:** This model is a first proof-of-concept designed to demonstrate the instruction-following capabilities of recently released base models. > It has been optimized to engage in conversation but has *NOT* been aligned through RLHF to filter or avoid sensitive topics. > As a result, it may generate harmful or inappropriate content. > The team is actively working to enhance its performance through further instruction and alignment with RL techniques.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlicense: apache-2.0\nlibrary_name: transformers\npipeline_tag: text-generation\nlanguage:\n- bg\n- ca\n- code\n- cs\n- cy\n- da\n- de\n- el\n- en\n- es\n- et\n- eu\n- fi\n- fr\n- ga\n- gl\n- hr\n- hu\n- it\n- lt\n- lv\n- mt\n- nl\n- nn\n- 'no'\n- oc\n- pl\n- pt\n- ro\n- ru\n- sh\n- sk\n- sl\n- sr\n- sv\n- uk\nbase_model:\n- BSC-LT/salamandra-7b-instruct\n---\n\n# GGUF quants\n\nExperimental GGUF quantization of [BSC-LT/salamandra-7b-instruct](https://huggingface.co/BSC-LT/salamandra-7b-instruct/) from llama.cpp (older version b2750).\n\nUse with common ChatLM template.\n\nBelow the start of the original Model Card, check it for more details.\n\n# Salamandra Model Card\n\nSalamandra comes in three different sizes — 2B, 7B and 40B parameters — with their respective base and instruction-tuned variants. \nThis model card corresponds to the 7B instructed version.\n\nTo visit the model cards of other Salamandra versions, please refer to the [Model Index](#model-index).\n\nThe entire Salamandra family is released under a permissive [Apache 2.0 license]((https://www.apache.org/licenses/LICENSE-2.0)).\nAlong with the open weights, all training scripts and configuration files are made publicly available in [this GitHub repository](https://github.com/langtech-bsc/salamandra).\n\n> [!WARNING]\n> **DISCLAIMER:** This model is a first proof-of-concept designed to demonstrate the instruction-following capabilities of recently released base models.\n> It has been optimized to engage in conversation but has *NOT* been aligned through RLHF to filter or avoid sensitive topics.\n> As a result, it may generate harmful or inappropriate content.\n> The team is actively working to enhance its performance through further instruction and alignment with RL techniques.",
"related_quantizations": []
},
"tags": [
"transformers",
"gguf",
"text-generation",
"bg",
"ca",
"code",
"cs",
"cy",
"da",
"de",
"el",
"en",
"es",
"et",
"eu",
"fi",
"fr",
"ga",
"gl",
"hr",
"hu",
"it",
"lt",
"lv",
"mt",
"nl",
"nn",
"no",
"oc",
"pl",
"pt",
"ro",
"ru",
"sh",
"sk",
"sl",
"sr",
"sv",
"uk",
"base_model:BSC-LT/salamandra-7b-instruct",
"base_model:quantized:BSC-LT/salamandra-7b-instruct",
"license:apache-2.0",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 2,
"downloads": 1050,
"gated": false,
"private": false,
"last_modified": "2024-10-03T18:52:29.000Z",
"created_at": "2024-10-03T08:04:01.000Z",
"pipeline_tag": "text-generation",
"library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "66fe4ff1da291ca0870d3299",
"id": "cstr/salamandra-7b-instruct-GGUF",
"modelId": "cstr/salamandra-7b-instruct-GGUF",
"sha": "6cd240cee8f33a2ffd9b1f9e4b84d339965578a8",
"createdAt": "2024-10-03T08:04:01.000Z",
"lastModified": "2024-10-03T18:52:29.000Z",
"author": "cstr",
"downloads": 1050,
"likes": 2,
"gated": false,
"private": false,
"pipeline_tag": "text-generation",
"library_name": "transformers",
"siblings_count": 3
}