GraySoft
Projects Models About FAQ Contact Download guIDE →

cstr/salamandra-7b-instruct-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

cstr/salamandra-7b-instruct-gguf overview

Experimental GGUF quantization of BSC-LT/salamandra-7b-instruct from llama.cpp (older version b2750). Use with common ChatLM template. Below the start of the original Model Card, check it for more details. # Salamandra Model Card Salamandra comes in three different sizes — 2B, 7B and 40B parameters — with their respective base and instruction-tuned variants. This model card corresponds to the 7B instructed version. To visit the model cards of other Salamandra versions, please refer to the Model Index. The entire Salamandra family is released under a permissive Apache 2.0 license). Along with the open weights, all training scripts and configuration files are made publicly available in this GitHub repository. DISCLAIMER: This model is a first proof-of-concept designed to demonstrate the instruction-following capabilities of recently released base models. It has been optimized to engage in conversation but has NOT been aligned through RLHF to filter or avoid sensitive topics. As a result, it may generate harmful or inappropriate content. The team is actively working to enhance its performance through further instruction and alignment with RL techniques.

transformersgguftext-generationbgcacodecscydadeeleneseteufifrgaglhrhuitltlvmtnlnnnoocpl
cstr/salamandra-7b-instruct-gguf visual
Downloads
1,050
Likes
2
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open

Repository Files & Downloads

1 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
salamandra-7b-instruct.Q4_K_M-f32.gguf GGUF Q4_K_M 4.52 GB Download

Model Details Live

Model Slug
cstr/salamandra-7b-instruct-gguf
Author
cstr
Pipeline Task
text-generation
Library
transformers
Created
2024-10-03
Last Modified
2024-10-03
Gated
No
Private
No
HF SHA
6cd240cee8f33a2ffd9b1f9e4b84d339965578a8
License
apache-2.0
Language
bg, ca, code, cs, cy, da, de, el, en, es, et, eu, fi, fr, ga, gl, hr, hu, it, lt, lv, mt, nl, nn, 'no', oc, pl, pt, ro, ru, sh, sk, sl, sr, sv, uk
Base Model
BSC-LT/salamandra-7b-instruct

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "apache-2.0",
    "library_name": "transformers",
    "pipeline_tag": "text-generation",
    "language": [
      "bg",
      "ca",
      "code",
      "cs",
      "cy",
      "da",
      "de",
      "el",
      "en",
      "es",
      "et",
      "eu",
      "fi",
      "fr",
      "ga",
      "gl",
      "hr",
      "hu",
      "it",
      "lt",
      "lv",
      "mt",
      "nl",
      "nn",
      "no",
      "oc",
      "pl",
      "pt",
      "ro",
      "ru",
      "sh",
      "sk",
      "sl",
      "sr",
      "sv",
      "uk"
    ],
    "base_model": [
      "BSC-LT/salamandra-7b-instruct"
    ],
    "frontmatter": {
      "license": "apache-2.0",
      "library_name": "transformers",
      "pipeline_tag": "text-generation",
      "language": [
        "bg",
        "ca",
        "code",
        "cs",
        "cy",
        "da",
        "de",
        "el",
        "en",
        "es",
        "et",
        "eu",
        "fi",
        "fr",
        "ga",
        "gl",
        "hr",
        "hu",
        "it",
        "lt",
        "lv",
        "mt",
        "nl",
        "nn",
        "'no'",
        "oc",
        "pl",
        "pt",
        "ro",
        "ru",
        "sh",
        "sk",
        "sl",
        "sr",
        "sv",
        "uk"
      ],
      "base_model": [
        "BSC-LT/salamandra-7b-instruct"
      ]
    },
    "hero_image_url": "",
    "summary": "Experimental GGUF quantization of BSC-LT/salamandra-7b-instruct from llama.cpp (older version b2750). Use with common ChatLM template. Below the start of the original Model Card, check it for more details. # Salamandra Model Card Salamandra comes in three different sizes — 2B, 7B and 40B parameters — with their respective base and instruction-tuned variants. This model card corresponds to the 7B instructed version. To visit the model cards of other Salamandra versions, please refer to the Model Index. The entire Salamandra family is released under a permissive Apache 2.0 license). Along with the open weights, all training scripts and configuration files are made publicly available in this GitHub repository. > [!WARNING] > **DISCLAIMER:** This model is a first proof-of-concept designed to demonstrate the instruction-following capabilities of recently released base models. > It has been optimized to engage in conversation but has *NOT* been aligned through RLHF to filter or avoid sensitive topics. > As a result, it may generate harmful or inappropriate content. > The team is actively working to enhance its performance through further instruction and alignment with RL techniques.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: apache-2.0\nlibrary_name: transformers\npipeline_tag: text-generation\nlanguage:\n- bg\n- ca\n- code\n- cs\n- cy\n- da\n- de\n- el\n- en\n- es\n- et\n- eu\n- fi\n- fr\n- ga\n- gl\n- hr\n- hu\n- it\n- lt\n- lv\n- mt\n- nl\n- nn\n- 'no'\n- oc\n- pl\n- pt\n- ro\n- ru\n- sh\n- sk\n- sl\n- sr\n- sv\n- uk\nbase_model:\n- BSC-LT/salamandra-7b-instruct\n---\n\n# GGUF quants\n\nExperimental GGUF quantization of [BSC-LT/salamandra-7b-instruct](https://huggingface.co/BSC-LT/salamandra-7b-instruct/) from llama.cpp (older version b2750).\n\nUse with common ChatLM template.\n\nBelow the start of the original Model Card, check it for more details.\n\n# Salamandra Model Card\n\nSalamandra comes in three different sizes — 2B, 7B and 40B parameters — with their respective base and instruction-tuned variants. \nThis model card corresponds to the 7B instructed version.\n\nTo visit the model cards of other Salamandra versions, please refer to the [Model Index](#model-index).\n\nThe entire Salamandra family is released under a permissive [Apache 2.0 license]((https://www.apache.org/licenses/LICENSE-2.0)).\nAlong with the open weights, all training scripts and configuration files are made publicly available in [this GitHub repository](https://github.com/langtech-bsc/salamandra).\n\n> [!WARNING]\n> **DISCLAIMER:** This model is a first proof-of-concept designed to demonstrate the instruction-following capabilities of recently released base models.\n> It has been optimized to engage in conversation but has *NOT* been aligned through RLHF to filter or avoid sensitive topics.\n> As a result, it may generate harmful or inappropriate content.\n> The team is actively working to enhance its performance through further instruction and alignment with RL techniques.",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "text-generation",
    "bg",
    "ca",
    "code",
    "cs",
    "cy",
    "da",
    "de",
    "el",
    "en",
    "es",
    "et",
    "eu",
    "fi",
    "fr",
    "ga",
    "gl",
    "hr",
    "hu",
    "it",
    "lt",
    "lv",
    "mt",
    "nl",
    "nn",
    "no",
    "oc",
    "pl",
    "pt",
    "ro",
    "ru",
    "sh",
    "sk",
    "sl",
    "sr",
    "sv",
    "uk",
    "base_model:BSC-LT/salamandra-7b-instruct",
    "base_model:quantized:BSC-LT/salamandra-7b-instruct",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 2,
  "downloads": 1050,
  "gated": false,
  "private": false,
  "last_modified": "2024-10-03T18:52:29.000Z",
  "created_at": "2024-10-03T08:04:01.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "66fe4ff1da291ca0870d3299",
  "id": "cstr/salamandra-7b-instruct-GGUF",
  "modelId": "cstr/salamandra-7b-instruct-GGUF",
  "sha": "6cd240cee8f33a2ffd9b1f9e4b84d339965578a8",
  "createdAt": "2024-10-03T08:04:01.000Z",
  "lastModified": "2024-10-03T18:52:29.000Z",
  "author": "cstr",
  "downloads": 1050,
  "likes": 2,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 3
}