GraySoft
Projects Models About FAQ Contact Download guIDE →
Model Intelligence Sheet

noxinc/gemma-portuguese-tom-cat-2b-it-q4_k_m-gguf-ptbr overview

This model was converted to GGUF format from rhaymison/gemma-portuguese-tom-cat-2b-it using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.

transformersggufportuguesebrasilgemmaportuguesinstrucaollama-cppgguf-my-repotext-generationptdataset:rhaymison/supersetbase_model:google/gemma-2b-itbase_model:quantized:google/gemma-2b-itlicense:apache-2.0model-indexendpoints_compatibleregion:usconversational
noxinc/gemma-portuguese-tom-cat-2b-it-q4_k_m-gguf-ptbr visual
Downloads
104
Likes
0
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open

Repository Files & Downloads

1 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
gemma-portuguese-tom-cat-2b-it.Q4_K_M.gguf GGUF Q4_K_M 1.52 GB Download

Model Details Live

Model Slug
noxinc/gemma-portuguese-tom-cat-2b-it-q4_k_m-gguf-ptbr
Author
noxinc
Pipeline Task
text-generation
Library
transformers
Created
2024-05-07
Last Modified
2024-05-07
Gated
No
Private
No
HF SHA
e55de3093f65efc87794bf1534573659784124c9
License
apache-2.0
Language
pt
Base Model
google/gemma-2b-it

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "language": [
      "pt"
    ],
    "license": "apache-2.0",
    "library_name": "transformers",
    "tags": [
      "portuguese",
      "brasil",
      "gemma",
      "portugues",
      "instrucao",
      "llama-cpp",
      "gguf-my-repo"
    ],
    "base_model": "google/gemma-2b-it",
    "datasets": [
      "rhaymison/superset"
    ],
    "pipeline_tag": "text-generation",
    "model-index": [
      {
        "name": "gemma-portuguese-tom-cat-2b-it",
        "results": [
          {
            "task": {
              "type": "text-generation",
              "name": "Text Generation"
            },
            "dataset": {
              "name": "ENEM Challenge (No Images)",
              "type": "eduagarcia/enem_challenge",
              "split": "train",
              "args": {
                "num_few_shot": 3
              }
            },
            "metrics": [
              {
                "type": "acc",
                "value": 27.71,
                "name": "accuracy",
                "verified": false
              }
            ],
            "source": {
              "url": "https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it",
              "name": "Open Portuguese LLM Leaderboard"
            }
          },
          {
            "task": {
              "type": "text-generation",
              "name": "Text Generation"
            },
            "dataset": {
              "name": "BLUEX (No Images)",
              "type": "eduagarcia-temp/BLUEX_without_images",
              "split": "train",
              "args": {
                "num_few_shot": 3
              }
            },
            "metrics": [
              {
                "type": "acc",
                "value": 29.07,
                "name": "accuracy",
                "verified": false
              }
            ],
            "source": {
              "url": "https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it",
              "name": "Open Portuguese LLM Leaderboard"
            }
          },
          {
            "task": {
              "type": "text-generation",
              "name": "Text Generation"
            },
            "dataset": {
              "name": "OAB Exams",
              "type": "eduagarcia/oab_exams",
              "split": "train",
              "args": {
                "num_few_shot": 3
              }
            },
            "metrics": [
              {
                "type": "acc",
                "value": 27.97,
                "name": "accuracy",
                "verified": false
              }
            ],
            "source": {
              "url": "https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it",
              "name": "Open Portuguese LLM Leaderboard"
            }
          },
          {
            "task": {
              "type": "text-generation",
              "name": "Text Generation"
            },
            "dataset": {
              "name": "Assin2 RTE",
              "type": "assin2",
              "split": "test",
              "args": {
                "num_few_shot": 15
              }
            },
            "metrics": [
              {
                "type": "f1_macro",
                "value": 46.84,
                "name": "f1-macro",
                "verified": false
              }
            ],
            "source": {
              "url": "https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it",
              "name": "Open Portuguese LLM Leaderboard"
            }
          },
          {
            "task": {
              "type": "text-generation",
              "name": "Text Generation"
            },
            "dataset": {
              "name": "Assin2 STS",
              "type": "eduagarcia/portuguese_benchmark",
              "split": "test",
              "args": {
                "num_few_shot": 15
              }
            },
            "metrics": [
              {
                "type": "pearson",
                "value": 14.06,
                "name": "pearson",
                "verified": false
              }
            ],
            "source": {
              "url": "https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it",
              "name": "Open Portuguese LLM Leaderboard"
            }
          },
          {
            "task": {
              "type": "text-generation",
              "name": "Text Generation"
            },
            "dataset": {
              "name": "FaQuAD NLI",
              "type": "ruanchaves/faquad-nli",
              "split": "test",
              "args": {
                "num_few_shot": 15
              }
            },
            "metrics": [
              {
                "type": "f1_macro",
                "value": 29.39,
                "name": "f1-macro",
                "verified": false
              }
            ],
            "source": {
              "url": "https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it",
              "name": "Open Portuguese LLM Leaderboard"
            }
          },
          {
            "task": {
              "type": "text-generation",
              "name": "Text Generation"
            },
            "dataset": {
              "name": "HateBR Binary",
              "type": "ruanchaves/hatebr",
              "split": "test",
              "args": {
                "num_few_shot": 25
              }
            },
            "metrics": [
              {
                "type": "f1_macro",
                "value": 46.59,
                "name": "f1-macro",
                "verified": false
              }
            ],
            "source": {
              "url": "https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it",
              "name": "Open Portuguese LLM Leaderboard"
            }
          },
          {
            "task": {
              "type": "text-generation",
              "name": "Text Generation"
            },
            "dataset": {
              "name": "PT Hate Speech Binary",
              "type": "hate_speech_portuguese",
              "split": "test",
              "args": {
                "num_few_shot": 25
              }
            },
            "metrics": [
              {
                "type": "f1_macro",
                "value": 45.36,
                "name": "f1-macro",
                "verified": false
              }
            ],
            "source": {
              "url": "https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it",
              "name": "Open Portuguese LLM Leaderboard"
            }
          },
          {
            "task": {
              "type": "text-generation",
              "name": "Text Generation"
            },
            "dataset": {
              "name": "tweetSentBR",
              "type": "eduagarcia/tweetsentbr_fewshot",
              "split": "test",
              "args": {
                "num_few_shot": 25
              }
            },
            "metrics": [
              {
                "type": "f1_macro",
                "value": 18.86,
                "name": "f1-macro",
                "verified": false
              }
            ],
            "source": {
              "url": "https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it",
              "name": "Open Portuguese LLM Leaderboard"
            }
          }
        ]
      }
    ],
    "frontmatter": {
      "language": [
        "pt"
      ],
      "license": "apache-2.0",
      "library_name": "transformers",
      "tags": [
        "portuguese",
        "brasil",
        "gemma",
        "portugues",
        "instrucao",
        "llama-cpp",
        "gguf-my-repo"
      ],
      "base_model": "google/gemma-2b-it",
      "datasets": [
        "rhaymison/superset"
      ],
      "pipeline_tag": [
        "name: gemma-portuguese-tom-cat-2b-it",
        "task:",
        "type: acc",
        "task:",
        "type: acc",
        "task:",
        "type: acc",
        "task:",
        "type: f1_macro",
        "task:",
        "type: pearson",
        "task:",
        "type: f1_macro",
        "task:",
        "type: f1_macro",
        "task:",
        "type: f1_macro",
        "task:",
        "type: f1_macro"
      ]
    },
    "hero_image_url": "",
    "summary": "This model was converted to GGUF format from rhaymison/gemma-portuguese-tom-cat-2b-it using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlanguage:\n- pt\nlicense: apache-2.0\nlibrary_name: transformers\ntags:\n- portuguese\n- brasil\n- gemma\n- portugues\n- instrucao\n- llama-cpp\n- gguf-my-repo\nbase_model: google/gemma-2b-it\ndatasets:\n- rhaymison/superset\npipeline_tag: text-generation\nmodel-index:\n- name: gemma-portuguese-tom-cat-2b-it\n  results:\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: ENEM Challenge (No Images)\n      type: eduagarcia/enem_challenge\n      split: train\n      args:\n        num_few_shot: 3\n    metrics:\n    - type: acc\n      value: 27.71\n      name: accuracy\n    source:\n      url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it\n      name: Open Portuguese LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: BLUEX (No Images)\n      type: eduagarcia-temp/BLUEX_without_images\n      split: train\n      args:\n        num_few_shot: 3\n    metrics:\n    - type: acc\n      value: 29.07\n      name: accuracy\n    source:\n      url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it\n      name: Open Portuguese LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: OAB Exams\n      type: eduagarcia/oab_exams\n      split: train\n      args:\n        num_few_shot: 3\n    metrics:\n    - type: acc\n      value: 27.97\n      name: accuracy\n    source:\n      url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it\n      name: Open Portuguese LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: Assin2 RTE\n      type: assin2\n      split: test\n      args:\n        num_few_shot: 15\n    metrics:\n    - type: f1_macro\n      value: 46.84\n      name: f1-macro\n    source:\n      url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it\n      name: Open Portuguese LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: Assin2 STS\n      type: eduagarcia/portuguese_benchmark\n      split: test\n      args:\n        num_few_shot: 15\n    metrics:\n    - type: pearson\n      value: 14.06\n      name: pearson\n    source:\n      url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it\n      name: Open Portuguese LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: FaQuAD NLI\n      type: ruanchaves/faquad-nli\n      split: test\n      args:\n        num_few_shot: 15\n    metrics:\n    - type: f1_macro\n      value: 29.39\n      name: f1-macro\n    source:\n      url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it\n      name: Open Portuguese LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: HateBR Binary\n      type: ruanchaves/hatebr\n      split: test\n      args:\n        num_few_shot: 25\n    metrics:\n    - type: f1_macro\n      value: 46.59\n      name: f1-macro\n    source:\n      url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it\n      name: Open Portuguese LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: PT Hate Speech Binary\n      type: hate_speech_portuguese\n      split: test\n      args:\n        num_few_shot: 25\n    metrics:\n    - type: f1_macro\n      value: 45.36\n      name: f1-macro\n    source:\n      url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it\n      name: Open Portuguese LLM Leaderboard\n  - task:\n      type: text-generation\n      name: Text Generation\n    dataset:\n      name: tweetSentBR\n      type: eduagarcia/tweetsentbr_fewshot\n      split: test\n      args:\n        num_few_shot: 25\n    metrics:\n    - type: f1_macro\n      value: 18.86\n      name: f1-macro\n    source:\n      url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-tom-cat-2b-it\n      name: Open Portuguese LLM Leaderboard\n---\n\n# noxinc/gemma-portuguese-tom-cat-2b-it-Q4_K_M-GGUF\nThis model was converted to GGUF format from [`rhaymison/gemma-portuguese-tom-cat-2b-it`](https://huggingface.co/rhaymison/gemma-portuguese-tom-cat-2b-it) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.\nRefer to the [original model card](https://huggingface.co/rhaymison/gemma-portuguese-tom-cat-2b-it) for more details on the model.\n## Use with llama.cpp\n\nInstall llama.cpp through brew.\n\n```bash\nbrew install ggerganov/ggerganov/llama.cpp\n```\nInvoke the llama.cpp server or the CLI.\n\nCLI:\n\n```bash\nllama-cli --hf-repo noxinc/gemma-portuguese-tom-cat-2b-it-Q4_K_M-GGUF --model gemma-portuguese-tom-cat-2b-it.Q4_K_M.gguf -p \"The meaning to life and the universe is\"\n```\n\nServer:\n\n```bash\nllama-server --hf-repo noxinc/gemma-portuguese-tom-cat-2b-it-Q4_K_M-GGUF --model gemma-portuguese-tom-cat-2b-it.Q4_K_M.gguf -c 2048\n```\n\nNote: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.\n\n```\ngit clone https://github.com/ggerganov/llama.cpp &&             cd llama.cpp &&             make &&             ./main -m gemma-portuguese-tom-cat-2b-it.Q4_K_M.gguf -n 128\n```\n",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "gguf",
    "portuguese",
    "brasil",
    "gemma",
    "portugues",
    "instrucao",
    "llama-cpp",
    "gguf-my-repo",
    "text-generation",
    "pt",
    "dataset:rhaymison/superset",
    "base_model:google/gemma-2b-it",
    "base_model:quantized:google/gemma-2b-it",
    "license:apache-2.0",
    "model-index",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 0,
  "downloads": 104,
  "gated": false,
  "private": false,
  "last_modified": "2024-05-07T16:10:35.000Z",
  "created_at": "2024-05-07T16:10:28.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "663a5274d67a4c20c6c2471f",
  "id": "noxinc/gemma-portuguese-tom-cat-2b-it-Q4_K_M-GGUF-PTBR",
  "modelId": "noxinc/gemma-portuguese-tom-cat-2b-it-Q4_K_M-GGUF-PTBR",
  "sha": "e55de3093f65efc87794bf1534573659784124c9",
  "createdAt": "2024-05-07T16:10:28.000Z",
  "lastModified": "2024-05-07T16:10:35.000Z",
  "author": "noxinc",
  "downloads": 104,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 3
}