GraySoft
Projects Models About FAQ Contact Download guIDE →
Model Intelligence Sheet

ussipan/sipangpt-0.1-llama-3.2-1b-gguf overview

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library. ---

transformerspytorchggufllamatext-generationtext-generation-inferenceunslothq4_k_m4bitsharegptpretainingfinetuningQ5_K_MQ8_0text2text-generationconversationalenesdataset:ussipan/sipangptlicense:apache-2.0endpoints_compatibleregion:us
ussipan/sipangpt-0.1-llama-3.2-1b-gguf visual
Downloads
1,137
Likes
1
Pipeline
text-generation
Library
transformers
Visibility
Public
Access
Open

Repository Files & Downloads

4 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
unsloth.F16.gguf GGUF F16 2.31 GB Download
unsloth.Q4_K_M.gguf GGUF Q4_K_M 770.28 MB Download
unsloth.Q5_K_M.gguf GGUF Q5_K_M 869.28 MB Download
unsloth.Q8_0.gguf GGUF 1.23 GB Download

Model Details Live

Model Slug
ussipan/sipangpt-0.1-llama-3.2-1b-gguf
Author
ussipan
Pipeline Task
text-generation
Library
transformers
Created
2024-10-02
Last Modified
2024-10-19
Gated
No
Private
No
HF SHA
8aa88f5f6ad544548711e12628cae7f3574e9cbd
License
apache-2.0
Language
en, es
Base Model
unsloth/Meta-Llama-3.2-1B-Instruct

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "base_model": "unsloth/Meta-Llama-3.2-1B-Instruct",
    "language": [
      "en",
      "es"
    ],
    "license": "apache-2.0",
    "tags": [
      "text-generation-inference",
      "transformers",
      "unsloth",
      "llama",
      "gguf",
      "q4_k_m",
      "4bit",
      "sharegpt",
      "pretaining",
      "finetuning",
      "Q5_K_M",
      "Q8_0"
    ],
    "datasets": [
      "ussipan/sipangpt"
    ],
    "pipeline_tag": "text2text-generation",
    "new_version": "ussipan/SipanGPT-0.3-Llama-3.2-1B-GGUF",
    "frontmatter": {
      "base_model": "unsloth/Meta-Llama-3.2-1B-Instruct",
      "language": [
        "en",
        "es"
      ],
      "license": "apache-2.0",
      "tags": [
        "text-generation-inference",
        "transformers",
        "unsloth",
        "llama",
        "gguf",
        "q4_k_m",
        "4bit",
        "sharegpt",
        "pretaining",
        "finetuning",
        "Q5_K_M",
        "Q8_0"
      ],
      "datasets": [
        "ussipan/sipangpt"
      ],
      "pipeline_tag": "text2text-generation",
      "new_version": "ussipan/SipanGPT-0.3-Llama-3.2-1B-GGUF"
    },
    "hero_image_url": "https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png",
    "summary": "This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.  ---",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nbase_model: unsloth/Meta-Llama-3.2-1B-Instruct\nlanguage:\n- en\n- es\nlicense: apache-2.0\ntags:\n- text-generation-inference\n- transformers\n- unsloth\n- llama\n- gguf\n- q4_k_m\n- 4bit\n- sharegpt\n- pretaining\n- finetuning\n- Q5_K_M\n- Q8_0\ndatasets:\n- ussipan/sipangpt\npipeline_tag: text2text-generation\nnew_version: ussipan/SipanGPT-0.3-Llama-3.2-1B-GGUF\n---\n# SipánGPT 0.1 Llama 3.2 1B GGUF\n- Modelo pre-entrenado para responder preguntas de la Universidad Señor de Sipán de Lambayeque, Perú.\n- Pre-trained model to answer questions from the Señor de Sipán University of Lambayeque, Peru.\n\n## Testing the model\n\n![image/png](https://cdn-uploads.huggingface.co/production/uploads/644474219174daa2f6919d31/NcZms2ChvHMURrl29eMiW.png)\n\n- Debido a la poca cantidad de conversaciones con las que fue entrenado (400 conversaciones), el modelo genera bastantes alucinaciones.\n- Due to the small number of conversations with which it was trained (400 conversations), the model generates quite a few hallucinations.\n\n\n# Uploaded  model\n\n- **Developed by:** jhangmez\n- **License:** apache-2.0\n- **Finetuned from model :** unsloth/Meta-Llama-3.2-1B-Instruct\n\nThis llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.\n\n[<img src=\"https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png\" width=\"200\"/>](https://github.com/unslothai/unsloth)\n\n---\n\n## SipánGPT 0.1 Llama 3.2 1B GGUF\n\n<div style=\"display: flex; align-items: center; height: fit-content;\">\n  <img src=\"https://avatars.githubusercontent.com/u/60937214?v=4\" width=\"40\" style=\"margin-right: 10px;\"/>\n  <span>Hecho con ❤️ por Jhan Gómez P.</span>\n</div>",
    "related_quantizations": []
  },
  "tags": [
    "transformers",
    "pytorch",
    "gguf",
    "llama",
    "text-generation",
    "text-generation-inference",
    "unsloth",
    "q4_k_m",
    "4bit",
    "sharegpt",
    "pretaining",
    "finetuning",
    "Q5_K_M",
    "Q8_0",
    "text2text-generation",
    "conversational",
    "en",
    "es",
    "dataset:ussipan/sipangpt",
    "license:apache-2.0",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 1,
  "downloads": 1137,
  "gated": false,
  "private": false,
  "last_modified": "2024-10-19T21:07:53.000Z",
  "created_at": "2024-10-02T23:45:40.000Z",
  "pipeline_tag": "text-generation",
  "library_name": "transformers"
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "66fddb241456cd9c8699c509",
  "id": "ussipan/SipanGPT-0.1-Llama-3.2-1B-GGUF",
  "modelId": "ussipan/SipanGPT-0.1-Llama-3.2-1B-GGUF",
  "sha": "8aa88f5f6ad544548711e12628cae7f3574e9cbd",
  "createdAt": "2024-10-02T23:45:40.000Z",
  "lastModified": "2024-10-19T21:07:53.000Z",
  "author": "ussipan",
  "downloads": 1137,
  "likes": 1,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "transformers",
  "siblings_count": 12
}