GraySoft
Projects Models About FAQ Contact Download guIDE →
Model Intelligence Sheet

quantfactory/arliai-llama-3-8b-instruct-dpo-v0.1-gguf overview

This is quantized version of OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1 created using llama.cpp # Model Description Based on Meta-Llama-3-8b-Instruct, and is governed by Meta Llama 3 License agreement: https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct DPO fine tuning method using the following datasets: Instruct format:

gguftext-generationbase_model:OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1base_model:quantized:OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1license:llama3endpoints_compatibleregion:usconversational
quantfactory/arliai-llama-3-8b-instruct-dpo-v0.1-gguf visual
Downloads
175
Likes
1
Pipeline
text-generation
Library
Visibility
Public
Access
Open

Repository Files & Downloads

14 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q2_K.gguf GGUF Q2_K 2.96 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q3_K_L.gguf GGUF Q3_K_L 4.03 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q3_K_M.gguf GGUF Q3_K_M 3.74 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q3_K_S.gguf GGUF Q3_K_S 3.41 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q4_0.gguf GGUF 4.34 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q4_1.gguf GGUF 4.78 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q4_K_M.gguf GGUF Q4_K_M 4.58 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q4_K_S.gguf GGUF Q4_K_S 4.37 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q5_0.gguf GGUF 5.21 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q5_1.gguf GGUF 5.65 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q5_K_M.gguf GGUF Q5_K_M 5.34 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q5_K_S.gguf GGUF Q5_K_S 5.21 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q6_K.gguf GGUF Q6_K 6.14 GB Download
ArliAI-Llama-3-8B-Instruct-DPO-v0.1.Q8_0.gguf GGUF 7.95 GB Download

Model Details Live

Model Slug
quantfactory/arliai-llama-3-8b-instruct-dpo-v0.1-gguf
Author
QuantFactory
Pipeline Task
text-generation
Library
Created
2024-07-14
Last Modified
2024-07-16
Gated
No
Private
No
HF SHA
33e244f3e31fef7f507d0ffe2c600055b48bb277
License
llama3
Language
Unknown
Base Model
OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "llama3",
    "pipeline_tag": "text-generation",
    "base_model": "OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1",
    "frontmatter": {
      "license": "llama3",
      "pipeline_tag": "text-generation",
      "base_model": "OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1"
    },
    "hero_image_url": "",
    "summary": "This is quantized version of OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1 created using llama.cpp # Model Description Based on Meta-Llama-3-8b-Instruct, and is governed by Meta Llama 3 License agreement: https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct DPO fine tuning method using the following datasets: Instruct format: `` system {{ system_prompt }}user {{ user_message_1 }}assistant {{ model_answer_1 }}user {{ user_message_2 }}assistant ``",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: llama3\npipeline_tag: text-generation\nbase_model: OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1\n---\n\n# QuantFactory/ArliAI-Llama-3-8B-Instruct-DPO-v0.1-GGUF\nThis is quantized version of [OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1](https://huggingface.co/OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1) created using llama.cpp\n\n# Model Description\nBased on Meta-Llama-3-8b-Instruct, and is governed by Meta Llama 3 License agreement:\nhttps://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct\n\n\nDPO fine tuning method using the following datasets:\n- https://huggingface.co/datasets/Intel/orca_dpo_pairs\n- https://huggingface.co/datasets/argilla/distilabel-math-preference-dpo\n- https://huggingface.co/datasets/unalignment/toxic-dpo-v0.2\n- https://huggingface.co/datasets/M4-ai/prm_dpo_pairs_cleaned\n- https://huggingface.co/datasets/jondurbin/truthy-dpo-v0.1\n\n\n\nInstruct format:\n```\n<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{{ system_prompt }}<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n{{ user_message_1 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n{{ model_answer_1 }}<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n{{ user_message_2 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n```",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "text-generation",
    "base_model:OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1",
    "base_model:quantized:OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1",
    "license:llama3",
    "endpoints_compatible",
    "region:us",
    "conversational"
  ],
  "likes": 1,
  "downloads": 175,
  "gated": false,
  "private": false,
  "last_modified": "2024-07-16T02:03:59.000Z",
  "created_at": "2024-07-14T18:10:19.000Z",
  "pipeline_tag": "text-generation",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "6694148bf3626024aaf4a469",
  "id": "QuantFactory/ArliAI-Llama-3-8B-Instruct-DPO-v0.1-GGUF",
  "modelId": "QuantFactory/ArliAI-Llama-3-8B-Instruct-DPO-v0.1-GGUF",
  "sha": "33e244f3e31fef7f507d0ffe2c600055b48bb277",
  "createdAt": "2024-07-14T18:10:19.000Z",
  "lastModified": "2024-07-16T02:03:59.000Z",
  "author": "QuantFactory",
  "downloads": 175,
  "likes": 1,
  "gated": false,
  "private": false,
  "pipeline_tag": "text-generation",
  "library_name": "",
  "siblings_count": 16
}