GraySoft
Projects Models About FAQ Contact Download guIDE →

ggml-org/ultravox-v0_5-llama-3_1-8b-gguf Q4_K_M GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.

Model Intelligence Sheet

ggml-org/ultravox-v0_5-llama-3_1-8b-gguf overview

--- license: mit ---

gguflicense:mitendpoints_compatibleregion:usimatrixconversational
ggml-org/ultravox-v0_5-llama-3_1-8b-gguf visual
Downloads
3,768
Likes
3
Pipeline
Library
Visibility
Public
Access
Open

Repository Files & Downloads

2 files detected
Direct downloads for all repository files
FileTypeQuantizationSizeLink
Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf GGUF Q4_K_M 4.58 GB Download
mmproj-ultravox-v0_5-llama-3_1-8b-f16.gguf GGUF F16 1.28 GB Download

Model Details Live

Model Slug
ggml-org/ultravox-v0_5-llama-3_1-8b-gguf
Author
ggml-org
Pipeline Task
Library
Created
2025-05-21
Last Modified
2025-05-22
Gated
No
Private
No
HF SHA
7a0280d66c0700c366c2c26586e0f0967f97bad0
License
Unknown
Language
Unknown
Base Model
Unknown

Metadata Inspector

Normalized metadata (stored in metadata_json)
{
  "metadata": {},
  "card_data": {
    "license": "mit",
    "frontmatter": {},
    "hero_image_url": "",
    "summary": "--- license: mit ---",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\r\nlicense: mit\r\n---\r\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "license:mit",
    "endpoints_compatible",
    "region:us",
    "imatrix",
    "conversational"
  ],
  "likes": 3,
  "downloads": 3768,
  "gated": false,
  "private": false,
  "last_modified": "2025-05-22T16:07:21.000Z",
  "created_at": "2025-05-21T15:57:32.000Z",
  "pipeline_tag": "",
  "library_name": ""
}
Source payload excerpt (from Hugging Face API)
{
  "_id": "682df7ec95e754c3b54b3307",
  "id": "ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF",
  "modelId": "ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF",
  "sha": "7a0280d66c0700c366c2c26586e0f0967f97bad0",
  "createdAt": "2025-05-21T15:57:32.000Z",
  "lastModified": "2025-05-22T16:07:21.000Z",
  "author": "ggml-org",
  "downloads": 3768,
  "likes": 3,
  "gated": false,
  "private": false,
  "pipeline_tag": "",
  "library_name": "",
  "siblings_count": 4
}