forkjoin-ai/qwen2-audio-7b-instruct-gguf Q4_0 GGUF - Free GGUF Download is indexed on GraySoft with repository links, GGUF quant files, and Hugging Face metadata. This page helps you pick a local model for guIDE or other runtimes. See related models in the same shard below.
Model Intelligence Sheet
forkjoin-ai/qwen2-audio-7b-instruct-gguf overview
Forkjoin.ai conversion of Qwen/Qwen2-Audio-7B-Instruct to GGUF format for edge deployment.
Downloads
420
Likes
0
Pipeline
text-to-audio
Library
llama-cpp
Visibility
Public
Access
Open
Repository Files & Downloads
Model Details Live
Metadata Inspector
Normalized metadata (stored in metadata_json)
{
"metadata": {},
"card_data": {
"language": [
"en"
],
"license": "apache-2.0",
"library_name": "llama-cpp",
"tags": [
"gguf",
"audio",
"speech",
"forkjoin-ai"
],
"base_model": "Qwen/Qwen2-Audio-7B-Instruct",
"pipeline_tag": "text-to-audio",
"frontmatter": {
"language": [
"en"
],
"license": "apache-2.0",
"library_name": "llama-cpp",
"tags": [
"gguf",
"audio",
"speech",
"forkjoin-ai"
],
"base_model": "Qwen/Qwen2-Audio-7B-Instruct",
"pipeline_tag": "text-to-audio"
},
"hero_image_url": "",
"summary": "Forkjoin.ai conversion of Qwen/Qwen2-Audio-7B-Instruct to GGUF format for edge deployment.",
"quick_links": [],
"benchmark_table_html": "",
"readme_markdown": "---\nlanguage:\n - en\nlicense: apache-2.0\nlibrary_name: llama-cpp\ntags:\n - gguf\n - audio\n - speech\n - forkjoin-ai\nbase_model: Qwen/Qwen2-Audio-7B-Instruct\npipeline_tag: text-to-audio\n---\n\n# Qwen2 Audio 7B Instruct\n\nForkjoin.ai conversion of [Qwen/Qwen2-Audio-7B-Instruct](https://huggingface.co/Qwen/Qwen2-Audio-7B-Instruct) to GGUF format for edge deployment.\n\n## Model Details\n\n- **Source Model**: [Qwen/Qwen2-Audio-7B-Instruct](https://huggingface.co/Qwen/Qwen2-Audio-7B-Instruct)\n- **Format**: GGUF\n- **Converted by**: [Forkjoin.ai](https://forkjoin.ai)\n\n## Usage\n\n### With llama.cpp\n\n```bash\n./llama-cli -m qwen2-audio-7b-instruct-gguf.gguf -p \"Your prompt here\" -n 256\n```\n\n### With Ollama\n\nCreate a `Modelfile`:\n```\nFROM ./qwen2-audio-7b-instruct-gguf.gguf\n```\n\n```bash\nollama create qwen2-audio-7b-instruct-gguf -f Modelfile\nollama run qwen2-audio-7b-instruct-gguf\n```\n\n## About Forkjoin.ai\n\n[Forkjoin.ai](https://forkjoin.ai) runs AI models at the edge -- in-browser, on-device, zero cloud cost. These converted models power real-time inference, speech recognition, and natural language capabilities.\n\nAll conversions are optimized for edge deployment within browser and mobile memory constraints.\n\n## License\n\nApache 2.0 (follows upstream model license)\n",
"related_quantizations": []
},
"tags": [
"llama-cpp",
"gguf",
"qwen2_audio",
"audio",
"speech",
"forkjoin-ai",
"text-to-audio",
"en",
"base_model:Qwen/Qwen2-Audio-7B-Instruct",
"base_model:quantized:Qwen/Qwen2-Audio-7B-Instruct",
"license:apache-2.0",
"endpoints_compatible",
"region:us",
"conversational"
],
"likes": 0,
"downloads": 420,
"gated": false,
"private": false,
"last_modified": "2026-03-20T16:39:42.000Z",
"created_at": "2026-03-09T21:49:38.000Z",
"pipeline_tag": "text-to-audio",
"library_name": "llama-cpp"
}
Source payload excerpt (from Hugging Face API)
{
"_id": "69af407212740098dae31207",
"id": "forkjoin-ai/qwen2-audio-7b-instruct-gguf",
"modelId": "forkjoin-ai/qwen2-audio-7b-instruct-gguf",
"sha": "bbcf8d2eada962fbc436c470b5870747ae40bffa",
"createdAt": "2026-03-09T21:49:38.000Z",
"lastModified": "2026-03-20T16:39:42.000Z",
"author": "forkjoin-ai",
"downloads": 420,
"likes": 0,
"gated": false,
"private": false,
"pipeline_tag": "text-to-audio",
"library_name": "llama-cpp",
"siblings_count": 6
}