Model Intelligence Sheet
gulf-inference/qwen3-8b-gguf overview
qwen3 8b gguf Optimized qwen3 8b gguf for efficient inference. Usage python from transformers import AutoModelForCausalLM, AutoTokenizer model = AutoModelForCa…
Repository Files & Downloads
0 GGUF files detected
Direct downloads for local inference
| File | Type | Quantization | Size | Link |
|---|---|---|---|---|
| Browse files on Hugging Face | ||||
Model Details
| Model ID | gulf-inference/qwen3-8b-gguf |
|---|---|
| Author | gulf-inference |
| Pipeline | text-generation |
| License | apache-2.0 |
| Base model | — |
| Last modified | 2026-06-25T17:10:01.000Z |
Model README
---
license: apache-2.0
language:
- en
pipeline_tag: text-generation
---
qwen3-8b-gguf
Optimized qwen3-8b-gguf for efficient inference.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("gulf-inference/qwen3-8b-gguf", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("gulf-inference/qwen3-8b-gguf", trust_remote_code=True)Run gulf-inference/qwen3-8b-gguf with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models