What is AI-Sweden-Models/gpt-sw3-126m-instruct-gguf?

AI-Sweden-Models/gpt-sw3-126m-instruct-gguf is a GGUF-quantized model for local AI inference.

What license applies to AI-Sweden-Models/gpt-sw3-126m-instruct-gguf?

License: other. Verify terms on Hugging Face before commercial use.

How do I run AI-Sweden-Models/gpt-sw3-126m-instruct-gguf locally?

Download a GGUF file from this page and load it in guIDE or llama.cpp. Pipeline task: text-generation.

Model Intelligence Sheet

AI-Sweden-Models/gpt-sw3-126m-instruct-gguf overview

AI-Sweden-Models/gpt-sw3-126m-instruct-gguf GGUF downloads for local AI inference with guIDE.

ggufdasvnoenisdataset:databricks/databricks-dolly-15kdataset:laion/OIGdataset:OpenAssistant/oasst1base_model:AI-Sweden-Models/gpt-sw3-126m-instructbase_model:quantized:AI-Sweden-Models/gpt-sw3-126m-instructlicense:otherendpoints_compatibleregion:usconversational

Runs locally from ~354.4 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads

180

Likes

Pipeline

—

Author

AI-Sweden-Models

Repository Files & Downloads

2 GGUF files detected

Direct downloads for local inference

File	Type	Quantization	Size	Link
GPT-Sw3-126M-Instruct-f16-GGUF.gguf	GGUF	F16	354.4 MB	Download
GPT-Sw3-126M-Instruct-f32-GGUF.gguf	GGUF	F32	706.9 MB	Download

Model Details

Model ID	AI-Sweden-Models/gpt-sw3-126m-instruct-gguf
Author	AI-Sweden-Models
Pipeline	—
License	other
Base model	AI-Sweden-Models/gpt-sw3-126m-instruct
Last modified	2026-06-24T07:59:01.000Z

Run AI-Sweden-Models/gpt-sw3-126m-instruct-gguf with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models