GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

VertexResearch/Vertex-0.6-15M-Base-GGUF overview

Vertex 0.6 15M Base Base pretrain only checkpoint of Vertex 0.6 15M , a tiny ~15M param model from the Vertex 0.6 family. Qwen3 architecture: hidden 256, 10 la…

gguftinyvertextext-generationendataset:openbmb/Ultra-FineWebdataset:openbmb/Ultra-FineWeb-L3base_model:VertexResearch/Vertex-0.6-15M-Basebase_model:quantized:VertexResearch/Vertex-0.6-15M-Baselicense:apache-2.0endpoints_compatibleregion:us

Runs locally from ~29.2 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
Vertex-0.6-15M-Base-F16.ggufGGUFF1629.2 MBDownload

Model Details

Model IDVertexResearch/Vertex-0.6-15M-Base-GGUF
AuthorVertexResearch
Pipelinetext-generation
Licenseapache-2.0
Base modelVertexResearch/Vertex-0.6-15M-Base
Last modified2026-09-06T10:20:49.000Z

Model README

---

license: apache-2.0

datasets:

  • openbmb/Ultra-FineWeb
  • openbmb/Ultra-FineWeb-L3

language:

  • en

pipeline_tag: text-generation

base_model: VertexResearch/Vertex-0.6-15M-Base

base_model_relation: quantized

tags:

  • tiny
  • vertex

---

Vertex 0.6 15M Base

Base (pretrain-only) checkpoint of Vertex 0.6 15M, a tiny ~15M-param

model from the Vertex 0.6 family. Qwen3 architecture: hidden 256, 10 layers,

4 heads / 2 KV (GQA, head_dim 64), SwiGLU ffn 1024, 20000-vocab ByteLevel

BPE, tied embeddings, ctx 2048.

Pretrained from scratch on 12B tokens of English web text: Ultra-FineWeb

plus Ultra-FineWeb-L3 synthetic rewrites (Multi-Style + QA), ~800 tokens per

parameter, on a single RTX 4060 Laptop (8GB).

This is a raw language model — no chat template, no instruction tuning. For chat, see

Vertex-0.6-15M-Instruct.

Training data

Pretrained on English web text from openbmb/Ultra-FineWeb and openbmb/Ultra-FineWeb-L3 (Multi-Style + QA synthetic configs), 12B tokens total.

Run VertexResearch/Vertex-0.6-15M-Base-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models