cstr/jina-v5-nano-gguf overview

{
  "metadata": {},
  "card_data": {
    "license": "mit",
    "language": [
      "multilingual"
    ],
    "tags": [
      "embeddings",
      "gguf",
      "ggml",
      "text-embeddings",
      "qwen3",
      "crispembed",
      "ollama"
    ],
    "pipeline_tag": "feature-extraction",
    "base_model": "jinaai/jina-embeddings-v5-text-nano",
    "frontmatter": {
      "license": "mit",
      "language": "[multilingual]",
      "tags": "[embeddings, gguf, ggml, text-embeddings, qwen3, crispembed, ollama]",
      "pipeline_tag": "feature-extraction",
      "base_model": "jinaai/jina-embeddings-v5-text-nano"
    },
    "hero_image_url": "",
    "summary": "GGUF format of jinaai/jina-embeddings-v5-text-nano for use with CrispEmbed and Ollama.",
    "quick_links": [],
    "benchmark_table_html": "",
    "readme_markdown": "---\nlicense: mit\nlanguage: [multilingual]\ntags: [embeddings, gguf, ggml, text-embeddings, qwen3, crispembed, ollama]\npipeline_tag: feature-extraction\nbase_model: jinaai/jina-embeddings-v5-text-nano\n---\n\n# jina-v5-nano GGUF\n\nGGUF format of [jinaai/jina-embeddings-v5-text-nano](https://huggingface.co/jinaai/jina-embeddings-v5-text-nano) for use with [CrispEmbed](https://github.com/CrispStrobe/CrispEmbed) and [Ollama](https://ollama.com).\n\n## Files\n\n| File | Quantization | Size |\n|------|-------------|------|\n| [jina-v5-nano-q4_k.gguf](https://huggingface.co/cstr/jina-v5-nano-GGUF/resolve/main/jina-v5-nano-q4_k.gguf) | Q4_K | 0 MB |\n| [jina-v5-nano-q5_k.gguf](https://huggingface.co/cstr/jina-v5-nano-GGUF/resolve/main/jina-v5-nano-q5_k.gguf) | Q5_K | 0 MB |\n| [jina-v5-nano-q8_0.gguf](https://huggingface.co/cstr/jina-v5-nano-GGUF/resolve/main/jina-v5-nano-q8_0.gguf) | Q8_0 | 0 MB |\n| [jina-v5-nano.gguf](https://huggingface.co/cstr/jina-v5-nano-GGUF/resolve/main/jina-v5-nano.gguf) | F32 | 0 MB |\n\n**Recommended:** Q8_0 for quality (cos vs HF: L2=1.0), Q4_K for size (L2=1.0).\n\n## Quick Start\n\n### CrispEmbed\n```bash\n./crispembed -m jina-v5-nano \"Hello world\"\n./crispembed-server -m jina-v5-nano --port 8080\n```\n\n### Ollama (with [CrispStrobe fork](https://github.com/CrispStrobe/ollama/tree/feat/xlmr-embedding))\n```bash\necho \"FROM jina-v5-nano-q8_0.gguf\" > Modelfile\nollama create jina-v5-nano -f Modelfile\ncurl http://localhost:11434/api/embed -d '{\"model\":\"jina-v5-nano\",\"input\":[\"Hello world\"]}'\n```\n\n### Python (CrispEmbed)\n```python\nfrom crispembed import CrispEmbed\nmodel = CrispEmbed(\"jina-v5-nano-q8_0.gguf\")\nvectors = model.encode([\"Hello world\", \"Goodbye world\"])\n```\n\n## Model Details\n\n| Property | Value |\n|----------|-------|\n| Architecture | Qwen3 |\n| Parameters | 210M |\n| Embedding Dimension | 768 |\n| Layers | 12 |\n| Pooling | last-token |\n| Tokenizer | BPE |\n| Language | multilingual |\n| Q8_0 vs HuggingFace | L2=1.0 |\n| Q4_K vs HuggingFace | L2=1.0 |\n\n## Server API\n\nCrispEmbed server supports four API dialects:\n- `POST /embed` -- native\n- `POST /v1/embeddings` -- OpenAI-compatible\n- `POST /api/embed` -- Ollama-compatible\n- `POST /api/embeddings` -- Ollama legacy\n\n## Credits\n\n- Original model: [jinaai/jina-embeddings-v5-text-nano](https://huggingface.co/jinaai/jina-embeddings-v5-text-nano)\n- Inference: [CrispEmbed](https://github.com/CrispStrobe/CrispEmbed) (MIT, ggml-based)\n",
    "related_quantizations": []
  },
  "tags": [
    "gguf",
    "embeddings",
    "ggml",
    "text-embeddings",
    "qwen3",
    "crispembed",
    "ollama",
    "feature-extraction",
    "multilingual",
    "base_model:jinaai/jina-embeddings-v5-text-nano",
    "base_model:quantized:jinaai/jina-embeddings-v5-text-nano",
    "license:mit",
    "endpoints_compatible",
    "region:us"
  ],
  "likes": 0,
  "downloads": 1488,
  "gated": false,
  "private": false,
  "last_modified": "2026-04-16T05:28:32.000Z",
  "created_at": "2026-04-15T03:30:16.000Z",
  "pipeline_tag": "feature-extraction",
  "library_name": ""
}

{
  "_id": "69df064815af821c90dced2e",
  "id": "cstr/jina-v5-nano-GGUF",
  "modelId": "cstr/jina-v5-nano-GGUF",
  "sha": "1c6911b7b233dfbe1241393023dc3850ebe4d61d",
  "createdAt": "2026-04-15T03:30:16.000Z",
  "lastModified": "2026-04-16T05:28:32.000Z",
  "author": "cstr",
  "downloads": 1488,
  "likes": 0,
  "gated": false,
  "private": false,
  "pipeline_tag": "feature-extraction",
  "library_name": "",
  "siblings_count": 6
}