cstr/ettin-reranker-400m-v1-GGUF overview
Ettin Reranker 400M — GGUF GGUF quantizations of cross encoder/ettin reranker 400m v1 https://huggingface.co/cross encoder/ettin reranker 400m v1 , a ModernBER…
Runs locally from ~241.7 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).
Repository Files & Downloads
Model Details
Model README
---
license: apache-2.0
base_model: cross-encoder/ettin-reranker-400m-v1
tags:
- gguf
- reranker
- cross-encoder
- modernbert
- crispembed
library_name: crispembed
---
Ettin Reranker 400M — GGUF
GGUF quantizations of cross-encoder/ettin-reranker-400m-v1, a ModernBERT-based cross-encoder reranker (401.6M params, Apache-2.0).
Converted with CrispEmbed.
Files
| File | Quant | Size |
|------|-------|------|
| | F32 | 1585 MB |
| | Q8_0 | 425 MB |
| | Q4_K | 253 MB |
Architecture
- Base: ModernBERT (28 layers, 1024 hidden)
- Classifier head: Dense(1024→1024, GELU) → LayerNorm → Dense(1024→1)
- Tokenizer: GPT-2 ByteLevel BPE (50368 tokens)
Usage
Run cstr/ettin-reranker-400m-v1-GGUF with guIDE
Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.
Source: Hugging Face · Compare models