GraySoft
Projects Models Compare Cloud benchmarks FAQ Download guIDE →
Model Intelligence Sheet

h0ffmann/marola-sea-tiny-GGUF overview

marola sea tiny GGUF A GGUF release of a marola sea checkpoint — a small model tuned on marola's own question/answer shape open water swim conditions, safety, …

ggufmarolaoceantext-generationbase_model:HuggingFaceTB/SmolLM2-360M-Instructbase_model:quantized:HuggingFaceTB/SmolLM2-360M-Instructlicense:apache-2.0endpoints_compatibleregion:usconversational

Runs locally from ~368.5 MB disk (4 GB VRAM class GPUs with llama.cpp / guIDE).

Downloads
0
Likes
0
Pipeline
text-generation
Author

Repository Files & Downloads

1 GGUF files detected
Direct downloads for local inference
FileTypeQuantizationSizeLink
marola-sea-tiny-Q8_0.ggufGGUFQ8_0368.5 MBDownload

Model Details

Model IDh0ffmann/marola-sea-tiny-GGUF
Authorh0ffmann
Pipelinetext-generation
Licenseapache-2.0
Base modelHuggingFaceTB/SmolLM2-360M-Instruct
Last modified2026-09-08T16:23:29.000Z

Model README

---

base_model: HuggingFaceTB/SmolLM2-360M-Instruct

license: apache-2.0

tags:

  • gguf
  • marola
  • ocean

pipeline_tag: text-generation

---

marola-sea-tiny-GGUF

A GGUF release of a marola-sea checkpoint — a small model tuned on marola's own

question/answer shape (open-water swim conditions, safety, sea life), served locally through

Ollama alongside marola's own RAG corpus and deterministic scoring

(Recommender/Swimability, never the model itself).

Honest framing (MIP-0025 §6, §8): tuning changes tone and format reliability, not factual

grounding. This model does not replace marola's RAG corpus (knowledge/, cited answers only) or

its Reviewer pass, and it is not a standalone safety authority — treat any first-aid or

hazard answer as a starting point, not a substitute for a lifeguard or emergency services (marola's

own answers carry this caveat automatically via the MIP-0022 safety footer; this raw checkpoint,

used outside marola, does not).

Files

  • marola-sea-tiny-Q8_0.gguf (386 MB)

CHECKSUMS (sha256) ships alongside these files — pin a specific hash in your own Modelfile

rather than a bare filename, so re-quantizing upstream can't silently change what you run.

Use with Ollama

ollama run hf.co/h0ffmann/marola-sea-tiny-GGUF
# or a specific quant tag, e.g.:
ollama run hf.co/h0ffmann/marola-sea-tiny-GGUF:Q4_K_M

Base model and training

Fine-tuned from HuggingFaceTB/SmolLM2-360M-Instruct via LoRA (finetune/train_lora.py

in h0ffmann/marola) on a small, hand-built dataset derived

from marola's own DSPy-compiled demos, sea-lore entries, and knowledge-corpus Q&A

(finetune/build_dataset.py) — a few dozen examples, enough to teach format and tone, not facts.

No just benchmark numbers recorded yet for this checkpoint — see docs/benchmarks/ in the source repo before trusting this over a plain base model.

Licence

Base model licence: apache-2.0. See the base model's own repo for the full licence text.

Run h0ffmann/marola-sea-tiny-GGUF with guIDE

Download guIDE — the AI-native code editor with local LLM inference and 69 built-in tools.

Download guIDE → · Browse 524k+ models · Compare models

Source: Hugging Face · Compare models