peculiar-ragdoll

Cyber Tiel Coder 35B A3B GGUF MTP

Cyber Tiel Coder 35B A3B GGUF MTP is a 35.5B mixture-of-experts qwen35moe model from peculiar-ragdoll, with about 3.0B parameters active per token. Configured context length is 262,144 tokens. License: mit. Quant sizes are the GGUF file bytes published on Hugging Face when a file exists.

Parameters35.5B / 3.0B active

Context256K

Attentionhybrid

Licensemit

40 layers · 2 KV heads · head dim 256 · 30 linear-attention layers · GGUF repo · config

Quant file sizes

Quant	File size	Source
Q8_0	35.1 GB	Estimated from parameters × bits per weight
Q6_K	27.1 GB	Estimated from parameters × bits per weight
Q5_K_M	23.6 GB	Estimated from parameters × bits per weight
Q4_K_M	20.0 GB	Estimated from parameters × bits per weight
Q3_K_M	16.1 GB	Estimated from parameters × bits per weight
Q2_K	13.8 GB	Estimated from parameters × bits per weight

On common machines

Device	Verdict	Quant	Speed
GeForce RTX 4060 Ti 8GB	Expert offload	Q4_K_M	78–107
GeForce RTX 3060 12GB	Expert offload	Q4_K_M	98–134
GeForce RTX 4060 Ti 16GB	Tight fit	Q2_K	118–161
GeForce RTX 4090	Tight fit	Q4_K_M	279–381
GeForce RTX 5090	Tight fit	Q6_K	375–511
Apple M4 Pro	Tight fit	Q3_K_M	92–126
Apple M5	Won't fit	Q2_K	—
CPU only · DDR5-5600	Runs on CPU	Q5_K_M	21–29

Smallest devices that fit it fully

GeForce RTX 5080 — Tight fit, Q2_K, 394–537 tok/s
GeForce RTX 5070 Ti — Tight fit, Q2_K, 368–501 tok/s
GeForce RTX 5060 Ti 16GB — Tight fit, Q2_K, 184–251 tok/s
GeForce RTX 4080 Super — Tight fit, Q2_K, 302–412 tok/s
GeForce RTX 4080 — Tight fit, Q2_K, 294–401 tok/s
GeForce RTX 4070 Ti Super — Tight fit, Q2_K, 276–376 tok/s

Run it

Commands for the GeForce RTX 4060 Ti 16GB estimate (Q2_K).

llama.cpp

# Quant size is estimated — the file may not be published yet
llama-server -hf peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-GGUF-MTP:Q2_K -c 4096 -ngl 40

No matching name in the Ollama library snapshot.

LM Studio

# Quant size is estimated — the file may not be published yet
lms get peculiar-ragdoll/Cyber-Tiel-Coder-35B-A3B-GGUF-MTP
# Then load quant Q2_K