majentik/Qwen3.5-27B-RotorQuant-GGUF-IQ4_XS
Text Generation • 27B • Updated • 261
Qwen 3.5 — quantized
Quantized GGUF and MLX packs of the Qwen 3.5 model family, including the 397B-A17B MoE.
-
-
majentik/Qwen3.5-27B-RotorQuant-GGUF-Q2_K
Text Generation • 27B • Updated • 92 • 2 -
majentik/Qwen3.5-27B-RotorQuant-GGUF-Q3_K_M
Text Generation • 27B • Updated • 119 -
majentik/Qwen3.5-27B-RotorQuant-GGUF-Q4_K_M
Text Generation • 27B • Updated • 84 -
majentik/Qwen3.5-27B-RotorQuant-GGUF-Q5_K_M
Text Generation • 27B • Updated • 106 -
majentik/Qwen3.5-27B-RotorQuant-GGUF-Q8_0
Text Generation • 27B • Updated • 97 -
majentik/Qwen3.5-27B-RotorQuant-MLX-2bit
Text Generation • 27B • Updated • 208 -
majentik/Qwen3.5-27B-RotorQuant-MLX-4bit
Text Generation • 27B • Updated • 183 -
majentik/Qwen3.5-27B-RotorQuant-MLX-8bit
Text Generation • 27B • Updated • 201 -
majentik/Qwen3.5-27B-TurboQuant-MLX-2bit
Text Generation • 27B • Updated • 267 -
majentik/Qwen3.5-27B-TurboQuant-MLX-4bit
Text Generation • 27B • Updated • 208 • 2 -
majentik/Qwen3.5-27B-TurboQuant-MLX-8bit
Text Generation • 27B • Updated • 138 -
majentik/Qwen3.5-397B-A17B-RotorQuant-MLX-2bit
Image-Text-to-Text • 38B • Updated • 137 -
majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-2bit
Image-Text-to-Text • 38B • Updated • 136