Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

349

Base only

Active filters: metal

prism-ml/Ternary-Bonsai-2-27B-gguf

Text Generation • 27B • Updated 4 days ago • 3.58M • 2.25k

prism-ml/Ternary-Bonsai-2-27B-mlx-2bit

Text Generation • 27B • Updated 7 days ago • 64k • 399

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 8 days ago • 2.06M • 944

incoai/Qwen3.8-27B-Splash

Text Generation • Updated 11 days ago • 111

dealignai/Bonsai-2-27B-Ternary-CRACK-GGUF

Text Generation • 27B • Updated 11 days ago • 72.4k • 154

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 29 days ago • 635k • • 1.4k

dealignai/Bonsai-2-27B-1bit-CRACK-GGUF

Text Generation • 27B • Updated 11 days ago • 36.4k • 84

incoai/Qwen3.6-35B-A3B-Splash

Text Generation • Updated 11 days ago • 27

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 432k • 877

antirez/deepseek-v4.1-flash-gguf

755B • Updated 17 days ago • 1.15M • 52

SiliconSpecies/Swift-1.5-Qwen3.8-27B-Splash

Text Generation • Updated 3 days ago • 7

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.1M • 258

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated Aug 3 • 430k • 213

SiliconSpecies/Swift-Qwen3.8-27B-Splash

Text Generation • Updated 3 days ago • 6

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 118k • 787

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 27B • Updated Jul 14 • 1.09M • 202

nitinpanj/Qwen3.8-27B-Splash-HQ

Text Generation • Updated 4 days ago • 247 • 7

Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-mlx-oQ8e-1M

Image-Text-to-Text • 28B • Updated 18 days ago • 7.81k • 22

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 29 days ago • 1.67M • 477

kernelpool/MiMo-V2.6-Flash-MXFP4-GGUF

310B • Updated 7 days ago • 451 • 2

choppedgarlic/CYBER-FROST-3.8-Q8-GGUF-ds4

Text Generation • 180B • Updated about 16 hours ago • 58 • 2

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 29.5k • 61

EnsueAI/metal-int4-sdpa

Updated Apr 21 • 3 • 7

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 203k • 143

EschaLabs/Qwen3.6-35B-A3B-Escha-W2

Text Generation • 7B • Updated Aug 9 • 2.36k • 257

ox-ox/DeepSeek-V4-Flash-0731-gguf-ds4

Text Generation • 284B • Updated Aug 1 • 365 • 25

chimingw/qwen3.5-9b-uncensored-hauhaucs-aggressive-q6-k-llamafile

Image-Text-to-Text • Updated Aug 15 • 41 • 1

Solstice-AI/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-mlx-oQ4e

Image-Text-to-Text • 28B • Updated 18 days ago • 875 • 1

DogContext/GLM-5.3-Flash-Uncensored-Q2-ds4

Text Generation • 321B • Updated 8 days ago • 28.5k • 12

nitinpanj/qwen38-flash-next-v3

Text Generation • 177B • Updated 10 days ago • 33.7k • 3