Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

204

Base only

Active filters: distill

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q2_K-GGUF

Text Generation • 9B • Updated Jul 3 • 133

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q3_K_M-GGUF

Text Generation • 9B • Updated Jul 3 • 63 • 2

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q4_0-GGUF

Text Generation • 9B • Updated Jul 3 • 86 • 2

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q4_K_M-GGUF

Text Generation • 9B • Updated Jul 3 • 337 • 2

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q5_0-GGUF

Text Generation • 9B • Updated Jul 3 • 47

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q5_K_M-GGUF

Text Generation • 9B • Updated Jul 3 • 99

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q6_K-GGUF

Text Generation • 9B • Updated Jul 3 • 47

ZeroXClem/Qwen3.5-9B-Fable-5-Quad-Stock-Q8_0-GGUF

Text Generation • 9B • Updated Jul 3 • 78

td-builder/DeepSeek-R1-Distill-Llama-70B-v2-Q4_K_M-GGUF

Text Generation • 71B • Updated Jul 4 • 339

amanwalksdownthestreet/DeepSeek-R1-Distill-Llama-70B-MXFP8

Text Generation • 73B • Updated Jul 13 • 16

jamiefutch/Qwopus3.5-122B-A10B-Kimi-K2.6-destilled-abliterated-NVFP4

Image-Text-to-Text • 74B • Updated Jul 14 • 203 • 3

11-47/Llama-3.2-Mavrick.Spark-1B

Text Generation • 1B • Updated Jul 17 • 267 • 2

mradermacher/Llama-3.2-Mavrick.Spark-1B-GGUF

Text Generation • 1B • Updated Jul 18 • 232

SceneWorks/sensenova-u1-8b-infographic-v3-fast-mlx

Text-to-Image • Updated Jul 19

NormieeBroo/Qwen3.5-9B-Fable-5-Quad-Stock-Q4_K_S-GGUF

Text Generation • 9B • Updated Jul 21 • 53

optionalAI/LFM2-8B-A1B-Instruct-Quantum-IQ1C-Qwen3.6-35B-A3B-DISTILL2-Q8_0-GGUF

Text Generation • 8B • Updated about 1 month ago • 249

optionalAI/LFM2-8B-A1B-Instruct-Quantum-IQ1C-Qwen3.6-35B-A3B-DISTILL2-Q5_K_M-GGUF

Text Generation • 8B • Updated about 1 month ago • 534

Dzluck/Qwen3.5-9B-Claude-Opus-4.6-Distill-GGUF

9B • Updated 27 days ago • 309

ArkhAngelLifeJiggy/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated-GGUF

125B • Updated 26 days ago • 523 • 1

DoctorEdoP369/Atena_Ai

3B • Updated 24 days ago • 824

saidutta69/DeepSeek-R1-Distill-Qwen-1.5B-heretic

Text Generation • 2B • Updated about 22 hours ago • 1.48k

mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-heretic-GGUF

2B • Updated 19 days ago • 614

mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-heretic-i1-GGUF

2B • Updated 19 days ago • 1.71k • 1

PJMixers-Images/FLUX.2-klein-4B-Distill-LoRA-Extract

Updated 5 days ago