Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

118

Base only

Active filters: optiq

mlx-community/DeepSeek-V4-Flash-0731-OptiQ-2bit

Text Generation • 26B • Updated about 18 hours ago • 2.64k • 5

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated Jul 14 • 11.9k • 66

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated Jul 14 • 7.62k • 91

mlx-community/gemma-4-12B-coder-fable5-composer2.5-v1-OptiQ-4bit

Image-Text-to-Text • 12B • Updated 27 days ago • 3.04k • 8

mlx-community/Ornith-1.0-35B-OptiQ-6bit

Image-Text-to-Text • 8B • Updated 8 days ago • 261 • 3

mlx-community/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated 27 days ago • 5.82k • 45

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated 27 days ago • 4k • 13

mlx-community/Hy3-OptiQ-2bit

Text Generation • 24B • Updated about 18 hours ago • 404 • 2

mlx-community/Muse-Glimmer-30B-OptiQ-4bit

Image-Text-to-Text • 7B • Updated 2 days ago • 360 • 2

mlx-community/Qwen3.8-27B-OptiQ-4bit

Image-Text-to-Text • Updated about 20 hours ago • 2

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated Jul 14 • 5.17k • 28

mlx-community/Devstral-Small-2-24B-Instruct-2512-OptiQ-4bit

Text Generation • 24B • Updated 23 days ago • 422 • 1

mlx-community/Fara1.5-27B-OptiQ-4bit

Image-Text-to-Text • 27B • Updated 23 days ago • 330 • 2

mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit

Text Generation • 35B • Updated 22 days ago • 5k • 14

mlx-community/Mage-VL-OptiQ-4bit

Image-Text-to-Text • 0.9B • Updated 12 days ago • 106 • 1

mlx-community/Ornith-1.0-9B-OptiQ-6bit

Image-Text-to-Text • 2B • Updated 8 days ago • 149 • 1

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.2B • Updated Jul 14 • 1.28k • 22

mlx-community/Qwen3.5-2B-OptiQ-4bit

Text Generation • 0.4B • Updated Jul 14 • 1.14k • 12

machinadeusex/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.8B • Updated Mar 14 • 43 • 1

mlx-community/YOLO26n-OptiQ-6bit

Object Detection • Updated Apr 26 • 51

mlx-community/YOLO26s-OptiQ-6bit

Object Detection • Updated Apr 26 • 34

mlx-community/YOLO26m-OptiQ-6bit

Object Detection • Updated Apr 26 • 38

mlx-community/YOLO26x-OptiQ-6bit

Object Detection • Updated Apr 26 • 129 • 2

mlx-community/YOLO26l-OptiQ-6bit

Object Detection • Updated Apr 26 • 41

mlx-community/gemma-4-e2b-it-OptiQ-4bit

Text Generation • 1B • Updated 27 days ago • 1.71k • 4

mlx-community/gemma-4-e4b-it-OptiQ-4bit

Text Generation • 7B • Updated 27 days ago • 6.88k • 29

mlx-community/Qwen3.5-27B-OptiQ-4bit

Text Generation • 27B • Updated Jul 14 • 1.38k • 3

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated Jul 14 • 10.7k • 77

mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit

Text Generation • 25B • Updated 27 days ago • 3.83k • 18

mlx-community/Qwen3.5-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated Jul 14 • 475 • 3