Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,619

Base only

Active filters: 6-bit

alexgusevski/Ministral-3-3B-Instruct-2512-q6-mlx

Text Generation • 0.8B • Updated Dec 11, 2025 • 12

alexgusevski/Ministral-3-3B-Reasoning-2512-q6-mlx

Text Generation • 0.8B • Updated Dec 11, 2025 • 6

alexgusevski/Ministral-3-8B-Instruct-2512-q6-mlx

Text Generation • 8B • Updated Dec 11, 2025 • 11

alexgusevski/Ministral-3-8B-Reasoning-2512-q6-mlx

Text Generation • 8B • Updated Dec 11, 2025 • 8

alexgusevski/Lightning-1.7B-q6-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 13

DeathGodlike/MS3.2-24B-Omega-Diamond_EXL3

Text Generation • Updated Dec 12, 2025

DeathGodlike/Dark-World-24B-v1_EXL3

Text Generation • Updated Dec 12, 2025

lmstudio-community/Olmo-3.1-32B-Think-MLX-6bit

Text Generation • 32B • Updated Dec 12, 2025 • 39

lmstudio-community/Olmo-3.1-32B-Instruct-MLX-6bit

Text Generation • 32B • Updated Dec 12, 2025 • 50

isogen/rnj-1-instruct-exl3-6bpw

4B • Updated Dec 15, 2025 • 5

mlx-community/VibeVoice-Realtime-0.5B-6bit

Text-to-Speech • 0.3B • Updated Dec 15, 2025 • 39 • 1

DeathGodlike/MN-12B-Mag-Mell-R1-Uncensored_EXL3

Text Generation • Updated Dec 13, 2025 • 5

DeathGodlike/Stellar-Odyssey-12b-v0.0_EXL3

Text Generation • Updated Dec 13, 2025

DeathGodlike/KansenSakura-Conflagration-RP-12b_EXL3

Text Generation • Updated Dec 13, 2025

mlx-community/mistralai_Devstral-Small-2-24B-Instruct-2512-MLX-6Bit

Image-Text-to-Text • 6B • Updated 16 days ago • 421

Ataromoku/ArliAI-Mistral-Small-22B-ArliAI-RPMax-v1.1-exl3-6bpw

8B • Updated Dec 14, 2025 • 8

mlx-community/AutoGLM-Phone-9B-Multilingual-6bit

Image-Text-to-Text • Updated Dec 15, 2025 • 23

Wwayu/Gemma-3-27B-Derestricted-mlx-6Bit

Text Generation • 27B • Updated Dec 15, 2025 • 31

Wwayu/medgemma-27b-text-heretic_med-mlx-6Bit

Text Generation • 27B • Updated Dec 15, 2025 • 88 • 1

introvoyz041/MediPhi-Clinical-mlx-6Bit-mlx-4Bit

Text Generation • 0.8B • Updated Dec 15, 2025 • 7

pj1983/Ministral-3-14B-Instruct-2512-heretic-mlx-6bit

Text Generation • 14B • Updated Dec 15, 2025 • 31

mlx-community/VoxCPM1.5-6bit

Text-to-Speech • 0.3B • Updated Dec 16, 2025 • 8

mlx-community/EuroLLM-22B-Instruct-2512-mlx-6bit

Text Generation • 23B • Updated Dec 16, 2025 • 53

steampunque/Voxtral-Mini-3B-2507-MP-GGUF

4B • Updated Feb 18 • 36 • 1

DeathGodlike/BlackDolphin-24B_EXL3

Text Generation • Updated Dec 16, 2025

smcleod/Nemotron-Cascade-14B-Thinking-mlx-6Bit

Text Generation • 15B • Updated Dec 17, 2025 • 10 • 1

smcleod/Nemotron-Cascade-8B-mlx-6Bit

Text Generation • 8B • Updated Dec 17, 2025 • 9

mlx-community/chatterbox-turbo-6bit

Text-to-Speech • 0.2B • Updated Dec 17, 2025 • 44

mlx-community/chatterbox-6bit

Text-to-Speech • 0.2B • Updated Jan 5 • 55

garrison/Magidonia-24B-v4.3-mlx-6Bit

24B • Updated Dec 17, 2025 • 11