mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit
Text Generation • 35B • Updated • 11.6k • 66
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
417
Active filters: 8bit
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation • 9B • Updated • 7.75k • 91
mlx-community/gemma-4-12B-it-OptiQ-4bit
Text Generation • 12B • Updated • 5.84k • 45
mlx-community/gemma-4-12B-it-qat-OptiQ-4bit
Text Generation • 12B • Updated • 4.12k • 13
mlx-community/gemma-4-12B-coder-fable5-composer2.5-v1-OptiQ-4bit
Image-Text-to-Text • 12B • Updated • 3.17k • 7
mlx-community/Ornith-1.0-9B-OptiQ-4bit
Image-Text-to-Text • 9B • Updated • 1.98k • 9
mlx-community/Ornith-1.0-35B-OptiQ-6bit
Image-Text-to-Text • 8B • Updated • 166 • 2
mlx-community/Qwen3.5-4B-OptiQ-4bit
Text Generation • 0.9B • Updated • 4.14k • 28
mlx-community/Qwen3.6-27B-OptiQ-4bit
Text Generation • 27B • Updated • 11k • 79
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-8bit
Image-Text-to-Text • 8B • Updated • 1.43k • 6
crumb/gpt-j-6b-finetune-super-glue
Text Generation • Updated • 14
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation • 6B • Updated • 17 • 7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation • 6B • Updated • 19 • 5
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation • Updated • 20
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation • Updated • 12 • 4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization • 3B • Updated • 8
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation • Updated • 6
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation • Updated • 15 • 1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation • 7B • Updated • 10 • 7
Trelis/mpt-7b-instruct-hosted-inference-8bit
Text Generation • Updated • 6
ecastera/eva-mistral-catmacaroni-7b-spanish
Text Generation • 7B • Updated • 11 • 3
ecastera/eva-mistral-turdus-7b-spanish
Text Generation • 7B • Updated • 6
ecastera/eva-mistral-7b-spanish-GGUF
7B • Updated • 37 • 10
BioMistral/BioMistral-7B-BnB.8
Text Generation • 7B • Updated • 10
alokabhishek/Llama-2-7b-chat-hf-bnb-8bit
Text Generation • 7B • Updated • 22 • 2
alokabhishek/Mistral-7B-Instruct-v0.2-bnb-8bit
Text Generation • 7B • Updated • 11 • 2
alokabhishek/Llama-2-7b-chat-hf-8.0-bpw-exl2
Text Generation • Updated • 4 • 1
alokabhishek/Mistral-7B-Instruct-v0.2-8.0-bpw-exl2
Text Generation • Updated • 6 • 1
alokabhishek/Meta-Llama-3-8B-Instruct-bnb-8bit
Text Generation • 8B • Updated • 33 • 2
alokabhishek/Meta-Llama-3-8B-Instruct-8.0-bpw-exl2
Text Generation • Updated • 6 • 1