-
-
-
-
-
-
Inference Providers
Active filters:
4-bit
Qwen/Qwen2.5-Coder-32B-Instruct-AWQ
Text Generation
•
33B
•
Updated
•
497k
•
33
Qwen/Qwen2.5-Coder-14B-Instruct-AWQ
Text Generation
•
15B
•
Updated
•
47.2k
•
14
mlx-community/Qwen2.5-Coder-14B-Instruct-4bit
Text Generation
•
Updated
•
1.03k
•
5
lmstudio-community/Qwen2.5-Coder-14B-Instruct-MLX-4bit
Text Generation
•
2B
•
Updated
•
60k
•
2
unsloth/Qwen2.5-Coder-3B-bnb-4bit
Text Generation
•
3B
•
Updated
•
1.03k
•
4
unsloth/Qwen2.5-Coder-3B-Instruct-bnb-4bit
Text Generation
•
3B
•
Updated
•
4.17k
•
6
casperhansen/llama-3.3-70b-instruct-awq
Text Generation
•
71B
•
Updated
•
195k
•
37
kosbu/Llama-3.3-70B-Instruct-AWQ
Text Generation
•
71B
•
Updated
•
449k
•
10
mlx-community/jinaai-ReaderLM-v2
Updated
•
121
•
24
MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation
•
24B
•
Updated
•
178k
•
8
AgeOfAlgorithms/Llasa-1b-GPTQ-4bit
Text Generation
•
1B
•
Updated
•
7
•
1
MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF
Text Generation
•
12B
•
Updated
•
116
•
4
Qwen/Qwen2.5-VL-7B-Instruct-AWQ
Image-Text-to-Text
•
8B
•
Updated
•
783k
•
99
unsloth/Phi-4-mini-instruct-bnb-4bit
Text Generation
•
4B
•
Updated
•
2.19k
•
5
unsloth/gemma-3-12b-it-bnb-4bit
Image-Text-to-Text
•
13B
•
Updated
•
28.7k
•
34
mlx-community/meta-llama-Llama-4-Scout-17B-16E-4bit
Text Generation
•
Updated
•
115
•
8
unsloth/Llama-4-Scout-17B-16E-unsloth-bnb-4bit
Image-Text-to-Text
•
112B
•
Updated
•
41
•
5
unsloth/Qwen3-0.6B-unsloth-bnb-4bit
Text Generation
•
0.6B
•
Updated
•
33.4k
•
21
unsloth/Qwen3-8B-unsloth-bnb-4bit
8B
•
Updated
•
75.8k
•
15
unsloth/Qwen3-8B-bnb-4bit
8B
•
Updated
•
171k
•
8
mlx-community/Qwen3-0.6B-4bit
Text Generation
•
Updated
•
29.1k
•
10
MaziyarPanahi/Qwen3-30B-A3B-GGUF
Text Generation
•
31B
•
Updated
•
273k
•
4
Text Generation
•
33B
•
Updated
•
302k
•
125
Text Generation
•
8B
•
Updated
•
133k
•
37
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
31B
•
Updated
•
235k
•
45
Qwen/Qwen3-235B-A22B-GPTQ-Int4
Text Generation
•
235B
•
Updated
•
5.39k
•
27
mlx-community/Devstral-Small-2505-4bit-DWQ
Text Generation
•
4B
•
Updated
•
90
•
4
Text Generation
•
0.2B
•
Updated
•
201
•
4
Text Generation
•
1B
•
Updated
•
597
•
8
Text Generation
•
0.6B
•
Updated
•
64.8k
•
24