Inference Providers
Active filters: gptq
Qwen/Qwen3.5-27B-GPTQ-Int4
Image-Text-to-Text
• 28B • Updated • 254k
• 31
Qwen/Qwen3.5-35B-A3B-GPTQ-Int4
Image-Text-to-Text
• 36B • Updated • 509k
• 53
Qwen/Qwen3.5-122B-A10B-GPTQ-Int4
Image-Text-to-Text
• 125B • Updated • 121k
• 29
happypatrick/Qwen3.5-122B-A10B-heretic-int4-AutoRound
Image-Text-to-Text
• 19B • Updated • 25.6k
• 6
btbtyler09/Qwen3-Coder-30B-A3B-Instruct-gptq-8bit
Text Generation
• 9B • Updated • 352k
• 4
0xSero/GLM-4.7-REAP-50-W4A16
Text Generation
• 2B • Updated • 154
• 69
Qwen/Qwen3.5-397B-A17B-GPTQ-Int4
Image-Text-to-Text
• Updated • 18.3k
• 18
codgician/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GPTQ-int4
Image-Text-to-Text
• 28B • Updated • 7.43k
• 4
TheBloke/guanaco-65B-GPTQ
Text Generation
• 65B • Updated • 820
• 263
TheBloke/Llama-2-13B-chat-GPTQ
Text Generation
• 13B • Updated • 13.2k
• 363
TheBloke/Llama-2-70B-Chat-GPTQ
Text Generation
• 69B • Updated • 3.04k
• 259
TheBloke/Falcon-180B-GPTQ
Text Generation
• 179B • Updated • 10
• 10
TheBloke/Qwen-14B-Chat-GPTQ
Text Generation
• 14B • Updated • 38
• 34
Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int8
Image-Text-to-Text
• 2B • Updated • 119
• 17
Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8
Text Generation
• 15B • Updated • 42.7k
• 22
circulus/gemma-3-4b-it-gptq
4B • Updated • 60
• 2
openguardrails/OpenGuardrails-Text-2510
Text Generation
• 15B • Updated • 598
• 10
0xSero/GLM-4.7-REAP-40-W4A16
Text Generation
• 2B • Updated • 52
• 7
apolo13x/Qwen3.5-35B-A3B-quantized.w4a16
Image-Text-to-Text
• 6B • Updated • 9.98k
• 2
btbtyler09/Qwen3.5-122B-A10B-GPTQ-4bit
Image-Text-to-Text
• 125B • Updated • 784
• 2
llmfan46/Qwen3.5-27B-heretic-v2-GPTQ-int8
Image-Text-to-Text
• 27B • Updated • 1.67k
• 1
llmfan46/Qwen3.5-27B-heretic-v2-GPTQ-int4
Image-Text-to-Text
• 27B • Updated • 1.53k
• 3
oxzoid/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GPTQ-int4
Image-Text-to-Text
• 28B • Updated • 1.39k
• 2
codgician/Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GPTQ-int4
Image-Text-to-Text
• 36B • Updated • 1.23k
• 2
dataslab/DLM-2.0-14B-GPTQ
Text Generation
• 3B • Updated • 16
• 1
dataslab/DLM-2.1-14B-GPTQ
Text Generation
• 3B • Updated • 14
• 1
humanjesse/NVIDIA-Nemotron-3-Super-120B-A12B-GPTQ-Int4
121B • Updated • 57
• 1
elinas/alpaca-13b-lora-int4
Text Generation
• Updated • 19
• 40
elinas/alpaca-30b-lora-int4
Text Generation
• Updated • 18
• 68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
• Updated • 23
• 40