Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

231

Base only

Active filters: nf4

art-from-the-machine/lingbot-world-base-cam-nf4-server

Image-to-Video • Updated Feb 10 • 1

sarathi-balakrishnan/Qwen2.5-VL-7B-Medical-LoRA

Image-Text-to-Text • Updated Feb 10 • 12

0ldev/Qwen2.5-VL-3B-Instruct-ov-nf4-npu

Image-Text-to-Text • Updated Feb 20 • 11

0ldev/gemma-3-4b-it-ov-nf4-npu

Text Generation • Updated Feb 20 • 11 • 1

0ldev/Qwen3-VL-2B-Instruct-ov-nf4-npu

Image-Text-to-Text • Updated Feb 20 • 12

EricRollei/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Feb 21 • 75 • 1

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 2.5k • 15

Tushe/nllb-200-600M-nf4-custom-weights-bare-metal

Translation • 0.4B • Updated Feb 24 • 16

MO7YW4NG/ms-marco-MiniLM-L-6-v2-4bit-nf4

Text Ranking • 23.1M • Updated Feb 24 • 6

PavonicAI/HeartMuLa-3B-4bit

4B • Updated Feb 24 • 34 • 2

mrhuseyn4/qwen3.5-27b-mxfp4

Text Generation • 28B • Updated Feb 25

mash2005/Qwen-Image-Edit-2511-MultiAngles-Q4

Image-to-Image • 11B • Updated Mar 18 • 6 • • 1

daksh-neo/Nemotron-3-Super-120B-NF4-4bit

Text Generation • 126B • Updated Mar 30 • 68 • 1

hupakabras/Nemotron-3-Nano-30B-A3B-bnb-4bit

Text Generation • 32B • Updated Mar 19 • 26

robotflowlabs/qwen2.5-7b-instruct-int4

Text Generation • 8B • Updated Mar 19 • 8

robotflowlabs/qwen3-vl-2b-instruct-int4

Image-Text-to-Text • 2B • Updated Mar 19 • 10

robotflowlabs/qwen3-vl-4b-instruct-int4

Image-Text-to-Text • 5B • Updated Mar 19 • 218

princeDjoumessi/CogVideoX-5b-nf4

Image-to-Video • 3B • Updated Mar 20 • 3

hhhhy888/Qwen3-TTS-12Hz-1.7B-Base-BNB-NF4

Text-to-Speech • 2B • Updated Mar 23 • 20 • 1

emreyigitozturk/llama-3.2-3b-bitsandbytes-4bit-nf4

Text Generation • Updated Mar 24

groxaxo/s2-pro-BnB-4Bits

Text-to-Speech • Updated Mar 25 • 312 • 7

Granddyser/biglove-klein2

Text-to-Image • 9B • Updated Apr 8 • 7.14k • 24

Whomstt/Ministral-3-3B-Instruct-2512-bnb-nf4

Text Generation • 4B • Updated Mar 27 • 12

cudabenchmarktest/personaplex-7b-nf4

Updated Mar 29 • 35

Loke-60000/christina-TTS-nf4

Text-to-Speech • 0.9B • Updated Mar 29 • 25

tantk/vibevoice-1.5b-bnb-4bit

Text-to-Speech • 2B • Updated Apr 2 • 8

livadies/gemma-4-E2B-Ghetto-NF4

Text Generation • 5B • Updated Apr 3 • 8

livadies/gemma-4-31B-Base-Ghetto-NF4

Text Generation • 32B • Updated Apr 3 • 11 • 2

livadies/gemma-4-E4B-Ghetto-NF4

Text Generation • 8B • Updated Apr 3 • 15

SanDiegoDude/JoyAI-Image-Edit-NF4

Updated Apr 4 • 1