Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,272

Base only

Active filters: vllm

canada-quant/hy3-w4a16-mtp

Text Generation • 47B • Updated 14 days ago • 1.8k • 5

anemll/DeepSeek-V4-Flash-NVFP4-TP2-W4A4-v1

Text Generation • 167B • Updated 10 days ago • 83 • 2

0xdfi/GLM-5.2-1M-context-NVFP4-4x-DGX-Spark

Text Generation • Updated 10 days ago • 2

rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm

Text Generation • 104B • Updated 3 days ago • 64 • 3

olka-fi/Laguna-S-2.1-MXFP4

Text Generation • 64B • Updated 6 days ago • 597 • 3

cyankiwi/Laguna-XS-2.1-AWQ-INT4

Text Generation • 34B • Updated 9 days ago • 298 • 3

rdtand/Laguna-S-2.1-prismaquant-gridbook-6bit-vllm

Text Generation • 85B • Updated 3 days ago • 383 • 6

pocharlies/Ornith-1.0-35B-NVFP4-MTP-graft

Text Generation • 20B • Updated 7 days ago • 1.64k • 2

drowzeys/keys-vllm-0.25.2-Anemll-MiaAI_lab-DSV4F-DSpark-100pct-Abliterated-Dual-DGX-Sparks

Text Generation • 165B • Updated 6 days ago • 32 • 2

JasonW2025/Hy3-295B-A21B-R2fc

Text Generation • 95B • Updated 4 days ago • 4 • 2

tengsnake/Llama-Guard-4-12B-NVFP4

Text Generation • 12B • Updated 3 days ago • 40 • 2

byteshape/Qwen-Image-2512-Humming

Text-to-Image • Updated 3 days ago • 2

JasonW2025/Laguna-S-2.1-ModelOpt-NVFP4-W4A4-vllm

Text Generation • 61B • Updated 2 days ago • 45 • 2

unistra-dnum/Luciole-1B-Instruct-1.1-NVFP4

Text Generation • 1B • Updated 2 days ago • 67 • 2

unistra-dnum/Luciole-8B-Instruct-1.1-NVFP4

Text Generation • 8B • Updated 2 days ago • 74 • 2

unistra-dnum/Luciole-23B-Instruct-1.1-NVFP4

Text Generation • 23B • Updated 2 days ago • 54 • 2

mistralai/Codestral-22B-v0.1

22B • Updated Jul 24, 2025 • 32.9k • 1.34k

mistralai/Mistral-Nemo-Instruct-2407

12B • Updated Jul 28, 2025 • 444k • 1.69k

mistralai/Pixtral-12B-2409

Updated Jun 2 • 7.12k • 692

RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

Text Generation • 89B • Updated Oct 2, 2024 • 210 • 12

huihui-ai/Mistral-Small-24B-Instruct-2501-abliterated

Text Generation • 24B • Updated Feb 2, 2025 • 2.71k • • 35

mistralai/Mistral-Small-3.1-24B-Instruct-2503

24B • Updated Dec 22, 2025 • 292k • 1.38k

RedHatAI/whisper-large-v3-quantized.w4a16

Automatic Speech Recognition • 2B • Updated Apr 22, 2025 • 3.21k • 4

RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.9B • Updated Apr 28 • 2.91k • 9

huihui-ai/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated

Image-Text-to-Text • 24B • Updated Jul 3, 2025 • 1.06k • • 17

RedHatAI/Llama-4-Scout-17B-16E-Instruct-NVFP4

Text Generation • 64B • Updated Nov 21, 2025 • 1.57k • 2

vinoku89/svg-code-generator

Text Generation • 0.6B • Updated Jul 26, 2025 • 1.91k • • 15

maerong3/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • 24B • Updated Aug 6, 2025 • 457 • 3

huihui-ai/Huihui-gpt-oss-20b-BF16-abliterated

Text Generation • 21B • Updated Sep 27, 2025 • 20.5k • 218

ByteDance-Seed/Seed-OSS-36B-Base

Text Generation • 36B • Updated Aug 26, 2025 • 2.48k • 65