Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

100

Base only

Active filters: localai

mudler/depth-anything.cpp-gguf

Depth Estimation • 0.1B • Updated Jun 20 • 19.4k • 12

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated Jun 11 • 7.48k • 12

mudler/face-detect-gguf

69.7M • Updated about 1 month ago • 17k • 2

mudler/voice-detect-gguf

0.3B • Updated about 1 month ago • 8.18k • 3

mudler/Qwen3.6-27B-NVFP4-GGUF

Text Generation • 27B • Updated Jun 27 • 885 • 5

mudler/Qwen3.6-35B-A3B-NVFP4-GGUF

Text Generation • 36B • Updated Jun 27 • 3.26k • 9

chris365312/whisper-large-v3-de-at-ct2

Automatic Speech Recognition • Updated Jun 24, 2025 • 15 • 3

AbdulElahGwaith/LocalAI

DQN-Labs-Community/dqnMath-v1

Text Generation • 4B • Updated Apr 1 • 26 • • 2

DQN-Labs-Community/dqnMath-v1-GGUF

Text Generation • 4B • Updated Apr 1 • 33 • 2

DQN-Labs-Community/dqnCode-v1

Text Generation • 4B • Updated Mar 30 • 77 • 2

DQN-Labs-Community/dqnCode-v1-GGUF

Text Generation • 4B • Updated Apr 1 • 236 • 2

DQN-Labs-Community/dqnGPT-v1

Text Generation • 8B • Updated Apr 6 • 12 • 1

mradermacher/dqnGPT-v1-GGUF

8B • Updated Apr 4 • 163 • 1

DQN-Labs-Community/dqnGPT-v1-GGUF

Text Generation • 8B • Updated Apr 5 • 107 • 2

mradermacher/dqnMath-v1-GGUF

4B • Updated Apr 7 • 220 • 1

mradermacher/dqnMath-v1-i1-GGUF

4B • Updated Apr 7 • 275 • 1

DQN-Labs-Community/dqnScience-v1-GGUF

Text Generation • 4B • Updated Apr 7 • 172 • 1

LocalAI-io/whisper-tiny-it

Automatic Speech Recognition • 37.8M • Updated May 24 • 13

LocalAI-io/whisper-tiny-it-ct2-int8

Automatic Speech Recognition • Updated May 24 • 5

LocalAI-io/whisper-base-it

Automatic Speech Recognition • 72.6M • Updated May 24 • 25

LocalAI-io/whisper-base-it-ct2-int8

Automatic Speech Recognition • Updated May 24 • 14

LocalAI-io/whisper-tiny-it-multi

Automatic Speech Recognition • 37.8M • Updated May 24 • 6

LocalAI-io/whisper-tiny-it-multi-ct2-int8

Automatic Speech Recognition • Updated May 24 • 6

LocalAI-io/whisper-base-it-multi

Automatic Speech Recognition • 72.6M • Updated May 24 • 5

LocalAI-io/whisper-base-it-multi-ct2-int8

Automatic Speech Recognition • Updated May 24 • 11

LocalAI-io/whisper-small-it-multi

Automatic Speech Recognition • 0.2B • Updated May 24 • 8

LocalAI-io/whisper-small-it-multi-ct2-int8

Automatic Speech Recognition • Updated May 24 • 7

LocalAI-io/whisper-medium-it-multi

Automatic Speech Recognition • 0.8B • Updated May 24 • 4

LocalAI-io/whisper-medium-it-multi-ct2-int8

Automatic Speech Recognition • Updated May 24 • 8