Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,253

Base only

Active filters: llama-cpp

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 1.87k • 352

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 17 days ago • 650k • • 1.33k

TokenRhythm/NeoHorse-1-4B-GGUF

Text Generation • 4B • Updated 8 days ago • 9.66k • 21

NANI-Nithin/K2-Horizon-MoVA-36B-A4B-GGUF

Text Generation • 37B • Updated 13 days ago • 43.3k • 36

TokenRhythm/NeoHorse-1-9B-GGUF

Text Generation • 9B • Updated 9 days ago • 9.79k • 19

Jab1718/qwen3.8-flash-coder-26gb-gguf

Text Generation • 43B • Updated 7 days ago • 5.86k • 15

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 419k • 855

SC117/Spark-X2.5-4B-abliterated-FIT-GGUF

Text Generation • 4B • Updated 11 days ago • 29.1k • 19

chenyumo/moziAI-35B-A3B-MOE-MTP

Text Generation • 36B • Updated 5 days ago • 20.8k • 19

ge525/Qwen3.8-9B-Distill-uncensored-heretic-Q4_K_M-GGUF

Text Generation • 9B • Updated 25 days ago • 15.1k • 21

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 43.5k • 187

theresa00l/Qwen3.8-27B-Uncensored-FP8-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated Aug 15 • 16.2k • 23

jan1k/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-Final-NVFP4-GGUF

Image-Text-to-Text • 35B • Updated 3 days ago • 3.44k • 6

MrFuzzihead/Qwen3.8-35B-A3B-Distill-APEX-GGUF

Text Generation • 35B • Updated about 5 hours ago • 17 • 5

AlicanKiraz0/BaronLLM-v2-OffensiveSecurityLLM-Q8

15B • Updated Aug 21, 2025 • 360 • 34

ISTA-DASLab/Qwen3.5-4B-GGUF-GSQ

Text Generation • 4B • Updated May 26 • 1.43k • 8

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 30k • 155

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 10.5k • 344

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 1.52k • 16

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 392k • 152

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-v3-GGUF

Text Generation • 1B • Updated Jul 29 • 1.68k • 9

V12nm/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 27 days ago • 1.58k • 3

prithivMLmods/OxCoder-9B-GGUF

Image-Text-to-Text • 9B • Updated 10 days ago • 6.69k • 8

DFveloper/gemma-4-26B-A4B-it-qat-q4_0-Claude-Opus-Distill-v2-GGUF

Text Generation • 25B • Updated 6 days ago • 634 • 3

wepiqx/OxCoder-9B-MERNIK-GGUF

Text Generation • 9B • Updated 3 days ago • 2.23k • 3

wepiqx/RINIQ-MERNIK-GGUF

Updated about 2 hours ago • 3

ggml-org/Qwen2.5-Coder-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Feb 27, 2025 • 1.2k • 4

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 2.35k • 63

maerong3/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • 24B • Updated Aug 6, 2025 • 17.7k • 7

bocalan/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 11, 2025 • 5.44k • 6