Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

133

Base only

Active filters: claude

ryzdfm/qwen2.5-coder-3b-claude_opus_4.6-distilled

Text Generation • 3B • Updated 29 days ago • 9.78k • 16

squ11z1/claude-oss-350m

Text Generation • 0.4B • Updated 26 days ago • 613 • 10

mondk/claude-sonnet5-base.qwen2.5code1.5b-it

Text Generation • 2B • Updated 6 days ago • 65 • 5

mondk/claude-sonnet5-qwen-thinking

Text Generation • 4B • Updated about 10 hours ago • 2

empero-ai/Qwen3.5-9B-Claude-Opus-4.6-Distill-GGUF

9B • Updated Mar 15 • 3.32k • 3

squ11z1/claude-oss

Text Generation • 9B • Updated 26 days ago • 2.68k • 21

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF

Text Generation • 8B • Updated 5 days ago • 81.9k • 4

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5

Text Generation • 8B • Updated 5 days ago • 1.53k • 3

AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF

Text Generation • 8B • Updated 5 days ago • 105k • 1

mradermacher/Parable-Qwen3-8B-Claude-Fable-5-i1-GGUF

8B • Updated 24 days ago • 6.81k • 2

mondk/claude-sonnet5-base.llama3.2-3b-it

Text Generation • 3B • Updated 4 days ago • 58 • 1

mondk/claude-sonnet5-base.qwen2.5code3b-it

Text Generation • 3B • Updated 2 days ago • 13 • 1

mondk/super-like-claude-gguf-v2

Text Generation • 3B • Updated 2 days ago • 1

mondk/large-like-claude-v2

Text Generation • 8B • Updated 1 day ago • 1

mondk/small-like-claude-v2

Text Generation • 1B • Updated 1 day ago • 1

ehristoforu/ReAssistant

Text Generation • Updated Nov 29, 2024

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q2_K-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 32

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q6_K-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 30

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q8_0-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 63 • 1

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q3_K_L-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 54 • 1

ayan4m1/Llama3.1-8B-Sonnet

Text Generation • 8B • Updated Feb 10, 2025 • 10 • 1

mradermacher/Llama3.1-8B-Sonnet-GGUF

8B • Updated Feb 11, 2025 • 153

ayan4m1/Claudette-7B

Text Generation • 7B • Updated Feb 13, 2025 • 5 • 2

mradermacher/Claudette-7B-GGUF

7B • Updated Feb 13, 2025 • 244 • 3

mradermacher/Claudette-7B-i1-GGUF

7B • Updated Feb 13, 2025 • 595 • 2

Delta-Vector/Rei-V2-12B

Text Generation • 12B • Updated Mar 31, 2025 • 16 • • 13

Delta-Vector/Rei-V2-12B-EXL2

Text Generation • Updated Mar 31, 2025

mradermacher/Rei-V2-12B-GGUF

12B • Updated Jul 11, 2025 • 258 • 1

mradermacher/Rei-V2-12B-i1-GGUF

12B • Updated Jul 11, 2025 • 632 • 1

rahmanazhar/meta-claude-3.7-finetuned

Text Generation • Updated Aug 21, 2025 • 1