Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

277

Base only

Active filters: valiant

koesn/Llama3.1-8B-Cobalt-GGUF

Text Generation • 8B • Updated Sep 10, 2024 • 81

koesn/Llama3.1-8B-Enigma-GGUF

Text Generation • 8B • Updated Sep 11, 2024 • 95

koesn/Llama3.1-8B-Fireplace2-GGUF

Text Generation • 8B • Updated Sep 12, 2024 • 121

mradermacher/Llama2-70B-ShiningValiant-GGUF

69B • Updated Sep 17, 2024 • 130

bartowski/Llama3.1-8B-ShiningValiant2-GGUF

Text Generation • 8B • Updated Sep 17, 2024 • 1.15k • 2

mradermacher/Llama2-70B-ShiningValiant-i1-GGUF

69B • Updated Sep 19, 2024 • 107

ValiantLabs/Llama3.2-3B-ShiningValiant2

Text Generation • 3B • Updated Jan 21, 2025 • 15 • • 6

ValiantLabs/Llama3.2-3B-Enigma

Text Generation • 3B • Updated Jan 21, 2025 • 14 • • 10

sequelbox/Llama3.1-8B-PlumMath

Text Generation • 8B • Updated Oct 4, 2024 • 9 • 1

ValiantLabs/Llama3.1-8B-Esper2

Text Generation • 8B • Updated Mar 12, 2025 • 8 • 2

sequelbox/Llama3.1-8B-PlumCode

Text Generation • 8B • Updated Nov 17, 2024 • 11

ValiantLabs/Llama3.2-3B-Esper2

Text Generation • 3B • Updated Jan 21, 2025 • 10 • 3

mradermacher/Llama3.1-8B-PlumMath-GGUF

8B • Updated Oct 11, 2024 • 441

mradermacher/Llama3.1-8B-PlumCode-GGUF

8B • Updated Aug 1, 2025 • 356

mradermacher/Llama3.1-8B-PlumMath-i1-GGUF

8B • Updated Oct 11, 2024 • 628

mradermacher/Llama3.1-8B-PlumCode-i1-GGUF

8B • Updated Nov 18, 2024 • 249

QuantFactory/Llama3.2-3B-Enigma-GGUF

Text Generation • 3B • Updated Oct 8, 2024 • 527 • 3

QuantFactory/Llama3.2-3B-ShiningValiant2-GGUF

Text Generation • 3B • Updated Oct 8, 2024 • 142 • 3

QuantFactory/Llama3.2-3B-Esper2-GGUF

Text Generation • 3B • Updated Oct 8, 2024 • 405 • 3

QuantFactory/Llama3.1-8B-Esper2-GGUF

Text Generation • 8B • Updated Oct 9, 2024 • 164 • 1

mradermacher/Llama3-70B-Fireplace-GGUF

71B • Updated Feb 6, 2025 • 47

mradermacher/Llama3-70B-Fireplace-i1-GGUF

71B • Updated Oct 24, 2024 • 41

ValiantLabs/Llama3.1-70B-ShiningValiant2

Text Generation • 71B • Updated Jan 21, 2025 • 7 • 4

bartowski/Llama3.2-3B-ShiningValiant2-GGUF

Text Generation • 3B • Updated Oct 31, 2024 • 375

bartowski/Llama3.1-70B-ShiningValiant2-GGUF

Text Generation • 71B • Updated Oct 31, 2024 • 566 • 3

mradermacher/CodeLlama-13B-Fireplace-GGUF

13B • Updated Nov 6, 2024 • 55

mradermacher/CodeLlama-13B-Fireplace-i1-GGUF

13B • Updated Nov 6, 2024 • 290

mradermacher/Llama3.1-70B-ShiningValiant2-GGUF

71B • Updated Nov 12, 2024 • 68

tensorblock/Llama3.1-8B-ShiningValiant2-GGUF

Text Generation • 8B • Updated Jan 27 • 66

mradermacher/Llama3.1-70B-ShiningValiant2-i1-GGUF

71B • Updated Nov 12, 2024 • 196