Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

104

Base only

Active filters: 1-bit

daksh-neo/sarvam-30b-quantized

Text Generation • 32B • Updated Mar 14 • 6

hidude562/tiny-tiny-stories

Text Generation • Updated Mar 26

DavidBPunkt/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 3 • 126

coverblew/llamita.cpp

Text Generation • Updated Apr 3 • 1

Zetaphor/Bonsai-llamafile

Updated Apr 4 • 91 • 4

MrNAM205/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 5 • 153

daksh-neo/qwen3.5-1bit-quantization-study

Text Generation • Updated Apr 10 • 2

mayomacam/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 6 • 141

Outlier-Ai/Outlier-10B-V2

Text Generation • 8B • Updated May 5 • 26 • 1

Torun00/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 8 • 129

Puppypepper21/Bonsai-8B-mlx-1bit

Text Generation • 0.4B • Updated Apr 8 • 93

mradermacher/Outlier-10B-V2-GGUF

Text Generation • 8B • Updated Apr 30 • 27 • 1

Outlier-Ai/Outlier-70B-V3.2

Text Generation • Updated May 5 • 12 • 3

Outlier-Ai/Outlier-40B-V3.2

Text Generation • Updated May 5 • 13 • 1

Outlier-Ai/Outlier-10B-V3.2

Text Generation • 23B • Updated May 5 • 13 • 1

cs-cmyk/df-ssm-mamba2-1.3b

randomaibullshitgo/qwen3-14b-medusa-1bit

bakrianto/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 22 • 137

toxzak/Qwen3.6-27B-FABQ-RC

Text Generation • Updated Jun 9 • 7 • 1

welcoma/Bonsai-1.7B-bonsai_q1_f32-MLC

Text Generation • Updated May 6 • 14

welcoma/Bonsai-4B-bonsai_q1_f32-MLC

Text Generation • Updated May 6 • 2

welcoma/Bonsai-8B-bonsai_q1_f32-MLC

Text Generation • Updated May 6 • 4

hidude562/bitnet1-300M-v76-research

jinreiyu/clone-Bonsai-8B-mlx-1bit

Text Generation • 0.4B • Updated May 15 • 137

jinreiyu/clone-Bonsai-8B-gguf

Text Generation • 8B • Updated May 15 • 128

leok7v/bonsai-1.7b

Text Generation • 2B • Updated May 23 • 63

toxzak/Qwen3.6-27B-Q1_K-GGUF

Updated Jun 9 • 261

Luncy1978/Bonsai-8B-gguf

Text Generation • 8B • Updated May 29 • 157

BlackCubeBanditos/Bonsai-1.7B-gguf

Text Generation • 2B • Updated May 30 • 151

brulee-1/SSMoELM-Base

11.9M • Updated Jun 4