Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

11

Full-text search

Active filters: tensorrt-llm

dimitribarbot/CodeLlama-13B-Instruct-GPTQ-TensorRT-LLM-RTX-4090

Text Generation • Updated Oct 25, 2024 • 19 • 1

DataSnake/Muse-12B-NVFP4

Text Generation • 7B • Updated 2 days ago • 42

DataSnake/Wayfarer-12B-NVFP4

Text Generation • 7B • Updated 2 days ago • 12

DataSnake/Wayfarer-2-12B-NVFP4

Text Generation • 7B • Updated 2 days ago • 17

trithemius/Velvet-14B-nvfp4

8B • Updated 17 days ago • 17

josephdowling10/Mixtral-8x7B-Instruct-v0.1-NVFP4

Text Generation • 23B • Updated 11 days ago • 4

yapwithai/delta-vector-rei-24B-kto-trt-awq

Text Generation • Updated about 3 hours ago

yapwithai/arliai-mistral-small-24B-arliai-rpmax-v1.4-trt-awq

Text Generation • Updated about 3 hours ago

yapwithai/arliai-qwen2.5-32B-arliai-rpmax-v1.3-trt-awq

Text Generation • Updated about 2 hours ago

yapwithai/nousresearch-hermes-4-14B-trt-awq

Text Generation • Updated about 2 hours ago

yapwithai/mistral-small-24B-instruct-2501-trt-awq

Text Generation • Updated about 2 hours ago