Inference Providers
Active filters: nm-vllm
RedHatAI/TinyLlama-1.1B-Chat-v1.0-pruned2.4
Text Generation • Updated • 9.33k
• • 2
RedHatAI/MiniChat-2-3B-pruned2.4
Text Generation • Updated • 12
RedHatAI/OpenHermes-2.5-Mistral-7B-pruned2.4
Text Generation • Updated • 30
RedHatAI/OpenHermes-2.5-Mistral-7B-pruned50
Text Generation • Updated • 41
• 1
RedHatAI/Nous-Hermes-2-SOLAR-10.7B-pruned2.4
Text Generation • Updated • 73
RedHatAI/Nous-Hermes-2-Yi-34B-pruned2.4
Text Generation • Updated • 72
RedHatAI/Nous-Hermes-2-Yi-34B-pruned50
Text Generation • Updated • 17
RedHatAI/zephyr-7b-beta-marlin
Text Generation • 1B • Updated • 74
RedHatAI/llama2.c-stories110M-pruned2.4
Text Generation • Updated • 28
RedHatAI/llama2.c-stories110M-pruned50
Text Generation • Updated • 2.59k
Text Generation • 3B • Updated • 19
RedHatAI/TinyLlama-1.1B-Chat-v1.0-marlin
Text Generation • 0.3B • Updated • 2.47k
• 2
RedHatAI/OpenHermes-2.5-Mistral-7B-marlin
Text Generation • 1B • Updated • 23
• 2
RedHatAI/Nous-Hermes-2-Yi-34B-marlin
Text Generation • 5B • Updated • 28
• 5
softmax/Llama-2-70b-chat-hf-marlin
Text Generation • 10B • Updated • 4
softmax/falcon-180B-chat-marlin
Text Generation • 26B • Updated • 19
dtransposed/llama2.c-stories110M-pruned50-compressed-tensors
Text Generation • 0.1B • Updated • 27
mradermacher/Nous-Hermes-2-SOLAR-10.7B-pruned2.4-GGUF
11B • Updated • 440
mradermacher/Nous-Hermes-2-SOLAR-10.7B-pruned2.4-i1-GGUF
11B • Updated • 784
tensorblock/llama2.c-stories110M-pruned50-GGUF
0.1B • Updated • 113
mradermacher/phi-2-pruned50-GGUF
3B • Updated • 316
mradermacher/llama2.c-stories110M-pruned50-GGUF
0.1B • Updated • 74
mradermacher/OpenHermes-2.5-Mistral-7B-pruned50-GGUF
7B • Updated • 229
• 1
mradermacher/MiniChat-2-3B-pruned2.4-GGUF
3B • Updated • 124
mradermacher/OpenHermes-2.5-Mistral-7B-pruned50-i1-GGUF
7B • Updated • 352
mradermacher/llama2.c-stories110M-pruned50-i1-GGUF
0.1B • Updated • 172
mradermacher/OpenHermes-2.5-Mistral-7B-pruned2.4-GGUF
7B • Updated • 155
mradermacher/OpenHermes-2.5-Mistral-7B-pruned2.4-i1-GGUF
7B • Updated • 217
tensorblock/OpenHermes-2.5-Mistral-7B-pruned2.4-GGUF
tensorblock/OpenHermes-2.5-Mistral-7B-pruned50-GGUF