itlwas
itlwas
AI & ML interests
👋 Here you’ll find GGUF models 🗂️ with Q4_K_M quantization ⚙️, optimized for low-resource devices 💻. These models balance size 📏 and performance 🚀. Notice any issues? Message me on Telegram: @itlwas
Recent Activity
liked
a model
3 days ago
zai-org/GLM-4.7
liked
a model
12 days ago
ServiceNow-AI/Apriel-1.6-15b-Thinker
liked
a model
5 months ago
openai/gpt-oss-120b
Organizations
-
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 29 -
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B • Updated • 20 -
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 16 -
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation • 3B • Updated • 31
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 45 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B • Updated • 14 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 62 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated • 12
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated • 4 -
itlwas/internlm2_5-7b-chat-1m-Q4_K_M-GGUF
Text Generation • 8B • Updated • 16 -
itlwas/dolphin-2.9-llama3-8b-1m-Q4_K_M-GGUF
8B • Updated • 30 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated • 10
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation • 12B • Updated • 11 • 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation • 12B • Updated • 91 • 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation • 7B • Updated • 21 • 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation • 12B • Updated • 54 • 1
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated • 4 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated • 10 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B • Updated • 12 • 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation • 8B • Updated • 36
-
itlwas/Custom-KoLLM-13B-v6-Q4_K_M-GGUF
Text Generation • 13B • Updated • 15 -
itlwas/Custom-KoLLM-13B-v5-Q4_K_M-GGUF
Text Generation • 13B • Updated • 14 -
itlwas/Custom-KoLLM-13B-v4-Q4_K_M-GGUF
Text Generation • 13B • Updated • 8 -
itlwas/Custom-KoLLM-13B-v3-Q4_K_M-GGUF
Text Generation • 13B • Updated • 8
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated • 4 -
itlwas/internlm2_5-7b-chat-1m-Q4_K_M-GGUF
Text Generation • 8B • Updated • 16 -
itlwas/dolphin-2.9-llama3-8b-1m-Q4_K_M-GGUF
8B • Updated • 30 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated • 10
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation • 12B • Updated • 11 • 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation • 12B • Updated • 91 • 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation • 7B • Updated • 21 • 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation • 12B • Updated • 54 • 1
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated • 4 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated • 10 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B • Updated • 12 • 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation • 8B • Updated • 36
-
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 29 -
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B • Updated • 20 -
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 16 -
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation • 3B • Updated • 31
-
itlwas/Custom-KoLLM-13B-v6-Q4_K_M-GGUF
Text Generation • 13B • Updated • 15 -
itlwas/Custom-KoLLM-13B-v5-Q4_K_M-GGUF
Text Generation • 13B • Updated • 14 -
itlwas/Custom-KoLLM-13B-v4-Q4_K_M-GGUF
Text Generation • 13B • Updated • 8 -
itlwas/Custom-KoLLM-13B-v3-Q4_K_M-GGUF
Text Generation • 13B • Updated • 8
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 45 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B • Updated • 14 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 62 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated • 12