Hugging Face's logo
community's picture
1 6

community

Complete123123
Lucy-in-the-Sky's profile picture
·

AI & ML interests

None yet

Recent Activity

new activity 20 days ago
NexaAI/DeepSeek-OCR-GGUF:cann't run？
replied to mitkox's post 26 days ago
I just threw Qwen3-0.6B in BF16 into an on device AI drag race on AMD Strix Halo with vLLM: 564 tokens/sec on short 100-token sprints 96 tokens/sec on 8K-token marathons TL;DR You don't just run AI on AMD. You negotiate with it. The hardware absolutely delivers. Spoiler alert; there is exactly ONE configuration where vLLM + ROCm + Triton + PyTorch + Drivers + Ubuntu Kernel to work at the same time. Finding it required the patience of a saint Consumer AMD for AI inference is the ultimate "budget warrior" play, insane performance-per-euro, but you need hardcore technical skills that would make a senior sysadmin nod in quiet respect.
liked a model about 1 month ago
richinfoai/ritrieve_zh_v1
View all activity

Organizations

None yet