community's picture

1 6

community

Complete123123

·

jiuyuehe

AI & ML interests

None yet

Recent Activity

new activity 22 days ago

NexaAI/DeepSeek-OCR-GGUF:cann't run？

replied to mitkox's post 28 days ago

I just threw Qwen3-0.6B in BF16 into an on device AI drag race on AMD Strix Halo with vLLM: 564 tokens/sec on short 100-token sprints 96 tokens/sec on 8K-token marathons TL;DR You don't just run AI on AMD. You negotiate with it. The hardware absolutely delivers. Spoiler alert; there is exactly ONE configuration where vLLM + ROCm + Triton + PyTorch + Drivers + Ubuntu Kernel to work at the same time. Finding it required the patience of a saint Consumer AMD for AI inference is the ultimate "budget warrior" play, insane performance-per-euro, but you need hardcore technical skills that would make a senior sysadmin nod in quiet respect.

liked a model about 1 month ago

richinfoai/ritrieve_zh_v1

View all activity

Organizations

None yet

liked 2 models about 1 month ago

richinfoai/ritrieve_zh_v1

Sentence Similarity • 0.3B • Updated Mar 25 • 546 • 44

tencent/Youtu-Embedding

Sentence Similarity • 2B • Updated 20 days ago • 674 • 49

liked a Space 3 months ago

POINTS Reader OCR

Vision-Language Models for Document Conversion

liked 2 models 5 months ago

nomic-ai/nomic-embed-vision-v1.5

Image Feature Extraction • 92.9M • Updated Mar 31 • 75.5k • 203

Marqo/onnx-open_clip-ViT-L-14-336

Updated Jan 3, 2023 • 3

liked a model 10 months ago

Lucy-in-the-Sky/deepseek-moe-16b-base-Q4_K_M-GGUF

16B • Updated Jan 31 • 23 • 4