What are the minimal computer/server config (memory, processor, GPU) to run DeepSeek-OCR?
#31
by leandrobortolotto - opened
I am considering installing DeepSeek on my server. What are the minimal requirements so I can run it as a service for my own application?
leandrobortolotto changed discussion title from What are the minimal compute settings to run DeepSeek-OCR? to What are the minimal computer/server settings to run DeepSeek-OCR?
leandrobortolotto changed discussion title from What are the minimal computer/server settings to run DeepSeek-OCR? to What are the minimal computer/server config (memory, processor, GPU) to run DeepSeek-OCR?
I have 32 GB VRAM and use less than 40% of it. With flash attention, I get about 10 seconds/page of throughput. 64 ram would definitely do the trick, it probably uses 10gb ram.
I have 32 GB VRAM and use less than 40% of it. With flash attention, I get about 10 seconds/page of throughput. 64 ram would definitely do the trick, it probably uses 10gb ram.
Tiny: base_size = 512, image_size = 512, crop_mode = False
Small: base_size = 640, image_size = 640, crop_mode = False
Base: base_size = 1024, image_size = 1024, crop_mode = False
Large: base_size = 1280, image_size = 1280, crop_mode = False
ok. Well, which size u used plz~~
ok. Well, which size u used plz~~
base