RedHatAI
/

Qwen2.5-VL-72B-Instruct-quantized.w8a8

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions

Qwen2.5-VL-72B-Instruct-quantized.w8a8 / generation_config.json

Commit History

Update files to match base model keeping quant_config intact

0d21073

shubhrapandit commited on May 1

Upload model files

4699ffe

Shubhra Pandit commited on Feb 7