OPEA
/

Qwen2.5-1.5B-Instruct-int4-sym-inc

4-bit precision

Model card Files Files and versions

cicdatopea commited on Sep 11

Commit

8f7abbc

·

verified ·

1 Parent(s): fb72325

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -25,7 +25,7 @@ language:
 This model is an int4 model with group_size 128 and symmetric quantization of [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) generated by [intel/auto-round](https://github.com/intel/auto-round). Load the model with `revision="14dbc8"` to use AutoGPTQ format
-⚠️ Important: This model is used for internal testing with Hugginface. Please do not delete or modify without approval.
 ## How To Use

 This model is an int4 model with group_size 128 and symmetric quantization of [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) generated by [intel/auto-round](https://github.com/intel/auto-round). Load the model with `revision="14dbc8"` to use AutoGPTQ format
+⚠️ Important: This model is used for internal testing with Hugginface and VLLM. Please do not delete or modify without approval.
 ## How To Use