EXL3 models
Collection
55 items • Updated • 51
How to use turboderp/HyperCLOVAX-SEED-Think-32B-exl3 with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("turboderp/HyperCLOVAX-SEED-Think-32B-exl3", dtype="auto")EXL3 quants of HyperCLOVAX-SEED-Think-32B
⚠️ Requires ExLlamaV3 v0.0.19 (or v0.0.18 dev branch)
Base bitrates:
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
Base model
naver-hyperclovax/HyperCLOVAX-SEED-Think-32B