metadata
license: other
license_name: mrl
base_model: mistralai/Mistral-Large-Instruct-2411
base_model_relation: quantized
quantized_by: turboderp
tags:
- exl3
EXL3 quants of Mistral-Large-Instruct-2411
1.40 bits per weight / H4
1.60 bits per weight / H4
1.80 bits per weight / H5
2.00 bits per weight / H5
2.25 bits per weight / H5
2.50 bits per weight / H5
3.00 bits per weight / H6
3.50 bits per weight / H6
4.00 bits per weight / H6
5.00 bits per weight / H6
6.00 bits per weight / H6
