Jeethu
/

Mistral-Nemo-Instruct-2407-PLLM

Text Generation

4-bit precision

Model card Files Files and versions

4-bit OmniQuant quantized version of Mistral-Nemo-Instruct-2407.

Downloads last month: 16

Model tree for Jeethu/Mistral-Nemo-Instruct-2407-PLLM

Base model

mistralai/Mistral-Nemo-Base-2407

Finetuned

mistralai/Mistral-Nemo-Instruct-2407

Quantized

(168)

this model

Paper for Jeethu/Mistral-Nemo-Instruct-2407-PLLM

OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models

Paper • 2308.13137 • Published Aug 25, 2023 • 20