How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-classification", model="elisachen/awq-tinyllama-classification")
# Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification

tokenizer = AutoTokenizer.from_pretrained("elisachen/awq-tinyllama-classification")
model = AutoModelForSequenceClassification.from_pretrained("elisachen/awq-tinyllama-classification", device_map="auto")
Quick Links

Configuration Parsing Warning:In config.json: "quantization_config.modules_to_not_convert" must be an array

README.md exists but content is empty.
Downloads last month
6
Safetensors
Model size
1B params
Tensor type
I32
·
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support