PEFT How to use SALT-NLP/CultureBank-Mixtral-SFT with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("/self/scr-sync/nlp/culturebank/models/.cache/huggingface/hub/models--mistralai--Mixtral-8x7B-Instruct-v0.1/snapshots/5c79a376139be989ef1838f360bf4f1f256d7aec/")
model = PeftModel.from_pretrained(base_model, "SALT-NLP/CultureBank-Mixtral-SFT") 
