Comparing Bad Apples to Good Oranges: Aligning Large Language Models via Joint Preference Optimization
Paper • 2404.00530 • Published
How to use jointpreferences/mistral_7b_lr_1.5e-6_sft with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("jointpreferences/mistral_7b_lr_1.5e-6_sft", dtype="auto")Configuration Parsing Warning:Config file config.json cannot be fetched (too big)
Configuration Parsing Warning:Config file tokenizer_config.json cannot be fetched (too big)
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Paper: Comparing Bad Apples to Good Oranges: Aligning Large Language Models via Joint Preference Optimization