An Empirical Study of DPO Configuration Choices for LLM Alignment
Jan Majkutewicz
jmajkutewicz
AI & ML interests
None yet
Recent Activity
updated
a dataset 9 days ago
jmajkutewicz/sql-create-context published
a dataset 9 days ago
jmajkutewicz/sql-create-context updated
a collection
5 months ago
Evaluation of DPO Configurations Organizations
None yet
models 10
jmajkutewicz/zephyr-7b-dpo_dataset-mix
Text Generation • Updated
• 2
jmajkutewicz/zephyr-7b-dpo_PKU-SafeRLHF
Text Generation • Updated
jmajkutewicz/zephyr-7b-dpo_ultrafeedback
Text Generation • Updated
jmajkutewicz/zephyr-7b-dpo_hh-rlhf
Text Generation • Updated
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_dataset-mix
Text Generation • Updated
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_PKU-SafeRLHF
Text Generation • Updated
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_ultrafeedback
Text Generation • Updated
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_hh-rlhf
Text Generation • Updated
jmajkutewicz/zephyr-7b-dpo_oasst1
Text Generation • Updated
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_oasst1
Text Generation • Updated
datasets 6
jmajkutewicz/sql-create-context
Viewer
• Updated
• 78.6k • 13
jmajkutewicz/PKU-SafeRLHF-binarized
Viewer
• Updated
• 82.1k • 5
jmajkutewicz/hh-rlhf-binarized
Viewer
• Updated
• 169k • 7
jmajkutewicz/oasst1-binarized
Viewer
• Updated
• 14.9k • 4
jmajkutewicz/SHP-binarized
Viewer
• Updated
• 121k • 5
jmajkutewicz/WikiPrefs
Viewer
• Updated
• 65.3k • 20