Models

1,180

Full-text search

Active filters: orpo

mradermacher/Huihui-Qwen3.5-2B-abliterated-Athanorlite-ORPO-i1-GGUF

Image-Text-to-Text • 2B • Updated 27 days ago • 3.62k • 1

mradermacher/Huihui-Qwen3.5-0.8B-abliterated-Athanorlite-ORPO-i1-GGUF

Text Generation • 0.8B • Updated 29 days ago • 3.11k • 1

hemlang/Hembot-7B-v1

Text Generation • 8B • Updated 10 days ago • 9 • 1

mradermacher/Hembot-7B-v1-GGUF

Text Generation • 8B • Updated 10 days ago • 843 • 1

mradermacher/Hembot-7B-v1-i1-GGUF

Text Generation • 8B • Updated 10 days ago • 3.96k • 1

alvarobartt/Mistral-7B-v0.1-ORPO

Text Generation • 7B • Updated Mar 23, 2024 • 7 • 14

alvarobartt/Mistral-7B-v0.1-ORPO-PEFT

Text Generation • Updated Mar 23, 2024 • 3 • 1

anakin87/gemma-2b-orpo

Text Generation • 3B • Updated Jun 29, 2025 • 21 • • 28

alvarobartt/mistral-orpo-mix

Text Generation • 7B • Updated Mar 24, 2024 • 4 • 1

bartowski/Mistral-7B-v0.1-ORPO-exl2

Text Generation • Updated Mar 24, 2024 • 1

bartowski/Mistral-7B-v0.1-ORPO-GGUF

Text Generation • 7B • Updated Mar 24, 2024 • 230 • 1

alvarobartt/mistral-orpo-mix-b0.1-l2048-pl1792-lr5e-6-inverse-sqrt

Text Generation • 7B • Updated Mar 26, 2024 • 4

alvarobartt/mistral-orpo-mix-b0.05-l1024-pl512-lr5e-7-cosine

Text Generation • 7B • Updated Mar 26, 2024 • 4

alvarobartt/mistral-7b-orpo-alignment-handbook

Text Generation • 7B • Updated Mar 27, 2024 • 8 • 1

alvarobartt/mistral-7b-orpo-airoboros-pref-10k

Text Generation • 7B • Updated Mar 28, 2024 • 13

mradermacher/mistral-7b-orpo-capybara-reproduction-GGUF

7B • Updated May 6, 2024 • 402

vain05/stablelm-2-1_6b-orpo-full-v1

Text Generation • 2B • Updated Apr 5, 2024 • 3

anakin87/gemma-2b-orpo-GGUF

3B • Updated Apr 9, 2024 • 21 • 7

vain05/stablelm-2-1_6b-orpo-full-v2

Text Generation • 2B • Updated Apr 6, 2024 • 2

vain05/stablelm-2-1_6b-orpo-full-v3

Text Generation • 2B • Updated Apr 7, 2024

HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1

Text Generation • 141B • Updated Apr 18, 2024 • 78 • 269

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • 141B • Updated Apr 12, 2024 • 517 • 29

mlx-community/zephyr-orpo-141b-A35b-v0.1-4bit

Updated Apr 12, 2024 • 9 • 2

wandb/zephyr-orpo-7b-v0.2

Text Generation • 7B • Updated Apr 21, 2024 • 7 • 4

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw2.25

Text Generation • Updated Apr 12, 2024 • 4 • 1

DrishtiSharma/doplhin-2.1-mistral-7b-orpo-ultrafeedback-binarized-preferences

Updated Apr 12, 2024 • 1

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw2.5

Text Generation • Updated Apr 12, 2024 • 3

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw3

Text Generation • Updated Apr 12, 2024 • 6

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw3.5

Text Generation • Updated Apr 12, 2024 • 6

blockblockblock/zephyr-orpo-141b-A35b-v0.1-bpw3.7

Text Generation • Updated Apr 12, 2024 • 4