Model save

Training in progress, step 10050

DPO LoRA checkpoint - step 10000 (eval_loss: 0.6355)

DPO LoRA checkpoint - step 9900 (eval_loss: 0.6342)

DPO LoRA checkpoint - step 9800 (eval_loss: 0.6355)

DPO LoRA checkpoint - step 9700 (eval_loss: 0.6356)

DPO LoRA checkpoint - step 9600 (eval_loss: 0.6347)

DPO LoRA checkpoint - step 9500 (eval_loss: 0.6358)

DPO LoRA checkpoint - step 9400 (eval_loss: 0.6343)

DPO LoRA checkpoint - step 9300 (eval_loss: 0.6351)

DPO LoRA checkpoint - step 9200 (eval_loss: 0.6333)

DPO LoRA checkpoint - step 9100 (eval_loss: 0.6349)

DPO LoRA checkpoint - step 9000 (eval_loss: 0.6345)

DPO LoRA checkpoint - step 8900 (eval_loss: 0.6348)

DPO LoRA checkpoint - step 8800 (eval_loss: 0.6352)

DPO LoRA checkpoint - step 8700 (eval_loss: 0.6347)

DPO LoRA checkpoint - step 8600 (eval_loss: 0.6351)

DPO LoRA checkpoint - step 8500 (eval_loss: 0.6347)

DPO LoRA checkpoint - step 8400 (eval_loss: 0.6357)

DPO LoRA checkpoint - step 8300 (eval_loss: 0.6353)

DPO LoRA checkpoint - step 8200 (eval_loss: 0.6357)

DPO LoRA checkpoint - step 8100 (eval_loss: 0.6360)

DPO LoRA checkpoint - step 8000 (eval_loss: 0.6349)

DPO LoRA checkpoint - step 7900 (eval_loss: 0.6362)

DPO LoRA checkpoint - step 7800 (eval_loss: 0.6356)

DPO LoRA checkpoint - step 7700 (eval_loss: 0.6356)

DPO LoRA checkpoint - step 7600 (eval_loss: 0.6349)

DPO LoRA checkpoint - step 7500 (eval_loss: 0.6365)

DPO LoRA checkpoint - step 7400 (eval_loss: 0.6371)

DPO LoRA checkpoint - step 7300 (eval_loss: 0.6371)

DPO LoRA checkpoint - step 7200 (eval_loss: 0.6371)

DPO LoRA checkpoint - step 7100 (eval_loss: 0.6370)

DPO LoRA checkpoint - step 7000 (eval_loss: 0.6371)

DPO LoRA checkpoint - step 6900 (eval_loss: 0.6394)

DPO LoRA checkpoint - step 6800 (eval_loss: 0.6393)

DPO LoRA checkpoint - step 6700 (eval_loss: 0.6396)

DPO LoRA checkpoint - step 6600 (eval_loss: 0.6385)

DPO LoRA checkpoint - step 6500 (eval_loss: 0.6379)

DPO LoRA checkpoint - step 6400 (eval_loss: 0.6403)

DPO LoRA checkpoint - step 6300 (eval_loss: 0.6386)

DPO LoRA checkpoint - step 6200 (eval_loss: 0.6365)

DPO LoRA checkpoint - step 6100 (eval_loss: 0.6414)

DPO LoRA checkpoint - step 6000 (eval_loss: 0.6389)

DPO LoRA checkpoint - step 5900 (eval_loss: 0.6396)

DPO LoRA checkpoint - step 5800 (eval_loss: 0.6395)

DPO LoRA checkpoint - step 5700 (eval_loss: 0.6427)

DPO LoRA checkpoint - step 5600 (eval_loss: 0.6451)

DPO LoRA checkpoint - step 5500 (eval_loss: 0.6404)

DPO LoRA checkpoint - step 5400 (eval_loss: 0.6432)

DPO LoRA checkpoint - step 5300 (eval_loss: 0.6453)