Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
quyanh
/
pythia-2.8b-dpo
like
0
Transformers
Safetensors
Generated from Trainer
dpo
trl
arxiv:
2305.18290
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
pythia-2.8b-dpo
175 MB
1 contributor
History:
105 commits
This model has 1 file scanned as suspicious.
Show
files
quyanh
Model save
a651235
verified
4 months ago
final_model
Model save
4 months ago
.gitattributes
1.52 kB
initial commit
4 months ago
README.md
2.52 kB
Training in progress, step 100
4 months ago
adapter_config.json
941 Bytes
DPO LoRA checkpoint - step 100 (eval_loss: 0.6984)
4 months ago
adapter_model.safetensors
83.9 MB
xet
Training in progress, step 10050
4 months ago
special_tokens_map.json
587 Bytes
Tokenizer - DPO LoRA checkpoint - step 100 (eval_loss: 0.6984)
4 months ago
tokenizer.json
3.56 MB
Tokenizer - DPO LoRA checkpoint - step 100 (eval_loss: 0.6984)
4 months ago
tokenizer_config.json
5.07 kB
Tokenizer - DPO LoRA checkpoint - step 100 (eval_loss: 0.6984)
4 months ago
training_args.bin
6.8 kB
xet
Training in progress, step 100
4 months ago
