microsoft
/

deberta-v3-large

Model card Files Files and versions

DeBERTa commited on Oct 24, 2021

Commit

8711b9e

·

1 Parent(s): 4d1fe29

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -53,7 +53,7 @@ python -m torch.distributed.launch --nproc_per_node=${num_gpus} \
   --do_eval \
   --evaluation_strategy steps \
   --max_seq_length 256 \
-  --warmup_steps 1000 \
   --per_device_train_batch_size ${batch_size} \
   --learning_rate 6e-6 \
   --num_train_epochs 2 \

   --do_eval \
   --evaluation_strategy steps \
   --max_seq_length 256 \
+  --warmup_steps 50 \
   --per_device_train_batch_size ${batch_size} \
   --learning_rate 6e-6 \
   --num_train_epochs 2 \