Unverified Commit 8b1b9394 authored by Daniel Khashabi's avatar Daniel Khashabi Committed by GitHub
Browse files

Minor fix.

parent 8809eb6c
...@@ -517,8 +517,7 @@ python ./run_squad.py \ ...@@ -517,8 +517,7 @@ python ./run_squad.py \
--doc_stride 128 \ --doc_stride 128 \
--output_dir $OUTPUT_DIR \ --output_dir $OUTPUT_DIR \
--train_batch_size 24 \ --train_batch_size 24 \
--gradient_accumulation_steps 2 \ --gradient_accumulation_steps 2
--optimize_on_cpu
``` ```
If you have a recent GPU (starting from NVIDIA Volta series), you should try **16-bit fine-tuning** (FP16). If you have a recent GPU (starting from NVIDIA Volta series), you should try **16-bit fine-tuning** (FP16).
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment