Unverified Commit d92a7f77 authored by Thomas Wolf's avatar Thomas Wolf Committed by GitHub
Browse files

Removing note on run_squad.py example

parent 5c0838d8
......@@ -194,5 +194,3 @@ python run_squad.py \
--doc_stride 128 \
--output_dir ../debug_squad/
```
There is currently a bug in the `run_squad.py` script that we are investigating. The reported numbers are very low (F1 of 41.8 and exact match of 21.7) even though the correct answer is usually in the n-best predictions. We are investigating that right now on the develop branch, follow [this issue](https://github.com/huggingface/pytorch-pretrained-BERT/issues/3) for more updates.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment