Unverified Commit f3312515 authored by Patrick von Platen's avatar Patrick von Platen Committed by GitHub
Browse files

Add note for WikiSplit

parent 0724c0f3
......@@ -17,6 +17,9 @@ Disclaimer: The model card has been written by the Hugging Face team.
You can use this model for sentence splitting, *e.g.*
**IMPORTANT**: The model was not trained on the `"` (double quotation mark) character -> so the before tokenizing the text,
it is advised to replace all `"` (double quotation marks) with two single `'` (single quotation mark).
```python
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment