Unverified Commit f3312515 authored by Patrick von Platen's avatar Patrick von Platen Committed by GitHub
Browse files

Add note for WikiSplit

parent 0724c0f3
...@@ -17,6 +17,9 @@ Disclaimer: The model card has been written by the Hugging Face team. ...@@ -17,6 +17,9 @@ Disclaimer: The model card has been written by the Hugging Face team.
You can use this model for sentence splitting, *e.g.* You can use this model for sentence splitting, *e.g.*
**IMPORTANT**: The model was not trained on the `"` (double quotation mark) character -> so the before tokenizing the text,
it is advised to replace all `"` (double quotation marks) with two single `'` (single quotation mark).
```python ```python
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment