Commits · 4ab742459735671189d774cfa336d52561655816 · chenpangpang / transformers

05 Jun, 2020 1 commit
- [cleanup/marian] pipelines test and new kwarg (#4812) · 4ab74245
  Sam Shleifer authored Jun 05, 2020
  
  4ab74245
19 May, 2020 1 commit
- [MarianTokenizer] implement save_vocabulary and other common methods (#4389) · efbc1c5a
  Sam Shleifer authored May 19, 2020
  
  efbc1c5a
13 May, 2020 1 commit
- [Marian Fixes] prevent predicting pad_token_id before softmax, support... · 9a687ebb
  Sam Shleifer authored May 13, 2020
```
[Marian Fixes] prevent predicting pad_token_id before softmax, support language codes, name multilingual models (#4290)
```
  9a687ebb
10 May, 2020 1 commit

[Marian] documentation and AutoModel support (#4152) · 3487be75

Sam Shleifer authored May 10, 2020

- MarianSentencepieceTokenizer - > MarianTokenizer
- Start using unk token.
- add docs page
- add better generation params to MarianConfig
- more conversion utilities

3487be75

28 Apr, 2020 1 commit
- MarianMTModel.from_pretrained('Helsinki-NLP/opus-marian-en-de') (#3908) · 847e7f33
  Sam Shleifer authored Apr 28, 2020
```
Co-Authored-By: Stefan Schweter <stefan@schweter.it>
```
  847e7f33