megatron/arguments.py · 717c5274462e171925129da8081fcd6e5904f3af · OpenDAS / Megatron-LM · GitLab

"docs/zh_cn/understand_mmcv/runner.md" did not exist on "db580dda8d2bf4c0e3aee3639e053cef6c58b80f"

Find file Blame History Permalink

Merge branch 'nextlm-merge-sentencepiece' into 'main' · 717c5274
Jared Casper authored Apr 06, 2023
```
Add support for GPTSentencePieceTokenizer and related fixes.

See merge request ADLR/megatron-lm!561
```
717c5274

arguments.py 63.4 KB