tests/engine/test_skip_tokenizer_init.py · a37d815b83849b5a96a182929dd6f3bd35f68fb8 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

Make initialization of tokenizer and detokenizer optional (#3748) · a37d815b
GeauxEric authored Apr 21, 2024
```
Co-authored-by: Yun Ding <yunding@nvidia.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
a37d815b

test_skip_tokenizer_init.py 947 Bytes