server/text_generation/models/causal_lm.py · fcc2c5fcbf1bff5cdbba1508818650db13982ed2 · OpenDAS / text-generation-inference · GitLab

Find file Blame History Permalink

fix(server): Use cleanup_tokenization_spaces=False for lossless decoding (#13) · b94f3021
Nicolas Patry authored Jan 03, 2023
```
Fixes #12 in the easiest way I could think of.
```
b94f3021

causal_lm.py 16.6 KB