server/text_generation/models/causal_lm.py · 60472f9d2b03822e9e771d9a4a4885e2496c5537 · OpenDAS / text-generation-inference · GitLab

Find file Blame History Permalink

fix(server): Check for device type correctly when determining initial padding (#16) · 686cc667
Nick Hill authored Dec 30, 2022
```
AFAIK there is no torch device type called "gpu".
```
686cc667

causal_lm.py 16.6 KB