Commits · e4b26aa10bd43c93cd236a9e3388692eb1e8a321 · OpenDAS / text-generation-inference

04 Jul, 2023 1 commit

fix(server): avoid errors for very small top_p values (#544) · e4b26aa1

Nick Hill authored Jul 04, 2023

See https://github.com/huggingface/transformers/pull/24111

I didn't add validation to the `__init__` method since it's not done for
other values/warpers.

e4b26aa1

20 Jun, 2023 1 commit
- fix(server): fix warpers on CPU (#472) · 53aa9194
  OlivierDehaene authored Jun 20, 2023
```
Closes #471
```
  53aa9194
26 May, 2023 1 commit
- feat(server): support vectorized warpers in flash causal lm (#317) · 62f91f78
  OlivierDehaene authored May 26, 2023
```
Co-authored-by: Joel Lamy-Poirier <joel.lamy-poirier@servicenow.com>
```
  62f91f78