Commits · 09b7c26bbdb940e4e0d2216e14fd437f89fcdeb2 · OpenDAS / text-generation-inference · GitLab

08 Feb, 2024 1 commit
- feat(server): add frequency penalty (#1541) · 09b7c26b
  OlivierDehaene authored Feb 08, 2024
  
  09b7c26b
04 Jul, 2023 1 commit

fix(server): avoid errors for very small top_p values (#544) · e4b26aa1

Nick Hill authored Jul 04, 2023

See https://github.com/huggingface/transformers/pull/24111

I didn't add validation to the `__init__` method since it's not done for
other values/warpers.

e4b26aa1

20 Jun, 2023 1 commit
- fix(server): fix warpers on CPU (#472) · 53aa9194
  OlivierDehaene authored Jun 20, 2023
```
Closes #471
```
  53aa9194
26 May, 2023 1 commit
- feat(server): support vectorized warpers in flash causal lm (#317) · 62f91f78
  OlivierDehaene authored May 26, 2023
```
Co-authored-by: Joel Lamy-Poirier <joel.lamy-poirier@servicenow.com>
```
  62f91f78