Commits · 1539d3cbbef294df9c7ee9db07f45c97e6370f7b · OpenDAS / text-generation-inference

26 Jan, 2023 1 commit
- feat(router): Remove second lock from batcher hot path (#27) · 1539d3cb
  OlivierDehaene authored Jan 26, 2023
```
@njhill
```
  1539d3cb
03 Jan, 2023 1 commit
- feat(router): Add const parameters to validation logic (#15) · 60472f9d
  Nick Hill authored Jan 03, 2023
```
I noticed some opportunity to collapse some of the logic, in case you
are interested.
```
  60472f9d
15 Dec, 2022 1 commit
- feat: Return logprobs (#8) · 32a25306
  OlivierDehaene authored Dec 15, 2022
  
  32a25306
12 Dec, 2022 1 commit
- feat: Support stop sequences (#7) · 718096f6
  OlivierDehaene authored Dec 12, 2022
  
  718096f6
04 Nov, 2022 1 commit
- feat(server): Support AutoModelForSeq2SeqLM · 427d7cc4
  OlivierDehaene authored Nov 04, 2022
  
  427d7cc4
28 Oct, 2022 1 commit
- feat(server): Support all AutoModelForCausalLM on a best effort basis · 3cf6368c
  OlivierDehaene authored Oct 28, 2022
  
  3cf6368c
21 Oct, 2022 1 commit
- feat(router): Add max_waiting_tokens · c8378933
  OlivierDehaene authored Oct 21, 2022
  
  c8378933
20 Oct, 2022 1 commit
- v0.1.0 · f16f2f5a
  Olivier Dehaene authored Oct 18, 2022
  
  f16f2f5a
17 Oct, 2022 1 commit
- feat: Improve error handling · 5e5d8766
  Olivier Dehaene authored Oct 17, 2022
  
  5e5d8766
11 Oct, 2022 2 commits
- Refactored gRPC interface · 4c693e65
  Olivier Dehaene authored Oct 11, 2022
```
Added validation logic
```
  4c693e65
- Add load testing · fa9a0884
  Olivier Dehaene authored Oct 11, 2022
  
  fa9a0884
08 Oct, 2022 1 commit
- Init · 295831a4
  Olivier Dehaene authored Oct 08, 2022
  
  295831a4