Commits · 6c781025ae1c015a175eb2e319bc6003b5d5bdab · OpenDAS / text-generation-inference

14 Nov, 2022 1 commit
- feat(rust): Update to 1.65 · 6c781025
  OlivierDehaene authored Nov 14, 2022
  
  6c781025
09 Nov, 2022 1 commit
- feat(server): Clarify CausalLMBatch concatenate method · dccd5c2b
  OlivierDehaene authored Nov 09, 2022
  
  dccd5c2b
08 Nov, 2022 1 commit
- fix(server): Fix Transformers fork version · fa43fb71
  OlivierDehaene authored Nov 08, 2022
  
  fa43fb71
07 Nov, 2022 1 commit
- feat(server): Improved doc · 4236e41b
  OlivierDehaene authored Nov 07, 2022
  
  4236e41b
04 Nov, 2022 3 commits
- feat(launcher): Pass CUDA_VISIBLE_DEVICES to the shard · cea6051e
  OlivierDehaene authored Nov 04, 2022
  
  cea6051e
- feat(server): Support AutoModelForSeq2SeqLM · 427d7cc4
  OlivierDehaene authored Nov 04, 2022
  
  427d7cc4
- feat(server): Support generic AutoModelForCausalLM · c5665f5c
  OlivierDehaene authored Nov 04, 2022
  
  c5665f5c
03 Nov, 2022 1 commit
- fix(models): Revert buggy support for AutoModel · 755fc0e4
  OlivierDehaene authored Nov 03, 2022
  
  755fc0e4
02 Nov, 2022 1 commit
- feat: Use json formatter by default in docker image · b3b7ea0d
  OlivierDehaene authored Nov 02, 2022
  
  b3b7ea0d
28 Oct, 2022 1 commit
- feat(server): Support all AutoModelForCausalLM on a best effort basis · 3cf6368c
  OlivierDehaene authored Oct 28, 2022
  
  3cf6368c
27 Oct, 2022 1 commit
- feat(server): Support bitsandbytes · 09674e6d
  OlivierDehaene authored Oct 27, 2022
  
  09674e6d
22 Oct, 2022 3 commits
- feat(client): Simplify sharded logic · beb55212
  OlivierDehaene authored Oct 22, 2022
  
  beb55212
- feat(server): Use safetensors · c8ce9b25
  Nicolas Patry authored Oct 22, 2022
```
Co-authored-by: OlivierDehaene <23298448+OlivierDehaene@users.noreply.github.com>
```
  c8ce9b25
- Create LICENSE (#2 ) · be8827fe
  Thomas Wang authored Oct 22, 2022
  
  be8827fe
21 Oct, 2022 2 commits
- feat(router): Add max_waiting_tokens · c8378933
  OlivierDehaene authored Oct 21, 2022
  
  c8378933
- fix(validation): Fix error messages · 895a341d
  OlivierDehaene authored Oct 21, 2022
  
  895a341d
20 Oct, 2022 1 commit
- v0.1.0 · f16f2f5a
  Olivier Dehaene authored Oct 18, 2022
  
  f16f2f5a
17 Oct, 2022 3 commits
- feat: Add arguments to CLI · 92c1ecd0
  Olivier Dehaene authored Oct 17, 2022
  
  92c1ecd0
- feat: Improve error handling · 5e5d8766
  Olivier Dehaene authored Oct 17, 2022
  
  5e5d8766
- Update aml deployment · 00e6ce44
  Olivier Dehaene authored Oct 17, 2022
  
  00e6ce44
15 Oct, 2022 1 commit
- feat: Add AML deployment · bcb53903
  Olivier Dehaene authored Oct 15, 2022
  
  bcb53903
14 Oct, 2022 1 commit
- feat: Docker image · bf99afe9
  Olivier Dehaene authored Oct 14, 2022
  
  bf99afe9
11 Oct, 2022 4 commits
- Use axum · 39df4d99
  Olivier Dehaene authored Oct 11, 2022
  
  39df4d99
- ValidationError was not correctly handled · e86ecbac
  Olivier Dehaene authored Oct 11, 2022
  
  e86ecbac
- Refactored gRPC interface · 4c693e65
  Olivier Dehaene authored Oct 11, 2022
```
Added validation logic
```
  4c693e65
- Add load testing · fa9a0884
  Olivier Dehaene authored Oct 11, 2022
  
  fa9a0884
08 Oct, 2022 2 commits
- fix: cleanup · 1d986983
  Olivier Dehaene authored Oct 08, 2022
  
  1d986983
- Init · 295831a4
  Olivier Dehaene authored Oct 08, 2022
  
  295831a4