Commits · 2475aede619c0c6d2ba8440303432d505c77f6d3 · OpenDAS / text-generation-inference

18 Apr, 2023 1 commit
- feat(router): add info route (#196) · 2475aede
  OlivierDehaene authored Apr 18, 2023
```
close #125
```
  2475aede
17 Apr, 2023 2 commits
- feat(python-client): get list of currently deployed tgi models using the inference API (#191) · b927244e
  OlivierDehaene authored Apr 17, 2023
  
  b927244e
- fix(router): fix truncation (#190) · c13b9d87
  OlivierDehaene authored Apr 17, 2023
```
closes #189
```
  c13b9d87
16 Apr, 2023 1 commit
- fix(docker): fix docker image dependencies (#187) · 7a1ba585
  OlivierDehaene authored Apr 17, 2023
  
  7a1ba585
14 Apr, 2023 5 commits
- fix(docker): revert dockerfile changes (#186) · 379c5c4d
  OlivierDehaene authored Apr 14, 2023
  
  379c5c4d
- fix(docker): fix image (#185) · f9047562
  OlivierDehaene authored Apr 14, 2023
  
  f9047562
- fix(docker): fix docker image (#184) · 1bb39463
  OlivierDehaene authored Apr 14, 2023
  
  1bb39463
- fix(ci): fix cosign error (#183) · 01c0e368
  OlivierDehaene authored Apr 14, 2023
  
  01c0e368
- fea(dockerfile): better layer caching (#159) · 53ee09c0
  OlivierDehaene authored Apr 14, 2023
  
  53ee09c0
13 Apr, 2023 7 commits
- fix(ci): fix ci permissions (#181) · 12e5633c
  OlivierDehaene authored Apr 13, 2023
  
  12e5633c
- feat(ci): faster scanning (#180) · c1e2ea3b
  OlivierDehaene authored Apr 13, 2023
  
  c1e2ea3b
- feat(ci): use large runners (#179) · 13f1cd02
  OlivierDehaene authored Apr 13, 2023
  
  13f1cd02
- feat(ci): add Trivy and scan docker image (#178) · 9683c37b
  OlivierDehaene authored Apr 13, 2023
  
  9683c37b
- feat(ci): add image signing with cosign (#175) · 643a39d5
  OlivierDehaene authored Apr 13, 2023
  
  643a39d5
- fix(ci): fix CVE in github-slug-action (#174) · 64347b05
  OlivierDehaene authored Apr 13, 2023
  
  64347b05
- fix(launcher): revert change on shard errors (#173) · e3a63b6f
  OlivierDehaene authored Apr 13, 2023
  
  e3a63b6f
12 Apr, 2023 2 commits
- feat(server): support sharded santacoder (#167) · 880a76ee
  OlivierDehaene authored Apr 12, 2023
  
  880a76ee
- feat(server): optimize decode for sane tokenizers (#170) · 5fa8ae04
  OlivierDehaene authored Apr 12, 2023
  
  5fa8ae04
11 Apr, 2023 3 commits
- v0.5.0 (#168) · 6f0f1d70
  OlivierDehaene authored Apr 11, 2023
  
  6f0f1d70
- feat(server): support OPT models (#55) · f26dfd0d
  OlivierDehaene authored Apr 11, 2023
```
OPT models do not all have a `tokenizer.json` file on the hub at the
moment. Can't merge for now.
```
  f26dfd0d
- feat(server): add flash attention llama (#144) · 299217c9
  OlivierDehaene authored Apr 11, 2023
  
  299217c9
09 Apr, 2023 5 commits
- feat(router): make router input validation optional (#164) · 99879600
  OlivierDehaene authored Apr 09, 2023
  
  99879600
- fix(router): use buckets for metrics histograms (#163) · 7dec65a2
  OlivierDehaene authored Apr 09, 2023
  
  7dec65a2
- fix(rust-client): use join_all instead of select_all to hopefully fix nccl issues (#162) · 5cddc055
  OlivierDehaene authored Apr 09, 2023
  
  5cddc055
- feat(launcher): allow disabling hf_transfer (#161) · e63a21eb
  OlivierDehaene authored Apr 09, 2023
  
  e63a21eb
- feat(docker): improve flash_attention caching (#160) · 1883d8ec
  OlivierDehaene authored Apr 09, 2023
  
  1883d8ec
05 Apr, 2023 1 commit
- fix(server): fix escape characters in stop sequence (#155) · 3f2542bb
  OlivierDehaene authored Apr 05, 2023
  
  3f2542bb
04 Apr, 2023 1 commit
- docs(readme): provide link Logits Warper README (#154) · 9122e7bd
  Guspan Tanadi authored Apr 04, 2023
  
  9122e7bd
03 Apr, 2023 1 commit
- feat(server): flash santacoder (#153) · c0aeb325
  OlivierDehaene authored Apr 03, 2023
  
  c0aeb325
30 Mar, 2023 4 commits
- v0.4.3 (#152) · fef1a1c3
  OlivierDehaene authored Mar 30, 2023
  
  fef1a1c3
- v0.4.2 (#151) · 84722f3e
  OlivierDehaene authored Mar 30, 2023
  
  84722f3e
- fix(server): fix flash neox rotary embeddings (#150) · 08b7e4a2
  OlivierDehaene authored Mar 30, 2023
  
  08b7e4a2
- feat(benchmark): tui based benchmarking tool (#149) · 610bb1f9
  OlivierDehaene authored Mar 30, 2023
  
  610bb1f9
29 Mar, 2023 2 commits

fix(ci): fix sagemaker action (#148) · 55106ec4
OlivierDehaene authored Mar 29, 2023

55106ec4

feat: aws sagemaker compatible image (#147) · d503e8f0

OlivierDehaene authored Mar 29, 2023



The only difference is that now it pushes to
registry.internal.huggingface.tech/api-inference/community/text-generation-inference/sagemaker:...
instead of
registry.internal.huggingface.tech/api-inference/community/text-generation-inference:sagemaker-...

---------
Co-authored-by: Philipp Schmid <32632186+philschmid@users.noreply.github.com>

d503e8f0

28 Mar, 2023 2 commits
- feat(server): reduce mlp and attn in one op for flash neox (#145) · c9bdaa8b
  OlivierDehaene authored Mar 28, 2023
  
  c9bdaa8b
- feat(server): clear cache on error (#143) · f0000689
  OlivierDehaene authored Mar 28, 2023
  
  f0000689
27 Mar, 2023 2 commits
- feat(server): Add mypy-protobuf (#141) · 8e8dd984
  Nick Hill authored Mar 27, 2023
```
Generates .pyi files for protobuf stubs which provide strong typing
information. Very helpful for IDE auto-completion, etc.
```
  8e8dd984
- fix(server): Avoid using try/except to determine kind of AutoModel (#142) · 462530c2
  Nick Hill authored Mar 27, 2023
  
  462530c2
26 Mar, 2023 1 commit
- v0.4.1 (#140) · ab5fd8cf
  OlivierDehaene authored Mar 26, 2023
  
  ab5fd8cf