Commits · ebc74d5666bf2a304181a5fe8cc7dfc6ddbe1d95 · OpenDAS / text-generation-inference

24 Apr, 2023 1 commit
- feat(router): use number of tokens in batch as input for dynamic batching (#226) · ebc74d56
  OlivierDehaene authored Apr 24, 2023
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  ebc74d56
21 Apr, 2023 2 commits
- v0.6.0 (#222) · 6ded76a4
  OlivierDehaene authored Apr 21, 2023
  
  6ded76a4
- feat(router): add device and dtype info (#215) · 343437c7
  OlivierDehaene authored Apr 21, 2023
  
  343437c7
20 Apr, 2023 1 commit
- feat(router): drop requests when client closes the channel (#202) · 709d8936
  OlivierDehaene authored Apr 20, 2023
  
  709d8936
19 Apr, 2023 2 commits
- feat(router): add git sha to info route (#208) · b6ee0ec7
  OlivierDehaene authored Apr 19, 2023
  
  b6ee0ec7
- fix(router): add auth token to get model info (#207) · 252f42c1
  OlivierDehaene authored Apr 19, 2023
  
  252f42c1
18 Apr, 2023 1 commit
- feat(router): add info route (#196) · 2475aede
  OlivierDehaene authored Apr 18, 2023
```
close #125
```
  2475aede
17 Apr, 2023 1 commit
- fix(router): fix truncation (#190) · c13b9d87
  OlivierDehaene authored Apr 17, 2023
```
closes #189
```
  c13b9d87
13 Apr, 2023 1 commit
- fix(ci): fix CVE in github-slug-action (#174) · 64347b05
  OlivierDehaene authored Apr 13, 2023
  
  64347b05
11 Apr, 2023 1 commit
- v0.5.0 (#168) · 6f0f1d70
  OlivierDehaene authored Apr 11, 2023
  
  6f0f1d70
09 Apr, 2023 3 commits
- feat(router): make router input validation optional (#164) · 99879600
  OlivierDehaene authored Apr 09, 2023
  
  99879600
- fix(router): use buckets for metrics histograms (#163) · 7dec65a2
  OlivierDehaene authored Apr 09, 2023
  
  7dec65a2
- fix(rust-client): use join_all instead of select_all to hopefully fix nccl issues (#162) · 5cddc055
  OlivierDehaene authored Apr 09, 2023
  
  5cddc055
30 Mar, 2023 3 commits
- v0.4.3 (#152) · fef1a1c3
  OlivierDehaene authored Mar 30, 2023
  
  fef1a1c3
- v0.4.2 (#151) · 84722f3e
  OlivierDehaene authored Mar 30, 2023
  
  84722f3e
- feat(benchmark): tui based benchmarking tool (#149) · 610bb1f9
  OlivierDehaene authored Mar 30, 2023
  
  610bb1f9
29 Mar, 2023 1 commit

feat: aws sagemaker compatible image (#147) · d503e8f0

OlivierDehaene authored Mar 29, 2023



The only difference is that now it pushes to
registry.internal.huggingface.tech/api-inference/community/text-generation-inference/sagemaker:...
instead of
registry.internal.huggingface.tech/api-inference/community/text-generation-inference:sagemaker-...

---------
Co-authored-by: Philipp Schmid <32632186+philschmid@users.noreply.github.com>

d503e8f0

28 Mar, 2023 1 commit
- feat(server): clear cache on error (#143) · f0000689
  OlivierDehaene authored Mar 28, 2023
  
  f0000689
26 Mar, 2023 1 commit
- v0.4.1 (#140) · ab5fd8cf
  OlivierDehaene authored Mar 26, 2023
  
  ab5fd8cf
16 Mar, 2023 1 commit
- fix(server): use server tokenizer as gt (#128) · b49dbf2d
  OlivierDehaene authored Mar 16, 2023
  
  b49dbf2d
13 Mar, 2023 1 commit
- fix(server): revert gpt-neox optims (#123) · cbd36aa4
  OlivierDehaene authored Mar 13, 2023
  
  cbd36aa4
09 Mar, 2023 4 commits
- v0.4.0 (#119) · 411d6247
  OlivierDehaene authored Mar 09, 2023
  
  411d6247
- feat(router): add best_of parameter (#117) · 55bd4fed
  OlivierDehaene authored Mar 09, 2023
  
  55bd4fed
- feat(router): support left truncation (#115) · e8bfe199
  OlivierDehaene authored Mar 09, 2023
```
closes #111
```
  e8bfe199
- feat: support typical sampling (#114) · 1a2d6825
  OlivierDehaene authored Mar 09, 2023
```
closes #112
```
  1a2d6825
07 Mar, 2023 1 commit
- feat(clients): Python client (#103) · 3fef90d5
  OlivierDehaene authored Mar 07, 2023
  
  3fef90d5
06 Mar, 2023 1 commit
- feat: allow local models (#101) · cd5961b5
  OlivierDehaene authored Mar 06, 2023
```
closes #99
```
  cd5961b5
03 Mar, 2023 1 commit
- v0.3.2 (#97) · 1c19b093
  OlivierDehaene authored Mar 03, 2023
  
  1c19b093
02 Mar, 2023 2 commits
- feat(server): add logits watermark (#90) · 9b8ea6a6
  OlivierDehaene authored Mar 02, 2023
  
  9b8ea6a6
- feat(router): add api-inference headers (#91) · f874c478
  OlivierDehaene authored Mar 02, 2023
  
  f874c478
28 Feb, 2023 1 commit
- feat(router): ask hf.co for pipelinetag to decide on compat_return_full_text (#89) · 4e685d90
  OlivierDehaene authored Feb 28, 2023
  
  4e685d90
27 Feb, 2023 1 commit
- feat(router): add legacy route for api-inference support (#88) · 21340f24
  OlivierDehaene authored Feb 27, 2023
  
  21340f24
24 Feb, 2023 2 commits
- feat(server): add special token bool (#85) · 0ac184ce
  OlivierDehaene authored Feb 24, 2023
  
  0ac184ce
- v0.3.1 (#84) · 4b1c9720
  OlivierDehaene authored Feb 24, 2023
  
  4b1c9720
17 Feb, 2023 1 commit
- feat(router): add cors allow origin options (#73) · 6796d38c
  OlivierDehaene authored Feb 17, 2023
  
  6796d38c
16 Feb, 2023 2 commits
- v0.3.0 (#72) · c720555a
  OlivierDehaene authored Feb 16, 2023
  
  c720555a
- feat(router): add prometheus metrics scrape endpoint (#71) · 439fcaf8
  OlivierDehaene authored Feb 16, 2023
  
  439fcaf8
15 Feb, 2023 1 commit
- feat(router): add max_total_tokens and empty_input validation (#68) · 5437d49b
  OlivierDehaene authored Feb 15, 2023
```
closes #65
```
  5437d49b
13 Feb, 2023 1 commit
- feat: add distributed tracing (#62) · 9af45414
  OlivierDehaene authored Feb 13, 2023
  
  9af45414
08 Feb, 2023 1 commit
- fixed SSE naming (#61) · e520d5b3
  Yannic Kilcher authored Feb 08, 2023
```
https://en.wikipedia.org/wiki/Server-sent_events
```
  e520d5b3