Commits · 6837b2eb77220194b5fae40fa07987b6ea66aaf8 · OpenDAS / text-generation-inference

18 Apr, 2023 1 commit
- feat(router): add info route (#196) · 2475aede
  OlivierDehaene authored Apr 18, 2023
```
close #125
```
  2475aede
17 Apr, 2023 1 commit
- fix(router): fix truncation (#190) · c13b9d87
  OlivierDehaene authored Apr 17, 2023
```
closes #189
```
  c13b9d87
13 Apr, 2023 1 commit
- fix(ci): fix CVE in github-slug-action (#174) · 64347b05
  OlivierDehaene authored Apr 13, 2023
  
  64347b05
11 Apr, 2023 1 commit
- v0.5.0 (#168) · 6f0f1d70
  OlivierDehaene authored Apr 11, 2023
  
  6f0f1d70
09 Apr, 2023 3 commits
- feat(router): make router input validation optional (#164) · 99879600
  OlivierDehaene authored Apr 09, 2023
  
  99879600
- fix(router): use buckets for metrics histograms (#163) · 7dec65a2
  OlivierDehaene authored Apr 09, 2023
  
  7dec65a2
- fix(rust-client): use join_all instead of select_all to hopefully fix nccl issues (#162) · 5cddc055
  OlivierDehaene authored Apr 09, 2023
  
  5cddc055
30 Mar, 2023 3 commits
- v0.4.3 (#152) · fef1a1c3
  OlivierDehaene authored Mar 30, 2023
  
  fef1a1c3
- v0.4.2 (#151) · 84722f3e
  OlivierDehaene authored Mar 30, 2023
  
  84722f3e
- feat(benchmark): tui based benchmarking tool (#149) · 610bb1f9
  OlivierDehaene authored Mar 30, 2023
  
  610bb1f9
29 Mar, 2023 1 commit

feat: aws sagemaker compatible image (#147) · d503e8f0

OlivierDehaene authored Mar 29, 2023



The only difference is that now it pushes to
registry.internal.huggingface.tech/api-inference/community/text-generation-inference/sagemaker:...
instead of
registry.internal.huggingface.tech/api-inference/community/text-generation-inference:sagemaker-...

---------
Co-authored-by: Philipp Schmid <32632186+philschmid@users.noreply.github.com>

d503e8f0

28 Mar, 2023 1 commit
- feat(server): clear cache on error (#143) · f0000689
  OlivierDehaene authored Mar 28, 2023
  
  f0000689
26 Mar, 2023 1 commit
- v0.4.1 (#140) · ab5fd8cf
  OlivierDehaene authored Mar 26, 2023
  
  ab5fd8cf
16 Mar, 2023 1 commit
- fix(server): use server tokenizer as gt (#128) · b49dbf2d
  OlivierDehaene authored Mar 16, 2023
  
  b49dbf2d
13 Mar, 2023 1 commit
- fix(server): revert gpt-neox optims (#123) · cbd36aa4
  OlivierDehaene authored Mar 13, 2023
  
  cbd36aa4
09 Mar, 2023 4 commits
- v0.4.0 (#119) · 411d6247
  OlivierDehaene authored Mar 09, 2023
  
  411d6247
- feat(router): add best_of parameter (#117) · 55bd4fed
  OlivierDehaene authored Mar 09, 2023
  
  55bd4fed
- feat(router): support left truncation (#115) · e8bfe199
  OlivierDehaene authored Mar 09, 2023
```
closes #111
```
  e8bfe199
- feat: support typical sampling (#114) · 1a2d6825
  OlivierDehaene authored Mar 09, 2023
```
closes #112
```
  1a2d6825
07 Mar, 2023 1 commit
- feat(clients): Python client (#103) · 3fef90d5
  OlivierDehaene authored Mar 07, 2023
  
  3fef90d5
06 Mar, 2023 1 commit
- feat: allow local models (#101) · cd5961b5
  OlivierDehaene authored Mar 06, 2023
```
closes #99
```
  cd5961b5
03 Mar, 2023 1 commit
- v0.3.2 (#97) · 1c19b093
  OlivierDehaene authored Mar 03, 2023
  
  1c19b093
02 Mar, 2023 2 commits
- feat(server): add logits watermark (#90) · 9b8ea6a6
  OlivierDehaene authored Mar 02, 2023
  
  9b8ea6a6
- feat(router): add api-inference headers (#91) · f874c478
  OlivierDehaene authored Mar 02, 2023
  
  f874c478
28 Feb, 2023 1 commit
- feat(router): ask hf.co for pipelinetag to decide on compat_return_full_text (#89) · 4e685d90
  OlivierDehaene authored Feb 28, 2023
  
  4e685d90
27 Feb, 2023 1 commit
- feat(router): add legacy route for api-inference support (#88) · 21340f24
  OlivierDehaene authored Feb 27, 2023
  
  21340f24
24 Feb, 2023 2 commits
- feat(server): add special token bool (#85) · 0ac184ce
  OlivierDehaene authored Feb 24, 2023
  
  0ac184ce
- v0.3.1 (#84) · 4b1c9720
  OlivierDehaene authored Feb 24, 2023
  
  4b1c9720
17 Feb, 2023 1 commit
- feat(router): add cors allow origin options (#73) · 6796d38c
  OlivierDehaene authored Feb 17, 2023
  
  6796d38c
16 Feb, 2023 2 commits
- v0.3.0 (#72) · c720555a
  OlivierDehaene authored Feb 16, 2023
  
  c720555a
- feat(router): add prometheus metrics scrape endpoint (#71) · 439fcaf8
  OlivierDehaene authored Feb 16, 2023
  
  439fcaf8
15 Feb, 2023 1 commit
- feat(router): add max_total_tokens and empty_input validation (#68) · 5437d49b
  OlivierDehaene authored Feb 15, 2023
```
closes #65
```
  5437d49b
13 Feb, 2023 1 commit
- feat: add distributed tracing (#62) · 9af45414
  OlivierDehaene authored Feb 13, 2023
  
  9af45414
08 Feb, 2023 1 commit
- fixed SSE naming (#61) · e520d5b3
  Yannic Kilcher authored Feb 08, 2023
```
https://en.wikipedia.org/wiki/Server-sent_events
```
  e520d5b3
07 Feb, 2023 1 commit
- V0.2.1 (#58) · 2fe5e1b3
  OlivierDehaene authored Feb 07, 2023
  
  2fe5e1b3
03 Feb, 2023 1 commit
- feat(router): refactor API and add openAPI schemas (#53) · 20c3c594
  OlivierDehaene authored Feb 03, 2023
  
  20c3c594
02 Feb, 2023 2 commits

breaking(router): modify /generate API to only return generated text (#50) · b1482d90

OlivierDehaene authored Feb 02, 2023

@njhill, @yk FYI

generated_text was concatenated to the user prompt for legacy reason. We
want to remove this behaviour as we don't think it is useful and even
detrimonial to usability.

We also remove the unused Vec.

b1482d90

feat(router): use background task to manage request queue (#52) · 7b870e1e
OlivierDehaene authored Feb 02, 2023
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
7b870e1e

01 Feb, 2023 1 commit
- feat(server): support repetition penalty (#47) · 313194f6
  OlivierDehaene authored Feb 01, 2023
  
  313194f6
31 Jan, 2023 1 commit
- feat: Add token streaming using ServerSideEvents support (#41) · 017a2a8c
  OlivierDehaene authored Jan 31, 2023
  
  017a2a8c