Commits · 6abec14a7eeb6e29a394557d64e2b527af1a89fb · OpenDAS / text-generation-inference

02 Jun, 2023 1 commit
- feat(server): only compute prefill logprobs when asked (#406) · 895c5f15
  OlivierDehaene authored Jun 02, 2023
```
Close #288
```
  895c5f15
24 May, 2023 1 commit
- feat: decrease IPC proto size (#367) · 218c9ada
  OlivierDehaene authored May 24, 2023
```
Closes #307 #308
```
  218c9ada
23 May, 2023 1 commit
- feat(router): log input/ouput at debug level (#364) · 94200538
  OlivierDehaene authored May 23, 2023
```
@njhill FYI
```
  94200538
16 May, 2023 1 commit
- fix(server): fix decode token (#334) · 5a582261
  OlivierDehaene authored May 16, 2023
```
Fixes #333

---------
Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
```
  5a582261
09 May, 2023 2 commits
- feat(docker): add benchmarking tool to docker image (#298) · e2502822
  OlivierDehaene authored May 09, 2023
  
  e2502822
- feat(router): Adding response schema for compat_generate (#292) · 926fd9a0
  Sai Vinay G authored May 09, 2023
  
  926fd9a0
04 May, 2023 1 commit
- fix(launcher): handle hub branches (#278) · b4fe248b
  Nicolas Patry authored May 04, 2023
  
  b4fe248b
02 May, 2023 1 commit
- chore(github): add templates (#264) · 411b0d4e
  Nicolas Patry authored May 02, 2023
  
  411b0d4e
27 Apr, 2023 1 commit
- feat(server): add watermarking tests (#248) · f092ba9b
  Ehsan M. Kermani authored Apr 27, 2023
  
  f092ba9b
26 Apr, 2023 2 commits
- feat(router): new healthcheck that skips the queue (#244) · db2b4e07
  Nicolas Patry authored Apr 26, 2023
```
Co-authored-by: OlivierDehaene <23298448+OlivierDehaene@users.noreply.github.com>
Co-authored-by: OlivierDehaene <olivier@huggingface.co>
```
  db2b4e07
- feat(router): add tests to validation (#237) · c4fb09f2
  Nicolas Patry authored Apr 26, 2023
  
  c4fb09f2
25 Apr, 2023 2 commits
- Starting some routing tests. (#233) · 45344244
  Nicolas Patry authored Apr 25, 2023
  
  45344244
- feat(router): add endpoint info to /info route (#228) · 8b182eb9
  OlivierDehaene authored Apr 25, 2023
  
  8b182eb9
24 Apr, 2023 1 commit
- feat(router): use number of tokens in batch as input for dynamic batching (#226) · ebc74d56
  OlivierDehaene authored Apr 24, 2023
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  ebc74d56
21 Apr, 2023 1 commit
- feat(router): add device and dtype info (#215) · 343437c7
  OlivierDehaene authored Apr 21, 2023
  
  343437c7
20 Apr, 2023 1 commit
- feat(router): drop requests when client closes the channel (#202) · 709d8936
  OlivierDehaene authored Apr 20, 2023
  
  709d8936
19 Apr, 2023 1 commit
- fix(router): add auth token to get model info (#207) · 252f42c1
  OlivierDehaene authored Apr 19, 2023
  
  252f42c1
18 Apr, 2023 1 commit
- feat(router): add info route (#196) · 2475aede
  OlivierDehaene authored Apr 18, 2023
```
close #125
```
  2475aede
17 Apr, 2023 1 commit
- fix(router): fix truncation (#190) · c13b9d87
  OlivierDehaene authored Apr 17, 2023
```
closes #189
```
  c13b9d87
09 Apr, 2023 2 commits
- feat(router): make router input validation optional (#164) · 99879600
  OlivierDehaene authored Apr 09, 2023
  
  99879600
- fix(router): use buckets for metrics histograms (#163) · 7dec65a2
  OlivierDehaene authored Apr 09, 2023
  
  7dec65a2
30 Mar, 2023 2 commits
- v0.4.3 (#152) · fef1a1c3
  OlivierDehaene authored Mar 30, 2023
  
  fef1a1c3
- feat(benchmark): tui based benchmarking tool (#149) · 610bb1f9
  OlivierDehaene authored Mar 30, 2023
  
  610bb1f9
29 Mar, 2023 1 commit

feat: aws sagemaker compatible image (#147) · d503e8f0

OlivierDehaene authored Mar 29, 2023



The only difference is that now it pushes to
registry.internal.huggingface.tech/api-inference/community/text-generation-inference/sagemaker:...
instead of
registry.internal.huggingface.tech/api-inference/community/text-generation-inference:sagemaker-...

---------
Co-authored-by: Philipp Schmid <32632186+philschmid@users.noreply.github.com>

d503e8f0

28 Mar, 2023 1 commit
- feat(server): clear cache on error (#143) · f0000689
  OlivierDehaene authored Mar 28, 2023
  
  f0000689
16 Mar, 2023 1 commit
- fix(server): use server tokenizer as gt (#128) · b49dbf2d
  OlivierDehaene authored Mar 16, 2023
  
  b49dbf2d
13 Mar, 2023 1 commit
- fix(server): revert gpt-neox optims (#123) · cbd36aa4
  OlivierDehaene authored Mar 13, 2023
  
  cbd36aa4
09 Mar, 2023 3 commits
- feat(router): add best_of parameter (#117) · 55bd4fed
  OlivierDehaene authored Mar 09, 2023
  
  55bd4fed
- feat(router): support left truncation (#115) · e8bfe199
  OlivierDehaene authored Mar 09, 2023
```
closes #111
```
  e8bfe199
- feat: support typical sampling (#114) · 1a2d6825
  OlivierDehaene authored Mar 09, 2023
```
closes #112
```
  1a2d6825
07 Mar, 2023 1 commit
- feat(clients): Python client (#103) · 3fef90d5
  OlivierDehaene authored Mar 07, 2023
  
  3fef90d5
06 Mar, 2023 1 commit
- feat: allow local models (#101) · cd5961b5
  OlivierDehaene authored Mar 06, 2023
```
closes #99
```
  cd5961b5
02 Mar, 2023 2 commits
- feat(server): add logits watermark (#90) · 9b8ea6a6
  OlivierDehaene authored Mar 02, 2023
  
  9b8ea6a6
- feat(router): add api-inference headers (#91) · f874c478
  OlivierDehaene authored Mar 02, 2023
  
  f874c478
28 Feb, 2023 1 commit
- feat(router): ask hf.co for pipelinetag to decide on compat_return_full_text (#89) · 4e685d90
  OlivierDehaene authored Feb 28, 2023
  
  4e685d90
27 Feb, 2023 1 commit
- feat(router): add legacy route for api-inference support (#88) · 21340f24
  OlivierDehaene authored Feb 27, 2023
  
  21340f24
24 Feb, 2023 1 commit
- feat(server): add special token bool (#85) · 0ac184ce
  OlivierDehaene authored Feb 24, 2023
  
  0ac184ce
17 Feb, 2023 1 commit
- feat(router): add cors allow origin options (#73) · 6796d38c
  OlivierDehaene authored Feb 17, 2023
  
  6796d38c
16 Feb, 2023 1 commit
- feat(router): add prometheus metrics scrape endpoint (#71) · 439fcaf8
  OlivierDehaene authored Feb 16, 2023
  
  439fcaf8
15 Feb, 2023 1 commit
- feat(router): add max_total_tokens and empty_input validation (#68) · 5437d49b
  OlivierDehaene authored Feb 15, 2023
```
closes #65
```
  5437d49b