Commits · e8bfe199bacb2778153bf0029b20dab866733c75 · OpenDAS / text-generation-inference · GitLab

09 Mar, 2023 3 commits
- feat(router): support left truncation (#115) · e8bfe199
  OlivierDehaene authored Mar 09, 2023
```
closes #111
```
  e8bfe199
- fix(server): do not warp prefill logits (#116) · c0795de2
  OlivierDehaene authored Mar 09, 2023
  
  c0795de2
- feat: support typical sampling (#114) · 1a2d6825
  OlivierDehaene authored Mar 09, 2023
```
closes #112
```
  1a2d6825
08 Mar, 2023 4 commits
- fix(server): fix index out of range for watermarking (#110) · 941cd42e
  OlivierDehaene authored Mar 08, 2023
  
  941cd42e
- fix(python-client): stream not set on the sync client (#109) · 2c5df5d2
  OlivierDehaene authored Mar 08, 2023
  
  2c5df5d2
- feat(launcher): default num_shard to CUDA_VISIBLE_DEVICES if possible (#108) · 5fd2dcb5
  OlivierDehaene authored Mar 08, 2023
  
  5fd2dcb5
- feat(launcher): allow parsing num_shard from CUDA_VISIBLE_DEVICES (#107) · 0ac38d33
  OlivierDehaene authored Mar 08, 2023
  
  0ac38d33
07 Mar, 2023 3 commits
- fix(server): fix galactica batch (#106) · b1485e18
  OlivierDehaene authored Mar 07, 2023
```
closes #105
```
  b1485e18
- feat(clients): Python client (#103) · 3fef90d5
  OlivierDehaene authored Mar 07, 2023
  
  3fef90d5
- feat: add supported models (#102) · 0e9ed1a8
  OlivierDehaene authored Mar 07, 2023
  
  0e9ed1a8
06 Mar, 2023 2 commits
- feat: allow local models (#101) · cd5961b5
  OlivierDehaene authored Mar 06, 2023
```
closes #99
```
  cd5961b5
- fix(server): fix generate_stream by forcing tokens to be decoded correctly (#100) · 9b205d33
  OlivierDehaene authored Mar 06, 2023
  
  9b205d33
03 Mar, 2023 5 commits
- v0.3.2 (#97) · 1c19b093
  OlivierDehaene authored Mar 03, 2023
  
  1c19b093
- feat(server): fix transformers commit (#96) · 0b6807ca
  OlivierDehaene authored Mar 03, 2023
  
  0b6807ca
- fix(launcher): add router parameters to launcher (#95) · 240c4187
  OlivierDehaene authored Mar 03, 2023
  
  240c4187
- feat(ci): improve CI speed (#94) · e3ded361
  OlivierDehaene authored Mar 03, 2023
  
  e3ded361
- feat(server): update to hf_transfer==0.1.2 (#93) · 2d39f199
  OlivierDehaene authored Mar 03, 2023
  
  2d39f199
02 Mar, 2023 2 commits
- feat(server): add logits watermark (#90) · 9b8ea6a6
  OlivierDehaene authored Mar 02, 2023
  
  9b8ea6a6
- feat(router): add api-inference headers (#91) · f874c478
  OlivierDehaene authored Mar 02, 2023
  
  f874c478
28 Feb, 2023 1 commit
- feat(router): ask hf.co for pipelinetag to decide on compat_return_full_text (#89) · 4e685d90
  OlivierDehaene authored Feb 28, 2023
  
  4e685d90
27 Feb, 2023 1 commit
- feat(router): add legacy route for api-inference support (#88) · 21340f24
  OlivierDehaene authored Feb 27, 2023
  
  21340f24
24 Feb, 2023 5 commits
- fix(server): fix token_is_special (#87) · 65e2f162
  OlivierDehaene authored Feb 24, 2023
  
  65e2f162
- fix(docs): fix openapi schema (#86) · 3b03c4ea
  OlivierDehaene authored Feb 24, 2023
  
  3b03c4ea
- feat(server): add special token bool (#85) · 0ac184ce
  OlivierDehaene authored Feb 24, 2023
  
  0ac184ce
- v0.3.1 (#84) · 4b1c9720
  OlivierDehaene authored Feb 24, 2023
  
  4b1c9720
- feat(server): pre-allocate max attention mask (#75) · 44ce098c
  OlivierDehaene authored Feb 24, 2023
  
  44ce098c
20 Feb, 2023 1 commit
- fix(server): remove position_ids from galactica forward (#82) · 78063c05
  OlivierDehaene authored Feb 20, 2023
```
closes #80
```
  78063c05
18 Feb, 2023 1 commit
- feat(server): enable hf-transfer (#76) · 17bc841b
  OlivierDehaene authored Feb 18, 2023
  
  17bc841b
17 Feb, 2023 1 commit
- feat(router): add cors allow origin options (#73) · 6796d38c
  OlivierDehaene authored Feb 17, 2023
  
  6796d38c
16 Feb, 2023 3 commits
- v0.3.0 (#72) · c720555a
  OlivierDehaene authored Feb 16, 2023
  
  c720555a
- feat(router): add prometheus metrics scrape endpoint (#71) · 439fcaf8
  OlivierDehaene authored Feb 16, 2023
  
  439fcaf8
- fix(launcher): copy current env vars to subprocesses (#70) · 7b3d460d
  OlivierDehaene authored Feb 16, 2023
```
closes #69
```
  7b3d460d
15 Feb, 2023 3 commits
- feat(router): add max_total_tokens and empty_input validation (#68) · 5437d49b
  OlivierDehaene authored Feb 15, 2023
```
closes #65
```
  5437d49b
- feat(launcher): add disable_custom_kernels arg (#67) · 68455353
  OlivierDehaene authored Feb 15, 2023
  
  68455353
- feat(server): improve download logging (#66) · c5a4a1fa
  OlivierDehaene authored Feb 15, 2023
  
  c5a4a1fa
14 Feb, 2023 1 commit
- feat: add safetensors conversion (#63) · 0fbc6919
  OlivierDehaene authored Feb 14, 2023
  
  0fbc6919
13 Feb, 2023 1 commit
- feat: add distributed tracing (#62) · 9af45414
  OlivierDehaene authored Feb 13, 2023
  
  9af45414
08 Feb, 2023 2 commits
- fixed SSE naming (#61) · e520d5b3
  Yannic Kilcher authored Feb 08, 2023
```
https://en.wikipedia.org/wiki/Server-sent_events
```
  e520d5b3
- fix(docker): increase shm size (#60) · 1ad3250b
  OlivierDehaene authored Feb 08, 2023
  
  1ad3250b
07 Feb, 2023 1 commit
- feat(server): support t5 (#59) · c503a639
  OlivierDehaene authored Feb 07, 2023
  
  c503a639