Commits · 9b205d33cc349a96937204ad16ebc1a578ad619b · OpenDAS / text-generation-inference

06 Mar, 2023 1 commit
- fix(server): fix generate_stream by forcing tokens to be decoded correctly (#100) · 9b205d33
  OlivierDehaene authored Mar 06, 2023
  
  9b205d33
03 Mar, 2023 5 commits
- v0.3.2 (#97) · 1c19b093
  OlivierDehaene authored Mar 03, 2023
  
  1c19b093
- feat(server): fix transformers commit (#96) · 0b6807ca
  OlivierDehaene authored Mar 03, 2023
  
  0b6807ca
- fix(launcher): add router parameters to launcher (#95) · 240c4187
  OlivierDehaene authored Mar 03, 2023
  
  240c4187
- feat(ci): improve CI speed (#94) · e3ded361
  OlivierDehaene authored Mar 03, 2023
  
  e3ded361
- feat(server): update to hf_transfer==0.1.2 (#93) · 2d39f199
  OlivierDehaene authored Mar 03, 2023
  
  2d39f199
02 Mar, 2023 2 commits
- feat(server): add logits watermark (#90) · 9b8ea6a6
  OlivierDehaene authored Mar 02, 2023
  
  9b8ea6a6
- feat(router): add api-inference headers (#91) · f874c478
  OlivierDehaene authored Mar 02, 2023
  
  f874c478
28 Feb, 2023 1 commit
- feat(router): ask hf.co for pipelinetag to decide on compat_return_full_text (#89) · 4e685d90
  OlivierDehaene authored Feb 28, 2023
  
  4e685d90
27 Feb, 2023 1 commit
- feat(router): add legacy route for api-inference support (#88) · 21340f24
  OlivierDehaene authored Feb 27, 2023
  
  21340f24
24 Feb, 2023 5 commits
- fix(server): fix token_is_special (#87) · 65e2f162
  OlivierDehaene authored Feb 24, 2023
  
  65e2f162
- fix(docs): fix openapi schema (#86) · 3b03c4ea
  OlivierDehaene authored Feb 24, 2023
  
  3b03c4ea
- feat(server): add special token bool (#85) · 0ac184ce
  OlivierDehaene authored Feb 24, 2023
  
  0ac184ce
- v0.3.1 (#84) · 4b1c9720
  OlivierDehaene authored Feb 24, 2023
  
  4b1c9720
- feat(server): pre-allocate max attention mask (#75) · 44ce098c
  OlivierDehaene authored Feb 24, 2023
  
  44ce098c
20 Feb, 2023 1 commit
- fix(server): remove position_ids from galactica forward (#82) · 78063c05
  OlivierDehaene authored Feb 20, 2023
```
closes #80
```
  78063c05
18 Feb, 2023 1 commit
- feat(server): enable hf-transfer (#76) · 17bc841b
  OlivierDehaene authored Feb 18, 2023
  
  17bc841b
17 Feb, 2023 1 commit
- feat(router): add cors allow origin options (#73) · 6796d38c
  OlivierDehaene authored Feb 17, 2023
  
  6796d38c
16 Feb, 2023 3 commits
- v0.3.0 (#72) · c720555a
  OlivierDehaene authored Feb 16, 2023
  
  c720555a
- feat(router): add prometheus metrics scrape endpoint (#71) · 439fcaf8
  OlivierDehaene authored Feb 16, 2023
  
  439fcaf8
- fix(launcher): copy current env vars to subprocesses (#70) · 7b3d460d
  OlivierDehaene authored Feb 16, 2023
```
closes #69
```
  7b3d460d
15 Feb, 2023 3 commits
- feat(router): add max_total_tokens and empty_input validation (#68) · 5437d49b
  OlivierDehaene authored Feb 15, 2023
```
closes #65
```
  5437d49b
- feat(launcher): add disable_custom_kernels arg (#67) · 68455353
  OlivierDehaene authored Feb 15, 2023
  
  68455353
- feat(server): improve download logging (#66) · c5a4a1fa
  OlivierDehaene authored Feb 15, 2023
  
  c5a4a1fa
14 Feb, 2023 1 commit
- feat: add safetensors conversion (#63) · 0fbc6919
  OlivierDehaene authored Feb 14, 2023
  
  0fbc6919
13 Feb, 2023 1 commit
- feat: add distributed tracing (#62) · 9af45414
  OlivierDehaene authored Feb 13, 2023
  
  9af45414
08 Feb, 2023 2 commits
- fixed SSE naming (#61) · e520d5b3
  Yannic Kilcher authored Feb 08, 2023
```
https://en.wikipedia.org/wiki/Server-sent_events
```
  e520d5b3
- fix(docker): increase shm size (#60) · 1ad3250b
  OlivierDehaene authored Feb 08, 2023
  
  1ad3250b
07 Feb, 2023 3 commits
- feat(server): support t5 (#59) · c503a639
  OlivierDehaene authored Feb 07, 2023
  
  c503a639
- V0.2.1 (#58) · 2fe5e1b3
  OlivierDehaene authored Feb 07, 2023
  
  2fe5e1b3
- fix(server): better handling of inference mode (#57) · 4acc42a6
  OlivierDehaene authored Feb 07, 2023
  
  4acc42a6
06 Feb, 2023 1 commit
- feat(ci): push to AML registry (#56) · e114d874
  OlivierDehaene authored Feb 06, 2023
  
  e114d874
03 Feb, 2023 2 commits
- feat(docs): Clarify installation steps (#54) · a0dca443
  lewtun authored Feb 03, 2023
```
Adds some bits for first-time users (like me 😄 )
```
  a0dca443
- feat(router): refactor API and add openAPI schemas (#53) · 20c3c594
  OlivierDehaene authored Feb 03, 2023
  
  20c3c594
02 Feb, 2023 3 commits
- breaking(router): modify /generate API to only return generated text (#50) · b1482d90
  OlivierDehaene authored Feb 02, 2023
```
@njhill, @yk FYI

generated_text was concatenated to the user prompt for legacy reason. We
want to remove this behaviour as we don't think it is useful and even
detrimonial to usability.

We also remove the unused Vec.
```
  b1482d90
- feat(router): use background task to manage request queue (#52) · 7b870e1e
  OlivierDehaene authored Feb 02, 2023
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  7b870e1e
- fix(server): allow greedy repetition penalty (#51) · df227ac2
  OlivierDehaene authored Feb 02, 2023
  
  df227ac2
01 Feb, 2023 3 commits
- feat(server): allow the server to use a local weight cache (#49) · 775115e3
  OlivierDehaene authored Feb 01, 2023
  
  775115e3
- feat(server): support repetition penalty (#47) · 313194f6
  OlivierDehaene authored Feb 01, 2023
  
  313194f6
- feat(server): allow gpt-neox models with odd vocab sizes to be sharded (#48) · 2ad895a6
  OlivierDehaene authored Feb 01, 2023
  
  2ad895a6