Commits · 951930fbff5737d46b4bec49759dac75f0bd2aac · OpenDAS / text-generation-inference

11 May, 2023 1 commit
- fix(server): fix multinomial implem in Sampling · 4f6d038c
  OlivierDehaene authored May 11, 2023
  
  4f6d038c
10 May, 2023 2 commits
- feat(server): use cuda graph in logits warping (#302) · a6c18c39
  OlivierDehaene authored May 10, 2023
  
  a6c18c39
- feat(server): shard token decode (#303) · 68e9d6ab
  OlivierDehaene authored May 10, 2023
  
  68e9d6ab
05 Apr, 2023 1 commit
- fix(server): fix escape characters in stop sequence (#155) · 3f2542bb
  OlivierDehaene authored Apr 05, 2023
  
  3f2542bb
30 Mar, 2023 1 commit
- feat(benchmark): tui based benchmarking tool (#149) · 610bb1f9
  OlivierDehaene authored Mar 30, 2023
  
  610bb1f9
24 Mar, 2023 1 commit
- feat(server): flash neoX (#133) · 05e9a796
  OlivierDehaene authored Mar 24, 2023
  
  05e9a796
09 Mar, 2023 2 commits
- fix(server): do not warp prefill logits (#116) · c0795de2
  OlivierDehaene authored Mar 09, 2023
  
  c0795de2
- feat: support typical sampling (#114) · 1a2d6825
  OlivierDehaene authored Mar 09, 2023
```
closes #112
```
  1a2d6825
08 Mar, 2023 1 commit
- fix(server): fix index out of range for watermarking (#110) · 941cd42e
  OlivierDehaene authored Mar 08, 2023
  
  941cd42e
07 Mar, 2023 1 commit
- feat(clients): Python client (#103) · 3fef90d5
  OlivierDehaene authored Mar 07, 2023
  
  3fef90d5
02 Mar, 2023 1 commit
- feat(server): add logits watermark (#90) · 9b8ea6a6
  OlivierDehaene authored Mar 02, 2023
  
  9b8ea6a6
14 Feb, 2023 1 commit
- feat: add safetensors conversion (#63) · 0fbc6919
  OlivierDehaene authored Feb 14, 2023
  
  0fbc6919