Commits · 610bb1f97811af2d80d16efd96f313012beb65aa · OpenDAS / text-generation-inference

30 Mar, 2023 1 commit
- feat(benchmark): tui based benchmarking tool (#149) · 610bb1f9
  OlivierDehaene authored Mar 30, 2023
  
  610bb1f9
28 Mar, 2023 2 commits
- feat(server): reduce mlp and attn in one op for flash neox (#145) · c9bdaa8b
  OlivierDehaene authored Mar 28, 2023
  
  c9bdaa8b
- feat(server): clear cache on error (#143) · f0000689
  OlivierDehaene authored Mar 28, 2023
  
  f0000689
27 Mar, 2023 1 commit
- fix(server): Avoid using try/except to determine kind of AutoModel (#142) · 462530c2
  Nick Hill authored Mar 27, 2023
  
  462530c2
26 Mar, 2023 1 commit
- feat(server): cleanup flash neox loading (#139) · 678b2f39
  OlivierDehaene authored Mar 26, 2023
  
  678b2f39
24 Mar, 2023 2 commits
- fix(server): fix flash-neox scores warping (#137) · d6a93fe9
  OlivierDehaene authored Mar 24, 2023
  
  d6a93fe9
- feat(server): flash neoX (#133) · 05e9a796
  OlivierDehaene authored Mar 24, 2023
  
  05e9a796
16 Mar, 2023 1 commit
- fix(server): use server tokenizer as gt (#128) · b49dbf2d
  OlivierDehaene authored Mar 16, 2023
  
  b49dbf2d
15 Mar, 2023 1 commit
- fix(server): add position ids to neox (#126) · 8ad60b75
  OlivierDehaene authored Mar 15, 2023
  
  8ad60b75
09 Mar, 2023 2 commits
- fix(server): do not warp prefill logits (#116) · c0795de2
  OlivierDehaene authored Mar 09, 2023
  
  c0795de2
- feat: support typical sampling (#114) · 1a2d6825
  OlivierDehaene authored Mar 09, 2023
```
closes #112
```
  1a2d6825
08 Mar, 2023 1 commit
- fix(server): fix index out of range for watermarking (#110) · 941cd42e
  OlivierDehaene authored Mar 08, 2023
  
  941cd42e
07 Mar, 2023 2 commits
- fix(server): fix galactica batch (#106) · b1485e18
  OlivierDehaene authored Mar 07, 2023
```
closes #105
```
  b1485e18
- feat(clients): Python client (#103) · 3fef90d5
  OlivierDehaene authored Mar 07, 2023
  
  3fef90d5