Commits · 22c4fd07abe9d499cd8eda807f389084773124bd · OpenDAS / text-generation-inference

12 May, 2023 1 commit
- chore(docker): use nvidia base image (#318) · 8a8f4341
  OlivierDehaene authored May 12, 2023
  
  8a8f4341
10 May, 2023 1 commit
- feat(server): shard token decode (#303) · 68e9d6ab
  OlivierDehaene authored May 10, 2023
  
  68e9d6ab
09 May, 2023 1 commit
- feat(server): optim flash causal lm decode_token (#285) · ad66f6ef
  OlivierDehaene authored May 09, 2023
  
  ad66f6ef
03 May, 2023 2 commits
- feat(server): support hf endpoint weight layout (#266) · 85aa7e2e
  OlivierDehaene authored May 03, 2023
  
  85aa7e2e
- fix(server): fix typo in tokenizers decode (#269) · 4096000e
  OlivierDehaene authored May 03, 2023
```
closes #268
```
  4096000e
21 Apr, 2023 2 commits
- fix(server): fix past key values logic (#216) · db4cb5e4
  OlivierDehaene authored Apr 21, 2023
```
@njhill fyi
```
  db4cb5e4
- feat(router): add device and dtype info (#215) · 343437c7
  OlivierDehaene authored Apr 21, 2023
  
  343437c7
19 Apr, 2023 1 commit
- feat(server): support quantization for flash models (#200) · e14ae3b5
  OlivierDehaene authored Apr 19, 2023
```
closes #197
```
  e14ae3b5
12 Apr, 2023 2 commits
- feat(server): support sharded santacoder (#167) · 880a76ee
  OlivierDehaene authored Apr 12, 2023
  
  880a76ee
- feat(server): optimize decode for sane tokenizers (#170) · 5fa8ae04
  OlivierDehaene authored Apr 12, 2023
  
  5fa8ae04
09 Apr, 2023 1 commit
- feat(router): make router input validation optional (#164) · 99879600
  OlivierDehaene authored Apr 09, 2023
  
  99879600
05 Apr, 2023 1 commit
- fix(server): fix escape characters in stop sequence (#155) · 3f2542bb
  OlivierDehaene authored Apr 05, 2023
  
  3f2542bb
03 Apr, 2023 1 commit
- feat(server): flash santacoder (#153) · c0aeb325
  OlivierDehaene authored Apr 03, 2023
  
  c0aeb325