Commits · 158540446410cb231380f72ccc8449562939c8b3 · OpenDAS / text-generation-inference

09 May, 2023 1 commit
- feat(server): optim flash causal lm decode_token (#285) · ad66f6ef
  OlivierDehaene authored May 09, 2023
  
  ad66f6ef
03 May, 2023 1 commit
- feat(server): support hf endpoint weight layout (#266) · 85aa7e2e
  OlivierDehaene authored May 03, 2023
  
  85aa7e2e
21 Apr, 2023 2 commits
- fix(server): fix past key values logic (#216) · db4cb5e4
  OlivierDehaene authored Apr 21, 2023
```
@njhill fyi
```
  db4cb5e4
- feat(router): add device and dtype info (#215) · 343437c7
  OlivierDehaene authored Apr 21, 2023
  
  343437c7
19 Apr, 2023 1 commit
- feat(server): support quantization for flash models (#200) · e14ae3b5
  OlivierDehaene authored Apr 19, 2023
```
closes #197
```
  e14ae3b5
11 Apr, 2023 1 commit
- feat(server): add flash attention llama (#144) · 299217c9
  OlivierDehaene authored Apr 11, 2023
  
  299217c9