Commits · c4bb5264acacf55f8f1e693ccd29f7a13d3bcba0 · OpenDAS / text-generation-inference

06 Jul, 2023 1 commit
- fix(server): decrease memory fragmentation (#557) · c4bb5264
  OlivierDehaene authored Jul 06, 2023
  
  c4bb5264
30 Jun, 2023 1 commit
- feat(server): add paged attention to flash models (#516) · e74bd41e
  OlivierDehaene authored Jun 30, 2023
```
Closes #478
```
  e74bd41e
28 Mar, 2023 1 commit
- feat(server): clear cache on error (#143) · f0000689
  OlivierDehaene authored Mar 28, 2023
  
  f0000689
07 Mar, 2023 1 commit
- feat(clients): Python client (#103) · 3fef90d5
  OlivierDehaene authored Mar 07, 2023
  
  3fef90d5
04 Nov, 2022 1 commit
- feat(server): Support AutoModelForSeq2SeqLM · 427d7cc4
  OlivierDehaene authored Nov 04, 2022
  
  427d7cc4
28 Oct, 2022 1 commit
- feat(server): Support all AutoModelForCausalLM on a best effort basis · 3cf6368c
  OlivierDehaene authored Oct 28, 2022
  
  3cf6368c
11 Oct, 2022 1 commit
- Refactored gRPC interface · 4c693e65
  Olivier Dehaene authored Oct 11, 2022
```
Added validation logic
```
  4c693e65
08 Oct, 2022 1 commit
- Init · 295831a4
  Olivier Dehaene authored Oct 08, 2022
  
  295831a4