Commits · d7117b95ab120230bb7dc6e69c7c4c800397fcbf · OpenDAS / Lmdeploy

22 Mar, 2024 1 commit
- 同步0.2.6代码 · d7117b95
  zhouxiang authored Mar 22, 2024
  
  d7117b95
20 Nov, 2023 1 commit

Optimize for throughput (#701) · 911c0a85

Li Zhang authored Nov 20, 2023



* tmp

* update

* update

* optimize for throughput

* update

* fix eos

* clean up

* fix serving

* fix indexed copy

* minor

* minor

---------
Co-authored-by: lvhan028 <lvhan_028@163.com>

911c0a85

01 Jul, 2023 2 commits
- build turbomind (#35) · 35d64462
  lvhan028 authored Jul 01, 2023
```
* build turbomind

* change namespace fastertransformer to turbomind

* change logger name
```
  35d64462
- rename src/fastertransformer to src/turbomind (#33) · 53d2e42c
  lvhan028 authored Jul 01, 2023
  
  53d2e42c
20 Jun, 2023 1 commit
- check-in fastertransformer (#7) · 9efcac38
  Li Zhang authored Jun 20, 2023
```
* add ft code

* gitignore

* fix lint

* revert fmha
```
  9efcac38