Commits · b8354dae03e3b942ddef98c3447545f78b84f902 · OpenDAS / Lmdeploy

11 Dec, 2023 1 commit
- Disable attention mask when it is not needed (#813) · b8354dae
  Li Zhang authored Dec 11, 2023
```
* disable attention mask when not needed

* fix for sm<80 and float data type
```
  b8354dae
04 Dec, 2023 1 commit

Unify prefill & decode passes (#775) · 7f943a26

Li Zhang authored Dec 04, 2023

* Unify prefill and decode passes

* dynamic split-fuse

* refactor

* correct input count calculation

* remove unused

* lint

* lint

* fix msvc build

* fix msvc build

* fix msvc build

* fix msvc build

* fix msvc build

* fix msvc build

* fix msvc build

* fix msvc build

* fix msvc build

7f943a26