GitLab

* Fix memory leak

* modern c++

* support actual seqlen

* fix lint

* update variable types

* lint

* update type

* fix lint

---------

* Pad tok_embedding and output weights to make their shape divisible by TP

* update

* update

* update

* update

* update llamaBatch

* add w4a16

* fix `deploy.py`

* add doc

* add w4a16 kernels

* fuse w1/w3 & bugfixes

* fix typo

* python

* guard sm75/80 features

* add missing header

* refactor

* qkvo bias

* update cost model

* fix lint

* update `deploy.py`

* add GQA for llama2

* fix model conversion

* fix lint & remove dev log

* update news

* minor

* fix allocation size

* fix split_dim for w_qkv.bias

* build turbomind

* change namespace fastertransformer to turbomind

* change logger name

* temp

* fix lint

* csrc->src

* remove clang-format

* skip .rst

* skip doc

* clang-format

version

version

* mat_B

* support attention bias

* fix conflict

* add ft code

* gitignore

* fix lint

* revert fmha