GitLab

* remove constraints on model name

* remove duplicate model converter

* add profile

* get eos and bos from server

* update stop_words

* update sequence_length when the last generated token is eos_id

* fix

* fix

* check-in models

* valicate model_name

* make stop_words as property

* debug profiling

* better stats

* fix assistant reponse

* update profile serving

* update

* update

* support attention bias

* fix conflict

* remove constraints on model name

* remove duplicate model converter

* update arch

* clang-format

* remove comment

---------
Co-authored-by: yaoqian <yaoqian@localhost.localdomain>

* support fmha

* update sm by cudaarch

* update ldscript path

* clang-format

* clang-format

---------

* check-in dockerfile

* check-in dockerfile

* add ft code

* gitignore

* fix lint

* revert fmha

* add logo

* update readme

* add scripts for deploying llama family models via fastertransformer

* fix

* fix

* set symlinks True when copying triton models templates

* pack model repository for triton inference server

* add exception

* fix

* update config.pbtxt and launching scripts