GitLab

* wip

* profile disable tp

* fix profile

* lint

* fix dlpack

* remove comment

* add tp flag

* add session len check

* add eos

* remove tp and session len inputs

* warp tokenizer

* multithread load weight

* update profile

* refactor tokenizer

* remove pre/post process

* remove mpi4py requirement

* remove

* remove bind

* remove mpi requirement

* check backend_tokenizer

* update log info

* format cuda utils

* [Fix] fix attempted_relative_import

* use try...except...else

* docs: fix doc

* fix: fix lint

* [bugfix] Fix some docs' bug in 'serving'

* [bugfix] Fix some docs' bug in 'serving'

* Update README.md: use internlm-chat-7b

* Update README_zh-CN.md: use intern-chat-7b

* Doc: update discord and wechat link

* Doc: update discord and wechat link

* [Doc] add discord and wechat link

* [Doc] add discord and wechat link

* [Doc] add discord and wechat link

* [Doc] add discord and wechat link

* move turbomind.md to docs/en

* update link

* update link

* add puyu model for internal use

* get/set session

* update

* add docstring

* add architecture docs

* add docstring

* update

* update

* fix according to review results

* add some docstrings.

* update docstring.

fix

* ignore magic methods

* docs(serving.md): typo

* docs(README): quantization

* feat(deploy.py): support w pack qkv

* update contrib

* update links

* previous merged

* add chinese

* support torch<2

* add a docstring

* fix typo

* rename torch submodule

* rename to pytorch

* rename in readme

* update benchmark image

* update image url

* draft torch client

* deal with space of tokenizer

* support tensor parallel

* fix

* fix

* move folder

* move instruction to readme

* move to torch/

* rename client to chat

* very bad response

* stash

* rename streamer

* support internlm

* change default args

* remove test

* improve instructions

* remove module docstring

* decrease header level of torch model

* streaming-output

* fix end

* fix profile

* support chinese streaming

* lint

* update chat

* lint

* fix benchmark

---------
Co-authored-by: grimoire <yaoqian@pjlab.org.cn>

* docs(README): fix script

* build lmdeploy in dockerfile

* rename file

* update dockerfile

---------
Co-authored-by: grimoire <streetyao@live.com>

* add performance

* use png

* update

* update

* update

* update

* update

* update internlm model

* update

* update

* update

* update

* update temperature, topk and top_p

* update

* update

* loosen log level

* add demo gif

* add demo gif