- 22 Nov, 2023 1 commit
-
-
xiabo authored
-
- 18 Nov, 2023 2 commits
- 16 Nov, 2023 1 commit
-
-
xiabo authored
-
- 15 Nov, 2023 2 commits
- 14 Nov, 2023 3 commits
- 30 Oct, 2023 1 commit
-
-
Lyu Han authored
-
- 25 Oct, 2023 3 commits
-
-
AllentDan authored
* support inference a batch of prompts * docstring and assert
-
RunningLeon authored
* add * import fire in main * wrap to speed up fire cli * update * update docs * update docs * fix * resolve commennts * resolve confict and add test for cli
-
Lyu Han authored
* add build from docker section * update * install python package * update * update * update
-
- 24 Oct, 2023 2 commits
- 23 Oct, 2023 2 commits
-
-
AllentDan authored
- 19 Oct, 2023 2 commits
- 18 Oct, 2023 2 commits
- 17 Oct, 2023 1 commit
-
-
Lyu Han authored
-
- 16 Oct, 2023 2 commits
- 13 Oct, 2023 3 commits
-
-
del-zhenwu authored
* [doc] Update benchmark command in w4a16.md * Update w4a16.md * Update w4a16.md add pip install nvidia-ml-py * [doc] Update w4a16.md * fix lint error Signed-off-by:
del-zhenwu <dele.zhenwu@gmail.com> * [doc] update model_path & prompt_tokens Signed-off-by:
del-zhenwu <dele.zhenwu@gmail.com> --------- Signed-off-by:
del-zhenwu <dele.zhenwu@gmail.com>
-
Chen Xin authored
* add tp hint for deploy * fix lint * assert tp in turbomind * fix lint
-
YiiSh authored
-
- 12 Oct, 2023 2 commits
- 11 Oct, 2023 3 commits
-
-
akhoroshev authored
-
Shahrukh Khan authored
-
AllentDan authored
* make IPv6 compatible, safe run for coroutine interrupting * instance_id -> session_id and fix api_client.py * update doc * remove useless faq * safe ip mapping * update app.py * remove print * update doc
-
- 09 Oct, 2023 3 commits
- 26 Sep, 2023 5 commits
-
-
Lyu Han authored
-
Lyu Han authored
* Fix memory leak * modern c++
-
AllentDan authored
* fix benchmark serving cannot use Qwen tokenizer * update benchmark readme
-
aisensiy authored
-
akhoroshev authored
-