"docs/en/vscode:/vscode.git/clone" did not exist on "71707334e61b8aff407ac1dbe38c0d1feccd9086"
- 14 Jul, 2023 4 commits
- 13 Jul, 2023 1 commit
-
-
del-zhenwu authored
-
- 12 Jul, 2023 2 commits
- 11 Jul, 2023 6 commits
-
-
lvhan028 authored
-
tpoisonooo authored
* docs(serving.md): typo * docs(README): quantization
-
tpoisonooo authored
* feat(deploy.py): support w pack qkv
-
q.yao authored
* update contrib * update links
-
Li Zhang authored
-
WRH authored
* previous merged * add chinese * support torch<2 * add a docstring * fix typo * rename torch submodule * rename to pytorch * rename in readme
-
- 10 Jul, 2023 1 commit
-
-
WRH authored
-
- 06 Jul, 2023 10 commits
-
-
pppppM authored
* update benchmark image * update image url
-
WRH authored
* draft torch client * deal with space of tokenizer * support tensor parallel * fix * fix * move folder * move instruction to readme * move to torch/ * rename client to chat * very bad response * stash * rename streamer * support internlm * change default args * remove test * improve instructions * remove module docstring * decrease header level of torch model
-
pppppM authored
-
q.yao authored
* streaming-output * fix end * fix profile * support chinese streaming * lint * update chat * lint * fix benchmark --------- Co-authored-by:grimoire <yaoqian@pjlab.org.cn>
-
AllentDan authored
-
tpoisonooo authored
* docs(README): fix script
-
pppppM authored
-
tpoisonooo authored
-
pppppM authored
-
lvhan028 authored
* build lmdeploy in dockerfile * rename file * update dockerfile --------- Co-authored-by:grimoire <streetyao@live.com>
-
- 05 Jul, 2023 13 commits
-
-
lvhan028 authored
* add performance * use png * update * update * update * update * update
-
lvhan028 authored
-
lvhan028 authored
* update internlm model * update * update * update * update * update temperature, topk and top_p * update * update * loosen log level
-
RunningLeon authored
-
Li Zhang authored
-
AllentDan authored
* add demo gif * add demo gif
-
tpoisonooo authored
* fix(kv_qparams.py): zp use min * revert(qparams.py): revert format * fix(kv_qparams.py): update formula
-
q.yao authored
-
tpoisonooo authored
-
tpoisonooo authored
-
pppppM authored
* add cal qparams * support offload inference * add collect funtions (mod,weight) * stats kv scales * update init * add user guide * fix hints * fix comments & support turbomind format * update user guide * fix slice kv cache error & support pileval dataset (used in llm-awq) * fix wrong num heads slice * update default dataset * fix conflict * fix hints * fix hints * add gitignore
-
tpoisonooo authored
* docs(quantization): add more test * revert(generate.sh): revert ninja * revert(llama_config.ini): revert empty line * fix(quantization.md): fix link error
-
q.yao authored
* wip * wip * example finish * fix include and namespace * wtf * install lib * batchize * update cmake install * multithread * fix comment * fix * add mmengine * bind llamamodel --------- Co-authored-by:
-
- 04 Jul, 2023 3 commits
