- 05 Jul, 2023 3 commits
-
-
tpoisonooo authored
-
pppppM authored
* add cal qparams * support offload inference * add collect funtions (mod,weight) * stats kv scales * update init * add user guide * fix hints * fix comments & support turbomind format * update user guide * fix slice kv cache error & support pileval dataset (used in llm-awq) * fix wrong num heads slice * update default dataset * fix conflict * fix hints * fix hints * add gitignore
-
tpoisonooo authored
* docs(quantization): add more test * revert(generate.sh): revert ninja * revert(llama_config.ini): revert empty line * fix(quantization.md): fix link error
-
- 04 Jul, 2023 2 commits
-
-
tpoisonooo authored
-
tpoisonooo authored
* docs(README): update description * docs(project): add quantization test results * docs(README): reorder * docs(quantization): add more description * docs(README): remove openmmlab badge * docs(README): scale up image * docs(dir): add zh_cn subdir
-