"test/srt/test_nightly_text_models_gsm8k_eval.py" did not exist on "fe68c1486f250fc6a66da214ebe29f4a82b686ec"
-
lvhan028 authored
* refactor model.py and support baichuan-7b * remove model_name * remove hard session_len * export tokenizer.py to target dir * remove model_name from client * remove model_name * update * correct throughput equation * fix session.response * update serving.md * update readme * update according to review comments * update * update * update * update
7b470f07