Unverified Commit 96c503eb authored by Liangsheng Yin's avatar Liangsheng Yin Committed by GitHub
Browse files

fix the broken server args (#585)

parent 441cca77
...@@ -151,7 +151,7 @@ def launch_server(server_args: ServerArgs, pipe_finish_writer, model_overide_arg ...@@ -151,7 +151,7 @@ def launch_server(server_args: ServerArgs, pipe_finish_writer, model_overide_arg
enable_show_time_cost() enable_show_time_cost()
if server_args.disable_disk_cache: if server_args.disable_disk_cache:
disable_cache() disable_cache()
if server_args.enable_flashinfer: if not server_args.disable_flashinfer:
assert_pkg_version("flashinfer", "0.0.7") assert_pkg_version("flashinfer", "0.0.7")
if server_args.chat_template: if server_args.chat_template:
# TODO: replace this with huggingface transformers template # TODO: replace this with huggingface transformers template
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment