Unverified Commit 2ff572e2 authored by Shangming Cai's avatar Shangming Cai Committed by GitHub
Browse files

[CI][Router] Fix bench_one_batch_server for pd router test (#7731)


Signed-off-by: default avatarShangming Cai <caishangming@linux.alibaba.com>
parent 84f2e4a0
...@@ -114,7 +114,7 @@ jobs: ...@@ -114,7 +114,7 @@ jobs:
run: | run: |
echo "Installing SGLang with all extras..." echo "Installing SGLang with all extras..."
python3 -m pip --no-cache-dir install -e "python[all]" --break-system-packages python3 -m pip --no-cache-dir install -e "python[all]" --break-system-packages
python3 -m pip --no-cache-dir install mooncake-transfer-engine==0.3.4.post1 python3 -m pip --no-cache-dir install mooncake-transfer-engine==0.3.4.post2
- name: Build and install sgl-router - name: Build and install sgl-router
run: | run: |
......
...@@ -253,8 +253,11 @@ def run_benchmark(server_args: ServerArgs, bench_args: BenchArgs): ...@@ -253,8 +253,11 @@ def run_benchmark(server_args: ServerArgs, bench_args: BenchArgs):
else: else:
proc, base_url = launch_server_process(server_args) proc, base_url = launch_server_process(server_args)
server_info = requests.get(base_url + "/get_server_info") server_info = requests.get(base_url + "/get_server_info").json()
tokenizer_path = server_info.json()["tokenizer_path"] if "tokenizer_path" in server_info:
tokenizer_path = server_info["tokenizer_path"]
elif "prefill" in server_info:
tokenizer_path = server_info["prefill"][0]["tokenizer_path"]
tokenizer = get_tokenizer(tokenizer_path) tokenizer = get_tokenizer(tokenizer_path)
# warmup # warmup
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment