Skip to content

GitLab

"tests/vscode:/vscode.git/clone" did not exist on "435d37ce5acb01f446ebb6fdd274915bc2f27bc8"
Unverified Commit 09bcbe01 authored by Lianmin Zheng's avatar Lianmin Zheng Committed by GitHub
Browse files

Update TypeBasedDispatcher and balance CI tests (#3001)

parent 03464890
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 4 deletions
.github/workflows/pr-test.yml
View file @ 09bcbe01
......@@ -52,7 +52,7 @@ jobs:
runs-on: 1-gpu-runner
strategy:
matrix:
range: [0-6, 6-15, 15-22, 22-32, 32-37, 37-100]
range: [0-6, 6-15, 15-22, 22-32, 32-40, 40-100]
steps:
- name: Checkout code
uses: actions/checkout@v3
......
python/sglang/srt/managers/tokenizer_manager.py
View file @ 09bcbe01
......@@ -226,9 +226,10 @@ class TokenizerManager:
self._result_dispatcher = TypeBasedDispatcher(
[
(BatchStrOut, self._handle_batch_output),
(BatchEmbeddingOut, self._handle_batch_output),
(BatchTokenIDOut, self._handle_batch_output),
(
(BatchStrOut, BatchEmbeddingOut, BatchTokenIDOut),
self._handle_batch_output,
),
(OpenSessionReqOutput, self._handle_open_session_req_output),
(
UpdateWeightFromDiskReqOutput,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment