Skip to content

GitLab

Unverified Commit 09bcbe01 authored by Lianmin Zheng's avatar Lianmin Zheng Committed by GitHub
Browse files

Update TypeBasedDispatcher and balance CI tests (#3001)

parent 03464890
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 4 deletions
.github/workflows/pr-test.yml
View file @ 09bcbe01
...@@ -52,7 +52,7 @@ jobs: ...@@ -52,7 +52,7 @@ jobs:
runs-on: 1-gpu-runner runs-on: 1-gpu-runner
strategy: strategy:
matrix: matrix:
range: [0-6, 6-15, 15-22, 22-32, 32-37, 37-100] range: [0-6, 6-15, 15-22, 22-32, 32-40, 40-100]
steps: steps:
- name: Checkout code - name: Checkout code
uses: actions/checkout@v3 uses: actions/checkout@v3
......
python/sglang/srt/managers/tokenizer_manager.py
View file @ 09bcbe01
...@@ -226,9 +226,10 @@ class TokenizerManager: ...@@ -226,9 +226,10 @@ class TokenizerManager:
self._result_dispatcher = TypeBasedDispatcher( self._result_dispatcher = TypeBasedDispatcher(
[ [
(BatchStrOut, self._handle_batch_output), (
(BatchEmbeddingOut, self._handle_batch_output), (BatchStrOut, BatchEmbeddingOut, BatchTokenIDOut),
(BatchTokenIDOut, self._handle_batch_output), self._handle_batch_output,
),
(OpenSessionReqOutput, self._handle_open_session_req_output), (OpenSessionReqOutput, self._handle_open_session_req_output),
( (
UpdateWeightFromDiskReqOutput, UpdateWeightFromDiskReqOutput,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment