Skip to content

GitLab

"configs/_base_/datasets/lyft-3d.py" did not exist on "aee606fc3d89245dc5fa6bb4c70da0f2e6f74933"
Unverified Commit 62bbd343 authored by Lianmin Zheng's avatar Lianmin Zheng Committed by GitHub
Browse files

Revert "Extract generation_manager from tokenizer_manager" (#3829)

parent f2388f6b
Expand all Show whitespace changes
Inline Side-by-side
Showing with 571 additions and 748 deletions
python/sglang/srt/entrypoints/engine.py
View file @ 62bbd343
...@@ -463,5 +463,5 @@ def _launch_subprocesses(server_args: ServerArgs) -> Tuple[TokenizerManager, Dic ...@@ -463,5 +463,5 @@ def _launch_subprocesses(server_args: ServerArgs) -> Tuple[TokenizerManager, Dic
# Assume all schedulers have the same scheduler_info # Assume all schedulers have the same scheduler_info
scheduler_info = scheduler_infos[0] scheduler_info = scheduler_infos[0]
tokenizer_manager.configure_max_req_input_len(scheduler_info["max_req_input_len"]) tokenizer_manager.max_req_input_len = scheduler_info["max_req_input_len"]
return tokenizer_manager, scheduler_info return tokenizer_manager, scheduler_info
python/sglang/srt/managers/generation_manager.py deleted 100644 → 0
View file @ f2388f6b
This diff is collapsed.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment