Skip to content

GitLab

Unverified Commit 6c1c1933 authored by Muqi Li's avatar Muqi Li Committed by GitHub
Browse files

[Detokenizer Manager] Cleanup state when reqs are finished (#12205)

parent 3029d301
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
python/sglang/srt/managers/detokenizer_manager.py
View file @ 6c1c1933
...@@ -235,6 +235,8 @@ class DetokenizerManager(MultiHttpWorkerDetokenizerMixin): ...@@ -235,6 +235,8 @@ class DetokenizerManager(MultiHttpWorkerDetokenizerMixin):
new_text = "" new_text = ""
else: else:
new_text = find_printable_text(new_text) new_text = find_printable_text(new_text)
else:
del self.decode_status[recv_obj.rids[i]]
output_str = self.trim_matched_stop( output_str = self.trim_matched_stop(
s.decoded_text + new_text, s.decoded_text + new_text,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment