Skip to content

GitLab

Unverified Commit 5ad033a0 authored by Max Shawabkeh's avatar Max Shawabkeh Committed by GitHub
Browse files

Fix StreamExecutor.fork() losing the current role start index. (#684)

parent 77e592e8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
python/sglang/lang/interpreter.py
View file @ 5ad033a0
...@@ -288,6 +288,7 @@ class StreamExecutor: ...@@ -288,6 +288,7 @@ class StreamExecutor:
exes[i].text_ = str(self.text_) exes[i].text_ = str(self.text_)
exes[i].messages_ = list(self.messages_) exes[i].messages_ = list(self.messages_)
exes[i].cur_role = self.cur_role exes[i].cur_role = self.cur_role
exes[i].cur_role_begin_pos = self.cur_role_begin_pos
exes[i].fork_start_text_pos = len(self.text_) exes[i].fork_start_text_pos = len(self.text_)
exes[i].images_ = list(self.images_) exes[i].images_ = list(self.images_)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment