Skip to content

GitLab

"docs/git@developer.sourcefind.cn:renzhc/diffusers_dcu.git" did not exist on "319124847216a57a6ae12b567689aa72b28f1c02"
Unverified Commit 364d3d72 authored by Liangsheng Yin's avatar Liangsheng Yin Committed by GitHub
Browse files

Fix broken penalty (#1184)

parent 5623826f
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/managers/schedule_batch.py
View file @ 364d3d72
...@@ -615,7 +615,7 @@ class ScheduleBatch: ...@@ -615,7 +615,7 @@ class ScheduleBatch:
for r in self.reqs for r in self.reqs
] ]
else: else:
self.penalizer_orchestrator.cumulate_input_tokens(input_ids) self.sampling_info.penalizer_orchestrator.cumulate_input_tokens(input_ids)
self.input_ids = torch.tensor(input_ids, dtype=torch.int32, device="cuda") self.input_ids = torch.tensor(input_ids, dtype=torch.int32, device="cuda")
self.seq_lens.add_(1) self.seq_lens.add_(1)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment