Skip to content

GitLab

Unverified Commit e1122233 authored by Dong-Yong Lee's avatar Dong-Yong Lee Committed by GitHub
Browse files

fix: bug fix when penalties are negative (#913) 


Co-authored-by: default avatardongyong-lee <dongyong.lee@navercorp.com>
parent 28873a27
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/layers/sampler.py
View file @ e1122233
...@@ -158,7 +158,7 @@ def _apply_penalties( ...@@ -158,7 +158,7 @@ def _apply_penalties(
continue continue
p = presence_penalties[i] p = presence_penalties[i]
f = frequency_penalties[i] f = frequency_penalties[i]
if p < _SAMPLING_EPS and f < _SAMPLING_EPS: if abs(p) < _SAMPLING_EPS and abs(f) < _SAMPLING_EPS:
continue continue
indices.append(i) indices.append(i)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment