vllm/v1/worker/gpu_input_batch.py · 96ae75ad7f96c70c436f9297b06d059ad85140f9 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "4685a630a293cd7c928092efd0f8c2606a770877"

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681) · dcb1a944

sroy745 authored Dec 26, 2024


Signed-off-by: Sourashis Roy <sroy@roblox.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

dcb1a944

gpu_input_batch.py 17.7 KB

Replace gpu_input_batch.py