tests/v1/sample/test_sampler.py · dcb1a944d4cf95b4a7b3522ddf970e6d3a28b8b5 · OpenDAS / vllm_cscc

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681) · dcb1a944

sroy745 authored Dec 26, 2024


Signed-off-by: Sourashis Roy <sroy@roblox.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

dcb1a944

test_sampler.py 14.7 KB

Replace test_sampler.py