tests/v1/sample/test_sampler.py · 371d04d39bf056e4cc56100c83d4812b7cb230e4 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling (#11394) · 371d04d3
Woosuk Kwon authored Dec 27, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
371d04d3

test_sampler.py 14.1 KB