Commits · cd579352bfef4828bb9a1e40221ff757495ccbdd · OpenDAS / vllm_cscc · GitLab

06 Mar, 2025 2 commits

[V1] Do not detokenize if sampling param detokenize is False (#14224) · cd579352

Himanshu Jaju authored Mar 06, 2025


Signed-off-by: Himanshu Jaju <hj@mistral.ai>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

cd579352

Reinstate `best_of` for V0 (#14356) · bf0560bd
Harry Mellor authored Mar 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
bf0560bd

05 Mar, 2025 3 commits

[V1][Easy] Add empty allowed_token_ids in the v1 sampler test (#14308) · 53ea6ad8
Lu Fang authored Mar 05, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
53ea6ad8

Deprecate `best_of` Sampling Parameter in anticipation for vLLM V1 (#13997) · a4f1ee35

Vincent authored Mar 05, 2025

Signed-off-by: vincent-4 <vincentzhongy+githubvincent4@gmail.com>
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a4f1ee35

[V1][Frontend] Add Testing For V1 Runtime Parameters (#14159) · 257e200a
Robert Shaw authored Mar 05, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
257e200a