Commits · 35bf5d08e8e4345805cebf08b29777f217ddf879 · OpenDAS / vllm_cscc

16 Jan, 2026 1 commit

[bugfix] Fix online serving crash when text type response_format is received (#26822) · 35bf5d08

cjackal authored Jan 16, 2026

Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Signed-off-by: j0shuajun <59368606+j0shuajun@users.noreply.github.com>
Co-authored-by: j0shuajun <59368606+j0shuajun@users.noreply.github.com>

35bf5d08

07 Jan, 2026 1 commit
- [OpenAI] Extend VLLMValidationError to additional validation parameters (#31870) · 1ab055ef
  R3hankhan authored Jan 07, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  1ab055ef
24 Dec, 2025 1 commit
- [Perf] Add skip_clone to SamplingParams for internal request handling (#31041) · bc5ef333
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bc5ef333
29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
25 Nov, 2025 2 commits
- Fix PoolingParams.skip_reading_prefix_cache type (#29364) · ce58fdc1
  kflu authored Nov 24, 2025
```
Signed-off-by: KFL <kludev@gmail.com>
```
  ce58fdc1
- Scheduled removal of `guided_*` config fields (#29326) · 316c8492
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  316c8492
21 Nov, 2025 1 commit
- [V0 Deprecation] Remove `best_of` (#29090) · 56e96b37
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56e96b37
19 Nov, 2025 1 commit
- [Core] Switch Flat logprob control from environment variable to SamplingParams (#28914) · 40b6b38f
  Jialin Ouyang authored Nov 18, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  40b6b38f
16 Nov, 2025 1 commit
- [Model] Allow users to control skip reading cache per request. (#28194) · a55b6463
  wang.yuqi authored Nov 16, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  a55b6463
14 Nov, 2025 1 commit

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

18 Oct, 2025 1 commit

[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515) · 7c572544

Hanchenli authored Oct 17, 2025


Signed-off-by: Hanchenli <lihanc2002@gmail.com>
Signed-off-by: Hanchenli <61769611+Hanchenli@users.noreply.github.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wei Wei <wwei6@meta.com>
Co-authored-by: Wei Wei <weiweinpu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

7c572544

17 Oct, 2025 1 commit
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
23 Sep, 2025 1 commit
- Add backward compatibility for `GuidedDecodingParams` (#25422) · 875d6def
  Harry Mellor authored Sep 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  875d6def
18 Sep, 2025 2 commits
- [Docs] add the parallel sampling usage in LLMEngine and AsyncLLM (#24222) · c9ff9e6f
  William Song authored Sep 18, 2025
  
  c9ff9e6f
- [Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89
  Aaron Pham authored Sep 18, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  29283e89
08 Sep, 2025 1 commit

[Sampler] Support returning all prompt logprobs (#23868) · b3d7e3c8

Xingyu Liu authored Sep 07, 2025


Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

b3d7e3c8

30 Aug, 2025 1 commit

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

10 Aug, 2025 1 commit
- [Docs] Fix warnings in docs build (#22588) · 00976db0
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  00976db0
04 Aug, 2025 1 commit
- [Sampler] Support returning all logprobs or logits (#21792) · 54de71d0
  22quinn authored Aug 04, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  54de71d0
15 Jul, 2025 1 commit
- [Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979) · 313ae8c1
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  313ae8c1
19 Jun, 2025 1 commit

[Frontend] Expose custom args in OpenAI APIs (#16862) · dfada85e

afeldman-nm authored Jun 18, 2025


Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

dfada85e

03 Jun, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Misc] fix: add miss best_of param validation (#18555) · d054da19
  CYJiang authored Jun 04, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  d054da19
09 May, 2025 1 commit
- Change `top_k` to be disabled with `0` (still accept `-1` for now) (#17773) · c6798baa
  Harry Mellor authored May 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c6798baa
08 May, 2025 1 commit
- [Bugfix] Fix bad words for Mistral models (#17753) · 39956efb
  Qiong Zhou Huang authored May 07, 2025
```
Signed-off-by: Qiong Zhou Huang <qiong@phonic.co>
```
  39956efb
02 May, 2025 1 commit
- add more pytorch related tests for torch nightly (#17422) · b8b0859b
  Yang Wang authored May 02, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  b8b0859b
30 Apr, 2025 1 commit

Truncation control for embedding models (#14776) · 1c2bc7ea

Gabriel Marinho authored Apr 29, 2025


Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1c2bc7ea

29 Apr, 2025 1 commit
- Simplify (and fix) passing of guided decoding backend options (#17008) · a6977dbd
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6977dbd
28 Apr, 2025 1 commit
- [Misc] Validate `stop_token_ids` contents (#17268) · 8262a3e2
  Nick Hill authored Apr 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8262a3e2
26 Apr, 2025 1 commit
- [V1] Add `structural_tag` support using xgrammar (#17085) · f8acd01f
  Russell Bryant authored Apr 26, 2025
  
  f8acd01f
22 Apr, 2025 1 commit

[Bugfix] Fix the issue where llm.generate cannot be called repeatedly after... · acba33a0

Chauncey authored Apr 22, 2025


[Bugfix] Fix the issue where llm.generate cannot be called repeatedly after setting GuidedDecodingParams (#16767)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

acba33a0

11 Apr, 2025 1 commit
- [Bugfix] Don't set an upper bound on repetition penalty (#16403) · f8f9c0ba
  Alex Brooks authored Apr 11, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  f8f9c0ba
09 Apr, 2025 1 commit
- [BugFix] fix some typos found by typos. (#16314) · 04149cce
  yihong authored Apr 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  04149cce
24 Mar, 2025 1 commit
- [BugFix][V1] Quick fix for min_tokens with multiple EOS (#15407) · 623e2ed2
  Nick Hill authored Mar 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  623e2ed2
16 Mar, 2025 1 commit
- [BugFix][V1] Fix overhead related to bad_words sampling when not in use (#14894) · fc1f6771
  Nick Hill authored Mar 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  fc1f6771
14 Mar, 2025 1 commit
- [Misc][Minor] Simplify `SamplingParams.__post_init__()` (#14772) · 4059adc3
  Nick Hill authored Mar 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4059adc3
08 Mar, 2025 2 commits
- [V1] Support bad_words in sampler (#13376) · eb8b5eb1
  22quinn authored Mar 08, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  eb8b5eb1
- [core] add `extra_args` to `SamplingParams` (#13300) · 4aae6676
  Aviv Keshet authored Mar 07, 2025
```
Signed-off-by: Aviv Keshet <akeshet@scaledcognition.com>
```
  4aae6676