Commits · 8fcaaf6a165e661f63fc51be906bc05b0767332f · OpenDAS / vllm_cscc

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
11 Oct, 2025 1 commit
- [Refactor]Reduce duplicate code in serving_chat (#26627) · d0bed837
  Chauncey authored Oct 11, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  d0bed837
10 Oct, 2025 1 commit
- [Bugfix] fixed top_logprobs: -1 does not appear to work as intended (#26470) · 910abdbd
  Chauncey authored Oct 11, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  910abdbd
09 Oct, 2025 1 commit
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit
- [Frontend] Cache chat template kwargs resolution (#26227) · a42d2df7
  Isotr0py authored Oct 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a42d2df7
03 Oct, 2025 3 commits
- [Model] Fixed stream generator for gpt-oss + spec-decoding (#26027) · 73a99cc2
  Aleksandr Samarin authored Oct 03, 2025
```
Signed-off-by: Aleksandr Samarin <astrlrd@nebius.com>
```
  73a99cc2
- [Renderer] Move Processor out of AsyncLLM (#24138) · 812b7f54
  Yang Liu authored Oct 03, 2025
```
Signed-off-by: Yang <lymailforjob@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  812b7f54
- [openai] Fix missing tool usage check (system message) (#24768) · 2ed3f20d
  kyt authored Oct 03, 2025
```
Signed-off-by: kyt <eluban4532@gmail.com>
```
  2ed3f20d
27 Sep, 2025 1 commit

Add filtering for chat template kwargs (#25794) · 7977e502

Russell Bryant authored Sep 27, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7977e502

24 Sep, 2025 1 commit
- [Bugfix] [Frontend] Cleanup gpt-oss non-streaming chat tool calls (#25514) · 5caaeb71
  Ben Browning authored Sep 23, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  5caaeb71
18 Sep, 2025 1 commit

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 2 commits

[BugFix] enable DOTALL to match multi-line tool_call parameters in... · 2b856970

Shijun Yin authored Sep 17, 2025


[BugFix] enable DOTALL to match multi-line tool_call parameters in extract_tool_call_required_streaming (#24668)
Signed-off-by: Shijun Yin <shijun.yin@outlook.com>

2b856970

[Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
6c47f6bf

16 Sep, 2025 1 commit
- [Bugfix] remove duplicate tokens streamed in required tool choice streaming (#23312) · 68dbde5d
  Cheng Kuan Yong Jason authored Sep 16, 2025
```
Signed-off-by: Jason Cheng <jasoncky96@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  68dbde5d
11 Sep, 2025 1 commit
- Fix model name included in responses (#24663) · c1eda615
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c1eda615
06 Sep, 2025 1 commit
- [Fix] [gpt-oss] fix non-tool calling path for chat completion (#24324) · fb691ee4
  Aaron Pham authored Sep 06, 2025
  
  fb691ee4
05 Sep, 2025 1 commit
- [gpt-oss] tool parser supports for /chat/completions [1/n] (#22386) · c29fb540
  Aaron Pham authored Sep 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c29fb540
04 Sep, 2025 1 commit
- [Frontend] Skip unnecessary detokenization when token_id is requested (#24236) · 65e03893
  Nicolò Lucchesi authored Sep 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  65e03893
01 Sep, 2025 1 commit
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
30 Aug, 2025 1 commit

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

27 Aug, 2025 2 commits
- [Frontend] Add --log-error-stack to print stack trace for error response (#22960) · 32102644
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  32102644
- [Bugfix] UnboundLocalError when GptOss reasoning specified (#23054) · 585e0bde
  Federico authored Aug 27, 2025
```
Signed-off-by: Federico <65908512+coval3nte@users.noreply.github.com>
```
  585e0bde
25 Aug, 2025 1 commit
- [gpt-oss] use reasoning channel for reasoning text in serving_chat (#22920) · 49ab23b3
  Yu Guo authored Aug 24, 2025
```
Signed-off-by: Yu Guo <yuguo@meta.com>
```
  49ab23b3
20 Aug, 2025 1 commit
- [Fix] correct tool_id for kimi-k2 when use tool_choice=required (#21259) · 582bbe6b
  bigmoyan authored Aug 21, 2025
```
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  582bbe6b
19 Aug, 2025 2 commits

fix: use cache_salt for gpt-oss (#23186) · 80141bbf
Marko Rosenmueller authored Aug 19, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
80141bbf

Add return_token_ids parameter to OpenAI API endpoints (#22587) · 24f4d1a2

Yuge Zhang authored Aug 20, 2025


Signed-off-by: Yuge Zhang <scottyugochang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

24f4d1a2

16 Aug, 2025 1 commit
- [Frontend] Avoid list copies in `serving_chat.py` (#22947) · f6b50405
  Nick Hill authored Aug 15, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  f6b50405
07 Aug, 2025 1 commit
- feat: Add --enable-log-outputs flag for logging model generations (#20707) · 8e8e0b6a
  Adrián García García authored Aug 07, 2025
```
Signed-off-by: Adrian Garcia <adrian.garcia@inceptionai.ai>
```
  8e8e0b6a
06 Aug, 2025 1 commit
- [gpt-oss] Support chat completion api (#22342) · f263a4b5
  Woosuk Kwon authored Aug 06, 2025
  
  f263a4b5
28 Jul, 2025 1 commit

[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named... · 7656cf4c

Hongsheng Liu authored Jul 28, 2025


[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named function calling when Thinking is disabled (#21573)
Signed-off-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: wangzi <3220100013@zju.edu.cn>

7656cf4c

24 Jul, 2025 1 commit

Replace `--expand-tools-even-if-tool-choice-none` with... · 6eca337c

Shintarou Okada authored Jul 24, 2025

Replace `--expand-tools-even-if-tool-choice-none` with `--exclude-tools-when-tool-choice-none` for v0.10.0 (#20544)
Signed-off-by: okada <kokuzen@gmail.com>
Signed-off-by: okada shintarou <okada@preferred.jp>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6eca337c

23 Jul, 2025 1 commit
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
17 Jul, 2025 1 commit
- [Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820) · 5a7fb3ab
  Asher authored Jul 17, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  5a7fb3ab
15 Jul, 2025 1 commit
- [Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979) · 313ae8c1
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  313ae8c1
10 Jul, 2025 1 commit
- [Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126) · 41060c6e
  Alex Brooks authored Jul 10, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  41060c6e
09 Jul, 2025 1 commit

[Bugfix] Fix the issue where `reasoning_content` is `None` when Thinkng is... · 2155e95e

Chauncey authored Jul 09, 2025


[Bugfix] Fix the issue where `reasoning_content` is `None` when Thinkng is enabled and `tool_choice` is set to `'required'`. (#20662)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

2155e95e

04 Jul, 2025 1 commit
- [Platform] Add custom default max tokens (#18557) · a4113b03
  Gabriel Marinho authored Jul 03, 2025
```
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
```
  a4113b03
01 Jul, 2025 1 commit
- [Frontend] Expand tools even if tool_choice="none" (#17177) · 3d19d47d
  Shintarou Okada authored Jul 02, 2025
```
Signed-off-by: okada shintarou <okada@preferred.jp>
```
  3d19d47d