Commits · 8fcaaf6a165e661f63fc51be906bc05b0767332f · OpenDAS / vllm_cscc

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
11 Oct, 2025 1 commit
- [Refactor]Reduce duplicate code in serving_chat (#26627) · d0bed837
  Chauncey authored Oct 11, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  d0bed837
10 Oct, 2025 4 commits
- [Bugfix] fixed top_logprobs: -1 does not appear to work as intended (#26470) · 910abdbd
  Chauncey authored Oct 11, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  910abdbd
- [CI] fix ruff format (#26579) · 720d3cd0
  Chauncey authored Oct 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  720d3cd0
- [GPT-OSS] Add support for arrays at tool message content (#25593) · 3ee202ea
  Luis Tomas Bolivar authored Oct 10, 2025
```
Signed-off-by: Luis Tomas Bolivar <ltomasbo@redhat.com>
```
  3ee202ea
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
09 Oct, 2025 2 commits
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
08 Oct, 2025 2 commits

[Bugfix] Fix `vllm bench ...` on CPU-only head nodes (#25283) · 76afe4ed

Aydin Abiar authored Oct 08, 2025

Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Aydin Abiar <aydin@anyscale.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

76afe4ed

Tidy `vllm/config/__init__.py` to only add classes and functions (#26405) · 2f99f2f5
Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2f99f2f5

07 Oct, 2025 3 commits
- Optimize KV cache distribution for asymmetric pipeline parallelism (#25164) · d100d78e
  Grant Holmes (Ren) authored Oct 07, 2025
```
Signed-off-by: gholmes829 <g.holmes429@gmail.com>
```
  d100d78e
- [responsesAPI][bugfix] serialize harmony messages (#26185) · 185d8ed4
  Andrew Xia authored Oct 07, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  185d8ed4
- [Deprecation] Deprecate `LLM.set_tokenizer` (#26333) · d9836d45
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9836d45
06 Oct, 2025 4 commits
- [Benchmark] Enable MM Embedding benchmarks (#26310) · 44b9af5b
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44b9af5b
- [Frontend] Consolidate tokenizer init code (#26276) · 391612e7
  Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  391612e7
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
- [CI][gpt-oss] Enable python tool tests in CI (#24315) · 91ac7f76
  wuhang authored Oct 06, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  91ac7f76
05 Oct, 2025 5 commits
- Fix per file ruff ignores related to simplification (#26259) · b893d661
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b893d661
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Bugfix] Allow `--skip-tokenizer-init` with `echo and return_token_ids` (#26238) · a964e5e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a964e5e6
04 Oct, 2025 3 commits
- [Renderer] Clean up renderer code (#26216) · 119f0063
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  119f0063
- [Frontend] Cache chat template kwargs resolution (#26227) · a42d2df7
  Isotr0py authored Oct 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a42d2df7
- [BugFix] Use async Mistral Tokenizer in Chat Completions (#26134) · ea25a76c
  Ben Browning authored Oct 03, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ea25a76c
03 Oct, 2025 6 commits
- [responsesAPI] add better error messaging for long prompts (#25724) · 831b1241
  Andrew Xia authored Oct 03, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  831b1241
- [Renderer] Move Processor out of LLMEngine (#26165) · d78fda7c
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d78fda7c
- [Model] Fixed stream generator for gpt-oss + spec-decoding (#26027) · 73a99cc2
  Aleksandr Samarin authored Oct 03, 2025
```
Signed-off-by: Aleksandr Samarin <astrlrd@nebius.com>
```
  73a99cc2
- [Renderer] Move Processor out of AsyncLLM (#24138) · 812b7f54
  Yang Liu authored Oct 03, 2025
```
Signed-off-by: Yang <lymailforjob@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  812b7f54
- [openai] Fix missing tool usage check (system message) (#24768) · 2ed3f20d
  kyt authored Oct 03, 2025
```
Signed-off-by: kyt <eluban4532@gmail.com>
```
  2ed3f20d
- [gpt-oss] disable tool server initialization if no tool in request (#25790) · e5017cd6
  Andrew Xia authored Oct 02, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  e5017cd6
30 Sep, 2025 1 commit

[gpt-oss] use vLLM instead of openai types for streaming (#25186) · 5db1870b

Andrew Xia authored Sep 30, 2025


Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>

5db1870b

27 Sep, 2025 3 commits

Add filtering for chat template kwargs (#25794) · 7977e502

Russell Bryant authored Sep 27, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7977e502

Validate API tokens in constant time (#25781) · 3f5d902d

Russell Bryant authored Sep 27, 2025


Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>

3f5d902d

Add option to restrict media domains (#25783) · 3958b96b

Russell Bryant authored Sep 26, 2025


Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>

3958b96b

26 Sep, 2025 1 commit
- Support LongCat-Flash-Chat tool call (#24083) · b03b1b97
  Xu Wenqing authored Sep 26, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  b03b1b97
25 Sep, 2025 2 commits

Add backward compatibility for `guided_...` API (#25615) · 70fbdb26

Harry Mellor authored Sep 25, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

70fbdb26

[V0 deprecation] Remove unreachable model_config.supported_tasks (#25642) · 7f570f1c
wang.yuqi authored Sep 25, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
7f570f1c

24 Sep, 2025 2 commits
- Improve `--help` for enhanced user experience (#24903) · e7f27ea6
  Harry Mellor authored Sep 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e7f27ea6
- [Bugfix] Fix DeepSeekV31ToolParser to correctly parse multiple tools in... · e18b714b
  Tao Hui authored Sep 24, 2025
```
[Bugfix] Fix DeepSeekV31ToolParser to correctly parse multiple tools in non-streaming output (#25405)
Signed-off-by: taohui <taohui3@gmail.com>
```
  e18b714b