Commits · 59a50afa084dbd26b8a4f58b960ce337af6a4667 · OpenDAS / vllm_cscc

06 Nov, 2025 2 commits
- [Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874) · 59a50afa
  Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  59a50afa
- [Misc] Remove the duplicate code (#28111) · 07d61451
  Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  07d61451
05 Nov, 2025 8 commits
- [Core] add support for reasoning parser plugins (#28075) · 752ddeac
  Walter Beller-Morales authored Nov 05, 2025
```
Signed-off-by: walter beller-morales <walter.beller.morales@gmail.com>
```
  752ddeac
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
- [BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546
  Ilya Markov authored Nov 05, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  e50c4546
- Fix excessive logging noise by reducing the log level of the... · b57789b6
  Eric Yue authored Nov 05, 2025
```
Fix excessive logging noise by reducing the log level of the MinimaxM2ToolParser import success message (#27635)
Signed-off-by: minatoaquaMK2 <jiacheng.yue@foxmail.com>
```
  b57789b6
- [Refactor] to simplify and extract the shared logic between chat completion and responses (#27961) · 0976711f
  Chauncey authored Nov 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  0976711f
- [Refactor] Lazy-loaded reasoning_parser (#28092) · e261d37c
  Chauncey authored Nov 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  e261d37c
- [Model, Core] Support Granite Speech & LoRA for STT (#24455) · b7cbc254
  Alex Brooks authored Nov 05, 2025
  
  b7cbc254
- [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
  wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  428bc7bf
04 Nov, 2025 2 commits
- [Multimodal] Make MediaConnector extensible. (#27759) · 1fb4217a
  Chenheli Hua authored Nov 04, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  1fb4217a
- [Refactor] Lazy import tool_parser (#27974) · c02fccdb
  Chauncey authored Nov 04, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  c02fccdb
03 Nov, 2025 2 commits
- Add ORCA endpoint load metrics support (#24905) · ba464e6a
  Misha Efimov authored Nov 03, 2025
```
Signed-off-by: Misha Efimov <mef@google.com>
```
  ba464e6a
- [Frontend] Align finish_reason when tool is called with OpenAI (#25054) · 470ad118
  Sungyoon Jeong authored Nov 03, 2025
```
Signed-off-by: Sungyoon Jeong <sungyoon.jeong@furiosa.ai>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  470ad118
02 Nov, 2025 1 commit
- Fix(llm): Abort orphaned requests when llm.chat() batch fails Fixes #26081 (#27420) · 0ce743f4
  Vensen authored Nov 03, 2025
```
Signed-off-by: vensenmu <vensenmu@gmail.com>
```
  0ce743f4
01 Nov, 2025 2 commits
- Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
  Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
  1e88fb75
- [Core][TPU] Support TPU Data Parallalism (#27365) · af6e19f5
  wenxindongwork authored Nov 01, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
  af6e19f5
31 Oct, 2025 3 commits
- [Feature] Pydantic validation for scheduler.py and structured_outputs.py (#26519) · 5e8862e9
  Vinay R Damodaran authored Oct 31, 2025
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5e8862e9
- [Cleanup] Remove no-longer-used `SpeculativeConfig.enable_chunked_prefill` (#27826) · 9e5bd307
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9e5bd307
- [bugfix] Missing cached item in beam search (#27874) · 103a468b
  Chenguang Zheng authored Nov 01, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  103a468b
30 Oct, 2025 2 commits
- [EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) · a2981c42
  cong-meta authored Oct 30, 2025
```
Co-authored-by: Cong Chen <prowindy@gmail.com>
```
  a2981c42
- [Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f
  wang.yuqi authored Oct 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4464723f
29 Oct, 2025 3 commits

[Frontend] Add `vllm bench sweep` to CLI (#27639) · ecca3fee

Cyrus Leung authored Oct 29, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

ecca3fee

[Frontend] [gpt-oss] Mcp type bug (#27689) · ab2eb27b

Alec S authored Oct 29, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

ab2eb27b

[Frontend] [gpt-oss] Tool json call parsing error retry (#27675) · 3c7fefde

Alec S authored Oct 29, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

3c7fefde

28 Oct, 2025 5 commits
- [Bugfix][Frontend] validate arg priority in frontend LLM class before add request (#27596) · b186149e
  Junpu Fan authored Oct 28, 2025
```
Signed-off-by: Junpu Fan <junpufan@gmail.com>
```
  b186149e
- fix: allow HuggingFace standard chat template params via **kwargs (#27622) · 446912d1
  wangln19 authored Oct 28, 2025
```
Signed-off-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  446912d1
- [Misc] Separate out `utils.counter` and move `utils.Device` to engine (#27588) · f58d9b64
  Cyrus Leung authored Oct 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f58d9b64
- [V0 Deprecation] Remove vestigial V0 logits_processors.py file (#27601) · 7a865f23
  Nick Hill authored Oct 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7a865f23
- Fix a robust parsing issue in KimiK2ToolParser that causes IndexError (#27565) · 2fa90bda
  wangln19 authored Oct 28, 2025
```
Signed-off-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Co-authored-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
```
  2fa90bda
27 Oct, 2025 4 commits
- [gpt-oss][2/N] Support input_messages in responsesRequest (#26962) · 53a56e65
  Andrew Xia authored Oct 27, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  53a56e65
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
- [Bugfix] Fixed when return_token_ids=False, the first event still contains... · a4fc2189
  Chauncey authored Oct 27, 2025
```
[Bugfix] Fixed when return_token_ids=False, the first event still contains prompt_token_ids. (#27561)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  a4fc2189
- [Misc] Clean up utils (#27552) · 7c2bdb83
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c2bdb83
26 Oct, 2025 2 commits

[Model][MiniMax-M2] Support MiniMax-M2 Model (#27535) · 720af6ab
Roger Young authored Oct 27, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
720af6ab

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

24 Oct, 2025 3 commits
- [Refactor] move tool parsing logic from protocol.py to the tool parser (#27383) · 35678169
  Chauncey authored Oct 24, 2025
```
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  35678169
- [BugFix] Fix torchrun DP with LLM class (#27395) · e0ef8a29
  22quinn authored Oct 24, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  e0ef8a29
- [Bugfix] Fix Pydantic union resolution for ResponseFunctionToolCall in Responses API (#26706) · 07447554
  strinczer authored Oct 24, 2025
```
Signed-off-by: Shai Trinczer <strinczer@icloud.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  07447554
23 Oct, 2025 1 commit

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973) · 3fa2c121

wang.yuqi authored Oct 23, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>

3fa2c121