Commits · 7f570f1caa472dcb4143488d9406eb339f87e359 · OpenDAS / vllm_cscc

25 Sep, 2025 1 commit
- [V0 deprecation] Remove unreachable model_config.supported_tasks (#25642) · 7f570f1c
  wang.yuqi authored Sep 25, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  7f570f1c
24 Sep, 2025 4 commits
- Improve `--help` for enhanced user experience (#24903) · e7f27ea6
  Harry Mellor authored Sep 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e7f27ea6
- [Bugfix] Fix DeepSeekV31ToolParser to correctly parse multiple tools in... · e18b714b
  Tao Hui authored Sep 24, 2025
```
[Bugfix] Fix DeepSeekV31ToolParser to correctly parse multiple tools in non-streaming output (#25405)
Signed-off-by: taohui <taohui3@gmail.com>
```
  e18b714b
- [V0 Deprecation] Remove max_seq_len_to_capture (#25543) · 2e19a848
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2e19a848
- [Bugfix] [Frontend] Cleanup gpt-oss non-streaming chat tool calls (#25514) · 5caaeb71
  Ben Browning authored Sep 23, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  5caaeb71
23 Sep, 2025 3 commits
- [gpt-oss][bugfix] remove logic to require resp_ in ResponseAPI (#25428) · 95bc60e4
  Andrew Xia authored Sep 23, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  95bc60e4
- [Bugfix] gpt-oss container tool output bug (#25485) · c828d1bf
  Alec S authored Sep 23, 2025
```
Signed-off-by: Alec Solder <alecs@fb.com>
Co-authored-by: Alec Solder <alecs@fb.com>
```
  c828d1bf
- [Frontend] Add a new xml-based tool parser for qwen3-coder (#25028) · 9383cd6f
  Zhikaiiii authored Sep 23, 2025
```
Signed-off-by: Zhikaiiii <1658973216@qq.com>
```
  9383cd6f
22 Sep, 2025 3 commits

[Frontend] Responses API MCP tools for built in tools and to pass through headers (#24628) · 45d7d852

Alec S authored Sep 22, 2025


Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec S <10566873+alecsolder@users.noreply.github.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

45d7d852

Make `mypy` behave like a proper pre-commit hook (#25313) · 3d2c56b7

Harry Mellor authored Sep 22, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

3d2c56b7

[Bugfix] Fix hermes tool parser handling of non-string argument types (#22002) · 0eecb316

WeiQing Chen authored Sep 22, 2025


Signed-off-by: wangzi <3220100013@zju.edu.cn>
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

0eecb316

21 Sep, 2025 3 commits
- [V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334) · 0ff8ebb2
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0ff8ebb2
- [Optimization] Cache chat template result when processor fails to be loaded (#25341) · 65a5910c
  Cyrus Leung authored Sep 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  65a5910c
- [V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  52c2a8d4
20 Sep, 2025 3 commits
- [V1] Support `LLM.apply_model` (#18465) · 3d9a1d2d
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3d9a1d2d
- [Bugfix] fix tool call arguments is empty (#25223) · f91480b2
  Chauncey authored Sep 20, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: xin.li <xin.li@daocloud.io>
```
  f91480b2
- Don't skip special tokens with hermes-style tool calling (#25281) · a36c6758
  Maximilien de Bayser authored Sep 19, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  a36c6758
19 Sep, 2025 5 commits

[Frontend] Responses API messages out, just harmony for now (#24985) · e69e0b8b

Alec S authored Sep 19, 2025


Signed-off-by: Alec Solder <alecs@fb.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

e69e0b8b

[Frontend] Pass API server count to each process (#23717) · 6c117cff
Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
6c117cff
Move `PoolerConfig` from `config/__init__.py` to `config/pooler.py` (#25181) · 058525b9
Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
058525b9

[gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent... · 6d8246aa

Andrew Xia authored Sep 18, 2025


[gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent for streaming (#24938)
Signed-off-by: Andrew Xia <axia@meta.com>

6d8246aa

[CORE] Prompt Embeddings Support for v1 Engine (#24278) · 9a4600e4

Andrew Sansom authored Sep 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9a4600e4

18 Sep, 2025 8 commits
- [V0 Deprecation] Remove AsyncLLMEngine (#25025) · e19bce40
  Woosuk Kwon authored Sep 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e19bce40
- [Docs] Fix warnings in mkdocs build (continued) (#25163) · b419937c
  Hyogeun Oh (오효근) authored Sep 19, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  b419937c
- [New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33
  wang.yuqi authored Sep 18, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  5f696c33
- feat(api): Return 503 on /health when engine is dead (#24897) · 67244c86
  dongbo910220 authored Sep 18, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  67244c86
- [Frontend] Support setting logprobs to -1 (#25031) · cc935fdd
  Chauncey authored Sep 18, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  cc935fdd
- [Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89
  Aaron Pham authored Sep 18, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  29283e89
- [CLI] Use streaming in CLI chat and completion commands (#23769) · e111d5b0
  Simon Mo authored Sep 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  e111d5b0
- Mark prompt logprobs as incompatible with prompt embeds at API level (#25077) · bec060fd
  Andrew Sansom authored Sep 17, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  bec060fd
17 Sep, 2025 6 commits
- [gpt-oss][2] fix types for streaming (#24556) · bff2e5f1
  Andrew Xia authored Sep 17, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  bff2e5f1
- [BugFix] enable DOTALL to match multi-line tool_call parameters in... · 2b856970
  Shijun Yin authored Sep 17, 2025
```
[BugFix] enable DOTALL to match multi-line tool_call parameters in extract_tool_call_required_streaming (#24668)
Signed-off-by: Shijun Yin <shijun.yin@outlook.com>
```
  2b856970
- [Frontend] Support returning all prompt logprobs (#24956) · 544fe76b
  Chauncey authored Sep 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  544fe76b
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
- [V0 Deprecation] Remove MQLLMEngine (#25019) · 5801e497
  Woosuk Kwon authored Sep 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  5801e497
- [misc] fix typo in value error (#24995) · ea3de5ef
  Prashant Gupta authored Sep 16, 2025
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  ea3de5ef
16 Sep, 2025 3 commits
- [gpt-oss][1][bugfix] fix streaming final output (#24466) · 86daa875
  Andrew Xia authored Sep 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  86daa875
- [gpt-oss][1b] streaming add item id, content id (#24788) · f4d6eb95
  Andrew Xia authored Sep 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  f4d6eb95
- [Bugfix] remove duplicate tokens streamed in required tool choice streaming (#23312) · 68dbde5d
  Cheng Kuan Yong Jason authored Sep 16, 2025
```
Signed-off-by: Jason Cheng <jasoncky96@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  68dbde5d
15 Sep, 2025 1 commit
- [gpt-oss][1a] create_responses stream outputs BaseModel type, api server is SSE still (#24759) · 73df49ef
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  73df49ef