Commits · a42d2df75f932711deee18e0f4d8ca92fe7ece8c · OpenDAS / vllm_cscc

04 Oct, 2025 2 commits
- [Frontend] Cache chat template kwargs resolution (#26227) · a42d2df7
  Isotr0py authored Oct 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a42d2df7
- [BugFix] Use async Mistral Tokenizer in Chat Completions (#26134) · ea25a76c
  Ben Browning authored Oct 03, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ea25a76c
03 Oct, 2025 6 commits
- [responsesAPI] add better error messaging for long prompts (#25724) · 831b1241
  Andrew Xia authored Oct 03, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  831b1241
- [Renderer] Move Processor out of LLMEngine (#26165) · d78fda7c
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d78fda7c
- [Model] Fixed stream generator for gpt-oss + spec-decoding (#26027) · 73a99cc2
  Aleksandr Samarin authored Oct 03, 2025
```
Signed-off-by: Aleksandr Samarin <astrlrd@nebius.com>
```
  73a99cc2
- [Renderer] Move Processor out of AsyncLLM (#24138) · 812b7f54
  Yang Liu authored Oct 03, 2025
```
Signed-off-by: Yang <lymailforjob@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  812b7f54
- [openai] Fix missing tool usage check (system message) (#24768) · 2ed3f20d
  kyt authored Oct 03, 2025
```
Signed-off-by: kyt <eluban4532@gmail.com>
```
  2ed3f20d
- [gpt-oss] disable tool server initialization if no tool in request (#25790) · e5017cd6
  Andrew Xia authored Oct 02, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  e5017cd6
30 Sep, 2025 1 commit

[gpt-oss] use vLLM instead of openai types for streaming (#25186) · 5db1870b

Andrew Xia authored Sep 30, 2025


Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>

5db1870b

27 Sep, 2025 2 commits

Add filtering for chat template kwargs (#25794) · 7977e502

Russell Bryant authored Sep 27, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7977e502

Validate API tokens in constant time (#25781) · 3f5d902d

Russell Bryant authored Sep 27, 2025


Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>

3f5d902d

26 Sep, 2025 1 commit
- Support LongCat-Flash-Chat tool call (#24083) · b03b1b97
  Xu Wenqing authored Sep 26, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  b03b1b97
25 Sep, 2025 2 commits

Add backward compatibility for `guided_...` API (#25615) · 70fbdb26

Harry Mellor authored Sep 25, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

70fbdb26

[V0 deprecation] Remove unreachable model_config.supported_tasks (#25642) · 7f570f1c
wang.yuqi authored Sep 25, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
7f570f1c

24 Sep, 2025 2 commits
- [Bugfix] Fix DeepSeekV31ToolParser to correctly parse multiple tools in... · e18b714b
  Tao Hui authored Sep 24, 2025
```
[Bugfix] Fix DeepSeekV31ToolParser to correctly parse multiple tools in non-streaming output (#25405)
Signed-off-by: taohui <taohui3@gmail.com>
```
  e18b714b
- [Bugfix] [Frontend] Cleanup gpt-oss non-streaming chat tool calls (#25514) · 5caaeb71
  Ben Browning authored Sep 23, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  5caaeb71
23 Sep, 2025 2 commits
- [gpt-oss][bugfix] remove logic to require resp_ in ResponseAPI (#25428) · 95bc60e4
  Andrew Xia authored Sep 23, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  95bc60e4
- [Frontend] Add a new xml-based tool parser for qwen3-coder (#25028) · 9383cd6f
  Zhikaiiii authored Sep 23, 2025
```
Signed-off-by: Zhikaiiii <1658973216@qq.com>
```
  9383cd6f
22 Sep, 2025 2 commits

[Frontend] Responses API MCP tools for built in tools and to pass through headers (#24628) · 45d7d852

Alec S authored Sep 22, 2025


Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec S <10566873+alecsolder@users.noreply.github.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

45d7d852

[Bugfix] Fix hermes tool parser handling of non-string argument types (#22002) · 0eecb316

WeiQing Chen authored Sep 22, 2025


Signed-off-by: wangzi <3220100013@zju.edu.cn>
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

0eecb316

20 Sep, 2025 1 commit
- Don't skip special tokens with hermes-style tool calling (#25281) · a36c6758
  Maximilien de Bayser authored Sep 19, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  a36c6758
19 Sep, 2025 4 commits

[Frontend] Responses API messages out, just harmony for now (#24985) · e69e0b8b

Alec S authored Sep 19, 2025


Signed-off-by: Alec Solder <alecs@fb.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

e69e0b8b

[Frontend] Pass API server count to each process (#23717) · 6c117cff
Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
6c117cff

[gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent... · 6d8246aa

Andrew Xia authored Sep 18, 2025


[gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent for streaming (#24938)
Signed-off-by: Andrew Xia <axia@meta.com>

6d8246aa

[CORE] Prompt Embeddings Support for v1 Engine (#24278) · 9a4600e4

Andrew Sansom authored Sep 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9a4600e4

18 Sep, 2025 6 commits
- [V0 Deprecation] Remove AsyncLLMEngine (#25025) · e19bce40
  Woosuk Kwon authored Sep 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e19bce40
- [Docs] Fix warnings in mkdocs build (continued) (#25163) · b419937c
  Hyogeun Oh (오효근) authored Sep 19, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  b419937c
- feat(api): Return 503 on /health when engine is dead (#24897) · 67244c86
  dongbo910220 authored Sep 18, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  67244c86
- [Frontend] Support setting logprobs to -1 (#25031) · cc935fdd
  Chauncey authored Sep 18, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  cc935fdd
- [Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89
  Aaron Pham authored Sep 18, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  29283e89
- Mark prompt logprobs as incompatible with prompt embeds at API level (#25077) · bec060fd
  Andrew Sansom authored Sep 17, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  bec060fd
17 Sep, 2025 5 commits
- [gpt-oss][2] fix types for streaming (#24556) · bff2e5f1
  Andrew Xia authored Sep 17, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  bff2e5f1
- [BugFix] enable DOTALL to match multi-line tool_call parameters in... · 2b856970
  Shijun Yin authored Sep 17, 2025
```
[BugFix] enable DOTALL to match multi-line tool_call parameters in extract_tool_call_required_streaming (#24668)
Signed-off-by: Shijun Yin <shijun.yin@outlook.com>
```
  2b856970
- [Frontend] Support returning all prompt logprobs (#24956) · 544fe76b
  Chauncey authored Sep 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  544fe76b
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
- [V0 Deprecation] Remove MQLLMEngine (#25019) · 5801e497
  Woosuk Kwon authored Sep 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  5801e497
16 Sep, 2025 2 commits
- [gpt-oss][1b] streaming add item id, content id (#24788) · f4d6eb95
  Andrew Xia authored Sep 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  f4d6eb95
- [Bugfix] remove duplicate tokens streamed in required tool choice streaming (#23312) · 68dbde5d
  Cheng Kuan Yong Jason authored Sep 16, 2025
```
Signed-off-by: Jason Cheng <jasoncky96@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  68dbde5d
15 Sep, 2025 2 commits
- [gpt-oss][1a] create_responses stream outputs BaseModel type, api server is SSE still (#24759) · 73df49ef
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  73df49ef
- [gpt-oss] Add IncompleteDetails to ResponsesRepsonse (#24561) · 25aba2b6
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  25aba2b6