Commits · 6c117cff7d0110c74f97f68cda009595a2fdae5e · OpenDAS / vllm_cscc

19 Sep, 2025 3 commits

[Frontend] Pass API server count to each process (#23717) · 6c117cff
Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
6c117cff

[gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent... · 6d8246aa

Andrew Xia authored Sep 18, 2025


[gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent for streaming (#24938)
Signed-off-by: Andrew Xia <axia@meta.com>

6d8246aa

[CORE] Prompt Embeddings Support for v1 Engine (#24278) · 9a4600e4

Andrew Sansom authored Sep 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9a4600e4

18 Sep, 2025 6 commits
- [V0 Deprecation] Remove AsyncLLMEngine (#25025) · e19bce40
  Woosuk Kwon authored Sep 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e19bce40
- [Docs] Fix warnings in mkdocs build (continued) (#25163) · b419937c
  Hyogeun Oh (오효근) authored Sep 19, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  b419937c
- feat(api): Return 503 on /health when engine is dead (#24897) · 67244c86
  dongbo910220 authored Sep 18, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  67244c86
- [Frontend] Support setting logprobs to -1 (#25031) · cc935fdd
  Chauncey authored Sep 18, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  cc935fdd
- [Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89
  Aaron Pham authored Sep 18, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  29283e89
- Mark prompt logprobs as incompatible with prompt embeds at API level (#25077) · bec060fd
  Andrew Sansom authored Sep 17, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  bec060fd
17 Sep, 2025 5 commits
- [gpt-oss][2] fix types for streaming (#24556) · bff2e5f1
  Andrew Xia authored Sep 17, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  bff2e5f1
- [BugFix] enable DOTALL to match multi-line tool_call parameters in... · 2b856970
  Shijun Yin authored Sep 17, 2025
```
[BugFix] enable DOTALL to match multi-line tool_call parameters in extract_tool_call_required_streaming (#24668)
Signed-off-by: Shijun Yin <shijun.yin@outlook.com>
```
  2b856970
- [Frontend] Support returning all prompt logprobs (#24956) · 544fe76b
  Chauncey authored Sep 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  544fe76b
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
- [V0 Deprecation] Remove MQLLMEngine (#25019) · 5801e497
  Woosuk Kwon authored Sep 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  5801e497
16 Sep, 2025 2 commits
- [gpt-oss][1b] streaming add item id, content id (#24788) · f4d6eb95
  Andrew Xia authored Sep 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  f4d6eb95
- [Bugfix] remove duplicate tokens streamed in required tool choice streaming (#23312) · 68dbde5d
  Cheng Kuan Yong Jason authored Sep 16, 2025
```
Signed-off-by: Jason Cheng <jasoncky96@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  68dbde5d
15 Sep, 2025 2 commits
- [gpt-oss][1a] create_responses stream outputs BaseModel type, api server is SSE still (#24759) · 73df49ef
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  73df49ef
- [gpt-oss] Add IncompleteDetails to ResponsesRepsonse (#24561) · 25aba2b6
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  25aba2b6
12 Sep, 2025 2 commits
- [Bugfix][Frontend] Fix `--enable-log-outputs` does not match the documentation (#24626) · 684b6870
  Kebe authored Sep 13, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  684b6870
- [Doc]: fix typos in various files (#24726) · bcb06d7b
  Didier Durand authored Sep 12, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  bcb06d7b
11 Sep, 2025 2 commits
- Fix model name included in responses (#24663) · c1eda615
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c1eda615
- [Doc]: fixing doc typos (#24635) · e2b1f863
  Didier Durand authored Sep 11, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  e2b1f863
10 Sep, 2025 2 commits
- fix some typos (#24167) · 3144d902
  co63oc authored Sep 10, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  3144d902
- Consolidate rendering parameters into RenderConfig dataclass (#24543) · 77f62613
  Flora Feng authored Sep 10, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  77f62613
09 Sep, 2025 4 commits

Extend renderer with embedding support and integrate completion endpoint (#24405) · 15cb047e
Flora Feng authored Sep 09, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
15cb047e
[gpt-oss] Validate gpt-oss python tool during initialization (#23856) · 1116590b
Chen Zhang authored Sep 09, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
1116590b
[doc] update `vllm serve` cli args documentation (#24329) · 13b89bd8
cjackal authored Sep 09, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
13b89bd8

[gpt-oss] Harmony changes with container tool support (#23386) · 170129eb

zhiweiz authored Sep 08, 2025


Signed-off-by: zhiweiz <zhiweiz@fb.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: zhiweiz <zhiweiz@fb.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

170129eb

08 Sep, 2025 2 commits

[Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449) · 01dfb5e9

Chenheli Hua authored Sep 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

01dfb5e9

[Doc]: fix typos in Python comments (#24417) · f4962a6d
Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
f4962a6d

07 Sep, 2025 1 commit
- Add renderer-based prompt processing for embedding and classification endpoints (#24356) · 0661cb9d
  Flora Feng authored Sep 07, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  0661cb9d
06 Sep, 2025 3 commits
- [Frontend][Responses API] Support reporting tool output tokens and fix... · a3645ed9
  Ye (Charlotte) Qi authored Sep 06, 2025
```
[Frontend][Responses API] Support reporting tool output tokens and fix reasoning token count (#24285)
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a3645ed9
- [Fix] [gpt-oss] fix non-tool calling path for chat completion (#24324) · fb691ee4
  Aaron Pham authored Sep 06, 2025
  
  fb691ee4
- [Doc]: fix typos in Python comments (#24294) · 35bf1938
  Didier Durand authored Sep 06, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  35bf1938
05 Sep, 2025 1 commit
- [gpt-oss] tool parser supports for /chat/completions [1/n] (#22386) · c29fb540
  Aaron Pham authored Sep 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c29fb540
04 Sep, 2025 4 commits
- [Frontend] Skip unnecessary detokenization when token_id is requested (#24236) · 65e03893
  Nicolò Lucchesi authored Sep 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  65e03893
- [Feature][Response API] Add streaming support for non-harmony (#23741) · 8f423e5f
  Kebe authored Sep 04, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  8f423e5f
- [Refactor] Introduce basic Renderer for completion-style request (#24010) · 712b273f
  Flora Feng authored Sep 03, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  712b273f
- [Feature][Responses API]Support MCP tools with streaming mode + background mode (#23927) · a38f8bd5
  wuhang authored Sep 04, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  a38f8bd5
03 Sep, 2025 1 commit
- Support add_generation_prompt in embeddings endpoint with chat request (#23931) · 28f350e1
  Jakub Smid authored Sep 03, 2025
```
Signed-off-by: biba10 <jaksmid@seznam.cz>
```
  28f350e1