Commits · 3567816932e674abce3f44ceb0aff03f73b5aaff · OpenDAS / vllm_cscc

24 Oct, 2025 2 commits
- [Refactor] move tool parsing logic from protocol.py to the tool parser (#27383) · 35678169
  Chauncey authored Oct 24, 2025
```
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  35678169
- [Bugfix] Fix Pydantic union resolution for ResponseFunctionToolCall in Responses API (#26706) · 07447554
  strinczer authored Oct 24, 2025
```
Signed-off-by: Shai Trinczer <strinczer@icloud.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  07447554
23 Oct, 2025 1 commit

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973) · 3fa2c121

wang.yuqi authored Oct 23, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>

3fa2c121

22 Oct, 2025 1 commit

[Frontend][3/N] Improve all pooling task | Support binary embedding response (#27066) · 1f633b86

wang.yuqi authored Oct 22, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1f633b86

18 Oct, 2025 1 commit

[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515) · 7c572544

Hanchenli authored Oct 17, 2025


Signed-off-by: Hanchenli <lihanc2002@gmail.com>
Signed-off-by: Hanchenli <61769611+Hanchenli@users.noreply.github.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wei Wei <wwei6@meta.com>
Co-authored-by: Wei Wei <weiweinpu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

7c572544

17 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
15 Oct, 2025 1 commit
- [Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
  wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f54f8512
14 Oct, 2025 2 commits
- [frontend][gptoss] Add per turn stats into Harmony Context (#25061) · 0512c04a
  Ye Hu authored Oct 14, 2025
```
Signed-off-by: lacora <hyelacora@gmail.com>
Co-authored-by: Ye Hu <yehu@fb.com>
```
  0512c04a
- fix: response_format for completion (#23212) · 9d696492
  Nan Qin authored Oct 14, 2025
```
Signed-off-by: Nan2018 <qinnanjoshua@gmail.com>
```
  9d696492
13 Oct, 2025 3 commits

[ResponseAPI] Further polish message serialization and unit tests (#26728) · 35bc22f2
Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
35bc22f2

[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64... · d2a79385

wang.yuqi authored Oct 14, 2025


[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64 (Still uses fp32 by default). (#26414)
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

d2a79385

[ResponseAPI] Simplify input/output message serialization (#26620) · 4073c82c
Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
4073c82c

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
07 Oct, 2025 1 commit
- [responsesAPI][bugfix] serialize harmony messages (#26185) · 185d8ed4
  Andrew Xia authored Oct 07, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  185d8ed4
06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
30 Sep, 2025 1 commit

[gpt-oss] use vLLM instead of openai types for streaming (#25186) · 5db1870b

Andrew Xia authored Sep 30, 2025


Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>

5db1870b

25 Sep, 2025 1 commit

Add backward compatibility for `guided_...` API (#25615) · 70fbdb26

Harry Mellor authored Sep 25, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

70fbdb26

19 Sep, 2025 3 commits

[Frontend] Responses API messages out, just harmony for now (#24985) · e69e0b8b

Alec S authored Sep 19, 2025


Signed-off-by: Alec Solder <alecs@fb.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

e69e0b8b

[gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent... · 6d8246aa

Andrew Xia authored Sep 18, 2025


[gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent for streaming (#24938)
Signed-off-by: Andrew Xia <axia@meta.com>

6d8246aa

[CORE] Prompt Embeddings Support for v1 Engine (#24278) · 9a4600e4

Andrew Sansom authored Sep 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9a4600e4

18 Sep, 2025 2 commits

[Frontend] Support setting logprobs to -1 (#25031) · cc935fdd
Chauncey authored Sep 18, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
cc935fdd

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 2 commits
- [gpt-oss][2] fix types for streaming (#24556) · bff2e5f1
  Andrew Xia authored Sep 17, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  bff2e5f1
- [Frontend] Support returning all prompt logprobs (#24956) · 544fe76b
  Chauncey authored Sep 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  544fe76b
15 Sep, 2025 1 commit
- [gpt-oss] Add IncompleteDetails to ResponsesRepsonse (#24561) · 25aba2b6
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  25aba2b6
12 Sep, 2025 1 commit
- [Doc]: fix typos in various files (#24726) · bcb06d7b
  Didier Durand authored Sep 12, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  bcb06d7b
09 Sep, 2025 1 commit
- Extend renderer with embedding support and integrate completion endpoint (#24405) · 15cb047e
  Flora Feng authored Sep 09, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  15cb047e
06 Sep, 2025 1 commit

[Frontend][Responses API] Support reporting tool output tokens and fix... · a3645ed9

Ye (Charlotte) Qi authored Sep 06, 2025


[Frontend][Responses API] Support reporting tool output tokens and fix reasoning token count (#24285)
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>

a3645ed9

03 Sep, 2025 1 commit
- Support add_generation_prompt in embeddings endpoint with chat request (#23931) · 28f350e1
  Jakub Smid authored Sep 03, 2025
```
Signed-off-by: biba10 <jaksmid@seznam.cz>
```
  28f350e1
01 Sep, 2025 4 commits
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
- [docs][misc] IOProcessor plugins fixes (#24046) · cf91a89d
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  cf91a89d
- [Frontend] Gemma3n audio `transcriptions`/`translations` endpoint (#23735) · d46934b2
  Nicolò Lucchesi authored Sep 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  d46934b2
- [Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  1cb39dbc
30 Aug, 2025 1 commit

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

26 Aug, 2025 1 commit
- feat: add usage to TranscriptionResponse (text and json response_format) (#23576) · ebd5a77b
  Guillaume Calmettes authored Aug 26, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  ebd5a77b
21 Aug, 2025 1 commit
- [Feature][Responses API] Support logprobs(non-stream) (#23319) · 5368f768
  Kebe authored Aug 22, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  5368f768
20 Aug, 2025 1 commit
- [Fix] correct tool_id for kimi-k2 when use tool_choice=required (#21259) · 582bbe6b
  bigmoyan authored Aug 21, 2025
```
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  582bbe6b
19 Aug, 2025 1 commit

Add return_token_ids parameter to OpenAI API endpoints (#22587) · 24f4d1a2

Yuge Zhang authored Aug 20, 2025


Signed-off-by: Yuge Zhang <scottyugochang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

24f4d1a2