Commits · b9d0504a366b667f8160174af1251bf8da9f006e · OpenDAS / vllm_cscc

29 Nov, 2025 5 commits
- [Bugfix] Revert test_tokenization.py (#29729) · b9d0504a
  Jee Jee Li authored Nov 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b9d0504a
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
- [LoRA] Cleanup LoRA unused code (#29611) · 39e63dec
  Jee Jee Li authored Nov 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  39e63dec
- [Frontend] Perform offline path replacement to `tokenizer` (#29706) · 762a4a6c
  Tsukasa OI authored Nov 29, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  762a4a6c
- [Bugfix] Fix wrong mock attribute (#29704) · b2c50eda
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b2c50eda
28 Nov, 2025 1 commit
- [Chore] Rename `Processor` to `InputProcessor` (#29682) · 8d9338fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9338fa
27 Nov, 2025 1 commit
- [CI] Add batched audios Whisper test (#29308) · e5a621b7
  Nicolò Lucchesi authored Nov 27, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  e5a621b7
25 Nov, 2025 3 commits
- [responsesAPI][2] parse ResponseFunctionToolCallOutputItem (#29383) · b07555d2
  Andrew Xia authored Nov 25, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  b07555d2
- [CI] Resettle pooling entrypoints tests. (#29370) · 7a80b018
  wang.yuqi authored Nov 25, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  7a80b018
- [Metrics] Scheduled removal of deprecated metrics (#29330) · 9cf4edae
  Mark McLoughlin authored Nov 25, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  9cf4edae
24 Nov, 2025 2 commits

[Tests] Verify gpt_oss package is installed in harmony tests (#29336) · 84371daf
Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
84371daf

[Bugfix] properly handle nested json with llama3 tool parser (#27701) · 656516c3

Aydin Abiar authored Nov 24, 2025

Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Signed-off-by: Aydin Abiar <62435714+Aydin-ab@users.noreply.github.com>
Co-authored-by: Aydin Abiar <aydin@anyscale.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

656516c3

22 Nov, 2025 2 commits

[responsesAPI] parse reasoning item input (#28248) · 742e9ff6

Andrew Xia authored Nov 21, 2025


Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

742e9ff6

[CI/Build][AMD] Enable Entrypoints Integration Test (Pooling) to run without error on ROCm (#29212) · 6f403501
rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
6f403501

21 Nov, 2025 1 commit
- [Core] Add audio_embeds support to chat completions (#29059) · 07304149
  jeremyteboul authored Nov 20, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
  07304149
18 Nov, 2025 3 commits
- [chore] Move the rest of wikimedia url to S3 (#28921) · c64c0b78
  Kevin H. Luu authored Nov 18, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c64c0b78
- [CI/Build] Replace wikipedia url with local server ones (#28908) · 896e41ae
  Isotr0py authored Nov 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  896e41ae
- [Bugfix] Fix wrong CLI defaults for dynamic `SchedulerConfig` fields (#28872) · bf9e1e87
  Cyrus Leung authored Nov 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bf9e1e87
14 Nov, 2025 2 commits

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

[Frontend] Added chat-style multimodal support to /classify. (#27516) · 360bd876

Srreyansh Sethi authored Nov 14, 2025


Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: vnadathur <glvikramn@gmail.com>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

360bd876

13 Nov, 2025 2 commits

[Frontend][responsesAPI][1/n] convert responses API tool input to chat... · 1a0b157a

Andrew Xia authored Nov 12, 2025


[Frontend][responsesAPI][1/n] convert responses API tool input to chat completions tool format (#28231)
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

1a0b157a

[Frontend] split append tool output (#28333) · 7c38ed0f
Andrew Xia authored Nov 12, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
7c38ed0f

12 Nov, 2025 1 commit
- [[V0 deprecation]]Remove VLLM_USE_V1 env (#28204) · e1710393
  wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  e1710393
11 Nov, 2025 1 commit

[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session... · bca74e32

Zuyi Zhao authored Nov 10, 2025


[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892)
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

bca74e32

08 Nov, 2025 1 commit
- `reasoning_content` -> `reasoning` (#27752) · d9ab1ad9
  Harry Mellor authored Nov 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d9ab1ad9
07 Nov, 2025 1 commit

[CI/Build] Loosen STT LoRA Translate Check (Flaky Test) (#28247) · e70fbc59

Alex Brooks authored Nov 06, 2025


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Signed-off-by: Alex Brooks <alex.brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

e70fbc59

05 Nov, 2025 2 commits
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
- [Model, Core] Support Granite Speech & LoRA for STT (#24455) · b7cbc254
  Alex Brooks authored Nov 05, 2025
  
  b7cbc254
03 Nov, 2025 1 commit
- Add ORCA endpoint load metrics support (#24905) · ba464e6a
  Misha Efimov authored Nov 03, 2025
```
Signed-off-by: Misha Efimov <mef@google.com>
```
  ba464e6a
02 Nov, 2025 2 commits
- Fix(llm): Abort orphaned requests when llm.chat() batch fails Fixes #26081 (#27420) · 0ce743f4
  Vensen authored Nov 03, 2025
```
Signed-off-by: vensenmu <vensenmu@gmail.com>
```
  0ce743f4
- [CI/Build] Fix flaky test_transcription_validation.py::test_basic_audio_gemma (#27924) · 758ea2e9
  Ben Browning authored Nov 01, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  758ea2e9
01 Nov, 2025 1 commit
- Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
  Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
  1e88fb75
30 Oct, 2025 2 commits
- [EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) · a2981c42
  cong-meta authored Oct 30, 2025
```
Co-authored-by: Cong Chen <prowindy@gmail.com>
```
  a2981c42
- [Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f
  wang.yuqi authored Oct 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4464723f
29 Oct, 2025 2 commits

[Core] Exposing engine sleep & wake_up state as prometheus metrics (#24176) · 1da3309a
Braulio Dumba authored Oct 29, 2025
```
Signed-off-by: Braulio Dumba <Braulio.Dumba@ibm.com>
```
1da3309a

[Frontend] [gpt-oss] Mcp type bug (#27689) · ab2eb27b

Alec S authored Oct 29, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>