Commits · 80f8af4b2fadf85403290a38c8ae77f01b6b5378 · OpenDAS / vllm_cscc

04 Dec, 2025 1 commit

[Frontend] Fixes anthropic /v1/messages streaming not containing input_tokens... · fca3f466

Benjamin Bartels authored Dec 04, 2025


[Frontend] Fixes anthropic /v1/messages streaming not containing input_tokens on first chunk (#29971)
Signed-off-by: bbartels <benjamin@bartels.dev>

fca3f466

03 Dec, 2025 2 commits
- [Refactor] [1/N] to simplify the vLLM serving architecture (#28040) · 3f42b05f
  Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  3f42b05f
- [responsesAPI] support input output messages for non harmony models (#29549) · 3a775148
  Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  3a775148
02 Dec, 2025 3 commits

[responsesAPI][3] ResponsesParser to set up non harmony MCP (#29413) · 52cb349f
Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
52cb349f

[Multimodal][Core] Optimize multimodal preprocessing cache by hashing image... · 60c3d413

ImaGoodFella authored Dec 02, 2025


[Multimodal][Core] Optimize multimodal preprocessing cache by hashing image bytes instead of pixel values (#29621)
Signed-off-by: Rahul Steiger <rasteiger@ethz.ch>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

60c3d413

[Chore] Move tokenizer initialization methods (#29793) · 653591d5
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
653591d5

01 Dec, 2025 4 commits
- [Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209) · 092bb73b
  sangbumlikeagod authored Dec 02, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
```
  092bb73b
- [Misc] Unify tokenizer registration (#29767) · f0a28bf6
  Cyrus Leung authored Dec 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a28bf6
- [Frontend] Add tool filtering support to ToolServer (#29224) · 014ece97
  daniel-salib authored Dec 01, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  014ece97
- [Frontend] Resettle pooling entrypoints (#29634) · 62de4f42
  wang.yuqi authored Dec 01, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  62de4f42
29 Nov, 2025 4 commits
- [Bugfix] Revert test_tokenization.py (#29729) · b9d0504a
  Jee Jee Li authored Nov 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b9d0504a
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
- [LoRA] Cleanup LoRA unused code (#29611) · 39e63dec
  Jee Jee Li authored Nov 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  39e63dec
- [Bugfix] Fix wrong mock attribute (#29704) · b2c50eda
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b2c50eda
28 Nov, 2025 1 commit
- [Chore] Rename `Processor` to `InputProcessor` (#29682) · 8d9338fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9338fa
27 Nov, 2025 1 commit
- [CI] Add batched audios Whisper test (#29308) · e5a621b7
  Nicolò Lucchesi authored Nov 27, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  e5a621b7
25 Nov, 2025 1 commit
- [Metrics] Scheduled removal of deprecated metrics (#29330) · 9cf4edae
  Mark McLoughlin authored Nov 25, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  9cf4edae
24 Nov, 2025 2 commits

[Tests] Verify gpt_oss package is installed in harmony tests (#29336) · 84371daf
Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
84371daf

[Bugfix] properly handle nested json with llama3 tool parser (#27701) · 656516c3

Aydin Abiar authored Nov 24, 2025

Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Signed-off-by: Aydin Abiar <62435714+Aydin-ab@users.noreply.github.com>
Co-authored-by: Aydin Abiar <aydin@anyscale.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

656516c3

22 Nov, 2025 1 commit

[responsesAPI] parse reasoning item input (#28248) · 742e9ff6

Andrew Xia authored Nov 21, 2025


Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

742e9ff6

18 Nov, 2025 3 commits
- [chore] Move the rest of wikimedia url to S3 (#28921) · c64c0b78
  Kevin H. Luu authored Nov 18, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c64c0b78
- [CI/Build] Replace wikipedia url with local server ones (#28908) · 896e41ae
  Isotr0py authored Nov 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  896e41ae
- [Bugfix] Fix wrong CLI defaults for dynamic `SchedulerConfig` fields (#28872) · bf9e1e87
  Cyrus Leung authored Nov 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bf9e1e87
14 Nov, 2025 1 commit

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

13 Nov, 2025 1 commit
- [Frontend] split append tool output (#28333) · 7c38ed0f
  Andrew Xia authored Nov 12, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  7c38ed0f
12 Nov, 2025 1 commit
- [[V0 deprecation]]Remove VLLM_USE_V1 env (#28204) · e1710393
  wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  e1710393
08 Nov, 2025 1 commit
- `reasoning_content` -> `reasoning` (#27752) · d9ab1ad9
  Harry Mellor authored Nov 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d9ab1ad9
07 Nov, 2025 1 commit

[CI/Build] Loosen STT LoRA Translate Check (Flaky Test) (#28247) · e70fbc59

Alex Brooks authored Nov 06, 2025


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Signed-off-by: Alex Brooks <alex.brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

e70fbc59

05 Nov, 2025 2 commits
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
- [Model, Core] Support Granite Speech & LoRA for STT (#24455) · b7cbc254
  Alex Brooks authored Nov 05, 2025
  
  b7cbc254
03 Nov, 2025 1 commit
- Add ORCA endpoint load metrics support (#24905) · ba464e6a
  Misha Efimov authored Nov 03, 2025
```
Signed-off-by: Misha Efimov <mef@google.com>
```
  ba464e6a
02 Nov, 2025 1 commit
- [CI/Build] Fix flaky test_transcription_validation.py::test_basic_audio_gemma (#27924) · 758ea2e9
  Ben Browning authored Nov 01, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  758ea2e9
01 Nov, 2025 1 commit
- Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
  Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
  1e88fb75
30 Oct, 2025 1 commit
- [EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) · a2981c42
  cong-meta authored Oct 30, 2025
```
Co-authored-by: Cong Chen <prowindy@gmail.com>
```
  a2981c42
29 Oct, 2025 2 commits

[Core] Exposing engine sleep & wake_up state as prometheus metrics (#24176) · 1da3309a
Braulio Dumba authored Oct 29, 2025
```
Signed-off-by: Braulio Dumba <Braulio.Dumba@ibm.com>
```
1da3309a

[Frontend] [gpt-oss] Mcp type bug (#27689) · ab2eb27b

Alec S authored Oct 29, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

ab2eb27b

28 Oct, 2025 1 commit
- [Bugfix] In LongRoPE, decide short vs long based on max_model_len (#27431) · 44b5ce95
  Matthew Bonanni authored Oct 28, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  44b5ce95
27 Oct, 2025 3 commits
- [gpt-oss][2/N] Support input_messages in responsesRequest (#26962) · 53a56e65
  Andrew Xia authored Oct 27, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  53a56e65
- [Chore]: Stream tokens vs characters in tool call parser tests (#26513) · 3b96f85c
  Ben Browning authored Oct 27, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  3b96f85c
- [Bugfix] Fixed when return_token_ids=False, the first event still contains... · a4fc2189
  Chauncey authored Oct 27, 2025
```
[Bugfix] Fixed when return_token_ids=False, the first event still contains prompt_token_ids. (#27561)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  a4fc2189