Commits · c4ed78b14f7f63cfa65722ad21deffe964441fd2 · OpenDAS / vllm_cscc

02 Sep, 2025 2 commits

[Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
24177984

[CI]: reduce HTTP calls inside entrypoints openai tests (#23646) · ce30dca5

Aziz authored Sep 02, 2025


Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
Signed-off-by: Aziz <azizbenothman76@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

ce30dca5

01 Sep, 2025 1 commit
- [Frontend] Gemma3n audio `transcriptions`/`translations` endpoint (#23735) · d46934b2
  Nicolò Lucchesi authored Sep 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  d46934b2
30 Aug, 2025 2 commits

[Bugfix] Fix test_lora_resolvers.py (#23984) · 628d00cd
Jee Jee Li authored Aug 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
628d00cd

[Bugfix] Fix --config arg expansion called from api_server.py (#23944) · 5b31cb17

dubejf authored Aug 30, 2025


Signed-off-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

5b31cb17

29 Aug, 2025 4 commits
- [RL][BugFix] Fix missing tokenizer error for token-in-token-out (#23904) · 4d7fe40f
  22quinn authored Aug 29, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4d7fe40f
- [Performance] V1 Classify Models E2E Performance Optimization (#23541) · d9e00dbd
  wang.yuqi authored Aug 29, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d9e00dbd
- [V0 Deprecation] Remove pooling model support in V0 (#23434) · 2554b27b
  Maximilien de Bayser authored Aug 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2554b27b
- [tests] Improve speed and reliability of test_transcription_api_correctness (#23854) · c8b3b299
  Russell Bryant authored Aug 29, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c8b3b299
27 Aug, 2025 1 commit
- [gpt-oss] Enable unit test for response API harmony integration (#23533) · eb199516
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  eb199516
26 Aug, 2025 3 commits
- feat: add usage to TranscriptionResponse (text and json response_format) (#23576) · ebd5a77b
  Guillaume Calmettes authored Aug 26, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  ebd5a77b
- [CI/Build] Fix typo in #23561 (#23616) · ce0e9dbd
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ce0e9dbd
- [CI/Build] Use vLLM client's user agent to fetch images (#23561) · 6fd45e7b
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6fd45e7b
24 Aug, 2025 1 commit
- (Misc): add missing test for zero truncation size. (#23457) · 5e021b49
  TeeKen Lau authored Aug 24, 2025
```
Signed-off-by: teekenl <teekenlau@gmail.com>
```
  5e021b49
23 Aug, 2025 1 commit
- fix(tests): Correct unreachable assertion in truncation test (#23425) · d9a55204
  Aziz authored Aug 23, 2025
```
Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
```
  d9a55204
20 Aug, 2025 2 commits
- [Fix] correct tool_id for kimi-k2 when use tool_choice=required (#21259) · 582bbe6b
  bigmoyan authored Aug 21, 2025
```
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  582bbe6b
- [BugFix] Fix stuck stats/metrics after requests are aborted (#22995) · 8fd92092
  Nick Hill authored Aug 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8fd92092
19 Aug, 2025 3 commits
- fix: use cache_salt for gpt-oss (#23186) · 80141bbf
  Marko Rosenmueller authored Aug 19, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  80141bbf
- [Frontend] Add `/collective_rpc` API endpoint (#23075) · f7cf5b51
  22quinn authored Aug 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  f7cf5b51
- Add return_token_ids parameter to OpenAI API endpoints (#22587) · 24f4d1a2
  Yuge Zhang authored Aug 20, 2025
```
Signed-off-by: Yuge Zhang <scottyugochang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  24f4d1a2
16 Aug, 2025 3 commits

[Flaky CI] Increase timeout tolerance for... · 3253ae76

Michael Goin authored Aug 16, 2025


[Flaky CI] Increase timeout tolerance for test_mp_crash_detection+test_default_mm_lora_chat_completions (#23028)
Signed-off-by: mgoin <mgoin64@gmail.com>

3253ae76

[Frontend] Added support for HermesToolParser for models without special tokens (#16890) · 68373d31
Woonggi Min authored Aug 17, 2025
```
Signed-off-by: minpeter <kali2005611@gmail.com>
```
68373d31

[BugFix] Add support for loading prompt embeds tensors serialized on... · 78863f8c

Andrew Sansom authored Aug 16, 2025


[BugFix] Add support for loading prompt embeds tensors serialized on unavailable devices and sparse tensors (#22962)
Signed-off-by: Andrew Sansom <andrew@protopia.ai>

78863f8c

15 Aug, 2025 1 commit
- [CI] Speed up Whisper tests by reusing server (#22859) · 8a87cd27
  Michael Goin authored Aug 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8a87cd27
14 Aug, 2025 3 commits
- [CI] Re-enable transcriptions `test_long_audio_request` (#22890) · 540d54ca
  Nicolò Lucchesi authored Aug 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  540d54ca
- [CI] remove flaky v0 test (#22864) · a353bd08
  Robert Shaw authored Aug 14, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  a353bd08
- [CI][Entrypoints]: add filter to generation to filter out invalid tool calls (#22826) · b6af24fb
  Will Eaton authored Aug 13, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  b6af24fb
13 Aug, 2025 2 commits

[Frontend] Add chunked processing to handle long inputs in embedding models (#22280) · 653124bd

Kdump authored Aug 13, 2025


Signed-off-by: x22x22 <wadeking@qq.com>
Signed-off-by: Kdump <rootshellexp@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

653124bd

[V0 Deprecation] Remove multi-step scheduling (#22138) · 71683ca6

Woosuk Kwon authored Aug 12, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>

71683ca6

12 Aug, 2025 2 commits
- [CI Failure] Use float32 for tests/entrypoints/openai/test_audio.py (#22686) · ea1292ad
  Michael Goin authored Aug 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ea1292ad
- [gpt-oss] Add test for response API + harmony (but skipped) (#22554) · 1891a265
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1891a265
11 Aug, 2025 3 commits
- [Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930) · 84cf78ac
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  84cf78ac
- Support token_type_ids in V1 with less code changes (#21985) · 39052dbc
  Maximilien de Bayser authored Aug 11, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  39052dbc
- [CI/Build] Fix tensorizer test for load_format change (#22583) · b799f4b9
  22quinn authored Aug 10, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  b799f4b9
08 Aug, 2025 2 commits
- Drop flaky test_healthcheck_response_time (#22539) · 311d8756
  Russell Bryant authored Aug 08, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  311d8756
- [Frontend] Add unix domain socket support (#18097) · baece8c3
  yyweiss authored Aug 09, 2025
```
Signed-off-by: <yyweiss@gmail.com>
Signed-off-by: yyw <yyweiss@gmail.com>
```
  baece8c3
07 Aug, 2025 1 commit
- [Frontend] Update OpenAI error response to upstream format (#22099) · 37066185
  Moritz Sanft authored Aug 07, 2025
```
Signed-off-by: Moritz Sanft <58110325+msanft@users.noreply.github.com>
```
  37066185
05 Aug, 2025 1 commit
- [Model] Pooling model activation supports per request control by PoolingParams (#20538) · 586f2867
  wang.yuqi authored Aug 05, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  586f2867
02 Aug, 2025 1 commit
- docs: remove deprecated disable-log-requests flag (#22113) · 067c34a1
  Roger Wang authored Aug 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  067c34a1
29 Jul, 2025 1 commit

[V0 deprecation] Guided decoding (#21347) · 37efc63b

Reza Barazesh authored Jul 29, 2025

Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

37efc63b