Commits · ce0e9dbd43e798d5b27a2a379aa4e13d91a279e3 · OpenDAS / vllm_cscc

26 Aug, 2025 2 commits
- [CI/Build] Fix typo in #23561 (#23616) · ce0e9dbd
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ce0e9dbd
- [CI/Build] Use vLLM client's user agent to fetch images (#23561) · 6fd45e7b
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6fd45e7b
24 Aug, 2025 1 commit
- (Misc): add missing test for zero truncation size. (#23457) · 5e021b49
  TeeKen Lau authored Aug 24, 2025
```
Signed-off-by: teekenl <teekenlau@gmail.com>
```
  5e021b49
23 Aug, 2025 1 commit
- fix(tests): Correct unreachable assertion in truncation test (#23425) · d9a55204
  Aziz authored Aug 23, 2025
```
Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
```
  d9a55204
22 Aug, 2025 1 commit
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
20 Aug, 2025 3 commits
- [Fix] correct tool_id for kimi-k2 when use tool_choice=required (#21259) · 582bbe6b
  bigmoyan authored Aug 21, 2025
```
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  582bbe6b
- [Fix] fix offline env use local mode path (#22526) · 38217877
  rongfu.leng authored Aug 20, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  38217877
- [BugFix] Fix stuck stats/metrics after requests are aborted (#22995) · 8fd92092
  Nick Hill authored Aug 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8fd92092
19 Aug, 2025 3 commits
- fix: use cache_salt for gpt-oss (#23186) · 80141bbf
  Marko Rosenmueller authored Aug 19, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  80141bbf
- [Frontend] Add `/collective_rpc` API endpoint (#23075) · f7cf5b51
  22quinn authored Aug 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  f7cf5b51
- Add return_token_ids parameter to OpenAI API endpoints (#22587) · 24f4d1a2
  Yuge Zhang authored Aug 20, 2025
```
Signed-off-by: Yuge Zhang <scottyugochang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  24f4d1a2
16 Aug, 2025 3 commits

[Flaky CI] Increase timeout tolerance for... · 3253ae76

Michael Goin authored Aug 16, 2025


[Flaky CI] Increase timeout tolerance for test_mp_crash_detection+test_default_mm_lora_chat_completions (#23028)
Signed-off-by: mgoin <mgoin64@gmail.com>

3253ae76

[Frontend] Added support for HermesToolParser for models without special tokens (#16890) · 68373d31
Woonggi Min authored Aug 17, 2025
```
Signed-off-by: minpeter <kali2005611@gmail.com>
```
68373d31

[BugFix] Add support for loading prompt embeds tensors serialized on... · 78863f8c

Andrew Sansom authored Aug 16, 2025


[BugFix] Add support for loading prompt embeds tensors serialized on unavailable devices and sparse tensors (#22962)
Signed-off-by: Andrew Sansom <andrew@protopia.ai>

78863f8c

15 Aug, 2025 1 commit
- [CI] Speed up Whisper tests by reusing server (#22859) · 8a87cd27
  Michael Goin authored Aug 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8a87cd27
14 Aug, 2025 3 commits
- [CI] Re-enable transcriptions `test_long_audio_request` (#22890) · 540d54ca
  Nicolò Lucchesi authored Aug 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  540d54ca
- [CI] remove flaky v0 test (#22864) · a353bd08
  Robert Shaw authored Aug 14, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  a353bd08
- [CI][Entrypoints]: add filter to generation to filter out invalid tool calls (#22826) · b6af24fb
  Will Eaton authored Aug 13, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  b6af24fb
13 Aug, 2025 2 commits

[Frontend] Add chunked processing to handle long inputs in embedding models (#22280) · 653124bd

Kdump authored Aug 13, 2025


Signed-off-by: x22x22 <wadeking@qq.com>
Signed-off-by: Kdump <rootshellexp@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

653124bd

[V0 Deprecation] Remove multi-step scheduling (#22138) · 71683ca6

Woosuk Kwon authored Aug 12, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>

71683ca6

12 Aug, 2025 3 commits
- [CI Failure] Use float32 for tests/entrypoints/openai/test_audio.py (#22686) · ea1292ad
  Michael Goin authored Aug 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ea1292ad
- Re-enable Xet on TPU tests now that `hf_xet` has been updated (#22666) · 839ab003
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  839ab003
- [gpt-oss] Add test for response API + harmony (but skipped) (#22554) · 1891a265
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1891a265
11 Aug, 2025 3 commits
- [Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930) · 84cf78ac
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  84cf78ac
- Support token_type_ids in V1 with less code changes (#21985) · 39052dbc
  Maximilien de Bayser authored Aug 11, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  39052dbc
- [CI/Build] Fix tensorizer test for load_format change (#22583) · b799f4b9
  22quinn authored Aug 10, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  b799f4b9
08 Aug, 2025 2 commits
- Drop flaky test_healthcheck_response_time (#22539) · 311d8756
  Russell Bryant authored Aug 08, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  311d8756
- [Frontend] Add unix domain socket support (#18097) · baece8c3
  yyweiss authored Aug 09, 2025
```
Signed-off-by: <yyweiss@gmail.com>
Signed-off-by: yyw <yyweiss@gmail.com>
```
  baece8c3
07 Aug, 2025 1 commit
- [Frontend] Update OpenAI error response to upstream format (#22099) · 37066185
  Moritz Sanft authored Aug 07, 2025
```
Signed-off-by: Moritz Sanft <58110325+msanft@users.noreply.github.com>
```
  37066185
05 Aug, 2025 1 commit
- [Model] Pooling model activation supports per request control by PoolingParams (#20538) · 586f2867
  wang.yuqi authored Aug 05, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  586f2867
02 Aug, 2025 2 commits
- [Frontend] Improve error message for too many mm items (#22114) · f5d0f478
  Cyrus Leung authored Aug 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f5d0f478
- docs: remove deprecated disable-log-requests flag (#22113) · 067c34a1
  Roger Wang authored Aug 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  067c34a1
29 Jul, 2025 1 commit

[V0 deprecation] Guided decoding (#21347) · 37efc63b

Reza Barazesh authored Jul 29, 2025

Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

37efc63b

28 Jul, 2025 3 commits

[Bugfix] Improve JSON extraction in LlamaToolParser (#19024) · 9ace2eaf
Keyang Ru authored Jul 28, 2025
```
Signed-off-by: keru <keyang.ru@oracle.com>
Co-authored-by: keru <keyang.ru@oracle.com>
```
9ace2eaf

[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named... · 7656cf4c

Hongsheng Liu authored Jul 28, 2025


[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named function calling when Thinking is disabled (#21573)
Signed-off-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: wangzi <3220100013@zju.edu.cn>

7656cf4c

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

25 Jul, 2025 2 commits
- Add support for Prithvi in Online serving mode (#21518) · e189b50f
  mgazz authored Jul 25, 2025
```
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e189b50f
- [Frontend] `run-batch` supports V1 (#21541) · 34ddcf9f
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34ddcf9f
24 Jul, 2025 2 commits
- [TPU][TEST] HF_HUB_DISABLE_XET=1 the test 3. (#21539) · 07d80d7b
  QiliangCui authored Jul 24, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  07d80d7b
- Add think chunk (#21333) · 6d8d0a24
  Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6d8d0a24