Commits · 36ede4598949092be3b61418a5141cbe730d1098 · OpenDAS / vllm_cscc · GitLab

30 Jul, 2025 36 commits
- Reduce time wasted in GitHub Actions using `concurrency` (#21919) · 36ede459
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  36ede459
- [CI/Build] Only run markdownlint in CI (#21892) · 0e40b260
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0e40b260
- [Test] Add Benchmark and Unit Test for `per_token_group_quant` (#21860) · 0271c2ff
  Wentao Ye authored Jul 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0271c2ff
- [misc] skip p2p check by default (#21904) · e91d3c9c
  youkaichao authored Jul 30, 2025
  
  e91d3c9c
- [Feature] Support multiple api keys in server (#18548) · bf668b5b
  Yan Pashkovsky authored Jul 30, 2025
```
Signed-off-by: Yan Pashkovsky <yanp.bugz@gmail.com>
```
  bf668b5b
- [Bugfix] we should use metavar is not choices (#21902) · da3e0bd6
  rongfu.leng authored Jul 30, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  da3e0bd6
- [Doc] Remove vLLM prefix and add citation for PagedAttention (#21910) · fcfd1eb9
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fcfd1eb9
- [Feature][EPLB] Add eplb support for Qwen3 (#20815) · d979dd6b
  aladerran authored Jul 30, 2025
```
Signed-off-by: aladerran <aladerran@gmail.com>
```
  d979dd6b
- [Hardware][CPU] Build fix for ARM without BF16 (#21848) · b876860c
  Eric Curtin authored Jul 30, 2025
```
Signed-off-by: Eric Curtin <ecurtin@redhat.com>
```
  b876860c
- Add @patrickvonplaten as maintainer of mistral's related files. (#21928) · 13986365
  Patrick von Platen authored Jul 30, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  13986365
- [Docs] Fix the example code of streaming chat completions in reasoning (#21825) · 5c8fe389
  Hongsheng Liu authored Jul 30, 2025
```
Signed-off-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: Zi Wang <66560864+BruceW-07@users.noreply.github.com>
```
  5c8fe389
- [Doc] Update partial support (#21916) · 5bbaf492
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5bbaf492
- [benchmark] add max-concurrency in result table (#21095) · 533db093
  Peter Pan authored Jul 30, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  533db093
- [Model] Remove DSV2 unused code (#21903) · fc91da54
  Jee Jee Li authored Jul 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fc91da54
- [Tests] Fixing bug inside MultiModalProfiler. (#21842) · 54779523
  Varun Vinayak Shenoy authored Jul 30, 2025
```
Signed-off-by: Varun Shenoy <varun.vinayak.shenoy@oracle.com>
```
  54779523
- [CI] rollback lint-and-deploy pipeline using amd machine (#21912) · 30ef30ed
  Kebe authored Jul 30, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  30ef30ed
- [Doc] Update Intern-S1 info (#21908) · 02f82fe4
  Jee Jee Li authored Jul 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  02f82fe4
- [Misc] Remove redundant config definitions (#21891) · 2ca5f82c
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2ca5f82c
- Update vLLM Benchmark Suite for Xeon based on 0.9.2 release (#21486) · 6f8d2618
  Louie Tsai authored Jul 29, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
```
  6f8d2618
- [Docs] Expand introduction to Ray in Multi-node deployment section (#21584) · 4cd7fe6c
  Ricardo Decal authored Jul 29, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  4cd7fe6c
- [CI/Build] Fix pre-commit failure in docs (#21897) · 16f32505
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  16f32505
- Add @sighingnow as maintainer of qwen's related files. (#21895) · e3bc17ce
  Tao He authored Jul 30, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  e3bc17ce
- [XPU] use `ZE_AFFINITY_MASK` for device select on xpu (#21815) · 05cbbe20
  Kunshang Ji authored Jul 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  05cbbe20
- [Frontend] Add LLM.reward specific to reward models (#21720) · 65f311ce
  wang.yuqi authored Jul 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  65f311ce
- [Perf] Using `__nv_fp8_e4m3` instead of `c10::e4m3` for `per_token_group_quant` (#21867) · 1b0a1555
  Wentao Ye authored Jul 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1b0a1555
- [Bugfix] Actually disable processing cache when API server is scaled out (#21839) · 44bc46da
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44bc46da
- [Bugfix] Fix comment typo of get_num_common_prefix_blocks() (#21827) · b7b23da4
  MingzhenHan authored Jul 30, 2025
```
Signed-off-by: MingzhenHan <hanmingzhen2002@outlook.com>
```
  b7b23da4
- [Bugfix] Fix shape mismatch assertion error when loading Gemma3n model with... · fdde1822
  Areeb Syed authored Jul 30, 2025
```
[Bugfix] Fix shape mismatch assertion error when loading Gemma3n model with BitsAndBytes quantization (#21808)
Signed-off-by: sydarb <areebsyed237@gmail.com>
```
  fdde1822
- Expose PyTorch profiler configuration to environment variables (#21803) · b917da44
  Csrayz authored Jul 30, 2025
```
Signed-off-by: Csrayz <33659823+Csrayz@users.noreply.github.com>
```
  b917da44
- [Docs] Update docker.md with HF_TOKEN, new model, and podman fix (#21856) · fb58e3a6
  Michael Goin authored Jul 29, 2025
  
  fb58e3a6
- [DOC] Fix path of v1 related figures (#21868) · 76080cff
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  76080cff
- [Docs] Switch to better markdown linting pre-commit hook (#21851) · ba5c5e54
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba5c5e54
- [v1][attention] Support Hybrid Allocator + FlashInfer (#21412) · 555e7225
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  555e7225
- [Bugfix] Correct max tokens for non-contiguous embeds (#21798) · 0e36abf9
  milesial authored Jul 29, 2025
```
Signed-off-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
Co-authored-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
```
  0e36abf9
- [ci] mark blackwell test optional for now (#21878) · 452b2a31
  Simon Mo authored Jul 29, 2025
  
  452b2a31
- [ci] add b200 test placeholder (#21866) · 0d0cc9e1
  Simon Mo authored Jul 29, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  0d0cc9e1
29 Jul, 2025 4 commits
- [BugFix] Fix interleaved sliding window not set for Gemma3n (#21863) · 9266d980
  Yong Hoon Shin authored Jul 29, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  9266d980
- Revert "[AMD][CI/Build] Fix the AMD issue caused by inappropriate of symbol... · 176bbce1
  Gregory Shtrasberg authored Jul 29, 2025
```
Revert "[AMD][CI/Build] Fix the AMD issue caused by inappropriate of symbol exposure (#21647)" (#21850)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  176bbce1
- docker: docker-aware precompiled wheel support (#21127) · a1873db2
  Doug Smith authored Jul 29, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  a1873db2
- Add `flashinfer_python` to CUDA wheel requirements (#21389) · a33ea28b
  Michael Goin authored Jul 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a33ea28b