Commits · 287f527f5403bb42a32136cf6c802faeb92a09ef · OpenDAS / vllm_cscc · GitLab

30 Jul, 2025 28 commits
- [Feature] Add async tensor parallelism for scaled mm (#20155) · 287f527f
  cascade authored Jul 30, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  287f527f
- [Misc] Support more collective_rpc return types (#21845) · 56bd537d
  Nick Hill authored Jul 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  56bd537d
- [TPU] Support Pathways in vLLM (#21417) · 8f0d5167
  wenxindongwork authored Jul 30, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
  8f0d5167
- feat(distributed): add `get_required_kvcache_layout` class method to kv connector api (#20433) · f4135232
  wxsm authored Jul 31, 2025
```
Signed-off-by: wxsm <wxsms@foxmail.com>
```
  f4135232
- [Bugfix] SharedStorage Connector for V1 PD multimodal (#21611) · 4904e53c
  Chenguang Zheng authored Jul 31, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
```
  4904e53c
- [CI/Build] Fix registry tests (#21934) · 004203e9
  Cyrus Leung authored Jul 31, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  004203e9
- [Bugfix] Fix TypeError in scheduler when comparing mixed request_id types (#21816) · 5c765aec
  633WHU authored Jul 30, 2025
```
Signed-off-by: chiliu <chiliu@paypal.com>
Co-authored-by: chiliu <chiliu@paypal.com>
```
  5c765aec
- Override attention metadata for fast prefill in some KV sharing setups (#21590) · ad510309
  Yong Hoon Shin authored Jul 30, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  ad510309
- [Bugfix] Fix multi-api server not working for text models (#21933) · 366f6b3a
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  366f6b3a
- [Bugfix] Fix OOM tests in initialization test (#21921) · 6e599eeb
  Isotr0py authored Jul 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  6e599eeb
- [NVIDIA] Fix Llama4 Scout FP4 functionality issues (#21499) · ff08e519
  Po-Han Huang (NVIDIA) authored Jul 30, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  ff08e519
- [Misc] Improve code readability of KVCacheManager (#21673) · 8f4a1c9a
  Ruixiang Tan authored Jul 30, 2025
```
Signed-off-by: tanruixiang <tanruixiang0104@gmail.com>
Signed-off-by: Ruixiang Tan <819464715@qq.com>
Signed-off-by: GitHub <noreply@github.com>
```
  8f4a1c9a
- [misc] skip p2p check by default (#21904) · e91d3c9c
  youkaichao authored Jul 30, 2025
  
  e91d3c9c
- [Feature] Support multiple api keys in server (#18548) · bf668b5b
  Yan Pashkovsky authored Jul 30, 2025
```
Signed-off-by: Yan Pashkovsky <yanp.bugz@gmail.com>
```
  bf668b5b
- [Bugfix] we should use metavar is not choices (#21902) · da3e0bd6
  rongfu.leng authored Jul 30, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  da3e0bd6
- [Feature][EPLB] Add eplb support for Qwen3 (#20815) · d979dd6b
  aladerran authored Jul 30, 2025
```
Signed-off-by: aladerran <aladerran@gmail.com>
```
  d979dd6b
- [benchmark] add max-concurrency in result table (#21095) · 533db093
  Peter Pan authored Jul 30, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  533db093
- [Model] Remove DSV2 unused code (#21903) · fc91da54
  Jee Jee Li authored Jul 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fc91da54
- [Misc] Remove redundant config definitions (#21891) · 2ca5f82c
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2ca5f82c
- [XPU] use `ZE_AFFINITY_MASK` for device select on xpu (#21815) · 05cbbe20
  Kunshang Ji authored Jul 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  05cbbe20
- [Frontend] Add LLM.reward specific to reward models (#21720) · 65f311ce
  wang.yuqi authored Jul 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  65f311ce
- [Bugfix] Actually disable processing cache when API server is scaled out (#21839) · 44bc46da
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44bc46da
- [Bugfix] Fix comment typo of get_num_common_prefix_blocks() (#21827) · b7b23da4
  MingzhenHan authored Jul 30, 2025
```
Signed-off-by: MingzhenHan <hanmingzhen2002@outlook.com>
```
  b7b23da4
- [Bugfix] Fix shape mismatch assertion error when loading Gemma3n model with... · fdde1822
  Areeb Syed authored Jul 30, 2025
```
[Bugfix] Fix shape mismatch assertion error when loading Gemma3n model with BitsAndBytes quantization (#21808)
Signed-off-by: sydarb <areebsyed237@gmail.com>
```
  fdde1822
- Expose PyTorch profiler configuration to environment variables (#21803) · b917da44
  Csrayz authored Jul 30, 2025
```
Signed-off-by: Csrayz <33659823+Csrayz@users.noreply.github.com>
```
  b917da44
- [Docs] Switch to better markdown linting pre-commit hook (#21851) · ba5c5e54
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba5c5e54
- [v1][attention] Support Hybrid Allocator + FlashInfer (#21412) · 555e7225
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  555e7225
- [Bugfix] Correct max tokens for non-contiguous embeds (#21798) · 0e36abf9
  milesial authored Jul 29, 2025
```
Signed-off-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
Co-authored-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
```
  0e36abf9
29 Jul, 2025 12 commits
- [BugFix] Fix interleaved sliding window not set for Gemma3n (#21863) · 9266d980
  Yong Hoon Shin authored Jul 29, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  9266d980
- docker: docker-aware precompiled wheel support (#21127) · a1873db2
  Doug Smith authored Jul 29, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  a1873db2
- [Bugfix] Fix workspace buffer None issue for Flashinfer TRTLLM Backend (#21525) · 58b11b24
  elvischenv authored Jul 29, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  58b11b24
- [Bugfix]fix mixed bits and visual language model quantization in AutoRound (#21802) · ad341c51
  Wenhua Cheng authored Jul 29, 2025
```
Signed-off-by: Wenhua Cheng <wenhua.cheng@intel.com>
```
  ad341c51
- [Bugfix] VLLM_V1 supports passing other compilation levels (#19340) · 04e38500
  Richard Zou authored Jul 29, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  04e38500
- [KVCache] Make KVCacheSpec hashable (#21791) · 755fa8b6
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  755fa8b6
- [Model] Refactor JambaForCausalLM (#21394) · 61a6905a
  Jee Jee Li authored Jul 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  61a6905a
- [V0 deprecation] Guided decoding (#21347) · 37efc63b
  Reza Barazesh authored Jul 29, 2025
```
Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  37efc63b
- [Model]: Fused MoE for nomic-embed-text-v2-moe (#18321) · a4528f0c
  Isotr0py authored Jul 29, 2025
```
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a4528f0c
- [Misc] Rework process titles (#21780) · 7234fe26
  Nick Hill authored Jul 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7234fe26
- Migrate InternVLImageInputs and InternVLVideoInputs to TensorSchema (#21684) · f1e2c095
  Benji Beck authored Jul 28, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  f1e2c095
- skip fusedmoe layer for start_load_kv (#21378) · e18f0851
  Calvin Chen authored Jul 29, 2025
```
Signed-off-by: calvin chen <wen.chen@dynamia.ai>
```
  e18f0851