Commits · c3e0e9337ef0af04d2d18b263a6a0f7deed75856 · OpenDAS / vllm_cscc · GitLab

31 Jul, 2025 21 commits
- [Feature] Add Flashinfer MoE Support for Compressed Tensor NVFP4 (#21639) · c3e0e933
  Wentao Ye authored Jul 31, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c3e0e933
- Add FlashInfer allreduce RMSNorm Quant fusion (#21069) · 6e672daf
  Ilya Markov authored Jul 31, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  6e672daf
- [Bugfix] Fix MTP weight loading (#21941) · 2dff2e21
  Benjamin Chislett authored Jul 31, 2025
  
  2dff2e21
- [Misc] Add unit tests for chunked local attention (#21692) · 71470bc4
  Yong Hoon Shin authored Jul 31, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  71470bc4
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
- Update torch_xla pin to 20250730 (#21956) · 53c21e49
  XiongfeiWei authored Jul 31, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  53c21e49
- Removing amdproduction Tests (#22027) · 0780bb57
  Alexei-V-Ivanov-AMD authored Jul 31, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  0780bb57
- fix(setup): improve precompiled wheel setup for Docker builds (#22025) · 58bb9021
  Doug Smith authored Jul 31, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  58bb9021
- [ez] Remove a trailing space from compilation/decorators.py (#22028) · 7349d526
  Zhengxu Chen authored Jul 31, 2025
  
  7349d526
- [Model] Add step3 vl (#21998) · 94846416
  Song authored Jul 31, 2025
```
Signed-off-by: oliveryuan <yuansong@step.ai>
Co-authored-by: oliveryuan <yuansong@step.ai>
```
  94846416
- [NVIDIA] Add SM100 Flashinfer MoE per tensor scale fp8 backend (#21458) · 207b750e
  amirkl94 authored Jul 31, 2025
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  207b750e
- [BugFix] Fix case where `collective_rpc` returns `None` (#22006) · 5daffe7c
  Nick Hill authored Jul 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5daffe7c
- [Model][CI] Let more pooling models support v1 (#21747) · 2836dd73
  wang.yuqi authored Jul 31, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2836dd73
- [CI/Build] get rid of unused VLLM_FA_CMAKE_GPU_ARCHES (#21599) · d2aab336
  Daniele authored Jul 31, 2025
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
```
  d2aab336
- [Deprecation] Remove deprecated args and methods (#21907) · 9532a6d5
  Cyrus Leung authored Jul 31, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9532a6d5
- [Bugfix]: fix metadata file copy in test_sharded_state_loader (#21830) · 3e36fcbe
  Ning Xie authored Jul 31, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3e36fcbe
- [CI Bugfix] Fix CI OOM for `test_shared_storage_connector_hashes` (#21973) · 055bd397
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  055bd397
- [Misc] Expand SUPPORTED_HIDDEN_SIZES for DeepEP low-latency kernels (#21818) · 0f7919fc
  Jee Jee Li authored Jul 31, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0f7919fc
- [UX] Rename CUTLASS_MLA_VLLM_V1 to CUTLASS_MLA (#21966) · 61445453
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  61445453
- [Bugfix] Relax lang pin for voxtral (#21833) · ec02e536
  Sanchit Gandhi authored Jul 31, 2025
```
Signed-off-by: Sanchit Gandhi <sgandhi3141@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  ec02e536
- [Example] Add `async_llm_streaming.py` example for AsyncLLM streaming in python (#21763) · 9cb497bf
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  9cb497bf
30 Jul, 2025 19 commits
- [Core] Move EngineCoreRequest to Request conversion out of EngineCore (#21627) · ca9e2be3
  Zebing Lin authored Jul 30, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  ca9e2be3
- [Bugfix] Fix None value handling in trace span creation for cancelled requests (#20272) · 601f856d
  Bram authored Jul 30, 2025
  
  601f856d
- [Feature] Add async tensor parallelism for scaled mm (#20155) · 287f527f
  cascade authored Jul 30, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  287f527f
- [Misc] Use dracut on CentOS and skip clone if repo exists for EP kernel installation (#21635) · f12d9256
  Ming Yang authored Jul 30, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  f12d9256
- For VLLM_USE_PRECOMPILED, only compiled .so files should be extracted (#21964) · b9b753e7
  Doug Smith authored Jul 30, 2025
  
  b9b753e7
- [Misc] Support more collective_rpc return types (#21845) · 56bd537d
  Nick Hill authored Jul 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  56bd537d
- [TPU] Support Pathways in vLLM (#21417) · 8f0d5167
  wenxindongwork authored Jul 30, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
  8f0d5167
- feat(distributed): add `get_required_kvcache_layout` class method to kv connector api (#20433) · f4135232
  wxsm authored Jul 31, 2025
```
Signed-off-by: wxsm <wxsms@foxmail.com>
```
  f4135232
- [Bugfix] SharedStorage Connector for V1 PD multimodal (#21611) · 4904e53c
  Chenguang Zheng authored Jul 31, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
```
  4904e53c
- [CI/Build] Fix registry tests (#21934) · 004203e9
  Cyrus Leung authored Jul 31, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  004203e9
- [Bugfix] Fix TypeError in scheduler when comparing mixed request_id types (#21816) · 5c765aec
  633WHU authored Jul 30, 2025
```
Signed-off-by: chiliu <chiliu@paypal.com>
Co-authored-by: chiliu <chiliu@paypal.com>
```
  5c765aec
- Override attention metadata for fast prefill in some KV sharing setups (#21590) · ad510309
  Yong Hoon Shin authored Jul 30, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  ad510309
- [Bugfix] Fix multi-api server not working for text models (#21933) · 366f6b3a
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  366f6b3a
- [Bugfix] Fix OOM tests in initialization test (#21921) · 6e599eeb
  Isotr0py authored Jul 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  6e599eeb
- [Docs] Reduce the size of the built docs (#21920) · 88edf599
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  88edf599
- [NVIDIA] Fix Llama4 Scout FP4 functionality issues (#21499) · ff08e519
  Po-Han Huang (NVIDIA) authored Jul 30, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  ff08e519
- [Misc] Improve code readability of KVCacheManager (#21673) · 8f4a1c9a
  Ruixiang Tan authored Jul 30, 2025
```
Signed-off-by: tanruixiang <tanruixiang0104@gmail.com>
Signed-off-by: Ruixiang Tan <819464715@qq.com>
Signed-off-by: GitHub <noreply@github.com>
```
  8f4a1c9a
- Reduce time wasted in GitHub Actions using `concurrency` (#21919) · 36ede459
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  36ede459
- [CI/Build] Only run markdownlint in CI (#21892) · 0e40b260
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0e40b260