Commits · 79731a79f09dc7bbe34dc8afbe8ef2242fb94a05 · OpenDAS / vllm_cscc · GitLab

01 Aug, 2025 10 commits
- [Doc] Fix a syntax error of example code in structured_outputs.md (#22045) · 79731a79
  Hongsheng Liu authored Aug 01, 2025
```
Signed-off-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: wangzi <3220100013@zju.edu.cn>
```
  79731a79
- Update sampling_metadata.py (#21937) · 53d7c392
  Aviad Rossmann authored Aug 01, 2025
```
Signed-off-by: Aviad Rossmann <aviadr@neureality.ai>
```
  53d7c392
- [Doc] Add Voxtral to Supported Models page (#22059) · 61dcc280
  Cyrus Leung authored Aug 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61dcc280
- [Model] [Quantization] Support quantization for Gemma3n (#21974) · 0f46a780
  Kyle Sayers authored Aug 01, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  0f46a780
- [BugFix] fix: aot passes kvcache dtype information (#19750) · e1a7fe4a
  Mickaël Seznec authored Aug 01, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  e1a7fe4a
- [Misc] Automatically resolve HF processor init kwargs (#22005) · 82de9b9d
  Cyrus Leung authored Aug 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82de9b9d
- [Bugfix] Fix: Fix multi loras with tp >=2 and LRU cache (#20873) · ad57f23f
  Charent authored Aug 01, 2025
```
Signed-off-by: charent <19562666+charent@users.noreply.github.com>
```
  ad57f23f
- [Refactor] Remove Duplicate `per_block_cast_to_fp8`, Remove Dependencies of DeepGEMM (#21787) · 37006420
  Wentao Ye authored Jul 31, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  37006420
- Move flashinfer-python to optional extra `vllm[flashinfer]` (#21959) · 0bd409cf
  Michael Goin authored Jul 31, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0bd409cf
- Add DeepGEMM to Dockerfile in vllm-base image (#21533) · e360316a
  Matthew Bonanni authored Jul 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  e360316a
31 Jul, 2025 21 commits
- [Feature] Add Flashinfer MoE Support for Compressed Tensor NVFP4 (#21639) · c3e0e933
  Wentao Ye authored Jul 31, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c3e0e933
- Add FlashInfer allreduce RMSNorm Quant fusion (#21069) · 6e672daf
  Ilya Markov authored Jul 31, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  6e672daf
- [Bugfix] Fix MTP weight loading (#21941) · 2dff2e21
  Benjamin Chislett authored Jul 31, 2025
  
  2dff2e21
- [Misc] Add unit tests for chunked local attention (#21692) · 71470bc4
  Yong Hoon Shin authored Jul 31, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  71470bc4
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
- Update torch_xla pin to 20250730 (#21956) · 53c21e49
  XiongfeiWei authored Jul 31, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  53c21e49
- Removing amdproduction Tests (#22027) · 0780bb57
  Alexei-V-Ivanov-AMD authored Jul 31, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  0780bb57
- fix(setup): improve precompiled wheel setup for Docker builds (#22025) · 58bb9021
  Doug Smith authored Jul 31, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  58bb9021
- [ez] Remove a trailing space from compilation/decorators.py (#22028) · 7349d526
  Zhengxu Chen authored Jul 31, 2025
  
  7349d526
- [Model] Add step3 vl (#21998) · 94846416
  Song authored Jul 31, 2025
```
Signed-off-by: oliveryuan <yuansong@step.ai>
Co-authored-by: oliveryuan <yuansong@step.ai>
```
  94846416
- [NVIDIA] Add SM100 Flashinfer MoE per tensor scale fp8 backend (#21458) · 207b750e
  amirkl94 authored Jul 31, 2025
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  207b750e
- [BugFix] Fix case where `collective_rpc` returns `None` (#22006) · 5daffe7c
  Nick Hill authored Jul 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5daffe7c
- [Model][CI] Let more pooling models support v1 (#21747) · 2836dd73
  wang.yuqi authored Jul 31, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2836dd73
- [CI/Build] get rid of unused VLLM_FA_CMAKE_GPU_ARCHES (#21599) · d2aab336
  Daniele authored Jul 31, 2025
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
```
  d2aab336
- [Deprecation] Remove deprecated args and methods (#21907) · 9532a6d5
  Cyrus Leung authored Jul 31, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9532a6d5
- [Bugfix]: fix metadata file copy in test_sharded_state_loader (#21830) · 3e36fcbe
  Ning Xie authored Jul 31, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3e36fcbe
- [CI Bugfix] Fix CI OOM for `test_shared_storage_connector_hashes` (#21973) · 055bd397
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  055bd397
- [Misc] Expand SUPPORTED_HIDDEN_SIZES for DeepEP low-latency kernels (#21818) · 0f7919fc
  Jee Jee Li authored Jul 31, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0f7919fc
- [UX] Rename CUTLASS_MLA_VLLM_V1 to CUTLASS_MLA (#21966) · 61445453
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  61445453
- [Bugfix] Relax lang pin for voxtral (#21833) · ec02e536
  Sanchit Gandhi authored Jul 31, 2025
```
Signed-off-by: Sanchit Gandhi <sgandhi3141@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  ec02e536
- [Example] Add `async_llm_streaming.py` example for AsyncLLM streaming in python (#21763) · 9cb497bf
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  9cb497bf
30 Jul, 2025 9 commits
- [Core] Move EngineCoreRequest to Request conversion out of EngineCore (#21627) · ca9e2be3
  Zebing Lin authored Jul 30, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  ca9e2be3
- [Bugfix] Fix None value handling in trace span creation for cancelled requests (#20272) · 601f856d
  Bram authored Jul 30, 2025
  
  601f856d
- [Feature] Add async tensor parallelism for scaled mm (#20155) · 287f527f
  cascade authored Jul 30, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  287f527f
- [Misc] Use dracut on CentOS and skip clone if repo exists for EP kernel installation (#21635) · f12d9256
  Ming Yang authored Jul 30, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  f12d9256
- For VLLM_USE_PRECOMPILED, only compiled .so files should be extracted (#21964) · b9b753e7
  Doug Smith authored Jul 30, 2025
  
  b9b753e7
- [Misc] Support more collective_rpc return types (#21845) · 56bd537d
  Nick Hill authored Jul 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  56bd537d
- [TPU] Support Pathways in vLLM (#21417) · 8f0d5167
  wenxindongwork authored Jul 30, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
  8f0d5167
- feat(distributed): add `get_required_kvcache_layout` class method to kv connector api (#20433) · f4135232
  wxsm authored Jul 31, 2025
```
Signed-off-by: wxsm <wxsms@foxmail.com>
```
  f4135232
- [Bugfix] SharedStorage Connector for V1 PD multimodal (#21611) · 4904e53c
  Chenguang Zheng authored Jul 31, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
```
  4904e53c