Commits · ba41cc90e8ef7f236347b2f1599eec2cbb9e1f0d · OpenDAS / vllm_cscc · GitLab

28 Apr, 2025 26 commits
- [Model] Add tuned triton fused_moe configs for Qwen3Moe (#17328) · ba41cc90
  Michael Goin authored Apr 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ba41cc90
- [Model] Qwen3 Dense FP8 Compat Fixes (#17318) · dcbac4cb
  Simon Mo authored Apr 28, 2025
```
Signed-off-by: simon-mo <xmo@berkeley.edu>
```
  dcbac4cb
- [Bugfix] Fix moe weight losing all extra attrs after `process_weights_after_loading`. (#16854) · ed246203
  Charlie Fu authored Apr 28, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  ed246203
- [BugFix] Fix cascade attention - RuntimeError: scheduler_metadata must have... · cc5befbc
  Lucas Wilkinson authored Apr 28, 2025
```
[BugFix] Fix cascade attention - RuntimeError: scheduler_metadata must have shape (metadata_size) (#17283)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  cc5befbc
- [Chore] cleanup license indicators in light of SPDX (#17259) · 2c89cd96
  Aaron Pham authored Apr 28, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  2c89cd96
- [Security] Don't bind tcp zmq socket to all interfaces (#17197) · a0304dc5
  Russell Bryant authored Apr 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  a0304dc5
- Explicitly explain quant method override ordering and ensure all overrides are ordered (#17256) · c7941cca
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c7941cca
- Make name of `compressed-tensors` quant method consistent across vLLM (#17255) · b6dd32aa
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b6dd32aa
- Improve conversion from dataclass configs to argparse arguments (#17303) · f9488694
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f9488694
- [Docs] Add a security guide (#17230) · 72dfe4c7
  Russell Bryant authored Apr 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  72dfe4c7
- [Misc] Clean up Qwen2.5-Omni code (#17301) · 8b464d96
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8b464d96
- [Misc] Minor typo/grammar in `platforms/interface.py` (#17307) · 889ebb26
  Nicolò Lucchesi authored Apr 28, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  889ebb26
- [doc] update wrong model id (#17287) · 3ad986c2
  Reid authored Apr 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  3ad986c2
- [Bugfix] Add missing `get_language_model` to new MLLMs (#17300) · 344e193b
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  344e193b
- Add missing class docstring for `PromptAdapterConfig` (#17302) · fb1c933a
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb1c933a
- Update tpu_worker.py 's typo (#17288) · 72c5b972
  idouba authored Apr 28, 2025
  
  72c5b972
- [Model] Add Granite Speech Support (#16246) · fa93cd9f
  Alex Brooks authored Apr 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  fa93cd9f
- [Core] Remove legacy input mapper/processor from V0 (#15686) · aec9674d
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aec9674d
- [Minor][Models] Pass partial_rotary_factor parameter to rope (#17266) · 7fcc4223
  Wanrui Dai authored Apr 28, 2025
```
Signed-off-by: evian <eviantai@u.nus.edu>
Co-authored-by: evian <eviantai@u.nus.edu>
```
  7fcc4223
- [Misc] Validate `stop_token_ids` contents (#17268) · 8262a3e2
  Nick Hill authored Apr 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8262a3e2
- [Doc] small fix (#17277) · f211331c
  Reid authored Apr 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  f211331c
- [Doc] Fix wrong github link in LMCache examples (#17274) · 9053d0b1
  Kuntai Du authored Apr 27, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  9053d0b1
- [Bugfix] Fix Mistral3 spatial merge error (#17270) · cb3f2d8d
  Michael Goin authored Apr 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cb3f2d8d
- [Bugfix] Fix cutlass dispatch for fp8/int8 to properly invoke M<=16 c… (#16751) · c12df53b
  TherLF authored Apr 28, 2025
```
Signed-off-by: Ther-LF <2639852836@qq.com>
```
  c12df53b
- [Bugfix] Fix missing ARG in Dockerfile for arm64 platforms (#17261) · d1aeea75
  Lennart K. M. Schulz authored Apr 28, 2025
```
Signed-off-by: lkm-schulz <44176356+lkm-schulz@users.noreply.github.com>
```
  d1aeea75
- [BugFix] Fix vllm_flash_attn install issues (#17267) · d8bccde6
  Lucas Wilkinson authored Apr 27, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  d8bccde6
27 Apr, 2025 12 commits
- [V1][Spec Decode] Make eagle compatible with prefix caching. (#17137) · 20e489ea
  Lily Liu authored Apr 27, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  20e489ea
- [Metrics] Fix minor inconsistencies in bucket progression (#17262) · 4213475e
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4213475e
- [doc] Add feature status legend (#17257) · d92879ba
  Reid authored Apr 27, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  d92879ba
- [Feature] support sequence parallelism using compilation pass (#16155) · 690fe019
  cascade authored Apr 27, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  690fe019
- [NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032) · ed7a29d9
  Kaixi Hou authored Apr 27, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
```
  ed7a29d9
- [Bugfix] Fix Lora Name Parsing (#17196) · 756848e7
  Alex Brooks authored Apr 27, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  756848e7
- [Misc] Change buckets of histogram_iteration_tokens to [1, 8, 16, 32, 64, 128,... · 18445edd
  Flex Wang authored Apr 27, 2025
```
[Misc] Change buckets of histogram_iteration_tokens to [1, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096, 8096] to represent number of tokens (#17033)
Signed-off-by: sfc-gh-zhwang <flex.wang@snowflake.com>
```
  18445edd
- [MISC] Use string annotation types for class definitions (#17244) · 30215ca6
  Jade Zheng authored Apr 27, 2025
```
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
```
  30215ca6
- [Bugfix] Get a specific type of layer from forward context (#17222) · 838cedad
  Chen Zhang authored Apr 27, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  838cedad
- [Bugfix] Fix QWen2 VL multimodal mapping (#17240) · 4283a28c
  Jee Jee Li authored Apr 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4283a28c
- [Misc] Make cached tokenizer pickle-compatible (#17048) · 93a126fb
  Cyrus Leung authored Apr 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  93a126fb
- [Kernel][Triton][FP8] Adding fp8 and variable length sequence support to... · 8e4b351a
  rasmith authored Apr 26, 2025
```
[Kernel][Triton][FP8] Adding fp8 and variable length sequence support to Triton FAv2 kernel (#12591)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  8e4b351a
26 Apr, 2025 2 commits
- Update test_flash_attn.py (#17102) · 9869453c
  Happy authored Apr 27, 2025
```
Signed-off-by: ShuaibinLi <lishuaibin@live.cn>
```
  9869453c
- [CI/Build] remove -t for run-lm-eval-gsm-hf-baseline.sh (#16271) · 3642c59a
  Reid authored Apr 27, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  3642c59a