Commits · 4dc24bc8bb9f21422297824f14dc367279684dc5 · OpenDAS / vllm_cscc · GitLab

06 May, 2025 4 commits
- support qwen3-moe nn layout · 4dc24bc8
  zhuwenwen authored May 06, 2025
  
  4dc24bc8
- update update_environment_variables · 15470ae4
  zhuwenwen authored May 06, 2025
  
  15470ae4
- update version · c8a2d2a4
  zhuwenwen authored May 06, 2025
  
  c8a2d2a4
- Merge tag 'v0.8.5.post1' into v0.8.5.post1-dev · dee71fba
  zhuwenwen authored May 06, 2025
  
  dee71fba
02 May, 2025 2 commits
- [BugFix][Attention] Fix sliding window attention in V1 giving incorrect results (#17574) · 3015d563
  Lucas Wilkinson authored May 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  3015d563
- [BugFix] Fix Memory Leak (#17567) · edb5286e
  Robert Shaw authored May 02, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  edb5286e
30 Apr, 2025 3 commits
- support qwen3 nn layout · 8a12a939
  zhuwenwen authored Apr 30, 2025
  
  8a12a939
- skip apply_rotary_emb from vllm_fa · ffd8e40d
  zhuwenwen authored Apr 30, 2025
  
  ffd8e40d
- skip is_rocm_aiter_moe_enabled and add mla pad · daefd764
  zhuwenwen authored Apr 30, 2025
  
  daefd764
29 Apr, 2025 5 commits
- update rocm.py · 43a52016
  zhuwenwen authored Apr 29, 2025
  
  43a52016
- update README.md · dcec1db7
  zhuwenwen authored Apr 29, 2025
  
  dcec1db7
- Merge tag 'v0.8.5' into v0.8.5-dev · dcb5624a
  zhuwenwen authored Apr 29, 2025
  
  dcb5624a
- 需改mtp 16卡性能差问题 · 55880ca2
  xiabo authored Apr 29, 2025
  
  55880ca2
- add triton_key · c7277a35
  zhuwenwen authored Apr 29, 2025
  
  c7277a35
28 Apr, 2025 26 commits
- [Model] Add tuned triton fused_moe configs for Qwen3Moe (#17328) · ba41cc90
  Michael Goin authored Apr 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ba41cc90
- [Model] Qwen3 Dense FP8 Compat Fixes (#17318) · dcbac4cb
  Simon Mo authored Apr 28, 2025
```
Signed-off-by: simon-mo <xmo@berkeley.edu>
```
  dcbac4cb
- [Bugfix] Fix moe weight losing all extra attrs after `process_weights_after_loading`. (#16854) · ed246203
  Charlie Fu authored Apr 28, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  ed246203
- [BugFix] Fix cascade attention - RuntimeError: scheduler_metadata must have... · cc5befbc
  Lucas Wilkinson authored Apr 28, 2025
```
[BugFix] Fix cascade attention - RuntimeError: scheduler_metadata must have shape (metadata_size) (#17283)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  cc5befbc
- [Chore] cleanup license indicators in light of SPDX (#17259) · 2c89cd96
  Aaron Pham authored Apr 28, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  2c89cd96
- [Security] Don't bind tcp zmq socket to all interfaces (#17197) · a0304dc5
  Russell Bryant authored Apr 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  a0304dc5
- Explicitly explain quant method override ordering and ensure all overrides are ordered (#17256) · c7941cca
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c7941cca
- Make name of `compressed-tensors` quant method consistent across vLLM (#17255) · b6dd32aa
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b6dd32aa
- Improve conversion from dataclass configs to argparse arguments (#17303) · f9488694
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f9488694
- [Docs] Add a security guide (#17230) · 72dfe4c7
  Russell Bryant authored Apr 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  72dfe4c7
- [Misc] Clean up Qwen2.5-Omni code (#17301) · 8b464d96
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8b464d96
- [Misc] Minor typo/grammar in `platforms/interface.py` (#17307) · 889ebb26
  Nicolò Lucchesi authored Apr 28, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  889ebb26
- [doc] update wrong model id (#17287) · 3ad986c2
  Reid authored Apr 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  3ad986c2
- [Bugfix] Add missing `get_language_model` to new MLLMs (#17300) · 344e193b
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  344e193b
- Add missing class docstring for `PromptAdapterConfig` (#17302) · fb1c933a
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb1c933a
- Update tpu_worker.py 's typo (#17288) · 72c5b972
  idouba authored Apr 28, 2025
  
  72c5b972
- [Model] Add Granite Speech Support (#16246) · fa93cd9f
  Alex Brooks authored Apr 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  fa93cd9f
- [Core] Remove legacy input mapper/processor from V0 (#15686) · aec9674d
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aec9674d
- [Minor][Models] Pass partial_rotary_factor parameter to rope (#17266) · 7fcc4223
  Wanrui Dai authored Apr 28, 2025
```
Signed-off-by: evian <eviantai@u.nus.edu>
Co-authored-by: evian <eviantai@u.nus.edu>
```
  7fcc4223
- [Misc] Validate `stop_token_ids` contents (#17268) · 8262a3e2
  Nick Hill authored Apr 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8262a3e2
- [Doc] small fix (#17277) · f211331c
  Reid authored Apr 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  f211331c
- [Doc] Fix wrong github link in LMCache examples (#17274) · 9053d0b1
  Kuntai Du authored Apr 27, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  9053d0b1
- [Bugfix] Fix Mistral3 spatial merge error (#17270) · cb3f2d8d
  Michael Goin authored Apr 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cb3f2d8d
- [Bugfix] Fix cutlass dispatch for fp8/int8 to properly invoke M<=16 c… (#16751) · c12df53b
  TherLF authored Apr 28, 2025
```
Signed-off-by: Ther-LF <2639852836@qq.com>
```
  c12df53b
- [Bugfix] Fix missing ARG in Dockerfile for arm64 platforms (#17261) · d1aeea75
  Lennart K. M. Schulz authored Apr 28, 2025
```
Signed-off-by: lkm-schulz <44176356+lkm-schulz@users.noreply.github.com>
```
  d1aeea75
- [BugFix] Fix vllm_flash_attn install issues (#17267) · d8bccde6
  Lucas Wilkinson authored Apr 27, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  d8bccde6