Commits · ef8f16f4df2d0f64bdcf1dbcbb0159400b70f064 · OpenDAS / vllm_cscc · GitLab

07 May, 2025 3 commits
- update v1 mla · ef8f16f4
  zhuwenwen authored May 07, 2025
  
  ef8f16f4
- update rocm.py · 660af62e
  zhuwenwen authored May 07, 2025
  
  660af62e
- [fix]修复并行解码多机推理报错 · c7096363
  zhuwenwen authored May 07, 2025
  
  c7096363
06 May, 2025 2 commits
- support qwen3-moe nn layout · 4dc24bc8
  zhuwenwen authored May 06, 2025
  
  4dc24bc8
- update update_environment_variables · 15470ae4
  zhuwenwen authored May 06, 2025
  
  15470ae4
02 May, 2025 2 commits
- [BugFix][Attention] Fix sliding window attention in V1 giving incorrect results (#17574) · 3015d563
  Lucas Wilkinson authored May 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  3015d563
- [BugFix] Fix Memory Leak (#17567) · edb5286e
  Robert Shaw authored May 02, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  edb5286e
30 Apr, 2025 3 commits
- support qwen3 nn layout · 8a12a939
  zhuwenwen authored Apr 30, 2025
  
  8a12a939
- skip apply_rotary_emb from vllm_fa · ffd8e40d
  zhuwenwen authored Apr 30, 2025
  
  ffd8e40d
- skip is_rocm_aiter_moe_enabled and add mla pad · daefd764
  zhuwenwen authored Apr 30, 2025
  
  daefd764
29 Apr, 2025 3 commits
- update rocm.py · 43a52016
  zhuwenwen authored Apr 29, 2025
  
  43a52016
- 需改mtp 16卡性能差问题 · 55880ca2
  xiabo authored Apr 29, 2025
  
  55880ca2
- add triton_key · c7277a35
  zhuwenwen authored Apr 29, 2025
  
  c7277a35
28 Apr, 2025 19 commits
- [Model] Add tuned triton fused_moe configs for Qwen3Moe (#17328) · ba41cc90
  Michael Goin authored Apr 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ba41cc90
- [Model] Qwen3 Dense FP8 Compat Fixes (#17318) · dcbac4cb
  Simon Mo authored Apr 28, 2025
```
Signed-off-by: simon-mo <xmo@berkeley.edu>
```
  dcbac4cb
- [Bugfix] Fix moe weight losing all extra attrs after `process_weights_after_loading`. (#16854) · ed246203
  Charlie Fu authored Apr 28, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  ed246203
- [BugFix] Fix cascade attention - RuntimeError: scheduler_metadata must have... · cc5befbc
  Lucas Wilkinson authored Apr 28, 2025
```
[BugFix] Fix cascade attention - RuntimeError: scheduler_metadata must have shape (metadata_size) (#17283)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  cc5befbc
- [Security] Don't bind tcp zmq socket to all interfaces (#17197) · a0304dc5
  Russell Bryant authored Apr 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  a0304dc5
- Explicitly explain quant method override ordering and ensure all overrides are ordered (#17256) · c7941cca
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c7941cca
- Make name of `compressed-tensors` quant method consistent across vLLM (#17255) · b6dd32aa
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b6dd32aa
- Improve conversion from dataclass configs to argparse arguments (#17303) · f9488694
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f9488694
- [Misc] Clean up Qwen2.5-Omni code (#17301) · 8b464d96
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8b464d96
- [Misc] Minor typo/grammar in `platforms/interface.py` (#17307) · 889ebb26
  Nicolò Lucchesi authored Apr 28, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  889ebb26
- [Bugfix] Add missing `get_language_model` to new MLLMs (#17300) · 344e193b
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  344e193b
- Add missing class docstring for `PromptAdapterConfig` (#17302) · fb1c933a
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb1c933a
- Update tpu_worker.py 's typo (#17288) · 72c5b972
  idouba authored Apr 28, 2025
  
  72c5b972
- [Model] Add Granite Speech Support (#16246) · fa93cd9f
  Alex Brooks authored Apr 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  fa93cd9f
- [Core] Remove legacy input mapper/processor from V0 (#15686) · aec9674d
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aec9674d
- [Minor][Models] Pass partial_rotary_factor parameter to rope (#17266) · 7fcc4223
  Wanrui Dai authored Apr 28, 2025
```
Signed-off-by: evian <eviantai@u.nus.edu>
Co-authored-by: evian <eviantai@u.nus.edu>
```
  7fcc4223
- [Misc] Validate `stop_token_ids` contents (#17268) · 8262a3e2
  Nick Hill authored Apr 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8262a3e2
- [Bugfix] Fix Mistral3 spatial merge error (#17270) · cb3f2d8d
  Michael Goin authored Apr 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cb3f2d8d
- [BugFix] Fix vllm_flash_attn install issues (#17267) · d8bccde6
  Lucas Wilkinson authored Apr 27, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  d8bccde6
27 Apr, 2025 8 commits
- [V1][Spec Decode] Make eagle compatible with prefix caching. (#17137) · 20e489ea
  Lily Liu authored Apr 27, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  20e489ea
- [Metrics] Fix minor inconsistencies in bucket progression (#17262) · 4213475e
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4213475e
- [Feature] support sequence parallelism using compilation pass (#16155) · 690fe019
  cascade authored Apr 27, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  690fe019
- [NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032) · ed7a29d9
  Kaixi Hou authored Apr 27, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
```
  ed7a29d9
- [Bugfix] Fix Lora Name Parsing (#17196) · 756848e7
  Alex Brooks authored Apr 27, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  756848e7
- [Misc] Change buckets of histogram_iteration_tokens to [1, 8, 16, 32, 64, 128,... · 18445edd
  Flex Wang authored Apr 27, 2025
```
[Misc] Change buckets of histogram_iteration_tokens to [1, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096, 8096] to represent number of tokens (#17033)
Signed-off-by: sfc-gh-zhwang <flex.wang@snowflake.com>
```
  18445edd
- [MISC] Use string annotation types for class definitions (#17244) · 30215ca6
  Jade Zheng authored Apr 27, 2025
```
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
```
  30215ca6
- [Bugfix] Get a specific type of layer from forward context (#17222) · 838cedad
  Chen Zhang authored Apr 27, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  838cedad