Commits · 4ff58b666d9de47f5e629c52cfde4baefd2c9d56 · OpenDAS / vllm_cscc · GitLab

09 May, 2025 2 commits
- debug v0 zero overhead schedule · 4ff58b66
  lizhigong authored Apr 14, 2025
  
  4ff58b66
- add v0 zero overhead · 54294854
  lizhigong authored Apr 11, 2025
  
  54294854
08 May, 2025 4 commits
- fix mtp run error · a0c212c0
  zhuwenwen authored May 08, 2025
  
  a0c212c0
- set VLLM_USE_V1=0 · 3d83fa41
  zhuwenwen authored May 08, 2025
  
  3d83fa41
- set MOE_NN=1 · e5497373
  zhuwenwen authored May 08, 2025
  
  e5497373
- set VLLM_ROCM_MOE_PADDING=0 · ee405280
  zhuwenwen authored May 08, 2025
  
  ee405280
07 May, 2025 4 commits
- [fix]修复cudagraph和eager分段模式开启mla后报错问题 · 91c7bda5
  zhuwenwen authored May 07, 2025
  
  91c7bda5
- update v1 mla · ef8f16f4
  zhuwenwen authored May 07, 2025
  
  ef8f16f4
- update rocm.py · 660af62e
  zhuwenwen authored May 07, 2025
  
  660af62e
- [fix]修复并行解码多机推理报错 · c7096363
  zhuwenwen authored May 07, 2025
  
  c7096363
06 May, 2025 2 commits
- support qwen3-moe nn layout · 4dc24bc8
  zhuwenwen authored May 06, 2025
  
  4dc24bc8
- update update_environment_variables · 15470ae4
  zhuwenwen authored May 06, 2025
  
  15470ae4
02 May, 2025 2 commits
- [BugFix][Attention] Fix sliding window attention in V1 giving incorrect results (#17574) · 3015d563
  Lucas Wilkinson authored May 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  3015d563
- [BugFix] Fix Memory Leak (#17567) · edb5286e
  Robert Shaw authored May 02, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  edb5286e
30 Apr, 2025 3 commits
- support qwen3 nn layout · 8a12a939
  zhuwenwen authored Apr 30, 2025
  
  8a12a939
- skip apply_rotary_emb from vllm_fa · ffd8e40d
  zhuwenwen authored Apr 30, 2025
  
  ffd8e40d
- skip is_rocm_aiter_moe_enabled and add mla pad · daefd764
  zhuwenwen authored Apr 30, 2025
  
  daefd764
29 Apr, 2025 3 commits
- update rocm.py · 43a52016
  zhuwenwen authored Apr 29, 2025
  
  43a52016
- 需改mtp 16卡性能差问题 · 55880ca2
  xiabo authored Apr 29, 2025
  
  55880ca2
- add triton_key · c7277a35
  zhuwenwen authored Apr 29, 2025
  
  c7277a35
28 Apr, 2025 19 commits
- [Model] Add tuned triton fused_moe configs for Qwen3Moe (#17328) · ba41cc90
  Michael Goin authored Apr 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ba41cc90
- [Model] Qwen3 Dense FP8 Compat Fixes (#17318) · dcbac4cb
  Simon Mo authored Apr 28, 2025
```
Signed-off-by: simon-mo <xmo@berkeley.edu>
```
  dcbac4cb
- [Bugfix] Fix moe weight losing all extra attrs after `process_weights_after_loading`. (#16854) · ed246203
  Charlie Fu authored Apr 28, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  ed246203
- [BugFix] Fix cascade attention - RuntimeError: scheduler_metadata must have... · cc5befbc
  Lucas Wilkinson authored Apr 28, 2025
```
[BugFix] Fix cascade attention - RuntimeError: scheduler_metadata must have shape (metadata_size) (#17283)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  cc5befbc
- [Security] Don't bind tcp zmq socket to all interfaces (#17197) · a0304dc5
  Russell Bryant authored Apr 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  a0304dc5
- Explicitly explain quant method override ordering and ensure all overrides are ordered (#17256) · c7941cca
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c7941cca
- Make name of `compressed-tensors` quant method consistent across vLLM (#17255) · b6dd32aa
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b6dd32aa
- Improve conversion from dataclass configs to argparse arguments (#17303) · f9488694
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f9488694
- [Misc] Clean up Qwen2.5-Omni code (#17301) · 8b464d96
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8b464d96
- [Misc] Minor typo/grammar in `platforms/interface.py` (#17307) · 889ebb26
  Nicolò Lucchesi authored Apr 28, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  889ebb26
- [Bugfix] Add missing `get_language_model` to new MLLMs (#17300) · 344e193b
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  344e193b
- Add missing class docstring for `PromptAdapterConfig` (#17302) · fb1c933a
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb1c933a
- Update tpu_worker.py 's typo (#17288) · 72c5b972
  idouba authored Apr 28, 2025
  
  72c5b972
- [Model] Add Granite Speech Support (#16246) · fa93cd9f
  Alex Brooks authored Apr 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  fa93cd9f
- [Core] Remove legacy input mapper/processor from V0 (#15686) · aec9674d
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aec9674d
- [Minor][Models] Pass partial_rotary_factor parameter to rope (#17266) · 7fcc4223
  Wanrui Dai authored Apr 28, 2025
```
Signed-off-by: evian <eviantai@u.nus.edu>
Co-authored-by: evian <eviantai@u.nus.edu>
```
  7fcc4223
- [Misc] Validate `stop_token_ids` contents (#17268) · 8262a3e2
  Nick Hill authored Apr 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8262a3e2
- [Bugfix] Fix Mistral3 spatial merge error (#17270) · cb3f2d8d
  Michael Goin authored Apr 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cb3f2d8d
- [BugFix] Fix vllm_flash_attn install issues (#17267) · d8bccde6
  Lucas Wilkinson authored Apr 27, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  d8bccde6
27 Apr, 2025 1 commit
- [V1][Spec Decode] Make eagle compatible with prefix caching. (#17137) · 20e489ea
  Lily Liu authored Apr 27, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  20e489ea