Commits · 83dd9e1a098a3239c32c96d58b27806623628eaf · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "d3c002eadcbaabe1cc2e5fe94321cdc6383cd4e3"

14 May, 2025 2 commits
- add kvint8 · 6d105cc4
  xiabo authored May 14, 2025
  
  6d105cc4
- add kvint8 · 45273722
  xiabo authored May 14, 2025
  
  45273722
13 May, 2025 2 commits
- support cutlass prefix-cache · bdc70899
  zhuwenwen authored May 13, 2025
  
  bdc70899
- add qwen3 moe configs · 09e372e7
  zhuwenwen authored May 13, 2025
```
support telechat2 and glm4 nn layout
remove log of request_id
```
  09e372e7
09 May, 2025 12 commits
- debug on v0.8.5 · cf1d8464
  lizhigong authored May 09, 2025
  
  cf1d8464
- roll back unused change · 29e922ac
  lizhigong authored May 09, 2025
  
  29e922ac
- pause speculative decoding with zero overhead scheduling, develop tbo first · 0ee425a6
  lizhigong authored May 08, 2025
  
  0ee425a6
- rm debug log · 7d224eb2
  lizhigong authored May 08, 2025
  
  7d224eb2
- debug spec decode zero overhead · 0ecda6d1
  lizhigong authored May 08, 2025
  
  0ecda6d1
- add spec decode zero overhead · 01c30741
  lizhigong authored Apr 27, 2025
  
  01c30741
- delete triton kernel ,use tensor indices · b01c8270
  lizhigong authored Apr 27, 2025
  
  b01c8270
- fix zero scheduler on v0.8.4 · 1ed30424
  lizhigong authored Apr 27, 2025
  
  1ed30424
- fix stop remote worker bug · 351d607d
  lizhigong authored Apr 27, 2025
  
  351d607d
- add VLLM_ZERO_DISABLE_AUTO_THREAD VLLM_ZERO_NO_THREAD change zero scheduling logic · 9076ef2b
  lizhigong authored Apr 15, 2025
  
  9076ef2b
- debug v0 zero overhead schedule · 4ff58b66
  lizhigong authored Apr 14, 2025
  
  4ff58b66
- add v0 zero overhead · 54294854
  lizhigong authored Apr 11, 2025
  
  54294854
08 May, 2025 4 commits
- fix mtp run error · a0c212c0
  zhuwenwen authored May 08, 2025
  
  a0c212c0
- set VLLM_USE_V1=0 · 3d83fa41
  zhuwenwen authored May 08, 2025
  
  3d83fa41
- set MOE_NN=1 · e5497373
  zhuwenwen authored May 08, 2025
  
  e5497373
- set VLLM_ROCM_MOE_PADDING=0 · ee405280
  zhuwenwen authored May 08, 2025
  
  ee405280
07 May, 2025 4 commits
- [fix]修复cudagraph和eager分段模式开启mla后报错问题 · 91c7bda5
  zhuwenwen authored May 07, 2025
  
  91c7bda5
- update v1 mla · ef8f16f4
  zhuwenwen authored May 07, 2025
  
  ef8f16f4
- update rocm.py · 660af62e
  zhuwenwen authored May 07, 2025
  
  660af62e
- [fix]修复并行解码多机推理报错 · c7096363
  zhuwenwen authored May 07, 2025
  
  c7096363
06 May, 2025 2 commits
- support qwen3-moe nn layout · 4dc24bc8
  zhuwenwen authored May 06, 2025
  
  4dc24bc8
- update update_environment_variables · 15470ae4
  zhuwenwen authored May 06, 2025
  
  15470ae4
02 May, 2025 2 commits
- [BugFix][Attention] Fix sliding window attention in V1 giving incorrect results (#17574) · 3015d563
  Lucas Wilkinson authored May 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  3015d563
- [BugFix] Fix Memory Leak (#17567) · edb5286e
  Robert Shaw authored May 02, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  edb5286e
30 Apr, 2025 3 commits
- support qwen3 nn layout · 8a12a939
  zhuwenwen authored Apr 30, 2025
  
  8a12a939
- skip apply_rotary_emb from vllm_fa · ffd8e40d
  zhuwenwen authored Apr 30, 2025
  
  ffd8e40d
- skip is_rocm_aiter_moe_enabled and add mla pad · daefd764
  zhuwenwen authored Apr 30, 2025
  
  daefd764
29 Apr, 2025 3 commits
- update rocm.py · 43a52016
  zhuwenwen authored Apr 29, 2025
  
  43a52016
- 需改mtp 16卡性能差问题 · 55880ca2
  xiabo authored Apr 29, 2025
  
  55880ca2
- add triton_key · c7277a35
  zhuwenwen authored Apr 29, 2025
  
  c7277a35
28 Apr, 2025 6 commits
- [Model] Add tuned triton fused_moe configs for Qwen3Moe (#17328) · ba41cc90
  Michael Goin authored Apr 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ba41cc90
- [Model] Qwen3 Dense FP8 Compat Fixes (#17318) · dcbac4cb
  Simon Mo authored Apr 28, 2025
```
Signed-off-by: simon-mo <xmo@berkeley.edu>
```
  dcbac4cb
- [Bugfix] Fix moe weight losing all extra attrs after `process_weights_after_loading`. (#16854) · ed246203
  Charlie Fu authored Apr 28, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  ed246203
- [BugFix] Fix cascade attention - RuntimeError: scheduler_metadata must have... · cc5befbc
  Lucas Wilkinson authored Apr 28, 2025
```
[BugFix] Fix cascade attention - RuntimeError: scheduler_metadata must have shape (metadata_size) (#17283)
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  cc5befbc
- [Security] Don't bind tcp zmq socket to all interfaces (#17197) · a0304dc5
  Russell Bryant authored Apr 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  a0304dc5
- Explicitly explain quant method override ordering and ensure all overrides are ordered (#17256) · c7941cca
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c7941cca