Commits · 3fb0bfcafabcf3b49c3150bcbee6ca178ca5e4d1 · OpenDAS / vllm_cscc

22 May, 2025 2 commits
- 优化awq权重转换的方式，修复可能会导致蒸馏模型加载时报错的bug · a94ed3ea
  yangql authored May 22, 2025
  
  a94ed3ea
- fix tbo to support deepseek · 0cc7c880
  lizhigong authored May 22, 2025
  
  0cc7c880
20 May, 2025 2 commits
- support qiyuan-8b-v2 and FM9GForCausalLM · 8fb5dea5
  zhuwenwen authored May 20, 2025
  
  8fb5dea5
- support Z100L and K100 inference · a5aa55e8
  zhuwenwen authored May 20, 2025
  
  a5aa55e8
19 May, 2025 4 commits
- [fix]修复开启并行解码后，打印"Current platform rocm does not have 'Event' attribute"问题 · 1b3f4b5b
  王敏 authored May 19, 2025
  
  1b3f4b5b
- 优化stream的初始化和warmup方式 · 828aeaae
  lizhigong authored May 19, 2025
  
  828aeaae
- 增加PA_TC kv cache int8/fp8支持 · e02d110d
  zhangshao authored May 19, 2025
  
  e02d110d
- 调试tbo正确性 · 56ffc380
  lizhigong authored May 19, 2025
  
  56ffc380
16 May, 2025 2 commits
- update qwen3_moe.py · 9b0aa006
  zhuwenwen authored May 16, 2025
  
  9b0aa006
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929
15 May, 2025 3 commits
- fix qwen3-235b run error and remove update_environment_variables of hip · 3f9af065
  zhuwenwen authored May 15, 2025
  
  3f9af065
- update pt_weights_iterator · 9cff1203
  zhuwenwen authored May 15, 2025
  
  9cff1203
- add perf scripts · b4a253fc
  zhuwenwen authored May 15, 2025
  
  b4a253fc
14 May, 2025 3 commits
- recover log of request_id · 26b1805e
  zhuwenwen authored May 14, 2025
  
  26b1805e
- add kvint8 · 6d105cc4
  xiabo authored May 14, 2025
  
  6d105cc4
- add kvint8 · 45273722
  xiabo authored May 14, 2025
  
  45273722
13 May, 2025 2 commits
- support cutlass prefix-cache · bdc70899
  zhuwenwen authored May 13, 2025
  
  bdc70899
- add qwen3 moe configs · 09e372e7
  zhuwenwen authored May 13, 2025
```
support telechat2 and glm4 nn layout
remove log of request_id
```
  09e372e7
09 May, 2025 12 commits
- debug on v0.8.5 · cf1d8464
  lizhigong authored May 09, 2025
  
  cf1d8464
- roll back unused change · 29e922ac
  lizhigong authored May 09, 2025
  
  29e922ac
- pause speculative decoding with zero overhead scheduling, develop tbo first · 0ee425a6
  lizhigong authored May 08, 2025
  
  0ee425a6
- rm debug log · 7d224eb2
  lizhigong authored May 08, 2025
  
  7d224eb2
- debug spec decode zero overhead · 0ecda6d1
  lizhigong authored May 08, 2025
  
  0ecda6d1
- add spec decode zero overhead · 01c30741
  lizhigong authored Apr 27, 2025
  
  01c30741
- delete triton kernel ,use tensor indices · b01c8270
  lizhigong authored Apr 27, 2025
  
  b01c8270
- fix zero scheduler on v0.8.4 · 1ed30424
  lizhigong authored Apr 27, 2025
  
  1ed30424
- fix stop remote worker bug · 351d607d
  lizhigong authored Apr 27, 2025
  
  351d607d
- add VLLM_ZERO_DISABLE_AUTO_THREAD VLLM_ZERO_NO_THREAD change zero scheduling logic · 9076ef2b
  lizhigong authored Apr 15, 2025
  
  9076ef2b
- debug v0 zero overhead schedule · 4ff58b66
  lizhigong authored Apr 14, 2025
  
  4ff58b66
- add v0 zero overhead · 54294854
  lizhigong authored Apr 11, 2025
  
  54294854
08 May, 2025 4 commits
- fix mtp run error · a0c212c0
  zhuwenwen authored May 08, 2025
  
  a0c212c0
- set VLLM_USE_V1=0 · 3d83fa41
  zhuwenwen authored May 08, 2025
  
  3d83fa41
- set MOE_NN=1 · e5497373
  zhuwenwen authored May 08, 2025
  
  e5497373
- set VLLM_ROCM_MOE_PADDING=0 · ee405280
  zhuwenwen authored May 08, 2025
  
  ee405280
07 May, 2025 4 commits
- [fix]修复cudagraph和eager分段模式开启mla后报错问题 · 91c7bda5
  zhuwenwen authored May 07, 2025
  
  91c7bda5
- update v1 mla · ef8f16f4
  zhuwenwen authored May 07, 2025
  
  ef8f16f4
- update rocm.py · 660af62e
  zhuwenwen authored May 07, 2025
  
  660af62e
- [fix]修复并行解码多机推理报错 · c7096363
  zhuwenwen authored May 07, 2025
  
  c7096363
06 May, 2025 2 commits
- support qwen3-moe nn layout · 4dc24bc8
  zhuwenwen authored May 06, 2025
  
  4dc24bc8
- update update_environment_variables · 15470ae4
  zhuwenwen authored May 06, 2025
  
  15470ae4