Commits · ce9db3f23c859a7571f81376ea461e34dbcd4bbe · OpenDAS / vllm_cscc

28 May, 2025 5 commits
- [feat]量化模型添加支持 moe_fused_gate kernel，并使用VLLM_ENABLE_MOE_FUSED_GATE环境变量控制开关，默认打开 · 1016e339
  王敏 authored May 28, 2025
  
  1016e339
- update use_rocm_custom_paged_attention · df877aad
  zhuwenwen authored May 28, 2025
  
  df877aad
- add cpm tokenizer · d2e73fb4
  zhuwenwen authored May 28, 2025
  
  d2e73fb4
- set VLLM_FLASH_ATTN_BACKEND to use FlashAttention Backend for attention computation on rocm · 82f60bef
  zhuwenwen authored May 28, 2025
  
  82f60bef
- using triton prefix cache on BW · 07b41ddf
  zhuwenwen authored May 28, 2025
  
  07b41ddf
27 May, 2025 2 commits
- [feat]适配sgl moe_fused_gate kernel · 0b229519
  王敏 authored May 27, 2025
  
  0b229519
- 修复0.8.5 config找不到的bug · 823b3332
  gaoqiong authored May 27, 2025
  
  823b3332
26 May, 2025 7 commits
- fix kernels tests of attention and core · f1467ce5
  zhuwenwen authored May 26, 2025
  
  f1467ce5
- debug and fix tbo error in mtp · bf790acd
  lizhigong authored May 26, 2025
  
  bf790acd
- fix tbo support deepseek mtp · 7124e74d
  lizhigong authored May 26, 2025
  
  7124e74d
- [fix]1.去掉lora kernel中的maxnreg参数，暂不支持；2.去掉merge-lora参数 · e14b43ff
  王敏 authored May 26, 2025
  
  e14b43ff
- update arg_utils.py · 19470842
  zhuwenwen authored May 26, 2025
  
  19470842
- Update sequence.py fix assert error。 · d82fa156
  lizhg1 authored May 26, 2025
  
  d82fa156
- update qwen3 moe inference · 7bdb03ea
  zhuwenwen authored May 26, 2025
  
  7bdb03ea
23 May, 2025 5 commits
- fix docstring · 95099cbc
  zhuwenwen authored May 23, 2025
  
  95099cbc
- fix run lora error · c7880912
  zhuwenwen authored May 23, 2025
  
  c7880912
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
- 修改MLA prefill阶段出现的Device2Host拷贝同步现象。 · 3f80d9ac
  lizhigong authored May 22, 2025
  
  3f80d9ac
- update setup.py · cb563bb5
  zhuwenwen authored May 23, 2025
  
  cb563bb5
22 May, 2025 3 commits
- 修改MLA prefill阶段出现的Device2Host拷贝同步现象 · 0c1fa562
  zhuwenwen authored May 22, 2025
  
  0c1fa562
- 优化awq权重转换的方式，修复可能会导致蒸馏模型加载时报错的bug · a94ed3ea
  yangql authored May 22, 2025
  
  a94ed3ea
- fix tbo to support deepseek · 0cc7c880
  lizhigong authored May 22, 2025
  
  0cc7c880
20 May, 2025 2 commits
- support qiyuan-8b-v2 and FM9GForCausalLM · 8fb5dea5
  zhuwenwen authored May 20, 2025
  
  8fb5dea5
- support Z100L and K100 inference · a5aa55e8
  zhuwenwen authored May 20, 2025
  
  a5aa55e8
19 May, 2025 4 commits
- [fix]修复开启并行解码后，打印"Current platform rocm does not have 'Event' attribute"问题 · 1b3f4b5b
  王敏 authored May 19, 2025
  
  1b3f4b5b
- 优化stream的初始化和warmup方式 · 828aeaae
  lizhigong authored May 19, 2025
  
  828aeaae
- 增加PA_TC kv cache int8/fp8支持 · e02d110d
  zhangshao authored May 19, 2025
  
  e02d110d
- 调试tbo正确性 · 56ffc380
  lizhigong authored May 19, 2025
  
  56ffc380
16 May, 2025 2 commits
- update qwen3_moe.py · 9b0aa006
  zhuwenwen authored May 16, 2025
  
  9b0aa006
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929
15 May, 2025 3 commits
- fix qwen3-235b run error and remove update_environment_variables of hip · 3f9af065
  zhuwenwen authored May 15, 2025
  
  3f9af065
- update pt_weights_iterator · 9cff1203
  zhuwenwen authored May 15, 2025
  
  9cff1203
- add perf scripts · b4a253fc
  zhuwenwen authored May 15, 2025
  
  b4a253fc
14 May, 2025 3 commits
- recover log of request_id · 26b1805e
  zhuwenwen authored May 14, 2025
  
  26b1805e
- add kvint8 · 6d105cc4
  xiabo authored May 14, 2025
  
  6d105cc4
- add kvint8 · 45273722
  xiabo authored May 14, 2025
  
  45273722
13 May, 2025 2 commits
- support cutlass prefix-cache · bdc70899
  zhuwenwen authored May 13, 2025
  
  bdc70899
- add qwen3 moe configs · 09e372e7
  zhuwenwen authored May 13, 2025
```
support telechat2 and glm4 nn layout
remove log of request_id
```
  09e372e7
09 May, 2025 2 commits
- debug on v0.8.5 · cf1d8464
  lizhigong authored May 09, 2025
  
  cf1d8464
- roll back unused change · 29e922ac
  lizhigong authored May 09, 2025
  
  29e922ac