Commits · aecdff1869c6ae2c923e9d6f164d20f3dd917bcf · OpenDAS / vllm_cscc

28 Nov, 2025 1 commit
- 合入中科嘉禾mp代码 · aecdff18
  gaoqiong authored Nov 28, 2025
  
  aecdff18
04 Nov, 2025 1 commit
- fix index · 6b58062d
  zhuwenwen authored Nov 04, 2025
  
  6b58062d
03 Nov, 2025 3 commits
- use apply_rotary_emb_torch for z100l&k100 · a3695a2b
  zhuwenwen authored Nov 03, 2025
  
  a3695a2b
- update moe configs name · 5ca1259e
  zhuwenwen authored Nov 03, 2025
  
  5ca1259e
- [fix]修复mori报错 · 0e35e124
  王敏 authored Nov 03, 2025
  
  0e35e124
01 Nov, 2025 1 commit
- [feat]整合mori和deepep相关代码 · d698d6f2
  王敏 authored Nov 01, 2025
  
  d698d6f2
31 Oct, 2025 1 commit
- fix pp1 rank error · db2c32b0
  zhuwenwen authored Oct 31, 2025
  
  db2c32b0
29 Oct, 2025 3 commits
- 增加pd分离单实例跨机第二个ip通过配置文件获取。配置文件上设置如下： · 832033f2
  zhuwenwen authored Oct 29, 2025
```
# 第一个ip为D的第一个节点，第二个ip为D的第二个节点,配置:export IP_CONFIG_FILE=/data/xiabo/w4a8_1/ip_config.txt
192.168.1.1 192.168.1.100
192.168.1.2 192.168.1.101
192.168.1.3 192.168.1.102
10.16.1.75 10.16.1.76
```
  832033f2
- remove fp8_e5m2 error · 397b9edd
  zhuwenwen authored Oct 29, 2025
  
  397b9edd
- remove redundant envs · c26cfd1a
  zhuwenwen authored Oct 29, 2025
  
  c26cfd1a
28 Oct, 2025 1 commit
- 修复数据集推理时候decode侧卡住 · 7cbb7097
  maxiao1 authored Oct 28, 2025
  
  7cbb7097
27 Oct, 2025 1 commit
- [feat]w4a8适配deepep ht模式，解决开启dp时mtp>1时卡住问题 · 98b7432a
  王敏 authored Oct 27, 2025
  
  98b7432a
24 Oct, 2025 1 commit

add VLLM_USE_LIGHTOP_MOE_SUM_MUL_ADD · c2e6f453

zhuwenwen authored Oct 24, 2025

support prefix cache on kme
fix the error in test_moe caused by moe align not supporting 511 and 211
multi-modal switching to torch implementation on z100l&k100

c2e6f453

20 Oct, 2025 1 commit
- 修复pd分离开启异步发送时decode侧判断条件卡住 · 4d044f5b
  maxiao1 authored Oct 20, 2025
  
  4d044f5b
17 Oct, 2025 3 commits
- Set the default value of routed_scaling_factor to 1 · 4c20b890
  zhuwenwen authored Oct 17, 2025
  
  4c20b890
- fix v0 eager fa-pa acc error · 2c16c7a4
  zhuwenwen authored Oct 17, 2025
  
  2c16c7a4
- 支持pd分离p2p_async & 解决oom问题 · 6ca3d790
  zhuwenwen authored Oct 17, 2025
  
  6ca3d790
15 Oct, 2025 7 commits
- 修复awq 的mtp中的blockint8的问题 · 0cc9bc74
  yangql authored Oct 15, 2025
  
  0cc9bc74
- update deepseek_v2.py · 4b3e2d5e
  zhuwenwen authored Oct 15, 2025
  
  4b3e2d5e
- update deepseek_v2.py · 4ae3fc04
  zhuwenwen authored Oct 15, 2025
  
  4ae3fc04
- 删除DPSK_FP16_QUICK，以及增加awq和blockwiseint8的shared_output接口 · 50cb9270
  yangql authored Oct 15, 2025
  
  50cb9270
- set VLLM_USE_OPT_MOE_SUM=1 and VLLM_USE_LIGHTOP_MOE_SUM=1 · 15ef12c1
  zhuwenwen authored Oct 15, 2025
  
  15ef12c1
- 删除DPSK_FP16_QUICK，以及增加awq和blockwiseint8的shared_output接口 · 7f459b46
  yangql authored Oct 15, 2025
  
  7f459b46
- support --no-enable-chunked-prefill of v1 · 2c4b2c80
  zhuwenwen authored Oct 15, 2025
  
  2c4b2c80
14 Oct, 2025 1 commit
- remove redundant maybe_calc_kv_scales · c3b8a0ae
  zhuwenwen authored Oct 14, 2025
  
  c3b8a0ae
13 Oct, 2025 10 commits
- 去掉all2all ep相关代码 · 0b467604
  王敏 authored Oct 13, 2025
  
  0b467604
- [fix]解决mori ep dp>1时cudagraph卡住问题 · f505d366
  王敏 authored Oct 13, 2025
  
  f505d366
- update the envs for moe_sum and moe_align · 766663e6
  zhuwenwen authored Oct 13, 2025
  
  766663e6
- update moe_sum and moe_align · 1277ff09
  zhuwenwen authored Oct 13, 2025
  
  1277ff09
- optimize the implementation of moe_sum (lightop) · 7e68a7fe
  zhuwenwen authored Oct 13, 2025
  
  7e68a7fe
- remove --no-enable-chunked-prefill of v1 · bdaaf39d
  zhuwenwen authored Oct 13, 2025
  
  bdaaf39d
- optimize the implementation of moe_sum · 06a1bee2
  zhuwenwen authored Oct 13, 2025
  
  06a1bee2
- disable cascade_attn · b7989b07
  zhuwenwen authored Oct 13, 2025
  
  b7989b07
- support dsv32 · 633f8199
  zhuwenwen authored Oct 13, 2025
  
  633f8199
- 新增fp8—e5m2 · ed3cdc81
  zhuwenwen authored Oct 13, 2025
  
  ed3cdc81
12 Oct, 2025 1 commit
- [fix]修复开启dp并且不开启ep报vmfault · f0f159a4
  王敏 authored Oct 12, 2025
  
  f0f159a4
11 Oct, 2025 3 commits
- close profile.StartTracer · a92daffa
  maxiao1 authored Oct 11, 2025
  
  a92daffa
- fix pd send async perfomance · 1707bebe
  maxiao1 authored Oct 11, 2025
  
  1707bebe
- change tbo about cudagrah · e42a922c
  maxiao1 authored Oct 11, 2025
  
  e42a922c
10 Oct, 2025 1 commit
- roll back version.py · 394648be
  lizhigong authored Oct 10, 2025
  
  394648be