Commits · db2c32b08fd0f80f2ac3cf5db03ba706e30a8d3d · OpenDAS / vllm_cscc

31 Oct, 2025 1 commit
- fix pp1 rank error · db2c32b0
  zhuwenwen authored Oct 31, 2025
  
  db2c32b0
29 Oct, 2025 3 commits
- 增加pd分离单实例跨机第二个ip通过配置文件获取。配置文件上设置如下： · 832033f2
  zhuwenwen authored Oct 29, 2025
```
# 第一个ip为D的第一个节点，第二个ip为D的第二个节点,配置:export IP_CONFIG_FILE=/data/xiabo/w4a8_1/ip_config.txt
192.168.1.1 192.168.1.100
192.168.1.2 192.168.1.101
192.168.1.3 192.168.1.102
10.16.1.75 10.16.1.76
```
  832033f2
- remove fp8_e5m2 error · 397b9edd
  zhuwenwen authored Oct 29, 2025
  
  397b9edd
- remove redundant envs · c26cfd1a
  zhuwenwen authored Oct 29, 2025
  
  c26cfd1a
28 Oct, 2025 1 commit
- 修复数据集推理时候decode侧卡住 · 7cbb7097
  maxiao1 authored Oct 28, 2025
  
  7cbb7097
24 Oct, 2025 1 commit

add VLLM_USE_LIGHTOP_MOE_SUM_MUL_ADD · c2e6f453

zhuwenwen authored Oct 24, 2025

support prefix cache on kme
fix the error in test_moe caused by moe align not supporting 511 and 211
multi-modal switching to torch implementation on z100l&k100

c2e6f453

20 Oct, 2025 1 commit
- 修复pd分离开启异步发送时decode侧判断条件卡住 · 4d044f5b
  maxiao1 authored Oct 20, 2025
  
  4d044f5b
17 Oct, 2025 3 commits
- Set the default value of routed_scaling_factor to 1 · 4c20b890
  zhuwenwen authored Oct 17, 2025
  
  4c20b890
- fix v0 eager fa-pa acc error · 2c16c7a4
  zhuwenwen authored Oct 17, 2025
  
  2c16c7a4
- 支持pd分离p2p_async & 解决oom问题 · 6ca3d790
  zhuwenwen authored Oct 17, 2025
  
  6ca3d790
15 Oct, 2025 7 commits
- 修复awq 的mtp中的blockint8的问题 · 0cc9bc74
  yangql authored Oct 15, 2025
  
  0cc9bc74
- update deepseek_v2.py · 4b3e2d5e
  zhuwenwen authored Oct 15, 2025
  
  4b3e2d5e
- update deepseek_v2.py · 4ae3fc04
  zhuwenwen authored Oct 15, 2025
  
  4ae3fc04
- 删除DPSK_FP16_QUICK，以及增加awq和blockwiseint8的shared_output接口 · 50cb9270
  yangql authored Oct 15, 2025
  
  50cb9270
- set VLLM_USE_OPT_MOE_SUM=1 and VLLM_USE_LIGHTOP_MOE_SUM=1 · 15ef12c1
  zhuwenwen authored Oct 15, 2025
  
  15ef12c1
- 删除DPSK_FP16_QUICK，以及增加awq和blockwiseint8的shared_output接口 · 7f459b46
  yangql authored Oct 15, 2025
  
  7f459b46
- support --no-enable-chunked-prefill of v1 · 2c4b2c80
  zhuwenwen authored Oct 15, 2025
  
  2c4b2c80
14 Oct, 2025 1 commit
- remove redundant maybe_calc_kv_scales · c3b8a0ae
  zhuwenwen authored Oct 14, 2025
  
  c3b8a0ae
13 Oct, 2025 9 commits
- 去掉all2all ep相关代码 · 0b467604
  王敏 authored Oct 13, 2025
  
  0b467604
- update the envs for moe_sum and moe_align · 766663e6
  zhuwenwen authored Oct 13, 2025
  
  766663e6
- update moe_sum and moe_align · 1277ff09
  zhuwenwen authored Oct 13, 2025
  
  1277ff09
- optimize the implementation of moe_sum (lightop) · 7e68a7fe
  zhuwenwen authored Oct 13, 2025
  
  7e68a7fe
- remove --no-enable-chunked-prefill of v1 · bdaaf39d
  zhuwenwen authored Oct 13, 2025
  
  bdaaf39d
- optimize the implementation of moe_sum · 06a1bee2
  zhuwenwen authored Oct 13, 2025
  
  06a1bee2
- disable cascade_attn · b7989b07
  zhuwenwen authored Oct 13, 2025
  
  b7989b07
- support dsv32 · 633f8199
  zhuwenwen authored Oct 13, 2025
  
  633f8199
- 新增fp8—e5m2 · ed3cdc81
  zhuwenwen authored Oct 13, 2025
  
  ed3cdc81
12 Oct, 2025 1 commit
- [fix]修复开启dp并且不开启ep报vmfault · f0f159a4
  王敏 authored Oct 12, 2025
  
  f0f159a4
11 Oct, 2025 3 commits
- close profile.StartTracer · a92daffa
  maxiao1 authored Oct 11, 2025
  
  a92daffa
- fix pd send async perfomance · 1707bebe
  maxiao1 authored Oct 11, 2025
  
  1707bebe
- change tbo about cudagrah · e42a922c
  maxiao1 authored Oct 11, 2025
  
  e42a922c
10 Oct, 2025 6 commits
- roll back version.py · 394648be
  lizhigong authored Oct 10, 2025
  
  394648be
- token split by token adapt to pd separation & p2p can be used async · 1a135a9d
  maxiao1 authored Oct 10, 2025
  
  1a135a9d
- keep same version · fc5bfc66
  maxiao1 authored Oct 10, 2025
  
  fc5bfc66
- pd分离_tbo · 12291212
  maxiao1 authored Oct 06, 2025
  
  12291212
- When VLLM_USE_FLASH_ATTN_PA=0, support the use of default block_size · 3daae57c
  zhuwenwen authored Oct 10, 2025
  
  3daae57c
- fix deepseek_v2.py · 2e1d8e9a
  zhuwenwen authored Oct 10, 2025
  
  2e1d8e9a
09 Oct, 2025 3 commits
- 优化mori ep · 5dcc5cb8
  王敏 authored Oct 09, 2025
  
  5dcc5cb8
- [fix]优化mori ep · 8b791547
  王敏 authored Oct 09, 2025
  
  8b791547
- Revert "Merge branch 'v0.9.2-dev-lmcache-pd' into 'v0.9.2-dev'" · 7b30ecd8
  zhuwenwen authored Oct 09, 2025
```
This reverts merge request !219
```
  7b30ecd8