Commits · 7624bd057c48f21f4fdb7416894dfbe20c848cfe · OpenDAS / vllm_cscc

23 Dec, 2025 1 commit
- add VLLM_USE_FUSED_FILL_RMS_CAT for dpsk mtp fill + rms*2 + cat · e80dcabe
  zhuwenwen authored Dec 23, 2025
```
update VLLM_USE_LIGHTOP_RMS_ROPE_CONCAT impl
```
  e80dcabe
19 Dec, 2025 2 commits
- update flash_mla_with_kvcache · 1e622f10
  zhuwenwen authored Dec 19, 2025
  
  1e622f10
- update k_cache · 31a3beb5
  zhuwenwen authored Dec 19, 2025
  
  31a3beb5
18 Dec, 2025 2 commits
- update self._q_scale · ee93cb70
  zhuwenwen authored Dec 18, 2025
  
  ee93cb70
- update get_mla_decoding_metadata_dense_fp8 interface and _k_scale&_v_scale · 1acf2d7a
  zhuwenwen authored Dec 18, 2025
  
  1acf2d7a
17 Dec, 2025 4 commits
- update flash_mla_with_kvcache_fp8 interface and k_cache · 77210184
  zhuwenwen authored Dec 17, 2025
  
  77210184
- maintain consistency between k_cache type and q · 3e191138
  zhuwenwen authored Dec 17, 2025
  
  3e191138
- convert q to float8_e4m3fn · da85feb7
  zhuwenwen authored Dec 17, 2025
  
  da85feb7
- remove fuse_rmsnorm_rope_quant_gfx938 · 99981972
  zhuwenwen authored Dec 17, 2025
  
  99981972
16 Dec, 2025 2 commits
- add fuse_rmsnorm_rope_quant_gfx938 to support use fp8_e4m3 mla · 0ce3b670
  zhuwenwen authored Dec 16, 2025
  
  0ce3b670
- add VLLM_USE_FLASH_MLA_FP8 to use mla fp8 · a9f57e73
  zhuwenwen authored Dec 16, 2025
```
set VLLM_USE_LIGHTOP_RMS_ROPE_CONCAT=1
```
  a9f57e73
07 Dec, 2025 1 commit
- sync flashmla get_mla_metadata · 62420b27
  zhuwenwen authored Dec 07, 2025
  
  62420b27
01 Dec, 2025 1 commit
- add VLLM_USE_OPT_RESHAPE_AND_CACHE (test) · 64e307c7
  zhuwenwen authored Dec 01, 2025
  
  64e307c7
23 Nov, 2025 1 commit
- add VLLM_USE_CAT_MLA to use fused cat and mla · 4b00d1ba
  zhuwenwen authored Nov 23, 2025
  
  4b00d1ba
19 Nov, 2025 1 commit
- set VLLM_USE_LIGHTOP_FILL_MOE_ALIGN=0 · 46006aee
  zhuwenwen authored Nov 19, 2025
  
  46006aee
13 Nov, 2025 2 commits
- [fix]解决moe_fused_gate编译错误，去掉mla中mtp部分的修改 · b956fc64
  zhuwenwen authored Nov 13, 2025
```
restore the default settings of disable_cascade_attn
add VLLM_USE_OPT_ZEROS to replace triton_ (torch.zeros)
set default_max_num_batched_tokens = 10240
update qwen3_moe of layernorm
```
  b956fc64
- add VLLM_USE_OPT_ZEROS to replace triton_ (torch.zeros) · b364c176
  zhuwenwen authored Nov 13, 2025
  
  b364c176
12 Nov, 2025 1 commit
- update qwen3_moe of layernorm and activation · a014d6a5
  zhuwenwen authored Nov 12, 2025
  
  a014d6a5
03 Nov, 2025 1 commit
- update moe configs name · 5ca1259e
  zhuwenwen authored Nov 03, 2025
  
  5ca1259e
31 Oct, 2025 1 commit
- update moe configs name · 96d4afdc
  zhuwenwen authored Oct 31, 2025
  
  96d4afdc
29 Oct, 2025 2 commits
- remove fp8_e5m2 error · 397b9edd
  zhuwenwen authored Oct 29, 2025
  
  397b9edd
- remove fp8_e5m2 error · 2b90ecd3
  zhuwenwen authored Oct 29, 2025
  
  2b90ecd3
17 Oct, 2025 1 commit
- fix v0 eager fa-pa acc error · 2c16c7a4
  zhuwenwen authored Oct 17, 2025
  
  2c16c7a4
16 Oct, 2025 1 commit
- fix v0 eager fa-pa acc error · 0adf9cda
  zhuwenwen authored Oct 16, 2025
  
  0adf9cda
14 Oct, 2025 1 commit
- remove redundant maybe_calc_kv_scales · c3b8a0ae
  zhuwenwen authored Oct 14, 2025
  
  c3b8a0ae
13 Oct, 2025 1 commit
- 新增fp8—e5m2 · ed3cdc81
  zhuwenwen authored Oct 13, 2025
  
  ed3cdc81
10 Oct, 2025 3 commits
- keep same version · fc5bfc66
  maxiao1 authored Oct 10, 2025
  
  fc5bfc66
- pd分离_tbo · 12291212
  maxiao1 authored Oct 06, 2025
  
  12291212
- When VLLM_USE_FLASH_ATTN_PA=0, support the use of default block_size · 3daae57c
  zhuwenwen authored Oct 10, 2025
  
  3daae57c
09 Oct, 2025 1 commit
- Revert "Merge branch 'v0.9.2-dev-lmcache-pd' into 'v0.9.2-dev'" · 7b30ecd8
  zhuwenwen authored Oct 09, 2025
```
This reverts merge request !219
```
  7b30ecd8
28 Sep, 2025 1 commit
- 修复kvcache-fp8—e5m2的不能开cp的bug · b2d14ba3
  yangql authored Sep 28, 2025
  
  b2d14ba3
24 Sep, 2025 2 commits
- add env · c6b7a44b
  yangshj1 authored Sep 24, 2025
  
  c6b7a44b
- add engine id · f6fcc8ff
  xuxz authored Sep 24, 2025
  
  f6fcc8ff
23 Sep, 2025 1 commit
- 修复kvcachefp8与cp/pc的冲突 · 8b7daa0d
  yangql authored Sep 23, 2025
  
  8b7daa0d
17 Sep, 2025 1 commit
- fix the performance issue of tbo pd separation · f8985b96
  lizhigong authored Sep 17, 2025
  
  f8985b96
16 Sep, 2025 1 commit
- add pd lmcache · f4fd3a96
  yangshj1 authored Sep 16, 2025
  
  f4fd3a96
13 Sep, 2025 1 commit
- add VLLM_USE_MERGE_ATTN_STATES_OPT to control merge_attn_states support · 2071c380
  zhuwenwen authored Sep 13, 2025
  
  2071c380
11 Sep, 2025 1 commit
- update fa interface · bf3d75f4
  zhuwenwen authored Sep 11, 2025
  
  bf3d75f4
10 Sep, 2025 2 commits
- add rocm merge_attn_states · f6324f60
  zhuwenwen authored Sep 10, 2025
  
  f6324f60
- update the conditions for pad_v on v0 · d6dc122f
  zhuwenwen authored Sep 10, 2025
  
  d6dc122f