Commits · ca034fd52e231849b2bdb7c9721b3ce5df2d107c · OpenDAS / vllm_cscc

06 Sep, 2025 6 commits
- Update version.py · 59a345ac
  gaoqiong authored Sep 06, 2025
  
  59a345ac
- 回退修改的version.py · 4e471b8a
  gaoqiong authored Sep 06, 2025
  
  4e471b8a
- [P/D][Feature]显存调度优化，及时释放tensor · ed392378
  zhuwenwen authored Sep 06, 2025
  
  ed392378
- [fix]fix tests of neuron, quantization etc · dc2aff4c
  zhuwenwen authored Sep 06, 2025
  
  dc2aff4c
- fix precision issue in mtp · 2a4a2877
  lizhigong authored Sep 05, 2025
  
  2a4a2877
- 增加reduce修改 · 863176e5
  SAC_fanth authored Sep 06, 2025
  
  863176e5
04 Sep, 2025 4 commits
- fix performance issues caused by enabling TBO · 424cccfe
  lizhigong authored Sep 04, 2025
  
  424cccfe
- fix bugs in zero overhead and tbo · f6f8db81
  lizhigong authored Sep 03, 2025
  
  f6f8db81
- 暂时去掉profilling标志位，避免影响其他模型 · 8d971060
  王敏 authored Sep 04, 2025
  
  8d971060
- add glm-4.5-air-tp8 nn moe configs · 7a97637e
  zhuwenwen authored Sep 04, 2025
  
  7a97637e
03 Sep, 2025 2 commits
- [fix]fix tests of v1 and worker · a7668e46
  zhuwenwen authored Sep 03, 2025
  
  a7668e46
- fix deepseek pp + mtp issue · bfffd59a
  lizhigong authored Sep 02, 2025
  
  bfffd59a
02 Sep, 2025 1 commit
- remove topk_ids · 4a62a3eb
  zhuwenwen authored Sep 02, 2025
  
  4a62a3eb
01 Sep, 2025 3 commits
- [fix]fix tests of fused_moe · 58bbb720
  zhuwenwen authored Sep 01, 2025
  
  58bbb720
- [BugFix]支持v1 engine pp deepseek · 4a946680
  zhuwenwen authored Sep 01, 2025
  
  4a946680
- add dca and sparse attention support on rocm · 12112a4d
  zhuwenwen authored Sep 01, 2025
  
  12112a4d
29 Aug, 2025 3 commits
- fix bug in zero-overhead core · 7d1b0c5e
  lizhigong authored Aug 29, 2025
  
  7d1b0c5e
- add benchmark_moe.py to perf · fb94600a
  zhuwenwen authored Aug 29, 2025
  
  fb94600a
- 修复residual FP16 overflow，解决mtp采样率和数据集精度的冲突 · 080ed180
  yangql authored Aug 29, 2025
  
  080ed180
28 Aug, 2025 1 commit
- 优化 block_tables 的生成逻辑，增加对混合情况的检测，确保在存在空和非空块时正确计算最大块长度。 · 4932783d
  laibao authored Aug 28, 2025
  
  4932783d
27 Aug, 2025 2 commits
- feat: w4a8 marlin合入主分支, 通过-q slimquant_w4a8_marlin 可以启用 · 533d4c72
  jujl1 authored Aug 27, 2025
  
  533d4c72
- when use tbo, deepseek prefill use eager · 8702264b
  lizhigong authored Aug 27, 2025
  
  8702264b
26 Aug, 2025 4 commits
- feat: w4a8 marlin 初版合入 · d0181e5a
  jujl1 authored Aug 25, 2025
  
  d0181e5a
- [fix]fix tests of kernels · 31584b45
  zhuwenwen authored Aug 26, 2025
  
  31584b45
- debug and fix error · a01df4a6
  lizhigong authored Aug 26, 2025
  
  a01df4a6
- v1 engine eager tbo support mla attention · 91ccb1cc
  lizhigong authored Aug 26, 2025
  
  91ccb1cc
25 Aug, 2025 2 commits
- fix self.drafter error · ba29eebb
  lizhigong authored Aug 25, 2025
  
  ba29eebb
- Remove the synchronization introduced by the verification logic when mtp is enabled. · 2fe2d237
  lizhigong authored Aug 25, 2025
  
  2fe2d237
22 Aug, 2025 2 commits
- update cuda_graph_sizes · 15347448
  zhuwenwen authored Aug 22, 2025
  
  15347448
- support adaptive max_num_seqs and cuda_graph_sizes · 65225897
  zhuwenwen authored Aug 22, 2025
  
  65225897
21 Aug, 2025 2 commits
- revert 修改flashmla的接口 · 9b67a1e0
  zhuwenwen authored Aug 21, 2025
  
  9b67a1e0
- update gen_model_json · 9c266e36
  zhuwenwen authored Aug 21, 2025
  
  9c266e36
20 Aug, 2025 4 commits
- set v1 attention use fa · f7beb354
  zhuwenwen authored Aug 20, 2025
  
  f7beb354
- update value_stride_order · 716852ab
  zhuwenwen authored Aug 20, 2025
  
  716852ab
- [fix]v0 SamplerOutput在非tree decoding时不传入logits · 01692be6
  王敏 authored Aug 20, 2025
  
  01692be6
- add ggml_dequantize · 9a4a94ee
  zhuwenwen authored Aug 20, 2025
  
  9a4a94ee
19 Aug, 2025 2 commits
- update v1 fa layout · 864c718a
  zhuwenwen authored Aug 19, 2025
  
  864c718a
- set VLLM_USE_GLOBAL_CACHE13=False · f3e13c54
  zhuwenwen authored Aug 19, 2025
  
  f3e13c54
18 Aug, 2025 2 commits
- fix issue from merge · 2e66885c
  lizhigong authored Aug 18, 2025
  
  2e66885c
- [fix]解决v1 deepseek cudagraph模式显存占用增长 · 81175fe4
  王敏 authored Aug 18, 2025
  
  81175fe4