Commits · 0896c8efd87258beb9b30b5cabbd97b377efbb2b · OpenDAS / vllm_cscc

06 Aug, 2025 5 commits
- update warmup_sampling_params · 0896c8ef
  zhuwenwen authored Aug 06, 2025
  
  0896c8ef
- Revert "Revert "[feat]优化mtp相关函数返回类型"" · c17574bd
  zhuwenwen authored Aug 06, 2025
```
This reverts commit c34fa0bf.
```
  c17574bd
- Revert "Revert "[feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样"" · 467490e6
  zhuwenwen authored Aug 06, 2025
```
This reverts commit 33485749.
```
  467490e6
- Revert "[feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样" · 33485749
  zhuwenwen authored Aug 06, 2025
```
This reverts commit 93fae6b1.
```
  33485749
- Revert "[feat]优化mtp相关函数返回类型" · c34fa0bf
  zhuwenwen authored Aug 06, 2025
```
This reverts commit edc45625.
```
  c34fa0bf
05 Aug, 2025 7 commits
- [feat]优化mtp相关函数返回类型 · edc45625
  zhuwenwen authored Aug 05, 2025
  
  edc45625
- [feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样 · 93fae6b1
  zhuwenwen authored Aug 05, 2025
  
  93fae6b1
- add tbo on v1 engine · 3d57a0d3
  zhuwenwen authored Aug 05, 2025
  
  3d57a0d3
- update lmslim import · 87d03653
  zhuwenwen authored Aug 05, 2025
  
  87d03653
- add glm4.5 k100-ai config · 92160378
  zhuwenwen authored Aug 05, 2025
  
  92160378
- add step3-vl k100-ai config · 375fdfb0
  zhuwenwen authored Aug 05, 2025
  
  375fdfb0
- when using VLLM_FLASH_ATTN_V1, set block_size to 64 · f54639f9
  zhuwenwen authored Aug 05, 2025
  
  f54639f9
04 Aug, 2025 2 commits
- add step3-vl tuning · 33d6c159
  zhuwenwen authored Aug 04, 2025
  
  33d6c159
- update conv layout · 71e4b817
  zhuwenwen authored Aug 04, 2025
  
  71e4b817
02 Aug, 2025 1 commit
- add glm4.5 config · 54b9592c
  zhuwenwen authored Aug 02, 2025
  
  54b9592c
01 Aug, 2025 9 commits
- set default block_size to 16 · d8a060dd
  zhuwenwen authored Aug 01, 2025
  
  d8a060dd
- update N to N1 · 66092265
  zhuwenwen authored Aug 01, 2025
  
  66092265
- 增加w4a8相关支持修改 · 531c6304
  zhuwenwen authored Aug 01, 2025
  
  531c6304
- update rocm.py · 386e5c47
  zhuwenwen authored Aug 01, 2025
  
  386e5c47
- update num_rejected_tokens and num_speculative_tokens · e3cacb3b
  zhuwenwen authored Aug 01, 2025
  
  e3cacb3b
- update linear.py · 7bb28d54
  zhuwenwen authored Aug 01, 2025
  
  7bb28d54
- remove num_speculative_tokens init val · 54ab90dd
  zhuwenwen authored Aug 01, 2025
  
  54ab90dd
- [Model] Add step3 vl · 9f7a7815
  zhuwenwen authored Aug 01, 2025
  
  9f7a7815
- [feat]支持v1 engine mtp cudagraph · 00e13357
  zhuwenwen authored Aug 01, 2025
  
  00e13357
31 Jul, 2025 6 commits
- update unused code · 3de379de
  zhuwenwen authored Jul 31, 2025
  
  3de379de
- 去除多余的w4a8参数 · 5ad884ee
  zhuwenwen authored Jul 31, 2025
```
增加fused moe文件中w4a8的相关修改
fix: 修复W8A8读config路径错误，删除int8_utils.py文件
fix: 修复W8A8INT8读config问题
修改W4A8 以及W8A8量化量化092接口
```
  5ad884ee
- update List[int] and update num_rejected_tokens · f137e58c
  zhuwenwen authored Jul 31, 2025
  
  f137e58c
- remove unused code · 1b78ef29
  zhuwenwen authored Jul 31, 2025
  
  1b78ef29
- update common.py · 0628e4b4
  zhuwenwen authored Jul 31, 2025
  
  0628e4b4
- update arg_utils.py · 2ae3fdba
  zhuwenwen authored Jul 31, 2025
  
  2ae3fdba
30 Jul, 2025 1 commit
- [Bugfix][P/D]skip fusedmoe layer for start_load_kv · 05c3c3bb
  zhuwenwen authored Jul 30, 2025
```
[Bugfix][P/D]Slove the problem that attn_medadata is not MLACommonMetadata
```
  05c3c3bb
29 Jul, 2025 1 commit
- GLM-4.5 Model Support · 751c492c
  zhuwenwen authored Jul 29, 2025
  
  751c492c
28 Jul, 2025 1 commit
- add v1 cpm support · 98958aed
  zhuwenwen authored Jul 28, 2025
  
  98958aed
26 Jul, 2025 1 commit
- 增加moe awq-marlin的支持 · c2bcb0ab
  yangql authored Jul 26, 2025
  
  c2bcb0ab
25 Jul, 2025 5 commits
- 修复block-wise的错误参数，以及增加dpsk-fp16-dtype的性能选择功能 · cb37537e
  yangql authored Jul 25, 2025
  
  cb37537e
- [fix]解决deepseek报错 · cf4c84b5
  王敏 authored Jul 25, 2025
  
  cf4c84b5
- [Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all... · b35835a1
  zhuwenwen authored Jul 25, 2025
```
[Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all cudagraph capture sizes <= max_num_seq.
```
  b35835a1
- set VLLM_USE_V1=1 · e4a84fdc
  zhuwenwen authored Jul 25, 2025
  
  e4a84fdc
- Triton-fused DeepseekScalingRotaryEmbedding · 7151fd54
  zhuwenwen authored Jul 25, 2025
  
  7151fd54
24 Jul, 2025 1 commit
- support full_cuda_graph · 8da1c576
  zhuwenwen authored Jul 24, 2025
  
  8da1c576