Commits · 65225897b568e6f7ef09fedd71898f08d9b3db7a · OpenDAS / vllm_cscc

22 Aug, 2025 1 commit
- support adaptive max_num_seqs and cuda_graph_sizes · 65225897
  zhuwenwen authored Aug 22, 2025
  
  65225897
19 Aug, 2025 1 commit
- update v1 fa layout · 864c718a
  zhuwenwen authored Aug 19, 2025
  
  864c718a
10 Aug, 2025 1 commit
- 更改默认的full _cuda_graph启动方式为false · 3dad13fb
  gaoqiong authored Aug 10, 2025
  
  3dad13fb
08 Aug, 2025 1 commit
- update fa full_cuda_graph support · 513f17a4
  zhuwenwen authored Aug 08, 2025
  
  513f17a4
06 Aug, 2025 1 commit
- update VLLM_FLASH_ATTN_V1 to VLLM_USE_FLASH_ATTN_PA · 88dbf92c
  zhuwenwen authored Aug 06, 2025
  
  88dbf92c
05 Aug, 2025 1 commit
- when using VLLM_FLASH_ATTN_V1, set block_size to 64 · 80a682c7
  zhuwenwen authored Aug 05, 2025
  
  80a682c7
04 Aug, 2025 1 commit
- add step3-vl tuning · 2d364c4e
  zhuwenwen authored Aug 04, 2025
  
  2d364c4e
01 Aug, 2025 1 commit
- set default block_size to 16 · 80045bf7
  zhuwenwen authored Aug 01, 2025
  
  80045bf7
31 Jul, 2025 1 commit
- [feat]支持v1 engine mtp cudagraph · fe393be8
  王敏 authored Jul 31, 2025
  
  fe393be8
29 Jul, 2025 1 commit
- GLM-4.5 Model Support · 751c492c
  zhuwenwen authored Jul 29, 2025
  
  751c492c
25 Jul, 2025 1 commit
- [Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all... · b35835a1
  zhuwenwen authored Jul 25, 2025
```
[Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all cudagraph capture sizes <= max_num_seq.
```
  b35835a1
22 Jul, 2025 2 commits
- update max_seq_len_to_capture to option int · d560429c
  zhuwenwen authored Jul 22, 2025
  
  d560429c
- update max_seq_len_to_capture to int · 988fc31c
  zhuwenwen authored Jul 22, 2025
  
  988fc31c
21 Jul, 2025 1 commit
- update max_seq_len_to_capture · 72273242
  zhuwenwen authored Jul 21, 2025
  
  72273242
17 Jul, 2025 2 commits
- update adpaptive block_size · 937a3ec1
  zhuwenwen authored Jul 17, 2025
  
  937a3ec1
- update default block_size · 4a84480f
  zhuwenwen authored Jul 17, 2025
  
  4a84480f
12 Jul, 2025 1 commit
- [fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错 · b16f183c
  王敏 authored Jul 12, 2025
  
  b16f183c
06 Jul, 2025 1 commit
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
04 Jul, 2025 1 commit
- [Model][3/N] Automatic conversion of CrossEncoding model (#20168) · 2e26f915
  wang.yuqi authored Jul 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2e26f915
03 Jul, 2025 4 commits
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
- update to PIECEWISE · e0d49ac2
  zhuwenwen authored Jul 03, 2025
  
  e0d49ac2
02 Jul, 2025 3 commits
- [DP] Support external DP Load Balancer mode (#19790) · 657f2f30
  Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  657f2f30
- [Bugfix] Fix the max_seq_len limit of 16384 for DeepSeek models (#20322) · ccbfb1d1
  WangHuaqiang authored Jul 02, 2025
```
Signed-off-by: Wang Huaqiang <huaqiang.wang@intel.com>
```
  ccbfb1d1
- [Frontend] Support configurable mm placeholder strings & flexible video... · 2e7cbf2d
  Chenheli Hua authored Jul 01, 2025
```
[Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  2e7cbf2d
01 Jul, 2025 2 commits
- [Perf] Validate @config in pre-commit instead of dynamically (#20200) · c05596f1
  Lionel Villard authored Jul 01, 2025
```
Signed-off-by: Lionel Villard <villard@us.ibm.com>
```
  c05596f1
- [CLI] Improve CLI arg parsing for `-O`/`--compilation-config` (#20156) · 6d42ce83
  Luka Govedič authored Jun 30, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  6d42ce83
28 Jun, 2025 1 commit
- [BugFix] Fix the incorrect func name in the comments. (config.py) (#20185) · 7b460c25
  Jiayi Yan authored Jun 28, 2025
  
  7b460c25
27 Jun, 2025 4 commits
- [Fix][torch.compile] Enable custom ops by default when Inductor off (#20102) · aafabaa0
  Luka Govedič authored Jun 27, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  aafabaa0
- [Bugfix] Fix flaky failure when getting DP ports (#20151) · 4ab3ac28
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4ab3ac28
- [Model][1/N] Automatic conversion of CrossEncoding model (#20012) · cd4cfee6
  wang.yuqi authored Jun 27, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  cd4cfee6
- 1.临时解决gemm调用到blaslt问题 · 6d172ab4
  王敏 authored Jun 27, 2025
```
2.支持设置v1的chunked_prefill开关
```
  6d172ab4
26 Jun, 2025 2 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- Revert "[Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine" (#20128) · 1f5d178e
  Michael Goin authored Jun 26, 2025
  
  1f5d178e
25 Jun, 2025 3 commits
- [Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine (#20062) · 9f0608fc
  zhrrr authored Jun 26, 2025
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  9f0608fc
- [Chore] debloat some initial logs (#19438) · ba7ba35c
  Aaron Pham authored Jun 25, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  ba7ba35c
- [Frontend] speed up import time of vllm.config (#18036) · 71089341
  David Xia authored Jun 25, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  71089341
23 Jun, 2025 1 commit
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
22 Jun, 2025 1 commit
- [Perf][CLI] Improve overall startup time (#19941) · c4cf2606
  Aaron Pham authored Jun 22, 2025
  
  c4cf2606