Commits · fe393be80b94f07bb7e1e141aa4136138a1f7795 · OpenDAS / vllm_cscc

31 Jul, 2025 1 commit
- [feat]支持v1 engine mtp cudagraph · fe393be8
  王敏 authored Jul 31, 2025
  
  fe393be8
29 Jul, 2025 1 commit
- GLM-4.5 Model Support · 751c492c
  zhuwenwen authored Jul 29, 2025
  
  751c492c
25 Jul, 2025 1 commit
- [Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all... · b35835a1
  zhuwenwen authored Jul 25, 2025
```
[Fix] MLA only supports decode-only full CUDAGraph capture. Make sure all cudagraph capture sizes <= max_num_seq.
```
  b35835a1
22 Jul, 2025 2 commits
- update max_seq_len_to_capture to option int · d560429c
  zhuwenwen authored Jul 22, 2025
  
  d560429c
- update max_seq_len_to_capture to int · 988fc31c
  zhuwenwen authored Jul 22, 2025
  
  988fc31c
21 Jul, 2025 1 commit
- update max_seq_len_to_capture · 72273242
  zhuwenwen authored Jul 21, 2025
  
  72273242
17 Jul, 2025 2 commits
- update adpaptive block_size · 937a3ec1
  zhuwenwen authored Jul 17, 2025
  
  937a3ec1
- update default block_size · 4a84480f
  zhuwenwen authored Jul 17, 2025
  
  4a84480f
12 Jul, 2025 1 commit
- [fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错 · b16f183c
  王敏 authored Jul 12, 2025
  
  b16f183c
06 Jul, 2025 1 commit
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
04 Jul, 2025 1 commit
- [Model][3/N] Automatic conversion of CrossEncoding model (#20168) · 2e26f915
  wang.yuqi authored Jul 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2e26f915
03 Jul, 2025 4 commits
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
- update to PIECEWISE · e0d49ac2
  zhuwenwen authored Jul 03, 2025
  
  e0d49ac2
02 Jul, 2025 3 commits
- [DP] Support external DP Load Balancer mode (#19790) · 657f2f30
  Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  657f2f30
- [Bugfix] Fix the max_seq_len limit of 16384 for DeepSeek models (#20322) · ccbfb1d1
  WangHuaqiang authored Jul 02, 2025
```
Signed-off-by: Wang Huaqiang <huaqiang.wang@intel.com>
```
  ccbfb1d1
- [Frontend] Support configurable mm placeholder strings & flexible video... · 2e7cbf2d
  Chenheli Hua authored Jul 01, 2025
```
[Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  2e7cbf2d
01 Jul, 2025 2 commits
- [Perf] Validate @config in pre-commit instead of dynamically (#20200) · c05596f1
  Lionel Villard authored Jul 01, 2025
```
Signed-off-by: Lionel Villard <villard@us.ibm.com>
```
  c05596f1
- [CLI] Improve CLI arg parsing for `-O`/`--compilation-config` (#20156) · 6d42ce83
  Luka Govedič authored Jun 30, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  6d42ce83
28 Jun, 2025 1 commit
- [BugFix] Fix the incorrect func name in the comments. (config.py) (#20185) · 7b460c25
  Jiayi Yan authored Jun 28, 2025
  
  7b460c25
27 Jun, 2025 4 commits
- [Fix][torch.compile] Enable custom ops by default when Inductor off (#20102) · aafabaa0
  Luka Govedič authored Jun 27, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  aafabaa0
- [Bugfix] Fix flaky failure when getting DP ports (#20151) · 4ab3ac28
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4ab3ac28
- [Model][1/N] Automatic conversion of CrossEncoding model (#20012) · cd4cfee6
  wang.yuqi authored Jun 27, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  cd4cfee6
- 1.临时解决gemm调用到blaslt问题 · 6d172ab4
  王敏 authored Jun 27, 2025
```
2.支持设置v1的chunked_prefill开关
```
  6d172ab4
26 Jun, 2025 2 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- Revert "[Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine" (#20128) · 1f5d178e
  Michael Goin authored Jun 26, 2025
  
  1f5d178e
25 Jun, 2025 3 commits
- [Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine (#20062) · 9f0608fc
  zhrrr authored Jun 26, 2025
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  9f0608fc
- [Chore] debloat some initial logs (#19438) · ba7ba35c
  Aaron Pham authored Jun 25, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  ba7ba35c
- [Frontend] speed up import time of vllm.config (#18036) · 71089341
  David Xia authored Jun 25, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  71089341
23 Jun, 2025 1 commit
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
22 Jun, 2025 3 commits
- [Perf][CLI] Improve overall startup time (#19941) · c4cf2606
  Aaron Pham authored Jun 22, 2025
  
  c4cf2606
- [Chore] dedup logs (#19955) · e91386cd
  Aaron Pham authored Jun 22, 2025
  
  e91386cd
- [MISC] add cpu_kvcache_space_bytes to CacheConfig (#19812) · 2bb246b8
  Ning Xie authored Jun 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2bb246b8
20 Jun, 2025 1 commit
- [Misc] Clean up useless code (#19889) · e773a9e1
  wangxiyuan authored Jun 21, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  e773a9e1
19 Jun, 2025 1 commit

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

18 Jun, 2025 1 commit
- [MISC] correct DeviceConfig device field static type analysis (#19699) · 6e9cc73f
  Ning Xie authored Jun 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6e9cc73f
16 Jun, 2025 2 commits

[MISC] typo fix (#19672) · 26bc46ef
Ning Xie authored Jun 16, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
26bc46ef

[Misc] Fix skipped max-model-len validation when deriving max model length... · b692e9cd

Ye (Charlotte) Qi authored Jun 15, 2025


[Misc] Fix skipped max-model-len validation when deriving max model length from tokenizer config (#19660)
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>

b692e9cd

15 Jun, 2025 1 commit
- Enable prefix caching with full cuda graphs (#19617) · 055915e6
  Woosuk Kwon authored Jun 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  055915e6