Commits · 8632e831ba0524f8335d83050b571a7168ea90a6 · OpenDAS / vllm_cscc

14 Jul, 2025 1 commit
- [Core] Add `update_config` RPC method (#20095) · 8632e831
  22quinn authored Jul 13, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  8632e831
13 Jul, 2025 2 commits

[Bugfix] Fix: add patch_rope_scaling after hf override (#20857) · 247102f0
Wang Siyuan authored Jul 13, 2025
```
Signed-off-by: Wang Siyuan <wsy0227@sjtu.edu.cn>
Signed-off-by: Wang Siyuan <sywang0227@gmail.com>
```
247102f0

[Core] Support multiple tasks per model (#20771) · 020f58ab

Nicolò Lucchesi authored Jul 13, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

020f58ab

12 Jul, 2025 2 commits
- [Frontend] Abstract prompt and SpeechToTextConfig for transcriptions models (#20637) · 3c7d942d
  Nicolò Lucchesi authored Jul 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3c7d942d
- Integration SM100 FlashInfer fused allreduce RMSNorm (#20691) · fc0f41d1
  Ilya Markov authored Jul 12, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  fc0f41d1
11 Jul, 2025 3 commits

[Bugfix] Upgrade depyf to 0.19 and streamline custom pass logging (#20777) · 762be26a
Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
```
762be26a
[V1] Enable Mamba2 layers other than MambaMixer2 in the v1 engine (#20660) · 5d09152f
nopperl authored Jul 11, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
5d09152f

Add kimi-k2 tool parser (#20789) · 0cf893ca

bigmoyan authored Jul 11, 2025


Signed-off-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>

0cf893ca

10 Jul, 2025 3 commits
- [Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126) · 41060c6e
  Alex Brooks authored Jul 10, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  41060c6e
- [V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) · d6902ce7
  Nathan Hoos authored Jul 10, 2025
```
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
```
  d6902ce7
- [BugFix] Fix `VllmConfig()` construction on all platforms (#20695) · ffbcc9e7
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ffbcc9e7
09 Jul, 2025 1 commit
- [Bugfix] set default set cuda_graph_sizes to min(self.max_num_seqs * 2, 512) (#20628) · 34dad19e
  zhrrr authored Jul 09, 2025
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  34dad19e
08 Jul, 2025 1 commit

[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e

Sanger Steel authored Jul 08, 2025


[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>

72d14d0e

07 Jul, 2025 2 commits
- [Misc] Add fully interleaved support for multimodal 'string' content format (#14047) · e601efcb
  Anton authored Jul 07, 2025
```
Signed-off-by: drobyshev.anton <drobyshev.anton@wb.ru>
Co-authored-by: drobyshev.anton <drobyshev.anton@wb.ru>
```
  e601efcb
- [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) · 110df743
  wang.yuqi authored Jul 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  110df743
06 Jul, 2025 1 commit
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
04 Jul, 2025 1 commit
- [Model][3/N] Automatic conversion of CrossEncoding model (#20168) · 2e26f915
  wang.yuqi authored Jul 04, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2e26f915
03 Jul, 2025 3 commits
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
02 Jul, 2025 3 commits
- [DP] Support external DP Load Balancer mode (#19790) · 657f2f30
  Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  657f2f30
- [Bugfix] Fix the max_seq_len limit of 16384 for DeepSeek models (#20322) · ccbfb1d1
  WangHuaqiang authored Jul 02, 2025
```
Signed-off-by: Wang Huaqiang <huaqiang.wang@intel.com>
```
  ccbfb1d1
- [Frontend] Support configurable mm placeholder strings & flexible video... · 2e7cbf2d
  Chenheli Hua authored Jul 01, 2025
```
[Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  2e7cbf2d
01 Jul, 2025 2 commits
- [Perf] Validate @config in pre-commit instead of dynamically (#20200) · c05596f1
  Lionel Villard authored Jul 01, 2025
```
Signed-off-by: Lionel Villard <villard@us.ibm.com>
```
  c05596f1
- [CLI] Improve CLI arg parsing for `-O`/`--compilation-config` (#20156) · 6d42ce83
  Luka Govedič authored Jun 30, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  6d42ce83
28 Jun, 2025 1 commit
- [BugFix] Fix the incorrect func name in the comments. (config.py) (#20185) · 7b460c25
  Jiayi Yan authored Jun 28, 2025
  
  7b460c25
27 Jun, 2025 3 commits
- [Fix][torch.compile] Enable custom ops by default when Inductor off (#20102) · aafabaa0
  Luka Govedič authored Jun 27, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  aafabaa0
- [Bugfix] Fix flaky failure when getting DP ports (#20151) · 4ab3ac28
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4ab3ac28
- [Model][1/N] Automatic conversion of CrossEncoding model (#20012) · cd4cfee6
  wang.yuqi authored Jun 27, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  cd4cfee6
26 Jun, 2025 2 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- Revert "[Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine" (#20128) · 1f5d178e
  Michael Goin authored Jun 26, 2025
  
  1f5d178e
25 Jun, 2025 3 commits
- [Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine (#20062) · 9f0608fc
  zhrrr authored Jun 26, 2025
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  9f0608fc
- [Chore] debloat some initial logs (#19438) · ba7ba35c
  Aaron Pham authored Jun 25, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  ba7ba35c
- [Frontend] speed up import time of vllm.config (#18036) · 71089341
  David Xia authored Jun 25, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  71089341
23 Jun, 2025 1 commit
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
22 Jun, 2025 3 commits
- [Perf][CLI] Improve overall startup time (#19941) · c4cf2606
  Aaron Pham authored Jun 22, 2025
  
  c4cf2606
- [Chore] dedup logs (#19955) · e91386cd
  Aaron Pham authored Jun 22, 2025
  
  e91386cd
- [MISC] add cpu_kvcache_space_bytes to CacheConfig (#19812) · 2bb246b8
  Ning Xie authored Jun 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2bb246b8
20 Jun, 2025 1 commit
- [Misc] Clean up useless code (#19889) · e773a9e1
  wangxiyuan authored Jun 21, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  e773a9e1
19 Jun, 2025 1 commit

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee