Commits · 287f527f5403bb42a32136cf6c802faeb92a09ef · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "8f9c28fd40a9daa744d08cacb0bd5ac2247a97d1"

30 Jul, 2025 13 commits
- [Feature] Add async tensor parallelism for scaled mm (#20155) · 287f527f
  cascade authored Jul 30, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  287f527f
- [Misc] Support more collective_rpc return types (#21845) · 56bd537d
  Nick Hill authored Jul 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  56bd537d
- feat(distributed): add `get_required_kvcache_layout` class method to kv connector api (#20433) · f4135232
  wxsm authored Jul 31, 2025
```
Signed-off-by: wxsm <wxsms@foxmail.com>
```
  f4135232
- [Bugfix] SharedStorage Connector for V1 PD multimodal (#21611) · 4904e53c
  Chenguang Zheng authored Jul 31, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
```
  4904e53c
- [CI/Build] Fix registry tests (#21934) · 004203e9
  Cyrus Leung authored Jul 31, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  004203e9
- [Bugfix] Fix TypeError in scheduler when comparing mixed request_id types (#21816) · 5c765aec
  633WHU authored Jul 30, 2025
```
Signed-off-by: chiliu <chiliu@paypal.com>
Co-authored-by: chiliu <chiliu@paypal.com>
```
  5c765aec
- Override attention metadata for fast prefill in some KV sharing setups (#21590) · ad510309
  Yong Hoon Shin authored Jul 30, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  ad510309
- [Bugfix] Fix OOM tests in initialization test (#21921) · 6e599eeb
  Isotr0py authored Jul 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  6e599eeb
- [Misc] Improve code readability of KVCacheManager (#21673) · 8f4a1c9a
  Ruixiang Tan authored Jul 30, 2025
```
Signed-off-by: tanruixiang <tanruixiang0104@gmail.com>
Signed-off-by: Ruixiang Tan <819464715@qq.com>
Signed-off-by: GitHub <noreply@github.com>
```
  8f4a1c9a
- [Test] Add Benchmark and Unit Test for `per_token_group_quant` (#21860) · 0271c2ff
  Wentao Ye authored Jul 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0271c2ff
- [Tests] Fixing bug inside MultiModalProfiler. (#21842) · 54779523
  Varun Vinayak Shenoy authored Jul 30, 2025
```
Signed-off-by: Varun Shenoy <varun.vinayak.shenoy@oracle.com>
```
  54779523
- [Frontend] Add LLM.reward specific to reward models (#21720) · 65f311ce
  wang.yuqi authored Jul 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  65f311ce
- [v1][attention] Support Hybrid Allocator + FlashInfer (#21412) · 555e7225
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  555e7225
29 Jul, 2025 4 commits
- [Bugfix] Fix workspace buffer None issue for Flashinfer TRTLLM Backend (#21525) · 58b11b24
  elvischenv authored Jul 29, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  58b11b24
- [Bugfix] VLLM_V1 supports passing other compilation levels (#19340) · 04e38500
  Richard Zou authored Jul 29, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  04e38500
- [KVCache] Make KVCacheSpec hashable (#21791) · 755fa8b6
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  755fa8b6
- [V0 deprecation] Guided decoding (#21347) · 37efc63b
  Reza Barazesh authored Jul 29, 2025
```
Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  37efc63b
28 Jul, 2025 13 commits

[Kernel] SM90 CUTLASS FP8 GEMM: add support for swap AB + kernel tuning (#20396) · c6c9122d
lyrisz authored Jul 28, 2025
```
Signed-off-by: Faqin Zhong <faqin.zhong@gmail.com>
Co-authored-by: Duncan Moss <djm.moss@gmail.com>
```
c6c9122d
Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778) · b18b417f
Kuntai Du authored Jul 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
b18b417f
Use `metavar` to list the choices for a CLI arg when custom values are also accepted (#21760) · 94b71ae1
Harry Mellor authored Jul 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
94b71ae1
[CI/Build] Fix plugin tests (#21758) · 04fe61aa
Cyrus Leung authored Jul 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
04fe61aa
[Bugfix] Improve JSON extraction in LlamaToolParser (#19024) · 9ace2eaf
Keyang Ru authored Jul 28, 2025
```
Signed-off-by: keru <keyang.ru@oracle.com>
Co-authored-by: keru <keyang.ru@oracle.com>
```
9ace2eaf

[`Ernie 4.5`] Name Change for Base 0.3B Model (#21735) · 656c24f1

Anton Vlasjuk authored Jul 28, 2025


Signed-off-by: vasqu <antonprogamer@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

656c24f1

[Model] Prioritize Transformers fallback over suffix matching (#21719) · a4ed7315
Cyrus Leung authored Jul 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
a4ed7315
[v1][mamba] Added mamba_type into MambaSpec (#21715) · a6c05028
Asaf Joseph Gardin authored Jul 28, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
a6c05028

[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named... · 7656cf4c

Hongsheng Liu authored Jul 28, 2025


[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named function calling when Thinking is disabled (#21573)
Signed-off-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: wangzi <3220100013@zju.edu.cn>

7656cf4c

Migrate Glm4vImageInputs, Glm4vVideoInputs to TensorSchema (#21678) · 88e46c7c

Benji Beck authored Jul 27, 2025


Signed-off-by: Benji Beck <benjibeck@meta.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

88e46c7c

[Model] Support TP/PP/mamba2 kernel for PLaMo2 (#19674) · c7ffe93d

Shinichi Hemmi authored Jul 28, 2025


Signed-off-by: Shinichi Hemmi <shemmi@preferred.jp>
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>
Co-authored-by: Sixue Wang <cecilwang@preferred.jp>

c7ffe93d

[V1] Exception Handling when Loading KV Cache from Remote Store (#21534) · 15a72ac4
Adeline authored Jul 28, 2025
```
Signed-off-by: liuyumoye <adeline_ly2023@outlook.com>
Co-authored-by: liuyumoye <adeline_ly2023@outlook.com>
```
15a72ac4

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

27 Jul, 2025 5 commits
- Fix CUDA permute/unpermute for use with DeepGemm Moe (#17934) · 57c22e57
  Caleb_Du authored Jul 27, 2025
```
Signed-off-by: Caleb_Du <Caleb_Du@zju.edu.cn>
```
  57c22e57
- [Refactor] Refactor MOE NVFP4 Code Base: ModelOpt + Compressed Tensor (#21631) · bda9d053
  Wentao Ye authored Jul 27, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  bda9d053
- [VLM] Add video support for Intern-S1 (#21671) · 3d847a31
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3d847a31
- [VLM] Support HF format Phi-4-MM model (#17121) · eed2f463
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  eed2f463
- Migrate FuyuImagePatchInputs to TensorSchema (#21662) · 3339cba3
  Benji Beck authored Jul 26, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  3339cba3
26 Jul, 2025 5 commits

Support encoder-only models without KV-Cache (#21270) · 1cd6eaba

Maximilien de Bayser authored Jul 26, 2025


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

1cd6eaba

[Bugfix] Investigate Qwen2-VL failing test (#21527) · f27fdfc3
Isotr0py authored Jul 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
f27fdfc3

Support Intern-S1 (#21628) · 875af38e

Lyu Han authored Jul 26, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

875af38e

[Model] Ultravox: Support Llama 4 and Gemma 3 backends (#17818) · 62965de5

Farzad Abdolhosseini authored Jul 26, 2025


Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
Signed-off-by: Patrick Li <patrick8289@gmail.com>
Co-authored-by: Patrick Li <patrick8289@gmail.com>

62965de5

[Feature] Add support for MoE models in the calibration-free RTN-based quantization (#20766) · 7ae75fa6
Alex Kogan authored Jul 25, 2025
```
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
```
7ae75fa6