Commits · 8f605ee30912541126c0fe46d0c8c413101b600a · OpenDAS / vllm_cscc

27 Jul, 2025 5 commits
- Fix CUDA permute/unpermute for use with DeepGemm Moe (#17934) · 57c22e57
  Caleb_Du authored Jul 27, 2025
```
Signed-off-by: Caleb_Du <Caleb_Du@zju.edu.cn>
```
  57c22e57
- [Refactor] Refactor MOE NVFP4 Code Base: ModelOpt + Compressed Tensor (#21631) · bda9d053
  Wentao Ye authored Jul 27, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  bda9d053
- [VLM] Add video support for Intern-S1 (#21671) · 3d847a31
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3d847a31
- [VLM] Support HF format Phi-4-MM model (#17121) · eed2f463
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  eed2f463
- Migrate FuyuImagePatchInputs to TensorSchema (#21662) · 3339cba3
  Benji Beck authored Jul 26, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  3339cba3
26 Jul, 2025 6 commits

Support encoder-only models without KV-Cache (#21270) · 1cd6eaba

Maximilien de Bayser authored Jul 26, 2025


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

1cd6eaba

[Bugfix] Investigate Qwen2-VL failing test (#21527) · f27fdfc3
Isotr0py authored Jul 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
f27fdfc3

Support Intern-S1 (#21628) · 875af38e

Lyu Han authored Jul 26, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

875af38e

[Model] Ultravox: Support Llama 4 and Gemma 3 backends (#17818) · 62965de5

Farzad Abdolhosseini authored Jul 26, 2025


Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
Signed-off-by: Patrick Li <patrick8289@gmail.com>
Co-authored-by: Patrick Li <patrick8289@gmail.com>

62965de5

[Feature] Add support for MoE models in the calibration-free RTN-based quantization (#20766) · 7ae75fa6
Alex Kogan authored Jul 25, 2025
```
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
```
7ae75fa6
Add interleaved RoPE test for Llama4 (Maverick) (#21478) · 2eddd437
Yong Hoon Shin authored Jul 25, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
2eddd437

25 Jul, 2025 10 commits
- [TPU][Test] Rollback PR-21550. (#21619) · 7cfea0df
  QiliangCui authored Jul 25, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  7cfea0df
- Add support for Prithvi in Online serving mode (#21518) · e189b50f
  mgazz authored Jul 25, 2025
```
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e189b50f
- [ROCm][AITER] Enable fp8 kv cache on rocm aiter backend. (#20295) · b3caeb82
  who who who authored Jul 25, 2025
```
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: amd-ruitang3 <Rui.Tang2@amd.com>
Co-authored-by: amd-ruitang3 <Rui.Tang2@amd.com>
```
  b3caeb82
- [MODEL] New model support for naver-hyperclovax/HyperCLOVAX-SEED-Vision-Instruct-3B (#20931) · 29c6fbe5
  bigshanedogg authored Jul 25, 2025
```
Signed-off-by: bigshanedogg <bigshane319@gmail.com>
```
  29c6fbe5
- [Tests] Harden DP tests (#21508) · e38e96a3
  Nick Hill authored Jul 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  e38e96a3
- [TPU][Bugfix] fix OOM issue in CI test (#21550) · 40d86ee4
  Chengji Yao authored Jul 24, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  40d86ee4
- Integrate TensorSchema with shape validation for Phi3VImagePixelInputs (#21232) · 965bc71b
  Benji Beck authored Jul 24, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  965bc71b
- [TPU][Test] Temporarily suspend this MoE model in test_basic.py. (#21560) · e0be2c4d
  QiliangCui authored Jul 24, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  e0be2c4d
- [DP] Support api-server-count > 0 in hybrid DP LB mode (#21510) · 9c8b2c2a
  Nick Hill authored Jul 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9c8b2c2a
- [Frontend] `run-batch` supports V1 (#21541) · 34ddcf9f
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34ddcf9f
24 Jul, 2025 13 commits
- [TPU][TEST] HF_HUB_DISABLE_XET=1 the test 3. (#21539) · 07d80d7b
  QiliangCui authored Jul 24, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  07d80d7b
- [P/D] Support CPU Transfer in NixlConnector (#18293) · 60662849
  Juncheng Gu authored Jul 24, 2025
```
Signed-off-by: Juncheng Gu <juncgu@gmail.com>
Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Richard Liu <39319471+richardsliu@users.noreply.github.com>
Co-authored-by: Richard Liu <ricliu@google.com>
```
  60662849
- [P/D] Move FakeNixlWrapper to test dir (#21328) · 1e9ea8e6
  Rui Qiao authored Jul 24, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  1e9ea8e6
- [Bugfix] Fix CUDA arch flags for MoE permute (#21426) · 2ded067f
  Ming Yang authored Jul 24, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  2ded067f
- [Model] Officially support Emu3 with Transformers backend (#21319) · 13abd0ea
  Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13abd0ea
- [Attention] Optimize FlashInfer MetadataBuilder Build call (#21137) · 61b8cea3
  Lucas Wilkinson authored Jul 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  61b8cea3
- [Core] Support model loader plugins (#21067) · 610852a4
  22quinn authored Jul 24, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  610852a4
- [v1][Core] Clean up usages of `SpecializedManager` (#21407) · fc5f756d
  Zhou Fang authored Jul 24, 2025
```
Signed-off-by: Zhou Fang <fang.github@gmail.com>
```
  fc5f756d
- [TPU][Bugfix] fix moe layer (#21340) · e74bfc70
  Chengji Yao authored Jul 24, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  e74bfc70
- Add think chunk (#21333) · 6d8d0a24
  Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6d8d0a24
- [DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8
  Robert Shaw authored Jul 23, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  d5b981f8
- [XPU][UT] increase intel xpu CI test scope (#21492) · 13e4ee1d
  Liangliang Ma authored Jul 24, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  13e4ee1d
- [Misc] Add dummy maverick test to CI (#21324) · 772ce5af
  Ming Yang authored Jul 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  772ce5af
23 Jul, 2025 6 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [Core] Add `reload_weights` RPC method (#20096) · 5c9b807b
  22quinn authored Jul 23, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  5c9b807b
- Add test case for compiling multiple graphs (#21044) · 4ac7713e
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  4ac7713e
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [Tests] Add tests for headless internal DP LB (#21450) · 316b1bf7
  Nick Hill authored Jul 23, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  316b1bf7
- [Model] add Hunyuan V1 Dense Model support. (#21368) · 2671334d
  Asher authored Jul 23, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  2671334d