Commits · dc5e4a653c859573dfcca99f1b0141c2db9f94cc · OpenDAS / vllm_cscc · GitLab

12 Aug, 2025 5 commits
- Upgrade FlashInfer to v0.2.11 (#22613) · dc5e4a65
  Po-Han Huang (NVIDIA) authored Aug 12, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  dc5e4a65
- Re-enable Xet on TPU tests now that `hf_xet` has been updated (#22666) · 839ab003
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  839ab003
- Enable 4bit bnb prequant MOE (#21548) · 9b94d6ec
  Andy Chen authored Aug 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9b94d6ec
- [gpt-oss] Add test for response API + harmony (but skipped) (#22554) · 1891a265
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1891a265
- [gpt-oss] Support streaming in response API (#22431) · 95a935fc
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  95a935fc
11 Aug, 2025 24 commits
- Support more parallel styles in Transformers backend TP (#22651) · 458e74eb
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  458e74eb
- [CI] Skip Tree Attn Test in `test_max_len.py` to unblock CI (#22664) · 65abe111
  TJian authored Aug 11, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  65abe111
- [BugFix] [Spec Decode] Remove LlamaForCausalLMEagle3 to fix CI (#22611) · 807d21b8
  22quinn authored Aug 11, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  807d21b8
- [CI/Build] Skip Mllama HF runner tests with Transformers v4.55.0 (#22659) · c90fb03d
  Isotr0py authored Aug 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c90fb03d
- [Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930) · 84cf78ac
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  84cf78ac
- fix: NIXL connector transfers partial block to pass full multi-modal context (#21074) · 16fb668b
  GuanLuo authored Aug 11, 2025
```
Signed-off-by: GuanLuo <gluo@nvidia.com>
```
  16fb668b
- [Feature] Add `VLLM_USE_DEEP_GEMM_E8M0` Env to Control E8M0 Scale (#21968) · f7dcce7a
  Wentao Ye authored Aug 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f7dcce7a
- [Misc] Further clean up some redundant config definitions (#22649) · 8e13d9fe
  Isotr0py authored Aug 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8e13d9fe
- Document aarch64 CPU support works (#22646) · 3fa5b258
  Eric Curtin authored Aug 11, 2025
```
Signed-off-by: Eric Curtin <ecurtin@redhat.com>
```
  3fa5b258
- [Model] NemotronH Support (#22349) · 14a5d903
  danielafrimi authored Aug 11, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  14a5d903
- [Misc] Move jsontree to utils (#22622) · 951b0382
  Cyrus Leung authored Aug 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  951b0382
- [Misc] Move tensor schema tests (#22612) · ebf7605b
  Cyrus Leung authored Aug 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebf7605b
- [Docs] Add comprehensive CLI reference for all large `vllm` subcommands (#22601) · bc1d02ac
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bc1d02ac
- [BUGFIX] KeyError 'layers.14.mlp.gate.g_idx' for Qwen3-MoE with GPTQ on ROCm (#22017) · 1e55dfa7
  JartX authored Aug 11, 2025
  
  1e55dfa7
- [Misc] benchmark_moe supports expert parallel (#22251) · 384a0529
  Jee Jee Li authored Aug 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  384a0529
- Support token_type_ids in V1 with less code changes (#21985) · 39052dbc
  Maximilien de Bayser authored Aug 11, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  39052dbc
- [ROCm][AITER] Support AITER Rope ops in RotaryEmbedding Module. (#22521) · 9c97a1c3
  vllmellm authored Aug 11, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  9c97a1c3
- [BugFix] Fix logits repetition penalty cuda check (#22592) · f919d4cb
  Eugene Cheah authored Aug 10, 2025
  
  f919d4cb
- [Misc][gpt-oss] guard import when triton kernel when not up to date (#22584) · afa5b7ca
  Zhewen Li authored Aug 10, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  afa5b7ca
- [Misc][gpt-oss] Add rules to label gpt-oss related PRs (#22600) · 1b990280
  Lifans authored Aug 10, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  1b990280
- [BugFix] Fix KVConnectorOutput TPU breakage (#22598) · 5898b135
  Nick Hill authored Aug 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5898b135
- [CI/Build] Fix tensorizer test for load_format change (#22583) · b799f4b9
  22quinn authored Aug 10, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  b799f4b9
- Migrate LlavaImageInputs to TensorSchema (#21770) · 06da44f0
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  06da44f0
- Migrate LlavaNextVideoPixelInputs to TensorSchema (#21843) · a5549917
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a5549917
10 Aug, 2025 11 commits
- enable Docker-aware precompiled wheel setup (#22106) · d1af8b7b
  Doug Smith authored Aug 10, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  d1af8b7b
- Fix TensorSchema validation test for symbolic dims (#22366) · 68b254d6
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  68b254d6
- Remove redundant row_indices unsqueeze operation in MiniCPMO (#22528) · 8c50d62f
  ZiTian Zhao authored Aug 11, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  8c50d62f
- Migrate LlavaNextImageInputs to TensorSchema (#21774) · b4e29167
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b4e29167
- Fix(benchmarks): allow multiple mm contents in OpenAI Chat Completion Benchmarks (#22534) · 65a7917b
  Breno Baldas Skuk authored Aug 10, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
```
  65a7917b
- [Bugfix][Kernel] Support partial rotary embedding for MRoPE triton kernel (#22593) · b76753f0
  Isotr0py authored Aug 11, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b76753f0
- [doc] add alibaba cloud as sponsor (#22597) · b81fe83b
  youkaichao authored Aug 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b81fe83b
- [doc] add beijing meetup links (#22596) · 0757551c
  youkaichao authored Aug 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  0757551c
- Move `CacheConfig` from `config/__init__.py` to `config/cache.py` (#22586) · 8290d15d
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8290d15d
- [Misc] Replace flaky image urls in pixtral test (#22574) · 049c2451
  Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  049c2451
- [Docs] Fix warnings in docs build (#22588) · 00976db0
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  00976db0