Commits · d1af8b7be9c5ad9d2926ce215771e9cd7279147b · OpenDAS / vllm_cscc · GitLab

10 Aug, 2025 21 commits
- enable Docker-aware precompiled wheel setup (#22106) · d1af8b7b
  Doug Smith authored Aug 10, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  d1af8b7b
- Fix TensorSchema validation test for symbolic dims (#22366) · 68b254d6
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  68b254d6
- Remove redundant row_indices unsqueeze operation in MiniCPMO (#22528) · 8c50d62f
  ZiTian Zhao authored Aug 11, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  8c50d62f
- Migrate LlavaNextImageInputs to TensorSchema (#21774) · b4e29167
  Benji Beck authored Aug 10, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b4e29167
- Fix(benchmarks): allow multiple mm contents in OpenAI Chat Completion Benchmarks (#22534) · 65a7917b
  Breno Baldas Skuk authored Aug 10, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
```
  65a7917b
- [Bugfix][Kernel] Support partial rotary embedding for MRoPE triton kernel (#22593) · b76753f0
  Isotr0py authored Aug 11, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b76753f0
- [doc] add alibaba cloud as sponsor (#22597) · b81fe83b
  youkaichao authored Aug 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b81fe83b
- [doc] add beijing meetup links (#22596) · 0757551c
  youkaichao authored Aug 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  0757551c
- Move `CacheConfig` from `config/__init__.py` to `config/cache.py` (#22586) · 8290d15d
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8290d15d
- [Misc] Replace flaky image urls in pixtral test (#22574) · 049c2451
  Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  049c2451
- [Docs] Fix warnings in docs build (#22588) · 00976db0
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  00976db0
- [Misc] Further refine type annotations in parallel state (#22499) · d411df02
  Cyrus Leung authored Aug 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d411df02
- [Doc] Fix API doc link in side navigation (#22585) · 010e0e39
  22quinn authored Aug 10, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  010e0e39
- [Misc] code clean duplicate set_current_vllm_config in _set_vllm_config (#22566) · 32697629
  Ning Xie authored Aug 10, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  32697629
- [Minor] Fix pre-commit error on main (#22579) · 7e8d6857
  Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  7e8d6857
- Refactor sliding window configuration to Transformers best practice (#21927) · c4984839
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4984839
- [TPU] kv cache update kernel doesn't need to be padded slices to multiple of... · 2a84fb42
  Chengji Yao authored Aug 09, 2025
```
[TPU] kv cache update kernel doesn't need to be padded slices to multiple of num_slices_per_block (#22394)
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>
```
  2a84fb42
- Improve fast_topk function with type hints and documentation (#22530) · 534c45b9
  ZiTian Zhao authored Aug 10, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  534c45b9
- [Config] add "qwen" as a native eagle3 target supported model (#22333) · 3d7363e6
  Le Chen authored Aug 10, 2025
```
Signed-off-by: lechen <lecself@163.com>
Signed-off-by: LeChen <lecself@163.com>
```
  3d7363e6
- [oss] Init gpt-oss bf16 support (#22508) · 0c5254b8
  Jee Jee Li authored Aug 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0c5254b8
- [V1] [Hybrid] Enable Full CUDA Graph (decode-only) for Mamba layers (#21401) · 61f67d8a
  Thomas Parnell authored Aug 10, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  61f67d8a
09 Aug, 2025 19 commits
- [FEAT] [Performance] Add triton mrope to replace the torch code path (#22375) · 42172ad1
  TJian authored Aug 09, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  42172ad1
- [Bugfix] Fix basic models tests hanging due to mm processor creation (#22571) · fbd8595c
  Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  fbd8595c
- [Model] Gemma3n MM (#20495) · 5a16fa61
  Nicolò Lucchesi authored Aug 09, 2025
```
Signed-off-by: ShriKode <shrikode@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: ShriKode <shrikode@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  5a16fa61
- Move `ParallelConfig` from `config/__init__.py` to `config/parallel.py` (#22565) · 2d18256e
  Harry Mellor authored Aug 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2d18256e
- [Docs] Reduce noise in docs and `--help` from the JSON tip (#22567) · 56186474
  Harry Mellor authored Aug 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  56186474
- [CI] [Hybrid] Speed up hybrid models test by removing large models (#22563) · 1bf5e1f2
  Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  1bf5e1f2
- GLM-4.5V with new class name at transformers (#22520) · a6022e6f
  Yuxuan Zhang authored Aug 09, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a6022e6f
- Update docs for Minimax-Text support (#22562) · 2be07a0d
  Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  2be07a0d
- [Bugfix] Fix CI moe kernel failure (#22556) · 0edc0cd5
  Jee Jee Li authored Aug 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0edc0cd5
- [Bugfix] Fix failing GPT-OSS initialization test (#22557) · 7920e9b1
  Isotr0py authored Aug 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7920e9b1
- [ROCm][Misc] Rename the context_len to seq_len in ROCm custom paged attention kernel (#22097) · b7c0942b
  Charlie Fu authored Aug 09, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  b7c0942b
- [TPU] Add support for online w8a8 quantization (#22425) · 9a0c5ded
  Kyuyeun Kim authored Aug 08, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9a0c5ded
- Fix loading of quantized BigCode models (#22463) · 10a02535
  Eldar Kurtić authored Aug 09, 2025
```
Signed-off-by: Eldar Kurtic <eldar@neuralmagic.com>
```
  10a02535
- [Misc] Use config definitions from Transformers library (#21913) · 65552b47
  Cyrus Leung authored Aug 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  65552b47
- v1: Pass KVConnectorOutput to scheduler-side (#22157) · 7ad7adb6
  Or Ozeri authored Aug 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7ad7adb6
- [V1] [Hybrid] Support Minimax-Text-01 in V1 (#22151) · 6ade99ea
  Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  6ade99ea
- [Log] Add Warning for Deprecation of DeepGEMM old version (#22194) · 3157aebb
  Wentao Ye authored Aug 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3157aebb
- Remove mamba_ssm from vLLM requirements; install inside test container using... · 8a0ffd62
  Thomas Parnell authored Aug 09, 2025
```
Remove mamba_ssm from vLLM requirements; install inside test container using `--no-build-isolation` (#22541)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  8a0ffd62
- [Doc] Add usage of implicit text-only mode (#22561) · 23472ff5
  Roger Wang authored Aug 08, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
```
  23472ff5