Commits · f59fc60fb317e7e04456de50b7abce99a9017225 · OpenDAS / vllm_cscc

"tests/compile/fullgraph/test_simple.py" did not exist on "09b95e36abbce747b52b9c3e7ae4cceaf40076ad"

25 Jun, 2025 7 commits
- [Feat][CLI] enforce-include-usage (#19695) · f59fc60f
  Max Wittig authored Jun 25, 2025
```
Signed-off-by: Max Wittig <max.wittig@siemens.com>
```
  f59fc60f
- [Refactor] Remove duplicate `ceil_div` (#20023) · 879f69be
  Wentao Ye authored Jun 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  879f69be
- [Frontend] speed up import time of vllm.config (#18036) · 71089341
  David Xia authored Jun 25, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  71089341
- Move to a faster base64 implementation (#19984) · 3443aaf8
  h-avsha authored Jun 25, 2025
```
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
```
  3443aaf8
- Revert "Fix(models/siglip): Add compatibility for Gemma models quantized by... · 2273ec32
  Isotr0py authored Jun 25, 2025
```
Revert "Fix(models/siglip): Add compatibility for Gemma models quantized by llm-compressor" (#20030)
```
  2273ec32
- Revert "[Feature] Integrate new deepgemm (#19820)" (#20049) · a6c4b87f
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a6c4b87f
- [Llama4] Update `attn_temperature_tuning` (#19997) · 1afa9948
  Brayden Zhong authored Jun 24, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  1afa9948
24 Jun, 2025 8 commits
- use .dev for version comparison with pytorch nightly release (#20031) · c01d1c5a
  Boyuan Feng authored Jun 24, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c01d1c5a
- [Feature] Integrate new deepgemm (#19820) · c6e3bba8
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c6e3bba8
- [P/D] Asynchronously do _nixl_handshake (#19836) · 91f7d9d0
  lkchen authored Jun 24, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  91f7d9d0
- [BugFix] Fix multi-node offline data parallel (#19937) · 8619e715
  Nick Hill authored Jun 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8619e715
- [Misc][Benchmarking] Add variable request-rate ("ramp-up") to the benchmarking client. (#19423) · c635c5f7
  d.transposed authored Jun 24, 2025
```
Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  c635c5f7
- [Fix][V1] Remove --scheduling-policy oracle (#20010) · 981eeca4
  amit authored Jun 24, 2025
```
Signed-off-by: amit <amit.man@gmail.com>
```
  981eeca4
- [Bugfix][CPU] Fix InputBatch for pooling models in the CPU v1 (#20014) · 53da4cd3
  Li, Jiang authored Jun 24, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  53da4cd3
- [PERF] Speedup of MRoPE prepare inputs (#19939) · 9a3b8832
  Vadim Gimpelson authored Jun 24, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  9a3b8832
23 Jun, 2025 11 commits
- Feat Dynamic Quantization for MoE Layers in GPTQ Marlin Backend (#19395) · dd2ccf8d
  Jun-Howie authored Jun 24, 2025
  
  dd2ccf8d
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
- [Misc] Add type alias `ReqId` and `EngineId` for better readability (#19880) · d0132f02
  lkchen authored Jun 23, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  d0132f02
- [Bugfix][v1] Fix step pooler implementation and step pooling usage in v1 (#19956) · 61f4fc5d
  Isotr0py authored Jun 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  61f4fc5d
- [EP+DP] Optimize the little operations in the DeepGEMM + DeepEP low latency case (#19885) · 68aaeb37
  Tyler Michael Smith authored Jun 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  68aaeb37
- [Doc] Update V1 status for decoder-only embedding models (#19952) · 5111642a
  Isotr0py authored Jun 23, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  5111642a
- [BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when... · 1bcd15ed
  lkchen authored Jun 22, 2025
```
[BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when *all* transfer done (#19874)
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  1bcd15ed
- [P/D][NixlConnector] Support `tp_size > num_kv_heads` deployments (#19691) · 2ebff5b7
  Nicolò Lucchesi authored Jun 23, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  2ebff5b7
- Fix(models/siglip): Add compatibility for Gemma models quantized by llm-compressor (#19643) · 493c2753
  Vensen authored Jun 23, 2025
```
Signed-off-by: Vensenmu <vensenmu@gmail.com>
```
  493c2753
- [Misc] Configurable timeout for execute_model RPC calls via env var (#19544) · f39ab2d4
  jinqinn authored Jun 23, 2025
```
Signed-off-by: jinqinn <goodqinjin@163.com>
```
  f39ab2d4
- [Core] feat: Implement Priority Scheduling in V1 Engine (#19057) · 4a0f7888
  amit authored Jun 23, 2025
```
Signed-off-by: amit <amit.man@gmail.com>
Co-authored-by: Roger Wang <Rogerw0108@gmail.com>
```
  4a0f7888
22 Jun, 2025 7 commits
- [Perf][CLI] Improve overall startup time (#19941) · c4cf2606
  Aaron Pham authored Jun 22, 2025
  
  c4cf2606
- [BugFix] Add an env to disable moe chunking to work around compile incompatibility (#19642) · 33d51f59
  Ye (Charlotte) Qi authored Jun 22, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  33d51f59
- [Chore] dedup logs (#19955) · e91386cd
  Aaron Pham authored Jun 22, 2025
  
  e91386cd
- [Misc] Simplify vllm bench cli subcommand implementation (#19948) · 2c11a29f
  Ye (Charlotte) Qi authored Jun 22, 2025
  
  2c11a29f
- [Benchmark] fix request loss if "ping" is returned (#19535) · 202c5df9
  Wang, Yi authored Jun 22, 2025
```
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  202c5df9
- [MISC] add cpu_kvcache_space_bytes to CacheConfig (#19812) · 2bb246b8
  Ning Xie authored Jun 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2bb246b8
- [Misc] add vllm_config in __init__ (#19866) · 4c409cab
  Ning Xie authored Jun 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  4c409cab
21 Jun, 2025 3 commits
- [Multimodal] Optimize Qwen2/2.5-VL startup time (#19756) · 2c5302fa
  Woosuk Kwon authored Jun 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  2c5302fa
- [New model support]Support Tarsier2 (#19887) · c3bf9bad
  汪志鹏 authored Jun 21, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  c3bf9bad
- [Bugfix] Fix bnb 8bit model weights loading (#19917) · 6f170f11
  Isotr0py authored Jun 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  6f170f11
20 Jun, 2025 4 commits
- Fix: Check the type of params to be a Sequence not list. (#19910) · 8ca81bb0
  Rabin Adhikari authored Jun 21, 2025
```
Signed-off-by: Rabin Adhikari <rabin.adk1@gmail.com>
```
  8ca81bb0
- [Misc] Clean up useless code (#19889) · e773a9e1
  wangxiyuan authored Jun 21, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  e773a9e1
- [Kernel] mark TorchSDPABackend swap_blocks NotImplementedError (#19749) · 71baf85a
  Ning Xie authored Jun 21, 2025
  
  71baf85a
- [CPU][CI] Fallback sliding window to v0 and fix CPU pooling model tests (#19901) · 79f2f1c2
  Li, Jiang authored Jun 20, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  79f2f1c2