Commits · c53fec1fcb27aca9475e55c2d1e74c532f5f0364 · OpenDAS / vllm_cscc

"docs/getting_started/installation/gpu.cuda.inc.md" did not exist on "60c68df6d1a4421480710c2303c8814724f90bb5"

25 Jun, 2025 11 commits
- [doc] add reference link for Intel XPU (#20064) · c53fec1f
  Reid authored Jun 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  c53fec1f
- [BugFix] Fix full-cuda-graph illegal memory access in FA3 (#20057) · 0f9e7354
  Lucas Wilkinson authored Jun 25, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  0f9e7354
- [Chore] debloat some initial logs (#19438) · ba7ba35c
  Aaron Pham authored Jun 25, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  ba7ba35c
- [Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward. Add... · 015fab8c
  bnellnm authored Jun 25, 2025
```
[Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward.  Add additional testing for cudagraphs. (#19717)
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  015fab8c
- [Feat][CLI] enforce-include-usage (#19695) · f59fc60f
  Max Wittig authored Jun 25, 2025
```
Signed-off-by: Max Wittig <max.wittig@siemens.com>
```
  f59fc60f
- [Refactor] Remove duplicate `ceil_div` (#20023) · 879f69be
  Wentao Ye authored Jun 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  879f69be
- [Frontend] speed up import time of vllm.config (#18036) · 71089341
  David Xia authored Jun 25, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  71089341
- Move to a faster base64 implementation (#19984) · 3443aaf8
  h-avsha authored Jun 25, 2025
```
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
```
  3443aaf8
- Revert "Fix(models/siglip): Add compatibility for Gemma models quantized by... · 2273ec32
  Isotr0py authored Jun 25, 2025
```
Revert "Fix(models/siglip): Add compatibility for Gemma models quantized by llm-compressor" (#20030)
```
  2273ec32
- Revert "[Feature] Integrate new deepgemm (#19820)" (#20049) · a6c4b87f
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a6c4b87f
- [Llama4] Update `attn_temperature_tuning` (#19997) · 1afa9948
  Brayden Zhong authored Jun 24, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  1afa9948
24 Jun, 2025 16 commits
- cmake: Update vllm_flash_attn for vllm_kernels (#20032) · 0d06b533
  Eli Uriegas authored Jun 24, 2025
```
Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
```
  0d06b533
- use .dev for version comparison with pytorch nightly release (#20031) · c01d1c5a
  Boyuan Feng authored Jun 24, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c01d1c5a
- [Easy] Remove submodule added in #19463 (#20039) · ead36984
  Brayden Zhong authored Jun 24, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  ead36984
- [Feature] Integrate new deepgemm (#19820) · c6e3bba8
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c6e3bba8
- [P/D] Asynchronously do _nixl_handshake (#19836) · 91f7d9d0
  lkchen authored Jun 24, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  91f7d9d0
- [BugFix] Fix multi-node offline data parallel (#19937) · 8619e715
  Nick Hill authored Jun 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8619e715
- [Misc][Benchmarking] Add variable request-rate ("ramp-up") to the benchmarking client. (#19423) · c635c5f7
  d.transposed authored Jun 24, 2025
```
Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  c635c5f7
- [Perf] Improve/Fix-regression for FA3 in High QPS regimes (#19463) · a045b7e8
  Lucas Wilkinson authored Jun 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  a045b7e8
- [Fix][V1] Remove --scheduling-policy oracle (#20010) · 981eeca4
  amit authored Jun 24, 2025
```
Signed-off-by: amit <amit.man@gmail.com>
```
  981eeca4
- refactor example - qwen3_reranker (#19847) · 26d34eb6
  Reid authored Jun 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  26d34eb6
- [Bugfix][CPU] Fix InputBatch for pooling models in the CPU v1 (#20014) · 53da4cd3
  Li, Jiang authored Jun 24, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  53da4cd3
- [PERF] Speedup of MRoPE prepare inputs (#19939) · 9a3b8832
  Vadim Gimpelson authored Jun 24, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  9a3b8832
- add some examples for other benchmark scripts (#19893) · 3014c920
  Reid authored Jun 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  3014c920
- [doc] Fix broken link in the installation for CPU (#19980) · 0eed5169
  Kay Yan authored Jun 24, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  0eed5169
- [Misc][Tools][Benchmark] Add profile to autotune script (#19711) · ee5ad8d2
  Chenyaaang authored Jun 23, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  ee5ad8d2
- Update test case parameter to have the throughput above 8.0 (#19994) · a738dbb2
  QiliangCui authored Jun 23, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  a738dbb2
23 Jun, 2025 13 commits
- [TPU] Fix tpu model runner test (#19995) · 33d5e29b
  Chenyaaang authored Jun 23, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  33d5e29b
- [Bugfix][Benchmark] Fix Marlin benchmark (#19929) · 4671ac6e
  22quinn authored Jun 23, 2025
  
  4671ac6e
- Feat Dynamic Quantization for MoE Layers in GPTQ Marlin Backend (#19395) · dd2ccf8d
  Jun-Howie authored Jun 24, 2025
  
  dd2ccf8d
- [CI/Build] Push latest tag for cpu and neuron docker image (#19897) · a3bc76e4
  22quinn authored Jun 23, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  a3bc76e4
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
- [Misc] Add type alias `ReqId` and `EngineId` for better readability (#19880) · d0132f02
  lkchen authored Jun 23, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  d0132f02
- [Bugfix][v1] Fix step pooler implementation and step pooling usage in v1 (#19956) · 61f4fc5d
  Isotr0py authored Jun 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  61f4fc5d
- [EP+DP] Optimize the little operations in the DeepGEMM + DeepEP low latency case (#19885) · 68aaeb37
  Tyler Michael Smith authored Jun 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  68aaeb37
- [Docs] Fix syntax highlighting of shell commands (#19870) · c3649e4f
  Lukas Geiger authored Jun 23, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  c3649e4f
- [doc] improve readability for long commands (#19920) · 53243e5c
  Reid authored Jun 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  53243e5c
- [Bugfix] Fix CI bitsandbytes failure (#19969) · a6e6604d
  Jee Jee Li authored Jun 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a6e6604d
- [doc] use MkDocs collapsible blocks - supplement (#19973) · b82e0f82
  Reid authored Jun 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  b82e0f82
- [Doc] Update V1 status for decoder-only embedding models (#19952) · 5111642a
  Isotr0py authored Jun 23, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  5111642a