Commits · fce10dbed5441b4f918b23a2b63aae72bc00a2f6 · OpenDAS / vllm_cscc

27 Aug, 2025 1 commit
- [XPU] Add xpu torch.compile support (#22609) · fce10dbe
  Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  fce10dbe
26 Aug, 2025 3 commits
- [Doc]: fix various spelling issues in multiple files (#23636) · 7c04779a
  Didier Durand authored Aug 26, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7c04779a
- [Kernel] Added flashinfer fp8 per-tensor gemms (#22895) · f66673a3
  nvjullin authored Aug 26, 2025
```
Signed-off-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f66673a3
- [CI Fix] Pin deepep and pplx tags in tools/ep_kernels/, gate multigpu tests (#23568) · 906e461e
  Michael Goin authored Aug 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  906e461e
25 Aug, 2025 2 commits

[TPU][Bugfix] Fixes prompt_token_ids error in tpu tests. (#23574) · c34c82b7
Pate Motter authored Aug 25, 2025
```
Signed-off-by: Pate Motter <patemotter@google.com>
```
c34c82b7

[Doc: ]fix various typos in multiple files (#23487) · 47455c42

Didier Durand authored Aug 25, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47455c42

22 Aug, 2025 4 commits
- [CI/Build] add EP dependencies to docker (#21976) · 0483fabc
  Zhewen Li authored Aug 22, 2025
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0483fabc
- [Bug fix] Dynamically setting the backend variable for genai_perf_tests in the... · ebe14621
  Naman Lalit authored Aug 22, 2025
```
[Bug fix] Dynamically setting the backend variable for genai_perf_tests in the run-nightly-benchmark script (#23375)
Signed-off-by: Naman Lalit <nl2688@nyu.edu>
```
  ebe14621
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
- [Core] Support custom executor qualname (#23314) · 480bdf5a
  22quinn authored Aug 21, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  480bdf5a
21 Aug, 2025 6 commits
- add tg-mxfp4-moe-test (#22540) · f8ce0229
  Lain authored Aug 21, 2025
```
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f8ce0229
- [ci/build] Fix abi tag for aarch64 (#23329) · e0b056e4
  youkaichao authored Aug 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e0b056e4
- [CI] Block the cu126 wheel build while broken (#23285) · f64ee61d
  Michael Goin authored Aug 21, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f64ee61d
- [CI] Delete images older than 24h. (#23291) · 8993073d
  QiliangCui authored Aug 21, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  8993073d
- [CI/Build] Split out mm processor tests (#23260) · 2461d9e5
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2461d9e5
- [CPU] Refactor CPU W8A8 scaled_mm (#23071) · 7be5d113
  Li, Jiang authored Aug 21, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7be5d113
20 Aug, 2025 5 commits
- [misc] fix multiple arch wheels for the nightly index (#23110) · 1b125004
  youkaichao authored Aug 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1b125004
- [Kernel/Quant] Remove the original marlin format and qqq (#23204) · 0cdbf5e6
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0cdbf5e6
- [torch.compile] Support conditional torch.compile per module (#22269) · dfd23820
  Yong Hoon Shin authored Aug 20, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  dfd23820
- Update to flashinfer-python==0.2.12 and disable AOT compile for non-release image (#23129) · 50df09fe
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  50df09fe
- Fix a performance comparison issue in Benchmark Suite (#23047) · 941f5685
  Louie Tsai authored Aug 19, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
```
  941f5685
19 Aug, 2025 5 commits

[CI/Build] Replace lm-eval gsm8k tests with faster implementation (#23002) · 0f4f0191
Michael Goin authored Aug 19, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
0f4f0191
[NVIDIA] Add SM100 Flashinfer Cutlass MoE fp8 backend (#22357) · a38b8af4
amirkl94 authored Aug 20, 2025
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
```
a38b8af4
[Frontend] Add `/collective_rpc` API endpoint (#23075) · f7cf5b51
22quinn authored Aug 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
f7cf5b51

[NVIDIA] Support Flashinfer TRTLLM FP8-q/kv/out Attention Kernel (#21716) · 03752dba

elvischenv authored Aug 19, 2025

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

03752dba

[CI][V0 Deprecation] Removed V0 Only Chunked Prefill and Prefix Caching Tests (#22871) · 66032887

Robert Shaw authored Aug 18, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

66032887

18 Aug, 2025 1 commit
- [XPU][CI]add xpu env vars in CI scripts (#22946) · 5c79b0d6
  Kunshang Ji authored Aug 18, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  5c79b0d6
16 Aug, 2025 2 commits

[V1] Logits processors extensibility (#19912) · bf7f470b

afeldman-nm authored Aug 16, 2025


Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: Andrew Feldman <afeld2012@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bf7f470b

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

15 Aug, 2025 4 commits
- ci: Add CUDA + arm64 release builds (#21201) · 76144adf
  Eli Uriegas authored Aug 15, 2025
```
Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
```
  76144adf
- Use regex in convert-results-json-to-markdown.py (#22989) · a344a1a7
  Michael Goin authored Aug 15, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  a344a1a7
- [Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra... · 8ad7285e
  bnellnm authored Aug 15, 2025
```
[Kernels] Clean up FusedMoeMethodBase and modular kernel setup.  Remove extra arguments from modular kernel methods. (#22035)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  8ad7285e
- [CI] Remove duplicated docs build from buildkite (#22924) · e8b40c7f
  Harry Mellor authored Aug 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e8b40c7f
14 Aug, 2025 2 commits

[Kernel] Add nvfp4 gemm flashinfer backends (#22346) · 279a5f31

nvjullin authored Aug 15, 2025


Signed-off-by: Julien Lin <jullin@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

279a5f31

vLLM Benchmark suite improvement (#22119) · 00e3f9da

Louie Tsai authored Aug 14, 2025


Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>

00e3f9da

13 Aug, 2025 1 commit

[V0 Deprecation] Remove multi-step scheduling (#22138) · 71683ca6

Woosuk Kwon authored Aug 12, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>

71683ca6

12 Aug, 2025 1 commit
- Re-enable Xet on TPU tests now that `hf_xet` has been updated (#22666) · 839ab003
  Harry Mellor authored Aug 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  839ab003
11 Aug, 2025 2 commits
- [Misc] Move tensor schema tests (#22612) · ebf7605b
  Cyrus Leung authored Aug 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebf7605b
- [CI/Build] Fix tensorizer test for load_format change (#22583) · b799f4b9
  22quinn authored Aug 10, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  b799f4b9
09 Aug, 2025 1 commit
- [TPU] Add support for online w8a8 quantization (#22425) · 9a0c5ded
  Kyuyeun Kim authored Aug 08, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9a0c5ded