Commits · a59cd9d9f7fd89e19beeffb7e7f89437d413eafb · OpenDAS / vllm_cscc

01 Aug, 2025 1 commit
- [BUG] [ROCm] Fix import bug on ROCm (#22083) · 26b5f7bd
  TJian authored Aug 01, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  26b5f7bd
31 Jul, 2025 2 commits
- Add FlashInfer allreduce RMSNorm Quant fusion (#21069) · 6e672daf
  Ilya Markov authored Jul 31, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  6e672daf
- [ez] Remove a trailing space from compilation/decorators.py (#22028) · 7349d526
  Zhengxu Chen authored Jul 31, 2025
  
  7349d526
30 Jul, 2025 1 commit
- [Feature] Add async tensor parallelism for scaled mm (#20155) · 287f527f
  cascade authored Jul 30, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  287f527f
29 Jul, 2025 1 commit
- [Bugfix] VLLM_V1 supports passing other compilation levels (#19340) · 04e38500
  Richard Zou authored Jul 29, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  04e38500
24 Jul, 2025 1 commit
- [XPU] Conditionally import CUDA-specific passes to avoid import errors on xpu platform (#21036) · d9f9a3fd
  Chaojun Zhang authored Jul 24, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  d9f9a3fd
23 Jul, 2025 1 commit
- Add test case for compiling multiple graphs (#21044) · 4ac7713e
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  4ac7713e
22 Jul, 2025 1 commit

Fix Flashinfer Allreduce+Norm enable disable calculation based on... · ae268b63

Xin Li authored Jul 22, 2025


Fix Flashinfer Allreduce+Norm enable disable calculation based on `fi_allreduce_fusion_max_token_num` (#21325)
Signed-off-by: XIn Li <xinli@nvidia.com>

ae268b63

15 Jul, 2025 3 commits
- [Misc] Refactor AllReduceFusionPass. Remove parameter (#20918) · 37a7d5d7
  Ilya Markov authored Jul 15, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  37a7d5d7
- [cold start] replace VLLM_COMPILE_DEPYF with debug_dump_dir (#20940) · 91b3d190
  Boyuan Feng authored Jul 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  91b3d190
- [BugFix] VLLM_DISABLE_COMPILE_CACHE=1 should disable all reads and writes from the cache (#20942) · ba8c3000
  Richard Zou authored Jul 14, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ba8c3000
14 Jul, 2025 1 commit
- Fall back if flashinfer comm module not found (#20936) · 61e20828
  Yong Hoon Shin authored Jul 14, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  61e20828
12 Jul, 2025 2 commits
- [cold start time] add envs.VLLM_COMPILE_DEPYF to guard decompile (#20790) · c1c8ca57
  Boyuan Feng authored Jul 11, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c1c8ca57
- Integration SM100 FlashInfer fused allreduce RMSNorm (#20691) · fc0f41d1
  Ilya Markov authored Jul 12, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  fc0f41d1
11 Jul, 2025 2 commits
- [Bugfix] Upgrade depyf to 0.19 and streamline custom pass logging (#20777) · 762be26a
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
```
  762be26a
- [Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830) · 31d5c179
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  31d5c179
08 Jul, 2025 1 commit
- [Misc] Improve logging for dynamic shape cache compilation (#20573) · d2e841a1
  Kyle Yu authored Jul 07, 2025
```
Signed-off-by: kyolebu <kyu@redhat.com>
```
  d2e841a1
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
24 Jun, 2025 1 commit
- use .dev for version comparison with pytorch nightly release (#20031) · c01d1c5a
  Boyuan Feng authored Jun 24, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c01d1c5a
23 Jun, 2025 1 commit
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
19 Jun, 2025 1 commit
- [BugFix] Fix use_cudagraph=False (#19612) · ed333497
  Richard Zou authored Jun 18, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ed333497
13 Jun, 2025 3 commits
- [CUDA] Enable full cudagraph for FlashMLA (#18581) · 3597b06a
  Luka Govedič authored Jun 13, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  3597b06a
- [torch.compile] reorganize the cache directory to support compiling multiple models (#19064) · d70bc7c0
  youkaichao authored Jun 13, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d70bc7c0
- use base version for version comparison (#19587) · ce688ad4
  Boyuan Feng authored Jun 13, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  ce688ad4
12 Jun, 2025 1 commit
- [torch.compile][ROCm] Fuse quantization onto attention using a torch.compile pass (#16756) · f98548b9
  Luka Govedič authored Jun 12, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
```
  f98548b9
08 Jun, 2025 1 commit
- [Bugfix] Re-enable use_cudagraph in vLLM v1 (#19299) · eaa2e510
  Richard Zou authored Jun 07, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  eaa2e510
04 Jun, 2025 1 commit
- [CPU] V1 support for the CPU backend (#16441) · 4555143e
  Li, Jiang authored Jun 04, 2025
  
  4555143e
03 Jun, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- Reduce logs in CLI scripts and plugin loader (#18970) · cc977286
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cc977286
30 May, 2025 1 commit
- Improve "failed to get the hash of the compiled graph" error (#18956) · 84ec470f
  Richard Zou authored May 30, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  84ec470f
29 May, 2025 2 commits
- Use standalone_compile by default in torch >= 2.8.0 (#18846) · a521ef06
  Richard Zou authored May 29, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  a521ef06
- Add ability to use CUDAGraphs with use_inductor=False (#17345) · 26b4fa45
  Richard Zou authored May 28, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  26b4fa45
28 May, 2025 1 commit
- Fix PiecewiseCompileInterpreter (#17338) · aa42561e
  Richard Zou authored May 28, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  aa42561e
27 May, 2025 1 commit

[Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c

Hyogeun Oh (오효근) authored May 27, 2025


[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>

a68e293c

23 May, 2025 1 commit
- [Feature]Add async tensor parallelism using compilation pass (#17882) · 71ea614d
  cascade authored May 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  71ea614d
22 May, 2025 1 commit
- [Compile][Platform] Make PiecewiseBackend pluggable and extendable (#18076) · f8d2cc5f
  Mengqing Cao authored May 23, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  f8d2cc5f
14 May, 2025 1 commit
- [AMD][torch.compile] Enable silu+fp8_quant fusion for rocm (#18082) · 7b2f28de
  Charlie Fu authored May 14, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  7b2f28de
13 May, 2025 2 commits
- Update deprecated type hinting in `vllm/compilation` (#18072) · 19324d66
  Harry Mellor authored May 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  19324d66
- [Fix] check to make sure processor has chat templates (#18047) · cb528d05
  Aaron Pham authored May 13, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  cb528d05
09 May, 2025 1 commit
- Improve configs - the rest! (#17562) · 4b2ed792
  Harry Mellor authored May 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4b2ed792