Commits · 99324e255d5f7f4fb75a858ca9f8f3ed1f946b46 · OpenDAS / vllm_cscc

04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
24 Jun, 2025 1 commit
- use .dev for version comparison with pytorch nightly release (#20031) · c01d1c5a
  Boyuan Feng authored Jun 24, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c01d1c5a
23 Jun, 2025 1 commit
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
19 Jun, 2025 2 commits

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

[BugFix] Fix use_cudagraph=False (#19612) · ed333497
Richard Zou authored Jun 18, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
ed333497

17 Jun, 2025 1 commit
- [Feature][ROCm] Add full graph capture support for TritonAttentionBackend (#19158) · a44b1c95
  Charlie Fu authored Jun 17, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  a44b1c95
13 Jun, 2025 1 commit
- [CUDA] Enable full cudagraph for FlashMLA (#18581) · 3597b06a
  Luka Govedič authored Jun 13, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  3597b06a
12 Jun, 2025 2 commits
- [torch.compile][ROCm] Fuse quantization onto attention using a torch.compile pass (#16756) · f98548b9
  Luka Govedič authored Jun 12, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
```
  f98548b9
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
10 Jun, 2025 1 commit
- [BugFix] Allow use_cudagraph to work with dynamic VLLM_USE_V1 (#19390) · 77f0d465
  Richard Zou authored Jun 10, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  77f0d465
09 Jun, 2025 1 commit
- [Misc] Cleanup compilation tests (#19343) · 3a4d4177
  Richard Zou authored Jun 09, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  3a4d4177
08 Jun, 2025 2 commits
- [Misc] Change tests/compile to use VLLM_V1 by default (#19302) · 3d64d366
  Richard Zou authored Jun 08, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  3d64d366
- [Bugfix] Re-enable use_cudagraph in vLLM v1 (#19299) · eaa2e510
  Richard Zou authored Jun 07, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  eaa2e510
04 Jun, 2025 1 commit
- [Bugfix] Fix FA3 full cuda graph correctness (#19106) · b124e108
  Woosuk Kwon authored Jun 03, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b124e108
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
29 May, 2025 1 commit
- Add ability to use CUDAGraphs with use_inductor=False (#17345) · 26b4fa45
  Richard Zou authored May 28, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  26b4fa45
23 May, 2025 1 commit
- [Feature]Add async tensor parallelism using compilation pass (#17882) · 71ea614d
  cascade authored May 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  71ea614d
14 May, 2025 1 commit
- [AMD][torch.compile] Enable silu+fp8_quant fusion for rocm (#18082) · 7b2f28de
  Charlie Fu authored May 14, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  7b2f28de
13 May, 2025 1 commit
- [Fix] check to make sure processor has chat templates (#18047) · cb528d05
  Aaron Pham authored May 13, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  cb528d05
09 May, 2025 1 commit
- Improve configs - the rest! (#17562) · 4b2ed792
  Harry Mellor authored May 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4b2ed792
08 May, 2025 1 commit

[Core] Support full cuda graph in v1 (#16072) · 7ea2adb8

Chanh Nguyen authored May 07, 2025


Signed-off-by: Chanh Nguyen <cnguyen@linkedin.com>
Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>

7ea2adb8

02 May, 2025 1 commit
- [easy] Print number of needed GPUs in skip message (#17594) · b90b0852
  Richard Zou authored May 02, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  b90b0852
01 May, 2025 1 commit

[torch.compile] Add torch inductor pass for fusing silu_and_mul with... · 460a2b11

Sage Moore authored May 01, 2025


[torch.compile] Add torch inductor pass for fusing silu_and_mul with subsequent scaled_fp8_quant operations (#10867)
Signed-off-by: Sage Moore <sage@neuralmagic.com>

460a2b11

28 Apr, 2025 1 commit
- Make name of `compressed-tensors` quant method consistent across vLLM (#17255) · b6dd32aa
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b6dd32aa
27 Apr, 2025 1 commit

[Feature] support sequence parallelism using compilation pass (#16155) · 690fe019

cascade authored Apr 27, 2025


Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

690fe019

09 Apr, 2025 1 commit
- [BugFix] Fix fusion test and add them to CI (#16287) · 9cdde472
  Luka Govedič authored Apr 09, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  9cdde472
31 Mar, 2025 1 commit
- [Feature][ROCm]Enable fusion pass for torch.compile on ROCm (#15050) · e8582945
  Charlie Fu authored Mar 31, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  e8582945
28 Mar, 2025 1 commit
- [Bugfix] [torch.compile] Add Dynamo metrics context during compilation (#15639) · 04437e31
  Luka Govedič authored Mar 28, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  04437e31
27 Mar, 2025 1 commit
- Support FIPS enabled machines with MD5 hashing (#15299) · 7a6d45bc
  Matthew Vine authored Mar 26, 2025
```
Signed-off-by: Matthew Vine <32849887+MattTheCuber@users.noreply.github.com>
```
  7a6d45bc
24 Mar, 2025 1 commit
- [Fix] [torch.compile] Improve UUID system for custom passes (#15249) · f622dbcf
  Luka Govedič authored Mar 23, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  f622dbcf
20 Mar, 2025 1 commit

Fix broken tests (#14713) · 70e500ca

Jovan Sardinha authored Mar 19, 2025


Signed-off-by: JovanSardinha <jovan.sardinha@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

70e500ca

19 Mar, 2025 1 commit
- [Core] Update dtype detection and defaults (#14858) · f690372b
  Cyrus Leung authored Mar 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f690372b
17 Mar, 2025 2 commits

[Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810) · 2bb0e1a7

vllmellm authored Mar 17, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2bb0e1a7

[Misc] Replace os environ to monkeypatch in test suite (#14516) · a73e183e

Sibi authored Mar 17, 2025


Signed-off-by: sibi <85477603+t-sibiraj@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

a73e183e

15 Mar, 2025 1 commit

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

14 Mar, 2025 1 commit

Update to torch==2.6.0 (#12721) · 14f301b5

Michael Goin authored Mar 14, 2025


Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: luka <luka@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

14f301b5

07 Mar, 2025 1 commit
- [FP8] Refactor apply_fp8_linear and apply_fp8_linear_generic into an object (#14390) · e1744502
  Luka Govedič authored Mar 07, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  e1744502
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
28 Feb, 2025 1 commit

[torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename... · bd56c983

Luka Govedič authored Feb 28, 2025


[torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename RedundantReshapesPass to NoopEliminationPass (#10902)
Signed-off-by: luka <luka@neuralmagic.com>

bd56c983

14 Feb, 2025 1 commit
- Consolidate Llama model usage in tests (#13094) · f2b20fe4
  Harry Mellor authored Feb 14, 2025
  
  f2b20fe4