Commits · c301616ed23fef433db1a49df332b9d61d3178ad · OpenDAS / vllm_cscc

13 Dec, 2024 1 commit

[torch.compile] Dynamic fp8 + rms_norm fusion (#10906) · 30870b4f

Luka Govedič authored Dec 12, 2024


Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

30870b4f

11 Dec, 2024 2 commits
- [torch.compile] remove graph logging in ci (#11110) · 66aaa772
  youkaichao authored Dec 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  66aaa772
- [torch.compile] use depyf to dump torch.compile internals (#10972) · 91642db9
  youkaichao authored Dec 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  91642db9
09 Dec, 2024 1 commit
- [torch.compile] add dynamo time tracking (#11005) · d1c2e15e
  youkaichao authored Dec 08, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d1c2e15e
06 Dec, 2024 3 commits
- [torch.compile] fix deprecated code (#10948) · a1887f2c
  youkaichao authored Dec 06, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a1887f2c
- [torch.compile] add logging for compilation time (#10941) · b031a455
  youkaichao authored Dec 06, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b031a455
- [torch.compile] use size tuning for specific sizes (#10933) · db87eb6c
  youkaichao authored Dec 05, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  db87eb6c
03 Dec, 2024 1 commit
- [torch.compile] remove compilation_context and simplify code (#10838) · dc5ce861
  youkaichao authored Dec 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  dc5ce861
01 Dec, 2024 1 commit
- [Misc] Improve type annotations for `support_torch_compile` (#10763) · f877a7d1
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f877a7d1
25 Nov, 2024 2 commits
- [misc] move functions to config.py (#10624) · 05d1f8c9
  youkaichao authored Nov 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  05d1f8c9
- [torch.compile] add warning for unsupported models (#10622) · 65813781
  youkaichao authored Nov 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  65813781
21 Nov, 2024 1 commit

[torch.compile] Inductor code caching fix (#10273) · 8b0fe06c

Luka Govedič authored Nov 21, 2024


Signed-off-by: luka <luka@neuralmagic.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>

8b0fe06c

20 Nov, 2024 1 commit
- [7/N] torch.compile, reduce compilation time (#10460) · 0cd3d971
  youkaichao authored Nov 20, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  0cd3d971
18 Nov, 2024 1 commit
- [4/N][torch.compile] clean up set_torch_compile_backend (#10401) · 51bb12d1
  youkaichao authored Nov 17, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  51bb12d1
17 Nov, 2024 1 commit
- [2/N][torch.compile] make compilation cfg part of vllm cfg (#10383) · 4fd93750
  youkaichao authored Nov 16, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4fd93750
15 Nov, 2024 1 commit
- [Misc] Change RedundantReshapesPass and FusionPass logging from info to debug (#10308) · 2885ba0e
  Tyler Michael Smith authored Nov 14, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  2885ba0e
12 Nov, 2024 1 commit
- [1/N] torch.compile user interface design (#10237) · eea55cca
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eea55cca
11 Nov, 2024 1 commit
- [v1][torch.compile] support managing cudagraph buffer (#10203) · 330e82d3
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  330e82d3
08 Nov, 2024 2 commits
- [Bugfix] SymIntArrayRef expected to contain concrete integers (#10170) · 10b67d86
  bnellnm authored Nov 08, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
```
  10b67d86
- [torch.compile] Fuse RMSNorm with quant (#9138) · 4f93dfe9
  Luka Govedič authored Nov 08, 2024
```
Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: youkaichao <youkaichao@126.com>
```
  4f93dfe9
06 Nov, 2024 2 commits
- [V1] Integrate Piecewise CUDA graphs (#10058) · 40899855
  Woosuk Kwon authored Nov 05, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  40899855
- [v1] reduce graph capture time for piecewise cudagraph (#10059) · c4cacbaa
  youkaichao authored Nov 05, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c4cacbaa
05 Nov, 2024 1 commit
- [bugfix] fix weak ref in piecewise cudagraph and tractable test (#10048) · ca9844b3
  youkaichao authored Nov 05, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ca9844b3
01 Nov, 2024 1 commit
- [torch.compile] use interpreter with stable api from pytorch (#9889) · aff1fd81
  youkaichao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  aff1fd81
30 Oct, 2024 1 commit
- [torch.compile] rework compile control with piecewise cudagraph (#9715) · ff5ed6e1
  youkaichao authored Oct 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ff5ed6e1
22 Oct, 2024 1 commit
- [torch.compile] auto infer dynamic_arg_dims from type annotation (#9589) · 17c79f3c
  youkaichao authored Oct 22, 2024
  
  17c79f3c
16 Oct, 2024 1 commit
- [CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267) · 776dbd74
  Russell Bryant authored Oct 16, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  776dbd74
10 Oct, 2024 2 commits
- [torch.compile] generic decorators (#9258) · e00c094f
  youkaichao authored Oct 10, 2024
  
  e00c094f
- [torch.compile] integration with compilation control (#9058) · e4d652ea
  youkaichao authored Oct 10, 2024
  
  e4d652ea
14 Sep, 2024 1 commit
- [torch.compile] fix functionalization (#8480) · a36e070d
  youkaichao authored Sep 14, 2024
  
  a36e070d
07 Sep, 2024 1 commit
- [tpu][misc] fix typo (#8260) · ce2702a9
  youkaichao authored Sep 06, 2024
  
  ce2702a9
28 Aug, 2024 1 commit
- [torch.compile] avoid Dynamo guard evaluation overhead (#7898) · ce6bf3a2
  youkaichao authored Aug 28, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ce6bf3a2