Commits · 4d3a2c284ecc47748273664c9a6ef302ff3adcbe · OpenDAS / vllm_cscc

17 Dec, 2024 1 commit

[torch.compile] fast inductor (#11108) · 88a412ed

youkaichao authored Dec 16, 2024


Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

88a412ed

11 Dec, 2024 2 commits
- [torch.compile] remove graph logging in ci (#11110) · 66aaa772
  youkaichao authored Dec 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  66aaa772
- [torch.compile] use depyf to dump torch.compile internals (#10972) · 91642db9
  youkaichao authored Dec 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  91642db9
09 Dec, 2024 1 commit
- [torch.compile] add dynamo time tracking (#11005) · d1c2e15e
  youkaichao authored Dec 08, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d1c2e15e
06 Dec, 2024 3 commits
- [torch.compile] fix deprecated code (#10948) · a1887f2c
  youkaichao authored Dec 06, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a1887f2c
- [torch.compile] add logging for compilation time (#10941) · b031a455
  youkaichao authored Dec 06, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b031a455
- [torch.compile] use size tuning for specific sizes (#10933) · db87eb6c
  youkaichao authored Dec 05, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  db87eb6c
03 Dec, 2024 1 commit
- [torch.compile] remove compilation_context and simplify code (#10838) · dc5ce861
  youkaichao authored Dec 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  dc5ce861
21 Nov, 2024 1 commit

[torch.compile] Inductor code caching fix (#10273) · 8b0fe06c

Luka Govedič authored Nov 21, 2024


Signed-off-by: luka <luka@neuralmagic.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>

8b0fe06c

20 Nov, 2024 1 commit
- [7/N] torch.compile, reduce compilation time (#10460) · 0cd3d971
  youkaichao authored Nov 20, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  0cd3d971
18 Nov, 2024 1 commit
- [4/N][torch.compile] clean up set_torch_compile_backend (#10401) · 51bb12d1
  youkaichao authored Nov 17, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  51bb12d1
17 Nov, 2024 1 commit
- [2/N][torch.compile] make compilation cfg part of vllm cfg (#10383) · 4fd93750
  youkaichao authored Nov 16, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4fd93750
11 Nov, 2024 1 commit
- [v1][torch.compile] support managing cudagraph buffer (#10203) · 330e82d3
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  330e82d3
08 Nov, 2024 2 commits
- [Bugfix] SymIntArrayRef expected to contain concrete integers (#10170) · 10b67d86
  bnellnm authored Nov 08, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
```
  10b67d86
- [torch.compile] Fuse RMSNorm with quant (#9138) · 4f93dfe9
  Luka Govedič authored Nov 08, 2024
```
Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: youkaichao <youkaichao@126.com>
```
  4f93dfe9
06 Nov, 2024 2 commits
- [V1] Integrate Piecewise CUDA graphs (#10058) · 40899855
  Woosuk Kwon authored Nov 05, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  40899855
- [v1] reduce graph capture time for piecewise cudagraph (#10059) · c4cacbaa
  youkaichao authored Nov 05, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c4cacbaa
05 Nov, 2024 1 commit
- [bugfix] fix weak ref in piecewise cudagraph and tractable test (#10048) · ca9844b3
  youkaichao authored Nov 05, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ca9844b3
01 Nov, 2024 1 commit
- [torch.compile] use interpreter with stable api from pytorch (#9889) · aff1fd81
  youkaichao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  aff1fd81
30 Oct, 2024 1 commit
- [torch.compile] rework compile control with piecewise cudagraph (#9715) · ff5ed6e1
  youkaichao authored Oct 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ff5ed6e1
16 Oct, 2024 1 commit
- [CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267) · 776dbd74
  Russell Bryant authored Oct 16, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  776dbd74
10 Oct, 2024 1 commit
- [torch.compile] integration with compilation control (#9058) · e4d652ea
  youkaichao authored Oct 10, 2024
  
  e4d652ea
14 Sep, 2024 1 commit
- [torch.compile] fix functionalization (#8480) · a36e070d
  youkaichao authored Sep 14, 2024
  
  a36e070d