Commits · f256ebe4df6757d76f1f1642d7e110268a2f8190 · OpenDAS / vllm_cscc · GitLab

10 Jan, 2025 1 commit
- [torch.compile] Hide KV cache behind torch.compile boundary (#11677) · cf5f000d
  Chen Zhang authored Jan 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  cf5f000d
15 Dec, 2024 1 commit
- [torch.compile] allow tracking forward time (#11081) · a1c02058
  youkaichao authored Dec 14, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a1c02058
10 Dec, 2024 1 commit
- [torch.compile] add a flag to track batchsize statistics (#11059) · 75f89dc4
  youkaichao authored Dec 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  75f89dc4
22 Nov, 2024 1 commit
- [torch.compile] support all attention backends (#10558) · eebad39f
  youkaichao authored Nov 22, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eebad39f
03 Oct, 2024 1 commit
- [misc] add forward context for attention (#9029) · 9aaf14c6
  youkaichao authored Oct 03, 2024
  
  9aaf14c6