Commits · 78800ecf7b9b4ed319e8134b7e5f173cf520d4f8 · OpenDAS / vllm_cscc

05 Dec, 2024 1 commit
- skip tests about cross-attn and not supported · 78800ecf
  zhuwenwen authored Dec 05, 2024
  
  78800ecf
27 Nov, 2024 1 commit
- add VLLM_OPTEST_MODELS_PATH/OPTEST_MODELS_PATH to load models from local path... · 3c9817d2
  zhuwenwen authored Nov 27, 2024
```
add VLLM_OPTEST_MODELS_PATH/OPTEST_MODELS_PATH  to load models from local path instead of Hugging Face Hub
```
  3c9817d2
18 Sep, 2024 1 commit

[Core][Bugfix][Perf] Introduce `MQLLMEngine` to avoid `asyncio` OH (#8157) · 7c7714d8

Alexander Matveev authored Sep 18, 2024


Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

7c7714d8

29 Aug, 2024 1 commit
- [torch.compile] remove reset (#7975) · a7f65c2b
  youkaichao authored Aug 28, 2024
  
  a7f65c2b
28 Aug, 2024 1 commit
- [torch.compile] avoid Dynamo guard evaluation overhead (#7898) · ce6bf3a2
  youkaichao authored Aug 28, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ce6bf3a2
27 Aug, 2024 1 commit
- [core][torch.compile] discard the compile for profiling (#7796) · 64cc6444
  youkaichao authored Aug 26, 2024
  
  64cc6444