Commits · 4851c202bbfb5dadc5a3b3b4409d3f083f4e8e90 · OpenDAS / vllm_cscc · GitLab

11 Sep, 2024 1 commit
- [Hardware][Intel] Support compressed-tensor W8A8 for CPU backend (#7257) · 0b952af4
  Li, Jiang authored Sep 12, 2024
  
  0b952af4
28 Aug, 2024 1 commit
- [hardware][rocm] allow rocm to override default env var (#7926) · bc6e42a9
  youkaichao authored Aug 27, 2024
  
  bc6e42a9
27 Aug, 2024 1 commit
- [cuda][misc] error on empty CUDA_VISIBLE_DEVICES (#7924) · ed6f002d
  youkaichao authored Aug 27, 2024
  
  ed6f002d
25 Aug, 2024 1 commit
- [misc][cuda] improve pynvml warning (#7852) · 70c094ad
  youkaichao authored Aug 25, 2024
  
  70c094ad
22 Aug, 2024 1 commit
- [TPU] Avoid initializing TPU runtime in is_tpu (#7763) · eeee1c3b
  Woosuk Kwon authored Aug 21, 2024
  
  eeee1c3b
20 Aug, 2024 2 commits
- [misc][cuda] add warning for pynvml user (#7675) · ad28a74b
  youkaichao authored Aug 20, 2024
  
  ad28a74b
- [doc] fix doc build error caused by msgspec (#7659) · e54ebc2f
  youkaichao authored Aug 19, 2024
  
  e54ebc2f
17 Aug, 2024 1 commit
- [misc] use nvml to get consistent device name (#7582) · eed020f6
  youkaichao authored Aug 16, 2024
  
  eed020f6
13 Aug, 2024 2 commits
- [hardware] unify usage of is_tpu to current_platform.is_tpu() (#7102) · 4d2dc507
  youkaichao authored Aug 13, 2024
  
  4d2dc507
- [mypy] Misc. typing improvements (#7417) · 9ba85bc1
  Cyrus Leung authored Aug 13, 2024
  
  9ba85bc1
07 Aug, 2024 1 commit
- [distributed][misc] add specialized method for cuda platform (#7249) · 639159b2
  youkaichao authored Aug 07, 2024
  
  639159b2
22 Jul, 2024 1 commit
- [Misc] Add a wrapper for torch.inference_mode (#6618) · 42de2cef
  Woosuk Kwon authored Jul 21, 2024
  
  42de2cef
10 Jul, 2024 1 commit
- [CI/Build] Enable mypy typing for remaining folders (#6268) · b422d496
  Benjamin Muskalla authored Jul 10, 2024
  
  b422d496
09 Jul, 2024 1 commit
- [hardware][cuda] use device id under CUDA_VISIBLE_DEVICES for get_device_capability (#6216) · a3c9435d
  youkaichao authored Jul 08, 2024
  
  a3c9435d
03 Jul, 2024 1 commit
- [hardware][misc] introduce platform abstraction (#6080) · 482045ee
  youkaichao authored Jul 02, 2024
  
  482045ee