Commits · eeee1c3b1ae30a9714dffe7a58bdbed10b1e2e38 · OpenDAS / vllm_cscc · GitLab

22 Aug, 2024 1 commit
- [TPU] Avoid initializing TPU runtime in is_tpu (#7763) · eeee1c3b
  Woosuk Kwon authored Aug 21, 2024
  
  eeee1c3b
20 Aug, 2024 2 commits
- [misc][cuda] add warning for pynvml user (#7675) · ad28a74b
  youkaichao authored Aug 20, 2024
  
  ad28a74b
- [doc] fix doc build error caused by msgspec (#7659) · e54ebc2f
  youkaichao authored Aug 19, 2024
  
  e54ebc2f
17 Aug, 2024 1 commit
- [misc] use nvml to get consistent device name (#7582) · eed020f6
  youkaichao authored Aug 16, 2024
  
  eed020f6
13 Aug, 2024 2 commits
- [hardware] unify usage of is_tpu to current_platform.is_tpu() (#7102) · 4d2dc507
  youkaichao authored Aug 13, 2024
  
  4d2dc507
- [mypy] Misc. typing improvements (#7417) · 9ba85bc1
  Cyrus Leung authored Aug 13, 2024
  
  9ba85bc1
07 Aug, 2024 1 commit
- [distributed][misc] add specialized method for cuda platform (#7249) · 639159b2
  youkaichao authored Aug 07, 2024
  
  639159b2
22 Jul, 2024 1 commit
- [Misc] Add a wrapper for torch.inference_mode (#6618) · 42de2cef
  Woosuk Kwon authored Jul 21, 2024
  
  42de2cef
10 Jul, 2024 1 commit
- [CI/Build] Enable mypy typing for remaining folders (#6268) · b422d496
  Benjamin Muskalla authored Jul 10, 2024
  
  b422d496
09 Jul, 2024 1 commit
- [hardware][cuda] use device id under CUDA_VISIBLE_DEVICES for get_device_capability (#6216) · a3c9435d
  youkaichao authored Jul 08, 2024
  
  a3c9435d
03 Jul, 2024 1 commit
- [hardware][misc] introduce platform abstraction (#6080) · 482045ee
  youkaichao authored Jul 02, 2024
  
  482045ee