Commits · eed92f12fc829ff074e7341283cb1677b7e65aa2 · OpenDAS / vllm_cscc

30 Oct, 2024 1 commit
- [TPU] Correctly profile peak memory usage & Upgrade PyTorch XLA (#9438) · 211fe91a
  Woosuk Kwon authored Oct 30, 2024
  
  211fe91a
04 Sep, 2024 1 commit
- [TPU][Bugfix] Use XLA rank for persistent cache path (#8137) · 61f4a93d
  Woosuk Kwon authored Sep 03, 2024
  
  61f4a93d
28 Aug, 2024 1 commit
- [TPU] Upgrade PyTorch XLA nightly (#7967) · eeffde1a
  Woosuk Kwon authored Aug 28, 2024
  
  eeffde1a
13 Aug, 2024 1 commit
- [TPU] Support multi-host inference (#7457) · a08df832
  Woosuk Kwon authored Aug 13, 2024
  
  a08df832
11 Aug, 2024 1 commit
- [TPU] Use mark_dynamic to reduce compilation time (#7340) · 90bab18f
  Woosuk Kwon authored Aug 10, 2024
  
  90bab18f
27 Jul, 2024 1 commit
- [TPU] Reduce compilation time & Upgrade PyTorch XLA version (#6856) · fad5576c
  Woosuk Kwon authored Jul 27, 2024
  
  fad5576c
16 Jul, 2024 1 commit
- [Hardware][TPU] Support MoE with Pallas GMM kernel (#6457) · c467dff2
  Woosuk Kwon authored Jul 16, 2024
  
  c467dff2
22 Jun, 2024 1 commit
- [Docs][TPU] Add installation tip for TPU (#5761) · 8c00f9c1
  Woosuk Kwon authored Jun 21, 2024
  
  8c00f9c1
12 Jun, 2024 1 commit
- [Hardware] Initial TPU integration (#5292) · 1a8bfd92
  Woosuk Kwon authored Jun 12, 2024
  
  1a8bfd92