Commits · e39ebf5cf5ec8f7449d633b6428333a99a206a1c · OpenDAS / vllm_cscc

04 Sep, 2024 1 commit
- [TPU][Bugfix] Use XLA rank for persistent cache path (#8137) · 61f4a93d
  Woosuk Kwon authored Sep 03, 2024
  
  61f4a93d
28 Aug, 2024 1 commit
- [TPU] Upgrade PyTorch XLA nightly (#7967) · eeffde1a
  Woosuk Kwon authored Aug 28, 2024
  
  eeffde1a
20 Aug, 2024 1 commit
- [OpenVINO] Updated documentation (#7687) · 398521ad
  Ilya Lavrenov authored Aug 20, 2024
  
  398521ad
14 Aug, 2024 1 commit
- [doc] update test script to include cudagraph (#7501) · 199adbb7
  youkaichao authored Aug 13, 2024
  
  199adbb7
13 Aug, 2024 1 commit
- [TPU] Support multi-host inference (#7457) · a08df832
  Woosuk Kwon authored Aug 13, 2024
  
  a08df832
11 Aug, 2024 2 commits
- [Doc] building vLLM with VLLM_TARGET_DEVICE=empty (#7403) · 02b1988b
  tomeras91 authored Aug 12, 2024
  
  02b1988b
- [TPU] Use mark_dynamic to reduce compilation time (#7340) · 90bab18f
  Woosuk Kwon authored Aug 10, 2024
  
  90bab18f
07 Aug, 2024 1 commit
- [OpenVINO] migrate to latest dependencies versions (#7251) · 80cbe10c
  Ilya Lavrenov authored Aug 07, 2024
  
  80cbe10c
05 Aug, 2024 1 commit
- bump version to v0.5.4 (#7139) · 4db5176d
  Simon Mo authored Aug 05, 2024
  
  4db5176d
02 Aug, 2024 1 commit
- [CI/Build] Add support for Python 3.12 (#7035) · b482b9a5
  Michael Goin authored Aug 02, 2024
  
  b482b9a5
01 Aug, 2024 1 commit
- [Kernel][RFC] Refactor the punica kernel based on Triton (#5036) · 7ecee343
  Jee Jee Li authored Aug 01, 2024
  
  7ecee343
30 Jul, 2024 1 commit
- [OpenVINO] Updated OpenVINO requirements and build docs (#6948) · 5895b246
  Ilya Lavrenov authored Jul 30, 2024
  
  5895b246
27 Jul, 2024 3 commits
- [TPU] Reduce compilation time & Upgrade PyTorch XLA version (#6856) · fad5576c
  Woosuk Kwon authored Jul 27, 2024
  
  fad5576c
- [Doc] add VLLM_TARGET_DEVICE=neuron to documentation for neuron (#6844) · 3c301239
  omrishiv authored Jul 26, 2024
```
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
```
  3c301239
- [ROCm] Upgrade PyTorch nightly version (#6845) · ced36cd8
  Woosuk Kwon authored Jul 26, 2024
  
  ced36cd8
26 Jul, 2024 2 commits
- [Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU backend... · 3bbb4936
  Li, Jiang authored Jul 27, 2024
```
[Hardware] [Intel] Enable Multiprocessing and tensor parallel in CPU backend and update documentation  (#6125)
```
  3bbb4936
- [doc][debugging] add known issues for hangs (#6816) · 85ad7e2d
  youkaichao authored Jul 25, 2024
  
  85ad7e2d
24 Jul, 2024 2 commits
- [Doc][AMD][ROCm]Added tips to refer to mi300x tuning guide for mi300x users (#6754) · d88c458f
  Hongxia Yang authored Jul 24, 2024
  
  d88c458f
- [Docs][ROCm] Detailed instructions to build from source (#6680) · ccc4a732
  Woosuk Kwon authored Jul 24, 2024
  
  ccc4a732
20 Jul, 2024 1 commit
- [Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA,... · 06d6c5fe
  Matt Wong authored Jul 20, 2024
```
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
```
  06d6c5fe
19 Jul, 2024 1 commit
- [Docs] Update docs for wheel location (#6580) · 30efe415
  Simon Mo authored Jul 19, 2024
  
  30efe415
17 Jul, 2024 2 commits
- [Doc][CI/Build] Update docs and tests to use `vllm serve` (#6431) · 5bf35a91
  Cyrus Leung authored Jul 17, 2024
  
  5bf35a91
- [ROCm] Cleanup Dockerfile and remove outdated patch (#6482) · 10383887
  Hongxia Yang authored Jul 17, 2024
  
  10383887
16 Jul, 2024 2 commits
- [Hardware][TPU] Support MoE with Pallas GMM kernel (#6457) · c467dff2
  Woosuk Kwon authored Jul 16, 2024
  
  c467dff2
- [doc][misc] remind to cancel debugging environment variables (#6481) · 9f4ccec7
  youkaichao authored Jul 16, 2024
```
[doc][misc] remind users to cancel debugging environment variables after debugging (#6481)
```
  9f4ccec7
15 Jul, 2024 2 commits
- [doc][misc] doc update (#6439) · 22e79ee8
  youkaichao authored Jul 14, 2024
  
  22e79ee8
- [Doc] xpu backend requires running setvars.sh (#6393) · 61e85dba
  Robert Cohn authored Jul 14, 2024
  
  61e85dba
12 Jul, 2024 1 commit
- Build some nightly wheels by default (#6380) · d719ba24
  Simon Mo authored Jul 12, 2024
  
  d719ba24
11 Jul, 2024 1 commit
- [Doc] Update description of vLLM support for CPUs (#6003) · 439c8458
  Jie Fu (傅杰) authored Jul 11, 2024
  
  439c8458
03 Jul, 2024 1 commit
- [doc][misc] bump up py version in installation doc (#6119) · 966fe721
  youkaichao authored Jul 03, 2024
  
  966fe721
28 Jun, 2024 1 commit
- [Hardware][Intel] OpenVINO vLLM backend (#5379) · 57f09a41
  Ilya Lavrenov authored Jun 28, 2024
  
  57f09a41
25 Jun, 2024 2 commits
- [Hardware][AMD][CI/Build][Doc] Upgrade to ROCm 6.1, Dockerfile improvements, test fixes (#5422) · dd793d1d
  Matt Wong authored Jun 25, 2024
  
  dd793d1d
- [doc][distributed] add both gloo and nccl tests (#5834) · c18ebfdd
  youkaichao authored Jun 25, 2024
  
  c18ebfdd
22 Jun, 2024 1 commit
- [Docs][TPU] Add installation tip for TPU (#5761) · 8c00f9c1
  Woosuk Kwon authored Jun 21, 2024
  
  8c00f9c1
17 Jun, 2024 2 commits
- [Hardware][Intel GPU] Add Intel GPU(XPU) inference backend (#3814) · 728c4c8a
  Kunshang Ji authored Jun 18, 2024
```
Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Abhilash Majumder <abhilash.majumder@intel.com>
Co-authored-by: Abhilash Majumder <30946547+abhilash1910@users.noreply.github.com>
```
  728c4c8a
- [Doc] add debugging tips for crash and multi-node debugging (#5581) · 845a3f26
  youkaichao authored Jun 16, 2024
  
  845a3f26
13 Jun, 2024 1 commit
- [Hardware][Intel] Optimize CPU backend and add more performance tips (#4971) · 80aa7e91
  Li, Jiang authored Jun 14, 2024
```
Co-authored-by: Jianan Gu <jianan.gu@intel.com>
```
  80aa7e91
12 Jun, 2024 2 commits
- [Doc] Update debug docs (#5438) · b8d4dfff
  Cyrus Leung authored Jun 13, 2024
  
  b8d4dfff
- [Hardware] Initial TPU integration (#5292) · 1a8bfd92
  Woosuk Kwon authored Jun 12, 2024
  
  1a8bfd92
11 Jun, 2024 1 commit
- [Doc] add common case for long waiting time (#5430) · 8f89d720
  youkaichao authored Jun 11, 2024
  
  8f89d720