Commits · 93872128111499f2d9127c3cd1f94b35850187d1 · OpenDAS / vllm_cscc

20 Sep, 2024 1 commit
- add benchmarks to vllm whl · 5b62725e
  zhuwenwen authored Sep 20, 2024
  
  5b62725e
11 Sep, 2024 1 commit

[model] Support for Llava-Next-Video model (#7559) · 6a512a00

Yangshen⚡Deng authored Sep 11, 2024


Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

6a512a00

10 Sep, 2024 2 commits
- [CI/Build] enable ccache/scccache for HIP builds (#8327) · 6234385f
  Daniele authored Sep 10, 2024
  
  6234385f
- update version and requirements-rocm.txt · 6897826e
  zhuwenwen authored Sep 10, 2024
  
  6897826e
09 Sep, 2024 1 commit
- update version · 50ed6d0a
  zhuwenwen authored Sep 09, 2024
  
  50ed6d0a
05 Sep, 2024 2 commits
- update version · 3015cac1
  zhuwenwen authored Sep 05, 2024
  
  3015cac1
- remove torch version · 163b243a
  zhuwenwen authored Sep 05, 2024
  
  163b243a
03 Sep, 2024 2 commits
- [CI/Build] make pip install vllm work in macos (for import only) (#8118) · c02638ef
  tomeras91 authored Sep 03, 2024
  
  c02638ef
- fix build error · 6bb59e94
  zhuwenwen authored Sep 03, 2024
  
  6bb59e94
01 Sep, 2024 1 commit
- [Misc] Optional installation of audio related packages (#8063) · 5b86b199
  Roger Wang authored Sep 01, 2024
  
  5b86b199
29 Aug, 2024 1 commit
- add torch version · 55588cbd
  zhuwenwen authored Aug 29, 2024
  
  55588cbd
21 Aug, 2024 1 commit
- [Bugfix] Pass PYTHONPATH from setup.py to CMake (#7730) · 1b32e026
  sasha0552 authored Aug 21, 2024
  
  1b32e026
19 Aug, 2024 1 commit
- [Bugfix] Fix xpu build (#7644) · 1a36287b
  Kunshang Ji authored Aug 19, 2024
  
  1a36287b
16 Aug, 2024 1 commit
- update version · 0451580f
  zhuwenwen authored Aug 16, 2024
  
  0451580f
13 Aug, 2024 1 commit
- fix build error · d1787c31
  zhuwenwen authored Aug 13, 2024
  
  d1787c31
11 Aug, 2024 1 commit
- [CI/Build] build on empty device for better dev experience (#4773) · 38608797
  tomeras91 authored Aug 11, 2024
  
  38608797
09 Aug, 2024 1 commit
- 增添lmslim gptq支持 · dcaabcf7
  gaoqiong authored Aug 09, 2024
  
  dcaabcf7
08 Aug, 2024 1 commit
- add git version for internal testing · 52c3dd59
  zhuwenwen authored Aug 08, 2024
  
  52c3dd59
07 Aug, 2024 1 commit
- [OpenVINO] migrate to latest dependencies versions (#7251) · 80cbe10c
  Ilya Lavrenov authored Aug 07, 2024
  
  80cbe10c
06 Aug, 2024 2 commits
- update version and add gptq_kernels info · c7e7ca7b
  zhuwenwen authored Aug 06, 2024
  
  c7e7ca7b
- update version and skip install gptq_kernels · 58fb0c33
  zhuwenwen authored Aug 06, 2024
  
  58fb0c33
02 Aug, 2024 2 commits
- [Misc] Disambiguate quantized types via a new ScalarType (#6396) · a8d604ca
  Lucas Wilkinson authored Aug 02, 2024
  
  a8d604ca
- [CI/Build] Add support for Python 3.12 (#7035) · b482b9a5
  Michael Goin authored Aug 02, 2024
  
  b482b9a5
01 Aug, 2024 1 commit
- [Kernel][RFC] Refactor the punica kernel based on Triton (#5036) · 7ecee343
  Jee Jee Li authored Aug 01, 2024
  
  7ecee343
31 Jul, 2024 1 commit
- update benchmarks and examples · 1190e964
  zhuwenwen authored Jul 31, 2024
  
  1190e964
25 Jul, 2024 2 commits
- update attention kernels and version · 0e640807
  zhuwenwen authored Jul 25, 2024
  
  0e640807
- update version · 69341fde
  zhuwenwen authored Jul 25, 2024
  
  69341fde
16 Jul, 2024 1 commit
- fix import error · 6fa22430
  zhuwenwen authored Jul 16, 2024
  
  6fa22430
14 Jul, 2024 2 commits
- [Feature] vLLM CLI (#5090) · dbfe254e
  Ethan Xu authored Jul 14, 2024
```
Co-authored-by: simon-mo <simon.mo@hey.com>
```
  dbfe254e
- [ci][build] fix commit id (#6420) · ccd3c045
  youkaichao authored Jul 14, 2024
```
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ccd3c045
12 Jul, 2024 1 commit
- [Misc] Add generated git commit hash as `vllm.__commit__` (#6386) · 111fc6e7
  Michael Goin authored Jul 12, 2024
  
  111fc6e7
28 Jun, 2024 1 commit
- [Hardware][Intel] OpenVINO vLLM backend (#5379) · 57f09a41
  Ilya Lavrenov authored Jun 28, 2024
  
  57f09a41
17 Jun, 2024 1 commit

[Hardware][Intel GPU] Add Intel GPU(XPU) inference backend (#3814) · 728c4c8a

Kunshang Ji authored Jun 18, 2024

Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Abhilash Majumder <abhilash.majumder@intel.com>
Co-authored-by: Abhilash Majumder <30946547+abhilash1910@users.noreply.github.com>

728c4c8a

13 Jun, 2024 2 commits
- [Misc] Add vLLM version getter to utils (#5098) · 03dccc88
  Cyrus Leung authored Jun 14, 2024
  
  03dccc88
- [ci] Use sccache to build images (#5419) · 916d219d
  Kevin H. Luu authored Jun 12, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  916d219d
12 Jun, 2024 1 commit
- [Hardware] Initial TPU integration (#5292) · 1a8bfd92
  Woosuk Kwon authored Jun 12, 2024
  
  1a8bfd92
11 Jun, 2024 1 commit
- [Misc] Remove VLLM_BUILD_WITH_NEURON env variable (#5389) · 8bab4959
  Woosuk Kwon authored Jun 11, 2024
  
  8bab4959
09 Jun, 2024 1 commit
- [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) · 5467ac31
  bnellnm authored Jun 09, 2024
  
  5467ac31
03 Jun, 2024 1 commit
- update version · 1dba29d3
  zhuwenwen authored Jun 03, 2024
  
  1dba29d3
02 Jun, 2024 1 commit
- [Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927) · a66cf40b
  Divakar Verma authored Jun 02, 2024
```
This PR enables the fused topk_softmax kernel used in moe layer for HIP
```
  a66cf40b