Commits · 52c3dd5909b6a89241b2ec32aed1c173b8aed1c0 · OpenDAS / vllm_cscc · GitLab

08 Aug, 2024 1 commit
- add git version for internal testing · 52c3dd59
  zhuwenwen authored Aug 08, 2024
  
  52c3dd59
06 Aug, 2024 2 commits
- update version and add gptq_kernels info · c7e7ca7b
  zhuwenwen authored Aug 06, 2024
  
  c7e7ca7b
- update version and skip install gptq_kernels · 58fb0c33
  zhuwenwen authored Aug 06, 2024
  
  58fb0c33
31 Jul, 2024 1 commit
- update benchmarks and examples · 1190e964
  zhuwenwen authored Jul 31, 2024
  
  1190e964
11 Jun, 2024 1 commit
- [Misc] Remove VLLM_BUILD_WITH_NEURON env variable (#5389) · 8bab4959
  Woosuk Kwon authored Jun 11, 2024
  
  8bab4959
09 Jun, 2024 1 commit
- [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) · 5467ac31
  bnellnm authored Jun 09, 2024
  
  5467ac31
03 Jun, 2024 1 commit
- update version · 1dba29d3
  zhuwenwen authored Jun 03, 2024
  
  1dba29d3
02 Jun, 2024 1 commit
- [Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927) · a66cf40b
  Divakar Verma authored Jun 02, 2024
```
This PR enables the fused topk_softmax kernel used in moe layer for HIP
```
  a66cf40b
01 Jun, 2024 1 commit
- [CI/Build] CMakeLists: build all extensions' cmake targets at the same time (#5034) · a360ff80
  Daniele authored Jun 01, 2024
  
  a360ff80
29 May, 2024 1 commit
- [Core][Optimization] remove vllm-nccl (#5091) · 5bd3c650
  youkaichao authored May 28, 2024
  
  5bd3c650
25 May, 2024 1 commit
- update version · 408f0a79
  zhuwenwen authored May 25, 2024
  
  408f0a79
22 May, 2024 2 commits
- fix make error · 09bcf00b
  zhuwenwen authored May 22, 2024
  
  09bcf00b
- skip fp8 · fd6bc480
  zhuwenwen authored May 22, 2024
  
  fd6bc480
13 May, 2024 1 commit
- [Frontend] [Core] perf: Automatically detect vLLM-tensorized model, update... · 8bc68e19
  Sanger Steel authored May 13, 2024
```
[Frontend] [Core] perf: Automatically detect vLLM-tensorized model, update `tensorizer` to version 2.9.0 (#4208)
```
  8bc68e19
12 May, 2024 1 commit
- update cmake args · dbb2e382
  zhuwenwen authored May 12, 2024
  
  dbb2e382
09 May, 2024 1 commit
- [ROCm] Add support for Punica kernels on AMD GPUs (#3140) · ff5abcd7
  kliuae authored May 10, 2024
```
Co-authored-by: miloice <jeffaw99@hotmail.com>
```
  ff5abcd7
08 May, 2024 1 commit
- [Misc] Use vllm-flash-attn instead of flash-attn (#4686) · 89579a20
  Woosuk Kwon authored May 08, 2024
  
  89579a20
03 May, 2024 1 commit
- [Misc] add installation time env vars (#4574) · 344bf7cd
  youkaichao authored May 03, 2024
  
  344bf7cd
02 May, 2024 1 commit
- [Misc] Exclude the `tests` directory from being packaged (#4552) · 5ad60b0c
  Hu Dong authored May 03, 2024
  
  5ad60b0c
01 May, 2024 1 commit
- [CI/Build][Bugfix] VLLM_USE_PRECOMPILED should skip compilation (#4534) · 8b798eec
  Travis Johnson authored May 01, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  8b798eec
30 Apr, 2024 1 commit
- [Frontend] [Core] Tensorizer: support dynamic `num_readers`, update version (#4467) · 715c2d85
  Alpay Ariyak authored Apr 30, 2024
  
  715c2d85
26 Apr, 2024 1 commit
- [CI] Disable non-lazy string operation on logging (#4326) · a88081bf
  SangBin Cho authored Apr 26, 2024
```
Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>
```
  a88081bf
18 Apr, 2024 1 commit
- [CI/CD] add neuron docker and ci test scripts (#3571) · cd2f63fb
  Liangfu Chen authored Apr 18, 2024
  
  cd2f63fb
14 Apr, 2024 2 commits
- [BugFix] Fix tensorizer extra in setup.py (#4072) · 563c54f7
  Nick Hill authored Apr 14, 2024
  
  563c54f7
- [Frontend] [Core] feat: Add model loading using `tensorizer` (#3476) · 711a0002
  Sanger Steel authored Apr 13, 2024
  
  711a0002
12 Apr, 2024 1 commit
- [Doc] Add typing hints / mypy types cleanup (#3816) · c2b4a1bc
  Michael Feil authored Apr 11, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  c2b4a1bc
05 Apr, 2024 1 commit
- [Misc] Define common requirements (#3841) · cfaf49a1
  Woosuk Kwon authored Apr 05, 2024
  
  cfaf49a1
04 Apr, 2024 1 commit
- [Core] manage nccl via a pypi package & upgrade to pt 2.2.1 (#3805) · ca81ff51
  youkaichao authored Apr 04, 2024
  
  ca81ff51
02 Apr, 2024 1 commit

[Hardware][Intel] Add CPU inference backend (#3634) · 0e3f06fe

bigPYJ1151 authored Apr 02, 2024


Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yuan Zhou <yuan.zhou@intel.com>

0e3f06fe

28 Mar, 2024 1 commit
- [CI/Build] update default number of jobs and nvcc threads to avoid overloading the system (#3675) · 3492859b
  youkaichao authored Mar 27, 2024
  
  3492859b
27 Mar, 2024 1 commit
- [Core] remove cupy dependency (#3625) · 8f44facd
  youkaichao authored Mar 27, 2024
  
  8f44facd
25 Mar, 2024 2 commits
- [CI] Try introducing isort. (#3495) · 01bfb22b
  SangBin Cho authored Mar 25, 2024
  
  01bfb22b
- [CI/Build] respect the common environment variable MAX_JOBS (#3600) · 42bc3861
  youkaichao authored Mar 24, 2024
  
  42bc3861
21 Mar, 2024 1 commit
- [BugFix] Hot fix in setup.py for neuron build (#3537) · 523e30ea
  Zhuohan Li authored Mar 20, 2024
  
  523e30ea
20 Mar, 2024 1 commit
- Check for _is_cuda() in compute_num_jobs (#3481) · ba8ae1d8
  bnellnm authored Mar 20, 2024
  
  ba8ae1d8
18 Mar, 2024 1 commit
- Cmake based build system (#2830) · 9fdf3de3
  bnellnm authored Mar 18, 2024
  
  9fdf3de3
17 Mar, 2024 1 commit
- [Misc] Use dataclass for InputMetadata (#3452) · abfc4f33
  Woosuk Kwon authored Mar 17, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  abfc4f33
16 Mar, 2024 2 commits
- Fix setup.py neuron-ls issue (#2671) · 6b78837b
  Simon Mo authored Mar 16, 2024
  
  6b78837b
- [Misc] fix line length for entire codebase (#3444) · 8e67598a
  Simon Mo authored Mar 16, 2024
  
  8e67598a
15 Mar, 2024 1 commit
- [Misc] add error message in non linux platform (#3438) · 604f2359
  youkaichao authored Mar 15, 2024
  
  604f2359