Commits · 47a0b615b45efd0a9ed57049d8ca6eff1c249844 · OpenDAS / vllm_cscc

20 Dec, 2024 2 commits

Add ray[default] to wget to run distributed inference out of box (#11265) · 47a0b615
Jiaxin Shan authored Dec 20, 2024
```
Signed-off-by: Jiaxin Shan <seedjeffwan@gmail.com>
```
47a0b615

[ci][gh200] dockerfile clean up (#11351) · 7801f56e

youkaichao authored Dec 19, 2024


Signed-off-by: drikster80 <ed.sealing@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: cenzhiyao <2523403608@qq.com>

7801f56e

16 Dec, 2024 1 commit
- WIP: [CI/Build] simplify Dockerfile build for ARM64 / GH200 (#11212) · b3b1526f
  cennn authored Dec 16, 2024
```
Signed-off-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
```
  b3b1526f
04 Nov, 2024 1 commit
- [Bugfix] Upgrade to pytorch 2.5.1 (#10001) · d93478b3
  bnellnm authored Nov 04, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
```
  d93478b3
30 Oct, 2024 1 commit
- [Misc] Specify minimum pynvml version (#9827) · 6aa6020f
  Jee Jee Li authored Oct 30, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6aa6020f
27 Oct, 2024 1 commit

[Misc] Upgrade to pytorch 2.5 (#9588) · 3cb07a36

bnellnm authored Oct 27, 2024


Signed-off-by: Bill Nell <bill@neuralmagic.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

3cb07a36

21 Sep, 2024 1 commit
- [Kernel] Build flash-attn from source (#8245) · 71c60491
  Luka Govedič authored Sep 21, 2024
  
  71c60491
11 Aug, 2024 1 commit
- [CI/Build] build on empty device for better dev experience (#4773) · 38608797
  tomeras91 authored Aug 11, 2024
  
  38608797
01 Aug, 2024 2 commits
- [Misc] Support attention logits soft-capping with flash-attn (#7022) · 805a8a75
  Woosuk Kwon authored Aug 01, 2024
  
  805a8a75
- [CI/Build] Update PyTorch to 2.4.0 (#6951) · 7e0861bd
  Sage Moore authored Aug 01, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  7e0861bd
12 Jul, 2024 1 commit
- [MISC] Upgrade dependency to PyTorch 2.3.1 (#5327) · aa48e502
  Cody Yu authored Jul 12, 2024
  
  aa48e502
24 Jun, 2024 1 commit
- [Bugfix] Add phi3v resize for dynamic shape and fix torchvision requirement (#5772) · edd5fe5f
  Isotr0py authored Jun 24, 2024
  
  edd5fe5f
03 Jun, 2024 1 commit
- [Core] Remove unnecessary copies in flash attn backend (#5138) · 0ab278ca
  Antoni Baum authored Jun 03, 2024
  
  0ab278ca
29 May, 2024 1 commit
- [Core][Optimization] remove vllm-nccl (#5091) · 5bd3c650
  youkaichao authored May 28, 2024
  
  5bd3c650
20 May, 2024 1 commit
- [Kernel] Add flash-attn back (#4907) · b57e6c59
  Woosuk Kwon authored May 19, 2024
  
  b57e6c59
08 May, 2024 1 commit
- [Misc] Use vllm-flash-attn instead of flash-attn (#4686) · 89579a20
  Woosuk Kwon authored May 08, 2024
  
  89579a20
30 Apr, 2024 1 commit
- [Misc] Upgrade to `torch==2.3.0` (#4454) · d627a3d8
  Michael Goin authored Apr 29, 2024
  
  d627a3d8
24 Apr, 2024 1 commit
- [CI][Build] change pynvml to nvidia-ml-py (#4302) · e4bf860a
  youkaichao authored Apr 23, 2024
  
  e4bf860a
15 Apr, 2024 1 commit
- [Misc] Upgrade triton to 2.2.0 (#4061) · 8db1bf32
  Roy authored Apr 15, 2024
  
  8db1bf32
05 Apr, 2024 1 commit
- [Misc] Define common requirements (#3841) · cfaf49a1
  Woosuk Kwon authored Apr 05, 2024
  
  cfaf49a1