Commits · 45ceb85a0c9032ea8bfa3d2526e3d7c1a09a48f0 · OpenDAS / vllm_cscc

19 Jul, 2024 1 commit
- [CI/Build] Build on Ubuntu 20.04 instead of 22.04 (#6517) · 1689219e
  Tyler Michael Smith authored Jul 18, 2024
  
  1689219e
15 Jul, 2024 2 commits
- [Misc] Use 0.0.9 version for flashinfer (#6447) · a63a4c63
  Pernekhan Utemuratov authored Jul 15, 2024
```
Co-authored-by: Pernekhan Utemuratov <pernekhan@deepinfra.com>
```
  a63a4c63
- [CI/Build] Cross python wheel (#6394) · a754dc2c
  Robert Shaw authored Jul 14, 2024
  
  a754dc2c
14 Jul, 2024 1 commit
- [ci][build] fix commit id (#6420) · ccd3c045
  youkaichao authored Jul 14, 2024
```
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ccd3c045
08 Jul, 2024 1 commit
- Add FlashInfer to default Dockerfile (#6172) · 4f0e0ea1
  Simon Mo authored Jul 08, 2024
  
  4f0e0ea1
06 Jul, 2024 1 commit
- Move release wheel env var to Dockerfile instead (#6163) · bc96d5c3
  Simon Mo authored Jul 05, 2024
  
  bc96d5c3
02 Jul, 2024 1 commit

[Model] Jamba support (#4115) · 9d6a8daa

Mor Zusman authored Jul 03, 2024


Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Erez Schwartz <erezs@ai21.com>
Co-authored-by: Mor Zusman <morz@ai21.com>
Co-authored-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Tomer Asida <tomera@ai21.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

9d6a8daa

21 Jun, 2024 1 commit
- [BugFix] exclude version 1.15.0 for modelscope (#5668) · f1e72cc1
  zhyncs authored Jun 22, 2024
  
  f1e72cc1
18 Jun, 2024 1 commit
- [ci] Setup Release pipeline and build release wheels with cache (#5610) · 19091efc
  Kevin H. Luu authored Jun 18, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  19091efc
13 Jun, 2024 2 commits
- Seperate dev requirements into lint and test (#5474) · a8fda4f6
  Antoni Baum authored Jun 13, 2024
  
  a8fda4f6
- [ci] Use sccache to build images (#5419) · 916d219d
  Kevin H. Luu authored Jun 12, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  916d219d
29 May, 2024 1 commit
- [Doc][Build] update after removing vllm-nccl (#5103) · 4fbcb0f2
  youkaichao authored May 29, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  4fbcb0f2
08 May, 2024 1 commit
- [Misc] Use vllm-flash-attn instead of flash-attn (#4686) · 89579a20
  Woosuk Kwon authored May 08, 2024
  
  89579a20
04 May, 2024 1 commit
- [CI] check size of the wheels (#4319) · 021b1a2a
  Simon Mo authored May 04, 2024
  
  021b1a2a
30 Apr, 2024 2 commits
- [Doc] add visualization for multi-stage dockerfile (#4456) · b31a1fb6
  Prashant Gupta authored Apr 30, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  b31a1fb6
- [Misc] Upgrade to `torch==2.3.0` (#4454) · d627a3d8
  Michael Goin authored Apr 29, 2024
  
  d627a3d8
05 Apr, 2024 2 commits
- [Misc] Define common requirements (#3841) · cfaf49a1
  Woosuk Kwon authored Apr 05, 2024
  
  cfaf49a1
- [CI/Build] refactor dockerfile & fix pip cache · d03d64fd
  youkaichao authored Apr 04, 2024
```
[CI/Build] fix pip cache with vllm_nccl & refactor dockerfile to build wheels (#3859)
```
  d03d64fd
04 Apr, 2024 1 commit
- [Core] manage nccl via a pypi package & upgrade to pt 2.2.1 (#3805) · ca81ff51
  youkaichao authored Apr 04, 2024
  
  ca81ff51
29 Mar, 2024 2 commits
- Usage Stats Collection (#2852) · d8658c8c
  yhu422 authored Mar 28, 2024
  
  d8658c8c
- add ccache to docker build image (#3704) · 7bc94a0f
  Simon Mo authored Mar 28, 2024
  
  7bc94a0f
27 Mar, 2024 1 commit
- [Core] remove cupy dependency (#3625) · 8f44facd
  youkaichao authored Mar 27, 2024
  
  8f44facd
19 Mar, 2024 1 commit
- Update dockerfile with ModelScope support (#3429) · c614cfee
  ifsheldon authored Mar 20, 2024
  
  c614cfee
18 Mar, 2024 1 commit
- Cmake based build system (#2830) · 9fdf3de3
  bnellnm authored Mar 18, 2024
  
  9fdf3de3
14 Mar, 2024 1 commit
- Install `flash_attn` in Docker image (#3396) · 06ec4867
  Thomas Parnell authored Mar 14, 2024
  
  06ec4867
13 Mar, 2024 1 commit
- add hf_transfer to requirements.txt (#3031) · e221910e
  Ronan McGovern authored Mar 13, 2024
  
  e221910e
14 Feb, 2024 1 commit
- Fix docker python version (#2845) · 87069ccf
  Nikola Borisov authored Feb 14, 2024
  
  87069ccf
01 Feb, 2024 1 commit
- fix python 3.8 syntax (#2716) · b9e96b17
  Simon Mo authored Feb 01, 2024
  
  b9e96b17
31 Jan, 2024 1 commit
- Add unit test for Mixtral MoE layer (#2677) · d0d93b92
  Philipp Moritz authored Jan 31, 2024
  
  d0d93b92
26 Jan, 2024 1 commit
- Don't build punica kernels by default (#2605) · 390b495f
  Philipp Moritz authored Jan 26, 2024
  
  390b495f
14 Jan, 2024 1 commit
- [CI] Add Buildkite (#2355) · 6e01e8c1
  Simon Mo authored Jan 14, 2024
  
  6e01e8c1
04 Jan, 2024 1 commit
- Build docker image with shared objects from "build" step (#2237) · 937e7b7d
  Alexandre Payot authored Jan 04, 2024
  
  937e7b7d
14 Dec, 2023 1 commit
- Optimize Mixtral with expert parallelism (#2090) · 21d93c14
  Antoni Baum authored Dec 13, 2023
  
  21d93c14
13 Dec, 2023 1 commit
- Update Dockerfile to build Megablocks (#2042) · 3fefe271
  Simon Mo authored Dec 12, 2023
  
  3fefe271
11 Dec, 2023 1 commit
- Update Dockerfile to support Mixtral (#2027) · eb172128
  Simon Mo authored Dec 11, 2023
  
  eb172128
08 Dec, 2023 1 commit
- [Docker] Add cuda arch list as build option (#1950) · c85b80c2
  Simon Mo authored Dec 08, 2023
  
  c85b80c2
07 Dec, 2023 1 commit
- [Docker] Adding number of nvcc_threads during build as envar (#1893) · 24f60a54
  AguirreNicolas authored Dec 07, 2023
  
  24f60a54
30 Nov, 2023 1 commit
- [FIX] Fix docker build error (#1831) (#1832) · f07c1cea
  Allen authored Nov 30, 2023
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  f07c1cea
09 Nov, 2023 1 commit
- Dockerfile: Upgrade Cuda to 12.1 (#1609) · aebfcb26
  GhaziSyed authored Nov 09, 2023
  
  aebfcb26
31 Oct, 2023 1 commit
- Add Dockerfile (#1350) · 9cabcb76
  Stephen Krider authored Oct 31, 2023
  
  9cabcb76