Commits · 7f0367109ebb6274e1e5ae7102948ebc730d4e60 · OpenDAS / vllm_cscc

03 Jul, 2025 1 commit

[Bugfix] Fixes for FlashInfer's TORCH_CUDA_ARCH_LIST (#20136) · bdb84e26

Tyler Michael Smith authored Jul 02, 2025


Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>

bdb84e26

27 Jun, 2025 1 commit

[CI/Build] Allow hermetic builds (#18064) · 3c545c0c

Fabien Dupont authored Jun 27, 2025


Signed-off-by: Fabien Dupont <fdupont@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Fabien Dupont <fabiendupont@pm.me>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Elias Levy <eliaslevy@google.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

3c545c0c

25 Jun, 2025 1 commit
- [CI] Add SM120 to the Dockerfile (#19794) · 296ce95d
  Michael Goin authored Jun 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  296ce95d
11 Jun, 2025 1 commit
- [CI] Update FlashInfer to 0.2.6.post1 (#19297) · 497a91e9
  Michael Goin authored Jun 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  497a91e9
23 May, 2025 3 commits
- [Doc] Update references to doc files (#18637) · 7d921649
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d921649
- Use prebuilt FlashInfer x86_64 PyTorch 2.7 CUDA 12.8 wheel for CI (#18537) · 1645b601
  Huy Do authored May 23, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  1645b601
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
22 May, 2025 1 commit

[Build/CI] Fix CUDA 11.8 build (#17679) · 6e588da0

Tyler Michael Smith authored May 22, 2025


Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>

6e588da0

21 May, 2025 1 commit
- [Build] fix Dockerfile shell (#18402) · 371376f9
  Kebe authored May 21, 2025
  
  371376f9
19 May, 2025 1 commit
- [Build] Supports CUDA 12.6 and 11.8 after Blackwell Update (#18316) · 47fda6d0
  Simon Mo authored May 18, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  47fda6d0
17 May, 2025 1 commit
- Update Dockerfile to build for Blackwell (#18095) · dcfe9523
  Michael Goin authored May 17, 2025
  
  dcfe9523
16 May, 2025 1 commit
- [Sampler] Adapt to FlashInfer 0.2.3 sampler API (#15777) · 7fdfa015
  Bowen Wang authored May 16, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7fdfa015
30 Apr, 2025 1 commit
- Update PyTorch to 2.7.0 (#16859) · 2c4f59af
  Huy Do authored Apr 29, 2025
  
  2c4f59af
29 Apr, 2025 1 commit
- [CI/Build] Add retry mechanism for add-apt-repository (#17107) · 08e15def
  Reid authored Apr 30, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  08e15def
28 Apr, 2025 1 commit
- [Bugfix] Fix missing ARG in Dockerfile for arm64 platforms (#17261) · d1aeea75
  Lennart K. M. Schulz authored Apr 28, 2025
```
Signed-off-by: lkm-schulz <44176356+lkm-schulz@users.noreply.github.com>
```
  d1aeea75
23 Apr, 2025 1 commit
- [CI/Build] workaround for CI build failure (#17070) · b07d7416
  Sangyeon Cho authored Apr 24, 2025
```
Signed-off-by: csy1204 <josang1204@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  b07d7416
18 Apr, 2025 1 commit
- [Misc] add collect_env to cli and docker image (#16759) · 7bdfd29a
  rongfu.leng authored Apr 18, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  7bdfd29a
16 Apr, 2025 1 commit
- [Bugfix] fix gpu docker image mis benchmarks dir (#16628) · 96bb8aa6
  rongfu.leng authored Apr 16, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  96bb8aa6
31 Mar, 2025 1 commit
- Move dockerfiles into their own directory (#14549) · e6e3c55e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6e3c55e
24 Mar, 2025 2 commits
- Revert "[CI/Build] Use uv python for docker rather than ppa:deadsnakess/ppa (#13569)" (#15377) · 7ffcccfa
  Simon Mo authored Mar 24, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  7ffcccfa
- [Misc] Upgrade BNB version (#15183) · 3892e58a
  Jee Jee Li authored Mar 24, 2025
  
  3892e58a
23 Mar, 2025 1 commit
- [ci/build] update torch nightly version for GH200 (#15135) · 09b6a955
  youkaichao authored Mar 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  09b6a955
14 Mar, 2025 1 commit

Update to torch==2.6.0 (#12721) · 14f301b5

Michael Goin authored Mar 14, 2025


Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: luka <luka@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

14f301b5

08 Mar, 2025 2 commits
- Move requirements into their own directory (#12547) · 206e2577
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  206e2577
- [CI/Build] refactor: set timezone of container to UTC (#12888) · 3b9c6c69
  Roger Meier authored Mar 08, 2025
```
Signed-off-by: Roger Meier <r.meier@siemens.com>
```
  3b9c6c69
06 Mar, 2025 2 commits
- [CI/Build] Use uv python for docker rather than ppa:deadsnakes/ppa (#13569) · d9292786
  Michael Goin authored Mar 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d9292786
- [Build] Add UV_HTTP_TIMEOUT to avoid timeout during installation (#13850) · 71eaf896
  Yuan Tang authored Mar 05, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  71eaf896
22 Feb, 2025 1 commit
- [CI/Build] fix uv caching in Dockerfile (#13611) · 78ac0f59
  Daniele authored Feb 22, 2025
  
  78ac0f59
20 Feb, 2025 1 commit
- [CI/Build] Use uv in the Dockerfile (#13566) · 497bc831
  Michael Goin authored Feb 20, 2025
  
  497bc831
15 Feb, 2025 1 commit
- [ci/build] update flashinfer (#13323) · 54ed913f
  youkaichao authored Feb 15, 2025
  
  54ed913f
03 Feb, 2025 1 commit
- [ci/build] fix gh200 test (#12681) · 1298a400
  youkaichao authored Feb 03, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1298a400
27 Jan, 2025 1 commit

[FlashInfer] Upgrade to 0.2.0 (#11194) · 2bc3fbba

Bowen Wang authored Jan 28, 2025


Signed-off-by: Bowen Wang <abmfy@icloud.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

2bc3fbba

24 Jan, 2025 1 commit
- [ci/build] sync default value for wheel size (#12398) · e784c6b9
  youkaichao authored Jan 24, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e784c6b9
21 Jan, 2025 1 commit
- [ci/build] update nightly torch for gh200 test (#12270) · 3aec49e5
  youkaichao authored Jan 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3aec49e5
08 Jan, 2025 2 commits
- [Doc][4/N] Reorganize API Reference (#11843) · 6cd40a5b
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6cd40a5b
- [Doc] Move examples into categories (#11840) · aba8d6ee
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aba8d6ee
02 Jan, 2025 1 commit
- [Misc] Minimum requirements for SageMaker compatibility (#11576) · 68d37809
  Nathan Azrak authored Jan 03, 2025
  
  68d37809
23 Dec, 2024 1 commit
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
20 Dec, 2024 2 commits
- Add ray[default] to wget to run distributed inference out of box (#11265) · 47a0b615
  Jiaxin Shan authored Dec 20, 2024
```
Signed-off-by: Jiaxin Shan <seedjeffwan@gmail.com>
```
  47a0b615
- [Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192) · 995f5623
  omer-dayan authored Dec 20, 2024
```
Signed-off-by: OmerD <omer@run.ai>
```
  995f5623