Commits · 54ed913f3437f9107791e8ea410170b86c968d52 · OpenDAS / vllm_cscc

15 Feb, 2025 1 commit
- [ci/build] update flashinfer (#13323) · 54ed913f
  youkaichao authored Feb 15, 2025
  
  54ed913f
03 Feb, 2025 1 commit
- [ci/build] fix gh200 test (#12681) · 1298a400
  youkaichao authored Feb 03, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1298a400
27 Jan, 2025 1 commit

[FlashInfer] Upgrade to 0.2.0 (#11194) · 2bc3fbba

Bowen Wang authored Jan 28, 2025


Signed-off-by: Bowen Wang <abmfy@icloud.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

2bc3fbba

24 Jan, 2025 1 commit
- [ci/build] sync default value for wheel size (#12398) · e784c6b9
  youkaichao authored Jan 24, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e784c6b9
21 Jan, 2025 1 commit
- [ci/build] update nightly torch for gh200 test (#12270) · 3aec49e5
  youkaichao authored Jan 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3aec49e5
08 Jan, 2025 2 commits
- [Doc][4/N] Reorganize API Reference (#11843) · 6cd40a5b
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6cd40a5b
- [Doc] Move examples into categories (#11840) · aba8d6ee
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aba8d6ee
02 Jan, 2025 1 commit
- [Misc] Minimum requirements for SageMaker compatibility (#11576) · 68d37809
  Nathan Azrak authored Jan 03, 2025
  
  68d37809
23 Dec, 2024 1 commit
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
20 Dec, 2024 3 commits
- Add ray[default] to wget to run distributed inference out of box (#11265) · 47a0b615
  Jiaxin Shan authored Dec 20, 2024
```
Signed-off-by: Jiaxin Shan <seedjeffwan@gmail.com>
```
  47a0b615
- [Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192) · 995f5623
  omer-dayan authored Dec 20, 2024
```
Signed-off-by: OmerD <omer@run.ai>
```
  995f5623
- [ci][gh200] dockerfile clean up (#11351) · 7801f56e
  youkaichao authored Dec 19, 2024
```
Signed-off-by: drikster80 <ed.sealing@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: cenzhiyao <2523403608@qq.com>
```
  7801f56e
16 Dec, 2024 1 commit
- WIP: [CI/Build] simplify Dockerfile build for ARM64 / GH200 (#11212) · b3b1526f
  cennn authored Dec 16, 2024
```
Signed-off-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
```
  b3b1526f
15 Dec, 2024 1 commit
- [[Misc]Upgrade bitsandbytes to the latest version 0.45.0 (#11201) · 15859f23
  Jee Jee Li authored Dec 15, 2024
  
  15859f23
26 Nov, 2024 1 commit
- [ci] add vllm_test_utils (#10659) · 334d64d1
  youkaichao authored Nov 26, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  334d64d1
08 Nov, 2024 1 commit
- Add hf_transfer to testing image (#10096) · aea6ad62
  Michael Goin authored Nov 08, 2024
  
  aea6ad62
06 Nov, 2024 1 commit
- [V1] Make v1 more testable (#9888) · d58268c5
  Joe Runde authored Nov 06, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  d58268c5
02 Nov, 2024 1 commit
- [CI/Build] Quoting around > (#9956) · 1b73ab2a
  Nikita Furin authored Nov 02, 2024
  
  1b73ab2a
17 Oct, 2024 1 commit
- [CI/Build] remove .github from .dockerignore, add dirty repo check (#9375) · a2c71c54
  Daniele authored Oct 17, 2024
  
  a2c71c54
14 Oct, 2024 1 commit
- [CI/Build] setuptools-scm fixes (#8900) · 203ab8f8
  Daniele authored Oct 14, 2024
  
  203ab8f8
09 Oct, 2024 1 commit
- [CI/Build] Update Dockerfile install+deploy image to ubuntu 22.04 (#9130) · d5fbb870
  Michael Goin authored Oct 09, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d5fbb870
08 Oct, 2024 1 commit

[CI/Build] Add examples folder into Docker image so that we can leverage the... · cfba685b

Peter Pan authored Oct 09, 2024


[CI/Build] Add examples folder into Docker image so that we can leverage the templates*.jinja when serving models (#8758)
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>

cfba685b

26 Sep, 2024 2 commits
- [Docs] Add README to the build docker image (#8825) · 520db4db
  Michael Goin authored Sep 26, 2024
  
  520db4db
- [Build/CI] Upgrade to gcc 10 in the base build Docker image (#8814) · f70bccac
  Tyler Michael Smith authored Sep 26, 2024
  
  f70bccac
25 Sep, 2024 1 commit
- [[Misc]] Add extra deps for openai server image (#8792) · c6f2485c
  Jee Jee Li authored Sep 26, 2024
  
  c6f2485c
23 Sep, 2024 1 commit
- [CI/Build] use setuptools-scm to set __version__ (#4738) · ee5f34b1
  Daniele authored Sep 23, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  ee5f34b1
21 Sep, 2024 1 commit
- [Kernel] Build flash-attn from source (#8245) · 71c60491
  Luka Govedič authored Sep 21, 2024
  
  71c60491
17 Sep, 2024 1 commit
- [Bugfix] Fix 3.12 builds on main (#8510) · cca61642
  Joe Runde authored Sep 16, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cca61642
16 Sep, 2024 1 commit
- [misc] small qol fixes for release process (#8517) · 5ce45eb5
  Simon Mo authored Sep 16, 2024
  
  5ce45eb5
11 Sep, 2024 1 commit

[model] Support for Llava-Next-Video model (#7559) · 6a512a00

Yangshen⚡Deng authored Sep 11, 2024


Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

6a512a00

07 Sep, 2024 1 commit
- [CI/Build] Use python 3.12 in cuda image (#8133) · cfe712bf
  Joe Runde authored Sep 07, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cfe712bf
06 Sep, 2024 1 commit
- [Misc] Use ray[adag] dependency instead of cuda (#7938) · de80783b
  Rui Qiao authored Sep 06, 2024
  
  de80783b
04 Sep, 2024 1 commit
- chore: Update check-wheel-size.py to read MAX_SIZE_MB from env (#8103) · ccd72071
  TimWang authored Sep 04, 2024
  
  ccd72071
02 Sep, 2024 1 commit
- [SpecDecode][Kernel] Flashinfer Rejection Sampling (#7244) · e6a26ed0
  Lily Liu authored Sep 01, 2024
  
  e6a26ed0
28 Aug, 2024 1 commit
- [Kernel/Model] Migrate mamba_ssm and causal_conv1d kernels to vLLM (#7651) · fdd9daaf
  Mor Zusman authored Aug 29, 2024
  
  fdd9daaf
22 Aug, 2024 1 commit

[ci] Cleanup & refactor Dockerfile to pass different Python versions and... · 666ad0aa

Kevin H. Luu authored Aug 22, 2024


[ci] Cleanup & refactor Dockerfile to pass different Python versions and sccache bucket via build args (#7705)
Signed-off-by: kevin <kevin@anyscale.com>

666ad0aa

19 Aug, 2024 1 commit
- [Core] Use flashinfer sampling kernel when available (#7137) · f710fb52
  Peng Guanwen authored Aug 19, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  f710fb52
12 Aug, 2024 1 commit
- [Kernel] Flashinfer correctness fix for v0.1.3 (#7319) · ec2affa8
  Lily Liu authored Aug 12, 2024
  
  ec2affa8
02 Aug, 2024 1 commit

[Core] Pipeline parallel with Ray ADAG (#6837) · 05308891

Rui Qiao authored Aug 02, 2024



Support pipeline-parallelism with Ray accelerated DAG.
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>

05308891

01 Aug, 2024 1 commit
- [CI/Build] Update PyTorch to 2.4.0 (#6951) · 7e0861bd
  Sage Moore authored Aug 01, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  7e0861bd