Commits · ebc73f2828df48f0ffbb99e52f0e4b394a23dbd3 · OpenDAS / vllm_cscc · GitLab

07 Jan, 2025 1 commit
- [Bugfix] Comprehensively test and fix LLaVA-NeXT feature size calculation (#11800) · 8f37be38
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8f37be38
15 Dec, 2024 1 commit
- [[Misc]Upgrade bitsandbytes to the latest version 0.45.0 (#11201) · 15859f23
  Jee Jee Li authored Dec 15, 2024
  
  15859f23
11 Dec, 2024 1 commit

[core] Bump ray to use _overlap_gpu_communication in compiled graph tests (#10410) · 72ff3a96

Rui Qiao authored Dec 11, 2024

Signed-off-by: Rui Qiao <ubuntu@ip-172-31-15-128.us-west-2.compute.internal>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Rui Qiao <ubuntu@ip-172-31-15-128.us-west-2.compute.internal>

72ff3a96

07 Dec, 2024 1 commit
- [Model] Update multi-modal processor to support Mantis(LLaVA) model (#10711) · 39e227c7
  Cyrus Leung authored Dec 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39e227c7
02 Dec, 2024 1 commit
- [CI/Build] Update `mistral_common` version for tests and docs (#10825) · e95f275f
  Cyrus Leung authored Dec 02, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e95f275f
08 Nov, 2024 1 commit
- [CI/Build] Update CPU tests to include all "standard" tests (#5481) · b489fc3c
  Cyrus Leung authored Nov 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b489fc3c
07 Nov, 2024 1 commit

Online video support for VLMs (#10020) · 28b2877d

litianjian authored Nov 08, 2024


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

28b2877d

04 Nov, 2024 1 commit
- [Bugfix] Upgrade to pytorch 2.5.1 (#10001) · d93478b3
  bnellnm authored Nov 04, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
```
  d93478b3
01 Nov, 2024 1 commit

[ci/build] Bump the patch-update group with 10 updates (#9897) · d151fde8

dependabot[bot] authored Nov 01, 2024

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <kevin@anyscale.com>

d151fde8

30 Oct, 2024 1 commit
- [ci/build] Pin CI dependencies version with pip-compile (#9810) · 62fac4b9
  Kevin H. Luu authored Oct 29, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  62fac4b9
15 Oct, 2024 1 commit
- [Misc] Directly use compressed-tensors for checkpoint definitions (#8909) · 22f8a695
  Michael Goin authored Oct 15, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  22f8a695
09 Oct, 2024 1 commit
- Add `lm-eval` directly to requirements-test.txt (#9161) · 9ba0bd6a
  Michael Goin authored Oct 08, 2024
  
  9ba0bd6a
04 Oct, 2024 1 commit

[Models] Add remaining model PP support (#7168) · 0f6d7a9a

Murali Andoorveedu authored Oct 03, 2024

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

0f6d7a9a

25 Sep, 2024 1 commit
- [[Misc]Upgrade bitsandbytes to the latest version 0.44.0 (#8768) · 13f9f7a3
  Jee Jee Li authored Sep 25, 2024
  
  13f9f7a3
17 Sep, 2024 1 commit
- [Misc] Limit to ray[adag] 2.35 to avoid backward incompatible change (#8509) · cbdb2522
  Rui Qiao authored Sep 17, 2024
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  cbdb2522
14 Sep, 2024 1 commit
- [Model] support minicpm3 (#8297) · 8a0cf1dd
  ywfang authored Sep 14, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a0cf1dd
11 Sep, 2024 1 commit

[model] Support for Llava-Next-Video model (#7559) · 6a512a00

Yangshen⚡Deng authored Sep 11, 2024


Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

6a512a00

06 Sep, 2024 1 commit
- [Misc] Use ray[adag] dependency instead of cuda (#7938) · de80783b
  Rui Qiao authored Sep 06, 2024
  
  de80783b
01 Sep, 2024 1 commit
- [Misc] Optional installation of audio related packages (#8063) · 5b86b199
  Roger Wang authored Sep 01, 2024
  
  5b86b199
28 Aug, 2024 1 commit
- [Kernel/Model] Migrate mamba_ssm and causal_conv1d kernels to vLLM (#7651) · fdd9daaf
  Mor Zusman authored Aug 29, 2024
  
  fdd9daaf
20 Aug, 2024 1 commit
- [ci] Install Buildkite test suite analysis (#7667) · 0df7ec0b
  Kevin H. Luu authored Aug 19, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  0df7ec0b
18 Aug, 2024 1 commit
- [CI/Build] Add text-only test for Qwen models (#7475) · 40e1360b
  Alex Brooks authored Aug 18, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  40e1360b
14 Aug, 2024 1 commit
- [Misc] Revert `compressed-tensors` code reuse (#7521) · f55a9aea
  Kyle Sayers authored Aug 14, 2024
  
  f55a9aea
13 Aug, 2024 1 commit
- [Misc] `compressed-tensors` code reuse (#7277) · 373538f9
  Kyle Sayers authored Aug 13, 2024
  
  373538f9
06 Aug, 2024 1 commit
- [Model] Support SigLIP encoder and alternative decoders for LLaVA models (#7153) · 1f26efbb
  Cyrus Leung authored Aug 06, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  1f26efbb
02 Aug, 2024 1 commit

[Core] Pipeline parallel with Ray ADAG (#6837) · 05308891

Rui Qiao authored Aug 02, 2024



Support pipeline-parallelism with Ray accelerated DAG.
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>

05308891

01 Aug, 2024 1 commit
- [CI/Build] Remove sparseml requirement from testing (#7037) · fb3db616
  Michael Goin authored Aug 01, 2024
  
  fb3db616
29 Jul, 2024 1 commit
- [Model] Initialize support for InternVL2 series models (#6514) · 7cbd9ec7
  Isotr0py authored Jul 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  7cbd9ec7
29 Jun, 2024 1 commit

[ CI/Build ] Added E2E Test For Compressed Tensors (#5839) · 8dbfcd35

Robert Shaw authored Jun 29, 2024


Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic>

8dbfcd35

28 Jun, 2024 1 commit
- [Kernel] Flashinfer for prefill & decode, with Cudagraph support for decode (#4628) · 7041de43
  Lily Liu authored Jun 28, 2024
```
Co-authored-by: LiuXiaoxuanPKU &lt;llilyliupku@gmail.com&gt;, bong-furiosa <bongwon.jang@furiosa.ai>
```
  7041de43
24 Jun, 2024 1 commit
- [Bugfix] Add phi3v resize for dynamic shape and fix torchvision requirement (#5772) · edd5fe5f
  Isotr0py authored Jun 24, 2024
  
  edd5fe5f
18 Jun, 2024 1 commit
- [Model] Initialize Phi-3-vision support (#4986) · daef218b
  Isotr0py authored Jun 18, 2024
  
  daef218b
13 Jun, 2024 1 commit
- Seperate dev requirements into lint and test (#5474) · a8fda4f6
  Antoni Baum authored Jun 13, 2024
  
  a8fda4f6
12 Jun, 2024 1 commit
- [CI] Upgrade codespell version. (#5381) · 847cdcca
  SangBin Cho authored Jun 13, 2024
  
  847cdcca
03 Jun, 2024 1 commit
- [Core] Support image processor (#4197) · 7a64d24a
  Cyrus Leung authored Jun 03, 2024
  
  7a64d24a
01 Jun, 2024 1 commit
- [Feature][Kernel] Support bitsandbytes quantization and QLoRA (#4776) · b9c0605a
  chenqianfzh authored Jun 01, 2024
  
  b9c0605a
22 May, 2024 1 commit
- [CI/Build] Enforce style for C++ and CUDA code with `clang-format` (#4722) · 5f6d10c1
  Michael Goin authored May 22, 2024
  
  5f6d10c1
13 May, 2024 1 commit
- [Frontend] [Core] perf: Automatically detect vLLM-tensorized model, update... · 8bc68e19
  Sanger Steel authored May 13, 2024
```
[Frontend] [Core] perf: Automatically detect vLLM-tensorized model, update `tensorizer` to version 2.9.0 (#4208)
```
  8bc68e19
11 May, 2024 1 commit
- [Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734) · e254497b
  Chang Su authored May 11, 2024
  
  e254497b
30 Apr, 2024 1 commit
- [Frontend] [Core] Tensorizer: support dynamic `num_readers`, update version (#4467) · 715c2d85
  Alpay Ariyak authored Apr 30, 2024
  
  715c2d85