Commits · 6192e9b8fef8492c3e52bd65c7d954a1ef9b40c8 · OpenDAS / vllm_cscc · GitLab

07 Nov, 2024 2 commits
- [Core][Distributed] Refactor ipc buffer init in CustomAllreduce (#10030) · 6192e9b8
  Hanzhi Zhou authored Nov 06, 2024
```
Signed-off-by: Hanzhi Zhou <hanzhi713@gmail.com>
```
  6192e9b8
- [core][distributed] add stateless_init_process_group (#10072) · 719c1ca4
  youkaichao authored Nov 06, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  719c1ca4
06 Nov, 2024 1 commit
- [distributed] add function to create ipc buffers directly (#10064) · 4be3a451
  youkaichao authored Nov 05, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4be3a451
01 Nov, 2024 1 commit
- [torch.compile] Adding torch compile annotations to some models (#9876) · 2b5bf209
  Yongzao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2b5bf209
24 Oct, 2024 3 commits
- [torch.compile] Adding torch compile annotations to some models (#9641) · d27cfbf7
  Yongzao authored Oct 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  d27cfbf7
- [torch.compile] Adding torch compile annotations to some models (#9639) · 8a02cd04
  Yongzao authored Oct 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  8a02cd04
- [Bugfix] Fix PP for ChatGLM and Molmo (#9422) · 836e8ef6
  Cyrus Leung authored Oct 24, 2024
  
  836e8ef6
23 Oct, 2024 1 commit
- [Model] Add Qwen2-Audio model support (#9248) · fc6c2746
  Yunfei Chu authored Oct 24, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fc6c2746
22 Oct, 2024 1 commit
- [Bugfix]: serialize config by value for --trust-remote-code (#6751) · b7299011
  Travis Johnson authored Oct 21, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b7299011
18 Oct, 2024 1 commit
- [Model] Add user-configurable task for models that support both generation and embedding (#9424) · 051eaf6d
  Cyrus Leung authored Oct 19, 2024
  
  051eaf6d
06 Oct, 2024 1 commit
- [Model] PP support for embedding models and update docs (#9090) · b22b7984
  Cyrus Leung authored Oct 06, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  b22b7984
04 Oct, 2024 1 commit

[Models] Add remaining model PP support (#7168) · 0f6d7a9a

Murali Andoorveedu authored Oct 03, 2024

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

0f6d7a9a

01 Oct, 2024 1 commit
- [Bugfix] Fix Fuyu tensor parallel inference (#8986) · bc4eb65b
  Isotr0py authored Oct 01, 2024
  
  bc4eb65b
26 Sep, 2024 1 commit
- [BugFix] Fix test breakages from transformers 4.45 upgrade (#8829) · 4b377d6f
  Nick Hill authored Sep 27, 2024
  
  4b377d6f
23 Sep, 2024 1 commit
- [Model] Support pp for qwen2-vl (#8696) · a79e5229
  Yanyi Liu authored Sep 23, 2024
  
  a79e5229
13 Sep, 2024 2 commits
- [CI/Build] Reorganize models tests (#7820) · a84e598e
  Cyrus Leung authored Sep 14, 2024
  
  a84e598e
- [CI/Build] Enable InternVL2 PP test only on single node (#8437) · 9b4a3b23
  Isotr0py authored Sep 13, 2024
  
  9b4a3b23
12 Sep, 2024 1 commit
- [CI/Build] Disable multi-node test for InternVL2 (#8428) · b61bd98f
  Roger Wang authored Sep 12, 2024
  
  b61bd98f
11 Sep, 2024 1 commit
- [Bugfix] Fix InternVL2 vision embeddings process with pipeline parallel (#8299) · 1230263e
  Isotr0py authored Sep 11, 2024
  
  1230263e
07 Sep, 2024 1 commit
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
05 Sep, 2024 1 commit
- Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860) · 8685ba1a
  manikandan.tm@zucisystems.com authored Sep 05, 2024
  
  8685ba1a
23 Aug, 2024 1 commit
- [Ray backend] Better error when pg topology is bad. (#7584) · c01a6cb2
  SangBin Cho authored Aug 22, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  c01a6cb2
21 Aug, 2024 1 commit
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
17 Aug, 2024 1 commit
- [aDAG] Unflake aDAG + PP tests (#7600) · 4706eb62
  SangBin Cho authored Aug 16, 2024
  
  4706eb62
16 Aug, 2024 2 commits
- [Misc/Testing] Use `torch.testing.assert_close` (#7324) · 50b8d08d
  jon-chuang authored Aug 15, 2024
  
  50b8d08d
- [ci/test] rearrange tests and make adag test soft fail (#7572) · 4cd7d47f
  youkaichao authored Aug 15, 2024
  
  4cd7d47f
13 Aug, 2024 3 commits
- [misc][plugin] add plugin system implementation (#7426) · 16422ea7
  youkaichao authored Aug 13, 2024
  
  16422ea7
- [Bugfix] Fix weight loading for Chameleon when TP>1 (#7410) · 7025b11d
  Cyrus Leung authored Aug 13, 2024
  
  7025b11d
- [Core] Shut down aDAG workers with clean async llm engine exit (#7224) · 198d6a28
  Rui Qiao authored Aug 12, 2024
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  198d6a28
09 Aug, 2024 1 commit
- [Core] Support serving encoder/decoder models (#7258) · 7eb4a51c
  Cyrus Leung authored Aug 09, 2024
  
  7eb4a51c
06 Aug, 2024 1 commit

[Core] Subclass ModelRunner to support cross-attention & encoder sequences... · fd95e026

afeldman-nm authored Aug 06, 2024


[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

fd95e026

03 Aug, 2024 2 commits
- [ci][distributed] disable ray dag tests (#7099) · a0d16456
  youkaichao authored Aug 02, 2024
  
  a0d16456
- [ci][distributed] merge distributed test commands (#7097) · 04e55834
  youkaichao authored Aug 02, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  04e55834
02 Aug, 2024 2 commits
- [Core] Pipeline parallel with Ray ADAG (#6837) · 05308891
  Rui Qiao authored Aug 02, 2024
```
Support pipeline-parallelism with Ray accelerated DAG.
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  05308891
- [ci][distributed] try to fix pp test (#7054) · 25235779
  youkaichao authored Aug 01, 2024
  
  25235779
31 Jul, 2024 2 commits
- [MISC] Introduce pipeline parallelism partition strategies (#6920) · bd700134
  Cody Yu authored Jul 31, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  bd700134
- [Bugfix] Fix broadcasting logic for `multi_modal_kwargs` (#6836) · f230cc2c
  Cyrus Leung authored Jul 31, 2024
  
  f230cc2c
26 Jul, 2024 1 commit
- [ci][distributed] fix flaky tests (#6806) · 443c7cf4
  youkaichao authored Jul 25, 2024
  
  443c7cf4
24 Jul, 2024 1 commit
- [Bugfix] fix flashinfer cudagraph capture for PP (#6708) · 5e8ca973
  William Lin authored Jul 23, 2024
  
  5e8ca973