Commits · f256ebe4df6757d76f1f1642d7e110268a2f8190 · OpenDAS / vllm_cscc · GitLab

16 Jan, 2025 1 commit
- Support torchrun and SPMD-style offline inference (#12071) · bf53e0c7
  youkaichao authored Jan 16, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  bf53e0c7
06 Jan, 2025 1 commit
- [distributed] remove pynccl's redundant change_state (#11749) · 9e764e7b
  cennn authored Jan 06, 2025
  
  9e764e7b
05 Jan, 2025 1 commit
- [distributed] remove pynccl's redundant stream (#11744) · 635b8972
  cennn authored Jan 05, 2025
  
  635b8972
04 Jan, 2025 1 commit
- [Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture (#11233) · 300acb83
  Yan Burman authored Jan 04, 2025
```
Signed-off-by: Yan Burman <yanburman@users.noreply.github.com>
Signed-off-by: Ido Asraff <idoa@atero.ai>
```
  300acb83
16 Dec, 2024 1 commit
- [Model] Refactor Ultravox to use merged input processor (#11198) · d927dbcd
  Isotr0py authored Dec 16, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d927dbcd
12 Dec, 2024 1 commit
- [core][distributed] initialization from StatelessProcessGroup (#10986) · 62de37a3
  youkaichao authored Dec 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  62de37a3
11 Dec, 2024 1 commit
- [Model] PP support for Mamba-like models (#10992) · ffa48c91
  Mor Zusman authored Dec 11, 2024
```
Signed-off-by: mzusman <mor.zusmann@gmail.com>
```
  ffa48c91
07 Dec, 2024 1 commit
- [Doc] Explicitly state that PP isn't compatible with speculative decoding yet (#10975) · c889d588
  Cyrus Leung authored Dec 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c889d588
04 Dec, 2024 1 commit
- [CI/Build] Replace mean with torch.all in test_pynccl.py (#10876) · d2bd88b1
  Tyler Michael Smith authored Dec 03, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  d2bd88b1
03 Dec, 2024 1 commit
- [core][distributed] add pynccl broadcast (#10843) · 21fe7b48
  youkaichao authored Dec 02, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  21fe7b48
26 Nov, 2024 1 commit

custom allreduce + torch.compile (#10121) · 9a88f897

Sage Moore authored Nov 26, 2024


Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

9a88f897

25 Nov, 2024 1 commit
- [Model] Add OLMo November 2024 model (#10503) · 9db713a1
  Shane A authored Nov 25, 2024
  
  9db713a1
23 Nov, 2024 1 commit
- [Misc] Add pynccl wrappers for all_gather and reduce_scatter (#9432) · 978b3974
  Tyler Michael Smith authored Nov 22, 2024
  
  978b3974
15 Nov, 2024 1 commit
- [Bugfix] Fix unable to load some models (#10312) · 972112d8
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  972112d8
14 Nov, 2024 1 commit
- [ci][distributed] disable hanging tests (#10317) · 29f3ef26
  youkaichao authored Nov 14, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  29f3ef26
13 Nov, 2024 1 commit
- [core][distributed] use tcp store directly (#10275) · 0d4ea3fb
  youkaichao authored Nov 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  0d4ea3fb
11 Nov, 2024 3 commits
- [misc][distributed] auto port selection and disable tests (#10226) · 8a7fe47d
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8a7fe47d
- [core][distributed] add stateless process group (#10216) · e6de9784
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e6de9784
- [misc] improve cloudpickle registration and tests (#10202) · 73b9083e
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  73b9083e
07 Nov, 2024 2 commits
- [Core][Distributed] Refactor ipc buffer init in CustomAllreduce (#10030) · 6192e9b8
  Hanzhi Zhou authored Nov 06, 2024
```
Signed-off-by: Hanzhi Zhou <hanzhi713@gmail.com>
```
  6192e9b8
- [core][distributed] add stateless_init_process_group (#10072) · 719c1ca4
  youkaichao authored Nov 06, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  719c1ca4
06 Nov, 2024 1 commit
- [distributed] add function to create ipc buffers directly (#10064) · 4be3a451
  youkaichao authored Nov 05, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4be3a451
01 Nov, 2024 1 commit
- [torch.compile] Adding torch compile annotations to some models (#9876) · 2b5bf209
  Yongzao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2b5bf209
24 Oct, 2024 3 commits
- [torch.compile] Adding torch compile annotations to some models (#9641) · d27cfbf7
  Yongzao authored Oct 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  d27cfbf7
- [torch.compile] Adding torch compile annotations to some models (#9639) · 8a02cd04
  Yongzao authored Oct 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  8a02cd04
- [Bugfix] Fix PP for ChatGLM and Molmo (#9422) · 836e8ef6
  Cyrus Leung authored Oct 24, 2024
  
  836e8ef6
23 Oct, 2024 1 commit
- [Model] Add Qwen2-Audio model support (#9248) · fc6c2746
  Yunfei Chu authored Oct 24, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fc6c2746
22 Oct, 2024 1 commit
- [Bugfix]: serialize config by value for --trust-remote-code (#6751) · b7299011
  Travis Johnson authored Oct 21, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b7299011
18 Oct, 2024 1 commit
- [Model] Add user-configurable task for models that support both generation and embedding (#9424) · 051eaf6d
  Cyrus Leung authored Oct 19, 2024
  
  051eaf6d
06 Oct, 2024 1 commit
- [Model] PP support for embedding models and update docs (#9090) · b22b7984
  Cyrus Leung authored Oct 06, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  b22b7984
04 Oct, 2024 1 commit

[Models] Add remaining model PP support (#7168) · 0f6d7a9a

Murali Andoorveedu authored Oct 03, 2024

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

0f6d7a9a

01 Oct, 2024 1 commit
- [Bugfix] Fix Fuyu tensor parallel inference (#8986) · bc4eb65b
  Isotr0py authored Oct 01, 2024
  
  bc4eb65b
26 Sep, 2024 1 commit
- [BugFix] Fix test breakages from transformers 4.45 upgrade (#8829) · 4b377d6f
  Nick Hill authored Sep 27, 2024
  
  4b377d6f
23 Sep, 2024 1 commit
- [Model] Support pp for qwen2-vl (#8696) · a79e5229
  Yanyi Liu authored Sep 23, 2024
  
  a79e5229
13 Sep, 2024 2 commits
- [CI/Build] Reorganize models tests (#7820) · a84e598e
  Cyrus Leung authored Sep 14, 2024
  
  a84e598e
- [CI/Build] Enable InternVL2 PP test only on single node (#8437) · 9b4a3b23
  Isotr0py authored Sep 13, 2024
  
  9b4a3b23
12 Sep, 2024 1 commit
- [CI/Build] Disable multi-node test for InternVL2 (#8428) · b61bd98f
  Roger Wang authored Sep 12, 2024
  
  b61bd98f
11 Sep, 2024 1 commit
- [Bugfix] Fix InternVL2 vision embeddings process with pipeline parallel (#8299) · 1230263e
  Isotr0py authored Sep 11, 2024
  
  1230263e
07 Sep, 2024 1 commit
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
05 Sep, 2024 1 commit
- Inclusion of InternVLChatModel In PP_SUPPORTED_MODELS(Pipeline Parallelism) (#7860) · 8685ba1a
  manikandan.tm@zucisystems.com authored Sep 05, 2024
  
  8685ba1a