Commits · f4135232b9a8c4845f8961fb1cd17581c56ae2ce · OpenDAS / vllm_cscc

30 Jul, 2025 1 commit
- feat(distributed): add `get_required_kvcache_layout` class method to kv connector api (#20433) · f4135232
  wxsm authored Jul 31, 2025
```
Signed-off-by: wxsm <wxsms@foxmail.com>
```
  f4135232
28 Jul, 2025 2 commits

[Model] Support TP/PP/mamba2 kernel for PLaMo2 (#19674) · c7ffe93d

Shinichi Hemmi authored Jul 28, 2025


Signed-off-by: Shinichi Hemmi <shemmi@preferred.jp>
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>
Co-authored-by: Sixue Wang <cecilwang@preferred.jp>

c7ffe93d

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

23 Jul, 2025 1 commit
- Simplify weight loading in Transformers backend (#21382) · f154bb9f
  Harry Mellor authored Jul 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f154bb9f
16 Jul, 2025 1 commit
- Fix inadvertently silenced PP tests for `mp`, add DeepSeek V2/V3 model family to PP tests (#20831) · d0dc4cfc
  Seiji Eicher authored Jul 16, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  d0dc4cfc
12 Jul, 2025 1 commit

Add pynccl all-gatherv and reducescatterv (#20154) · a8593237

Trevor Morris authored Jul 11, 2025


Signed-off-by: Trevor Morris <tmorris@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

a8593237

27 Jun, 2025 1 commit

[Feature] add quick all reduce (#19744) · 0740e29b

li haoyang authored Jun 27, 2025


Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>

0740e29b

26 Jun, 2025 1 commit
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
25 Jun, 2025 1 commit
- [Misc] Add parallel state `node_count` function (#20045) · c40692bf
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c40692bf
23 Jun, 2025 1 commit
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
04 Jun, 2025 1 commit
- feat: add data parallel rank to KVEventBatch (#18925) · b712be98
  Yan Ru Pei authored Jun 03, 2025
  
  b712be98
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
30 May, 2025 1 commit
- [VLM] Add PP support and fix GPTQ inference for Ovis models (#18958) · 5a864163
  Isotr0py authored May 31, 2025
```
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  5a864163
22 May, 2025 1 commit
- [CI] Fix race condition with StatelessProcessGroup.barrier (#18506) · 6e0fd34d
  Russell Bryant authored May 21, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  6e0fd34d
21 May, 2025 1 commit
- [Bugfix][Failing Test] Fix test_events.py (#18460) · 61acfc45
  Rabi Mishra authored May 21, 2025
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  61acfc45
17 May, 2025 1 commit
- Support sequence parallelism combined with pipeline parallelism (#18243) · 9ab2c02f
  cascade authored May 17, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  9ab2c02f
16 May, 2025 1 commit
- [Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 (#17827) · 3d2779c2
  Lucia Fang authored May 15, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  3d2779c2
14 May, 2025 1 commit
- [Misc] replace does not exist model (#18119) · 82e7f9bb
  rongfu.leng authored May 14, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  82e7f9bb
09 May, 2025 1 commit
- Improve configs - the rest! (#17562) · 4b2ed792
  Harry Mellor authored May 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4b2ed792
06 May, 2025 1 commit

[V1][PP] Support PP for MultiprocExecutor (#14219) · a6fed020

Li, Jiang authored May 06, 2025


Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: jiang.li <jiang1.li@intel.com>

a6fed020

30 Apr, 2025 1 commit

[V1][Metrics] add support for kv event publishing (#16750) · 0be6d05b

Alec authored Apr 30, 2025


Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

0be6d05b

27 Apr, 2025 1 commit

[Feature] support sequence parallelism using compilation pass (#16155) · 690fe019

cascade authored Apr 27, 2025


Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

690fe019

26 Apr, 2025 1 commit
- [Bugfix] Fix standard models tests (#17217) · 909fdaf1
  Cyrus Leung authored Apr 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  909fdaf1
01 Apr, 2025 1 commit
- [Distributed] Add custom allreduce support for ROCM (#14125) · b7b7676d
  Ilya Markov authored Apr 01, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  b7b7676d
31 Mar, 2025 2 commits
- [Bugfix] Check dimensions of multimodal embeddings in V1 (#15816) · 09e974d4
  Cyrus Leung authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09e974d4
- Upgrade `transformers` to `v4.50.3` (#13905) · e5ef4fa9
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e5ef4fa9
26 Mar, 2025 1 commit

Separate base model from `TransformersModel` (#15467) · cf5c8f16

Harry Mellor authored Mar 26, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

cf5c8f16

25 Mar, 2025 1 commit

Add pipeline parallel support to `TransformersModel` (#12832) · 97cfa65d

Harry Mellor authored Mar 25, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

97cfa65d

20 Mar, 2025 1 commit

[ci] feat: make the test_torchrun_example run with tp=2, external_dp=2 (#15172) · 086b5682

Chi Zhang authored Mar 21, 2025


Signed-off-by: Chi Zhang <zhangchi.usc1992@bytedance.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

086b5682

17 Mar, 2025 2 commits

[Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810) · 2bb0e1a7

vllmellm authored Mar 17, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2bb0e1a7

[Misc] Replace os environ to monkeypatch in test suite (#14516) · a73e183e

Sibi authored Mar 17, 2025


Signed-off-by: sibi <85477603+t-sibiraj@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

a73e183e

16 Mar, 2025 1 commit
- [Misc] Catching Ray Compiled Graph PP test failures for V1 (#14847) · b9b5bdfc
  Rui Qiao authored Mar 16, 2025
  
  b9b5bdfc
15 Mar, 2025 1 commit

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

14 Mar, 2025 1 commit
- [Misc] Clean up type annotation for `SupportsMultiModal` (#14794) · 601bd326
  Cyrus Leung authored Mar 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  601bd326
07 Mar, 2025 1 commit
- [Misc] Set default value of seed to None (#14274) · cc102814
  மனோஜ்குமார் பழனிச்சாமி authored Mar 07, 2025
```
Signed-off-by: மனோஜ்குமார் பழனிச்சாமி <smartmanoj42857@gmail.com>
```
  cc102814
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
27 Feb, 2025 1 commit
- [misc] Rename Ray ADAG to Compiled Graph (#13928) · c9944acb
  Rui Qiao authored Feb 26, 2025
  
  c9944acb
26 Feb, 2025 1 commit
- Improve pipeline partitioning (#13839) · 145944cb
  Harry Mellor authored Feb 26, 2025
  
  145944cb
24 Feb, 2025 1 commit
- Expert Parallelism (EP) Support for DeepSeek V2 (#12583) · 781096e3
  Jongseok Park authored Feb 24, 2025
  
  781096e3
23 Feb, 2025 1 commit
- [v1] torchrun compatibility (#13642) · eb24dc4a
  youkaichao authored Feb 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eb24dc4a