Commits · f8a1a2d108d290791ae1245b2ee309f38fdd7619 · OpenDAS / vllm_cscc

06 Jun, 2025 1 commit
- [v1] Hybrid Memory Allocator (#17996) · f8a1a2d1
  Chen Zhang authored Jun 06, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  f8a1a2d1
04 Jun, 2025 1 commit
- [CI/Build][Bugfix] Ensure compatibility with transformers 4.52 (#18678) · 01dc9a76
  Cyrus Leung authored Jun 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  01dc9a76
03 Jun, 2025 4 commits
- [Kernel] DeepEP dispatch-combine kernel integration (#18434) · fa98d777
  Varun Sundar Rabindranath authored Jun 03, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fa98d777
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [V1] Support DP with Ray (#18779) · bdce64f2
  Rui Qiao authored Jun 02, 2025
  
  bdce64f2
- [Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) · 9112b443
  Siyuan Liu authored Jun 02, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  9112b443
02 Jun, 2025 2 commits

[Bugfix][Model] Attempt to fix eagle in V0. (#18978) · ca2f6b9c
Gregory Shtrasberg authored Jun 02, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
ca2f6b9c

[Model] enable data parallel for Llama4 vision encoder (#18368) · ebb1ec93

jennyyyyzhen authored Jun 02, 2025


Signed-off-by: yzhen <yzhen@devgpu093.cco2.facebook.com>
Co-authored-by: yZhen <yZhen@fb.com>
Co-authored-by: yzhen <yzhen@devgpu093.cco2.facebook.com>

ebb1ec93

01 Jun, 2025 1 commit
- [Core] Rework dtype resolution (#18751) · 6aa8f9a4
  Cyrus Leung authored Jun 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6aa8f9a4
31 May, 2025 1 commit

[Neuron] Add Multi-Modal model support for Neuron (#18921) · 2a50ef57

Satyajith Chilappagari authored May 31, 2025


Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
Co-authored-by: Ashraf Mahgoub <ashymahg@amazon.com>
Co-authored-by: Rohith Nallamaddi <nalrohit@amazon.com>
Co-authored-by: FeliciaLuo <luof@amazon.com>
Co-authored-by: Elaine Zhao <elaineyz@amazon.com>

2a50ef57

29 May, 2025 3 commits
- Skip device and quant Pydantic validation to make plugin device work (#18843) · 3c49dbdd
  Yikun Jiang authored May 29, 2025
```
Signed-off-by: Yikun Jiang <yikunkero@gmail.com>
```
  3c49dbdd
- [Doc][Neuron] Update documentation for Neuron (#18868) · 1661a9c2
  aws-elaineyz authored May 28, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
```
  1661a9c2
- Add ability to use CUDAGraphs with use_inductor=False (#17345) · 26b4fa45
  Richard Zou authored May 28, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  26b4fa45
28 May, 2025 5 commits
- Remove checks for `None` for fields which should never be `None` (#17985) · 6dbe5b5c
  Harry Mellor authored May 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6dbe5b5c
- Enable Pydantic mypy checks and convert configs to Pydantic dataclasses (#17599) · 4c2b38ce
  Harry Mellor authored May 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4c2b38ce
- [CI] improve embed testing (#18747) · de65fc8e
  wang.yuqi authored May 28, 2025
  
  de65fc8e
- [Deprecation] Remove fallbacks for Embeddings API (#18795) · 0c492b78
  Cyrus Leung authored May 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c492b78
- [Bugfix] Fix nomic max_model_len (#18755) · 3e9ce609
  wang.yuqi authored May 28, 2025
  
  3e9ce609
27 May, 2025 1 commit

[Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c

Hyogeun Oh (오효근) authored May 27, 2025


[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>

a68e293c

26 May, 2025 1 commit
- [Bugfix] Fix Mistral-format models with sliding window (#18693) · 61a45e7a
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61a45e7a
23 May, 2025 8 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [Doc] Update references to doc files (#18637) · 7d921649
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d921649
- [V1] Support Deepseek MTP (#18435) · 2628a69e
  Jiayi Yao authored May 23, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  2628a69e
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- [Feature]Add async tensor parallelism using compilation pass (#17882) · 71ea614d
  cascade authored May 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  71ea614d
- [Neuron] Remove bypass on EAGLEConfig and add a test (#18514) · ed5d4082
  aws-elaineyz authored May 22, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
```
  ed5d4082
- [Bugfix] Set `KVTransferConfig.engine_id` in post_init (#18576) · e44d8ce8
  lkchen authored May 22, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  e44d8ce8
- Enable hybrid attention models for Transformers backend (#18494) · 4b0da7b6
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4b0da7b6
22 May, 2025 1 commit
- [Platform] Move platform check to right place (#18470) · 721fb9b1
  wangxiyuan authored May 23, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  721fb9b1
21 May, 2025 1 commit
- [Frontend] deprecate `--device` arg (#18399) · 5d7f5452
  Kebe authored May 21, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  5d7f5452
20 May, 2025 1 commit
- [Minor] Rename quantization nvfp4 to modelopt_fp4 (#18356) · f4a8a374
  Michael Goin authored May 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f4a8a374
17 May, 2025 2 commits
- Support sequence parallelism combined with pipeline parallelism (#18243) · 9ab2c02f
  cascade authored May 17, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  9ab2c02f
- [P/D][V1] Support dynamic loading of external KV connector implementations (#18142) · 3e0d4350
  David Ben-David authored May 17, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  3e0d4350
16 May, 2025 1 commit
- [Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 (#17827) · 3d2779c2
  Lucia Fang authored May 15, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  3d2779c2
15 May, 2025 3 commits
- [Misc] Avoid cuda graph log when sizes still match (#18202) · e3f3aee6
  Nicolò Lucchesi authored May 15, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  e3f3aee6
- fix: typos (#18151) · a9944aab
  omahs authored May 15, 2025
```
Signed-off-by: omahs <73983677+omahs@users.noreply.github.com>
```
  a9944aab
- [Fix][ROCm] Enforce eager for all encoder-decoder models on ROCm (#18154) · 83f74c69
  Luka Govedič authored May 15, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
  83f74c69
14 May, 2025 2 commits
- [V1] Structured Outputs + Thinking compatibility (#16577) · 2fc9075b
  Aaron Pham authored May 14, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  2fc9075b
- [Bug]: Fix S3 model/tokenizer path resolution (#18083) · 754b699c
  Jon Gill authored May 13, 2025
```
Signed-off-by: Jon Gill <jon@yurts.ai>
```
  754b699c
13 May, 2025 1 commit
- [V1] DP scale-out (2/N): Decouple engine process management and comms (#15977) · 55aa7af9
  Nick Hill authored May 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  55aa7af9