Commits · 9912b8ccb861593d76216afa583ac593faf5a309 · OpenDAS / vllm_cscc

19 Nov, 2025 1 commit

[Build] Add OpenAI triton_kernels (#28788) · 9912b8cc

Varun Sundar Rabindranath authored Nov 18, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

9912b8cc

15 Nov, 2025 1 commit
- [PERF] Remove TRTLLM Gen attn kernel limitation `max_seq_len <=131072` (#28755) · 173b356a
  Vadim Gimpelson authored Nov 15, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  173b356a
14 Nov, 2025 3 commits

[Config] Clean up SchedulerConfig initialization (#28665) · 511a6b61
Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
511a6b61

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438) · 4516d44b

Jingchun Gao authored Nov 14, 2025


Signed-off-by: gaojc <1055866782@qq.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

4516d44b

[Misc] Remove `warn_for_unimplemented_methods` (#28613) · 01bea115
Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
01bea115

13 Nov, 2025 4 commits
- [Performance][B200] silu_mul_quant: pack scales in int32 (#28358) · fe1cd770
  Varun Sundar Rabindranath authored Nov 13, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fe1cd770
- [BugFix][ROCm] Fix `get_cu_count` missing variable error (#28608) · 7dca0c90
  Pleaplusone authored Nov 13, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  7dca0c90
- [Bugfix] Fix SM100 gpt-oss regression due to faulty attn sink support (#28561) · a543e678
  Michael Goin authored Nov 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a543e678
- [platform] Move get_cu_count to utils (#27005) · 2dacd573
  wangxiyuan authored Nov 13, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  2dacd573
12 Nov, 2025 3 commits
- [MoE][Kernel][Perf] Improve Shared Expert Stream Overlap (#28406) · 69d0e903
  Alexander Matveev authored Nov 12, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  69d0e903
- [Performance][B200] Fix deepgemm prologue (#27897) · 74a9a9fa
  Varun Sundar Rabindranath authored Nov 12, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  74a9a9fa
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
10 Nov, 2025 1 commit
- [Perf] Move gc.freeze logic from EngineCoreProc to EngineCore for better coverage (#27896) · b30372cb
  Jialin Ouyang authored Nov 10, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b30372cb
08 Nov, 2025 1 commit
- [flashinfer][fix] do not check nvcc availability when using pre-downloaded cubins (#27990) · 4a36681f
  Xiaozhu Meng authored Nov 07, 2025
```
Signed-off-by: Xiaozhu <mxz297@gmail.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  4a36681f
05 Nov, 2025 2 commits
- [Feature] Extend batch invariant torch.compile to B200 (#27856) · faedbb4d
  Paul Zhang authored Nov 05, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
```
  faedbb4d
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
04 Nov, 2025 1 commit
- [Multimodal] Make MediaConnector extensible. (#27759) · 1fb4217a
  Chenheli Hua authored Nov 04, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  1fb4217a
03 Nov, 2025 1 commit
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
01 Nov, 2025 1 commit
- [Docs] Mock all imports for docs (#27873) · 799ce45c
  Harry Mellor authored Nov 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  799ce45c
28 Oct, 2025 2 commits
- [Misc] Make `LayerBlockType` a `Literal` instead of `Enum` (#27658) · f5710ef0
  Cyrus Leung authored Oct 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f5710ef0
- [Misc] Separate out `utils.counter` and move `utils.Device` to engine (#27588) · f58d9b64
  Cyrus Leung authored Oct 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f58d9b64
27 Oct, 2025 2 commits
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
- [Misc] Clean up utils (#27552) · 7c2bdb83
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c2bdb83
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

24 Oct, 2025 1 commit
- [Log] Optimize Startup Log (#26740) · 52efc34e
  Wentao Ye authored Oct 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  52efc34e
23 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.platform_utils.py` (#27374) · ca76486a
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  ca76486a
- [Chore] Remove duplicate `has_` functions in vllm.utils (#27372) · e255d929
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  e255d929
22 Oct, 2025 3 commits

[Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
a0003b56

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

[Frontend][3/N] Improve all pooling task | Support binary embedding response (#27066) · 1f633b86

wang.yuqi authored Oct 22, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1f633b86

21 Oct, 2025 1 commit
- [Chore] Separate out NCCL utilities from vllm.utils (#27197) · 6c728f77
  dongbo910220 authored Oct 21, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  6c728f77
19 Oct, 2025 3 commits
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
- [Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f
  iAmir97 authored Oct 19, 2025
```
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
```
  7a6c8c3f
- [Chore] Separate out hashing utilities from vllm.utils (#27151) · 8a297115
  dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  8a297115
18 Oct, 2025 4 commits

[Chore] Separate out profiling utilities from vllm.utils (#27150) · a1946c9f
dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
a1946c9f
[Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
6ac5e06f
[Misc] Refactor `get_kv_cache_spec` into `AttentionLayerBase` (#26587) · b26b70be
Nicolò Lucchesi authored Oct 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
b26b70be

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

17 Oct, 2025 2 commits
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- Remove unused imports (#26972) · 4d055ef4
  Lukas Geiger authored Oct 17, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4d055ef4