Commits · dc6908ac6a188234c1480ed3e2bf3b2b8136642a · OpenDAS / vllm_cscc

23 Mar, 2026 1 commit

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007) · dc6908ac

Ranran authored Mar 23, 2026


Signed-off-by: Ranran <1012869439@qq.com>
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: ran <hzz5361@psu.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc6908ac

22 Mar, 2026 1 commit
- [Test] Only Run MLA model when user explicitly set for batch invariance (#37719) · eaf49786
  Wentao Ye authored Mar 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eaf49786
30 Jan, 2026 1 commit

Disable Cascade Attention for Batch Invariance (#32561) · 8f5d5120

Frank Wang authored Jan 30, 2026

Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

8f5d5120

17 Dec, 2025 1 commit
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
16 Dec, 2025 1 commit

[Refactor] Small refactor for group topk (#30562) · f21f5ea3

Wentao Ye authored Dec 16, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

f21f5ea3

09 Dec, 2025 2 commits
- [Feature] Batch-Invariant Support for FA2 and LoRA (#30018) · 5dcd593b
  liuquan authored Dec 09, 2025
```
Signed-off-by: quanliu <18646313696@163.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  5dcd593b
- [Feature] Batch invariant: Enable `TRITON_MLA` without prefix-caching (#29125) · d9417096
  Wentao Ye authored Dec 08, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d9417096
26 Nov, 2025 1 commit

[Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345) · 0b0aa874

Wentao Ye authored Nov 26, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0b0aa874

21 Nov, 2025 1 commit
- [CI] Add batch invariant test to ci (#27842) · 1f400c58
  Wentao Ye authored Nov 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1f400c58
20 Nov, 2025 1 commit
- [Bug] Fix torch dynamo warning Dynamo detected a call to a `functools.lru_cache` (#29038) · 2c52c7fd
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2c52c7fd
19 Nov, 2025 1 commit
- [Bug] Fix Batch Invariant MLA test (#28967) · 1607e664
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1607e664
17 Nov, 2025 1 commit
- [Test] Batch Invariant: Rename and organize tests (#27421) · a289cc1d
  Wentao Ye authored Nov 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a289cc1d
05 Nov, 2025 1 commit
- [Feature] Extend batch invariant torch.compile to B200 (#27856) · faedbb4d
  Paul Zhang authored Nov 05, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
```
  faedbb4d
28 Oct, 2025 1 commit
- [Test] Batch Invariant: Unit test using parameterized backend (#27478) · 6afc28a9
  Wentao Ye authored Oct 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6afc28a9
18 Oct, 2025 1 commit
- [Feature] Batch Invariant: Support DeepGEMM and Blackwell (#27127) · 245e4f2c
  Wentao Ye authored Oct 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  245e4f2c
17 Oct, 2025 1 commit
- [Test] Make `test_failure` more stable for batch invariance (#27054) · f50cc221
  Wentao Ye authored Oct 17, 2025
  
  f50cc221
16 Oct, 2025 3 commits
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- [Bug] Fix batch invariant test `has` to `is` (#27032) · 2ed8b6b3
  Wentao Ye authored Oct 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2ed8b6b3
- Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de
  Bram Wasti authored Oct 15, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7d8975de
13 Oct, 2025 1 commit
- [unrevert] Add batch invariant kernel override for FlashInfer backend [2/n] (#26373) · 32637990
  Bram Wasti authored Oct 13, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
```
  32637990
08 Oct, 2025 1 commit
- [Bug] Fix Test in Batch Invariant (#26128) · 4ba88757
  Wentao Ye authored Oct 08, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4ba88757
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 2 commits
- Revert "Add batch invariant kernel override for FlashInfer backend [2/n]" (#26220) · 1838cd48
  Cyrus Leung authored Oct 04, 2025
  
  1838cd48
- Add batch invariant kernel override for FlashInfer backend [2/n] (#25769) · 2f7dbc9b
  Bram Wasti authored Oct 03, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  2f7dbc9b
26 Sep, 2025 1 commit
- Kernel-override Determinism [1/n] (#25603) · dc48ba0c
  Bram Wasti authored Sep 26, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  dc48ba0c