Commits · a810671a261997b5d95fee7868d79514844e6e81 · OpenDAS / vllm_cscc · GitLab

18 Dec, 2025 1 commit

[Bug] Fix batch invariant in torch 2.10 (#30907) · 66287582

Wentao Ye authored Dec 18, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

66287582

15 Dec, 2025 1 commit

Update batch invariant to use attention config (#30704) · 60dbf7d8

Matthew Bonanni authored Dec 15, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

60dbf7d8

13 Dec, 2025 1 commit

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

09 Dec, 2025 2 commits
- [Feature] Batch-Invariant Support for FA2 and LoRA (#30018) · 5dcd593b
  liuquan authored Dec 09, 2025
```
Signed-off-by: quanliu <18646313696@163.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  5dcd593b
- [Feature] Batch invariant: Enable `TRITON_MLA` without prefix-caching (#29125) · d9417096
  Wentao Ye authored Dec 08, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d9417096
26 Nov, 2025 1 commit

[Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345) · 0b0aa874

Wentao Ye authored Nov 26, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0b0aa874

25 Nov, 2025 1 commit
- [UX] Raise error for attn backend of batch invariant (#29348) · 699bca76
  Wentao Ye authored Nov 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  699bca76
22 Nov, 2025 1 commit

[tiny] Remove unsupported TRITON_MLA backend from batch invariance (#28832) · 5f7209a7

Bram Wasti authored Nov 22, 2025


Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

5f7209a7

21 Nov, 2025 1 commit
- [Bug] Fix torch warning of tf32 usage (#29112) · e1eefa4c
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e1eefa4c
20 Nov, 2025 1 commit
- [Bug] Fix torch dynamo warning Dynamo detected a call to a `functools.lru_cache` (#29038) · 2c52c7fd
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2c52c7fd
19 Nov, 2025 1 commit
- [Bug] Fix Batch Invariant MLA test (#28967) · 1607e664
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1607e664
18 Nov, 2025 1 commit
- [Refactor] Remove Unused Func in Batch Invariant (#28881) · 3ddcf460
  Wentao Ye authored Nov 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3ddcf460
12 Nov, 2025 1 commit
- [Core] Cache `vllm_is_batch_invariant` (#28304) · ac0bb2c3
  Lukas Geiger authored Nov 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  ac0bb2c3
05 Nov, 2025 1 commit
- [Feature] Extend batch invariant torch.compile to B200 (#27856) · faedbb4d
  Paul Zhang authored Nov 05, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
```
  faedbb4d
04 Nov, 2025 1 commit
- [Bug] Batch invariant: Fix flash attn MLA `RuntimeError: scheduler_metadata... · 7e4be741
  Wentao Ye authored Nov 04, 2025
```
[Bug] Batch invariant: Fix flash attn MLA `RuntimeError: scheduler_metadata must have shape (metadata_size)` (#27884)
```
  7e4be741
30 Oct, 2025 2 commits

[Feature] Batch invariant torch.compile (#27660) · e7acb200

Paul Zhang authored Oct 30, 2025


Signed-off-by: PaulZhang12 <paulzhan@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

e7acb200

Add more dims for batch invariant shims (#27489) · ded8ada8

Bram Wasti authored Oct 30, 2025

Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ded8ada8

28 Oct, 2025 1 commit
- [Test] Batch Invariant: Unit test using parameterized backend (#27478) · 6afc28a9
  Wentao Ye authored Oct 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6afc28a9
21 Oct, 2025 1 commit
- [Feature] Batch Invariant for R1 TP 8 on Blackwell (#27229) · 86ed7702
  Wentao Ye authored Oct 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  86ed7702
19 Oct, 2025 1 commit
- output type conversion fix (#27159) · 221bf725
  Jianyu Huang authored Oct 19, 2025
  
  221bf725
16 Oct, 2025 2 commits
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de
  Bram Wasti authored Oct 15, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7d8975de
13 Oct, 2025 1 commit
- [unrevert] Add batch invariant kernel override for FlashInfer backend [2/n] (#26373) · 32637990
  Bram Wasti authored Oct 13, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
```
  32637990
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
05 Oct, 2025 2 commits
- Fix per file ruff ignores related to simplification (#26259) · b893d661
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b893d661
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 2 commits
- Revert "Add batch invariant kernel override for FlashInfer backend [2/n]" (#26220) · 1838cd48
  Cyrus Leung authored Oct 04, 2025
  
  1838cd48
- Add batch invariant kernel override for FlashInfer backend [2/n] (#25769) · 2f7dbc9b
  Bram Wasti authored Oct 03, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  2f7dbc9b
27 Sep, 2025 1 commit
- [Bugfix] Fix triton import precommit failure (#25803) · f9df8b4a
  Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  f9df8b4a
26 Sep, 2025 1 commit
- Kernel-override Determinism [1/n] (#25603) · dc48ba0c
  Bram Wasti authored Sep 26, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  dc48ba0c