Commits · b8ff05361a2ab91e6be33601d4f564408e10eb24 · OpenDAS / vllm_cscc

13 Aug, 2025 1 commit
- Force TRTLLM attention for gpt-oss on SM100 (#22678) · c6b92879
  Michael Goin authored Aug 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c6b92879
08 Aug, 2025 1 commit

Support Tensorrt-LLM MoE fp4 for low-latency (#21331) · a3b9c17b

Shu Wang authored Aug 07, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: XIn Li <xinli@nvidia.com>
Co-authored-by: XIn Li <xinli@nvidia.com>

a3b9c17b

07 Aug, 2025 1 commit

Fix trtllm-gen attention env and add attention sink (#22378) · 9a3835aa

Lain authored Aug 06, 2025


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: Lain <fusiyuan2000@hotmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

9a3835aa

05 Aug, 2025 1 commit
- [NVIDIA] Support Flashinfer TRT-LLM Prefill Attention Kernel (#22095) · 83156c7b
  elvischenv authored Aug 05, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  83156c7b
01 Aug, 2025 1 commit
- [Bugfix] Check NVIDIA artifactory is accessible before using flashinfer cubin kernels (#21893) · f81c1bb0
  Michael Goin authored Aug 01, 2025
  
  f81c1bb0
31 Jul, 2025 1 commit

[NVIDIA] Add SM100 Flashinfer MoE per tensor scale fp8 backend (#21458) · 207b750e

amirkl94 authored Jul 31, 2025


Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

207b750e

26 Jul, 2025 1 commit
- [Bug] Fix `has_flashinfer_moe` Import Error when it is not installed (#21634) · c215f5c8
  Wentao Ye authored Jul 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c215f5c8
24 Jul, 2025 1 commit
- Update flashinfer CUTLASS MoE Kernel (#21408) · 1b25f1fe
  Shu Wang authored Jul 24, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  1b25f1fe
22 Jul, 2025 1 commit
- Update fp4 quantize API (#21327) · 9e23ad96
  Shu Wang authored Jul 22, 2025
```
Signed-off-by: Shu Wang <shuw@nvidia.com>
```
  9e23ad96
19 Jul, 2025 1 commit

[NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency (#20645) · 6d0734c5

Kaixi Hou authored Jul 19, 2025


Signed-off-by: kaixih <kaixih@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

6d0734c5

18 Jul, 2025 1 commit

[Core] FlashInfer CUTLASS fused MoE backend (NVFP4) (#20037) · c7d8724e

Shu Wang authored Jul 17, 2025


Signed-off-by: shuw <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

c7d8724e