Commits · 0dfb30d5752950abe72701d98d3e263a75142d43 · OpenDAS / vllm_cscc

10 Feb, 2026 1 commit

support fa kvcache fp8, add VLLM_USE_QUERY_QUANT to not use q quant(todo) · 0dfb30d5

zhuwenwen authored Feb 10, 2026

[opt] 优化epsp代码, 零消耗添加epsp
update VLLM_USE_FUSED_RMS_ROPE=0 (default). for qwen3, VLLM_USE_FUSED_RMS_ROPE=1 (default)
feat(moe/marlin): Marlin W16A16 MoE 自动探测并预打包（去掉手动开关）
perf(qwen3): 融合 q/k RMSNorm + RoPE
fused_moe_fp8接入lmslim

0dfb30d5

13 Oct, 2025 1 commit
- 新增fp8—e5m2 · ed3cdc81
  zhuwenwen authored Oct 13, 2025
  
  ed3cdc81
28 Sep, 2025 2 commits
- 修复kvcache-fp8—e5m2的不能开cp的bug · b2d14ba3
  yangql authored Sep 28, 2025
  
  b2d14ba3
- 新增fp8—e5m2_utils · bb13d854
  yangql authored Sep 28, 2025
  
  bb13d854
16 Jun, 2025 1 commit
- [MISC] Remove unused variableds in C++ (#19609) · c6703d1e
  Lu Fang authored Jun 16, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  c6703d1e
12 Jun, 2025 1 commit
- add kvcache fp8 · 504a12b8
  zhuwenwen authored Jun 12, 2025
  
  504a12b8
14 May, 2025 1 commit
- add kvint8 · 45273722
  xiabo authored May 14, 2025
  
  45273722
31 Mar, 2025 1 commit
- skip fp8 kernels and paged_attention_rocm · 52675626
  zhuwenwen authored Mar 31, 2025
  
  52675626
15 Mar, 2025 1 commit
- [Misc][Easy] Annotate unused vars in the csrc files (#14798) · 8c0d15d5
  Lu Fang authored Mar 14, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8c0d15d5
14 Mar, 2025 1 commit
- forward fix PR 14245, restore build on ROCm 6.2 (#14709) · 2a602b05
  Jeff Daily authored Mar 13, 2025
```
Signed-off-by: Jeff Daily <jeff.daily@amd.com>
```
  2a602b05
11 Mar, 2025 1 commit
- dynamic distpatch of fp8 kernels (#14245) · a1c8f379
  Jeff Daily authored Mar 11, 2025
```
Signed-off-by: Jeff Daily <jeff.daily@amd.com>
```
  a1c8f379
27 Feb, 2025 1 commit
- [ROCm][Quantization][Kernel] Use FP8 FNUZ when OCP flag is 0 or undefined (#13851) · a31614e3
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Feb 27, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  a31614e3
25 Feb, 2025 1 commit
- [ROCm][Quantization][Kernel] Using HIP FP8 header (#12593) · aabeb268
  Gregory Shtrasberg authored Feb 25, 2025
  
  aabeb268
30 Jul, 2024 1 commit
- [Kernel] Squash a few more warnings (#6914) · cbbc9044
  Tyler Michael Smith authored Jul 30, 2024
  
  cbbc9044
22 May, 2024 1 commit
- [CI/Build] Enforce style for C++ and CUDA code with `clang-format` (#4722) · 5f6d10c1
  Michael Goin authored May 22, 2024
  
  5f6d10c1
10 May, 2024 1 commit
- [Kernel] Refactor FP8 kv-cache with NVIDIA float8_e4m3 support (#4535) · c8331017
  Cody Yu authored May 09, 2024
  
  c8331017
03 Apr, 2024 1 commit

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290) · 2ff767b5

Adrian Abeyta authored Apr 03, 2024


Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: AdrianAbeyta <Adrian.Abeyta@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: root <root@gt-pla-u18-08.pla.dcgpu>
Co-authored-by: mawong-amd <156021403+mawong-amd@users.noreply.github.com>
Co-authored-by: ttbachyinsda <ttbachyinsda@outlook.com>
Co-authored-by: guofangze <guofangze@kuaishou.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: jacobthebanana <50071502+jacobthebanana@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2ff767b5