Commits · 1bd3ae330425c16478524015a8e95e4c48fb8c15 · OpenDAS / vllm_cscc

26 Sep, 2025 1 commit

Llamas 3.1 405B fp4 changes upstreaming from 355_wip (#25135) · 53a30845

Aleksandr Malyshev authored Sep 25, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>

53a30845

24 Sep, 2025 1 commit
- [Core] Support weight_loader_v2 for `UnquantizedLinearMethod` (#23036) · de94289a
  Kyle Sayers authored Sep 24, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  de94289a
23 Sep, 2025 1 commit
- deepseek-r1-w4a8 mlp/moe调用silu-mul-quant融合 · 3155bf9e
  zhuwenwen authored Sep 23, 2025
  
  3155bf9e
18 Sep, 2025 1 commit
- Refactor dense FP8 tensor/channel/block utils and add CT FP8 block (#21404) · fbd6523a
  Michael Goin authored Sep 18, 2025
  
  fbd6523a
15 Sep, 2025 2 commits
- [USAGE] Improve error handling for weight initialization in Unquantized… (#20321) · b834b4cb
  Rafael Marcelino Koike authored Sep 15, 2025
```
Signed-off-by: Rafael Marcelino Koike <rafael.koike@oracle.com>
Signed-off-by: Rafael Koike <koike.rafael@gmail.com>
```
  b834b4cb
- deepseek-r1-w4a8使用rmsquant融合算子及横向融合 · 9f201bc1
  zhuwenwen authored Sep 15, 2025
  
  9f201bc1
13 Sep, 2025 1 commit
- [Doc]: fix typos in various files (#24798) · 41ae4a1e
  Didier Durand authored Sep 13, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  41ae4a1e
06 Sep, 2025 2 commits

[Bugfix] Fix broken deepseek fp8 TP weights loading (#24367) · 00a4e56d
Isotr0py authored Sep 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
00a4e56d

[Core] Allow disabling TP sharding for parallel Linear layer (#23024) · 53b19ccd

Isotr0py authored Sep 06, 2025

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

53b19ccd

04 Sep, 2025 1 commit
- [CPU] Refactor CPU unquantized linear (#24150) · 57b1ce94
  Li, Jiang authored Sep 04, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  57b1ce94
02 Sep, 2025 1 commit
- [Bugfix] Fix packed_factor missing attribute error (#23902) · 9480ae24
  Kyuyeun Kim authored Sep 02, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9480ae24
28 Aug, 2025 1 commit
- [Transform] [Quantization] Add transforms to compressed tensors (#22486) · 22feac8e
  Kyle Sayers authored Aug 28, 2025
  
  22feac8e
26 Aug, 2025 1 commit

[Docs] Fix warnings in `mkdocs build` (#23649) · 730d0ac8

Hyogeun Oh (오효근) authored Aug 27, 2025

Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

730d0ac8

25 Aug, 2025 1 commit
- [Misc] Unified linear print info (#23516) · 170e8ea9
  Jee Jee Li authored Aug 25, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  170e8ea9
23 Aug, 2025 1 commit

Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527) · fa78de9d

Daifeng Li authored Aug 23, 2025


Signed-off-by: feng <fengli1702@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

fa78de9d

21 Aug, 2025 1 commit
- [CPU] Refactor CPU W8A8 scaled_mm (#23071) · 7be5d113
  Li, Jiang authored Aug 21, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7be5d113
20 Aug, 2025 1 commit
- [Kernel/Quant] Remove the original marlin format and qqq (#23204) · 0cdbf5e6
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0cdbf5e6
19 Aug, 2025 1 commit

[FEAT] [Performance] Enable DP for ViT in Qwen2.5VL (#22742) · 1298c677

TJian authored Aug 19, 2025


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1298c677

16 Aug, 2025 1 commit

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

13 Aug, 2025 1 commit
- [Platform] Custom ops support for FusedMoe (#22509) · 0b1bdac6
  wangxiyuan authored Aug 13, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  0b1bdac6
01 Aug, 2025 1 commit
- update linear.py · 7bb28d54
  zhuwenwen authored Aug 01, 2025
  
  7bb28d54
22 Jul, 2025 1 commit
- [perf] Add fused MLA QKV + strided layernorm (#21116) · 4fb56914
  Mickaël Seznec authored Jul 22, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4fb56914
17 Jul, 2025 1 commit
- [Bugfix] weight loading use correct tp_group with patch_tensor_parallel_group (#21024) · c9ba8104
  Kevin_Xiong authored Jul 17, 2025
```
Signed-off-by: KevinXiong-C <kevin_xiong1997@outlook.com>
```
  c9ba8104
01 Jul, 2025 1 commit
- [CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
  Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  6cc1e7d9
06 Jun, 2025 1 commit
- [Model] Add VLLM_USE_NN to use nn layout · 6880bf15
  zhuwenwen authored Jun 06, 2025
  
  6880bf15
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
27 May, 2025 1 commit
- [V1][Quantization] Add CUDA graph compatible v1 GGUF support (#18646) · 1f1b1bc0
  Isotr0py authored May 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1f1b1bc0
23 May, 2025 1 commit
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
21 May, 2025 1 commit
- [Doc] fix arg docstring in linear layers (#18410) · c154d893
  GiantCroc authored May 21, 2025
```
Signed-off-by: giantcroc <1204449533@qq.com>
```
  c154d893
16 May, 2025 1 commit
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929
14 May, 2025 1 commit
- [Bugfix] Fix QKVCrossParallelLinear::sync_weight_attrs for PyTorch compile (#17844) · 38fe728d
  Andrzej Kotłowski authored May 14, 2025
```
Signed-off-by: Andrzej Kotłowski <akotlowski@habana.ai>
```
  38fe728d
28 Apr, 2025 1 commit
- [Model] Qwen3 Dense FP8 Compat Fixes (#17318) · dcbac4cb
  Simon Mo authored Apr 28, 2025
```
Signed-off-by: simon-mo <xmo@berkeley.edu>
```
  dcbac4cb
22 Apr, 2025 2 commits
- [Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS (#6036) · 8d32dc60
  Lei Wang authored Apr 22, 2025
```
Signed-off-by: xinyuxiao <xinyuxiao2024@gmail.com>
Co-authored-by: xinyuxiao <xinyuxiao2024@gmail.com>
```
  8d32dc60
- [Performance][ROCm] Add skinny gemms for unquantized linear on ROCm (#15830) · 188b7f9b
  Charlie Fu authored Apr 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
```
  188b7f9b
08 Apr, 2025 1 commit
- [Bugfix] Handle `process_weights_after_loading` for `QKVCrossParallelLinear` (#15328) · 40b4284f
  Isotr0py authored Apr 09, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  40b4284f
14 Mar, 2025 1 commit
- 增加deepseek v3 block-int8量化支持 · ba1ff372
  zhuwenwen authored Mar 14, 2025
```
增加线性int8 gemm配置
```
  ba1ff372
12 Mar, 2025 2 commits
- [Kernel] Add ModelOpt FP4 Checkpoint Support (#12520) · debd6bbf
  Pavani Majety authored Mar 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  debd6bbf
- [Core] Refactor `QKVCrossParallelLinear` implementation to support BNB 4-bit quantization (#14545) · e392d858
  Isotr0py authored Mar 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  e392d858
06 Mar, 2025 1 commit

[Core] Optimizing cross-attention `QKVParallelLinear` computation (#12325) · 69ff99fd

Nicolò Lucchesi authored Mar 06, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: NickLucche <nick@nlucches-4xa100.c.openshift-330514.internal>
Co-authored-by: NickLucche <nick@nlucches-4xa100.c.openshift-330514.internal>

69ff99fd

05 Mar, 2025 1 commit
- [LoRA] Remove linear hack outside transformers backend (#14177) · e17e4488
  Isotr0py authored Mar 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  e17e4488