Commits · d1ddf340c88110ab9b961d5464ed7599bd4dc9a8 · OpenDAS / vllm_cscc

09 Oct, 2025 1 commit
- [V0 deprecation] Remove `QKVCrossParallelLinear` implementation (#26475) · d1ddf340
  Isotr0py authored Oct 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d1ddf340
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
26 Sep, 2025 1 commit

Llamas 3.1 405B fp4 changes upstreaming from 355_wip (#25135) · 53a30845

Aleksandr Malyshev authored Sep 25, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>

53a30845

24 Sep, 2025 1 commit
- [Core] Support weight_loader_v2 for `UnquantizedLinearMethod` (#23036) · de94289a
  Kyle Sayers authored Sep 24, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  de94289a
18 Sep, 2025 1 commit
- Refactor dense FP8 tensor/channel/block utils and add CT FP8 block (#21404) · fbd6523a
  Michael Goin authored Sep 18, 2025
  
  fbd6523a
15 Sep, 2025 1 commit
- [USAGE] Improve error handling for weight initialization in Unquantized… (#20321) · b834b4cb
  Rafael Marcelino Koike authored Sep 15, 2025
```
Signed-off-by: Rafael Marcelino Koike <rafael.koike@oracle.com>
Signed-off-by: Rafael Koike <koike.rafael@gmail.com>
```
  b834b4cb
13 Sep, 2025 1 commit
- [Doc]: fix typos in various files (#24798) · 41ae4a1e
  Didier Durand authored Sep 13, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  41ae4a1e
06 Sep, 2025 2 commits

[Bugfix] Fix broken deepseek fp8 TP weights loading (#24367) · 00a4e56d
Isotr0py authored Sep 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
00a4e56d

[Core] Allow disabling TP sharding for parallel Linear layer (#23024) · 53b19ccd

Isotr0py authored Sep 06, 2025

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

53b19ccd

04 Sep, 2025 1 commit
- [CPU] Refactor CPU unquantized linear (#24150) · 57b1ce94
  Li, Jiang authored Sep 04, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  57b1ce94
02 Sep, 2025 1 commit
- [Bugfix] Fix packed_factor missing attribute error (#23902) · 9480ae24
  Kyuyeun Kim authored Sep 02, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9480ae24
28 Aug, 2025 1 commit
- [Transform] [Quantization] Add transforms to compressed tensors (#22486) · 22feac8e
  Kyle Sayers authored Aug 28, 2025
  
  22feac8e
26 Aug, 2025 1 commit

[Docs] Fix warnings in `mkdocs build` (#23649) · 730d0ac8

Hyogeun Oh (오효근) authored Aug 27, 2025

Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

730d0ac8

25 Aug, 2025 1 commit
- [Misc] Unified linear print info (#23516) · 170e8ea9
  Jee Jee Li authored Aug 25, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  170e8ea9
23 Aug, 2025 1 commit

Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527) · fa78de9d

Daifeng Li authored Aug 23, 2025


Signed-off-by: feng <fengli1702@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

fa78de9d

21 Aug, 2025 1 commit
- [CPU] Refactor CPU W8A8 scaled_mm (#23071) · 7be5d113
  Li, Jiang authored Aug 21, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7be5d113
20 Aug, 2025 1 commit
- [Kernel/Quant] Remove the original marlin format and qqq (#23204) · 0cdbf5e6
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0cdbf5e6
19 Aug, 2025 1 commit

[FEAT] [Performance] Enable DP for ViT in Qwen2.5VL (#22742) · 1298c677

TJian authored Aug 19, 2025


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1298c677

16 Aug, 2025 1 commit

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

13 Aug, 2025 1 commit
- [Platform] Custom ops support for FusedMoe (#22509) · 0b1bdac6
  wangxiyuan authored Aug 13, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  0b1bdac6
22 Jul, 2025 1 commit
- [perf] Add fused MLA QKV + strided layernorm (#21116) · 4fb56914
  Mickaël Seznec authored Jul 22, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4fb56914
17 Jul, 2025 1 commit
- [Bugfix] weight loading use correct tp_group with patch_tensor_parallel_group (#21024) · c9ba8104
  Kevin_Xiong authored Jul 17, 2025
```
Signed-off-by: KevinXiong-C <kevin_xiong1997@outlook.com>
```
  c9ba8104
01 Jul, 2025 1 commit
- [CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
  Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  6cc1e7d9
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
27 May, 2025 1 commit
- [V1][Quantization] Add CUDA graph compatible v1 GGUF support (#18646) · 1f1b1bc0
  Isotr0py authored May 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1f1b1bc0
21 May, 2025 1 commit
- [Doc] fix arg docstring in linear layers (#18410) · c154d893
  GiantCroc authored May 21, 2025
```
Signed-off-by: giantcroc <1204449533@qq.com>
```
  c154d893
14 May, 2025 1 commit
- [Bugfix] Fix QKVCrossParallelLinear::sync_weight_attrs for PyTorch compile (#17844) · 38fe728d
  Andrzej Kotłowski authored May 14, 2025
```
Signed-off-by: Andrzej Kotłowski <akotlowski@habana.ai>
```
  38fe728d
28 Apr, 2025 1 commit
- [Model] Qwen3 Dense FP8 Compat Fixes (#17318) · dcbac4cb
  Simon Mo authored Apr 28, 2025
```
Signed-off-by: simon-mo <xmo@berkeley.edu>
```
  dcbac4cb
22 Apr, 2025 2 commits
- [Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS (#6036) · 8d32dc60
  Lei Wang authored Apr 22, 2025
```
Signed-off-by: xinyuxiao <xinyuxiao2024@gmail.com>
Co-authored-by: xinyuxiao <xinyuxiao2024@gmail.com>
```
  8d32dc60
- [Performance][ROCm] Add skinny gemms for unquantized linear on ROCm (#15830) · 188b7f9b
  Charlie Fu authored Apr 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
```
  188b7f9b
08 Apr, 2025 1 commit
- [Bugfix] Handle `process_weights_after_loading` for `QKVCrossParallelLinear` (#15328) · 40b4284f
  Isotr0py authored Apr 09, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  40b4284f
12 Mar, 2025 2 commits
- [Kernel] Add ModelOpt FP4 Checkpoint Support (#12520) · debd6bbf
  Pavani Majety authored Mar 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  debd6bbf
- [Core] Refactor `QKVCrossParallelLinear` implementation to support BNB 4-bit quantization (#14545) · e392d858
  Isotr0py authored Mar 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  e392d858
06 Mar, 2025 1 commit

[Core] Optimizing cross-attention `QKVParallelLinear` computation (#12325) · 69ff99fd

Nicolò Lucchesi authored Mar 06, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: NickLucche <nick@nlucches-4xa100.c.openshift-330514.internal>
Co-authored-by: NickLucche <nick@nlucches-4xa100.c.openshift-330514.internal>

69ff99fd

05 Mar, 2025 1 commit
- [LoRA] Remove linear hack outside transformers backend (#14177) · e17e4488
  Isotr0py authored Mar 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  e17e4488
27 Feb, 2025 1 commit
- [Model] Deepseek GGUF support (#13167) · 7f0be2aa
  Szymon Ożóg authored Feb 27, 2025
  
  7f0be2aa
12 Feb, 2025 1 commit
- [Bugfix] Allow fallback to AWQ from AWQMarlin at per-layer granularity (#13119) · 09972e71
  Michael Goin authored Feb 12, 2025
  
  09972e71
11 Feb, 2025 1 commit
- Fix initializing GGUF weights for ColumnParallelLinear when using tensor parallel > 1 (#13023) · 2b25b7d2
  Szymon Ożóg authored Feb 11, 2025
  
  2b25b7d2
05 Feb, 2025 1 commit
- Refactor `Linear` handling in `TransformersModel` (#12727) · 249824c3
  Harry Mellor authored Feb 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  249824c3