Commits · ecb4f822091a64b5084b3a4aff326906487a363f · OpenDAS / vllm_cscc

22 Jan, 2026 1 commit

Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3

Eldar Kurtić authored Jan 22, 2026


Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>

44f08af3

14 Jan, 2026 2 commits
- [Docs] Add docs about OOT Quantization Plugins (#32035) · 6388b500
  Michael Goin authored Jan 14, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6388b500
- Consolidate Intel Quantization Toolkit Integration in vLLM (#31716) · 50632adc
  Yi Liu authored Jan 14, 2026
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
```
  50632adc
13 Jan, 2026 1 commit
- Fix various typos found in `docs` (#32212) · f243abc9
  Andrew Bennett authored Jan 12, 2026
```
Signed-off-by: Andrew Bennett <potatosaladx@meta.com>
```
  f243abc9
24 Dec, 2025 1 commit
- [Chore] Bump `lm-eval` version (#31264) · d2018073
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2018073
22 Dec, 2025 2 commits
- [Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN... · 19cc9468
  CedricHuang authored Dec 22, 2025
```
[Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN and FP8_PB_WO  in vLLM (#30957)
```
  19cc9468
- [Doc] Clarify FP8 KV cache computation workflow (#31071) · 9d701e90
  Steve Westerhouse authored Dec 21, 2025
```
Signed-off-by: westers <steve.westerhouse@origami-analytics.com>
```
  9d701e90
08 Dec, 2025 1 commit
- [Misc] Rename TensorRT Model Optimizer to Model Optimizer (#30091) · cd00c443
  Zhiyu authored Dec 07, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  cd00c443
24 Nov, 2025 1 commit
- Remove VLLM_SKIP_WARMUP tip (#29331) · 4dd42db5
  Tyler Michael Smith authored Nov 24, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  4dd42db5
21 Nov, 2025 1 commit

[Doc] cleanup TPU documentation and remove outdated examples (#29048) · dd39f91e

Rob Mulla authored Nov 20, 2025

Signed-off-by: Rob Mulla <rob.mulla@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dd39f91e

19 Nov, 2025 2 commits
- [Doc]: fix typos in various files (#28945) · 7ed27f3c
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7ed27f3c
- [Docs] Update oneshot imports (#28188) · 6a25ea5f
  Uranus authored Nov 19, 2025
```
Signed-off-by: UranusSeven <109661872+UranusSeven@users.noreply.github.com>
```
  6a25ea5f
15 Nov, 2025 1 commit
- [Doc]: fix typos in various files (#28567) · 2bb4435c
  Didier Durand authored Nov 15, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  2bb4435c
11 Nov, 2025 1 commit

[ROCm][Quantization] extend AMD Quark to support mixed-precision quantized model (#24239) · 05576df8

xuebwang-amd authored Nov 12, 2025


Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

05576df8

17 Oct, 2025 1 commit
- [Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4ffd6e89
15 Oct, 2025 2 commits
- [Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  8f4b313c
- [Doc] ruff format remaining Python examples (#26795) · 62566979
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  62566979
14 Oct, 2025 1 commit

Notice for deprecation of AutoAWQ (#26820) · b92ab3de

HDCharles authored Oct 14, 2025


Signed-off-by: HDCharles <39544797+HDCharles@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b92ab3de

07 Oct, 2025 1 commit
- [Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
  fxmarty-amd authored Oct 07, 2025
  
  41f1cf38
01 Oct, 2025 1 commit
- Fix INT8 quantization error on Blackwell GPUs (SM100+) (#25935) · 99028fda
  Param authored Sep 30, 2025
```
Signed-off-by: padg9912 <phone.and.desktop@gmail.com>
```
  99028fda
13 Sep, 2025 1 commit
- [Docs] Remove Neuron install doc as backend no longer exists (#24396) · abc7989a
  Harry Mellor authored Sep 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  abc7989a
26 Aug, 2025 1 commit
- [Docs] Move quant supported hardware table to README (#23663) · 6421b66b
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6421b66b
25 Aug, 2025 1 commit

[Doc: ]fix various typos in multiple files (#23487) · 47455c42

Didier Durand authored Aug 25, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47455c42

22 Aug, 2025 1 commit
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
16 Aug, 2025 1 commit

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

08 Aug, 2025 1 commit
- [Docs] Improve API docs (+small tweaks) (#22459) · 7be7f382
  Harry Mellor authored Aug 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7be7f382
30 Jul, 2025 1 commit
- [Docs] Switch to better markdown linting pre-commit hook (#21851) · ba5c5e54
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba5c5e54
29 Jul, 2025 1 commit
- [Docs] Minimize spacing for supported_hardware.md table (#21779) · 947e982e
  Michael Goin authored Jul 28, 2025
  
  947e982e
25 Jul, 2025 1 commit

[Docs] add auto-round quantization readme (#21600) · 5ac3168e

Wenhua Cheng authored Jul 25, 2025

Signed-off-by: Wenhua Cheng <wenhua.cheng@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

5ac3168e

21 Jul, 2025 2 commits
- [Misc] unify variable for LLM instance (#20996) · d9784107
  Ning Xie authored Jul 21, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d9784107
- [Docs] Fix hardcoded links in docs (#21287) · be54a951
  Harry Mellor authored Jul 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  be54a951
16 Jul, 2025 1 commit

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC... · 01513a33

Nir David authored Jul 16, 2025


Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>

01513a33

09 Jul, 2025 1 commit

[Feature][Quantization] MXFP4 support for MOE models (#17888) · 332d4cb1

fxmarty-amd authored Jul 09, 2025


Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>

332d4cb1

08 Jul, 2025 3 commits
- Stop using title frontmatter and fix doc that can only be reached by search (#20623) · b942c094
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b942c094
- Remove unnecessary explicit title anchors and use relative links instead (#20620) · b4bab816
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b4bab816
- Make distinct `code` and `console` admonitions so readers are less likely to miss them (#20585) · af107d5a
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  af107d5a
03 Jul, 2025 1 commit
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
23 Jun, 2025 2 commits
- [Docs] Fix syntax highlighting of shell commands (#19870) · c3649e4f
  Lukas Geiger authored Jun 23, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  c3649e4f
- [doc] Fold long code blocks to improve readability (#19926) · f17aec0d
  Reid authored Jun 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  f17aec0d
11 Jun, 2025 1 commit
- [Doc] Fix quantization link titles (#19478) · a5115f4f
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a5115f4f