Commits · 19cc9468fd0fa1701e7cb74b5928b329a1d16cf1 · OpenDAS / vllm_cscc

22 Dec, 2025 2 commits
- [Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN... · 19cc9468
  CedricHuang authored Dec 22, 2025
```
[Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN and FP8_PB_WO  in vLLM (#30957)
```
  19cc9468
- [Doc] Clarify FP8 KV cache computation workflow (#31071) · 9d701e90
  Steve Westerhouse authored Dec 21, 2025
```
Signed-off-by: westers <steve.westerhouse@origami-analytics.com>
```
  9d701e90
08 Dec, 2025 1 commit
- [Misc] Rename TensorRT Model Optimizer to Model Optimizer (#30091) · cd00c443
  Zhiyu authored Dec 07, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  cd00c443
24 Nov, 2025 1 commit
- Remove VLLM_SKIP_WARMUP tip (#29331) · 4dd42db5
  Tyler Michael Smith authored Nov 24, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  4dd42db5
21 Nov, 2025 1 commit

[Doc] cleanup TPU documentation and remove outdated examples (#29048) · dd39f91e

Rob Mulla authored Nov 20, 2025

Signed-off-by: Rob Mulla <rob.mulla@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dd39f91e

19 Nov, 2025 2 commits
- [Doc]: fix typos in various files (#28945) · 7ed27f3c
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7ed27f3c
- [Docs] Update oneshot imports (#28188) · 6a25ea5f
  Uranus authored Nov 19, 2025
```
Signed-off-by: UranusSeven <109661872+UranusSeven@users.noreply.github.com>
```
  6a25ea5f
15 Nov, 2025 1 commit
- [Doc]: fix typos in various files (#28567) · 2bb4435c
  Didier Durand authored Nov 15, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  2bb4435c
11 Nov, 2025 1 commit

[ROCm][Quantization] extend AMD Quark to support mixed-precision quantized model (#24239) · 05576df8

xuebwang-amd authored Nov 12, 2025


Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

05576df8

17 Oct, 2025 1 commit
- [Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4ffd6e89
15 Oct, 2025 2 commits
- [Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  8f4b313c
- [Doc] ruff format remaining Python examples (#26795) · 62566979
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  62566979
14 Oct, 2025 1 commit

Notice for deprecation of AutoAWQ (#26820) · b92ab3de

HDCharles authored Oct 14, 2025


Signed-off-by: HDCharles <39544797+HDCharles@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b92ab3de

07 Oct, 2025 1 commit
- [Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
  fxmarty-amd authored Oct 07, 2025
  
  41f1cf38
01 Oct, 2025 1 commit
- Fix INT8 quantization error on Blackwell GPUs (SM100+) (#25935) · 99028fda
  Param authored Sep 30, 2025
```
Signed-off-by: padg9912 <phone.and.desktop@gmail.com>
```
  99028fda
13 Sep, 2025 1 commit
- [Docs] Remove Neuron install doc as backend no longer exists (#24396) · abc7989a
  Harry Mellor authored Sep 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  abc7989a
26 Aug, 2025 1 commit
- [Docs] Move quant supported hardware table to README (#23663) · 6421b66b
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6421b66b
25 Aug, 2025 1 commit

[Doc: ]fix various typos in multiple files (#23487) · 47455c42

Didier Durand authored Aug 25, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47455c42

22 Aug, 2025 1 commit
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
16 Aug, 2025 1 commit

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

08 Aug, 2025 1 commit
- [Docs] Improve API docs (+small tweaks) (#22459) · 7be7f382
  Harry Mellor authored Aug 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7be7f382
30 Jul, 2025 1 commit
- [Docs] Switch to better markdown linting pre-commit hook (#21851) · ba5c5e54
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba5c5e54
29 Jul, 2025 1 commit
- [Docs] Minimize spacing for supported_hardware.md table (#21779) · 947e982e
  Michael Goin authored Jul 28, 2025
  
  947e982e
25 Jul, 2025 1 commit

[Docs] add auto-round quantization readme (#21600) · 5ac3168e

Wenhua Cheng authored Jul 25, 2025

Signed-off-by: Wenhua Cheng <wenhua.cheng@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

5ac3168e

21 Jul, 2025 2 commits
- [Misc] unify variable for LLM instance (#20996) · d9784107
  Ning Xie authored Jul 21, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d9784107
- [Docs] Fix hardcoded links in docs (#21287) · be54a951
  Harry Mellor authored Jul 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  be54a951
16 Jul, 2025 1 commit

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC... · 01513a33

Nir David authored Jul 16, 2025


Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>

01513a33

09 Jul, 2025 1 commit

[Feature][Quantization] MXFP4 support for MOE models (#17888) · 332d4cb1

fxmarty-amd authored Jul 09, 2025


Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>

332d4cb1

08 Jul, 2025 3 commits
- Stop using title frontmatter and fix doc that can only be reached by search (#20623) · b942c094
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b942c094
- Remove unnecessary explicit title anchors and use relative links instead (#20620) · b4bab816
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b4bab816
- Make distinct `code` and `console` admonitions so readers are less likely to miss them (#20585) · af107d5a
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  af107d5a
03 Jul, 2025 1 commit
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
23 Jun, 2025 2 commits
- [Docs] Fix syntax highlighting of shell commands (#19870) · c3649e4f
  Lukas Geiger authored Jun 23, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  c3649e4f
- [doc] Fold long code blocks to improve readability (#19926) · f17aec0d
  Reid authored Jun 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  f17aec0d
11 Jun, 2025 1 commit
- [Doc] Fix quantization link titles (#19478) · a5115f4f
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a5115f4f
29 May, 2025 1 commit
- [Doc][Neuron] Update documentation for Neuron (#18868) · 1661a9c2
  aws-elaineyz authored May 28, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
```
  1661a9c2
25 May, 2025 2 commits

[Misc] small improve (#18680) · 3a886bd5

Reid authored May 25, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

3a886bd5

[doc] improve readability (#18675) · 279f8545

Reid authored May 25, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

279f8545

23 May, 2025 1 commit
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9