Commits · edbf2d609e6a23a105cc109844a187d72727b014 · OpenDAS / vllm_cscc · GitLab

06 May, 2025 4 commits
- [easy] Fix logspam on PiecewiseBackend errors (#17138) · edbf2d60
  Richard Zou authored May 06, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  edbf2d60
- [Model] Add GraniteMoeHybrid 4.0 model (#17497) · 999328be
  Stan Wozniak authored May 06, 2025
```
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
```
  999328be
- Update nm to rht in doc links + refine fp8 doc (#17678) · 98834fef
  Michael Goin authored May 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  98834fef
- [Bugfix] LoRA - Retire unused maxnreg LoRA kernel argument (#17677) · 90bd2ae1
  Varun Sundar Rabindranath authored May 06, 2025
  
  90bd2ae1
05 May, 2025 10 commits
- [TPU][V1] Add support for top-logprobs (#17072) · 5941e0b7
  Nicolò Lucchesi authored May 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5941e0b7
- [TPU] Enable gemma3-27b with TP>1 on multi-chips. (#17335) · 97659408
  XiongfeiWei authored May 05, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  97659408
- [BugFix] Increase timeout for startup failure test (#17642) · 5ea5c514
  Nick Hill authored May 05, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5ea5c514
- [Benchmarks] Remove invalid option under V1 engine (#17651) · d3efde81
  Russell Bryant authored May 05, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  d3efde81
- Use git-path commit in hook (#17616) · aea302be
  Thomas J. Fan authored May 05, 2025
```
Signed-off-by: Thomas J. Fan <thomasjpfan@gmail.com>
```
  aea302be
- [Doc] Fix broken cuda installation doc rendering (#17654) · cc05b90d
  Isotr0py authored May 06, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  cc05b90d
- [Kernel] some optimizations for dense marlin and moe marlin (#16850) · 1d0c9d6b
  Jinzhen Lin authored May 06, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  1d0c9d6b
- [Build/CI] Upgrade CUTLASS to 3.9.2 (#17641) · f62cad64
  Tyler Michael Smith authored May 04, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  f62cad64
- [Bugfix] fix KeyError on top logprobs are special tokens (#17637) · 5394ad73
  Chauncey authored May 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  5394ad73
- [Bugfix][Easy] Fix whitespace in shm_broadcast.py logging (#17635) · 68e1ee00
  Tyler Michael Smith authored May 04, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  68e1ee00
04 May, 2025 2 commits
- [Bugfix] Prioritize dtype in root config before checking text config (#17629) · 2858830c
  Cyrus Leung authored May 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2858830c
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
03 May, 2025 11 commits
- [Misc] V0 fallback for `--enable-prompt-embeds` (#17615) · 46fae69c
  Cyrus Leung authored May 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  46fae69c
- [Bugfix] Fix broken Qwen2.5-omni tests (#17613) · f66f1e0f
  Isotr0py authored May 04, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f66f1e0f
- [Core] Gate `prompt_embeds` behind a feature flag (#17607) · 887d7af8
  Cyrus Leung authored May 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  887d7af8
- [Bugfix][ROCm] Using device_type because on ROCm the API is still torch.cuda (#17601) · a9284245
  Gregory Shtrasberg authored May 03, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  a9284245
- [Build/CI] Upgrade CUTLASS to 3.9.1 (#17602) · c8386fa6
  Tyler Michael Smith authored May 03, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  c8386fa6
- [Frontend][TPU] Add TPU default max-num-batched-tokens based on device name (#17508) · 87baebeb
  Chenyaaang authored May 02, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  87baebeb
- [Quantizaton] [AMD] Add support for running DeepSeek int8 w8a8 MoE on ROCm (#17558) · e3d0a1d1
  rasmith authored May 02, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  e3d0a1d1
- Update test requirements to CUDA 12.8 (#17576) · d47b605e
  22quinn authored May 02, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  d47b605e
- [Neuron][Build] Require setuptools >= 77.0.3 for PEP 639 (#17603) · 22c6f639
  Liangfu Chen authored May 02, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  22c6f639
- [release] Add command to clean up Docker containers/images in TPU release machine (#17606) · 3ec97e2c
  Kevin H. Luu authored May 02, 2025
  
  3ec97e2c
- fix typo in logging (#17605) · 9b103a1d
  Eric Hartford authored May 02, 2025
  
  9b103a1d
02 May, 2025 13 commits
- [easy] Print number of needed GPUs in skip message (#17594) · b90b0852
  Richard Zou authored May 02, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  b90b0852
- [Hardware][AMD] Improve OAM device ID + llama4 Maverick MOE tuning (#16263) · 9352cdb5
  Xiaodong Wang authored May 02, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Lu Fang <lufang@fb.com>
```
  9352cdb5
- Add NVIDIA TensorRT Model Optimizer in vLLM documentation (#17561) · 182f40ea
  Zhiyu authored May 02, 2025
  
  182f40ea
- permute/unpermute kernel for moe optimization (#14568) · 3e887d2e
  Caleb_Du authored May 03, 2025
```
Signed-off-by: Caleb_Du <Caleb_Du@zju.edu.cn>
```
  3e887d2e
- [BugFix][Attention] Fix sliding window attention in V1 giving incorrect results (#17574) · 0f87d8f7
  Lucas Wilkinson authored May 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  0f87d8f7
- [Bugfix] fix tmp_out and exp_sums dimensions (#17438) · 4c33d673
  Hui Liu authored May 02, 2025
```
Signed-off-by: Hui Liu <96135754+hliuca@users.noreply.github.com>
```
  4c33d673
- [Misc] Clean up input processing (#17582) · cb234955
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cb234955
- [doc] miss result (#17589) · 3a500cd0
  Reid authored May 02, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  3a500cd0
- Support W8A8 INT8 MoE for compressed-tensors (#16745) · 868c546d
  Michael Goin authored May 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  868c546d
- [Security] Fix image hash collision (#17378) · 99404f53
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  99404f53
- Automatically tell users that dict args must be valid JSON in CLI (#17577) · 785d75a0
  Harry Mellor authored May 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  785d75a0
- [doc] add the print result (#17584) · 6d1479ca
  Reid authored May 02, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  6d1479ca
- add more pytorch related tests for torch nightly (#17422) · b8b0859b
  Yang Wang authored May 02, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  b8b0859b