Commits · 06be85882814f5772f54f5e15c975c43f43361a9 · OpenDAS / vllm_cscc · GitLab

14 Jun, 2025 4 commits
- [Bugfix] Fix the speculative decoding test by setting the target dtype (#19633) · 06be8588
  Lu Fang authored Jun 14, 2025
  
  06be8588
- [V1][Metrics] Deprecate metrics with gpu_ prefix for non GPU specific metrics. (#18354) · d1e34cc9
  Saheli Bhattacharjee authored Jun 14, 2025
```
Signed-off-by: Saheli Bhattacharjee <saheli@krai.ai>
```
  d1e34cc9
- [BugFix] Fix DP Coordinator incorrect debug log message (#19624) · bd517eb9
  Nick Hill authored Jun 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  bd517eb9
- Adding "AMD: Multi-step Tests" to amdproduction. (#19508) · d65668b4
  Concurrensee authored Jun 13, 2025
```
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d65668b4
13 Jun, 2025 18 commits
- [torch.compile] Use custom ops when use_inductor=False (#19618) · aafbbd98
  Woosuk Kwon authored Jun 13, 2025
  
  aafbbd98
- [Doc] Add troubleshooting section to k8s deployment (#19377) · 0f087451
  Anna Pendleton authored Jun 13, 2025
```
Signed-off-by: Anna Pendleton <pendleton@google.com>
```
  0f087451
- [CUDA] Enable full cudagraph for FlashMLA (#18581) · 3597b06a
  Luka Govedič authored Jun 13, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  3597b06a
- [doc][mkdocs] fix the duplicate Supported features sections in GPU docs (#19606) · 1015296b
  Reid authored Jun 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1015296b
- [Refactor] Remove unused variables in `moe_permute_unpermute_kernel.inl` (#19573) · ce9dc02c
  Wentao Ye authored Jun 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ce9dc02c
- [Model] Fix minimax model cache & lm_head precision (#19592) · a24cb916
  qscqesze authored Jun 13, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  a24cb916
- [BugFix] Honor `enable_caching` in connector-delayed kvcache load case (#19435) · 7e8d97dd
  Nick Hill authored Jun 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7e8d97dd
- [torch.compile] reorganize the cache directory to support compiling multiple models (#19064) · d70bc7c0
  youkaichao authored Jun 13, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d70bc7c0
- use base version for version comparison (#19587) · ce688ad4
  Boyuan Feng authored Jun 13, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  ce688ad4
- [Fix] The zip function in Python 3.9 does not have the strict argument (#19549) · cefdb996
  汪志鹏 authored Jun 13, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  cefdb996
- [Fix] bump mistral common to support magistral (#19533) · ace5cdaf
  汪志鹏 authored Jun 13, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  ace5cdaf
- [CPU] Refine default config for the CPU backend (#19539) · 64587211
  Li, Jiang authored Jun 13, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  64587211
- [Misc] Correct broken docs link (#19553) · bb4a0dec
  Hyogeun Oh (오효근) authored Jun 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  bb4a0dec
- [doc] fix incorrect link (#19586) · c707cfc1
  Reid authored Jun 13, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  c707cfc1
- [Doc] uses absolute links for structured outputs (#19582) · 7b3c9ff9
  Aaron Pham authored Jun 12, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  7b3c9ff9
- [Bugfix] Fix EAGLE vocab embedding for multimodal target model (#19570) · c68698b3
  qizixi authored Jun 12, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  c68698b3
- [BugFix] : Fix Batched DeepGemm Experts (#19515) · e3b12667
  Varun Sundar Rabindranath authored Jun 12, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e3b12667
- Revert "[Build/CI] Add tracing deps to vllm container image (#15224)" (#19378) · e6aab5de
  kourosh hakhamaneshi authored Jun 12, 2025
  
  e6aab5de
12 Jun, 2025 18 commits
- [V1] Resolve failed concurrent structured output requests (#19565) · c57bb199
  Russell Bryant authored Jun 12, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c57bb199
- [Doc] Unify structured outputs examples (#18196) · dba68f91
  Aaron Pham authored Jun 12, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  dba68f91
- [Bugfix] Enforce contiguous input for dynamic_per_token FP8/INT8 quant (#19452) · a3319f4f
  Michael Goin authored Jun 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a3319f4f
- [Misc] Turn MOE_DP_CHUNK_SIZE into an env var (#19506) · 9d880f59
  Varun Sundar Rabindranath authored Jun 12, 2025
  
  9d880f59
- [Spec Decode][Benchmark] Generalize spec decode offline benchmark to more... · 017ef648
  Ekagra Ranjan authored Jun 12, 2025
```
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)
```
  017ef648
- [doc] Make top navigation sticky (#19540) · 4b25ab14
  Reid authored Jun 12, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  4b25ab14
- [torch.compile][ROCm] Fuse quantization onto attention using a torch.compile pass (#16756) · f98548b9
  Luka Govedič authored Jun 12, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
```
  f98548b9
- Fix TorchAOConfig skip layers (#19265) · 96846bb3
  mobicham authored Jun 12, 2025
```
Signed-off-by: mobicham <hicham@mobiuslabs.com>
```
  96846bb3
- [Perf] Vectorize static / dynamic INT8 quant kernels (#19233) · b6efafd9
  Wentao Ye authored Jun 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b6efafd9
- [V1][NixlConnector] Drop `num_blocks` check (#19532) · 1129e2b1
  Nicolò Lucchesi authored Jun 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  1129e2b1
- [Doc] Add V1 column to supported models list (#19523) · c742438f
  Cyrus Leung authored Jun 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c742438f
- [Quantization] Improve AWQ logic (#19431) · 73e2e011
  Jee Jee Li authored Jun 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  73e2e011
- [Bugfix] Respect num-gpu-blocks-override in v1 (#19503) · c9280e63
  jmswen authored Jun 12, 2025
```
Signed-off-by: Jon Swenson <jmswen@gmail.com>
```
  c9280e63
- [Bugfix][V1] Allow manual FlashAttention for Blackwell (#19492) · af09b3f0
  Michael Goin authored Jun 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  af09b3f0
- [Security] Prevent new imports of (cloud)pickle (#18018) · 4f6c42fa
  Russell Bryant authored Jun 12, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Aaron Pham <Aaronpham0103@gmail.com>
```
  4f6c42fa
- Fix typo (#19525) · dff68000
  niu_he authored Jun 12, 2025
```
Signed-off-by: 2niuhe <carlton2tang@gmail.com>
```
  dff68000
- [AMD][Kernel][BugFix] fix test_rocm_compressed_tensors_w8a8 for rocm (#19509) · 2e090bd5
  rasmith authored Jun 12, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  2e090bd5
- [BugFix] Handle missing sep_token for Qwen3-Reranker in Score API (#19522) · 1b0b065e
  wonjun Jang authored Jun 12, 2025
```
Signed-off-by: strutive07 <strutive07@gmail.com>
```
  1b0b065e