Commits · 26bc46ef8954bac7f2387a83e6781655ea81782c · OpenDAS / vllm_cscc

16 Jun, 2025 7 commits

[MISC] typo fix (#19672) · 26bc46ef
Ning Xie authored Jun 16, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
26bc46ef
[TPU] support attention head dim smaller than 128 (#19620) · a77aea59
Chengji Yao authored Jun 15, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
a77aea59

[Misc] Fix skipped max-model-len validation when deriving max model length... · b692e9cd

Ye (Charlotte) Qi authored Jun 15, 2025


[Misc] Fix skipped max-model-len validation when deriving max model length from tokenizer config (#19660)
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>

b692e9cd

[Misc][Frontend] passthrough `bad_words` (#19564) · 367871a4

Francesco Bertolotti authored Jun 16, 2025

Signed-off-by: Francesco Bertolotti <francesco.bertolotti@igenius.ai>
Co-authored-by: Francesco Bertolotti <francesco.bertolotti@igenius.ai>
Co-authored-by: Aaron Pham <Aaronpham0103@gmail.com>

367871a4

[Bugfix][Core] Prefix caching causes incorrect outputs due to outdated... · 92183b41

quanliu authored Jun 16, 2025


[Bugfix][Core] Prefix caching causes incorrect outputs due to outdated ComputedBlocksTracker (#18957)
Signed-off-by: 刘全 <quan.liu2@dbappsecurity.com.cn>
Co-authored-by: 刘全 <quan.liu2@dbappsecurity.com.cn>

92183b41

[MISC] Remove unused variableds in C++ (#19609) · c6703d1e
Lu Fang authored Jun 16, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
c6703d1e
[Misc] Remove duplicate multiproc method setting for CPU platform (#19649) · a5e7242d
Isotr0py authored Jun 16, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
a5e7242d

15 Jun, 2025 6 commits
- [CI/Build] Fix torch nightly CI dependencies part 2 (#19589) · 91b2c17a
  Richard Zou authored Jun 15, 2025
  
  91b2c17a
- Enable prefix caching with full cuda graphs (#19617) · 055915e6
  Woosuk Kwon authored Jun 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  055915e6
- [Benchmark] Refactor benchmark script for fp8 & int8 (#19627) · 3d330c4c
  Wentao Ye authored Jun 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3d330c4c
- [Kernel] Raise verbose error and consolidate `num_heads/num_kv_heads` divisibility check (#19339) · 0b73736a
  22quinn authored Jun 14, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  0b73736a
- [Bugfix][2/n] Fix speculative decoding CI - Fix test_ngram_e2e_greedy_correctness (#19644) · ee1531bc
  Lu Fang authored Jun 15, 2025
  
  ee1531bc
- [Perf] Further tunings for SM100 FP8 CUTLASS kernel (#19566) · e13945f9
  Ilya Markov authored Jun 15, 2025
  
  e13945f9
14 Jun, 2025 10 commits
- [Fix] Convert kv_transfer_config from dict to KVTransferConfig (#19262) · 08500011
  maobaolong authored Jun 15, 2025
  
  08500011
- [Bugfix] Don't attempt to use triton if no driver is active (#19561) · 861a0a0a
  Konrad Zawora authored Jun 14, 2025
  
  861a0a0a
- Only build CUTLASS MoE kernels on Hopper (#19648) · bc956b38
  Huy Do authored Jun 14, 2025
  
  bc956b38
- [Hardware][NVIDIA][kernel] Fp4 MOE quant kernel optimization (#19500) · 294fc1e2
  jiahanc authored Jun 14, 2025
  
  294fc1e2
- [Bugfix] Fix auto dtype casting for BatchFeature (#19316) · 2db9044a
  Isotr0py authored Jun 14, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2db9044a
- [Misc] Modularize CLI Argument Parsing in Benchmark Scripts (#19593) · 6fa718a4
  Reid authored Jun 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  6fa718a4
- [Bugfix] Fix the speculative decoding test by setting the target dtype (#19633) · 06be8588
  Lu Fang authored Jun 14, 2025
  
  06be8588
- [V1][Metrics] Deprecate metrics with gpu_ prefix for non GPU specific metrics. (#18354) · d1e34cc9
  Saheli Bhattacharjee authored Jun 14, 2025
```
Signed-off-by: Saheli Bhattacharjee <saheli@krai.ai>
```
  d1e34cc9
- [BugFix] Fix DP Coordinator incorrect debug log message (#19624) · bd517eb9
  Nick Hill authored Jun 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  bd517eb9
- Adding "AMD: Multi-step Tests" to amdproduction. (#19508) · d65668b4
  Concurrensee authored Jun 13, 2025
```
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d65668b4
13 Jun, 2025 17 commits
- [torch.compile] Use custom ops when use_inductor=False (#19618) · aafbbd98
  Woosuk Kwon authored Jun 13, 2025
  
  aafbbd98
- [Doc] Add troubleshooting section to k8s deployment (#19377) · 0f087451
  Anna Pendleton authored Jun 13, 2025
```
Signed-off-by: Anna Pendleton <pendleton@google.com>
```
  0f087451
- [CUDA] Enable full cudagraph for FlashMLA (#18581) · 3597b06a
  Luka Govedič authored Jun 13, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  3597b06a
- [doc][mkdocs] fix the duplicate Supported features sections in GPU docs (#19606) · 1015296b
  Reid authored Jun 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1015296b
- [Refactor] Remove unused variables in `moe_permute_unpermute_kernel.inl` (#19573) · ce9dc02c
  Wentao Ye authored Jun 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ce9dc02c
- [Model] Fix minimax model cache & lm_head precision (#19592) · a24cb916
  qscqesze authored Jun 13, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  a24cb916
- [BugFix] Honor `enable_caching` in connector-delayed kvcache load case (#19435) · 7e8d97dd
  Nick Hill authored Jun 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7e8d97dd
- [torch.compile] reorganize the cache directory to support compiling multiple models (#19064) · d70bc7c0
  youkaichao authored Jun 13, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d70bc7c0
- use base version for version comparison (#19587) · ce688ad4
  Boyuan Feng authored Jun 13, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  ce688ad4
- [Fix] The zip function in Python 3.9 does not have the strict argument (#19549) · cefdb996
  汪志鹏 authored Jun 13, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  cefdb996
- [Fix] bump mistral common to support magistral (#19533) · ace5cdaf
  汪志鹏 authored Jun 13, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  ace5cdaf
- [CPU] Refine default config for the CPU backend (#19539) · 64587211
  Li, Jiang authored Jun 13, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  64587211
- [Misc] Correct broken docs link (#19553) · bb4a0dec
  Hyogeun Oh (오효근) authored Jun 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  bb4a0dec
- [doc] fix incorrect link (#19586) · c707cfc1
  Reid authored Jun 13, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  c707cfc1
- [Doc] uses absolute links for structured outputs (#19582) · 7b3c9ff9
  Aaron Pham authored Jun 12, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  7b3c9ff9
- [Bugfix] Fix EAGLE vocab embedding for multimodal target model (#19570) · c68698b3
  qizixi authored Jun 12, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  c68698b3
- [BugFix] : Fix Batched DeepGemm Experts (#19515) · e3b12667
  Varun Sundar Rabindranath authored Jun 12, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e3b12667