Commits · 2e2000f352d861dd2b527a48c5f12d295a93c3dd · OpenDAS / vllm_cscc

"vllm/entrypoints/openai/engine/protocol.py" did not exist on "d4c574c39f2adde4cfca4f583dc5b33714df774a"

21 Aug, 2025 11 commits

[Model] Add LFM2 architecture (#22845) · 2e2000f3
Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
2e2000f3

[BugFix] Fix Python 3.9 Support (#23306) · 31282401

Jared O'Connell authored Aug 21, 2025

Signed-off-by: Jared O'Connell <46976761+jaredoconnell@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

31282401

[Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0c31e28e

[Sampler] Support returning final logprobs (#22387) · f571ff8e

22quinn authored Aug 20, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

f571ff8e

[Model][VLM] Support R-4B Model (#23246) · 655a09f6

杨奇(yann qi) authored Aug 21, 2025

Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

655a09f6

[V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c

Asaf Joseph Gardin authored Aug 21, 2025


Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>

3663870c

[CI/Build] Split out mm processor tests (#23260) · 2461d9e5
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
2461d9e5
[CPU] Refactor CPU W8A8 scaled_mm (#23071) · 7be5d113
Li, Jiang authored Aug 21, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
7be5d113
[Optimization] Make new_block_ids None if empty (#23262) · b029de99
Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
b029de99
[CI Bugfix] Fix CI by fully removing --enable-prompt-adapter (#23284) · bbea1cef
Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
bbea1cef
Remove duplicate entry in vllm.attention.__all__ (#23296) · f5aa307d
Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
f5aa307d

20 Aug, 2025 29 commits
- [EP] Add logging for experts map (#22685) · 4b795020
  22quinn authored Aug 20, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  4b795020
- Feature/mla tests (#23195) · 10cc12ba
  Matthew Bonanni authored Aug 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  10cc12ba
- Remove chunked_prefill_enabled flag in V1 MLA (#23183) · a4fbb32f
  Matthew Bonanni authored Aug 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  a4fbb32f
- [Feature] use --eplb_config to set eplb param (#20562) · 4fbda0b2
  rongfu.leng authored Aug 21, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4fbda0b2
- Do not use eval() to convert unknown types (#23266) · 4e51fa8c
  Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4e51fa8c
- [Perf] Speed up function `_convert_tokens_to_string_with_added_encoders` by 13.7x (#20413) · bf7c99df
  Saurabh Misra authored Aug 20, 2025
```
Signed-off-by: Saurabh Misra <misra.saurabh1@gmail.com>
Signed-off-by: Aseem Saxena <aseem.bits@gmail.com>
Co-authored-by: codeflash-ai[bot] <148906541+codeflash-ai[bot]@users.noreply.github.com>
Co-authored-by: Aseem Saxena <aseem.bits@gmail.com>
```
  bf7c99df
- [Frontend] improve error logging of chat completion (#22957) · b95697d7
  Chen Zhang authored Aug 20, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  b95697d7
- [Fix] correct tool_id for kimi-k2 when use tool_choice=required (#21259) · 582bbe6b
  bigmoyan authored Aug 21, 2025
```
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  582bbe6b
- [Kernel/Quant] Remove the original marlin format and qqq (#23204) · 0cdbf5e6
  Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0cdbf5e6
- Small fix for Command-A-Vision (#23268) · ebe56a00
  dongluw authored Aug 20, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  ebe56a00
- Limit HTTP header count and size (#23267) · f77a0802
  Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
  f77a0802
- Migrate Mistral3ImagePixelInputs to TensorSchema (#21945) · c4477f55
  Benji Beck authored Aug 20, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c4477f55
- [torch.compile] Support conditional torch.compile per module (#22269) · dfd23820
  Yong Hoon Shin authored Aug 20, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  dfd23820
- [FIXBUG ] Allow disabling rocm_aiter_fa backend for ROCm GPUs not compatible with AITER (#22795) · 3b11b26b
  JartX authored Aug 20, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  3b11b26b
- [Misc] Add max_seq_len to CommonAttentionMetadata (#23216) · d6d13bd4
  Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d6d13bd4
- [CLI][Doc] Formalize `--mm-encoder-tp-mode` (#23190) · 5efd6905
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5efd6905
- [Kernel] CUTLASS MoE FP8: Integrate cuda moe permute/unpermute (#23045) · b17109be
  shixianc authored Aug 20, 2025
```
Signed-off-by: Shixian Cui <shixian@amazon.com>
```
  b17109be
- [Bugfix] Ensure correctness of HCXVision processing (#23254) · 44492358
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44492358
- [Fix] fix offline env use local mode path (#22526) · 38217877
  rongfu.leng authored Aug 20, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  38217877
- [Model] Improve olmo and olmo2 (#23228) · c6d80a7a
  Jee Jee Li authored Aug 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c6d80a7a
- [Model][V1] Support Ernie MTP (#22169) · 7cd17e22
  xyxinyang authored Aug 20, 2025
```
Signed-off-by: zhouchong <zhouchong03@baidu.com>
Co-authored-by: zhouchong <zhouchong03@baidu.com>
```
  7cd17e22
- [Bugfix] Ensure correctness of Cohere2Vision processing (#23245) · 68fcd3fa
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68fcd3fa
- [Model] Support deepseek with eagle (#21086) · 83e69a09
  Xin Yang authored Aug 20, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  83e69a09
- [Model] use autoWeightsLoader for gptoss (#22446) · 103f1ec8
  Calvin Chen authored Aug 20, 2025
```
Signed-off-by: calvin chen <wen.chen@dynamia.ai>
```
  103f1ec8
- fix cuda graph (#22721) · d983769c
  who who who authored Aug 20, 2025
```
Signed-off-by: fsx950223 <fsx950223@outlook.com>
```
  d983769c
- [BugFix] Fix stuck stats/metrics after requests are aborted (#22995) · 8fd92092
  Nick Hill authored Aug 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8fd92092
- [CI/Build] Also check DP in benchmarks throughput script (#23038) · f7290232
  Zhewen Li authored Aug 19, 2025
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  f7290232
- chore: support pytorch format in lora (#22790) · 1a3079a1
  길재은 authored Aug 20, 2025
```
Signed-off-by: jaeeun.kil <rha3122@naver.com>
Signed-off-by: 길재은 <rha3122@naver.com>
```
  1a3079a1
- [Attention] Optimize make_local_attention_virtual_batches for Flash Attention (#23185) · a634733f
  Zebing Lin authored Aug 19, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  a634733f