Commits · 34a984274eae2f8fb9d1d6413abd08d7fcde741c · OpenDAS / vllm_cscc

"vllm/engine/llm_engine.py" did not exist on "e86717833da1216222cf0d490c2e3ba198610b13"

29 Nov, 2025 11 commits
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
- [Model Runner V2] Fuse penalties and temperature into single kernel (#29720) · f223ed41
  Woosuk Kwon authored Nov 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f223ed41
- [Doc]: fixing typos in various files. (#29717) · 04a797cd
  Didier Durand authored Nov 29, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  04a797cd
- [Model Runner V2] Add sample/ directory and reorganize files (#29719) · 6afc0ffa
  Woosuk Kwon authored Nov 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6afc0ffa
- [LoRA] Cleanup LoRA unused code (#29611) · 39e63dec
  Jee Jee Li authored Nov 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  39e63dec
- [Model Runner V2] Don't use UVA buffer for prefill_len (#29713) · 4a80ad0a
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4a80ad0a
- [BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable (#29698) · e23f665d
  Lucas Wilkinson authored Nov 28, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e23f665d
- [Model Runner V2] Refactor prefill token preparation (#29712) · ca1b1e72
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ca1b1e72
- [Frontend] Perform offline path replacement to `tokenizer` (#29706) · 762a4a6c
  Tsukasa OI authored Nov 29, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  762a4a6c
- [Model Runner V2] Support penalties using bin counts (#29703) · 1dcafb3d
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1dcafb3d
- [Bugfix] Fix O(n²) multimodal string prompt processing (#29667) · c625d7b1
  Mert Unsal authored Nov 28, 2025
```
Signed-off-by: mertunsall <mertunsal1905@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c625d7b1
28 Nov, 2025 29 commits
- [compile] Include `enable_sleep_mode` into caching factors. (#29696) · 6173682b
  Zhengxu Chen authored Nov 28, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  6173682b
- bugfix: correct attn output with base 2 or e (#28840) · 9726e645
  Augusto Yao authored Nov 29, 2025
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
```
  9726e645
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [Bugfix] fix dots.llm1.inst (#29687) · a51f4186
  Jiangyun Zhu authored Nov 29, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  a51f4186
- [Misc] Remove redundant `ClassRegistry` (#29681) · 7675ba30
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  7675ba30
- [Perf] Optimize EAGLE prepare_inputs_padded with triton kernels (#28597) · 1986de13
  Benjamin Chislett authored Nov 28, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  1986de13
- [Frontend] Remap -O to -cc commandline flag (#29557) · 3461e7ef
  Yanan Cao authored Nov 28, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  3461e7ef
- Remove `all_special_tokens_extended` from tokenizer code (#29686) · fecae12c
  Harry Mellor authored Nov 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fecae12c
- [Chore] Rename `Processor` to `InputProcessor` (#29682) · 8d9338fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9338fa
- [Chore]: Reorganize model repo operating functions in `transformers_utils` (#29680) · f946a8d7
  Isotr0py authored Nov 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f946a8d7
- [V0 deprecation] Clean up legacy paged attention helper functions (#28043) · 6f9d81d0
  Isotr0py authored Nov 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6f9d81d0
- [Doc]: fixing typos in multiple files. (#29685) · fae69430
  Didier Durand authored Nov 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  fae69430
- add add_truncate_prompt_tokens in repr for PoolingParams (#29683) · 3bcbb30c
  果冻虾仁 authored Nov 29, 2025
  
  3bcbb30c
- [mypy] Enable type checking for more directories (#29674) · 9e6bcda3
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9e6bcda3
- Guard FlashInfer sampler using the same check as FlashInfer attention backend (#29415) · 9eec282c
  Harry Mellor authored Nov 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9eec282c
- [Misc] Remove `yapf` directives (#29675) · 0808eb81
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0808eb81
- Remove upstream fa checks (#29471) · 460d8bbf
  Mingyuan Ma authored Nov 28, 2025
```
Signed-off-by: mingyuanm <mingyuanm@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  460d8bbf
- [CPU] Update torch 2.9.1 for CPU backend (#29664) · e2f56c30
  Li, Jiang authored Nov 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e2f56c30
- Revert "Supress verbose logs from model_hosting_container_standards (… (#29335) · f8151b66
  HappyAmazonian authored Nov 28, 2025
```
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f8151b66
- [Optimization] Early return for `_apply_matches` and `_iter_placeholders` (#29668) · 1168768a
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1168768a
- [BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542) · 8e7a8916
  Nick Hill authored Nov 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8e7a8916
- [mypy] Pass type checking for `vllm/utils` and `vllm/v1/pool` (#29666) · 953d9c82
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  953d9c82
- [Misc] Remove redundant attention var constants (#29650) · 33b06a6f
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  33b06a6f
- [Rocm] Set VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS default is disabled (#28985) · 3cb32e5d
  杰兮 authored Nov 28, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  3cb32e5d
- Fix parameter order in GPT-OSS weight loading function for non-MXFP4 weights (#29506) · 5f5521bd
  Filipp Fisin authored Nov 28, 2025
```
Signed-off-by: Filipp Fisin <48059208+qGentry@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  5f5521bd
- [BUGFIX] MistralTokenizer._call__ adds an invalid EOS token (#29607) · b2c1d294
  Julien Denize authored Nov 28, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  b2c1d294
- [Doc] Improve abnormal information string (#29655) · cc0f2a0e
  maang-h authored Nov 28, 2025
```
Signed-off-by: maang <maang_h@163.com>
```
  cc0f2a0e
- [Feature][Bench] Add pareto visualization (#29477) · 48059895
  rongfu.leng authored Nov 28, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  48059895
- Revert "[CPU]Update CPU PyTorch to 2.9.0 (#29589)" (#29647) · b34e8775
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b34e8775