Commits · 675704ac01e8ab1b986f777f7ccc4ac72159eb7b · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "e599e2c65ee32abcc986733ab0a55becea158bb4"

31 Oct, 2025 9 commits
- [Bugfix] Allow 64-bit integer values for LoRA IDs to avoid overflow/truncation (#27876) · 675704ac
  Madeesh Kannan authored Oct 31, 2025
```
Signed-off-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
```
  675704ac
- [CI/Build] Add gpt-oss LoRA test (#27870) · 0384aa71
  Jee Jee Li authored Oct 31, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0384aa71
- [Perf] Decouple torch op from GDA to leverage torch.compile (#27871) · 3857eb87
  Jiangyun Zhu authored Oct 31, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  3857eb87
- [BugFix] Don’t compute reorder threshold when there are no attention groups (#27861) · 933cdea4
  Huamin Li authored Oct 31, 2025
  
  933cdea4
- [Bugfix] Avoid too small block m/n for FlexAttention kernel option (#27853) · 3933f18a
  Isotr0py authored Oct 31, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3933f18a
- [Kimi-Linear] Correct prefixes and add compatibility to AWQ quants (#27834) · e5ef4dfc
  toncao authored Oct 31, 2025
```
Signed-off-by: toncao <cpatonn@gmail.com>
Co-authored-by: toncao <cpatonn@gmail.com>
```
  e5ef4dfc
- [Hardware][Powerpc] Fix VLLM_CPU_OMP_THREADS_BIND="auto" low CPU utilization for Power (#27734) · 36960501
  Akash kaothalkar authored Oct 31, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  36960501
- [benchmark] Make request IDs unique across clients by default (#27723) · b2e65cb4
  Seiji Eicher authored Oct 30, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  b2e65cb4
- [CI Test] Add Scheduled Integration Test (#27765) · 2bf0bcc1
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2bf0bcc1
30 Oct, 2025 31 commits
- [CI/Build][Intel] Enable performance benchmarks for Intel Gaudi 3 (#26919) · 697f507a
  Jakub Sochacki authored Oct 31, 2025
```
Signed-off-by: jakub-sochacki <jakub.sochacki@wp.pl>
```
  697f507a
- [Misc] Make all tool scripts executable (#27831) · d5d2a0fe
  Matthew Bonanni authored Oct 30, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  d5d2a0fe
- [BugFix] Fix broken import in initialize_ray_cluster() (#27838) · c9791f18
  Nick Hill authored Oct 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c9791f18
- [Feature] Batch invariant torch.compile (#27660) · e7acb200
  Paul Zhang authored Oct 30, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  e7acb200
- [Core][Perf] Only invoke save_new_computed_blocks when computed blocks are not empty (#27799) · 4b68c4a5
  Jialin Ouyang authored Oct 30, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4b68c4a5
- [Refactor] Remove `VLLM_DEEPEP_LOW_LATENCY_ALLOW_NVLINK` (#27750) · a8141fa6
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a8141fa6
- [Fix] Skip `record_sleep_state` logic in `PrometheusStatsLogger` if not in dev mode (#27789) · 49170025
  Sumanth R Hegde authored Oct 30, 2025
```
Signed-off-by: SumanthRH <sumanthrh99@gmail.com>
```
  49170025
- [EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) · a2981c42
  cong-meta authored Oct 30, 2025
```
Co-authored-by: Cong Chen <prowindy@gmail.com>
```
  a2981c42
- [Core][Bookkeeping] Update cu_num_accepted_tokens for all req_index (#27629) · 4574d48b
  Jialin Ouyang authored Oct 30, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4574d48b
- [Bugfix] Fix 2 precommit issues - (mamba_block_size, kv_cache_config) (#27811) · ab98f655
  Tyler Michael Smith authored Oct 30, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  ab98f655
- [Model] Use the same fused_moe configs for all H200 devices (#23642) · 2918c1b4
  Roger Meier authored Oct 31, 2025
```
Signed-off-by: Roger Meier <r.meier@siemens.com>
```
  2918c1b4
- [MTP] Refactor mtp predictor to avoid d2h operation (#27643) · 10042057
  Mengqing Cao authored Oct 31, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  10042057
- Reapply "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27768) · ba33e883
  Huy Do authored Oct 30, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  ba33e883
- [Docs] add Shanghai Meetup - 2025/10 (#27545) · 33a0ea5f
  Kebe authored Oct 31, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: esmeetu <jasonailu87@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: esmeetu <jasonailu87@gmail.com>
```
  33a0ea5f
- [Misc] Replace CUDA_VISIBLE_DEVICES in DP with torch.cuda.set_device for... · 60f76baa
  Ilya Markov authored Oct 30, 2025
```
[Misc] Replace CUDA_VISIBLE_DEVICES in DP with torch.cuda.set_device for device selection on cuda-like devices (#27564)
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  60f76baa
- [BugFix] Stopgap - Flashinfer Autotuner + GPT-OSS + DP/TP (#27762) · e5e076ca
  Varun Sundar Rabindranath authored Oct 30, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e5e076ca
- [Bugfix][CPU] Fix MRoPE dispatch on the CPU backend (#27800) · eebf00cb
  Li, Jiang authored Oct 30, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  eebf00cb
- [Model][Ouro] Support Ouro Model (#27794) · 9956aae4
  Fan Yin authored Oct 30, 2025
```
Signed-off-by: yinfan.1024 <yinfan.1024@bytedance.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: yinfan.1024 <yinfan.1024@bytedance.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9956aae4
- [KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770) · 0fe01404
  Zhewen Li authored Oct 30, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  0fe01404
- [Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b
  Zhiyuan Li authored Oct 30, 2025
```
Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  4e68cc9b
- [CI Failure] Fix test_kv_cache_model_load_and_run (#27717) · 1994de99
  Huamin Li authored Oct 30, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  1994de99
- [Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f
  wang.yuqi authored Oct 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4464723f
- [Bugfix] Improve GPU validation logging in Ray fallback scenarios (#25775) · 74374386
  Sairam Pillai authored Oct 30, 2025
```
Signed-off-by: Sairam Pillai <sairam.pillai61@gmail.com>
```
  74374386
- [CI] Fix mypy for `vllm/v1/core` and `vllm/v1/engine` (#27108) · c01f6e52
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c01f6e52
- [CI Failure] fix test_default_mm_loras (#27795) · c7d2a554
  Huamin Li authored Oct 30, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  c7d2a554
- [V0 deprecation] Remove VLLM_USE_V1 usage in config module (#27784) · af826e08
  wangxiyuan authored Oct 30, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  af826e08
- [BugFix][VL] Fix FA selection on Qwen2.5-VL (#27790) · e806178d
  Zhewen Li authored Oct 30, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  e806178d
- [CI/Build]Add eval config for Qwen3-235B-A22B-Instruct-2507-FP8 (#27113) · 5be1bed7
  Huamin Li authored Oct 30, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  5be1bed7
- use stringData in secret yaml to store huggingface token (#25685) · 31b55ffc
  yitingdc authored Oct 30, 2025
```
Signed-off-by: yiting.jiang <yiting.jiang@daocloud.io>
```
  31b55ffc
- Add more dims for batch invariant shims (#27489) · ded8ada8
  Bram Wasti authored Oct 30, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  ded8ada8
- [Benchmark] Cleanup deprecated nightly benchmark and adjust the docstring for... · 8bff831f
  Kuntai Du authored Oct 29, 2025
```
[Benchmark] Cleanup deprecated nightly benchmark and adjust the docstring for performance benchmark (#25786)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  8bff831f