Commits · d6517be3cd06111ada0a603acaeab28dd4580641 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "d9fc8cd9da4a69cb4171efb7cb5a46308680c83c"

31 Oct, 2025 4 commits
- [Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3
  GuanLuo authored Nov 01, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  d6517be3
- [Bugfix] Allow 64-bit integer values for LoRA IDs to avoid overflow/truncation (#27876) · 675704ac
  Madeesh Kannan authored Oct 31, 2025
```
Signed-off-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
```
  675704ac
- [BugFix] Don’t compute reorder threshold when there are no attention groups (#27861) · 933cdea4
  Huamin Li authored Oct 31, 2025
  
  933cdea4
- [Bugfix] Avoid too small block m/n for FlexAttention kernel option (#27853) · 3933f18a
  Isotr0py authored Oct 31, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3933f18a
30 Oct, 2025 12 commits
- [BugFix] Fix broken import in initialize_ray_cluster() (#27838) · c9791f18
  Nick Hill authored Oct 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c9791f18
- [Core][Perf] Only invoke save_new_computed_blocks when computed blocks are not empty (#27799) · 4b68c4a5
  Jialin Ouyang authored Oct 30, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4b68c4a5
- [Fix] Skip `record_sleep_state` logic in `PrometheusStatsLogger` if not in dev mode (#27789) · 49170025
  Sumanth R Hegde authored Oct 30, 2025
```
Signed-off-by: SumanthRH <sumanthrh99@gmail.com>
```
  49170025
- [Core][Bookkeeping] Update cu_num_accepted_tokens for all req_index (#27629) · 4574d48b
  Jialin Ouyang authored Oct 30, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4574d48b
- [Bugfix] Fix 2 precommit issues - (mamba_block_size, kv_cache_config) (#27811) · ab98f655
  Tyler Michael Smith authored Oct 30, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  ab98f655
- [Misc] Replace CUDA_VISIBLE_DEVICES in DP with torch.cuda.set_device for... · 60f76baa
  Ilya Markov authored Oct 30, 2025
```
[Misc] Replace CUDA_VISIBLE_DEVICES in DP with torch.cuda.set_device for device selection on cuda-like devices (#27564)
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  60f76baa
- [KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770) · 0fe01404
  Zhewen Li authored Oct 30, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  0fe01404
- [Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b
  Zhiyuan Li authored Oct 30, 2025
```
Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  4e68cc9b
- [Bugfix] Improve GPU validation logging in Ray fallback scenarios (#25775) · 74374386
  Sairam Pillai authored Oct 30, 2025
```
Signed-off-by: Sairam Pillai <sairam.pillai61@gmail.com>
```
  74374386
- [CI] Fix mypy for `vllm/v1/core` and `vllm/v1/engine` (#27108) · c01f6e52
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c01f6e52
- [BugFix] Reordering extend logic fix (#27739) · b5d70751
  Lucas Wilkinson authored Oct 30, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b5d70751
- [BugFix] Handle unscheduled requests properly when async scheduling (#27756) · 2ce5c5d3
  Nick Hill authored Oct 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ce5c5d3
29 Oct, 2025 4 commits
- [Bug] Fix DBO IMA issue for DeepEPHT (#27666) · b5d90f74
  Wentao Ye authored Oct 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b5d90f74
- [KVConnector] Add metrics to Prometheus-Grafana dashboard (#26811) · accb8fab
  Nicolò Lucchesi authored Oct 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  accb8fab
- [Core] Exposing engine sleep & wake_up state as prometheus metrics (#24176) · 1da3309a
  Braulio Dumba authored Oct 29, 2025
```
Signed-off-by: Braulio Dumba <Braulio.Dumba@ibm.com>
```
  1da3309a
- [Core] Early return in SlidingWindowManager.remove_skipped_blocks (#27673) · 0b51c9bd
  Jialin Ouyang authored Oct 28, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  0b51c9bd
28 Oct, 2025 9 commits
- [AsyncScheduling] Make async overlap work with logprobs (#27615) · 4fe58953
  Nick Hill authored Oct 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4fe58953
- [Core] Scheduler: Publish connector events after output (#25875) · 111faf11
  Or Ozeri authored Oct 28, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  111faf11
- [Misc] Make reorder batch also separate extends (#27367) · 141e6a05
  Lucas Wilkinson authored Oct 29, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  141e6a05
- [Misc] Make `LayerBlockType` a `Literal` instead of `Enum` (#27658) · f5710ef0
  Cyrus Leung authored Oct 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f5710ef0
- [Bugfix][CI] Fix v1 attention backend tests and add CI coverage (#26597) · a8c02fb5
  Mohammad Miadh Angkad authored Oct 28, 2025
```
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
Signed-off-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a8c02fb5
- [Core] Enable async scheduling for external_launcher mode (#27394) · 2abbd351
  22quinn authored Oct 28, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  2abbd351
- [Misc] Separate out `utils.counter` and move `utils.Device` to engine (#27588) · f58d9b64
  Cyrus Leung authored Oct 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f58d9b64
- [Core][Bookkeeping Optimization] Update against numpy view of is_token_ids tensor (#27618) · b46e4a06
  Jialin Ouyang authored Oct 28, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b46e4a06
- [Bugfix] fixed inconsistent finish_reason handling between V0 and V1 engines (#27555) · 61fbfe52
  Chauncey authored Oct 28, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  61fbfe52
27 Oct, 2025 2 commits

Code quality improvements: version update, type annotation enhancement, and... · 69f06406

usberkeley authored Oct 28, 2025


Code quality improvements: version update, type annotation enhancement, and enum usage simplification (#27581)
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>

69f06406

[Misc] Clean up more utils (#27567) · 6ebffafb
Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
6ebffafb

26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

25 Oct, 2025 3 commits
- [Misc] Simplify max tokens in multimodal registry (#27500) · 4c5f6321
  Cyrus Leung authored Oct 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4c5f6321
- [Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712) · b8535403
  Kuntai Du authored Oct 24, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  b8535403
- Revert "[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selectio… (#27502) · 56ed7609
  Zhuohan Li authored Oct 24, 2025
  
  56ed7609
24 Oct, 2025 5 commits
- [Log] Optimize Startup Log (#26740) · 52efc34e
  Wentao Ye authored Oct 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  52efc34e
- [Perf][Async Scheduling] Remove CPU->GPU sync in dummy_run (#27455) · 04024282
  Lehua Ding authored Oct 25, 2025
```
Signed-off-by: Lehua Ding <lehuading@tencent.com>
```
  04024282
- [Attention] Add MLA prefill backend: trtllm_ragged_attention_deepseek (#26397) · 0f67d4d9
  Ming Yang authored Oct 24, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  0f67d4d9
- [MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922
  fhl2000 authored Oct 24, 2025
```
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  284cc922
- [Chore] remove structural tags logging lines (#27451) · d4c574c3
  Aaron Pham authored Oct 24, 2025
  
  d4c574c3