Commits · 1e88fb751bce13c74355d177fd06035858ce77c4 · OpenDAS / vllm_cscc

"csrc/vscode:/vscode.git/clone" did not exist on "e0ba5f6027732a221f71e976cc5ff06a512d9441"

01 Nov, 2025 15 commits

Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
1e88fb75
[BugFix] Fix mixed penalties batch with async scheduling (#27910) · c2ed069b
Nick Hill authored Nov 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
c2ed069b
[Core][TPU] Support TPU Data Parallalism (#27365) · af6e19f5
wenxindongwork authored Nov 01, 2025
```
Signed-off-by: wenxindongwork <wenxindong@google.com>
```
af6e19f5
[Bugfix] Python 3.10 compatibility for `Self` (#27918) · 99d69af9
Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
99d69af9
[Bugfix] DeepSeek V3.2 MTP metadata & CUDA graph issues (#26779) · d811b442
Haco authored Nov 01, 2025
```
Signed-off-by: xiaohajiayou <923390377@qq.com>
```
d811b442

[V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798) · 30a14b03

wangxiyuan authored Nov 01, 2025


Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

30a14b03

[Docs] Mock all imports for docs (#27873) · 799ce45c
Harry Mellor authored Nov 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
799ce45c

[Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188

Yihua Cheng authored Nov 01, 2025

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e6751188

[Bugfix] [Model] Missing MRoPE function definition from `KeyeForConditionalGeneration` (#27895) · e2347dbf
TJian authored Oct 31, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
e2347dbf

[CI/Build] Bump transformers version (#27528) · 879a0657

Cyrus Leung authored Nov 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

879a0657

Adding SplitK in fused_moe_lora kernel (#27818) · 29de3cde

yugong333 authored Oct 31, 2025


Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

29de3cde

[Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5

Yan Ma authored Nov 01, 2025


Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

7e2729b5

[Bugfix] Fix KDA output (#27905) · 3a5de7d2
Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
3a5de7d2
[Kernel] Enable FusedMoEModularKernel support bias (#27754) · bc4486d6
Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
bc4486d6
[Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
0cdbe7b7

31 Oct, 2025 16 commits
- [Hybrid] A simpler algorithm to find kernel_block_size (#26476) · df334868
  Chen Zhang authored Oct 31, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  df334868
- Add FLASHINFER_MLA to test_mla_backends and add B200 CI run (#27663) · f29aeb5a
  Matthew Bonanni authored Oct 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f29aeb5a
- [Feature] Pydantic validation for scheduler.py and structured_outputs.py (#26519) · 5e8862e9
  Vinay R Damodaran authored Oct 31, 2025
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5e8862e9
- [Cleanup] Remove no-longer-used `SpeculativeConfig.enable_chunked_prefill` (#27826) · 9e5bd307
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9e5bd307
- Flashinfer_CUTLASS_MOE fuses quantization for TP (#27223) · fc16f1c4
  Shu Wang authored Oct 31, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  fc16f1c4
- fix incorrect type annotation in KimiMLP (#27885) · bc306fe5
  ZiTian Zhao authored Nov 01, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  bc306fe5
- [bugfix] Missing cached item in beam search (#27874) · 103a468b
  Chenguang Zheng authored Nov 01, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  103a468b
- [Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3
  GuanLuo authored Nov 01, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  d6517be3
- [Bugfix] Fix broken MRoPE for GLM-4.1V/GLM-4.5V (#27860) · 7e06c40e
  Isotr0py authored Nov 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7e06c40e
- [Bugfix] Allow 64-bit integer values for LoRA IDs to avoid overflow/truncation (#27876) · 675704ac
  Madeesh Kannan authored Oct 31, 2025
```
Signed-off-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
```
  675704ac
- [Perf] Decouple torch op from GDA to leverage torch.compile (#27871) · 3857eb87
  Jiangyun Zhu authored Oct 31, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  3857eb87
- [BugFix] Don’t compute reorder threshold when there are no attention groups (#27861) · 933cdea4
  Huamin Li authored Oct 31, 2025
  
  933cdea4
- [Bugfix] Avoid too small block m/n for FlexAttention kernel option (#27853) · 3933f18a
  Isotr0py authored Oct 31, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3933f18a
- [Kimi-Linear] Correct prefixes and add compatibility to AWQ quants (#27834) · e5ef4dfc
  toncao authored Oct 31, 2025
```
Signed-off-by: toncao <cpatonn@gmail.com>
Co-authored-by: toncao <cpatonn@gmail.com>
```
  e5ef4dfc
- [Hardware][Powerpc] Fix VLLM_CPU_OMP_THREADS_BIND="auto" low CPU utilization for Power (#27734) · 36960501
  Akash kaothalkar authored Oct 31, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  36960501
- [benchmark] Make request IDs unique across clients by default (#27723) · b2e65cb4
  Seiji Eicher authored Oct 30, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  b2e65cb4
30 Oct, 2025 9 commits
- [BugFix] Fix broken import in initialize_ray_cluster() (#27838) · c9791f18
  Nick Hill authored Oct 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c9791f18
- [Feature] Batch invariant torch.compile (#27660) · e7acb200
  Paul Zhang authored Oct 30, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  e7acb200
- [Core][Perf] Only invoke save_new_computed_blocks when computed blocks are not empty (#27799) · 4b68c4a5
  Jialin Ouyang authored Oct 30, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4b68c4a5
- [Refactor] Remove `VLLM_DEEPEP_LOW_LATENCY_ALLOW_NVLINK` (#27750) · a8141fa6
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a8141fa6
- [Fix] Skip `record_sleep_state` logic in `PrometheusStatsLogger` if not in dev mode (#27789) · 49170025
  Sumanth R Hegde authored Oct 30, 2025
```
Signed-off-by: SumanthRH <sumanthrh99@gmail.com>
```
  49170025
- [EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) · a2981c42
  cong-meta authored Oct 30, 2025
```
Co-authored-by: Cong Chen <prowindy@gmail.com>
```
  a2981c42
- [Core][Bookkeeping] Update cu_num_accepted_tokens for all req_index (#27629) · 4574d48b
  Jialin Ouyang authored Oct 30, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4574d48b
- [Bugfix] Fix 2 precommit issues - (mamba_block_size, kv_cache_config) (#27811) · ab98f655
  Tyler Michael Smith authored Oct 30, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  ab98f655
- [Model] Use the same fused_moe configs for all H200 devices (#23642) · 2918c1b4
  Roger Meier authored Oct 31, 2025
```
Signed-off-by: Roger Meier <r.meier@siemens.com>
```
  2918c1b4