Commits · 1e88fb751bce13c74355d177fd06035858ce77c4 · OpenDAS / vllm_cscc

"lib/llm/src/vscode:/vscode.git/clone" did not exist on "923e1ee729605a5c3abf2e43b535e9b2da90e771"

01 Nov, 2025 5 commits

Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
1e88fb75

[Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188

Yihua Cheng authored Nov 01, 2025

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e6751188

[Bugfix] [Model] Missing MRoPE function definition from `KeyeForConditionalGeneration` (#27895) · e2347dbf
TJian authored Oct 31, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
e2347dbf

[CI/Build] Bump transformers version (#27528) · 879a0657

Cyrus Leung authored Nov 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

879a0657

[Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
0cdbe7b7

31 Oct, 2025 4 commits
- [Hybrid] A simpler algorithm to find kernel_block_size (#26476) · df334868
  Chen Zhang authored Oct 31, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  df334868
- Add FLASHINFER_MLA to test_mla_backends and add B200 CI run (#27663) · f29aeb5a
  Matthew Bonanni authored Oct 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f29aeb5a
- [Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3
  GuanLuo authored Nov 01, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  d6517be3
- [CI/Build] Add gpt-oss LoRA test (#27870) · 0384aa71
  Jee Jee Li authored Oct 31, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0384aa71
30 Oct, 2025 11 commits
- [Fix] Skip `record_sleep_state` logic in `PrometheusStatsLogger` if not in dev mode (#27789) · 49170025
  Sumanth R Hegde authored Oct 30, 2025
```
Signed-off-by: SumanthRH <sumanthrh99@gmail.com>
```
  49170025
- [EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) · a2981c42
  cong-meta authored Oct 30, 2025
```
Co-authored-by: Cong Chen <prowindy@gmail.com>
```
  a2981c42
- [Model][Ouro] Support Ouro Model (#27794) · 9956aae4
  Fan Yin authored Oct 30, 2025
```
Signed-off-by: yinfan.1024 <yinfan.1024@bytedance.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: yinfan.1024 <yinfan.1024@bytedance.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9956aae4
- [KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770) · 0fe01404
  Zhewen Li authored Oct 30, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  0fe01404
- [Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b
  Zhiyuan Li authored Oct 30, 2025
```
Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  4e68cc9b
- [CI Failure] Fix test_kv_cache_model_load_and_run (#27717) · 1994de99
  Huamin Li authored Oct 30, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  1994de99
- [Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f
  wang.yuqi authored Oct 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4464723f
- [CI Failure] fix test_default_mm_loras (#27795) · c7d2a554
  Huamin Li authored Oct 30, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  c7d2a554
- [BugFix] Reordering extend logic fix (#27739) · b5d70751
  Lucas Wilkinson authored Oct 30, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b5d70751
- kernels/moe test pruning (#27053) · b8c48c5d
  Fardin Hoque authored Oct 29, 2025
```
Signed-off-by: Fardin Hoque <kfhfar@amazon.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  b8c48c5d
- [BugFix] Handle unscheduled requests properly when async scheduling (#27756) · 2ce5c5d3
  Nick Hill authored Oct 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ce5c5d3
29 Oct, 2025 10 commits

[Core] Exposing engine sleep & wake_up state as prometheus metrics (#24176) · 1da3309a
Braulio Dumba authored Oct 29, 2025
```
Signed-off-by: Braulio Dumba <Braulio.Dumba@ibm.com>
```
1da3309a
[CI] Fix flaky `test_two_responses_with_same_prev_id` test (#27745) · 0f95a1c3
Nicolò Lucchesi authored Oct 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
0f95a1c3
[CI/Build] Skip cpu offloading test on AMD (#27690) · 9a0d2f0d
Zhewen Li authored Oct 29, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
9a0d2f0d

[VLM] Add Qwen3-VL generation test (#25185) · ad3ec895

Isotr0py authored Oct 29, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

ad3ec895

Feature/video support in random mm dataset (#25963) · 5e72216d

Eugene Khvedchenya authored Oct 29, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Eugene Khvedchenya <ekhvedchenia@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

5e72216d

[Frontend] [gpt-oss] Mcp type bug (#27689) · ab2eb27b

Alec S authored Oct 29, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

ab2eb27b

[Bugfix] Fix modular kernel tests (#27707) · 1891cf60
bnellnm authored Oct 29, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
1891cf60
[CI/Build] Move pre-commit only scripts to `tools/pre_commit` (#27657) · 4fb8771c
Cyrus Leung authored Oct 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
4fb8771c

[Speculators] Move tests + fix integration (#27308) · 413ef7a3

Dipika Sikka authored Oct 29, 2025


Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Signed-off-by: rahul-tuli <rtuli@redhat.com>
Co-authored-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

413ef7a3

[CI/Build][Bugfix]Fix Quantized Models Test on AMD (#27712) · 83fd49b1
Zhewen Li authored Oct 28, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
83fd49b1

28 Oct, 2025 10 commits

[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic... · 94666612

Lucas Kabela authored Oct 28, 2025


[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic nn.Module and demonstrate speedup on Qwen Vision model (#23207)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Signed-off-by: Lucas Kabela <lucasakabela@gmail.com>

94666612

[AsyncScheduling] Make async overlap work with logprobs (#27615) · 4fe58953
Nick Hill authored Oct 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
4fe58953
[Core] Scheduler: Publish connector events after output (#25875) · 111faf11
Or Ozeri authored Oct 28, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
111faf11
[Test] Batch Invariant: Unit test using parameterized backend (#27478) · 6afc28a9
Wentao Ye authored Oct 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
6afc28a9
[Misc] Make reorder batch also separate extends (#27367) · 141e6a05
Lucas Wilkinson authored Oct 29, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
141e6a05

[Bugfix][CI] Fix v1 attention backend tests and add CI coverage (#26597) · a8c02fb5

Mohammad Miadh Angkad authored Oct 28, 2025


Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
Signed-off-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

a8c02fb5

[Bugfix] Fix allocation & free logic of SingleWriterShmRingBuffer (#27117) · 02af36df

Kero Liang authored Oct 28, 2025


Signed-off-by: Kero Liang <kerorek@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: donglu <donglu@cohere.com>
Co-authored-by: Roger Wang <hey@rogerw.io>