Commits · bc6e542d9fc400d7002853b3878c81b14fbdc998 · OpenDAS / vllm_cscc · GitLab

21 Sep, 2025 10 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
- feat: Enable engine-level arguments with speculators models (#25250) · c438b295
  Rahul Tuli authored Sep 21, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  c438b295
- [V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334) · 0ff8ebb2
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0ff8ebb2
- [V0 Deprecation] Remove V0 Sequence class & Sampler (#25332) · 26e673fe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  26e673fe
- [V1] Add sliding window support to Flex Attention backend (#24089) · cf56cf78
  Isotr0py authored Sep 21, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cf56cf78
- [CI] Skip tests failing on main (#25326) · 72dd1595
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  72dd1595
- [Chore] Remove unused sampler in models (#25324) · 572ddf83
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  572ddf83
- [V0 Deprecation] Remove V0 Output Processor (#25320) · 86647d1c
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  86647d1c
- [V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  52c2a8d4
20 Sep, 2025 9 commits
- [V0 Deprecation] Enable the remaining multimodal tests in V1 (#25307) · bef180f0
  Cyrus Leung authored Sep 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bef180f0
- [Core] Enable sharded state loader for V1 engine and enhance test coverage (#25308) · d88918e4
  lirong authored Sep 20, 2025
```
Signed-off-by: pengdrumli <pengdrumli@tencent.com>
```
  d88918e4
- [V1] Support `LLM.apply_model` (#18465) · 3d9a1d2d
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3d9a1d2d
- [Hybrid Allocator] Support full attention with different hidden size (#25101) · 9607d5eb
  Chen Zhang authored Sep 19, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  9607d5eb
- [Bugfix] fix tool call arguments is empty (#25223) · f91480b2
  Chauncey authored Sep 20, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: xin.li <xin.li@daocloud.io>
```
  f91480b2
- [Misc] Support more collective_rpc return types (#25294) · 535d8005
  Nick Hill authored Sep 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  535d8005
- [torch.compile] CUDAGraph Inductor partition integration (#24281) · 8945b001
  Boyuan Feng authored Sep 19, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Signed-off-by: boyuanfeng <boyuan@meta.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  8945b001
- test: Remove vestigial skip for prompt embeds tests after landing v1 Prompt Embeds support (#25291) · c7e71361
  Andrew Sansom authored Sep 19, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  c7e71361
- [Bugfix] Remove VLLM_TEST_DYNAMO_FULLGRAPH_CAPTURE #2969 (#25090) · 3da17c2c
  Lucas Kabela authored Sep 19, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  3da17c2c
19 Sep, 2025 18 commits
- Enable modelopt gemma3 nvfp4/fp8, make workflow more robust (#22771) · 431535b5
  Zhiyu authored Sep 19, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  431535b5
- [Frontend] Responses API messages out, just harmony for now (#24985) · e69e0b8b
  Alec S authored Sep 19, 2025
```
Signed-off-by: Alec Solder <alecs@fb.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  e69e0b8b
- Optimize triton unified attention performance for sliding window attention (#24390) · a2a5f79e
  qizixi authored Sep 19, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
  a2a5f79e
- [KV offload][4/N] Offloading KV connector (#22595) · c59a0eca
  Or Ozeri authored Sep 19, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  c59a0eca
- [Core][Prefix Hash] Fix prefix hash metrics sliding window maintainance (#24990) · 2506ce51
  Jialin Ouyang authored Sep 19, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  2506ce51
- [CI/Build] fix test function_calling (#25072) · 47fd08aa
  Chauncey authored Sep 20, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  47fd08aa
- Encoder model support for the Transformers backend (#25174) · 12aed7e4
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  12aed7e4
- [Core] Modify the initialization parameters of the lora manager (#25249) · 28219864
  Jee Jee Li authored Sep 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  28219864
- [Frontend] Pass API server count to each process (#23717) · 6c117cff
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6c117cff
- [KV offload][3/N] Add worker-side CPU support (#21448) · 7ac67ea5
  Or Ozeri authored Sep 19, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7ac67ea5
- Move `ModelConfig` from `config/__init__.py` to `config/model.py` (#25252) · aed16879
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aed16879
- [P/D][Nixl] Introduce `KVTransferMetrics` and aggregation strategy (#22188) · a3d087ad
  Nicolò Lucchesi authored Sep 19, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a3d087ad
- Move `PoolerConfig` from `config/__init__.py` to `config/pooler.py` (#25181) · 058525b9
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  058525b9
- [Kernel][Performance] Add Triton kernel for Qwen3-VL interleaved MRoPE (#25055) · cea91a32
  Isotr0py authored Sep 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cea91a32
- [Misc] Cleanup test conftest for deprecated encoder-decoder models (#25231) · f2718d29
  Isotr0py authored Sep 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f2718d29
- [gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent... · 6d8246aa
  Andrew Xia authored Sep 18, 2025
```
[gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent for streaming (#24938)
Signed-off-by: Andrew Xia <axia@meta.com>
```
  6d8246aa
- [KV offload][2/N] Introduce LRU-based CPU offloading management (#20075) · 9d1c50a5
  Or Ozeri authored Sep 19, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  9d1c50a5
- [CORE] Prompt Embeddings Support for v1 Engine (#24278) · 9a4600e4
  Andrew Sansom authored Sep 18, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  9a4600e4
18 Sep, 2025 3 commits
- [KV offload][1b/N] rename offloading to kv_offload (#25191) · a53ad626
  Or Ozeri authored Sep 18, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  a53ad626
- [V0 Deprecation] Remove AsyncLLMEngine (#25025) · e19bce40
  Woosuk Kwon authored Sep 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e19bce40
- [KV offload][1/N] Introduce an offloading component (#19848) · 505805b6
  Or Ozeri authored Sep 18, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  505805b6