Commits · d0dc4cfca48c2734da18ec42d6bba1346cbfc400 · OpenDAS / vllm_cscc · GitLab

16 Jul, 2025 6 commits
- Fix inadvertently silenced PP tests for `mp`, add DeepSeek V2/V3 model family to PP tests (#20831) · d0dc4cfc
  Seiji Eicher authored Jul 16, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  d0dc4cfc
- [Meta] Llama4 EAGLE Support (#20591) · c11013db
  zhiweiz authored Jul 15, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>
```
  c11013db
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
- Avoid direct comparison of floating point numbers (#21002) · 6ebf3137
  Maximilien de Bayser authored Jul 16, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  6ebf3137
- [Voxtral] Add more tests (#21010) · cfbcb9ed
  Patrick von Platen authored Jul 16, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  cfbcb9ed
- [Frontend] OpenAI Responses API supports input image (#20975) · 34cda778
  Chauncey authored Jul 16, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  34cda778
15 Jul, 2025 9 commits
- [Deprecation] Remove `nullable_kvs` (#20969) · 1e36c868
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1e36c868
- Voxtral (#20970) · e7e3e6d2
  Patrick von Platen authored Jul 15, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e7e3e6d2
- [Deprecation] Remove `TokenizerPoolConfig` (#20968) · 56fe4bed
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  56fe4bed
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
- [Misc] Refactor AllReduceFusionPass. Remove parameter (#20918) · 37a7d5d7
  Ilya Markov authored Jul 15, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  37a7d5d7
- Implement Async Scheduling (#19970) · d4d30940
  Woosuk Kwon authored Jul 14, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d4d30940
- [CI] Fix flaky `test_streaming_response` test (#20913) · 80305c1b
  Nicolò Lucchesi authored Jul 15, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  80305c1b
- Use w8a8 quantized matmul Pallas kernel (#19170) · d4170fad
  XiongfeiWei authored Jul 14, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  d4170fad
- [BugFix] VLLM_DISABLE_COMPILE_CACHE=1 should disable all reads and writes from the cache (#20942) · ba8c3000
  Richard Zou authored Jul 14, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ba8c3000
14 Jul, 2025 6 commits
- [Misc] Relax translations tests (#20856) · 149f2435
  Nicolò Lucchesi authored Jul 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  149f2435
- [Model] Add Ling implementation (#20680) · 38efa282
  ant-yy authored Jul 14, 2025
```
Signed-off-by: vito.yy <vito.yy@antgroup.com>
```
  38efa282
- [CI/Build] Fix OOM issue in Jina-VL test (#20907) · dcf2a5e2
  Cyrus Leung authored Jul 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcf2a5e2
- [MISC] Move bind_kv_cache to worker module (#20900) · 1e9438e0
  wangxiyuan authored Jul 14, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  1e9438e0
- [Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) · 66f6fbd3
  Maroon Ayoub authored Jul 14, 2025
```
Signed-off-by: Maroon Ayoub <maroon.ayoub@ibm.com>
```
  66f6fbd3
- [Core] Add `update_config` RPC method (#20095) · 8632e831
  22quinn authored Jul 13, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  8632e831
13 Jul, 2025 5 commits
- Support for LlamaForSequenceClassification (#20807) · bd4c1e6f
  Minkyu Kim authored Jul 13, 2025
```
Signed-off-by: thechaos16 <thechaos16@gmail.com>
```
  bd4c1e6f
- Renable google/gemma-3-1b-it accuracy test. (#20866) · 99b4f080
  QiliangCui authored Jul 12, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  99b4f080
- [Core] Support multiple tasks per model (#20771) · 020f58ab
  Nicolò Lucchesi authored Jul 13, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  020f58ab
- [Refactor] Change the way of import triton (#20774) · c1acd6d7
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c1acd6d7
- [Perf] Use Triton instead of Torch for DeepGEMM Per Token Group Quant (#20841) · 42d440c2
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  42d440c2
12 Jul, 2025 7 commits
- [Sched] Enhance the logic to remove stopped requests from queues (#20739) · f45a3328
  Woosuk Kwon authored Jul 12, 2025
  
  f45a3328
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
- [Bugfix] Replace unavailable video url in multimodal test (#20854) · 147afb44
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  147afb44
- [CI/Build] Ensure compatability with Transformers v4.53 (#20541) · 01cae377
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  01cae377
- [Bugfix] Fix tensor parallel issue in Qwen3 reranker weight loading (#20682) · 11c01986
  yurhett authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  11c01986
- Add pynccl all-gatherv and reducescatterv (#20154) · a8593237
  Trevor Morris authored Jul 11, 2025
```
Signed-off-by: Trevor Morris <tmorris@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  a8593237
- Integration SM100 FlashInfer fused allreduce RMSNorm (#20691) · fc0f41d1
  Ilya Markov authored Jul 12, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  fc0f41d1
11 Jul, 2025 7 commits
- Update kimi-k2 tool calling docs, enable unit tests (#20821) · 5f0af36a
  bigmoyan authored Jul 12, 2025
```
Signed-off-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  5f0af36a
- [Bugfix] Fix OOM in language generation test (#20814) · 0d21b266
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0d21b266
- [Misc] Add unit tests for MoE ModularKernel combinations + Profiling utility (#20449) · 53fa4573
  Varun Sundar Rabindranath authored Jul 11, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  53fa4573
- Temporarily suspend google/gemma-3-1b-it. (#20722) · b4f0b5f9
  QiliangCui authored Jul 11, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  b4f0b5f9
- [Bugfix] Refactor `/invocations` to be task-agnostic (#20764) · cbd14ed5
  Cyrus Leung authored Jul 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd14ed5
- [Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). (#19825) · 7bd4c37a
  Pavani Majety authored Jul 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7bd4c37a
- [Quantization][1/N] MoE support BNB-Inflight Quantization (#20061) · 8020e98c
  Jee Jee Li authored Jul 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8020e98c