Commits · 946aadb4a0e07bf735b0f0145230c59002dc5089 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "c866e0079de05cf6aee5931f3b9e200e8cbcf26c"

15 Jul, 2025 4 commits
- [CI/Build] Split Entrypoints Test into LLM and API Server (#20945) · 946aadb4
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  946aadb4
- [Bugfix] Fix incorrect dispatch for CutlassBlockScaledGroupedGemm and DeepGEMM (#20933) · bcdfb2a3
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bcdfb2a3
- [BugFix] VLLM_DISABLE_COMPILE_CACHE=1 should disable all reads and writes from the cache (#20942) · ba8c3000
  Richard Zou authored Jul 14, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ba8c3000
- SM100 Cutlass MLA decode with unrestricted num_heads (< 128) for DeepSeek TP (#20769) · 8cdc3712
  Alexander Matveev authored Jul 14, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  8cdc3712
14 Jul, 2025 25 commits
- Fall back if flashinfer comm module not found (#20936) · 61e20828
  Yong Hoon Shin authored Jul 14, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  61e20828
- [Docs] remove outdated performance benchmark (#20935) · 55e1c66d
  Kuntai Du authored Jul 14, 2025
```
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  55e1c66d
- Fix overflow indexing in causal_conv1d kernel (#20938) · 86f3ac21
  Thomas Parnell authored Jul 14, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  86f3ac21
- [Misc] Relax translations tests (#20856) · 149f2435
  Nicolò Lucchesi authored Jul 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  149f2435
- [Misc] ModularKernel : Perform WeightAndReduce inside TritonExperts & DeepGemmExperts (#20725) · c0569dbc
  Varun Sundar Rabindranath authored Jul 15, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  c0569dbc
- Add benchmark dataset for mlperf llama tasks (#20338) · 8bb43b9c
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8bb43b9c
- Change default model to Qwen3-0.6B (#20335) · 55975621
  Tyler Michael Smith authored Jul 14, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  55975621
- [CI/Build] Add Transformers nightly tests in CI (#20924) · 6d0cf239
  Isotr0py authored Jul 15, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  6d0cf239
- [Misc] Clean up Aimv2 config registration in Ovis config (#20921) · 3fc96443
  Isotr0py authored Jul 14, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  3fc96443
- [CI] Update codeowner for compilation code (#20929) · 0caf61c0
  Lu Fang authored Jul 14, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  0caf61c0
- [CI] cc folks on changes to vllm/compilation (#20925) · 66762465
  Richard Zou authored Jul 14, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  66762465
- [Model] Add Ling implementation (#20680) · 38efa282
  ant-yy authored Jul 14, 2025
```
Signed-off-by: vito.yy <vito.yy@antgroup.com>
```
  38efa282
- [Misc] Log the reason for falling back to FlexAttention (#20699) · e8cc53af
  Cyrus Leung authored Jul 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e8cc53af
- [Bugfix]: Fix messy code when using logprobs (#20910) · a4851cfe
  Chauncey authored Jul 14, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  a4851cfe
- [Misc] Remove unused function (#20909) · 9887e8ec
  Reid authored Jul 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  9887e8ec
- [Bugfix] Bump up mistral_common to support v13 tokenizer (#20905) · f326ab9c
  22quinn authored Jul 14, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  f326ab9c
- [CI/Build] Fix OOM issue in Jina-VL test (#20907) · dcf2a5e2
  Cyrus Leung authored Jul 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcf2a5e2
- [MISC] Move bind_kv_cache to worker module (#20900) · 1e9438e0
  wangxiyuan authored Jul 14, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  1e9438e0
- [Refactor][V1] Move outlines utils for V1 imports (#20878) · 697ef765
  Aaron Pham authored Jul 14, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  697ef765
- [Quantization] add BNB for MixtralForCausalLM (#20893) · a99b9f7d
  Jee Jee Li authored Jul 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a99b9f7d
- [ROCm] [Bugfix] [Critical]: Fix mamba compilation bug (#20883) · c488b928
  TJian authored Jul 14, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  c488b928
- Fix: Add missing EOFError handling in CLI complete command (#20896) · 2c7fa471
  Reid authored Jul 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  2c7fa471
- Removing redundant python version check (#20888) · 88fc8a97
  Daniel song authored Jul 14, 2025
```
Signed-off-by: Dannyso05 <dansong1177@gmail.com>
```
  88fc8a97
- [Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) · 66f6fbd3
  Maroon Ayoub authored Jul 14, 2025
```
Signed-off-by: Maroon Ayoub <maroon.ayoub@ibm.com>
```
  66f6fbd3
- [Core] Add `update_config` RPC method (#20095) · 8632e831
  22quinn authored Jul 13, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  8632e831
13 Jul, 2025 10 commits
- [V1] Hybrid allocator without prefix caching (#20661) · 4bbfc36b
  nopperl authored Jul 14, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  4bbfc36b
- [V1] [ROCm] [AITER] Upgrade AITER to commit `916bf3c` and bugfix APIs (#20880) · 80d38b8a
  TJian authored Jul 13, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  80d38b8a
- [Bugfix] fix define of RerankDocument (#20877) · 211b6a61
  Liuchenlong authored Jul 13, 2025
```
Signed-off-by: liuchenlong <liuchenlong@xiaohongshu.com>
Co-authored-by: liuchenlong <liuchenlong@xiaohongshu.com>
```
  211b6a61
- [Bugfix] Fix: add patch_rope_scaling after hf override (#20857) · 247102f0
  Wang Siyuan authored Jul 13, 2025
```
Signed-off-by: Wang Siyuan <wsy0227@sjtu.edu.cn>
Signed-off-by: Wang Siyuan <sywang0227@gmail.com>
```
  247102f0
- Support for LlamaForSequenceClassification (#20807) · bd4c1e6f
  Minkyu Kim authored Jul 13, 2025
```
Signed-off-by: thechaos16 <thechaos16@gmail.com>
```
  bd4c1e6f
- Renable google/gemma-3-1b-it accuracy test. (#20866) · 99b4f080
  QiliangCui authored Jul 12, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  99b4f080
- [Core] Support multiple tasks per model (#20771) · 020f58ab
  Nicolò Lucchesi authored Jul 13, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  020f58ab
- [Refactor] Change the way of import triton (#20774) · c1acd6d7
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c1acd6d7
- [Bugfix] Fix a couple PPLX+CUTLASS MoE bugs (#20825) · 3b3b778d
  ElizaWszola authored Jul 13, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  3b3b778d
- [Perf] Use Triton instead of Torch for DeepGEMM Per Token Group Quant (#20841) · 42d440c2
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  42d440c2
12 Jul, 2025 1 commit
- [Sched] Enhance the logic to remove stopped requests from queues (#20739) · f45a3328
  Woosuk Kwon authored Jul 12, 2025
  
  f45a3328