Commits · 41aa5784287f00b026f3ba225ac18ab3caccc622 · OpenDAS / vllm_cscc · GitLab

04 Jun, 2025 9 commits
- [NVIDIA] Add Cutlass MLA backend (#17625) · 41aa5784
  Kaixi Hou authored Jun 04, 2025
  
  41aa5784
- [Cleanup][v1]:remote guided-decoding-backend for example (#19059) · 8d646c2e
  Calvin Chen authored Jun 04, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  8d646c2e
- [KERNEL] Sampler. CUDA kernel for applying repetition penalty (#18437) · 5d6d1adf
  Vadim Gimpelson authored Jun 04, 2025
  
  5d6d1adf
- [Core] Cast multimodal input in hf processor (#18862) · 1409ef91
  Lukas Geiger authored Jun 04, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  1409ef91
- [CPU] V1 support for the CPU backend (#16441) · 4555143e
  Li, Jiang authored Jun 04, 2025
  
  4555143e
- [Docs] Add developer doc about CI failures (#18782) · 52dceb17
  Russell Bryant authored Jun 03, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  52dceb17
- [Misc] Fix path and python alias errors in disagg_prefill exmaples (#18919) · abd7df2f
  Jiaxin Shan authored Jun 03, 2025
  
  abd7df2f
- feat: add data parallel rank to KVEventBatch (#18925) · b712be98
  Yan Ru Pei authored Jun 03, 2025
  
  b712be98
- [Bugfix] Max concurrency estimation and check_enough_kv_cache_memory for... · a8da78ea
  Chen Zhang authored Jun 04, 2025
```
[Bugfix] Max concurrency estimation and check_enough_kv_cache_memory for models with sliding window layers (#19029)
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  a8da78ea
03 Jun, 2025 31 commits
- [Bugfix][P/D] Fix Prefix Cache Bug (#18411) · 5d96533e
  Nicolò Lucchesi authored Jun 04, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  5d96533e
- [Bugfix]: Fix the incompatibility issue with tool_choice 'required' when... · 4de790fc
  Chauncey authored Jun 04, 2025
```
[Bugfix]: Fix the incompatibility issue with tool_choice 'required' when Thinking is enabled (#19075)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4de790fc
- [Bugfix] get_num_blocks_to_allocate with null_block (#19031) · b5fd9506
  Chen Zhang authored Jun 04, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  b5fd9506
- [V1][Spec Decode][Ngram] 1.35x gain -> 1.95x gain on InstructCoder with prompt fix (#18971) · 135cf55c
  Ekagra Ranjan authored Jun 03, 2025
  
  135cf55c
- [v1] Re-init input batch for multiple kv cache groups (#18654) · 6cac54f4
  Chen Zhang authored Jun 04, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6cac54f4
- Fix interaction between `Optional` and `Annotated` in CLI typing (#19093) · 6865fe00
  Harry Mellor authored Jun 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Yikun Jiang <yikun@apache.org>
```
  6865fe00
- [Perf] Tune `scaled_fp8_quant` by increasing vectorization (#18844) · e31446b6
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e31446b6
- [V1] Support cross-layer KV sharing (#18212) · bdf13965
  Yong Hoon Shin authored Jun 03, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  bdf13965
- [Kernel] DeepEP dispatch-combine kernel integration (#18434) · fa98d777
  Varun Sundar Rabindranath authored Jun 03, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fa98d777
- [doc] update docker version (#19074) · 01eee405
  Reid authored Jun 04, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  01eee405
- [Doc] Readme standardization (#18695) · 19bdaf32
  SorenDreano authored Jun 03, 2025
```
Co-authored-by: Soren Dreano <soren@numind.ai>
```
  19bdaf32
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Misc] fix: add miss best_of param validation (#18555) · d054da19
  CYJiang authored Jun 04, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  d054da19
- [Misc] Add missing `_Backend` enums (#19081) · 4b7817c1
  Nicolò Lucchesi authored Jun 03, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  4b7817c1
- [Doc] Improve the Pull Request template with key components (#19086) · d00dd65c
  Lu Fang authored Jun 03, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  d00dd65c
- [Bugfix] disable processor cache (#19068) · d81edded
  Raushan Turganbay authored Jun 03, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  d81edded
- Fix underscores in dict keys passed via CLI (#19030) · 476844d4
  Harry Mellor authored Jun 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  476844d4
- [CI/Build] Remove V0 LoRA test (#19066) · 4e68ae5e
  Jee Jee Li authored Jun 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4e68ae5e
- [doc] clarify windows support (#19088) · 4e88723f
  youkaichao authored Jun 03, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4e88723f
- [Doc] Update V1 user guide for embedding and enc-dec models (#19060) · 118ff921
  Cyrus Leung authored Jun 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  118ff921
- [Misc] Update `WeightsMapper` for qwen2-vl/qwen2.5-vl (#19054) · ec2dcd80
  Isotr0py authored Jun 03, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ec2dcd80
- [Doc] Add InternVL LoRA support (#19055) · 42243fbd
  Jee Jee Li authored Jun 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  42243fbd
- Update docker docs with ARM CUDA cross-compile (#19037) · 6d18ed2a
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  6d18ed2a
- [v1][KVCacheManager] Rename BlockHashType to BlockHash (#19015) · f32fcd94
  Chen Zhang authored Jun 03, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  f32fcd94
- [Bugfix] Use cmake 3.26.1 instead of 3.26 to avoid build failure (#19019) · d32aa2e6
  Lu Fang authored Jun 03, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  d32aa2e6
- Reduce logs in CLI scripts and plugin loader (#18970) · cc977286
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cc977286
- [bugfix] small fix logic issue (#18999) · 17430e36
  Reid authored Jun 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  17430e36
- Add tarsier model support (#18985) · 1282bd81
  汪志鹏 authored Jun 03, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  1282bd81
- [V1] Support DP with Ray (#18779) · bdce64f2
  Rui Qiao authored Jun 02, 2025
  
  bdce64f2
- [ROCm][Build] Clean up the ROCm build (#19040) · 9e6f61e8
  Gregory Shtrasberg authored Jun 02, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  9e6f61e8
- [CPU][CI] Re-enable the CPU CI tests (#19046) · 8655f47f
  Li, Jiang authored Jun 03, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  8655f47f