Commits · ded1fb635b7c1504a83fc7c195a5bf47d31c1bef · OpenDAS / vllm_cscc · GitLab

30 Jun, 2025 12 commits
- [Bugfix][V1][P/D]Fix the issue of occasional garbled output for P2pNcclConnector (#20263) · ded1fb63
  Zhonghua Deng authored Jul 01, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  ded1fb63
- [Refactor] Remove useless pdb comment (#20266) · 97d9524f
  Wentao Ye authored Jun 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  97d9524f
- [Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058) · d8cf819a
  Kyle Sayers authored Jun 30, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d8cf819a
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc
- [Spec Decode] Refactor spec decoding into a separate function (#20238) · 2062c072
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2062c072
- [Bugfix] fix quark ptpc (#20251) · 1c50e100
  li haoyang authored Jun 30, 2025
```
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: Haoyang Li <307790822@qq.com>
```
  1c50e100
- [Quantization] Improve BitsAndBytesModelLoader (#20242) · 8fe7fc86
  Jee Jee Li authored Jun 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8fe7fc86
- [Bugfix] Fix processor initialization in transformers 4.53.0 (#20244) · e936e401
  Isotr0py authored Jun 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  e936e401
- [Bugfix] Skip loading extra parameters for modelopt Qwen3 MoE model (#19598) · f5dfa075
  noiji authored Jun 30, 2025
```
Signed-off-by: noiji <>
```
  f5dfa075
- [Misc] Fix import (#20233) · 19108ef3
  Woosuk Kwon authored Jun 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  19108ef3
- [BUGFIX][DEEPSEEK][MODEL_LOAD] fix w13, w2 weight not initialized assert (#20202) · 5a52f389
  Chendi.Xue authored Jun 29, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  5a52f389
- [Model] support dots1 (#18254) · 65b1cbb1
  redmoe-moutain authored Jun 30, 2025
```
Signed-off-by: redmoe-moutain <agiredmoe@gmail.com>
```
  65b1cbb1
29 Jun, 2025 1 commit
- [Quantization] Add compressed-tensors NVFP4 MoE Support (#19990) · 6f2f53a8
  Dipika Sikka authored Jun 30, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  6f2f53a8
28 Jun, 2025 7 commits
- [Refactor] Create a function util and cache the results for `has_deepgemm`,... · 4d366936
  Wentao Ye authored Jun 28, 2025
```
[Refactor] Create a function util and cache the results for `has_deepgemm`, `has_deepep`, `has_pplx` (#20187)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4d366936
- [Bugfix] Correct behavior of GraniteMoeHybrid for TensorParallel execution (#20137) · daec9dea
  Stan Wozniak authored Jun 28, 2025
```
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  daec9dea
- [Frontend] Generalize `v1/audio/transcriptions` endpoint (#20179) · daceac57
  Nicolò Lucchesi authored Jun 28, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  daceac57
- [BugFix] Fix the incorrect func name in the comments. (config.py) (#20185) · 7b460c25
  Jiayi Yan authored Jun 28, 2025
  
  7b460c25
- [Bugfix] Properly reject requests with empty list guided_choice (#20195) · f7197722
  Michael Goin authored Jun 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f7197722
- Fix num_token_padding support for static per-tensor scaled_fp8_quant (#20188) · a29e62ea
  Michael Goin authored Jun 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a29e62ea
- [Misc] Add type assertion of request_id for LLMEngine.add_request (#19700) · e53be6f0
  Chales Xu authored Jun 28, 2025
```
Signed-off-by: n2ptr <xuzhanchaomail@163.com>
```
  e53be6f0
27 Jun, 2025 9 commits
- [Bugfix] Mark 'hidden_states' as mutable in moe_forward registration. (#20152) · c6c98305
  bnellnm authored Jun 27, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  c6c98305
- [Fix][torch.compile] Enable custom ops by default when Inductor off (#20102) · aafabaa0
  Luka Govedič authored Jun 27, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  aafabaa0
- [Perf] Improved perf for resolve_chat_template_content_format (#20065) · aa0dc77e
  Ilya Lavrenov authored Jun 27, 2025
```
Signed-off-by: Ilya Lavrenov <ilya.lavrenov@cerebras.net>
```
  aa0dc77e
- [Bugfix] Fix flaky failure when getting DP ports (#20151) · 4ab3ac28
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4ab3ac28
- Gemma3n (Text-only) (#20134) · d1c956dc
  Robert Shaw authored Jun 27, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  d1c956dc
- Quick Fix by adding conditional import for flash_attn_varlen_func in flash_attn (#20143) · dec197e3
  Chendi.Xue authored Jun 27, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  dec197e3
- [Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946) · 6e244ae0
  Yazan Sharaya authored Jun 27, 2025
```
Signed-off-by: Yazan-Sharaya <yazan.sharaya.yes@gmail.com>
```
  6e244ae0
- [Model][1/N] Automatic conversion of CrossEncoding model (#20012) · cd4cfee6
  wang.yuqi authored Jun 27, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  cd4cfee6
- [Feature] add quick all reduce (#19744) · 0740e29b
  li haoyang authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  0740e29b
26 Jun, 2025 11 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- [TPU] add kv cache update kernel (#19928) · 04e1642e
  Chengji Yao authored Jun 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  04e1642e
- [Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) · b69781f1
  Kunshang Ji authored Jun 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b69781f1
- [Bug Fix] Fix address/port already in use error for deep_ep test (#20094) · c894c5dc
  Wentao Ye authored Jun 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c894c5dc
- Revert "[Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine" (#20128) · 1f5d178e
  Michael Goin authored Jun 26, 2025
  
  1f5d178e
- [Bugfix][V1][ROCm] Fix AITER Flash Attention Backend (Fix API Break and Local... · 27c065df
  TJian authored Jun 26, 2025
```
[Bugfix][V1][ROCm] Fix AITER Flash Attention Backend (Fix API Break and Local Attention Logic: affecting Llama4) (#19904)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  27c065df
- [CPU] Fix torch version in x86 CPU backend (#19258) · 0567c824
  Li, Jiang authored Jun 26, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0567c824
- [Refactor] Remove unused library (#20099) · d188913d
  Wentao Ye authored Jun 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d188913d
- [Bugfix] Allow `CUDA_VISIBLE_DEVICES=''` in `Platform.device_id_to_physical_device_id` (#18979) · 65397e40
  Seiji Eicher authored Jun 26, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  65397e40
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
- [PD] Skip `tp_size` exchange with rank0 (#19413) · 25826835
  Nicolò Lucchesi authored Jun 26, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  25826835