Commits · dec197e3e5d14e1d4fbad61b565e151f52976c0f · OpenDAS / vllm_cscc · GitLab

27 Jun, 2025 10 commits
- Quick Fix by adding conditional import for flash_attn_varlen_func in flash_attn (#20143) · dec197e3
  Chendi.Xue authored Jun 27, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  dec197e3
- [Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946) · 6e244ae0
  Yazan Sharaya authored Jun 27, 2025
```
Signed-off-by: Yazan-Sharaya <yazan.sharaya.yes@gmail.com>
```
  6e244ae0
- [Model][1/N] Automatic conversion of CrossEncoding model (#20012) · cd4cfee6
  wang.yuqi authored Jun 27, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  cd4cfee6
- [Fix] Fix gemma CI test failing on main (#20124) · e1109306
  Thomas Parnell authored Jun 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  e1109306
- [CI] Sync test dependency with test.in for torch nightly (#19632) · 8b64c895
  Yang Wang authored Jun 26, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  8b64c895
- [Feature] add quick all reduce (#19744) · 0740e29b
  li haoyang authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  0740e29b
- [Bugfix] Build moe_data for both sm100 and sm90 (#20086) · 44d2e6af
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  44d2e6af
- [Perf] SM100 FP8 GEMM Optimizations after cutlass_profiler (#20071) · 2d7779f8
  Ilya Markov authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  2d7779f8
- [Quantization] Bump to use latest `compressed-tensors` (#20033) · a57d57fa
  Dipika Sikka authored Jun 26, 2025
```
Signed-off-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
```
  a57d57fa
- [CI Failure] Fix OOM with test_oot_registration_embedding (#20144) · 71799fd0
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  71799fd0
26 Jun, 2025 21 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- [Doc] correct LoRA capitalization (#20135) · 07b8fae2
  Kyle Yu authored Jun 26, 2025
```
Signed-off-by: kyolebu <kyu@redhat.com>
```
  07b8fae2
- [Refactor] Rename commnication utils (#20091) · 56230881
  Wentao Ye authored Jun 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  56230881
- [TPU] add kv cache update kernel (#19928) · 04e1642e
  Chengji Yao authored Jun 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  04e1642e
- [Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) · b69781f1
  Kunshang Ji authored Jun 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b69781f1
- Spam folks if config.py changes (#20131) · 0bceac98
  Tyler Michael Smith authored Jun 26, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  0bceac98
- [Doc] Rename page titles (#20130) · 34878a0b
  Cyrus Leung authored Jun 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34878a0b
- [Doc] Auto sign-off for VSCode (#20132) · 6393b039
  Cyrus Leung authored Jun 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6393b039
- [Doc] Automatically signed-off by PyCharm (#20120) · 0907d507
  wang.yuqi authored Jun 26, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  0907d507
- [Bug Fix] Fix address/port already in use error for deep_ep test (#20094) · c894c5dc
  Wentao Ye authored Jun 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c894c5dc
- Revert "[Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine" (#20128) · 1f5d178e
  Michael Goin authored Jun 26, 2025
  
  1f5d178e
- [Bugfix][V1][ROCm] Fix AITER Flash Attention Backend (Fix API Break and Local... · 27c065df
  TJian authored Jun 26, 2025
```
[Bugfix][V1][ROCm] Fix AITER Flash Attention Backend (Fix API Break and Local Attention Logic: affecting Llama4) (#19904)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  27c065df
- [Docs] Improve frameworks/helm.md (#20113) · 84c260ca
  Michael Yao authored Jun 26, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  84c260ca
- [Misc] Use collapsible blocks for benchmark examples. (#20017) · 167aca45
  Reid authored Jun 26, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  167aca45
- [CPU] Fix torch version in x86 CPU backend (#19258) · 0567c824
  Li, Jiang authored Jun 26, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0567c824
- [Refactor] Remove unused library (#20099) · d188913d
  Wentao Ye authored Jun 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d188913d
- [Doc] Update docs for New Model Implementation (#20115) · 1d7c29f5
  Cyrus Leung authored Jun 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1d7c29f5
- [Bugfix] Allow `CUDA_VISIBLE_DEVICES=''` in `Platform.device_id_to_physical_device_id` (#18979) · 65397e40
  Seiji Eicher authored Jun 26, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  65397e40
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
- [PD] Skip `tp_size` exchange with rank0 (#19413) · 25826835
  Nicolò Lucchesi authored Jun 26, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  25826835
- [Bugfix] Fix Mistral tool-parser regex for nested JSON (#20093) · 754b00ed
  Michael Goin authored Jun 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  754b00ed
25 Jun, 2025 9 commits
- [CI] Add SM120 to the Dockerfile (#19794) · 296ce95d
  Michael Goin authored Jun 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  296ce95d
- [TPU] Add TPU specific var VLLM_TPU_MOST_MODEL_LEN (#19919) · 2d7620c3
  Chenyaaang authored Jun 25, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  2d7620c3
- [P/D] Avoid stranding blocks in P when aborted in D's waiting queue (#19223) · 55c65ab4
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  55c65ab4
- [TPU][Bugfix] fix kv cache padding (#20048) · 2cc20699
  Chengji Yao authored Jun 25, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  2cc20699
- [Bugfix] default set cuda_graph_sizes to max_num_seqs for v1 engine (#20062) · 9f0608fc
  zhrrr authored Jun 26, 2025
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  9f0608fc
- Fix the path to the testing script. (#20082) · 4e0db57f
  QiliangCui authored Jun 25, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  4e0db57f
- [Misc] Add parallel state `node_count` function (#20045) · c40692bf
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c40692bf
- [PD] let toy proxy handle /chat/completions (#19730) · 4734704b
  lkchen authored Jun 25, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  4734704b
- static_scaled_fp8_quant should not run when scale.numel is not 1 (#20076) · 8b8c209e
  Eldar Kurtić authored Jun 25, 2025
  
  8b8c209e