Commits · 135cf55cd1d83cd4e18266e343a59e6d9f87856f · OpenDAS / vllm_cscc

"vllm/executor/ray_distributed_executor.py" did not exist on "d619ae2d19c41d9aa8f68fa0e5e32cc410dc2522"

03 Jun, 2025 32 commits
- [V1][Spec Decode][Ngram] 1.35x gain -> 1.95x gain on InstructCoder with prompt fix (#18971) · 135cf55c
  Ekagra Ranjan authored Jun 03, 2025
  
  135cf55c
- [v1] Re-init input batch for multiple kv cache groups (#18654) · 6cac54f4
  Chen Zhang authored Jun 04, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6cac54f4
- Fix interaction between `Optional` and `Annotated` in CLI typing (#19093) · 6865fe00
  Harry Mellor authored Jun 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Yikun Jiang <yikun@apache.org>
```
  6865fe00
- [Perf] Tune `scaled_fp8_quant` by increasing vectorization (#18844) · e31446b6
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e31446b6
- [V1] Support cross-layer KV sharing (#18212) · bdf13965
  Yong Hoon Shin authored Jun 03, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  bdf13965
- [Kernel] DeepEP dispatch-combine kernel integration (#18434) · fa98d777
  Varun Sundar Rabindranath authored Jun 03, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fa98d777
- [doc] update docker version (#19074) · 01eee405
  Reid authored Jun 04, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  01eee405
- [Doc] Readme standardization (#18695) · 19bdaf32
  SorenDreano authored Jun 03, 2025
```
Co-authored-by: Soren Dreano <soren@numind.ai>
```
  19bdaf32
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Misc] fix: add miss best_of param validation (#18555) · d054da19
  CYJiang authored Jun 04, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  d054da19
- [Misc] Add missing `_Backend` enums (#19081) · 4b7817c1
  Nicolò Lucchesi authored Jun 03, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  4b7817c1
- [Doc] Improve the Pull Request template with key components (#19086) · d00dd65c
  Lu Fang authored Jun 03, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  d00dd65c
- [Bugfix] disable processor cache (#19068) · d81edded
  Raushan Turganbay authored Jun 03, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  d81edded
- Fix underscores in dict keys passed via CLI (#19030) · 476844d4
  Harry Mellor authored Jun 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  476844d4
- [CI/Build] Remove V0 LoRA test (#19066) · 4e68ae5e
  Jee Jee Li authored Jun 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4e68ae5e
- [doc] clarify windows support (#19088) · 4e88723f
  youkaichao authored Jun 03, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4e88723f
- [Doc] Update V1 user guide for embedding and enc-dec models (#19060) · 118ff921
  Cyrus Leung authored Jun 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  118ff921
- [Misc] Update `WeightsMapper` for qwen2-vl/qwen2.5-vl (#19054) · ec2dcd80
  Isotr0py authored Jun 03, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ec2dcd80
- [Doc] Add InternVL LoRA support (#19055) · 42243fbd
  Jee Jee Li authored Jun 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  42243fbd
- Update docker docs with ARM CUDA cross-compile (#19037) · 6d18ed2a
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  6d18ed2a
- [v1][KVCacheManager] Rename BlockHashType to BlockHash (#19015) · f32fcd94
  Chen Zhang authored Jun 03, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  f32fcd94
- [Bugfix] Use cmake 3.26.1 instead of 3.26 to avoid build failure (#19019) · d32aa2e6
  Lu Fang authored Jun 03, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  d32aa2e6
- Reduce logs in CLI scripts and plugin loader (#18970) · cc977286
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cc977286
- [bugfix] small fix logic issue (#18999) · 17430e36
  Reid authored Jun 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  17430e36
- Add tarsier model support (#18985) · 1282bd81
  汪志鹏 authored Jun 03, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  1282bd81
- [V1] Support DP with Ray (#18779) · bdce64f2
  Rui Qiao authored Jun 02, 2025
  
  bdce64f2
- [ROCm][Build] Clean up the ROCm build (#19040) · 9e6f61e8
  Gregory Shtrasberg authored Jun 02, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  9e6f61e8
- [CPU][CI] Re-enable the CPU CI tests (#19046) · 8655f47f
  Li, Jiang authored Jun 03, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  8655f47f
- Adding "LoRA Test %N" to AMD production tests (#18929) · 4ce42f92
  Concurrensee authored Jun 02, 2025
```
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
```
  4ce42f92
- [Bugfix][EP+DP] Use pplx-kernel internode instead of intranode (#19034) · 8a57872b
  Tyler Michael Smith authored Jun 02, 2025
```
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8a57872b
- [Doc] Remove duplicate TOCs during MkDocs migration (#19021) · 5bc1ad6c
  Hyogeun Oh (오효근) authored Jun 03, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  5bc1ad6c
- [Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) · 9112b443
  Siyuan Liu authored Jun 02, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  9112b443
02 Jun, 2025 7 commits
- add an absolute path for run.sh (#18258) · c57d577e
  Calvin Chen authored Jun 03, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  c57d577e
- [Bugfix][Model] Attempt to fix eagle in V0. (#18978) · ca2f6b9c
  Gregory Shtrasberg authored Jun 02, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  ca2f6b9c
- [Frontend] enable custom logging for the uvicorn server (OpenAI API server) (#18403) · 20133cfe
  Frαnçois authored Jun 02, 2025
```
Signed-off-by: François Paupier <francois.paupier@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  20133cfe
- [Model] enable data parallel for Llama4 vision encoder (#18368) · ebb1ec93
  jennyyyyzhen authored Jun 02, 2025
```
Signed-off-by: yzhen <yzhen@devgpu093.cco2.facebook.com>
Co-authored-by: yZhen <yZhen@fb.com>
Co-authored-by: yzhen <yzhen@devgpu093.cco2.facebook.com>
```
  ebb1ec93
- [doc] add pytest tips (#19010) · 5b168b6d
  Reid authored Jun 02, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  5b168b6d
- [Core] Support inplace model weights loading (#18745) · 9760fd8f
  22quinn authored Jun 02, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  9760fd8f
- [Bugfix][Nixl] Fix DP Metadata Handshake (#19008) · b9f61e13
  Robert Shaw authored Jun 01, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  b9f61e13
01 Jun, 2025 1 commit

[Misc] reuse num_tokens_across_dp of get_dp_padding to avoid unnecessary dp... · d6fd3a33

zhrrr authored Jun 02, 2025


[Misc] reuse num_tokens_across_dp of get_dp_padding to avoid unnecessary dp all reduce in set_forward_context (#18935)
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>

d6fd3a33