Commits · 54631f826233dbd1c046f9a70e98bc2e25edff1a · OpenDAS / vllm_cscc · GitLab

22 May, 2025 21 commits
- [Misc] Call `ndarray.tobytes()` directly instead of `ndarray.data.tobytes()` (#18347) · 54631f82
  Lukas Geiger authored May 22, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  54631f82
- [Misc] improve Automatic Prefix Caching example (#18554) · cb506ecb
  Reid authored May 22, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  cb506ecb
- [BugFix][CPU] Fix x86 SHM distributed module initialization (#18536) · 93f71673
  Li, Jiang authored May 22, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  93f71673
- [Doc] Add stream flag for chat completion example (#18524) · 3f505233
  Calvin Chen authored May 22, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  3f505233
- [Bugfix] Use random hidden states in dummy sampler run (#18543) · 4e04eceb
  Bowen Wang authored May 22, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  4e04eceb
- [Doc] Support --stream arg in openai_completion_client.py script (#18388) · 71075029
  CYJiang authored May 22, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  71075029
- [CI/Build] Update bamba test model location (#18544) · ca86a7cf
  Harry Mellor authored May 22, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ca86a7cf
- [Bugfix] Add kwargs to RequestOutput __init__ to be forward compatible (#18513) · a35a4947
  lkchen authored May 22, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  a35a4947
- [Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18526) · f6037d19
  燃 authored May 22, 2025
```
Co-authored-by: 松灵 <wpf272043@alibaba-inc.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6037d19
- Order sequence ids + config update to support specifying custom quantization layers (#18279) · fa72f9a8
  aws-elaineyz authored May 22, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
Co-authored-by: Tailin Pan <tailinpa@amazon.com>
Co-authored-by: Rishabh Rajesh <rishyraj@amazon.com>
Co-authored-by: Yishan McNabb <yishanm@amazon.com>
Co-authored-by: Patrick Lange <patlange@amazon.com>
Co-authored-by: Maxwell Goldberg <mgld@amazon.com>
Co-authored-by: Aakash Shetty <sheaak@amazon.com>
```
  fa72f9a8
- Update default neuron config for speculation (#18274) · ebed81fb
  aws-elaineyz authored May 22, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
Co-authored-by: Shashwat Srijan <sssrijan@amazon.com>
Co-authored-by: Aakash Shetty <sheaak@amazon.com>
```
  ebed81fb
- [Neuron] Update Dockerfile.neuron to use latest neuron release (2.23) (#18512) · e2d7d312
  Satyajith Chilappagari authored May 22, 2025
```
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
```
  e2d7d312
- [Doc] Fix invalid JSON in example args (#18527) · 23b67b37
  Cyrus Leung authored May 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  23b67b37
- [Bugfix] Fix LoRA test (#18518) · db5a29ba
  Jee Jee Li authored May 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db5a29ba
- [Bugfix][Model] Make Olmo2Model weight loading return loaded weights (#18504) · 51797775
  Shane A authored May 21, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
```
  51797775
- [BugFix][DP] Send DP wave completion only from `dp_rank==0` (#18502) · cf5984b2
  Nick Hill authored May 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: kourosh hakhamaneshi <kourosh@anyscale.com>
```
  cf5984b2
- [Bugfix] Inconsistent token calculation compared to HF in llava family (#18479) · d022115c
  youngrok cha authored May 22, 2025
```
Signed-off-by: jaycha <jaycha@ncsoft.com>
```
  d022115c
- Intialize io_thread_pool attribute in the beginning. (#18331) · acb54ca8
  Rabi Mishra authored May 22, 2025
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  acb54ca8
- [CI] Fix race condition with StatelessProcessGroup.barrier (#18506) · 6e0fd34d
  Russell Bryant authored May 21, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  6e0fd34d
- [MISC] update project urls in pyproject.toml (#18519) · 176d62e4
  Ning Xie authored May 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  176d62e4
- [FalconH1] Fix output dtype in RMSNorm fallback path for Falcon-H1 (e.g. 0.5B) (#18500) · 20bd6f4d
  Dhia Eddine Rhaiem authored May 22, 2025
```
Signed-off-by: dhia.rhaiem <dhia.rhaiem@tii.ae>
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Ilyas Chahed <ilyas.chahed@tii.ae>
Co-authored-by: Jingwei Zuo <jingwei.zuo@tii.ae>
```
  20bd6f4d
21 May, 2025 19 commits
- [Bugfix] Consistent ascii handling in tool parsers (#17704) · 1f079540
  Sebastian Schoennenbeck authored May 21, 2025
```
Signed-off-by: Sebastian Schönnenbeck <sebastian.schoennenbeck@comma-soft.com>
```
  1f079540
- [FEAT][ROCm] Upgrade AITER MLA v1 backend (#18338) · 94d8ec8d
  vllmellm authored May 22, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  94d8ec8d
- Revert "[v1] Support multiple KV cache groups in GPU model runner (#17945) (#18459) · bb0a3112
  Mark McLoughlin authored May 21, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  bb0a3112
- [ROCm][Kernel][V1] Enable AMD Radeon GPU Custom Paged Attention on v1 (#17004) · dd5fa7e0
  Hosang authored May 21, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
  dd5fa7e0
- [Misc] Update deprecation message for `--enable-reasoning` (#18404) · 2b161045
  Hyogeun Oh (오효근) authored May 21, 2025
  
  2b161045
- [Build] fix Dockerfile shell (#18402) · 371376f9
  Kebe authored May 21, 2025
  
  371376f9
- [Bugfix] Reduce moe_sum test size to avoid OOM (#18484) · c6c10ca9
  bnellnm authored May 21, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  c6c10ca9
- [Doc] fix arg docstring in linear layers (#18410) · c154d893
  GiantCroc authored May 21, 2025
```
Signed-off-by: giantcroc <1204449533@qq.com>
```
  c154d893
- [MODEL] FalconH1 (#18406) · eca18691
  Dhia Eddine Rhaiem authored May 21, 2025
```
Signed-off-by: dhia.rhaiem <dhia.rhaiem@tii.ae>
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Ilyas Chahed <ilyas.chahed@tii.ae>
Co-authored-by: Jingwei Zuo <jingwei.zuo@tii.ae>
```
  eca18691
- [Bugfix][Failing Test] Fix test_events.py (#18460) · 61acfc45
  Rabi Mishra authored May 21, 2025
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  61acfc45
- [Misc] refactor disaggregated-prefill-v1 example (#18474) · 107f5fc4
  Reid authored May 21, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  107f5fc4
- [V1] Fix general plugins not loaded in engine for multiproc (#18326) · 907f935d
  Yong Hoon Shin authored May 21, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  907f935d
- [Frontend] deprecate `--device` arg (#18399) · 5d7f5452
  Kebe authored May 21, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  5d7f5452
- [Misc] MultiConnector._connectors type (#18423) · cd8dfc6d
  Nicolò Lucchesi authored May 21, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  cd8dfc6d
- [Bugfix][Failing Test] Fix nixl connector test when promt size < block size (#18429) · d06dd72b
  wwl2755 authored May 21, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  d06dd72b
- Revert "[Bugfix] Fix MRoPE Errors in the Qwen-VL Model When Processing Pure Text (#18407)" (#18456) · ad0012a0
  Cyrus Leung authored May 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad0012a0
- [Bug] Fix moe_sum signature (#18440) · 92247c52
  bnellnm authored May 21, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  92247c52
- [Bugfix] config.head_dim is now explicitly set to None (#18432) · 0c15c2e4
  Gregory Shtrasberg authored May 21, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  0c15c2e4
- [TPU] Re-enable the Pallas MoE kernel (#18025) · 3b17ea26
  Michael Goin authored May 20, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  3b17ea26