Commits · e6e3c55ef28f30bca855399419c61bb70af03db2 · OpenDAS / vllm_cscc · GitLab

31 Mar, 2025 17 commits
- Move dockerfiles into their own directory (#14549) · e6e3c55e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6e3c55e
- [V1][Core] Remove unused speculative config from scheduler (#15818) · f98a4920
  Mark McLoughlin authored Mar 31, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  f98a4920
- Fix Transformers backend compatibility check (#15290) · d4bfc23e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d4bfc23e
- [V1] TPU CI - Add basic perf regression test (#15414) · 9a2160fa
  Alexander Matveev authored Mar 31, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  9a2160fa
- fix: change GB to GiB in logging close #14979 (#15807) · 2de41182
  yihong authored Apr 01, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  2de41182
- [V1][Spec Decode] Remove deprecated spec decode config params (#15466) · 239b7bef
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  239b7bef
- [Bugfix] Check dimensions of multimodal embeddings in V1 (#15816) · 09e974d4
  Cyrus Leung authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09e974d4
- Upgrade `transformers` to `v4.50.3` (#13905) · e5ef4fa9
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e5ef4fa9
- [Bugfix] Fix missing return value in load_weights method of adapters.py (#15542) · 037bcd94
  Mrm authored Mar 31, 2025
```
Signed-off-by: noc-turne <2270929247@qq.com>
```
  037bcd94
- [Bugfix] Fix Crashing When Loading Modules With Batchnorm Stats (#15813) · c2e7507a
  Alex Brooks authored Mar 31, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  c2e7507a
- [Model] Update support for NemotronNAS models (#15008) · 3aa2b6a6
  Naveassaf authored Mar 31, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  3aa2b6a6
- [V1] Fully Transparent Implementation of CPU Offloading (#15354) · 555aa219
  youkaichao authored Mar 31, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  555aa219
- fix: better install requirement for install in setup.py (#15796) · e7ae3bf3
  yihong authored Mar 31, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  e7ae3bf3
- Recommend developing with Python 3.12 in developer guide (#15811) · b932c048
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b932c048
- [Feature][ROCm]Enable fusion pass for torch.compile on ROCm (#15050) · e8582945
  Charlie Fu authored Mar 31, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  e8582945
- [Benchmark] Update Vision Arena Dataset and HuggingFaceDataset Setup (#15748) · effc5d24
  Jennifer Zhao authored Mar 31, 2025
```
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
```
  effc5d24
- [Misc] update the comments (#15780) · 18ed3132
  Chengyang LIU authored Mar 30, 2025
```
Signed-off-by: chengyang liu <lcy4869@gmail.com>
Co-authored-by: chengyang liu <lcy4869@gmail.com>
```
  18ed3132
30 Mar, 2025 9 commits
- [V1][Scheduler] Avoid calling `_try_schedule_encoder_inputs` for every request (#15778) · 9b459eca
  Woosuk Kwon authored Mar 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9b459eca
- fix: Comments to English for better dev experience (#15768) · 70fedd0f
  yihong authored Mar 31, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  70fedd0f
- [Bugfix] Added `embed_is_patch` mask for fuyu model (#15731) · bb103b29
  kYLe authored Mar 30, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
```
  bb103b29
- fix: lint fix a ruff checkout syntax error (#15767) · 248e76c4
  yihong authored Mar 30, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  248e76c4
- [V1] Override `mm_counts` for dummy data creation (#15703) · 803d5c35
  Cyrus Leung authored Mar 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  803d5c35
- fix test_phi3v (#15321) · 7fd8c0f8
  pansicheng authored Mar 30, 2025
```
Signed-off-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  7fd8c0f8
- [doc] update conda to usage link in installation (#15761) · 44c3a5ab
  Reid authored Mar 30, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  44c3a5ab
- [Bugfix] Fix Mistral guided generation using xgrammar (#15704) · 6909a762
  Julien Denize authored Mar 30, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6909a762
- [CI] xgrammar structured output supports Enum. (#15757) · 04553371
  Chauncey authored Mar 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  04553371
29 Mar, 2025 14 commits
- [Bugfix] Fix Mllama interleaved images input support (#15564) · 3c0ff914
  Isotr0py authored Mar 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  3c0ff914
- [V1][Minor] Simplify rejection sampler's parse_output (#15741) · 2bc4be4e
  Woosuk Kwon authored Mar 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2bc4be4e
- [V1] Support interleaved modality items (#15605) · c67abd61
  Roger Wang authored Mar 29, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  c67abd61
- [Feature][Disaggregated] Support XpYd disaggregated prefill with MooncakeStore (#12957) · 6fa7cd3d
  shangmingc authored Mar 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6fa7cd3d
- [V1] [Feature] Collective RPC (#15444) · 94744ba4
  wwl2755 authored Mar 29, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  94744ba4
- [FEAT] [ROCm] Add AITER int8 scaled gemm kernel (#15433) · 4965ec42
  TJian authored Mar 29, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  4965ec42
- [doc] update doc (#15740) · 73aa7041
  Reid authored Mar 29, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  73aa7041
- [Kernel][TPU][ragged-paged-attn] vLLM code change for PR#8896 (#15659) · 7c1f7600
  yarongmu-google authored Mar 28, 2025
```
Signed-off-by: Yarong Mu <ymu@google.com>
```
  7c1f7600
- [TPU][V1][Bugfix] Fix w8a8 recompiilation with GSM8K (#15714) · da461f3c
  Nicolò Lucchesi authored Mar 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  da461f3c
- [Bugfix] set VLLM_WORKER_MULTIPROC_METHOD=spawn for vllm.entrypoionts.openai.api_server (#15700) · 5b800f09
  Jinzhen Lin authored Mar 29, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  5b800f09
- Use numba 0.61 for python 3.10+ to support numpy>=2 (#15692) · 8427f704
  cyyever authored Mar 29, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
```
  8427f704
- [CI] Speed up V1 structured output tests (#15718) · 7a799208
  Russell Bryant authored Mar 29, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7a799208
- [Bugfix] LoRA V1: add and fix entrypoints tests (#15715) · 1286211f
  Varun Sundar Rabindranath authored Mar 28, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  1286211f
- [Misc][V1] Misc code streamlining (#15723) · 6d531ad7
  Nick Hill authored Mar 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  6d531ad7