Commits · 9b459eca88b4953586391c14d183574c4d21fca3 · OpenDAS / vllm_cscc · GitLab

30 Mar, 2025 9 commits
- [V1][Scheduler] Avoid calling `_try_schedule_encoder_inputs` for every request (#15778) · 9b459eca
  Woosuk Kwon authored Mar 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9b459eca
- fix: Comments to English for better dev experience (#15768) · 70fedd0f
  yihong authored Mar 31, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  70fedd0f
- [Bugfix] Added `embed_is_patch` mask for fuyu model (#15731) · bb103b29
  kYLe authored Mar 30, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
```
  bb103b29
- fix: lint fix a ruff checkout syntax error (#15767) · 248e76c4
  yihong authored Mar 30, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  248e76c4
- [V1] Override `mm_counts` for dummy data creation (#15703) · 803d5c35
  Cyrus Leung authored Mar 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  803d5c35
- fix test_phi3v (#15321) · 7fd8c0f8
  pansicheng authored Mar 30, 2025
```
Signed-off-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  7fd8c0f8
- [doc] update conda to usage link in installation (#15761) · 44c3a5ab
  Reid authored Mar 30, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  44c3a5ab
- [Bugfix] Fix Mistral guided generation using xgrammar (#15704) · 6909a762
  Julien Denize authored Mar 30, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6909a762
- [CI] xgrammar structured output supports Enum. (#15757) · 04553371
  Chauncey authored Mar 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  04553371
29 Mar, 2025 19 commits
- [Bugfix] Fix Mllama interleaved images input support (#15564) · 3c0ff914
  Isotr0py authored Mar 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  3c0ff914
- [V1][Minor] Simplify rejection sampler's parse_output (#15741) · 2bc4be4e
  Woosuk Kwon authored Mar 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2bc4be4e
- [V1] Support interleaved modality items (#15605) · c67abd61
  Roger Wang authored Mar 29, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  c67abd61
- [Feature][Disaggregated] Support XpYd disaggregated prefill with MooncakeStore (#12957) · 6fa7cd3d
  shangmingc authored Mar 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6fa7cd3d
- [V1] [Feature] Collective RPC (#15444) · 94744ba4
  wwl2755 authored Mar 29, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  94744ba4
- [FEAT] [ROCm] Add AITER int8 scaled gemm kernel (#15433) · 4965ec42
  TJian authored Mar 29, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  4965ec42
- [doc] update doc (#15740) · 73aa7041
  Reid authored Mar 29, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  73aa7041
- [Kernel][TPU][ragged-paged-attn] vLLM code change for PR#8896 (#15659) · 7c1f7600
  yarongmu-google authored Mar 28, 2025
```
Signed-off-by: Yarong Mu <ymu@google.com>
```
  7c1f7600
- [TPU][V1][Bugfix] Fix w8a8 recompiilation with GSM8K (#15714) · da461f3c
  Nicolò Lucchesi authored Mar 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  da461f3c
- [Bugfix] set VLLM_WORKER_MULTIPROC_METHOD=spawn for vllm.entrypoionts.openai.api_server (#15700) · 5b800f09
  Jinzhen Lin authored Mar 29, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  5b800f09
- Use numba 0.61 for python 3.10+ to support numpy>=2 (#15692) · 8427f704
  cyyever authored Mar 29, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
```
  8427f704
- [CI] Speed up V1 structured output tests (#15718) · 7a799208
  Russell Bryant authored Mar 29, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7a799208
- [Bugfix] LoRA V1: add and fix entrypoints tests (#15715) · 1286211f
  Varun Sundar Rabindranath authored Mar 28, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  1286211f
- [Misc][V1] Misc code streamlining (#15723) · 6d531ad7
  Nick Hill authored Mar 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  6d531ad7
- [Docs] Document v0 engine support in reasoning outputs (#15739) · 762b424a
  Ce Gao authored Mar 29, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  762b424a
- [Model] Support Skywork-R1V (#15397) · de1cb387
  pengyuange authored Mar 29, 2025
```
Signed-off-by: jiacai.liu <932997367@qq.com>
Co-authored-by: jiacai.liu <932997367@qq.com>
```
  de1cb387
- [ROCm][AMD][Build] Update AMD supported arch list (#15632) · c802f543
  Gregory Shtrasberg authored Mar 28, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  c802f543
- [Docs][V1] Optimize diagrams in prefix caching design (#15716) · cff8991a
  simpx authored Mar 29, 2025
  
  cff8991a
- implement prometheus fast-api-instrumentor for http service metrics (#15657) · f3f8d8ff
  daniel-salib authored Mar 28, 2025
  
  f3f8d8ff
28 Mar, 2025 12 commits
- [Misc] cli auto show default value (#15582) · 26df46ee
  Reid authored Mar 29, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  26df46ee
- [V1] TPU - Fix the chunked prompt bug (#15713) · c3f687ac
  Alexander Matveev authored Mar 28, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  c3f687ac
- [Bugfix] [torch.compile] Add Dynamo metrics context during compilation (#15639) · 04437e31
  Luka Govedič authored Mar 28, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  04437e31
- [TPU] [Perf] Improve Memory Usage Estimation (#15671) · 038beded
  Robert Shaw authored Mar 28, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  038beded
- [Misc] Remove stale func in KVTransferConfig (#14746) · d03308be
  shangmingc authored Mar 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  d03308be
- [Misc] Remove unused utils and clean up imports (#15708) · c6bc0034
  Cyrus Leung authored Mar 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6bc0034
- [Minor] Remove TGI launching script (#15646) · 70e13224
  Woosuk Kwon authored Mar 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  70e13224
- Fix cpu offload testing for gptq/awq/ct (#15648) · 47e9038d
  Michael Goin authored Mar 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  47e9038d
- [Bugfix] Fix regex compile display format (#15368) · 432cf22a
  Kebe authored Mar 28, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  432cf22a
- [doc] add missing imports (#15699) · 2914006f
  Reid authored Mar 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2914006f
- [V1] Support disable_any_whtespace for guidance backend (#15584) · 7329ff54
  Russell Bryant authored Mar 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7329ff54
- [Bugfix] `embed_is_patch` for Idefics3 (#15696) · 541d1df4
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  541d1df4