Commits · bb103b29bf3d26fa831458a8ca5af1bb820c4712 · OpenDAS / vllm_cscc · GitLab

30 Mar, 2025 4 commits
- [Bugfix] Added `embed_is_patch` mask for fuyu model (#15731) · bb103b29
  kYLe authored Mar 30, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
```
  bb103b29
- [V1] Override `mm_counts` for dummy data creation (#15703) · 803d5c35
  Cyrus Leung authored Mar 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  803d5c35
- fix test_phi3v (#15321) · 7fd8c0f8
  pansicheng authored Mar 30, 2025
```
Signed-off-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  7fd8c0f8
- [Bugfix] Fix Mistral guided generation using xgrammar (#15704) · 6909a762
  Julien Denize authored Mar 30, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6909a762
29 Mar, 2025 13 commits
- [Bugfix] Fix Mllama interleaved images input support (#15564) · 3c0ff914
  Isotr0py authored Mar 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  3c0ff914
- [V1][Minor] Simplify rejection sampler's parse_output (#15741) · 2bc4be4e
  Woosuk Kwon authored Mar 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2bc4be4e
- [V1] Support interleaved modality items (#15605) · c67abd61
  Roger Wang authored Mar 29, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  c67abd61
- [Feature][Disaggregated] Support XpYd disaggregated prefill with MooncakeStore (#12957) · 6fa7cd3d
  shangmingc authored Mar 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6fa7cd3d
- [V1] [Feature] Collective RPC (#15444) · 94744ba4
  wwl2755 authored Mar 29, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  94744ba4
- [FEAT] [ROCm] Add AITER int8 scaled gemm kernel (#15433) · 4965ec42
  TJian authored Mar 29, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  4965ec42
- [Kernel][TPU][ragged-paged-attn] vLLM code change for PR#8896 (#15659) · 7c1f7600
  yarongmu-google authored Mar 28, 2025
```
Signed-off-by: Yarong Mu <ymu@google.com>
```
  7c1f7600
- [TPU][V1][Bugfix] Fix w8a8 recompiilation with GSM8K (#15714) · da461f3c
  Nicolò Lucchesi authored Mar 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  da461f3c
- [Bugfix] set VLLM_WORKER_MULTIPROC_METHOD=spawn for vllm.entrypoionts.openai.api_server (#15700) · 5b800f09
  Jinzhen Lin authored Mar 29, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  5b800f09
- [Bugfix] LoRA V1: add and fix entrypoints tests (#15715) · 1286211f
  Varun Sundar Rabindranath authored Mar 28, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  1286211f
- [Misc][V1] Misc code streamlining (#15723) · 6d531ad7
  Nick Hill authored Mar 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  6d531ad7
- [Model] Support Skywork-R1V (#15397) · de1cb387
  pengyuange authored Mar 29, 2025
```
Signed-off-by: jiacai.liu <932997367@qq.com>
Co-authored-by: jiacai.liu <932997367@qq.com>
```
  de1cb387
- implement prometheus fast-api-instrumentor for http service metrics (#15657) · f3f8d8ff
  daniel-salib authored Mar 28, 2025
  
  f3f8d8ff
28 Mar, 2025 23 commits
- [Misc] cli auto show default value (#15582) · 26df46ee
  Reid authored Mar 29, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  26df46ee
- [V1] TPU - Fix the chunked prompt bug (#15713) · c3f687ac
  Alexander Matveev authored Mar 28, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  c3f687ac
- [Bugfix] [torch.compile] Add Dynamo metrics context during compilation (#15639) · 04437e31
  Luka Govedič authored Mar 28, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  04437e31
- [TPU] [Perf] Improve Memory Usage Estimation (#15671) · 038beded
  Robert Shaw authored Mar 28, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  038beded
- [Misc] Remove stale func in KVTransferConfig (#14746) · d03308be
  shangmingc authored Mar 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  d03308be
- [Misc] Remove unused utils and clean up imports (#15708) · c6bc0034
  Cyrus Leung authored Mar 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6bc0034
- [Bugfix] Fix regex compile display format (#15368) · 432cf22a
  Kebe authored Mar 28, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  432cf22a
- [V1] Support disable_any_whtespace for guidance backend (#15584) · 7329ff54
  Russell Bryant authored Mar 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7329ff54
- [Bugfix] `embed_is_patch` for Idefics3 (#15696) · 541d1df4
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  541d1df4
- [Bugfix][v1] xgrammar structured output supports Enum. (#15594) · 3b00ff91
  Chauncey authored Mar 28, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  3b00ff91
- [Model] Adding torch compile annotations to chatglm (#15624) · 91276c57
  Jee Jee Li authored Mar 28, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  91276c57
- [Frontend] update priority for --api-key and VLLM_API_KEY (#15588) · fd5fd269
  Reid authored Mar 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  fd5fd269
- [Bugfix][Frontend] Eliminate regex based check in reasoning full generator (#14821) · 3bbaacbe
  Ce Gao authored Mar 28, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  3bbaacbe
- [Bugfix] Fix 'InductorAdaptor object has no attribute 'cache_dir' (#15674) · 70f2c2a7
  Jee Jee Li authored Mar 28, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  70f2c2a7
- [Refactor][Frontend] Keep all logic about reasoning into one class (#14428) · 32b14baf
  Ce Gao authored Mar 28, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  32b14baf
- [V1] Remove legacy input registry (#15673) · 355f6634
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  355f6634
- [Bugfix] Fix `mm_hashes` forgetting to be passed (#15668) · 8693e47e
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8693e47e
- Refactor error handling for multiple exceptions in preprocessing (#15650) · cec8c7d7
  Jason (Siyu) Zhu authored Mar 27, 2025
```
Signed-off-by: JasonZhu1313 <jasonchu13@outlook.com>
```
  cec8c7d7
- [Quantization][FP8] Adding support for fp8 gemm layer input in fp8 (#14578) · 4d0ec372
  Gregory Shtrasberg authored Mar 27, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  4d0ec372
- Revert "Use Cache Hinting for fused_moe kernel (#15511)" (#15645) · 4ae17bf1
  Wes authored Mar 27, 2025
```
Signed-off-by: Wes Medford <wryanmedford@gmail.com>
```
  4ae17bf1
- [Bugfix] Fix failure to launch in Tensor Parallel TP mode on macOS. (#14948) · 4e0f6076
  Kebe authored Mar 28, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  4e0f6076
- [Quantization][V1] BitsAndBytes support V1 (#15611) · 726efc6a
  Jee Jee Li authored Mar 28, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  726efc6a
- [TPU] Lazy Import (#15656) · bd45912b
  Robert Shaw authored Mar 27, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  bd45912b