Commits · 04437e313dbbf4427734a3ed2d1d650efc57ef66 · OpenDAS / vllm_cscc · GitLab

28 Mar, 2025 31 commits
- [Bugfix] [torch.compile] Add Dynamo metrics context during compilation (#15639) · 04437e31
  Luka Govedič authored Mar 28, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  04437e31
- [TPU] [Perf] Improve Memory Usage Estimation (#15671) · 038beded
  Robert Shaw authored Mar 28, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  038beded
- [Misc] Remove stale func in KVTransferConfig (#14746) · d03308be
  shangmingc authored Mar 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  d03308be
- [Misc] Remove unused utils and clean up imports (#15708) · c6bc0034
  Cyrus Leung authored Mar 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6bc0034
- [Minor] Remove TGI launching script (#15646) · 70e13224
  Woosuk Kwon authored Mar 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  70e13224
- Fix cpu offload testing for gptq/awq/ct (#15648) · 47e9038d
  Michael Goin authored Mar 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  47e9038d
- [Bugfix] Fix regex compile display format (#15368) · 432cf22a
  Kebe authored Mar 28, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  432cf22a
- [doc] add missing imports (#15699) · 2914006f
  Reid authored Mar 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2914006f
- [V1] Support disable_any_whtespace for guidance backend (#15584) · 7329ff54
  Russell Bryant authored Mar 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7329ff54
- [Bugfix] `embed_is_patch` for Idefics3 (#15696) · 541d1df4
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  541d1df4
- [Bugfix][v1] xgrammar structured output supports Enum. (#15594) · 3b00ff91
  Chauncey authored Mar 28, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  3b00ff91
- [Model] Adding torch compile annotations to chatglm (#15624) · 91276c57
  Jee Jee Li authored Mar 28, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  91276c57
- [Docs] Add "Generation quality changed" section to troubleshooting (#15701) · 0b416752
  Harry Mellor authored Mar 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0b416752
- [Frontend] update priority for --api-key and VLLM_API_KEY (#15588) · fd5fd269
  Reid authored Mar 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  fd5fd269
- [Bugfix][Frontend] Eliminate regex based check in reasoning full generator (#14821) · 3bbaacbe
  Ce Gao authored Mar 28, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  3bbaacbe
- [Misc] Fix test_sleep to use query parameters (#14373) · a10314c6
  Lize Cai authored Mar 28, 2025
```
Signed-off-by: Lize Cai <lize.cai@sap.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  a10314c6
- [Bugfix] Fix 'InductorAdaptor object has no attribute 'cache_dir' (#15674) · 70f2c2a7
  Jee Jee Li authored Mar 28, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  70f2c2a7
- [CPU][CI] Improve CPU Dockerfile (#15690) · 280d0741
  Li, Jiang authored Mar 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  280d0741
- [Refactor][Frontend] Keep all logic about reasoning into one class (#14428) · 32b14baf
  Ce Gao authored Mar 28, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  32b14baf
- [TPU][CI] Fix TPUModelRunner Test (#15667) · 2d9045fc
  Robert Shaw authored Mar 28, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  2d9045fc
- [V1] Remove legacy input registry (#15673) · 355f6634
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  355f6634
- [Bugfix] Fix `mm_hashes` forgetting to be passed (#15668) · 8693e47e
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8693e47e
- Refactor error handling for multiple exceptions in preprocessing (#15650) · cec8c7d7
  Jason (Siyu) Zhu authored Mar 27, 2025
```
Signed-off-by: JasonZhu1313 <jasonchu13@outlook.com>
```
  cec8c7d7
- [Quantization][FP8] Adding support for fp8 gemm layer input in fp8 (#14578) · 4d0ec372
  Gregory Shtrasberg authored Mar 27, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  4d0ec372
- [Misc]add coding benchmark for speculative decoding (#15303) · e7f720ea
  Chen Xia authored Mar 27, 2025
```
Signed-off-by: CXIAAAAA <cxia0209@gmail.com>
```
  e7f720ea
- Revert "Use Cache Hinting for fused_moe kernel (#15511)" (#15645) · 4ae17bf1
  Wes authored Mar 27, 2025
```
Signed-off-by: Wes Medford <wryanmedford@gmail.com>
```
  4ae17bf1
- [CI][TPU] Temporarily Disable Quant Test on TPU (#15649) · 8a49eea7
  Robert Shaw authored Mar 27, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  8a49eea7
- [Doc] Fix dead links in Job Board (#15637) · b4245a48
  wwl2755 authored Mar 27, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  b4245a48
- [Bugfix] Fix failure to launch in Tensor Parallel TP mode on macOS. (#14948) · 4e0f6076
  Kebe authored Mar 28, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  4e0f6076
- [Quantization][V1] BitsAndBytes support V1 (#15611) · 726efc6a
  Jee Jee Li authored Mar 28, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  726efc6a
- [TPU] Lazy Import (#15656) · bd45912b
  Robert Shaw authored Mar 27, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  bd45912b
27 Mar, 2025 9 commits
- [V1] AsyncLLM data parallel (#13923) · 15dac210
  Nick Hill authored Mar 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  15dac210
- [CI] Update rules for applying `tpu` label. (#15634) · 112b3e5b
  Russell Bryant authored Mar 27, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  112b3e5b
- Correct PowerPC to modern IBM Power (#15635) · 32d66927
  cnorman authored Mar 27, 2025
```
Signed-off-by: Christy Norman <christy@linux.vnet.ibm.com>
```
  32d66927
- [Bugfix][TPU][V1] Fix recompilation (#15553) · 4098b722
  Nicolò Lucchesi authored Mar 27, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4098b722
- Use absolute placement for Ask AI button (#15628) · 46450b8d
  Harry Mellor authored Mar 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  46450b8d
- [Misc] Avoid direct access of global `mm_registry` in `compute_encoder_budget` (#15621) · 13ac9cab
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13ac9cab
- [Feature] Add middleware to log API Server responses (#15593) · 66aa4c0b
  Yuan Tang authored Mar 27, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  66aa4c0b
- [Misc] Replace `is_encoder_decoder_inputs` with `split_enc_dec_inputs` (#15620) · 24718153
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  24718153
- [Doc] Link to onboarding tasks (#15629) · 07bf813f
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  07bf813f