Commits · 56d4aefa33f3f8ffaf74d02a8d7eef9523651864 · OpenDAS / vllm_cscc · GitLab

10 Apr, 2025 29 commits
- [VLM] Avoid unnecessary dummy multimodal data during processing (#16416) · 56d4aefa
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56d4aefa
- [V1] Zero-copy tensor/ndarray serialization/transmission (#13790) · dd143ef5
  Nick Hill authored Apr 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  dd143ef5
- [Model] Reduce redundant computations in mamba2 blocks for Bamba-9B (#15423) · daefed05
  Chih-Chieh Yang authored Apr 10, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
```
  daefed05
- [Bugfix] Fix bug when dataset is json (#15899) · 5fbab20e
  Chenyaaang authored Apr 10, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  5fbab20e
- [V1][Spec Decode] Eagle Model loading (#16035) · e8224f3d
  Lily Liu authored Apr 10, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  e8224f3d
- [V1] Set structured output backend to `auto` by default (#15724) · 9665313c
  Russell Bryant authored Apr 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  9665313c
- Improve configs - `ParallelConfig` (#16332) · 0c54fc72
  Harry Mellor authored Apr 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0c54fc72
- [TPU][V1] Use `language_model` interface for getting text backbone in MM (#16410) · c1b57855
  Nicolò Lucchesi authored Apr 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  c1b57855
- [VLM] Remove `BaseProcessingInfo.get_mm_max_tokens_per_item` (#16408) · 83b824c8
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83b824c8
- Fix the torch version parsing logic (#15857) · 7678fcd5
  Lu Fang authored Apr 10, 2025
  
  7678fcd5
- [CI] Add auto update workflow for Dockerfile graph (#11879) · 8661c024
  wineandchord authored Apr 10, 2025
```
Signed-off-by: wineandchord <guoqizhou19@gmail.com>
```
  8661c024
- [doc] update the wrong link (#16401) · ce8d6b75
  Reid authored Apr 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  ce8d6b75
- [Model] Remove image mm limit for LLaMa4 (#16365) · 61de3ef7
  Ye (Charlotte) Qi authored Apr 10, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  61de3ef7
- Update Numba to 0.61.2 (#16376) · ec1f9c8c
  cyyever authored Apr 10, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
```
  ec1f9c8c
- [doc] add download model tips (#16389) · 65e09094
  Reid authored Apr 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  65e09094
- [Kernel] Use moe_wna16 kernel for compressed tensors wna16 moe models (#16038) · c70cf0fe
  Michael Goin authored Apr 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c70cf0fe
- [Bugfix] Fix validation error for text-only Mllama 3.2 (#16377) · a5d11a54
  Cyrus Leung authored Apr 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a5d11a54
- [Misc] Update transformers version limits of multi-modal tests (#16381) · 3d4c8775
  Cyrus Leung authored Apr 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3d4c8775
- [Model] use AutoWeightsLoader for deepseek_v2, internlm2 (#16383) · a9bd832f
  Aaron Ang authored Apr 10, 2025
```
Signed-off-by: Aaron Ang <aaron.angyd@gmail.com>
```
  a9bd832f
- fix sonnet dataset sample when prefix len is very small (#16379) · 417bcefb
  Chenyaaang authored Apr 09, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  417bcefb
- [Bugfix][TPU] Fix TPU validate_request (#16369) · baada0e7
  Michael Goin authored Apr 09, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  baada0e7
- [misc] use tqdm.auto where appropriate (#16290) · 82eb61dd
  Benjamin Kitor authored Apr 09, 2025
```
Signed-off-by: Benjamin Kitor <bkitor@gigaio.com>
```
  82eb61dd
- [CI][Bugfix] Pin triton version for CPU (#16384) · 0d4d06fe
  Roger Wang authored Apr 09, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0d4d06fe
- [bugfix] Avoid the time consumption caused by creating dummy videos. (#16371) · 4aed0ca6
  Jintao authored Apr 10, 2025
  
  4aed0ca6
- [TPU] Fix dummy loading OOM (#16372) · 1621b252
  Chengji Yao authored Apr 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  1621b252
- [Model] use AutoWeightsLoader for granite, granitemoe, granitemoeshared, grok1, mixtral (#16325) · a5647971
  Aaron Ang authored Apr 09, 2025
```
Signed-off-by: Aaron Ang <aaron.angyd@gmail.com>
```
  a5647971
- [Bugfix]: do not shutdown server if `skip_special_use=False` for MistralTokenizer (#14094) · 1da6a092
  Guillaume Calmettes authored Apr 10, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  1da6a092
- Add GLM-4-0414 support (#16338) · 1e44ffc3
  Yuxuan Zhang authored Apr 10, 2025
```
Signed-off-by: lvfei.lv <lvfei.lv@alibaba-inc.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Ajay Vohra <ajayvohr@amazon.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Co-authored-by: Accelerator1996 <lvfei.lv@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: yihong <zouzou0208@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: ajayvohra2005 <ajayvohr@amazon.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  1e44ffc3
- [TPU][V1] Refine tpu_model_runner to mitigate future recompilation issues (#16275) · a4547485
  Chengji Yao authored Apr 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  a4547485
09 Apr, 2025 11 commits
- [Misc] refactor Structured Outputs example (#16322) · 1bff42c4
  Reid authored Apr 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1bff42c4
- [Hardware] add platform-specific request validation api (#16291) · cb391d85
  Joe Runde authored Apr 09, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cb391d85
- [Build/CI] Add tracing deps to vllm container image (#15224) · fee5b8d3
  Russell Bryant authored Apr 09, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  fee5b8d3
- Fix `benchmark_throughput.py --backend=hf` (#16352) · b2ce859b
  Michael Goin authored Apr 09, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b2ce859b
- [CI]Fix hpu docker and numpy version for CI (#16355) · 566f10a9
  Chendi.Xue authored Apr 09, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  566f10a9
- [Bugfix] catch AssertionError in MistralTokenizer as ValueError (#16344) · c3b51891
  Guillaume Calmettes authored Apr 09, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  c3b51891
- [Bugfix] Fix profiling.py (#16202) · a25866ac
  zh Wang authored Apr 10, 2025
```
Signed-off-by: zh Wang <rekind133@outlook.com>
```
  a25866ac
- Revert "Update label-tpu mergify and remove removal bot" (#16350) · 098900d7
  Michael Goin authored Apr 09, 2025
  
  098900d7
- [Bugfix][Frontend] respect provided default guided decoding backend (#15476) · 98d01d3c
  Guillaume Calmettes authored Apr 09, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  98d01d3c
- [Model] Add `SupportsMultiModal.get_language_model` interface (#16007) · d55244df
  Nicolò Lucchesi authored Apr 09, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d55244df
- [BugFix] fix some typos found by typos. (#16314) · 04149cce
  yihong authored Apr 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  04149cce