Commits · aa3b3d76e0db63a4214b45805dc9bc3e5609c30e · OpenDAS / vllm_cscc · GitLab

11 Apr, 2025 10 commits
- Enforce valid max_num_batched_tokens when disable_chunked_mm_input=True (#16447) · aa3b3d76
  Michael Goin authored Apr 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  aa3b3d76
- [Core][LoRA][1/N] Add LoRA for EncoderDecoderModelRunner (#15990) · f7030df3
  Jee Jee Li authored Apr 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f7030df3
- Revert "[Model] use AutoWeightsLoader for deepseek_v2, internlm2" (#16453) · 905e91e9
  DefTruth authored Apr 11, 2025
  
  905e91e9
- [Bugfix] Don't set an upper bound on repetition penalty (#16403) · f8f9c0ba
  Alex Brooks authored Apr 11, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  f8f9c0ba
- [CPU][Bugfix] Fix CPU docker issues (#16454) · dda81102
  Li, Jiang authored Apr 11, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  dda81102
- [Bugfix][VLM] Fix failing Phi-4-MM multi-images tests and add vision-speech test (#16424) · 93195146
  Isotr0py authored Apr 11, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  93195146
- Update supported_hardware.md for TPU INT8 (#16437) · ed375995
  Michael Goin authored Apr 10, 2025
  
  ed375995
- [Llama4] Enable attention temperature tuning by default for long context (>32k) (#16439) · 99ef59cf
  Yong Hoon Shin authored Apr 10, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  99ef59cf
- update benchmark_serving_structured_output to include auto backend (#16438) · d544d141
  Chenyaaang authored Apr 10, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  d544d141
- check input length of sonnet samples (#16423) · 3e397a94
  Alexey Belyakov authored Apr 11, 2025
```
Signed-off-by: alexey-belyakov <alexey.belyakov@intel.com>
```
  3e397a94
10 Apr, 2025 30 commits
- Fix range_ratio Bug in RandomDataset (#16126) · 268c3250
  WWW authored Apr 11, 2025
```
Signed-off-by: jadewang21 <jadewangcn@outlook.com>
```
  268c3250
- [TPU][V1] Disable per-request seed/Generator (#16172) · 3cc9af88
  Nicolò Lucchesi authored Apr 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3cc9af88
- [Bugfix] Fix output token length check logic (#16419) · 7cd0bd72
  look authored Apr 11, 2025
```
Signed-off-by: look <eeslook@163.com>
```
  7cd0bd72
- [VLM] Avoid unnecessary dummy multimodal data during processing (#16416) · 56d4aefa
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56d4aefa
- [V1] Zero-copy tensor/ndarray serialization/transmission (#13790) · dd143ef5
  Nick Hill authored Apr 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  dd143ef5
- [Model] Reduce redundant computations in mamba2 blocks for Bamba-9B (#15423) · daefed05
  Chih-Chieh Yang authored Apr 10, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
```
  daefed05
- [Bugfix] Fix bug when dataset is json (#15899) · 5fbab20e
  Chenyaaang authored Apr 10, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  5fbab20e
- [V1][Spec Decode] Eagle Model loading (#16035) · e8224f3d
  Lily Liu authored Apr 10, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  e8224f3d
- [V1] Set structured output backend to `auto` by default (#15724) · 9665313c
  Russell Bryant authored Apr 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  9665313c
- Improve configs - `ParallelConfig` (#16332) · 0c54fc72
  Harry Mellor authored Apr 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0c54fc72
- [TPU][V1] Use `language_model` interface for getting text backbone in MM (#16410) · c1b57855
  Nicolò Lucchesi authored Apr 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  c1b57855
- [VLM] Remove `BaseProcessingInfo.get_mm_max_tokens_per_item` (#16408) · 83b824c8
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83b824c8
- Fix the torch version parsing logic (#15857) · 7678fcd5
  Lu Fang authored Apr 10, 2025
  
  7678fcd5
- [CI] Add auto update workflow for Dockerfile graph (#11879) · 8661c024
  wineandchord authored Apr 10, 2025
```
Signed-off-by: wineandchord <guoqizhou19@gmail.com>
```
  8661c024
- [doc] update the wrong link (#16401) · ce8d6b75
  Reid authored Apr 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  ce8d6b75
- [Model] Remove image mm limit for LLaMa4 (#16365) · 61de3ef7
  Ye (Charlotte) Qi authored Apr 10, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  61de3ef7
- Update Numba to 0.61.2 (#16376) · ec1f9c8c
  cyyever authored Apr 10, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
```
  ec1f9c8c
- [doc] add download model tips (#16389) · 65e09094
  Reid authored Apr 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  65e09094
- [Kernel] Use moe_wna16 kernel for compressed tensors wna16 moe models (#16038) · c70cf0fe
  Michael Goin authored Apr 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c70cf0fe
- [Bugfix] Fix validation error for text-only Mllama 3.2 (#16377) · a5d11a54
  Cyrus Leung authored Apr 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a5d11a54
- [Misc] Update transformers version limits of multi-modal tests (#16381) · 3d4c8775
  Cyrus Leung authored Apr 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3d4c8775
- [Model] use AutoWeightsLoader for deepseek_v2, internlm2 (#16383) · a9bd832f
  Aaron Ang authored Apr 10, 2025
```
Signed-off-by: Aaron Ang <aaron.angyd@gmail.com>
```
  a9bd832f
- fix sonnet dataset sample when prefix len is very small (#16379) · 417bcefb
  Chenyaaang authored Apr 09, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  417bcefb
- [Bugfix][TPU] Fix TPU validate_request (#16369) · baada0e7
  Michael Goin authored Apr 09, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  baada0e7
- [misc] use tqdm.auto where appropriate (#16290) · 82eb61dd
  Benjamin Kitor authored Apr 09, 2025
```
Signed-off-by: Benjamin Kitor <bkitor@gigaio.com>
```
  82eb61dd
- [CI][Bugfix] Pin triton version for CPU (#16384) · 0d4d06fe
  Roger Wang authored Apr 09, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0d4d06fe
- [bugfix] Avoid the time consumption caused by creating dummy videos. (#16371) · 4aed0ca6
  Jintao authored Apr 10, 2025
  
  4aed0ca6
- [TPU] Fix dummy loading OOM (#16372) · 1621b252
  Chengji Yao authored Apr 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  1621b252
- [Model] use AutoWeightsLoader for granite, granitemoe, granitemoeshared, grok1, mixtral (#16325) · a5647971
  Aaron Ang authored Apr 09, 2025
```
Signed-off-by: Aaron Ang <aaron.angyd@gmail.com>
```
  a5647971
- [Bugfix]: do not shutdown server if `skip_special_use=False` for MistralTokenizer (#14094) · 1da6a092
  Guillaume Calmettes authored Apr 10, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  1da6a092