Commits · 70de35a8816e224663aede45b7f54eef250a5cfe · OpenDAS / vllm_cscc · GitLab

11 Apr, 2025 17 commits
- Fix erroneous "model doesn't support compile" warning (#16486) · 70de35a8
  Richard Zou authored Apr 11, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  70de35a8
- [Hardware][Intel-Gaudi] Multi-step scheduling implementation for HPU (#12779) · 34b2cf3b
  Tomasz Zielinski authored Apr 11, 2025
```
Signed-off-by: Tomasz Zielinski <tomasz.zielinski@intel.com>
```
  34b2cf3b
- [Bugfix] Fix bugs of running Quark quantized models (#16236) · 9e90c9f7
  chaow-amd authored Apr 11, 2025
```
Signed-off-by: chaow <chaow@amd.com>
```
  9e90c9f7
- [Kernel] support merge_attn_states CUDA kernel, 3x speedup (#16173) · e9528f6d
  DefTruth authored Apr 11, 2025
```
Signed-off-by: DefTruth <qiustudent_r@163.com>
```
  e9528f6d
- Don't install triton on `ppc64le` platform (#16470) · 51baa9c3
  Harry Mellor authored Apr 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51baa9c3
- [Misc] update api_client example (#16459) · 35e076b3
  Reid authored Apr 11, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  35e076b3
- [Misc] Raise error for V1 not supporting Long LoRA. (#16415) · a26f59cc
  Jee Jee Li authored Apr 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a26f59cc
- Enforce valid max_num_batched_tokens when disable_chunked_mm_input=True (#16447) · aa3b3d76
  Michael Goin authored Apr 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  aa3b3d76
- [Core][LoRA][1/N] Add LoRA for EncoderDecoderModelRunner (#15990) · f7030df3
  Jee Jee Li authored Apr 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f7030df3
- Revert "[Model] use AutoWeightsLoader for deepseek_v2, internlm2" (#16453) · 905e91e9
  DefTruth authored Apr 11, 2025
  
  905e91e9
- [Bugfix] Don't set an upper bound on repetition penalty (#16403) · f8f9c0ba
  Alex Brooks authored Apr 11, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  f8f9c0ba
- [CPU][Bugfix] Fix CPU docker issues (#16454) · dda81102
  Li, Jiang authored Apr 11, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  dda81102
- [Bugfix][VLM] Fix failing Phi-4-MM multi-images tests and add vision-speech test (#16424) · 93195146
  Isotr0py authored Apr 11, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  93195146
- Update supported_hardware.md for TPU INT8 (#16437) · ed375995
  Michael Goin authored Apr 10, 2025
  
  ed375995
- [Llama4] Enable attention temperature tuning by default for long context (>32k) (#16439) · 99ef59cf
  Yong Hoon Shin authored Apr 10, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  99ef59cf
- update benchmark_serving_structured_output to include auto backend (#16438) · d544d141
  Chenyaaang authored Apr 10, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  d544d141
- check input length of sonnet samples (#16423) · 3e397a94
  Alexey Belyakov authored Apr 11, 2025
```
Signed-off-by: alexey-belyakov <alexey.belyakov@intel.com>
```
  3e397a94
10 Apr, 2025 23 commits
- Fix range_ratio Bug in RandomDataset (#16126) · 268c3250
  WWW authored Apr 11, 2025
```
Signed-off-by: jadewang21 <jadewangcn@outlook.com>
```
  268c3250
- [TPU][V1] Disable per-request seed/Generator (#16172) · 3cc9af88
  Nicolò Lucchesi authored Apr 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3cc9af88
- [Bugfix] Fix output token length check logic (#16419) · 7cd0bd72
  look authored Apr 11, 2025
```
Signed-off-by: look <eeslook@163.com>
```
  7cd0bd72
- [VLM] Avoid unnecessary dummy multimodal data during processing (#16416) · 56d4aefa
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56d4aefa
- [V1] Zero-copy tensor/ndarray serialization/transmission (#13790) · dd143ef5
  Nick Hill authored Apr 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  dd143ef5
- [Model] Reduce redundant computations in mamba2 blocks for Bamba-9B (#15423) · daefed05
  Chih-Chieh Yang authored Apr 10, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
```
  daefed05
- [Bugfix] Fix bug when dataset is json (#15899) · 5fbab20e
  Chenyaaang authored Apr 10, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  5fbab20e
- [V1][Spec Decode] Eagle Model loading (#16035) · e8224f3d
  Lily Liu authored Apr 10, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  e8224f3d
- [V1] Set structured output backend to `auto` by default (#15724) · 9665313c
  Russell Bryant authored Apr 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  9665313c
- Improve configs - `ParallelConfig` (#16332) · 0c54fc72
  Harry Mellor authored Apr 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0c54fc72
- [TPU][V1] Use `language_model` interface for getting text backbone in MM (#16410) · c1b57855
  Nicolò Lucchesi authored Apr 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  c1b57855
- [VLM] Remove `BaseProcessingInfo.get_mm_max_tokens_per_item` (#16408) · 83b824c8
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83b824c8
- Fix the torch version parsing logic (#15857) · 7678fcd5
  Lu Fang authored Apr 10, 2025
  
  7678fcd5
- [CI] Add auto update workflow for Dockerfile graph (#11879) · 8661c024
  wineandchord authored Apr 10, 2025
```
Signed-off-by: wineandchord <guoqizhou19@gmail.com>
```
  8661c024
- [doc] update the wrong link (#16401) · ce8d6b75
  Reid authored Apr 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  ce8d6b75
- [Model] Remove image mm limit for LLaMa4 (#16365) · 61de3ef7
  Ye (Charlotte) Qi authored Apr 10, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  61de3ef7
- Update Numba to 0.61.2 (#16376) · ec1f9c8c
  cyyever authored Apr 10, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
```
  ec1f9c8c
- [doc] add download model tips (#16389) · 65e09094
  Reid authored Apr 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  65e09094
- [Kernel] Use moe_wna16 kernel for compressed tensors wna16 moe models (#16038) · c70cf0fe
  Michael Goin authored Apr 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c70cf0fe
- [Bugfix] Fix validation error for text-only Mllama 3.2 (#16377) · a5d11a54
  Cyrus Leung authored Apr 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a5d11a54
- [Misc] Update transformers version limits of multi-modal tests (#16381) · 3d4c8775
  Cyrus Leung authored Apr 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3d4c8775
- [Model] use AutoWeightsLoader for deepseek_v2, internlm2 (#16383) · a9bd832f
  Aaron Ang authored Apr 10, 2025
```
Signed-off-by: Aaron Ang <aaron.angyd@gmail.com>
```
  a9bd832f
- fix sonnet dataset sample when prefix len is very small (#16379) · 417bcefb
  Chenyaaang authored Apr 09, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  417bcefb