Commits · ca796e19528384abba8732bb9fd204273a728d11 · OpenDAS / vllm_cscc · GitLab

21 Mar, 2025 1 commit
- Merge tag 'v0.8.1' into v0.8.1-ori · ca796e19
  zhuwenwen authored Mar 21, 2025
  
  ca796e19
19 Mar, 2025 22 commits
- [V1] Minor V1 async engine test refactor (#15075) · 61c7a1b8
  Murali Andoorveedu authored Mar 19, 2025
```
Signed-off-by: andoorve <murali.andoorveedu@mail.utoronto.ca>
Co-authored-by: andoorve <murali.andoorveedu@mail.utoronto.ca>
```
  61c7a1b8
- [Frontend] Remove custom_cache_manager (#13791) · 374ee287
  Alessandro Sangiorgi authored Mar 19, 2025
```
Signed-off-by: fulvius31 <asangior@redhat.com>
```
  374ee287
- [Misc] Update the "the first vLLM China Meetup" slides link to point to the first page (#15134) · a4d83661
  Kero Liang authored Mar 19, 2025
```
Signed-off-by: imkero <kerorek@outlook.com>
```
  a4d83661
- [Bugfix] Adjust mllama to regional compilation (#15112) · 8363cd09
  Jan Kaniecki authored Mar 19, 2025
```
Signed-off-by: Jan Kaniecki <jkaniecki@habana.ai>
```
  8363cd09
- [Misc][Benchmark] Add support for different `tokenizer_mode` (#15040) · 6c5a3195
  Aaron Pham authored Mar 19, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  6c5a3195
- [Doc] Update tip info on using latest transformers when creating a custom Dockerfile (#15070) · 073d1ed3
  Marc-Alexandre Côté authored Mar 19, 2025
  
  073d1ed3
- [Bugfix] Fix size calculation of processing cache (#15114) · 3d446433
  Cyrus Leung authored Mar 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3d446433
- [Misc] Avoid unnecessary HF `do_rescale` warning when passing dummy data (#15107) · 1fe0fd12
  Cyrus Leung authored Mar 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1fe0fd12
- [V1][Bugfix] Fix oracle for device checking (#15104) · dafb4e50
  Roger Wang authored Mar 19, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  dafb4e50
- [CI][Intel GPU] update XPU dockerfile and CI script (#15109) · 68cf1601
  Kunshang Ji authored Mar 19, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  68cf1601
- [Bugfix] Re-enable Gemma3 for V1 (#14980) · 61f41218
  Cyrus Leung authored Mar 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61f41218
- [V1] Ensure using int64 for sampled token ids (#15065) · 05ccd0aa
  Woosuk Kwon authored Mar 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  05ccd0aa
- add --gpu-max-threads-per-block=1024 to fix rms_norm_kernel accuracy · e983c804
  zhuwenwen authored Mar 19, 2025
  
  e983c804
- skip rms_norm_dynamic_per_token_quant · 0dc4c8e9
  zhuwenwen authored Mar 19, 2025
  
  0dc4c8e9
- update rocm.py · d9ef7ce7
  zhuwenwen authored Mar 19, 2025
  
  d9ef7ce7
- skip fp8 kernel and _rocm_C extension · 9e053941
  zhuwenwen authored Mar 19, 2025
  
  9e053941
- [Core] Update dtype detection and defaults (#14858) · f690372b
  Cyrus Leung authored Mar 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f690372b
- [Model] Remove duplicated message check in Mistral chat completion request (#15069) · 8b3e94a3
  Brayden Zhong authored Mar 19, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  8b3e94a3
- [Fix]atomicAdd ambiguous · f850f22a
  zhuwenwen authored Mar 19, 2025
  
  f850f22a
- support kme and bw · 07e3681a
  zhuwenwen authored Mar 19, 2025
  
  07e3681a
- [Model] Pixtral: Remove layer instantiation duplication (#15053) · 437f9162
  Julien Denize authored Mar 19, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  437f9162
- [Misc][V1] Skip device checking if not available (#15061) · 4f065f12
  Cody Yu authored Mar 18, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  4f065f12
18 Mar, 2025 17 commits
- [Doc] Minor v1_user_guide update (#15064) · 228b768d
  Jennifer Zhao authored Mar 18, 2025
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  228b768d
- fix long dtype in topk sampling (#15049) · 027827cc
  Chujie Zheng authored Mar 19, 2025
  
  027827cc
- [V1] TPU - CI/CD use smaller model (#15054) · 72a8639b
  Alexander Matveev authored Mar 18, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  72a8639b
- [V1][Spec Decode] Optimize Rejection Sampler with Triton Kernels (#14930) · 99abb8b6
  Woosuk Kwon authored Mar 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  99abb8b6
- [V1] Refactor Structured Output for multiple backends (#14694) · 3a1e6481
  Russell Bryant authored Mar 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3a1e6481
- [Bugfix] Fix LoRA extra vocab size (#15047) · 966f933e
  Jee Jee Li authored Mar 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  966f933e
- [Bugfix] Fix broken CPU quantization due to triton import (#15038) · 1a504aff
  Isotr0py authored Mar 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1a504aff
- [MODEL] Add support for Zamba2 models (#13185) · 01ca85bb
  yury-tokpanov authored Mar 18, 2025
```
Signed-off-by: Yury Tokpanov <yury@zyphra.com>
Signed-off-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  01ca85bb
- [Bugfix] Register serializers for V0 MQ Engine (#15009) · d82b9487
  Simon Mo authored Mar 18, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  d82b9487
- [Bugfix] Loosen type check to avoid errors in V1 (#15021) · be13281d
  Cyrus Leung authored Mar 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  be13281d
- [Bugfix] torchrun compatibility (#14899) · 54e084f7
  hoshi-hiyouga authored Mar 18, 2025
```
Signed-off-by: hiyouga <hiyouga@buaa.edu.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  54e084f7
- [Kernels] LoRA - Retire SGMV and BGMV Kernels (#14685) · 9e8f089d
  Varun Sundar Rabindranath authored Mar 18, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  9e8f089d
- [Bugfix] Fix LoRA extra vocab size (#15047) · 46c759c1
  Jee Jee Li authored Mar 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  46c759c1
- [Bugfix] Fix broken CPU quantization due to triton import (#15038) · 179a619c
  Isotr0py authored Mar 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  179a619c
- [MODEL] Add support for Zamba2 models (#13185) · 452e8fd9
  yury-tokpanov authored Mar 18, 2025
```
Signed-off-by: Yury Tokpanov <yury@zyphra.com>
Signed-off-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  452e8fd9
- MI325 configs, fused_moe_kernel bugfix (#14987) · 8b793f7e
  ekuznetsov139 authored Mar 18, 2025
```
Signed-off-by: Eugene Kuznetsov <eugene.kuznetsov@amd.com>
```
  8b793f7e
- [TPU][V1][Bugfix] Fix chunked prefill with padding (#15037) · af35d3a3
  Nicolò Lucchesi authored Mar 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  af35d3a3