Commits · 243eb9199fa5962e8edf46e47170f68b3f6a0116 · OpenDAS / vllm_cscc · GitLab

26 May, 2025 15 commits
- [Bugfix]: handle hf-xet CAS error when loading Qwen3 weights in vLLM (#18701) · 243eb919
  dylan authored May 26, 2025
  
  243eb919
- [Misc] add AutoGen integration (#18712) · 0665e299
  Reid authored May 26, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  0665e299
- [Hardware][Intel-Gaudi] [CI/Build] Add tensor parallel size = 2 test to HPU CI (#18709) · e76be065
  Łukasz Durejko authored May 26, 2025
```
Signed-off-by: Lukasz Durejko <ldurejko@habana.ai>
```
  e76be065
- [CI/Build] Split pooling and generation extended language models tests in CI (#18705) · 08777500
  Isotr0py authored May 26, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  08777500
- [Model] Add support for YARN in NemotronNAS models (#18427) · 6d68030f
  Naveassaf authored May 26, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  6d68030f
- [CI] fix dump_input for str type (#18697) · 5a2c76cb
  Ning Xie authored May 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5a2c76cb
- [CI/Build] Replace `math.isclose` with `pytest.approx` (#18703) · 38b13dfe
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  38b13dfe
- [Bugfix] Fix Mistral-format models with sliding window (#18693) · 61a45e7a
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61a45e7a
- [Doc] Fix issue template format (#18699) · 65523a09
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  65523a09
- [GH] Add issue template for reporting CI failures (#18696) · 4b7740a1
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4b7740a1
- [CI] add missing argument (#18694) · 4ea62c0e
  Ning Xie authored May 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  4ea62c0e
- [Bugfix] Fix the lm_head in gpt_bigcode in lora mode (#6357) · 561b77a0
  Maximilien de Bayser authored May 26, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
```
  561b77a0
- refactor: simplify request handler, use positive condition check for handler assignment (#18690) · abd4030d
  CYJiang authored May 26, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  abd4030d
- [Misc] Fixed the abnormally high TTFT issue in the PD disaggregation example (#18644) · 8820821b
  AlexZhao authored May 26, 2025
```
Signed-off-by: zhaohaidao <zhaohaidao2008@hotmail.com>
Signed-off-by: zhaohaiyuan <zhaohaiyuan@xiaohongshu.com>
Co-authored-by: zhaohaiyuan <zhaohaiyuan@xiaohongshu.com>
```
  8820821b
- [CI/Build][Doc] Update `gte-Qwen2-1.5B-instruct` usage (#18683) · fba06427
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  fba06427
25 May, 2025 16 commits
- [Core][Multimodal] Convert PIL Image to array without data copy when hashing (#18682) · 6071e989
  Lukas Geiger authored May 25, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  6071e989
- [Bugfix] Fix profiling dummy data for Pixtral (#18677) · 57fd13a7
  Cyrus Leung authored May 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  57fd13a7
- [Misc] small improve (#18680) · 3a886bd5
  Reid authored May 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  3a886bd5
- [CI/build] fix no regex (#18676) · 35be8fad
  Reid authored May 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  35be8fad
- [Bugfix] Fix cpu usage and cache hit stats reporting on cpu environment (#18674) · f2faac74
  Yuqi Zhang authored May 25, 2025
```
Signed-off-by: zzzyq <zhangyuqi94@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  f2faac74
- [doc] improve readability (#18675) · 279f8545
  Reid authored May 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  279f8545
- [doc] fix broken links (#18671) · 624b77a2
  Reid authored May 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  624b77a2
- [Misc] Reduce logs on startup (#18649) · 503f8487
  Cyrus Leung authored May 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  503f8487
- [BUGFIX] catch subclass first for try...except (#18672) · 44073a7a
  Ning Xie authored May 25, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  44073a7a
- Speed up the `kernels/quantization/` tests (#18669) · 63934543
  Michael Goin authored May 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  63934543
- [VLM] Initialize video input support for InternVL models (#18499) · 75f81750
  Isotr0py authored May 25, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  75f81750
- [Misc][ModelScope] Change to use runtime VLLM_USE_MODELSCOPE (#18655) · 6ab681bc
  Mengqing Cao authored May 25, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  6ab681bc
- [Misc]Replace `cuda` hard code with `current_platform` in Ray (#14668) · cebc22f3
  Chenguang Li authored May 25, 2025
```
Signed-off-by: noemotiovon <757486878@qq.com>
```
  cebc22f3
- [MISC] correct signature for LoaderFunction (#18670) · 6c6dcd86
  Ning Xie authored May 25, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6c6dcd86
- [V1] Fix _pickle.PicklingError: Can't pickle <class... · 7891fdf0
  Seiji Eicher authored May 24, 2025
```
[V1] Fix _pickle.PicklingError: Can't pickle <class 'transformers_modules.deepseek-ai.DeepSeek-V2-Lite... (#18640)
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  7891fdf0
- [BugFix][Spec Decode] Improve Prefix Caching Logic in Speculative Decoding (#18668) · 6825d9a9
  Woosuk Kwon authored May 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6825d9a9
24 May, 2025 9 commits
- [CI/Build] fix permission denied issue (#18645) · b554ab73
  Reid authored May 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  b554ab73
- fix(regression): clone from reference items (#18662) · 9ea7f1ab
  Aaron Pham authored May 24, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  9ea7f1ab
- [CI] enforce import regex instead of re (#18665) · 2807271c
  Aaron Pham authored May 24, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  2807271c
- [BugFix] Fix import error for fused_moe (#18642) · b9018a3f
  wangxiyuan authored May 24, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  b9018a3f
- [MISC] typo fix and clean import (#18664) · 4ceafb62
  Ning Xie authored May 24, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  4ceafb62
- [CI/Build] `chmod +x` to `cleanup_pr_body.sh` (#18650) · 2e670578
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2e670578
- [Doc] Reorganize user guide (#18661) · 1cb194a0
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1cb194a0
- [Model] use AutoWeightsLoader for gpt2 (#18625) · 2cd4d58d
  ztang2370 authored May 24, 2025
```
Signed-off-by: zt2370 <ztang2370@gmail.com>
```
  2cd4d58d
- [Doc] Add community links (#18657) · 6d166a8d
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6d166a8d