Commits · b50602d5f04677e75158c0d2e0e8b51793a5d545 · OpenDAS / vllm_cscc · GitLab

27 May, 2025 4 commits
- [Model][Gemma3] Cast image pixel values already on CPU (#18732) · b50602d5
  Lukas Geiger authored May 27, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  b50602d5
- [V1][Quantization] Add CUDA graph compatible v1 GGUF support (#18646) · 1f1b1bc0
  Isotr0py authored May 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1f1b1bc0
- [Misc] improve web section group title display (#18684) · 1f88dbd2
  Reid authored May 27, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1f88dbd2
- [Model][Gemma3] Simplify image input validation (#18710) · 0eebd748
  Lukas Geiger authored May 27, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  0eebd748
26 May, 2025 20 commits
- Convert `examples` to `ruff-format` (#18400) · 27bebcd8
  Harry Mellor authored May 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  27bebcd8
- [V1][Sampler] Improve performance of FlashInfer sampling by sampling logits... · e7523c2e
  Lukas Geiger authored May 26, 2025
```
[V1][Sampler] Improve performance of FlashInfer sampling by sampling logits instead of probs (#18608)
```
  e7523c2e
- [Bugfix] Fix Llama GGUF initialization (#18717) · a869baca
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a869baca
- [Doc] Move examples and further reorganize user guide (#18666) · 82e2339b
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82e2339b
- [Doc] Improve API docs (#18713) · 9553fdb4
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9553fdb4
- [Bugfix]: handle hf-xet CAS error when loading Qwen3 weights in vLLM (#18701) · 243eb919
  dylan authored May 26, 2025
  
  243eb919
- [Misc] add AutoGen integration (#18712) · 0665e299
  Reid authored May 26, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  0665e299
- [Hardware][Intel-Gaudi] [CI/Build] Add tensor parallel size = 2 test to HPU CI (#18709) · e76be065
  Łukasz Durejko authored May 26, 2025
```
Signed-off-by: Lukasz Durejko <ldurejko@habana.ai>
```
  e76be065
- [CI/Build] Split pooling and generation extended language models tests in CI (#18705) · 08777500
  Isotr0py authored May 26, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  08777500
- [Model] Add support for YARN in NemotronNAS models (#18427) · 6d68030f
  Naveassaf authored May 26, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  6d68030f
- [CI] fix dump_input for str type (#18697) · 5a2c76cb
  Ning Xie authored May 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5a2c76cb
- [CI/Build] Replace `math.isclose` with `pytest.approx` (#18703) · 38b13dfe
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  38b13dfe
- [Bugfix] Fix Mistral-format models with sliding window (#18693) · 61a45e7a
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61a45e7a
- [Doc] Fix issue template format (#18699) · 65523a09
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  65523a09
- [GH] Add issue template for reporting CI failures (#18696) · 4b7740a1
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4b7740a1
- [CI] add missing argument (#18694) · 4ea62c0e
  Ning Xie authored May 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  4ea62c0e
- [Bugfix] Fix the lm_head in gpt_bigcode in lora mode (#6357) · 561b77a0
  Maximilien de Bayser authored May 26, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
```
  561b77a0
- refactor: simplify request handler, use positive condition check for handler assignment (#18690) · abd4030d
  CYJiang authored May 26, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  abd4030d
- [Misc] Fixed the abnormally high TTFT issue in the PD disaggregation example (#18644) · 8820821b
  AlexZhao authored May 26, 2025
```
Signed-off-by: zhaohaidao <zhaohaidao2008@hotmail.com>
Signed-off-by: zhaohaiyuan <zhaohaiyuan@xiaohongshu.com>
Co-authored-by: zhaohaiyuan <zhaohaiyuan@xiaohongshu.com>
```
  8820821b
- [CI/Build][Doc] Update `gte-Qwen2-1.5B-instruct` usage (#18683) · fba06427
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  fba06427
25 May, 2025 16 commits
- [Core][Multimodal] Convert PIL Image to array without data copy when hashing (#18682) · 6071e989
  Lukas Geiger authored May 25, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  6071e989
- [Bugfix] Fix profiling dummy data for Pixtral (#18677) · 57fd13a7
  Cyrus Leung authored May 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  57fd13a7
- [Misc] small improve (#18680) · 3a886bd5
  Reid authored May 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  3a886bd5
- [CI/build] fix no regex (#18676) · 35be8fad
  Reid authored May 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  35be8fad
- [Bugfix] Fix cpu usage and cache hit stats reporting on cpu environment (#18674) · f2faac74
  Yuqi Zhang authored May 25, 2025
```
Signed-off-by: zzzyq <zhangyuqi94@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  f2faac74
- [doc] improve readability (#18675) · 279f8545
  Reid authored May 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  279f8545
- [doc] fix broken links (#18671) · 624b77a2
  Reid authored May 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  624b77a2
- [Misc] Reduce logs on startup (#18649) · 503f8487
  Cyrus Leung authored May 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  503f8487
- [BUGFIX] catch subclass first for try...except (#18672) · 44073a7a
  Ning Xie authored May 25, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  44073a7a
- Speed up the `kernels/quantization/` tests (#18669) · 63934543
  Michael Goin authored May 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  63934543
- [VLM] Initialize video input support for InternVL models (#18499) · 75f81750
  Isotr0py authored May 25, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  75f81750
- [Misc][ModelScope] Change to use runtime VLLM_USE_MODELSCOPE (#18655) · 6ab681bc
  Mengqing Cao authored May 25, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  6ab681bc
- [Misc]Replace `cuda` hard code with `current_platform` in Ray (#14668) · cebc22f3
  Chenguang Li authored May 25, 2025
```
Signed-off-by: noemotiovon <757486878@qq.com>
```
  cebc22f3
- [MISC] correct signature for LoaderFunction (#18670) · 6c6dcd86
  Ning Xie authored May 25, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6c6dcd86
- [V1] Fix _pickle.PicklingError: Can't pickle <class... · 7891fdf0
  Seiji Eicher authored May 24, 2025
```
[V1] Fix _pickle.PicklingError: Can't pickle <class 'transformers_modules.deepseek-ai.DeepSeek-V2-Lite... (#18640)
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  7891fdf0
- [BugFix][Spec Decode] Improve Prefix Caching Logic in Speculative Decoding (#18668) · 6825d9a9
  Woosuk Kwon authored May 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6825d9a9