Commits · 794ae1f551e4152a258f88c0c914ce5ea130bd05 · OpenDAS / vllm_cscc · GitLab

28 May, 2025 4 commits
- [rocm] Fix wrong attention log (#18764) · 794ae1f5
  fxmarty-amd authored May 28, 2025
```
Signed-off-by: Felix Marty <felmarty@amd.com>
```
  794ae1f5
- [Core] Improve Tensor serialisation (#18774) · d73a9457
  Lukas Geiger authored May 28, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  d73a9457
- [Build] Fixes for CMake install (#18570) · a3896c7f
  Luka Govedič authored May 27, 2025
  
  a3896c7f
- [Bugfix] Disable prefix caching by default for benchmark (#18771) · 51e98e4f
  cascade authored May 27, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  51e98e4f
27 May, 2025 24 commits
- Support datasets in `vllm bench serve` and sync with benchmark_[serving,datasets].py (#18566) · e56f44d9
  Michael Goin authored May 27, 2025
  
  e56f44d9
- [Neuron] Support quantization on neuron (#18283) · e0cbad4e
  Satyajith Chilappagari authored May 27, 2025
```
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
```
  e0cbad4e
- [CI/Build] [TPU] Fix TPU CI exit code (#18282) · b48d5cca
  Carol Zheng authored May 27, 2025
```
Signed-off-by: Carol Zheng <cazheng@google.com>
```
  b48d5cca
- [Bugfix] Mistral tool calling when content is list (#18729) · 58738772
  Michael Goin authored May 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  58738772
- [Core] Automatically cast multi-modal input dtype (#18756) · 696259ca
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  696259ca
- optimize get_kv_cache_torch_dtype (#18531) · 6b6d4961
  chunxiaozheng authored May 27, 2025
```
Signed-off-by: idellzheng <idellzheng@tencent.com>
```
  6b6d4961
- Disable prefix cache by default for benchmark (#18639) · aaa4ac1c
  cascade authored May 27, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  aaa4ac1c
- [V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010) · 06a03380
  Mark McLoughlin authored May 27, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  06a03380
- [CI/Build] Remove imports of built-in `re` (#18750) · 4318c055
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4318c055
- [Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c
  Hyogeun Oh (오효근) authored May 27, 2025
```
[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  a68e293c
- [BUG FIX] minicpm (#18739) · 68811079
  Shawn Huang authored May 27, 2025
```
Signed-off-by: huangyuxiang03 <huangyx0321@gmail.com>
Co-authored-by: huangyuxiang03 <huangyx0321@gmail.com>
```
  68811079
- [Build] fix cpu build missing libtbbmalloc.so (#18744) · e0f0ff87
  Kebe authored May 27, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  e0f0ff87
- Minor fix about MooncakeStoreConnector (#18721) · c24b1572
  maobaolong authored May 27, 2025
```
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
```
  c24b1572
- [Doc] cleanup deprecated flag for doc (#18715) · 4693a343
  Calvin Chen authored May 27, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  4693a343
- [Hardware][Intel-Gaudi] [CI/Build] Fix multiple containers using the same name... · bbd9a84d
  Łukasz Durejko authored May 27, 2025
```
[Hardware][Intel-Gaudi] [CI/Build] Fix multiple containers using the same name in run-hpu-test.sh (#18752)
Signed-off-by: Lukasz Durejko <ldurejko@habana.ai>
```
  bbd9a84d
- feat(rocm-support): support mamba2 on rocm (#18565) · a547aeb8
  almersawi authored May 27, 2025
```
Signed-off-by: Islam Almersawi <islam.almersawi@openinnovation.ai>
Co-authored-by: Islam Almersawi <islam.almersawi@openinnovation.ai>
```
  a547aeb8
- [Misc] improve docs (#18734) · fc6d0c29
  Reid authored May 27, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  fc6d0c29
- [Doc] Update reproducibility doc and example (#18741) · 753944fa
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  753944fa
- [Doc] Update OOT model docs (#18742) · 25a817f2
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  25a817f2
- [FEAT] [ROCm] Upgrade AITER Fused MoE kernels. (#18271) · d260f799
  vllmellm authored May 27, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  d260f799
- [Model][Gemma3] Cast image pixel values already on CPU (#18732) · b50602d5
  Lukas Geiger authored May 27, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  b50602d5
- [V1][Quantization] Add CUDA graph compatible v1 GGUF support (#18646) · 1f1b1bc0
  Isotr0py authored May 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1f1b1bc0
- [Misc] improve web section group title display (#18684) · 1f88dbd2
  Reid authored May 27, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1f88dbd2
- [Model][Gemma3] Simplify image input validation (#18710) · 0eebd748
  Lukas Geiger authored May 27, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  0eebd748
26 May, 2025 12 commits
- Convert `examples` to `ruff-format` (#18400) · 27bebcd8
  Harry Mellor authored May 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  27bebcd8
- [V1][Sampler] Improve performance of FlashInfer sampling by sampling logits... · e7523c2e
  Lukas Geiger authored May 26, 2025
```
[V1][Sampler] Improve performance of FlashInfer sampling by sampling logits instead of probs (#18608)
```
  e7523c2e
- [Bugfix] Fix Llama GGUF initialization (#18717) · a869baca
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a869baca
- [Doc] Move examples and further reorganize user guide (#18666) · 82e2339b
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82e2339b
- [Doc] Improve API docs (#18713) · 9553fdb4
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9553fdb4
- [Bugfix]: handle hf-xet CAS error when loading Qwen3 weights in vLLM (#18701) · 243eb919
  dylan authored May 26, 2025
  
  243eb919
- [Misc] add AutoGen integration (#18712) · 0665e299
  Reid authored May 26, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  0665e299
- [Hardware][Intel-Gaudi] [CI/Build] Add tensor parallel size = 2 test to HPU CI (#18709) · e76be065
  Łukasz Durejko authored May 26, 2025
```
Signed-off-by: Lukasz Durejko <ldurejko@habana.ai>
```
  e76be065
- [CI/Build] Split pooling and generation extended language models tests in CI (#18705) · 08777500
  Isotr0py authored May 26, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  08777500
- [Model] Add support for YARN in NemotronNAS models (#18427) · 6d68030f
  Naveassaf authored May 26, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  6d68030f
- [CI] fix dump_input for str type (#18697) · 5a2c76cb
  Ning Xie authored May 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5a2c76cb
- [CI/Build] Replace `math.isclose` with `pytest.approx` (#18703) · 38b13dfe
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  38b13dfe