Commits · d08b356ee08dc8e0b0dd052ed7bef5245e21d7af · OpenDAS / vllm_cscc · GitLab

22 Jan, 2026 40 commits
- [Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619) · d08b356e
  Xin Yang authored Jan 22, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d08b356e
- [Refactor] Remove unused tpu files (#32610) · f7448101
  Wentao Ye authored Jan 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f7448101
- Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3
  Eldar Kurtić authored Jan 22, 2026
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  44f08af3
- [Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 (#32795) · 955b43a5
  Matthew Bonanni authored Jan 22, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  955b43a5
- [CPU Backend] [Perf] Accelerate tensor-parallel/data-parallel inference across... · 744ef304
  Fadi Arafeh authored Jan 22, 2026
```
[CPU Backend] [Perf] Accelerate tensor-parallel/data-parallel inference across NUMA domains on Arm (#32792)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  744ef304
- [CI][Attention] Add more CI dependencies for attention tests (#32487) · 300622e6
  Matthew Bonanni authored Jan 22, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  300622e6
- [Feature] Add --ssl-ciphers CLI argument for TLS cipher control (#30937) · 69d09fdd
  RickyChen / 陳昭儒 authored Jan 23, 2026
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
```
  69d09fdd
- Support custom URI schemes and trace handlers for profiler (#32393) · 3a63be0f
  David Ramon Prados authored Jan 22, 2026
  
  3a63be0f
- [UX] Default api_server_count to dp_size if not specified (#32525) · 803e3f3f
  Tyler Michael Smith authored Jan 22, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  803e3f3f
- [MISC] Add .cursor to .gitignore (#32868) · 70917b1c
  Vadim Gimpelson authored Jan 22, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  70917b1c
- [Hardware][AMD][CI][Bugfix] Fix regressions from deprecated env vars (#32837) · c517d8c9
  Matt authored Jan 22, 2026
```
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  c517d8c9
- [Bugfix] ModelScope is supported when downloading LORA models. (#32844) · fc37187a
  Xu Jinyang authored Jan 23, 2026
```
Signed-off-by: AuYang <459461160@qq.com>
```
  fc37187a
- Support bge-m3 sparse embeddings and colbert embeddings (#14526) · ff365eea
  Maximilien de Bayser authored Jan 22, 2026
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
```
  ff365eea
- [Misc] Bump opencv-python dependecy version to 4.13 (#32668) · 444e2e7e
  Isotr0py authored Jan 22, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  444e2e7e
- [Cleanup] Move scheduler `get_routed_experts` logic to separate method (#32706) · bc14663e
  Nick Hill authored Jan 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  bc14663e
- [torch.compile] Improve Cold Start for MoEs (#32805) · 654a71fc
  Richard Zou authored Jan 22, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  654a71fc
- [Misc][BE] Turn on strict type coverage for vllm/compilation (#31756) · 15e302df
  Lucas Kabela authored Jan 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  15e302df
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
- OffloadingConnector: Support kernel_block_size != block_size (#30692) · 421012b6
  Or Ozeri authored Jan 22, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  421012b6
- [Frontend] add prompt_cache_key for openresponses (#32824) · 841d53aa
  Chauncey authored Jan 22, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  841d53aa
- [CI] refactor release pipeline config into groups (#32833) · 1752262e
  Shengqi Chen authored Jan 22, 2026
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  1752262e
- [Bugfix] Fix Whisper/encoder-decoder GPU memory leak (#32789) · ea6102b8
  Nicolò Lucchesi authored Jan 22, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  ea6102b8
- [Frontend][2/n] Make pooling entrypoints request schema consensus | ChatRequest (#32574) · 328cbb27
  wang.yuqi authored Jan 22, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  328cbb27
- Enable Cross layers KV cache layout at NIXL Connector (#30207) · 64e3d67a
  liranschour authored Jan 22, 2026
```
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
```
  64e3d67a
- [Benchmark] Don't default to `temperature==0` in `vllm bench serve` (#32723) · 098b2d66
  Nick Hill authored Jan 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  098b2d66
- [Misc] Replace urllib's `urlparse` with urllib3's `parse_url` (#32746) · 8ebf271b
  Isotr0py authored Jan 22, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8ebf271b
- [AMD][ROCm] MoRI EP: a high-performance all2all backend (#28664) · 49a12622
  Alex Sun authored Jan 22, 2026
```
Signed-off-by: Alex Sun <alex.s@amd.com>
```
  49a12622
- [Model] Extend `collect_children` and `no_init_weights` contexts (#32757) · 2b8a38b6
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2b8a38b6
- [bench] add start_times field to vllm bench serve json result (#32667) · 1bf1a34b
  Kebe authored Jan 22, 2026
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  1bf1a34b
- [ROCm][CI][Docs] Add comment explaining TRITON_ATTN fallback for ROCm (#32835) · a8102998
  Andreas Karatzas authored Jan 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a8102998
- [ROCm][CI] Fix AITER test flakiness by using explicit attention backend (#32346) · eb1629da
  Andreas Karatzas authored Jan 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  eb1629da
- [ROCm][CI] Lower Acceptance Len Threshold For test_draft_model_quantization (#32731) · 019e2c3b
  Micah Williamson authored Jan 21, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  019e2c3b
- Upgrade transformers-4.57.5 (#32287) · f5fdec8c
  Huy Do authored Jan 21, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  f5fdec8c
- [Llama.py -> mistral.py] Extract mistral-only relevant code into separate file (#32780) · 1579c9b5
  Patrick von Platen authored Jan 22, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  1579c9b5
- [FlashMLA] Update FlashMLA to expose new arguments (#32810) · 889722f3
  Lucas Wilkinson authored Jan 21, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  889722f3
- [ROCm][CI] fix get_valid_backends (#32787) · 49d96538
  Divakar Verma authored Jan 21, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  49d96538
- [Docs] Remove outdated async_scheduling limitation with speculative decoding (#32775) · a1d82466
  Ifta khairul Alam Adil authored Jan 22, 2026
```
Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
Signed-off-by: Ifta khairul Alam Adil <25082512+ikaadil@users.noreply.github.com>
```
  a1d82466
- Cleanup some huggingface_hub-related stuff (#32788) · 24a163ed
  Lucain authored Jan 22, 2026
  
  24a163ed
- [EC Connector] Optimize remote cache check in scheduler (#32585) · 378385b9
  knlnguyen1802 authored Jan 22, 2026
```
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
```
  378385b9
- [Bugfix] Fix potential EAGLE spec decode segfault during graph capture (#32818) · c5487e2b
  Matt authored Jan 21, 2026
```
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  c5487e2b