Commits · 656fd72976a86f4bc1887be228dac0ab71c56c71 · OpenDAS / vllm_cscc

"tests/entrypoints/openai/models/test_models.py" did not exist on "06b2550cbb56f4a538f43c56addf20f4d2d19cad"

01 Apr, 2025 13 commits
- [Misc] Fix speculative config repr string (#15860) · 656fd729
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  656fd729
- [Misc] Enable V1 LoRA by default (#15320) · 79455cf4
  Varun Sundar Rabindranath authored Apr 01, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  79455cf4
- [Feature] specify model in config.yaml (#15798) · 30d6a015
  Wei Zeng authored Apr 01, 2025
```
Signed-off-by: weizeng <weizeng@roblox.com>
```
  30d6a015
- [V1] Implement sliding window attention in kv_cache_manager (#14097) · 3a5f0afc
  Chen Zhang authored Apr 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  3a5f0afc
- [ROCm] Use device name in the warning (#15838) · c7e63aa4
  Gregory Shtrasberg authored Apr 01, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  c7e63aa4
- [sleep mode] clear pytorch cache after sleep (#15248) · 4a9ce178
  Lionel Villard authored Apr 01, 2025
```
Signed-off-by: <villard@us.ibm.com>
```
  4a9ce178
- [V1] TPU - Fix fused MOE (#15834) · 7e4e709b
  Alexander Matveev authored Apr 01, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  7e4e709b
- [Bugfix]: Fix is_embedding_layer condition in VocabParallelEmbedding (#15824) · 63d8eabe
  Alexey Kiryushin authored Apr 01, 2025
```
Signed-off-by: alexwl <alexey.a.kiryushin@gmail.com>
```
  63d8eabe
- [Bugfix] Fix extra comma (#15851) · e830b013
  Percy authored Apr 01, 2025
```
Signed-off-by: haochengxia <xhc_1007@163.com>
```
  e830b013
- [Bugfix][Model] fix mllama multi-image (#14883) · ff647398
  Yan Ma authored Apr 01, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  ff647398
- [Frontend] Add Phi-4-mini function calling support (#14886) · a164aea3
  Kinfey authored Apr 01, 2025
```
Signed-off-by: Kinfey <kinfeylo@microsoft.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a164aea3
- Rename fallback model and refactor supported models section (#15829) · a76f547e
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a76f547e
- [Distributed] Add custom allreduce support for ROCM (#14125) · b7b7676d
  Ilya Markov authored Apr 01, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  b7b7676d
31 Mar, 2025 13 commits
- Move dockerfiles into their own directory (#14549) · e6e3c55e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6e3c55e
- [V1][Core] Remove unused speculative config from scheduler (#15818) · f98a4920
  Mark McLoughlin authored Mar 31, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  f98a4920
- Fix Transformers backend compatibility check (#15290) · d4bfc23e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d4bfc23e
- [V1] TPU CI - Add basic perf regression test (#15414) · 9a2160fa
  Alexander Matveev authored Mar 31, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  9a2160fa
- fix: change GB to GiB in logging close #14979 (#15807) · 2de41182
  yihong authored Apr 01, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  2de41182
- [V1][Spec Decode] Remove deprecated spec decode config params (#15466) · 239b7bef
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  239b7bef
- [Bugfix] Check dimensions of multimodal embeddings in V1 (#15816) · 09e974d4
  Cyrus Leung authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09e974d4
- [Bugfix] Fix missing return value in load_weights method of adapters.py (#15542) · 037bcd94
  Mrm authored Mar 31, 2025
```
Signed-off-by: noc-turne <2270929247@qq.com>
```
  037bcd94
- [Bugfix] Fix Crashing When Loading Modules With Batchnorm Stats (#15813) · c2e7507a
  Alex Brooks authored Mar 31, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  c2e7507a
- [Model] Update support for NemotronNAS models (#15008) · 3aa2b6a6
  Naveassaf authored Mar 31, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  3aa2b6a6
- [V1] Fully Transparent Implementation of CPU Offloading (#15354) · 555aa219
  youkaichao authored Mar 31, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  555aa219
- [Feature][ROCm]Enable fusion pass for torch.compile on ROCm (#15050) · e8582945
  Charlie Fu authored Mar 31, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  e8582945
- [Misc] update the comments (#15780) · 18ed3132
  Chengyang LIU authored Mar 30, 2025
```
Signed-off-by: chengyang liu <lcy4869@gmail.com>
Co-authored-by: chengyang liu <lcy4869@gmail.com>
```
  18ed3132
30 Mar, 2025 6 commits
- [V1][Scheduler] Avoid calling `_try_schedule_encoder_inputs` for every request (#15778) · 9b459eca
  Woosuk Kwon authored Mar 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9b459eca
- fix: Comments to English for better dev experience (#15768) · 70fedd0f
  yihong authored Mar 31, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  70fedd0f
- [Bugfix] Added `embed_is_patch` mask for fuyu model (#15731) · bb103b29
  kYLe authored Mar 30, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
```
  bb103b29
- [V1] Override `mm_counts` for dummy data creation (#15703) · 803d5c35
  Cyrus Leung authored Mar 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  803d5c35
- fix test_phi3v (#15321) · 7fd8c0f8
  pansicheng authored Mar 30, 2025
```
Signed-off-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  7fd8c0f8
- [Bugfix] Fix Mistral guided generation using xgrammar (#15704) · 6909a762
  Julien Denize authored Mar 30, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6909a762
29 Mar, 2025 8 commits
- [Bugfix] Fix Mllama interleaved images input support (#15564) · 3c0ff914
  Isotr0py authored Mar 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  3c0ff914
- [V1][Minor] Simplify rejection sampler's parse_output (#15741) · 2bc4be4e
  Woosuk Kwon authored Mar 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2bc4be4e
- [V1] Support interleaved modality items (#15605) · c67abd61
  Roger Wang authored Mar 29, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  c67abd61
- [Feature][Disaggregated] Support XpYd disaggregated prefill with MooncakeStore (#12957) · 6fa7cd3d
  shangmingc authored Mar 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6fa7cd3d
- [V1] [Feature] Collective RPC (#15444) · 94744ba4
  wwl2755 authored Mar 29, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  94744ba4
- [FEAT] [ROCm] Add AITER int8 scaled gemm kernel (#15433) · 4965ec42
  TJian authored Mar 29, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  4965ec42
- [Kernel][TPU][ragged-paged-attn] vLLM code change for PR#8896 (#15659) · 7c1f7600
  yarongmu-google authored Mar 28, 2025
```
Signed-off-by: Yarong Mu <ymu@google.com>
```
  7c1f7600
- [TPU][V1][Bugfix] Fix w8a8 recompiilation with GSM8K (#15714) · da461f3c
  Nicolò Lucchesi authored Mar 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  da461f3c