Commits · f35f8e2242db224a92a14e084d502eec67d56da9 · OpenDAS / vllm_cscc · GitLab

03 Mar, 2025 5 commits
- [Build] Make sure local main branch is synced when VLLM_USE_PRECOMPILED=1 (#13921) · f35f8e22
  Cody Yu authored Mar 03, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  f35f8e22
- [Misc][Platform] Move use allgather to platform (#14010) · b87c21fc
  Mengqing Cao authored Mar 03, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  b87c21fc
- [Misc] duplicate code in deepseek_v2 (#14106) · e584b85a
  wang.yuqi authored Mar 03, 2025
  
  e584b85a
- [Bugfix] Explicitly include "omp.h" for MacOS to avoid installation failure (#14051) · 09e56f92
  Sheng Yao authored Mar 03, 2025
  
  09e56f92
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
02 Mar, 2025 4 commits
- [v0][structured output] Support reasoning output (#12955) · bf33700e
  Ce Gao authored Mar 03, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  bf33700e
- [Doc] Source building add clone step (#14086) · bc6ccb98
  qux-bbb authored Mar 02, 2025
```
Signed-off-by: qux-bbb <1147635419@qq.com>
```
  bc6ccb98
- [Misc] Accurately capture the time of loading weights (#14063) · 82fbeae9
  Jun Duan authored Mar 01, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  82fbeae9
- [Model] Add LoRA support for TransformersModel (#13770) · cc5e8f6d
  Jee Jee Li authored Mar 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  cc5e8f6d
01 Mar, 2025 10 commits
- [v1] Add `__repr__` to KVCacheBlock to avoid recursive print (#14081) · d54990da
  Chen Zhang authored Mar 02, 2025
  
  d54990da
- [v1][Bugfix] Only cache blocks that are not in the prefix cache (#14073) · b9f1d429
  Chen Zhang authored Mar 01, 2025
  
  b9f1d429
- [ROCm][V1][Bugfix] Add get_builder_cls method to the ROCmAttentionBackend class (#14065) · b28246f6
  Sage Moore authored Feb 28, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  b28246f6
- [V1][Minor] Do not print attn backend twice (#13985) · 3b5567a2
  Woosuk Kwon authored Feb 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  3b5567a2
- [Doc] Consolidate `whisper` and `florence2` examples (#14050) · fdcc4053
  Isotr0py authored Mar 01, 2025
  
  fdcc4053
- [Documentation] Add more deployment guide for Kubernetes deployment (#13841) · 8994dabc
  Kuntai Du authored Feb 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  8994dabc
- [Bugfix][V1][Minor] Fix shutting_down flag checking in V1 MultiprocExecutor (#14053) · 02296f42
  Li, Jiang authored Mar 01, 2025
  
  02296f42
- [Misc][Kernel]: Add GPTQAllSpark Quantization (#12931) · 6a92ff93
  YajieWang authored Mar 01, 2025
  
  6a92ff93
- [Bugfix] Add file lock for ModelScope download (#14060) · 6a84164a
  Jee Jee Li authored Mar 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6a84164a
- [Docs] Add `pipeline_parallel_size` to optimization docs (#14059) · f64ffa8c
  Brayden Zhong authored Mar 01, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  f64ffa8c
28 Feb, 2025 19 commits
- [torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename... · bd56c983
  Luka Govedič authored Feb 28, 2025
```
[torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename RedundantReshapesPass to NoopEliminationPass (#10902)
Signed-off-by: luka <luka@neuralmagic.com>
```
  bd56c983
- [core] Bump ray to 2.43 (#13994) · 084bbac8
  Rui Qiao authored Feb 28, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  084bbac8
- [v1] Move block pool operations to a separate class (#13973) · 28943d36
  Chen Zhang authored Mar 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  28943d36
- Add RELEASE.md (#13926) · b526ca67
  Andrey Talman authored Feb 28, 2025
```
Signed-off-by: atalman <atalman@fb.com>
```
  b526ca67
- [v1] Cleanup the BlockTable in InputBatch (#13977) · e7bd944e
  Chen Zhang authored Mar 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  e7bd944e
- [V1][TPU] Integrate the new ragged paged attention kernel with vLLM v1 on TPU (#13379) · c3b6559a
  iefgnoix authored Feb 28, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  c3b6559a
- Fix entrypoint tests for embedding models (#14052) · 4be4b26c
  Harry Mellor authored Feb 28, 2025
  
  4be4b26c
- [Doc] Fix ROCm documentation (#14041) · 2aed2c9f
  Brayden Zhong authored Feb 28, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2aed2c9f
- [Bugfix] Initialize attention bias on the same device as Query/Key/Value for QwenVL Series (#14031) · 9b61dd41
  Yang Liu authored Feb 28, 2025
  
  9b61dd41
- [VLM][Bugfix] Enable specifying prompt target via index (#14038) · f7bee5c8
  Cyrus Leung authored Feb 28, 2025
  
  f7bee5c8
- [Bugfix] Fix MoeWNA16Method activation (#14024) · e0734387
  Jee Jee Li authored Feb 28, 2025
  
  e0734387
- Update AutoAWQ docs (#14042) · f58f8b5c
  Harry Mellor authored Feb 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f58f8b5c
- [V1][Minor] Restore V1 compatibility with LLMEngine class (#13090) · b3f7aacc
  Thibault Schueller authored Feb 28, 2025
  
  b3f7aacc
- [Hardware][Intel-Gaudi] Regional compilation support (#13213) · b91660dd
  Kacper Pietkun authored Feb 28, 2025
  
  b91660dd
- Use smaller embedding model when not testing model specifically (#13891) · 76c89fca
  Harry Mellor authored Feb 28, 2025
  
  76c89fca
- [Bugfix][Disaggregated] patch the inflight batching on the decode node in... · b9e41734
  Mathis Felardos authored Feb 28, 2025
```
[Bugfix][Disaggregated] patch the inflight batching on the decode node in SimpleConnector to avoid hangs in SimpleBuffer (nccl based) (#13987)
Signed-off-by: Mathis Felardos <mathis@mistral.ai>
```
  b9e41734
- [Doc] Move multimodal Embedding API example to Online Serving page (#14017) · 1088f062
  Cyrus Leung authored Feb 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1088f062
- [Bugfix] Check that number of images matches number of <|image|> tokens with mllama (#13911) · 73e0225e
  Travis Johnson authored Feb 27, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  73e0225e
- [V1]`SupportsV0Only` protocol for model definitions (#13959) · 6c85da3a
  Roger Wang authored Feb 27, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  6c85da3a
27 Feb, 2025 2 commits
- [Misc] Print FusedMoE detail info (#13974) · 67fc4268
  Jee Jee Li authored Feb 28, 2025
  
  67fc4268
- [Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626) · 9804145c
  Benjamin Chislett authored Feb 27, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  9804145c