Commits · 79e4937c65d5f553f878293a0da50f83b3773141 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "910abdbd0866b203df2eb4e5419cada905d3803d"

03 Mar, 2025 17 commits
- [v1] Add comments to the new ragged paged attention Pallas kernel (#14155) · 79e4937c
  iefgnoix authored Mar 03, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  79e4937c
- [Docs] Add GPTQModel (#14056) · cd1d3c3d
  Qubitium-ModelCloud authored Mar 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  cd1d3c3d
- [Kernel] Optimize moe intermediate_cache usage (#13625) · 19d98e0c
  Michael Goin authored Mar 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  19d98e0c
- [Bugfix] Allow shared_experts skip quantization for DeepSeekV2/V3 (#14100) · 2b04c209
  Michael Goin authored Mar 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  2b04c209
- [WIP][[V1][Metrics] Implement max_num_generation_tokens, request_params_n,... · ae122b1c
  Mark McLoughlin authored Mar 03, 2025
```
[WIP][[V1][Metrics] Implement max_num_generation_tokens,  request_params_n, and request_params_max_tokens metrics (#14055)
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  ae122b1c
- [V1] Simplify stats logging (#14082) · 872db2be
  Nick Hill authored Mar 03, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  872db2be
- [V0][Metrics] Deprecate some KV/prefix cache metrics (#14136) · 2dfdfed8
  Mark McLoughlin authored Mar 03, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  2dfdfed8
- [V0][Metrics] Remove unimplemented `vllm:tokens_total` (#14134) · c41d2715
  Mark McLoughlin authored Mar 03, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  c41d2715
- Fix `head_dim` not existing in all model configs (Transformers backend) (#14141) · 91373a0d
  Harry Mellor authored Mar 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  91373a0d
- [ROCm] Faster Custom Paged Attention kernels (#12348) · 848a6438
  TJian authored Mar 04, 2025
  
  848a6438
- Improve the docs for `TransformersModel` (#14147) · 98175b28
  Harry Mellor authored Mar 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  98175b28
- [V1] Refactor parallel sampling support (#13774) · 4167252e
  Mark McLoughlin authored Mar 03, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  4167252e
- [Build] Make sure local main branch is synced when VLLM_USE_PRECOMPILED=1 (#13921) · f35f8e22
  Cody Yu authored Mar 03, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  f35f8e22
- [Misc][Platform] Move use allgather to platform (#14010) · b87c21fc
  Mengqing Cao authored Mar 03, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  b87c21fc
- [Misc] duplicate code in deepseek_v2 (#14106) · e584b85a
  wang.yuqi authored Mar 03, 2025
  
  e584b85a
- [Bugfix] Explicitly include "omp.h" for MacOS to avoid installation failure (#14051) · 09e56f92
  Sheng Yao authored Mar 03, 2025
  
  09e56f92
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
02 Mar, 2025 4 commits
- [v0][structured output] Support reasoning output (#12955) · bf33700e
  Ce Gao authored Mar 03, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  bf33700e
- [Doc] Source building add clone step (#14086) · bc6ccb98
  qux-bbb authored Mar 02, 2025
```
Signed-off-by: qux-bbb <1147635419@qq.com>
```
  bc6ccb98
- [Misc] Accurately capture the time of loading weights (#14063) · 82fbeae9
  Jun Duan authored Mar 01, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  82fbeae9
- [Model] Add LoRA support for TransformersModel (#13770) · cc5e8f6d
  Jee Jee Li authored Mar 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  cc5e8f6d
01 Mar, 2025 10 commits
- [v1] Add `__repr__` to KVCacheBlock to avoid recursive print (#14081) · d54990da
  Chen Zhang authored Mar 02, 2025
  
  d54990da
- [v1][Bugfix] Only cache blocks that are not in the prefix cache (#14073) · b9f1d429
  Chen Zhang authored Mar 01, 2025
  
  b9f1d429
- [ROCm][V1][Bugfix] Add get_builder_cls method to the ROCmAttentionBackend class (#14065) · b28246f6
  Sage Moore authored Feb 28, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  b28246f6
- [V1][Minor] Do not print attn backend twice (#13985) · 3b5567a2
  Woosuk Kwon authored Feb 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  3b5567a2
- [Doc] Consolidate `whisper` and `florence2` examples (#14050) · fdcc4053
  Isotr0py authored Mar 01, 2025
  
  fdcc4053
- [Documentation] Add more deployment guide for Kubernetes deployment (#13841) · 8994dabc
  Kuntai Du authored Feb 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  8994dabc
- [Bugfix][V1][Minor] Fix shutting_down flag checking in V1 MultiprocExecutor (#14053) · 02296f42
  Li, Jiang authored Mar 01, 2025
  
  02296f42
- [Misc][Kernel]: Add GPTQAllSpark Quantization (#12931) · 6a92ff93
  YajieWang authored Mar 01, 2025
  
  6a92ff93
- [Bugfix] Add file lock for ModelScope download (#14060) · 6a84164a
  Jee Jee Li authored Mar 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6a84164a
- [Docs] Add `pipeline_parallel_size` to optimization docs (#14059) · f64ffa8c
  Brayden Zhong authored Mar 01, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  f64ffa8c
28 Feb, 2025 9 commits
- [torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename... · bd56c983
  Luka Govedič authored Feb 28, 2025
```
[torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename RedundantReshapesPass to NoopEliminationPass (#10902)
Signed-off-by: luka <luka@neuralmagic.com>
```
  bd56c983
- [core] Bump ray to 2.43 (#13994) · 084bbac8
  Rui Qiao authored Feb 28, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  084bbac8
- [v1] Move block pool operations to a separate class (#13973) · 28943d36
  Chen Zhang authored Mar 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  28943d36
- Add RELEASE.md (#13926) · b526ca67
  Andrey Talman authored Feb 28, 2025
```
Signed-off-by: atalman <atalman@fb.com>
```
  b526ca67
- [v1] Cleanup the BlockTable in InputBatch (#13977) · e7bd944e
  Chen Zhang authored Mar 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  e7bd944e
- [V1][TPU] Integrate the new ragged paged attention kernel with vLLM v1 on TPU (#13379) · c3b6559a
  iefgnoix authored Feb 28, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  c3b6559a
- Fix entrypoint tests for embedding models (#14052) · 4be4b26c
  Harry Mellor authored Feb 28, 2025
  
  4be4b26c
- [Doc] Fix ROCm documentation (#14041) · 2aed2c9f
  Brayden Zhong authored Feb 28, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2aed2c9f
- [Bugfix] Initialize attention bias on the same device as Query/Key/Value for QwenVL Series (#14031) · 9b61dd41
  Yang Liu authored Feb 28, 2025
  
  9b61dd41