Commits · 257e200a2537a8175392d3bb285473ab80867576 · OpenDAS / vllm_cscc · GitLab

"tests/kernels/quantization/untest_marlin_gemm.py" did not exist on "0f41fbe5a370c0b87bb9a038be592c9272d46364"

05 Mar, 2025 6 commits
- [V1][Frontend] Add Testing For V1 Runtime Parameters (#14159) · 257e200a
  Robert Shaw authored Mar 05, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
  257e200a
- [Bugfix][V1] Fix allowed_token_ids for v1 Sampler (#14169) · 8d6cd32b
  Lu Fang authored Mar 05, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d6cd32b
- [Misc][V1] Avoid using `envs.VLLM_USE_V1` in mm processing (#14256) · ec79b67c
  Roger Wang authored Mar 04, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  ec79b67c
- [V1] EP/TP MoE + DP Attention (#13931) · 72c62eae
  Tyler Michael Smith authored Mar 05, 2025
  
  72c62eae
- [V1][Bugfix] Do not reset prefix caching metrics (#14235) · ade3f7d9
  Cody Yu authored Mar 04, 2025
  
  ade3f7d9
- [V1][TPU] TPU multimodal model support for ragged attention (#14158) · fbfc3ee3
  Michael Goin authored Mar 04, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  fbfc3ee3
04 Mar, 2025 2 commits
- [TPU][Profiler] Support start_profile/stop_profile in TPU worker (#13988) · beebf474
  Siyuan Liu authored Mar 04, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  beebf474
- [V1][BugFix] Fix remaining sync engine client shutdown errors/hangs (#13869) · 5db6b2c9
  Nick Hill authored Mar 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5db6b2c9
03 Mar, 2025 5 commits
- [v1] Add comments to the new ragged paged attention Pallas kernel (#14155) · 79e4937c
  iefgnoix authored Mar 03, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  79e4937c
- [WIP][[V1][Metrics] Implement max_num_generation_tokens, request_params_n,... · ae122b1c
  Mark McLoughlin authored Mar 03, 2025
```
[WIP][[V1][Metrics] Implement max_num_generation_tokens,  request_params_n, and request_params_max_tokens metrics (#14055)
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  ae122b1c
- [V1] Simplify stats logging (#14082) · 872db2be
  Nick Hill authored Mar 03, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  872db2be
- [V1] Refactor parallel sampling support (#13774) · 4167252e
  Mark McLoughlin authored Mar 03, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  4167252e
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
02 Mar, 2025 1 commit
- [Misc] Accurately capture the time of loading weights (#14063) · 82fbeae9
  Jun Duan authored Mar 01, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  82fbeae9
01 Mar, 2025 4 commits
- [v1] Add `__repr__` to KVCacheBlock to avoid recursive print (#14081) · d54990da
  Chen Zhang authored Mar 02, 2025
  
  d54990da
- [v1][Bugfix] Only cache blocks that are not in the prefix cache (#14073) · b9f1d429
  Chen Zhang authored Mar 01, 2025
  
  b9f1d429
- [ROCm][V1][Bugfix] Add get_builder_cls method to the ROCmAttentionBackend class (#14065) · b28246f6
  Sage Moore authored Feb 28, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  b28246f6
- [Bugfix][V1][Minor] Fix shutting_down flag checking in V1 MultiprocExecutor (#14053) · 02296f42
  Li, Jiang authored Mar 01, 2025
  
  02296f42
28 Feb, 2025 3 commits
- [v1] Move block pool operations to a separate class (#13973) · 28943d36
  Chen Zhang authored Mar 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  28943d36
- [v1] Cleanup the BlockTable in InputBatch (#13977) · e7bd944e
  Chen Zhang authored Mar 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  e7bd944e
- [V1][TPU] Integrate the new ragged paged attention kernel with vLLM v1 on TPU (#13379) · c3b6559a
  iefgnoix authored Feb 28, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  c3b6559a
27 Feb, 2025 4 commits
- [Attention] Flash MLA for V1 (#13867) · 2e94b9cf
  Lucas Wilkinson authored Feb 27, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Yang Chen <yangche@fb.com>
```
  2e94b9cf
- [V1][Minor] Minor cleanup for GPU Model Runner (#13983) · cd813c6d
  Woosuk Kwon authored Feb 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cd813c6d
- [Attention] MLA support for V1 (#13789) · 58d1b2aa
  Yang Chen authored Feb 27, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
  58d1b2aa
- [V1][Metrics] Handle preemptions (#13169) · cd711c48
  Mark McLoughlin authored Feb 27, 2025
  
  cd711c48
26 Feb, 2025 1 commit
- [V1][Spec Decode] Change Spec Decode Rejection Sampling API (#13729) · 5629f26d
  Lily Liu authored Feb 25, 2025
  
  5629f26d
25 Feb, 2025 4 commits
- [Core] LoRA V1 - Add add/pin/list/remove_lora functions (#13705) · 03f48b3d
  Varun Sundar Rabindranath authored Feb 25, 2025
  
  03f48b3d
- [V1][Metrics] Implement vllm:lora_requests_info metric (#13504) · bc32bc73
  Mark McLoughlin authored Feb 25, 2025
  
  bc32bc73
- [Misc] set single whitespace between log sentences (#13771) · 51010a18
  cjackal authored Feb 25, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  51010a18
- Remove unused kwargs from model definitions (#13555) · cdc1fa12
  Harry Mellor authored Feb 25, 2025
  
  cdc1fa12
24 Feb, 2025 3 commits
- Revert "[V1][Core] Fix memory issue with logits & sampling" (#13775) · 22757848
  Roger Wang authored Feb 24, 2025
  
  22757848
- [V1] V1 engine implements parallel sampling (AsyncLLM and LLMEngine) (#10980) · befc402d
  afeldman-nm authored Feb 24, 2025
```
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  befc402d
- [V1][Core] Fix memory issue with logits & sampling (#13721) · 437b76ff
  Roger Wang authored Feb 24, 2025
  
  437b76ff
23 Feb, 2025 2 commits

[V1][BugFix] Fix engine core client shutdown hangs (#13298) · cbae7af5

Nick Hill authored Feb 23, 2025

Even though ZMQ context.destroy() is meant to close open sockets before terminating the context, it appears to be necessary to do this explicitly or else it can hang in the context.term() method.

Close zmq sockets explicitly before terminating context, make shutdown of client resource more robust, shut down engine core process prior to terminating zmq context.
Signed-off-by: Nick Hill <nhill@redhat.com>

cbae7af5

[v1] torchrun compatibility (#13642) · eb24dc4a
youkaichao authored Feb 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
eb24dc4a

22 Feb, 2025 5 commits
- [V1][Kernel] Refactor the prefix_prefill kernel so that the caller no longer... · 558db808
  Sage Moore authored Feb 22, 2025
```
[V1][Kernel] Refactor the prefix_prefill kernel so that the caller no longer has to pass in the context lengths (#13095)
```
  558db808
- [ci] fix linter (#13701) · 2382ad29
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2382ad29
- [core] set up data parallel communication (#13591) · 3e472d88
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3e472d88
- [CI/Build] Fix pre-commit errors (#13696) · 7f6bae56
  Cyrus Leung authored Feb 22, 2025
  
  7f6bae56
- [Metrics] Add `--show-hidden-metrics-for-version` CLI arg (#13295) · 2cb8c154
  Mark McLoughlin authored Feb 22, 2025
  
  2cb8c154