Commits · d91457d529c2df5d66bdfd939b90b7c75a9729b8 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "aee4c14689c59e6e5f288fc8e53cf57dc170bcda"

04 Jan, 2025 2 commits
- [V1] Add `RayExecutor` support for `AsyncLLM` (api server) (#11712) · fbf25645
  Kunshang Ji authored Jan 04, 2025
  
  fbf25645
- [V1] log GPU blocks num for MultiprocExecutor (#11656) · e5d7ed0c
  WangErXiao authored Jan 04, 2025
  
  e5d7ed0c
03 Jan, 2025 8 commits
- [V1] Chore: cruft removal (#11724) · ad0d567e
  Robert Shaw authored Jan 03, 2025
  
  ad0d567e
- Update requirements-tpu.txt to support python 3.9 and 3.11 (#11695) · bf0d97d7
  Michael Goin authored Jan 03, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  bf0d97d7
- [Misc]Add BNB quantization for Qwen2VL (#11719) · a655eb30
  Jee Jee Li authored Jan 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  a655eb30
- [V1] Improve TP>1 Error Handling + Stack Trace (#11721) · 1543914c
  Robert Shaw authored Jan 03, 2025
```
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  1543914c
- [Bugfix] Fix ColumnParallelLinearWithLoRA slice (#11708) · 61fed92c
  ZincCat authored Jan 03, 2025
```
Signed-off-by: ZincCat <zincchloride@outlook.com>
```
  61fed92c
- [V1] Simplify Shutdown (#11659) · 80c751e7
  Robert Shaw authored Jan 03, 2025
  
  80c751e7
- [Model] Whisper model implementation (#11280) · e1a5c2f0
  Aurick Qiao authored Jan 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  e1a5c2f0
- [Bugfix] Check chain_speculative_sampling before calling it (#11673) · 07064cb1
  Lu Fang authored Jan 02, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  07064cb1
02 Jan, 2025 7 commits
- [Misc] Minimum requirements for SageMaker compatibility (#11576) · 68d37809
  Nathan Azrak authored Jan 03, 2025
  
  68d37809
- [Bugfix] Change kv scaling factor by param json on nvidia gpu (#11688) · 187e3299
  bjmsong authored Jan 03, 2025
```
Signed-off-by: bjmsong <bjmsong@126.com>
Co-authored-by: bjmsong <bjmsong@126.com>
```
  187e3299
- [V1][Minor] Optimize token_ids_cpu copy (#11692) · b55ed6ef
  Woosuk Kwon authored Jan 03, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b55ed6ef
- [Bugfix] Free cross attention block table for preempted-for-recompute sequence group. (#10013) · 2f385183
  Kathy Yu authored Jan 02, 2025
```
Signed-off-by: Kathy Yu <feiyangyu@google.com>
```
  2f385183
- [VLM] Merged multi-modal processor for LLaVA-NeXT (#11682) · 8c38ee70
  Cyrus Leung authored Jan 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c38ee70
- [mypy] Pass type checking in vllm/inputs (#11680) · b6087a6b
  Tobias Pitters authored Jan 02, 2025
```
Signed-off-by: Tobias Pitters <tobias.pitters@gmail.com>
```
  b6087a6b
- [VLM][Bugfix] Multi-modal processor compatible with V1 multi-input (#11674) · 23c1b10a
  Cyrus Leung authored Jan 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  23c1b10a
01 Jan, 2025 6 commits
- [VLM] Move supported limits and max tokens to merged multi-modal processor (#11669) · a115ac46
  Cyrus Leung authored Jan 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  a115ac46
- [V1] Implement Cascade Attention (#11635) · 73001445
  Woosuk Kwon authored Jan 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  73001445
- [Doc] Fix typo (#11666) · 6d70198b
  Kazuhiro Serizawa authored Jan 01, 2025
```
Signed-off-by: Kazuhiro Serizawa <nserihiro@gmail.com>
```
  6d70198b
- [Misc] Optimize Qwen2-VL LoRA test (#11663) · 11d8a091
  Jee Jee Li authored Jan 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  11d8a091
- [VLM] Add max-count checking in data parser for single image models (#11661) · 365801fe
  Cyrus Leung authored Jan 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  365801fe
- [Bugfix][Refactor] Unify model management in frontend (#11660) · 4db72e57
  Joe Runde authored Dec 31, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  4db72e57
31 Dec, 2024 6 commits

[V1][VLM] V1 support for selected single-image models. (#11632) · e7c7c5e8

Roger Wang authored Dec 31, 2024


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>

e7c7c5e8

[V1] Simpify vision block hash for prefix caching by removing offset from hash (#11646) · 8c3230d8
Chen Zhang authored Dec 31, 2024

8c3230d8

[Bugfix] Move the _touch(computed_blocks) call in the allocate_slots method to... · 2c571880

sakunkun authored Dec 31, 2024

[Bugfix] Move the _touch(computed_blocks) call in the allocate_slots method to after the check for allocating new blocks. (#11565)

2c571880

[Misc][LoRA] Support Rank Stabilized LoRA (RSLoRA) (#6909) · 82c49d32

John Giorgi authored Dec 31, 2024


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

82c49d32

[Bugfix] Fix OpenAI parallel sampling when using xgrammar (#11637) · 74fa1d12
Michael Goin authored Dec 30, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
74fa1d12

[Model][LoRA]LoRA support added for MolmoForCausalLM (#11439) · a2a40bcd

Matthias Vogler authored Dec 31, 2024


Signed-off-by: Matthias Vogler <matthias.vogler@joesecurity.org>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Matthias Vogler <matthias.vogler@joesecurity.org>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a2a40bcd

30 Dec, 2024 7 commits
- [Bugfix] Validate and concatenate image embeddings in MiniCPMVBaseModel (#11631) · 36e76700
  whyiug authored Dec 31, 2024
  
  36e76700
- [V1] [6/N] API Server: Better Shutdown (#11586) · 5886aa49
  Robert Shaw authored Dec 30, 2024
  
  5886aa49
- [VLM] Abstract out multi-modal data parsing in merged processor (#11620) · 8d9b6721
  Cyrus Leung authored Dec 30, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9b6721
- [platforms] enable platform plugins (#11602) · b12e87f9
  youkaichao authored Dec 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b12e87f9
- [CI/Build][CPU] Fix CPU CI by lazy importing triton FP8 kernels (#11618) · 5dbf8545
  Li, Jiang authored Dec 30, 2024
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  5dbf8545
- [Docker] bump up neuron sdk v2.21 (#11593) · 628ec6c1
  Liangfu Chen authored Dec 29, 2024
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  628ec6c1
- [v1] fix compilation cache (#11598) · 3682e33f
  youkaichao authored Dec 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3682e33f
29 Dec, 2024 3 commits
- Remove print statement in DeepseekScalingRotaryEmbedding (#11604) · 0aa38d16
  Michael Goin authored Dec 29, 2024
  
  0aa38d16
- [Misc] KV cache transfer connector registry (#11481) · faef77c0
  Kuntai Du authored Dec 29, 2024
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  faef77c0
- [v1][bugfix] fix cudagraph with inplace buffer assignment (#11596) · dba4d9de
  youkaichao authored Dec 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  dba4d9de
28 Dec, 2024 1 commit
- [V1] [5/N] API Server: unify `Detokenizer` and `EngineCore` input (#11545) · 4fb8e329
  Robert Shaw authored Dec 28, 2024
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
  4fb8e329