Commits · 239b7befddb486d121779a7f80d1f5d9dcdd248f · OpenDAS / vllm_cscc · GitLab

31 Mar, 2025 2 commits
- [V1][Spec Decode] Remove deprecated spec decode config params (#15466) · 239b7bef
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  239b7bef
- [Bugfix] Check dimensions of multimodal embeddings in V1 (#15816) · 09e974d4
  Cyrus Leung authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09e974d4
29 Mar, 2025 2 commits

[Bugfix] Fix Mllama interleaved images input support (#15564) · 3c0ff914
Isotr0py authored Mar 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
3c0ff914

[Model] Support Skywork-R1V (#15397) · de1cb387

pengyuange authored Mar 29, 2025


Signed-off-by: jiacai.liu <932997367@qq.com>
Co-authored-by: jiacai.liu <932997367@qq.com>

de1cb387

27 Mar, 2025 2 commits
- [V1] AsyncLLM data parallel (#13923) · 15dac210
  Nick Hill authored Mar 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  15dac210
- [TPU] [V1] fix cases when max_num_reqs is set smaller than MIN_NUM_SEQS (#15583) · 619d3de8
  Chengji Yao authored Mar 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  619d3de8
26 Mar, 2025 2 commits
- multi-node offline DP+EP example (#15484) · e64afa45
  youkaichao authored Mar 26, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e64afa45
- [Misc] improve example script output (#15528) · 4ec2cee0
  Reid authored Mar 26, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  4ec2cee0
25 Mar, 2025 1 commit
- [Misc] Clean up MiniCPM-V/O code (#15337) · a9e879b3
  Cyrus Leung authored Mar 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a9e879b3
23 Mar, 2025 1 commit
- [V1][Usage] Refactor speculative decoding configuration and tests (#14434) · 50c9636d
  shangmingc authored Mar 23, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  50c9636d
21 Mar, 2025 2 commits
- Add an example for reproducibility (#15262) · e588ac23
  Woosuk Kwon authored Mar 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e588ac23
- [Misc] Clean up the BitsAndBytes arguments (#15140) · 10f55fe6
  Jee Jee Li authored Mar 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  10f55fe6
20 Mar, 2025 2 commits
- [Doc] Update Mistral Small 3.1/Pixtral example (#15184) · 34868b10
  Roger Wang authored Mar 19, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  34868b10
- [Bugfix] Fix embedding assignment for InternVL-based models (#15086) · ffa443af
  Cyrus Leung authored Mar 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ffa443af
18 Mar, 2025 2 commits
- [Bugfix] Fix LoRA extra vocab size (#15047) · 46c759c1
  Jee Jee Li authored Mar 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  46c759c1
- [Mistral-Small 3.1] Update docs and tests (#14977) · f863ffc9
  Patrick von Platen authored Mar 18, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  f863ffc9
17 Mar, 2025 1 commit
- [Misc] Add `--seed` option to offline multi-modal examples (#14934) · 6eaf1e5c
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6eaf1e5c
16 Mar, 2025 1 commit
- [BugFix] Fix torch distributed stateless PG backend init (#14870) · b82662d9
  Nick Hill authored Mar 15, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b82662d9
15 Mar, 2025 2 commits

[VLM] Merged multi-modal processor for Pixtral (#12211) · 61c6a5a7

Rémi Delacourt authored Mar 15, 2025


Signed-off-by: remi <remi@mistral.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

61c6a5a7

[Bugfix] EAGLE output norm bug (#14464) · 9ed6ee92
Bryan Lu authored Mar 14, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
9ed6ee92

13 Mar, 2025 1 commit

[VLM] Support pan-and-scan for Gemma3 multi-modal processor (#14672) · 38240392

Cyrus Leung authored Mar 13, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <ywang@roblox.com>

38240392

12 Mar, 2025 1 commit

[Model] Add support for Gemma 3 (#14660) · c0c25e25

Woosuk Kwon authored Mar 12, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

c0c25e25

10 Mar, 2025 1 commit
- Correct capitalisation: `VLLM` -> `vLLM` (#14562) · 3b352a2f
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3b352a2f
09 Mar, 2025 1 commit
- [Hardware][TPU] Fix the recompiling issue in logits processor after warmup (#14510) · 212007b1
  Chengji Yao authored Mar 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  212007b1
08 Mar, 2025 1 commit
- [VLM] Add TP support for Phi-4-MM (#14453) · 03fe18ae
  Isotr0py authored Mar 08, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  03fe18ae
07 Mar, 2025 1 commit
- [Misc] Add Phi4-MM example (#14343) · 952a0749
  Jee Jee Li authored Mar 08, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  952a0749
06 Mar, 2025 2 commits
- [Distributed] Add enable_expert_parallel arg (#14305) · cc2f9b32
  Tyler Michael Smith authored Mar 06, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  cc2f9b32
- [RLHF] use worker_extension_cls for compatibility with V0 and V1 (#14185) · 151b08e0
  youkaichao authored Mar 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  151b08e0
05 Mar, 2025 3 commits

Deprecate `best_of` Sampling Parameter in anticipation for vLLM V1 (#13997) · a4f1ee35

Vincent authored Mar 05, 2025

Signed-off-by: vincent-4 <vincentzhongy+githubvincent4@gmail.com>
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a4f1ee35

[Bugfix] Fix broken vision language example (#14292) · f71b00a1
Isotr0py authored Mar 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
f71b00a1
[V1] EP/TP MoE + DP Attention (#13931) · 72c62eae
Tyler Michael Smith authored Mar 05, 2025

72c62eae

04 Mar, 2025 1 commit
- [V1][Molmo] Fix get_multimodal_embeddings() in molmo.py (#14161) · b3cf368d
  lkchen authored Mar 04, 2025
  
  b3cf368d
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
01 Mar, 2025 1 commit
- [Doc] Consolidate `whisper` and `florence2` examples (#14050) · fdcc4053
  Isotr0py authored Mar 01, 2025
  
  fdcc4053
27 Feb, 2025 1 commit
- [VLM] Support multimodal inputs for Florence-2 models (#13320) · edf309eb
  Isotr0py authored Feb 27, 2025
  
  edf309eb
26 Feb, 2025 1 commit
- [Misc] fixed qwen_vl_utils parameter error (#13906) · d08b285a
  Chauncey authored Feb 27, 2025
  
  d08b285a
25 Feb, 2025 1 commit
- [Feature] Support KV cache offloading and disagg prefill with LMCache connector. (#12953) · 2f42a488
  Jiayi Yao authored Feb 25, 2025
  
  2f42a488
22 Feb, 2025 2 commits
- [ci] fix linter (#13701) · 2382ad29
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2382ad29
- [core] set up data parallel communication (#13591) · 3e472d88
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3e472d88
20 Feb, 2025 1 commit
- Merge similar examples in `offline_inference` into single `basic` example (#12737) · 992e5c3d
  Harry Mellor authored Feb 20, 2025
  
  992e5c3d