Commits · 3b5d646e6b99c793444a424f4615b77cd8a12225 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "8322d4e47f89f7985b9b3b808fc4ba8549d6afcd"

22 May, 2025 1 commit
- update deps of glm4-32b and cpm · 3b5d646e
  zhuwenwen authored May 22, 2025
  
  3b5d646e
15 May, 2025 1 commit
- add perf scripts · b4a253fc
  zhuwenwen authored May 15, 2025
  
  b4a253fc
26 Apr, 2025 1 commit
- [Hardware][Intel-Gaudi] Update hpu-extension and update bucketing system for HPU device (#17186) · c48334d4
  Agata Dobrzyniewicz authored Apr 26, 2025
```
Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
```
  c48334d4
25 Apr, 2025 2 commits
- [Misc] Inline Molmo requirements (#17190) · 9d98ab5e
  Cyrus Leung authored Apr 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9d98ab5e
- Bump Transformers to 4.51.3 (#17116) · 0bd7f8fc
  Harry Mellor authored Apr 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0bd7f8fc
24 Apr, 2025 3 commits
- Add `:markdownhelp:` to `EngineArgs` docs so markdown docstrings render properly (#17124) · 0422ce10
  Harry Mellor authored Apr 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0422ce10
- Molmo Requirements (#17026) · 47bdee40
  Eyshika Agarwal authored Apr 24, 2025
```
Signed-off-by: Eyshika Agarwal <eyshikaengineer@gmail.com>
Signed-off-by: eyshika <eyshikaengineer@gmail.com>
```
  47bdee40
- update deps of flashmla · 779033b7
  zhuwenwen authored Apr 24, 2025
  
  779033b7
23 Apr, 2025 1 commit
- add Dockerfile build vllm against torch nightly (#16936) · f67e9e9f
  Yang Wang authored Apr 22, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  f67e9e9f
19 Apr, 2025 1 commit

[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477) · 83f3c3bd

Isotr0py authored Apr 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

83f3c3bd

18 Apr, 2025 1 commit

Add property-based testing for vLLM endpoints using an API defined by an... · e37073ef

Tarun Kumar authored Apr 18, 2025


Add property-based testing for vLLM endpoints using an API defined by an OpenAPI 3.1 schema (#16721)
Signed-off-by: Tarun Kumar <takumar@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

e37073ef

17 Apr, 2025 1 commit
- [V1][Perf] Faster incremental detokenization (#15137) · 05fcd1b4
  Nick Hill authored Apr 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  05fcd1b4
16 Apr, 2025 2 commits

[ROCM] Bind triton version to 3.2 in requirements-built.txt (#16664) · 44fa4d55
Sage Moore authored Apr 15, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
44fa4d55

[Model] Add PLaMo2 (#14323) · 3badb021

Shinichi Hemmi authored Apr 16, 2025


Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Signed-off-by: shemmi <shemmi@preferred.jp>
Co-authored-by: Kento Nozawa <nzw0301@preferred.jp>
Co-authored-by: Hiroaki Mikami <mhiroaki@preferred.jp>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>

3badb021

15 Apr, 2025 1 commit

[BugFix]: Update minimum `pyzmq` version (#16549) · 70e7ed84

Taneem Ibrahim authored Apr 14, 2025


Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

70e7ed84

14 Apr, 2025 3 commits
- [Hardware][TPU] Add torchvision to tpu dependency file (#16616) · c64ee872
  Siyuan Liu authored Apr 14, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  c64ee872
- [Model][VLM] Add Kimi-VL model support (#16387) · b1308b84
  courage17340 authored Apr 15, 2025
```
Signed-off-by: courage17340 <courage17340@163.com>
```
  b1308b84
- Fix triton install condition on CPU (#16600) · 9883a188
  Harry Mellor authored Apr 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9883a188
11 Apr, 2025 2 commits
- Don't install triton on `ppc64le` platform (#16470) · 51baa9c3
  Harry Mellor authored Apr 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51baa9c3
- update numpy deps · ac61f64c
  zhuwenwen authored Apr 11, 2025
  
  ac61f64c
10 Apr, 2025 2 commits
- Update Numba to 0.61.2 (#16376) · ec1f9c8c
  cyyever authored Apr 10, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
```
  ec1f9c8c
- [CI][Bugfix] Pin triton version for CPU (#16384) · 0d4d06fe
  Roger Wang authored Apr 09, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0d4d06fe
09 Apr, 2025 6 commits
- [Build/CI] Add tracing deps to vllm container image (#15224) · fee5b8d3
  Russell Bryant authored Apr 09, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  fee5b8d3
- [CI]Fix hpu docker and numpy version for CI (#16355) · 566f10a9
  Chendi.Xue authored Apr 09, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  566f10a9
- add deps of python-multipart · e9389ccc
  zhuwenwen authored Apr 09, 2025
  
  e9389ccc
- [TPU] Update PyTorch/XLA (#16288) · b1eb4ca1
  Chengji Yao authored Apr 08, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  b1eb4ca1
- [Core] Upgrade to xgrammar 0.1.18, add cache size limit (#16283) · cb84e45a
  Russell Bryant authored Apr 08, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cb84e45a
- [Model] Add smolvlm support (#16017) · 102bf967
  Chauncey authored Apr 09, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  102bf967
08 Apr, 2025 3 commits
- Update to transformers==4.51.1 (#16257) · 90cb44eb
  Harry Mellor authored Apr 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  90cb44eb
- [Bugfix] Fix and reorganize broken GGUF tests and bump gguf version (#16194) · f6b32efb
  Isotr0py authored Apr 08, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f6b32efb
- [Misc] Update compressed-tensors to version 0.9.3 (#16196) · f94ab12f
  Miles Williams authored Apr 08, 2025
```
Signed-off-by: Miles Williams <42222518+mlsw@users.noreply.github.com>
```
  f94ab12f
07 Apr, 2025 2 commits

[V1][BugFix] Exit properly if engine core fails during startup (#16137) · 7f6d47c1
Nick Hill authored Apr 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
7f6d47c1

Upstream Llama4 Support to Main (#16113) · 55dcce91

Lu Fang authored Apr 07, 2025


Signed-off-by: Aston Zhang <22279212+astonzhang@users.noreply.github.com>
Signed-off-by: Chris Thi <chris.c.thi@gmail.com>
Signed-off-by: drisspg <drisspguessous@gmail.com>
Signed-off-by: Jon Swenson <jmswen@gmail.com>
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Xiaodong Wang <xdwang@meta.com>
Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Lu Fang <lufang@fb.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>