Commits · e4ca6e3a99816920df80a1e0a72cd3658d9d134b · OpenDAS / vllm_cscc

08 May, 2025 2 commits
- Fix transient dependency error in docs build (#17848) · e4ca6e3a
  Harry Mellor authored May 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e4ca6e3a
- [Installation] OpenTelemetry version update (#17771) · c747d845
  Mikhail Podvitskii authored May 08, 2025
```
Signed-off-by: Mikhail Podvitskii <podvitskiymichael@gmail.com>
```
  c747d845
07 May, 2025 4 commits

Only depend on importlib-metadata for Python < 3.10 (#17776) · 1a6af145
Christian Heimes authored May 07, 2025
```
Signed-off-by: Christian Heimes <christian@python.org>
```
1a6af145

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357) · 043e4c49

Satyajith Chilappagari authored May 07, 2025


Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
Co-authored-by: Aaron Dou <yzdou@amazon.com>
Co-authored-by: Shashwat Srijan <sssrijan@amazon.com>
Co-authored-by: Chongming Ni <chongmni@amazon.com>
Co-authored-by: Amulya Ballakur <amulyaab@amazon.com>
Co-authored-by: Patrick Lange <patlange@amazon.com>
Co-authored-by: Elaine Zhao <elaineyz@amazon.com>
Co-authored-by: Lin Lin Pan <tailinpa@amazon.com>
Co-authored-by: Navyadhara Gogineni <navyadha@amazon.com>
Co-authored-by: Yishan McNabb <yishanm@amazon.com>
Co-authored-by: Mrinal Shukla <181322398+mrinalks@users.noreply.github.com>

043e4c49

Add logging for torch nightly version (#17669) · 6de3e134
Yang Wang authored May 06, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
6de3e134
Fix doc build performance (#17748) · 022afbeb
Harry Mellor authored May 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
022afbeb

06 May, 2025 1 commit
- [TPU] Increase block size and reset block shapes (#16458) · 621ca2c0
  Jevin Jiang authored May 06, 2025
  
  621ca2c0
05 May, 2025 1 commit
- [Doc] Fix broken cuda installation doc rendering (#17654) · cc05b90d
  Isotr0py authored May 06, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  cc05b90d
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
03 May, 2025 2 commits
- Update test requirements to CUDA 12.8 (#17576) · d47b605e
  22quinn authored May 02, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  d47b605e
- [Neuron][Build] Require setuptools >= 77.0.3 for PEP 639 (#17603) · 22c6f639
  Liangfu Chen authored May 02, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  22c6f639
02 May, 2025 1 commit
- add more pytorch related tests for torch nightly (#17422) · b8b0859b
  Yang Wang authored May 02, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  b8b0859b
01 May, 2025 2 commits
- [CI/Build] Remove `awscli` dependency (#17532) · f2e7af9b
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f2e7af9b
- [Build] Require setuptools >= 77.0.3 for PEP 639 (#17389) · 7a0a146c
  Russell Bryant authored May 01, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7a0a146c
30 Apr, 2025 5 commits
- Bump Compressed Tensors version to 0.9.4 (#17478) · 200bbf92
  Rahul Tuli authored Apr 30, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  200bbf92
- [Bugfix][ROCm] Restrict ray version due to a breaking release (#17480) · 584f5fb4
  Gregory Shtrasberg authored Apr 30, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  584f5fb4
- [Hardware][Intel GPU] Upgrade to torch 2.7 (#17444) · ed6cfb90
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
```
  ed6cfb90
- [Intel GPU] [CI]Fix XPU ci, setuptools >=80.0 have build issue (#17298) · 6ed9f604
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6ed9f604
- Update PyTorch to 2.7.0 (#16859) · 2c4f59af
  Huy Do authored Apr 29, 2025
  
  2c4f59af
29 Apr, 2025 3 commits
- [CI] Uses Python 3.11 for TPU (#17359) · b37685af
  Aaron Pham authored Apr 29, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  b37685af
- Update docs requirements (#17379) · 4a5e1314
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4a5e1314
- [Build][Bugfix] Restrict setuptools version to <80 (#17320) · 44641092
  Gregory Shtrasberg authored Apr 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  44641092
26 Apr, 2025 1 commit
- [Hardware][Intel-Gaudi] Update hpu-extension and update bucketing system for HPU device (#17186) · c48334d4
  Agata Dobrzyniewicz authored Apr 26, 2025
```
Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
```
  c48334d4
25 Apr, 2025 2 commits
- [Misc] Inline Molmo requirements (#17190) · 9d98ab5e
  Cyrus Leung authored Apr 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9d98ab5e
- Bump Transformers to 4.51.3 (#17116) · 0bd7f8fc
  Harry Mellor authored Apr 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0bd7f8fc
24 Apr, 2025 2 commits
- Add `:markdownhelp:` to `EngineArgs` docs so markdown docstrings render properly (#17124) · 0422ce10
  Harry Mellor authored Apr 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0422ce10
- Molmo Requirements (#17026) · 47bdee40
  Eyshika Agarwal authored Apr 24, 2025
```
Signed-off-by: Eyshika Agarwal <eyshikaengineer@gmail.com>
Signed-off-by: eyshika <eyshikaengineer@gmail.com>
```
  47bdee40
23 Apr, 2025 1 commit
- add Dockerfile build vllm against torch nightly (#16936) · f67e9e9f
  Yang Wang authored Apr 22, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  f67e9e9f
19 Apr, 2025 1 commit

[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477) · 83f3c3bd

Isotr0py authored Apr 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

83f3c3bd

18 Apr, 2025 1 commit

Add property-based testing for vLLM endpoints using an API defined by an... · e37073ef

Tarun Kumar authored Apr 18, 2025


Add property-based testing for vLLM endpoints using an API defined by an OpenAPI 3.1 schema (#16721)
Signed-off-by: Tarun Kumar <takumar@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

e37073ef

17 Apr, 2025 1 commit
- [V1][Perf] Faster incremental detokenization (#15137) · 05fcd1b4
  Nick Hill authored Apr 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  05fcd1b4
16 Apr, 2025 2 commits

[ROCM] Bind triton version to 3.2 in requirements-built.txt (#16664) · 44fa4d55
Sage Moore authored Apr 15, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
44fa4d55

[Model] Add PLaMo2 (#14323) · 3badb021

Shinichi Hemmi authored Apr 16, 2025


Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Signed-off-by: shemmi <shemmi@preferred.jp>
Co-authored-by: Kento Nozawa <nzw0301@preferred.jp>
Co-authored-by: Hiroaki Mikami <mhiroaki@preferred.jp>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>

3badb021

15 Apr, 2025 1 commit

[BugFix]: Update minimum `pyzmq` version (#16549) · 70e7ed84

Taneem Ibrahim authored Apr 14, 2025


Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

70e7ed84

14 Apr, 2025 3 commits
- [Hardware][TPU] Add torchvision to tpu dependency file (#16616) · c64ee872
  Siyuan Liu authored Apr 14, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  c64ee872
- [Model][VLM] Add Kimi-VL model support (#16387) · b1308b84
  courage17340 authored Apr 15, 2025
```
Signed-off-by: courage17340 <courage17340@163.com>
```
  b1308b84
- Fix triton install condition on CPU (#16600) · 9883a188
  Harry Mellor authored Apr 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9883a188
11 Apr, 2025 1 commit
- Don't install triton on `ppc64le` platform (#16470) · 51baa9c3
  Harry Mellor authored Apr 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51baa9c3
10 Apr, 2025 2 commits
- Update Numba to 0.61.2 (#16376) · ec1f9c8c
  cyyever authored Apr 10, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
```
  ec1f9c8c
- [CI][Bugfix] Pin triton version for CPU (#16384) · 0d4d06fe
  Roger Wang authored Apr 09, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0d4d06fe