Commits · e0f0ff87b89978d1d0bea2aec2d85cec72b71238 · OpenDAS / vllm_cscc

27 May, 2025 1 commit
- [Build] fix cpu build missing libtbbmalloc.so (#18744) · e0f0ff87
  Kebe authored May 27, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  e0f0ff87
26 May, 2025 2 commits
- [Doc] Move examples and further reorganize user guide (#18666) · 82e2339b
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82e2339b
- [Bugfix]: handle hf-xet CAS error when loading Qwen3 weights in vLLM (#18701) · 243eb919
  dylan authored May 26, 2025
  
  243eb919
23 May, 2025 3 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to... · 7ab056c2
  Kay Yan authored May 23, 2025
```
[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to `requirements/cpu.txt`  (#18542)
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  7ab056c2
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
21 May, 2025 1 commit
- [TPU] Re-enable the Pallas MoE kernel (#18025) · 3b17ea26
  Michael Goin authored May 20, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  3b17ea26
20 May, 2025 3 commits
- fix:Build torch wheel inline rather than picking from nightly (#18351) · 23baa218
  Dilip Gowda Bhagavan authored May 21, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
```
  23baa218
- [CI] Add mteb testing to test the accuracy of the embedding model (#17175) · 86847700
  wang.yuqi authored May 20, 2025
  
  86847700
- Update cpu.txt (#18398) · d6c86d09
  汪志鹏 authored May 20, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  d6c86d09
15 May, 2025 1 commit
- Adding "Basic Models Test" and "Multi-Modal Models Test (Extended) 3" in AMD Pipeline (#18106) · 566ec04c
  Alexei-V-Ivanov-AMD authored May 15, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  566ec04c
13 May, 2025 1 commit

[Feature][V1] Support `tool_choice: required` when using Xgrammar as the... · dc1a8217

Chauncey authored May 13, 2025


[Feature][V1]  Support `tool_choice: required` when using Xgrammar as the `StructuredOutputBackend`. (#17845)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

dc1a8217

09 May, 2025 2 commits

AMD conditional all test execution // new test groups (#17556) · 3b602cde
Alexei-V-Ivanov-AMD authored May 09, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
```
3b602cde

[V1][Structured Output] Update llguidance (`>= 0.7.11`) to avoid... · 760e3ecc

Shanshan Shen authored May 09, 2025


[V1][Structured Output] Update llguidance (`>= 0.7.11`) to avoid AttributeError (no `StructTag`)  (#17839)
Signed-off-by: shen-shanshan <467638484@qq.com>

760e3ecc

08 May, 2025 2 commits
- Fix transient dependency error in docs build (#17848) · e4ca6e3a
  Harry Mellor authored May 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e4ca6e3a
- [Installation] OpenTelemetry version update (#17771) · c747d845
  Mikhail Podvitskii authored May 08, 2025
```
Signed-off-by: Mikhail Podvitskii <podvitskiymichael@gmail.com>
```
  c747d845
07 May, 2025 4 commits

Only depend on importlib-metadata for Python < 3.10 (#17776) · 1a6af145
Christian Heimes authored May 07, 2025
```
Signed-off-by: Christian Heimes <christian@python.org>
```
1a6af145

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357) · 043e4c49

Satyajith Chilappagari authored May 07, 2025


Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
Co-authored-by: Aaron Dou <yzdou@amazon.com>
Co-authored-by: Shashwat Srijan <sssrijan@amazon.com>
Co-authored-by: Chongming Ni <chongmni@amazon.com>
Co-authored-by: Amulya Ballakur <amulyaab@amazon.com>
Co-authored-by: Patrick Lange <patlange@amazon.com>
Co-authored-by: Elaine Zhao <elaineyz@amazon.com>
Co-authored-by: Lin Lin Pan <tailinpa@amazon.com>
Co-authored-by: Navyadhara Gogineni <navyadha@amazon.com>
Co-authored-by: Yishan McNabb <yishanm@amazon.com>
Co-authored-by: Mrinal Shukla <181322398+mrinalks@users.noreply.github.com>

043e4c49

Add logging for torch nightly version (#17669) · 6de3e134
Yang Wang authored May 06, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
6de3e134
Fix doc build performance (#17748) · 022afbeb
Harry Mellor authored May 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
022afbeb

06 May, 2025 1 commit
- [TPU] Increase block size and reset block shapes (#16458) · 621ca2c0
  Jevin Jiang authored May 06, 2025
  
  621ca2c0
05 May, 2025 1 commit
- [Doc] Fix broken cuda installation doc rendering (#17654) · cc05b90d
  Isotr0py authored May 06, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  cc05b90d
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
03 May, 2025 2 commits
- Update test requirements to CUDA 12.8 (#17576) · d47b605e
  22quinn authored May 02, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  d47b605e
- [Neuron][Build] Require setuptools >= 77.0.3 for PEP 639 (#17603) · 22c6f639
  Liangfu Chen authored May 02, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  22c6f639
02 May, 2025 1 commit
- add more pytorch related tests for torch nightly (#17422) · b8b0859b
  Yang Wang authored May 02, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  b8b0859b
01 May, 2025 2 commits
- [CI/Build] Remove `awscli` dependency (#17532) · f2e7af9b
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f2e7af9b
- [Build] Require setuptools >= 77.0.3 for PEP 639 (#17389) · 7a0a146c
  Russell Bryant authored May 01, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7a0a146c
30 Apr, 2025 5 commits
- Bump Compressed Tensors version to 0.9.4 (#17478) · 200bbf92
  Rahul Tuli authored Apr 30, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  200bbf92
- [Bugfix][ROCm] Restrict ray version due to a breaking release (#17480) · 584f5fb4
  Gregory Shtrasberg authored Apr 30, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  584f5fb4
- [Hardware][Intel GPU] Upgrade to torch 2.7 (#17444) · ed6cfb90
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
```
  ed6cfb90
- [Intel GPU] [CI]Fix XPU ci, setuptools >=80.0 have build issue (#17298) · 6ed9f604
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6ed9f604
- Update PyTorch to 2.7.0 (#16859) · 2c4f59af
  Huy Do authored Apr 29, 2025
  
  2c4f59af
29 Apr, 2025 3 commits
- [CI] Uses Python 3.11 for TPU (#17359) · b37685af
  Aaron Pham authored Apr 29, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  b37685af
- Update docs requirements (#17379) · 4a5e1314
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4a5e1314
- [Build][Bugfix] Restrict setuptools version to <80 (#17320) · 44641092
  Gregory Shtrasberg authored Apr 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  44641092
26 Apr, 2025 1 commit
- [Hardware][Intel-Gaudi] Update hpu-extension and update bucketing system for HPU device (#17186) · c48334d4
  Agata Dobrzyniewicz authored Apr 26, 2025
```
Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
```
  c48334d4
25 Apr, 2025 2 commits
- [Misc] Inline Molmo requirements (#17190) · 9d98ab5e
  Cyrus Leung authored Apr 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9d98ab5e
- Bump Transformers to 4.51.3 (#17116) · 0bd7f8fc
  Harry Mellor authored Apr 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0bd7f8fc
24 Apr, 2025 1 commit
- Add `:markdownhelp:` to `EngineArgs` docs so markdown docstrings render properly (#17124) · 0422ce10
  Harry Mellor authored Apr 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0422ce10