Commits · f2036734fbf6d4b119d9362dddb8b4a6954e3591 · OpenDAS / vllm_cscc

13 May, 2025 1 commit

[Feature][V1] Support `tool_choice: required` when using Xgrammar as the... · dc1a8217

Chauncey authored May 13, 2025


[Feature][V1]  Support `tool_choice: required` when using Xgrammar as the `StructuredOutputBackend`. (#17845)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

dc1a8217

09 May, 2025 1 commit

[V1][Structured Output] Update llguidance (`>= 0.7.11`) to avoid... · 760e3ecc

Shanshan Shen authored May 09, 2025


[V1][Structured Output] Update llguidance (`>= 0.7.11`) to avoid AttributeError (no `StructTag`)  (#17839)
Signed-off-by: shen-shanshan <467638484@qq.com>

760e3ecc

08 May, 2025 1 commit
- [Installation] OpenTelemetry version update (#17771) · c747d845
  Mikhail Podvitskii authored May 08, 2025
```
Signed-off-by: Mikhail Podvitskii <podvitskiymichael@gmail.com>
```
  c747d845
07 May, 2025 1 commit
- Only depend on importlib-metadata for Python < 3.10 (#17776) · 1a6af145
  Christian Heimes authored May 07, 2025
```
Signed-off-by: Christian Heimes <christian@python.org>
```
  1a6af145
01 May, 2025 1 commit
- [Build] Require setuptools >= 77.0.3 for PEP 639 (#17389) · 7a0a146c
  Russell Bryant authored May 01, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7a0a146c
30 Apr, 2025 1 commit
- Bump Compressed Tensors version to 0.9.4 (#17478) · 200bbf92
  Rahul Tuli authored Apr 30, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  200bbf92
29 Apr, 2025 1 commit
- [Build][Bugfix] Restrict setuptools version to <80 (#17320) · 44641092
  Gregory Shtrasberg authored Apr 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  44641092
17 Apr, 2025 1 commit
- [V1][Perf] Faster incremental detokenization (#15137) · 05fcd1b4
  Nick Hill authored Apr 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  05fcd1b4
15 Apr, 2025 1 commit

[BugFix]: Update minimum `pyzmq` version (#16549) · 70e7ed84

Taneem Ibrahim authored Apr 14, 2025


Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

70e7ed84

09 Apr, 2025 2 commits
- [Build/CI] Add tracing deps to vllm container image (#15224) · fee5b8d3
  Russell Bryant authored Apr 09, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  fee5b8d3
- [Core] Upgrade to xgrammar 0.1.18, add cache size limit (#16283) · cb84e45a
  Russell Bryant authored Apr 08, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cb84e45a
08 Apr, 2025 3 commits
- Update to transformers==4.51.1 (#16257) · 90cb44eb
  Harry Mellor authored Apr 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  90cb44eb
- [Bugfix] Fix and reorganize broken GGUF tests and bump gguf version (#16194) · f6b32efb
  Isotr0py authored Apr 08, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f6b32efb
- [Misc] Update compressed-tensors to version 0.9.3 (#16196) · f94ab12f
  Miles Williams authored Apr 08, 2025
```
Signed-off-by: Miles Williams <42222518+mlsw@users.noreply.github.com>
```
  f94ab12f
07 Apr, 2025 1 commit

Upstream Llama4 Support to Main (#16113) · 55dcce91

Lu Fang authored Apr 07, 2025


Signed-off-by: Aston Zhang <22279212+astonzhang@users.noreply.github.com>
Signed-off-by: Chris Thi <chris.c.thi@gmail.com>
Signed-off-by: drisspg <drisspguessous@gmail.com>
Signed-off-by: Jon Swenson <jmswen@gmail.com>
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Xiaodong Wang <xdwang@meta.com>
Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Lu Fang <lufang@fb.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

55dcce91

02 Apr, 2025 3 commits
- Fix `huggingface-cli[hf-xet]` -> `huggingface-cli[hf_xet]` (#15969) · 55acf86b
  Harry Mellor authored Apr 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  55acf86b
- Add minimum version for `huggingface_hub` to enable Xet downloads (#15873) · 51826d51
  Harry Mellor authored Apr 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51826d51
- [V1] Fix json_object support with xgrammar (#15488) · 14e53ed1
  Russell Bryant authored Apr 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  14e53ed1
01 Apr, 2025 1 commit

[Misc] Allow using OpenCV as video IO fallback (#15055) · 4e5a0f6a

Isotr0py authored Apr 01, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

4e5a0f6a

31 Mar, 2025 1 commit
- Upgrade `transformers` to `v4.50.3` (#13905) · e5ef4fa9
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e5ef4fa9
29 Mar, 2025 1 commit
- Use numba 0.61 for python 3.10+ to support numpy>=2 (#15692) · 8427f704
  cyyever authored Mar 29, 2025
```
Signed-off-by: cyy <cyyever@outlook.com>
```
  8427f704
25 Mar, 2025 1 commit

[V1] guidance backend for structured output + `auto` fallback mode (#14779) · a09ad90a

Russell Bryant authored Mar 25, 2025


Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Loc Huynh <jc1da.3011@gmail.com>
Co-authored-by: Michal Moskal <michal@moskal.me>

a09ad90a

20 Mar, 2025 1 commit

[Core][V0] Add guidance backend for structured output (#14589) · 1f16b7fe

Russell Bryant authored Mar 20, 2025


Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Loc Huynh <lohuynh@microsoft.com>
Co-authored-by: Michal Moskal <michal@moskal.me>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

1f16b7fe

17 Mar, 2025 2 commits

[Fix][Structured Output] using vocab_size to construct matcher (#14868) · c0efdd65

Aaron Pham authored Mar 17, 2025

Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

c0efdd65

Add patch merger (#14957) · d20b0c13
Patrick von Platen authored Mar 17, 2025

d20b0c13

15 Mar, 2025 1 commit
- [VLM] Limit multimodal input cache by memory (#14805) · 3556a414
  Cyrus Leung authored Mar 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3556a414
14 Mar, 2025 1 commit
- [Build/CI] Move ninja to common deps (#14835) · 233ffce1
  Russell Bryant authored Mar 14, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  233ffce1
11 Mar, 2025 1 commit
- [V1] Add regex structured output support with xgrammar (#14590) · 4bf82d4b
  Russell Bryant authored Mar 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4bf82d4b
08 Mar, 2025 1 commit
- Move requirements into their own directory (#12547) · 206e2577
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  206e2577
05 Mar, 2025 2 commits
- [Model] New model support for Phi-4-multimodal-instruct (#14119) · 0a995d54
  Congcong Chen authored Mar 04, 2025
  
  0a995d54
- Moved numba from common requirements to cuda/rocm specific requirements (#14199) · 5b143d33
  Nishidha authored Mar 05, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  5b143d33
27 Feb, 2025 1 commit
- Update LMFE version to v0.10.11 to support new versions of transforme… (#13930) · 1dd422b6
  Noam Gat authored Feb 27, 2025
  
  1dd422b6
25 Feb, 2025 1 commit
- Fix `/v1/audio/transcriptions ` Bad Request Error (#13811) · 6522d55b
  Wen Sun authored Feb 25, 2025
  
  6522d55b
24 Feb, 2025 1 commit
- [CI/Build] add python-json-logger to requirements-common (#12842) · 7940d8a6
  Roger Meier authored Feb 24, 2025
  
  7940d8a6
22 Feb, 2025 2 commits
- Support SSL Key Rotation in HTTP Server (#13495) · 8db1b9d0
  Keyun Tong authored Feb 22, 2025
  
  8db1b9d0
- [Misc] Bump compressed-tensors (#13619) · 95c617e0
  Dipika Sikka authored Feb 22, 2025
  
  95c617e0
18 Feb, 2025 1 commit
- [V1][Spec Decode] Optimize N-gram matching with Numba (#13365) · 4c822298
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4c822298
16 Feb, 2025 1 commit
- [Bugfix] Pin xgrammar to 0.1.11 (#13338) · d3d547e0
  Michael Goin authored Feb 15, 2025
  
  d3d547e0
14 Feb, 2025 1 commit
- [Core] choice-based structured output with xgrammar (#12632) · 7734e9a2
  Russell Bryant authored Feb 14, 2025
  
  7734e9a2
13 Feb, 2025 1 commit
- [Frontend] Add `/v1/audio/transcriptions` OpenAI API endpoint (#12909) · d84cef76
  Nicolò Lucchesi authored Feb 13, 2025
  
  d84cef76