Commits · b4c1aef21c1a4cb252e7a440b3f9b0baebefbbef · OpenDAS / vllm_cscc

20 Mar, 2026 1 commit
- [Refactor] Relocate tests from tests/v1/entrypoints/ to tests/entrypoints/ (#37500) · b4c1aef2
  Flora Feng authored Mar 20, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  b4c1aef2
05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

15 Jan, 2026 1 commit

[ROCm][CI] Disable async scheduling on ROCm for... · 773d7073

Micah Williamson authored Jan 14, 2026


[ROCm][CI] Disable async scheduling on ROCm for test_structured_output[meta-llama/Meta-Llama-3.1-8B-Instruct-xgrammar-auto-speculative_config9] (#32355)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>

773d7073

25 Dec, 2025 1 commit
- [BugFix] Fix async scheduling + reasoning with struct output (#31332) · 81786c87
  Nick Hill authored Dec 25, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  81786c87
01 Dec, 2025 1 commit
- [Misc] Unify tokenizer registration (#29767) · f0a28bf6
  Cyrus Leung authored Dec 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a28bf6
25 Nov, 2025 1 commit
- Scheduled removal of `guided_*` config fields (#29326) · 316c8492
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  316c8492
21 Nov, 2025 1 commit

Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9

Julien Denize authored Nov 21, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

57430fc9

20 Nov, 2025 2 commits
- [CI/Build] Remove skip global cleanup in test_struct_output_generate.py (#29022) · c7a29d2c
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  c7a29d2c
- [CI/Build] Skip lm-format-enforcer tests in test_struct_output_generate.py for now (#29021) · 8237ab8a
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  8237ab8a
14 Nov, 2025 1 commit

[BugFix][CI/Build][ROCM] Fix import error and apply assert in appropriate case... · 93103575

rasmith authored Nov 14, 2025


[BugFix][CI/Build][ROCM] Fix import error and apply assert in appropriate case in test_struct_output_generate (#28311)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

93103575

08 Nov, 2025 1 commit
- `reasoning_content` -> `reasoning` (#27752) · d9ab1ad9
  Harry Mellor authored Nov 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d9ab1ad9
05 Nov, 2025 1 commit
- [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
  wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  428bc7bf
18 Oct, 2025 1 commit

[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515) · 7c572544

Hanchenli authored Oct 17, 2025


Signed-off-by: Hanchenli <lihanc2002@gmail.com>
Signed-off-by: Hanchenli <61769611+Hanchenli@users.noreply.github.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wei Wei <wwei6@meta.com>
Co-authored-by: Wei Wei <weiweinpu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

7c572544

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
08 Oct, 2025 1 commit
- Tidy `vllm/config/__init__.py` to only add classes and functions (#26405) · 2f99f2f5
  Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2f99f2f5
07 Oct, 2025 1 commit
- [V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1e4ecca1
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
03 Oct, 2025 1 commit
- [CI/Build] do not enforce precompilation on tpu ci tests (#25992) · adae0c1f
  Xiang Si authored Oct 03, 2025
```
Signed-off-by: Xiang Si <sixiang@google.com>
```
  adae0c1f
24 Sep, 2025 1 commit
- Improve output when failing json.loads() on structured output test (#25483) · 7ad5e50a
  Doug Smith authored Sep 23, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  7ad5e50a
23 Sep, 2025 1 commit
- Add backward compatibility for `GuidedDecodingParams` (#25422) · 875d6def
  Harry Mellor authored Sep 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  875d6def
18 Sep, 2025 1 commit

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 1 commit
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
08 Sep, 2025 1 commit
- [CI/Build] Disable flaky test_structured_output tests (#24404) · 3a3e91bd
  22quinn authored Sep 07, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  3a3e91bd
07 Sep, 2025 1 commit
- [CI][Fix] deterministic seed for flaky CI runs on structured outputs (#24380) · e6759754
  Aaron Pham authored Sep 06, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  e6759754
06 Sep, 2025 1 commit
- [CI] Disable flaky structured output test from CI (#24366) · b121ca22
  Roger Wang authored Sep 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  b121ca22
25 Aug, 2025 1 commit

Frontend: Adding LM Format Enforcer support to V1 engine (#22564) · 39971db3

Noam Gat authored Aug 25, 2025


Signed-off-by: Noam Gat <noamgat@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39971db3

22 Aug, 2025 2 commits
- Add unit tests for batched guided and non-guided requests (#23389) · b6d7d34f
  Yong Hoon Shin authored Aug 22, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  b6d7d34f
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
10 Jul, 2025 1 commit
- [V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) · d6902ce7
  Nathan Hoos authored Jul 10, 2025
```
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
```
  d6902ce7
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
23 May, 2025 1 commit
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
14 May, 2025 1 commit

[V1] Structured Outputs + Thinking compatibility (#16577) · 2fc9075b

Aaron Pham authored May 14, 2025


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

2fc9075b

12 May, 2025 1 commit
- [CI] Make JSON output tests less likely to fail (#17859) · ebab1ac3
  Russell Bryant authored May 12, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ebab1ac3
08 May, 2025 1 commit

[V1] Add VLLM_ALLOW_INSECURE_SERIALIZATION env var (#17490) · 6930a411

Russell Bryant authored May 08, 2025


Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

6930a411

01 May, 2025 1 commit
- [CI][TPU] Skip structured outputs+spec decode tests on TPU (#17510) · 17b4d85f
  Michael Goin authored Apr 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  17b4d85f
30 Apr, 2025 1 commit
- [V1][Feature] Enable Speculative Decoding with Structured Outputs (#14702) · 34120f5a
  Benjamin Chislett authored Apr 29, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  34120f5a
29 Apr, 2025 2 commits
- Simplify (and fix) passing of guided decoding backend options (#17008) · a6977dbd
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6977dbd
- implement Structural Tag with Guidance backend (#17333) · 86d9fc29
  Michał Moskal authored Apr 28, 2025
```
Signed-off-by: Michal Moskal <michal@moskal.me>
```
  86d9fc29
26 Apr, 2025 1 commit
- [V1] Add `structural_tag` support using xgrammar (#17085) · f8acd01f
  Russell Bryant authored Apr 26, 2025
  
  f8acd01f