Commits · 73f635a75f8a7b6655d45a26e34ac7b9a3ad11fd · OpenDAS / vllm_cscc

15 Jan, 2026 2 commits
- [Refactor] [11/N] to simplify the mcp architecture (#32396) · 707b44cc
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  707b44cc
- [Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369) · 4c1c501a
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4c1c501a
14 Jan, 2026 4 commits
- [Frontend] track responsesAPI server_load (#32323) · 00e6402d
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  00e6402d
- [Frontend] Standardize use of `create_error_response` (#32319) · 3f28174c
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f28174c
- [Refactor] [9/N] to simplify the vLLM openai translations serving ar chitecture (#32313) · 769d0629
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  769d0629
- [Refactor] [8/N] to simplify the vLLM openai responsesapi_serving architecture (#32260) · 9312a6c0
  Chauncey authored Jan 14, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9312a6c0
13 Jan, 2026 1 commit
- [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) · fefce498
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fefce498
09 Jan, 2026 1 commit
- Rename --exclude-log-deltas to --enable-log-deltas (#32020) · ac9f9330
  Kevin Šuc authored Jan 09, 2026
```
Signed-off-by: Catacomba <kevinsuc16@gmail.com>
```
  ac9f9330
08 Jan, 2026 1 commit
- [Frontend] Improve error message (#31987) · aa125ecf
  Cyrus Leung authored Jan 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa125ecf
07 Jan, 2026 1 commit
- [OpenAI] Extend VLLMValidationError to additional validation parameters (#31870) · 1ab055ef
  R3hankhan authored Jan 07, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  1ab055ef
05 Jan, 2026 1 commit

[Frontend] [Doc] Exclude log deltas feature (#30322) · 79ed460d

Kevin Šuc authored Jan 05, 2026


Signed-off-by: Catacomba <kevinsuc16@gmail.com>
Signed-off-by: Kevin Šuc <kevinsuc16@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

79ed460d

30 Dec, 2025 1 commit
- feat(frontend): add --default-chat-template-kwargs CLI argument (#31343) · dc837bc2
  Hojin Yang authored Dec 30, 2025
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
```
  dc837bc2
29 Dec, 2025 1 commit

[Feature] Add offline FastAPI documentation support for air-gapped environments (#30184) · b3a2bdf1

RickyChen / 陳昭儒 authored Dec 30, 2025

Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

b3a2bdf1

23 Dec, 2025 2 commits

[OpenAI] Add parameter metadata to validation errors (#30134) · 769f27e7
R3hankhan authored Dec 23, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
769f27e7

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54

18 Dec, 2025 1 commit
- feat(api): Eager chat template warmup to eliminate first-request latency (#30700) · 05a83dc6
  Nathan Price authored Dec 17, 2025
```
Signed-off-by: Nathan Price <nathan@abridge.com>
```
  05a83dc6
17 Dec, 2025 1 commit
- [Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749) · 9ad5b217
  Chauncey authored Dec 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9ad5b217
15 Dec, 2025 1 commit
- [Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) · 2a1776b7
  Chauncey authored Dec 15, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2a1776b7
07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
05 Dec, 2025 1 commit

[KVConnector][Feature] Support KV connector cache reset via /reset_prefix_cache (#27170) · adb31506

Tova Movshovitz authored Dec 05, 2025

Signed-off-by: tovam <tovam@pliops.com>
Signed-off-by: Tova Movshovitz <tovam@pliops.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

adb31506

03 Dec, 2025 1 commit
- [Refactor] [1/N] to simplify the vLLM serving architecture (#28040) · 3f42b05f
  Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  3f42b05f
02 Dec, 2025 1 commit

[Core] Support reseting all running requests' KV while calling `reset_prefix_cache` (#28827) · d0cd7289

Zhuohan Li authored Dec 01, 2025


Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

d0cd7289

01 Dec, 2025 2 commits
- [Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209) · 092bb73b
  sangbumlikeagod authored Dec 02, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
```
  092bb73b
- [Frontend] Resettle pooling entrypoints (#29634) · 62de4f42
  wang.yuqi authored Dec 01, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  62de4f42
28 Nov, 2025 1 commit
- Revert "Supress verbose logs from model_hosting_container_standards (… (#29335) · f8151b66
  HappyAmazonian authored Nov 28, 2025
```
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f8151b66
20 Nov, 2025 1 commit

[RL] Add Pause and Resume Generation for Asynchronous RL Training (#28037) · 371b1d4c

Samit authored Nov 20, 2025


Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: samithuang <285365963@qq.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

371b1d4c

18 Nov, 2025 1 commit
- Supress verbose logs from model_hosting_container_standards (#28949) · 67745d18
  Michael Goin authored Nov 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67745d18
15 Nov, 2025 1 commit
- [RL] [V1] Remove unused device argument from reset_kv_cache (#28766) · dd6ac1c2
  Zhuohan Li authored Nov 14, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  dd6ac1c2
14 Nov, 2025 2 commits

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

[Frontend] Added chat-style multimodal support to /classify. (#27516) · 360bd876

Srreyansh Sethi authored Nov 14, 2025


Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: vnadathur <glvikramn@gmail.com>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

360bd876

11 Nov, 2025 1 commit

[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session... · bca74e32

Zuyi Zhao authored Nov 10, 2025


[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892)
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

bca74e32

10 Nov, 2025 1 commit
- [Perf] Move gc.freeze logic from EngineCoreProc to EngineCore for better coverage (#27896) · b30372cb
  Jialin Ouyang authored Nov 10, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b30372cb
08 Nov, 2025 1 commit
- [Feat] Drop-in Torch CUDA Profiler (#27841) · 975676d1
  Benjamin Chislett authored Nov 08, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  975676d1
06 Nov, 2025 2 commits
- [Chore] eliminate duplicated and unconditional object serialization in... · d4aa65c9
  Vico Chu authored Nov 07, 2025
```
[Chore] eliminate duplicated and unconditional object serialization in anthropic messages api (#27792)
Signed-off-by: Vico Chu <vico24826@gmail.com>
```
  d4aa65c9
- [Frontend] Fix logging format when enable response logging (#28049) · d1dd5f53
  Roy Wang authored Nov 07, 2025
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  d1dd5f53
05 Nov, 2025 3 commits
- [Core] add support for reasoning parser plugins (#28075) · 752ddeac
  Walter Beller-Morales authored Nov 05, 2025
```
Signed-off-by: walter beller-morales <walter.beller.morales@gmail.com>
```
  752ddeac
- [Refactor] Lazy-loaded reasoning_parser (#28092) · e261d37c
  Chauncey authored Nov 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  e261d37c
- [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
  wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  428bc7bf
04 Nov, 2025 1 commit
- [Refactor] Lazy import tool_parser (#27974) · c02fccdb
  Chauncey authored Nov 04, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  c02fccdb