Commits · 34ddcf9ff433a9a80657ec507a57c049d7ef8183 · OpenDAS / vllm_cscc

25 Jul, 2025 1 commit
- [Frontend] `run-batch` supports V1 (#21541) · 34ddcf9f
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34ddcf9f
24 Jul, 2025 3 commits
- [TPU][TEST] HF_HUB_DISABLE_XET=1 the test 3. (#21539) · 07d80d7b
  QiliangCui authored Jul 24, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  07d80d7b
- Add think chunk (#21333) · 6d8d0a24
  Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6d8d0a24
- [XPU][UT] increase intel xpu CI test scope (#21492) · 13e4ee1d
  Liangliang Ma authored Jul 24, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  13e4ee1d
23 Jul, 2025 1 commit
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
20 Jul, 2025 1 commit
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
19 Jul, 2025 1 commit
- [Bugfix][Frontend] Fix openai CLI arg `middleware` (#21220) · b3d82108
  22quinn authored Jul 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  b3d82108
17 Jul, 2025 2 commits
- [Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820) · 5a7fb3ab
  Asher authored Jul 17, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  5a7fb3ab
- Update PyTorch to `torch==2.7.1` for CUDA (#21011) · 4e7dfbe7
  Michael Goin authored Jul 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4e7dfbe7
16 Jul, 2025 3 commits

feat - add a new endpoint `get_tokenizer_info` to provide... · 18bdcf41

Mac Misiura authored Jul 16, 2025


feat - add a new endpoint `get_tokenizer_info` to provide tokenizer/chat-template information (#20575)
Signed-off-by: m-misiura <mmisiura@redhat.com>

18bdcf41

Avoid direct comparison of floating point numbers (#21002) · 6ebf3137
Maximilien de Bayser authored Jul 16, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
6ebf3137

[Voxtral] Add more tests (#21010) · cfbcb9ed

Patrick von Platen authored Jul 16, 2025


Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

cfbcb9ed

15 Jul, 2025 3 commits
- [Deprecation] Remove `nullable_kvs` (#20969) · 1e36c868
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1e36c868
- Voxtral (#20970) · e7e3e6d2
  Patrick von Platen authored Jul 15, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e7e3e6d2
- [CI] Fix flaky `test_streaming_response` test (#20913) · 80305c1b
  Nicolò Lucchesi authored Jul 15, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  80305c1b
14 Jul, 2025 1 commit
- [Misc] Relax translations tests (#20856) · 149f2435
  Nicolò Lucchesi authored Jul 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  149f2435
13 Jul, 2025 1 commit
- Renable google/gemma-3-1b-it accuracy test. (#20866) · 99b4f080
  QiliangCui authored Jul 12, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  99b4f080
11 Jul, 2025 2 commits
- Temporarily suspend google/gemma-3-1b-it. (#20722) · b4f0b5f9
  QiliangCui authored Jul 11, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  b4f0b5f9
- [Bugfix] Refactor `/invocations` to be task-agnostic (#20764) · cbd14ed5
  Cyrus Leung authored Jul 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd14ed5
10 Jul, 2025 3 commits
- [Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126) · 41060c6e
  Alex Brooks authored Jul 10, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  41060c6e
- [V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) · d6902ce7
  Nathan Hoos authored Jul 10, 2025
```
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
```
  d6902ce7
- [Frontend] Support Tool Calling with both `tool_choice='required'` and `$defs`. (#20629) · 8f2720de
  Chauncey authored Jul 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  8f2720de
09 Jul, 2025 2 commits

[Bugfix] Fix the issue where `reasoning_content` is `None` when Thinkng is... · 2155e95e

Chauncey authored Jul 09, 2025


[Bugfix] Fix the issue where `reasoning_content` is `None` when Thinkng is enabled and `tool_choice` is set to `'required'`. (#20662)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

2155e95e

[tech debt] Revisit lora request model checker (#20636) · baed180a
kourosh hakhamaneshi authored Jul 08, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
baed180a

08 Jul, 2025 1 commit

[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e

Sanger Steel authored Jul 08, 2025


[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>

72d14d0e

07 Jul, 2025 3 commits
- [Misc] Add fully interleaved support for multimodal 'string' content format (#14047) · e601efcb
  Anton authored Jul 07, 2025
```
Signed-off-by: drobyshev.anton <drobyshev.anton@wb.ru>
Co-authored-by: drobyshev.anton <drobyshev.anton@wb.ru>
```
  e601efcb
- [Front-end] microbatch tokenization (#19334) · a37d75bb
  ztang2370 authored Jul 08, 2025
```
Signed-off-by: zt2370 <ztang2370@gmail.com>
```
  a37d75bb
- Implement OpenAI Responses API [1/N] (#20504) · 462b2692
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  462b2692
06 Jul, 2025 1 commit

[Frontend] Support image object in llm.chat (#19635) · fe1e9248

Flora Feng authored Jul 05, 2025


Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>

fe1e9248

04 Jul, 2025 1 commit
- [Bug][Frontend] Fix structure of transcription's decoder_prompt (#18809) · 9e5452ee
  sangbumlikeagod authored Jul 04, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
```
  9e5452ee
03 Jul, 2025 2 commits
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
02 Jul, 2025 1 commit

[Frontend] Support configurable mm placeholder strings & flexible video... · 2e7cbf2d

Chenheli Hua authored Jul 01, 2025


[Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>

2e7cbf2d

01 Jul, 2025 2 commits

Add GLM4.1V model (Draft) (#19331) · ed70f3c6

Yuxuan Zhang authored Jul 01, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

ed70f3c6

[Bugfix] Fix include prompt in stream response when echo=true (#15233) · e28533a1
fyuan1316 authored Jul 01, 2025
```
Signed-off-by: Yuan Fang <yuanfang@alauda.io>
```
e28533a1

27 Jun, 2025 1 commit
- [Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946) · 6e244ae0
  Yazan Sharaya authored Jun 27, 2025
```
Signed-off-by: Yazan-Sharaya <yazan.sharaya.yes@gmail.com>
```
  6e244ae0
25 Jun, 2025 1 commit

[Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723

Nicolò Lucchesi authored Jun 25, 2025


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

e795d723

19 Jun, 2025 2 commits

[Core][Bugfix] Fix Online MM Beam Search (#19688) · ead21102
Alex Brooks authored Jun 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
ead21102

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

17 Jun, 2025 1 commit
- [Frontend] add chunking audio for > 30s audio (#19597) · ede5c4eb
  nguyenhoangthuan99 authored Jun 17, 2025
```
Signed-off-by: nguyenhoangthuan99 <thuanhppro12@gmail.com>
```
  ede5c4eb