Commits · c6187f55f7c4844ed9ff5630d41114cbe6fccb6b · OpenDAS / vllm_cscc

09 Oct, 2025 3 commits
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
- [Misc] Upgrade more code to Python 3.10 (#26463) · dc7976dd
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dc7976dd
07 Oct, 2025 3 commits
- Revert #24446 and #26168 (#26332) · 31a4b3e6
  Thomas Parnell authored Oct 08, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  31a4b3e6
- [V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1e4ecca1
- [responsesAPI][bugfix] serialize harmony messages (#26185) · 185d8ed4
  Andrew Xia authored Oct 07, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  185d8ed4
06 Oct, 2025 2 commits
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
- [CI][gpt-oss] Enable python tool tests in CI (#24315) · 91ac7f76
  wuhang authored Oct 06, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  91ac7f76
05 Oct, 2025 4 commits
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Bugfix] Allow `--skip-tokenizer-init` with `echo and return_token_ids` (#26238) · a964e5e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a964e5e6
04 Oct, 2025 3 commits
- [Renderer] Clean up renderer code (#26216) · 119f0063
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  119f0063
- [Core] Enable decode of context length equal to max model length (#26168) · f05fea1f
  Yannick Schnider authored Oct 04, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
```
  f05fea1f
- [BugFix] Use async Mistral Tokenizer in Chat Completions (#26134) · ea25a76c
  Ben Browning authored Oct 03, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ea25a76c
03 Oct, 2025 5 commits
- [responsesAPI] add better error messaging for long prompts (#25724) · 831b1241
  Andrew Xia authored Oct 03, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  831b1241
- [Renderer] Move Processor out of AsyncLLM (#24138) · 812b7f54
  Yang Liu authored Oct 03, 2025
```
Signed-off-by: Yang <lymailforjob@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  812b7f54
- [openai] Fix missing tool usage check (system message) (#24768) · 2ed3f20d
  kyt authored Oct 03, 2025
```
Signed-off-by: kyt <eluban4532@gmail.com>
```
  2ed3f20d
- add(v1): RequestStatesStats to RequestOutput (#24947) · 3e70e3d4
  HUIJONG JEONG authored Oct 03, 2025
```
Signed-off-by: huijjj <huijong.jeong@squeezebits.com>
```
  3e70e3d4
- [gpt-oss] disable tool server initialization if no tool in request (#25790) · e5017cd6
  Andrew Xia authored Oct 02, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  e5017cd6
30 Sep, 2025 3 commits
- [gpt-oss] use vLLM instead of openai types for streaming (#25186) · 5db1870b
  Andrew Xia authored Sep 30, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  5db1870b
- [Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f652e6c
- Test Prompt Embeds/LoRA compatibility and Enable LoRA Support for OPT Models (#25717) · 78a47f87
  Andrew Sansom authored Sep 29, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  78a47f87
27 Sep, 2025 2 commits

Add filtering for chat template kwargs (#25794) · 7977e502

Russell Bryant authored Sep 27, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7977e502

Add option to restrict media domains (#25783) · 3958b96b

Russell Bryant authored Sep 26, 2025


Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>

3958b96b

25 Sep, 2025 2 commits
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
- [CI/Build] Fix flaky entrypoints test (#25663) · 0bcc3a16
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0bcc3a16
24 Sep, 2025 1 commit
- [Bugfix] [Frontend] Cleanup gpt-oss non-streaming chat tool calls (#25514) · 5caaeb71
  Ben Browning authored Sep 23, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  5caaeb71
23 Sep, 2025 2 commits
- [gpt-oss][bugfix] remove logic to require resp_ in ResponseAPI (#25428) · 95bc60e4
  Andrew Xia authored Sep 23, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  95bc60e4
- [Test]: Hermes tool parser stream output error in Qwen3 case (#25203) · 4322c553
  Andreas Hartel authored Sep 23, 2025
```
Signed-off-by: Andreas Hartel <andreas.hartel@aleph-alpha.com>
```
  4322c553
22 Sep, 2025 2 commits

[Frontend] Responses API MCP tools for built in tools and to pass through headers (#24628) · 45d7d852

Alec S authored Sep 22, 2025


Signed-off-by: Alec Solder <alecs@fb.com>
Signed-off-by: Alec S <10566873+alecsolder@users.noreply.github.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

45d7d852

[Bugfix] Fix hermes tool parser handling of non-string argument types (#22002) · 0eecb316

WeiQing Chen authored Sep 22, 2025


Signed-off-by: wangzi <3220100013@zju.edu.cn>
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

0eecb316

21 Sep, 2025 3 commits
- [Bugfix][V0 Deprecation][CI] use async mock and await for async method (#25325) · 04d37523
  Yang Liu authored Sep 21, 2025
```
Signed-off-by: Yang <lymailforjob@gmail.com>
```
  04d37523
- [CI] Skip tests failing on main (#25326) · 72dd1595
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  72dd1595
- [V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  52c2a8d4
20 Sep, 2025 2 commits
- [Bugfix] fix tool call arguments is empty (#25223) · f91480b2
  Chauncey authored Sep 20, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: xin.li <xin.li@daocloud.io>
```
  f91480b2
- test: Remove vestigial skip for prompt embeds tests after landing v1 Prompt Embeds support (#25291) · c7e71361
  Andrew Sansom authored Sep 19, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  c7e71361
19 Sep, 2025 3 commits
- [Frontend] Responses API messages out, just harmony for now (#24985) · e69e0b8b
  Alec S authored Sep 19, 2025
```
Signed-off-by: Alec Solder <alecs@fb.com>
Co-authored-by: Alec Solder <alecs@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  e69e0b8b
- [CI/Build] fix test function_calling (#25072) · 47fd08aa
  Chauncey authored Sep 20, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  47fd08aa
- [Frontend] Pass API server count to each process (#23717) · 6c117cff
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6c117cff