Commits · 136a17fe6edacba292d899af4cfd424e0ca98d9f · OpenDAS / vllm_cscc

15 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.func` (#26904) · 136a17fe
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  136a17fe
- [Core][Easy] Use envs.__getattr__ for all Unify to environment variable access (#26810) · 07ca70af
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  07ca70af
14 Oct, 2025 1 commit
- [Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
  Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  8317f723
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 1 commit
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
09 Oct, 2025 1 commit
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
06 Oct, 2025 1 commit
- [Frontend] Consolidate tokenizer init code (#26276) · 391612e7
  Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  391612e7
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
03 Oct, 2025 2 commits

[Renderer] Move Processor out of AsyncLLM (#24138) · 812b7f54

Yang Liu authored Oct 03, 2025


Signed-off-by: Yang <lymailforjob@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

812b7f54

[Input] Remove unused `prompt` field (#26097) · 0ad9951c
Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0ad9951c

02 Oct, 2025 1 commit
- [Misc] Make handling of SamplingParams clearer in n>1 case (#26032) · 169313b9
  Nick Hill authored Oct 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  169313b9
01 Oct, 2025 1 commit
- [Bugfix] Apply same sampling parameters for both `n=1` and `n>1` (#26005) · 3b7c20a6
  Kenichi Maehashi authored Oct 01, 2025
```
Signed-off-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  3b7c20a6
21 Sep, 2025 1 commit

[V0 Deprecation] Remove V0 core (#25321) · c99db8c8

Woosuk Kwon authored Sep 20, 2025


Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

c99db8c8

18 Sep, 2025 1 commit

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 1 commit
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
12 Sep, 2025 2 commits

[UX] Remove AsyncLLM torch profiler disabled log (#24609) · 9d2a4460
Michael Goin authored Sep 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
9d2a4460

[V1] feat:add engine v1 tracing (#20372) · 40b6c912

RichardoMu authored Sep 12, 2025


Signed-off-by: Mu Huai <tianbowen.tbw@antgroup.com>
Signed-off-by: Ye Zhang <zhysishu@gmail.com>
Signed-off-by: RichardoMu <44485717+RichardoMrMu@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Ye Zhang <zhysishu@gmail.com>
Co-authored-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: 瑜琮 <ly186375@antfin.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

40b6c912

08 Sep, 2025 1 commit
- [Bugfix] Disable the statslogger if the api_server_count is greater than 1 (#22227) · e680723e
  Chauncey authored Sep 09, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  e680723e
04 Sep, 2025 1 commit

[Misc] Have AsyncLLM `custom_stat_loggers` extend default logger list (#20952) · 60b755cb

Seiji Eicher authored Sep 04, 2025


Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

60b755cb

29 Aug, 2025 1 commit
- Fix(async): Add support for truncate_prompt_tokens in AsyncLLM (#23800) · 05d839c1
  Raghavan authored Aug 29, 2025
  
  05d839c1
28 Aug, 2025 1 commit
- [V1] Enable prefill optimization for Gemma3n (#22628) · cb293f6a
  Yong Hoon Shin authored Aug 28, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  cb293f6a
27 Aug, 2025 1 commit
- [Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  69244e67
20 Aug, 2025 1 commit
- [Core] Add torch profiler CPU traces for AsyncLLM. (#21794) · e58c5a97
  Chenheli Hua authored Aug 19, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  e58c5a97
16 Aug, 2025 1 commit
- [Misc] Support passing multiple request ids at once to `AsyncLLM.abort()` (#22944) · ad0297d1
  Nick Hill authored Aug 15, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ad0297d1
14 Aug, 2025 1 commit

[Bugfix] Add reset prefix cache for online serving (#22726) · 7655dc3e

iAmir97 authored Aug 14, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

7655dc3e

08 Aug, 2025 2 commits
- [BugFix] Don't cancel asyncio tasks directly from destructors (#22476) · ccdae737
  Nick Hill authored Aug 08, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ccdae737
- [CI/Build] Fix multimodal tests (#22491) · 1712543d
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1712543d
02 Aug, 2025 1 commit
- [BugFix] Improve internal DP load balancing (#21617) · 8d524ce7
  Nick Hill authored Aug 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8d524ce7
01 Aug, 2025 1 commit
- Deprecate `--disable-log-requests` and replace with `--enable-log-requests` (#21739) · 2d7b09b9
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2d7b09b9
25 Jul, 2025 1 commit
- [V1] Get supported tasks from model runner instead of model config (#21585) · 46d81d69
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  46d81d69
24 Jul, 2025 1 commit

[DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8

Robert Shaw authored Jul 23, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

d5b981f8

23 Jul, 2025 2 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
22 Jul, 2025 1 commit
- Add tokenization_kwargs to encode for embedding model truncation (#21033) · 44554a00
  Wang Yijun authored Jul 22, 2025
  
  44554a00
21 Jul, 2025 1 commit

[DP] Fix Prometheus Logging (#21257) · 29d1ffc5

Robert Shaw authored Jul 21, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

29d1ffc5

19 Jul, 2025 1 commit
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
19 Jun, 2025 2 commits

[Bugfix] Add check_health to v1 async client. (#19821) · e2148dc5
kourosh hakhamaneshi authored Jun 18, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
e2148dc5

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

06 Jun, 2025 1 commit
- [Bugfix][Core] Update cancellation logic in `generate()` to handle Generator exits (#19225) · ca27f0f9
  Adolfo Victoria authored Jun 06, 2025
```
Co-authored-by: Adolfo Victoria <adovi@meta.com>
```
  ca27f0f9
04 Jun, 2025 1 commit
- [Misc] refactor: simplify EngineCoreClient.make_async_mp_client in AsyncLLM (#18817) · 23027e2d
  CYJiang authored Jun 05, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  23027e2d