Commits · 65ac8d8dc474839eafaea2adddb76fd2341cb78d · OpenDAS / vllm_cscc

04 Nov, 2025 1 commit
- [Metrics] Enable sleep state metric outside of dev mode (#27867) · 380ba681
  Mark McLoughlin authored Nov 04, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  380ba681
30 Oct, 2025 1 commit
- [Fix] Skip `record_sleep_state` logic in `PrometheusStatsLogger` if not in dev mode (#27789) · 49170025
  Sumanth R Hegde authored Oct 30, 2025
```
Signed-off-by: SumanthRH <sumanthrh99@gmail.com>
```
  49170025
29 Oct, 2025 2 commits
- [KVConnector] Add metrics to Prometheus-Grafana dashboard (#26811) · accb8fab
  Nicolò Lucchesi authored Oct 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  accb8fab
- [Core] Exposing engine sleep & wake_up state as prometheus metrics (#24176) · 1da3309a
  Braulio Dumba authored Oct 29, 2025
```
Signed-off-by: Braulio Dumba <Braulio.Dumba@ibm.com>
```
  1da3309a
24 Oct, 2025 1 commit
- [Log] Optimize Startup Log (#26740) · 52efc34e
  Wentao Ye authored Oct 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  52efc34e
23 Oct, 2025 1 commit
- [Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245) · 88afa110
  Tova Movshovitz authored Oct 23, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  88afa110
18 Oct, 2025 1 commit
- [V1][Metrics][Plugin] Add plugin support for custom `StatLoggerBase` implementations (#22456) · 83e760c5
  Tova Movshovitz authored Oct 19, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  83e760c5
14 Oct, 2025 1 commit
- [Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
  Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  8317f723
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 2 commits
- [Metrics] Add test for multi-modal cache stats logging (#26588) · e5192819
  Mark McLoughlin authored Oct 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  e5192819
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
05 Oct, 2025 2 commits
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Easy] Add str repr for IterationStats (#26232) · 78c1d5bf
  22quinn authored Oct 04, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  78c1d5bf
03 Oct, 2025 1 commit
- [NIXL][Misc] Expose metrics from NIXL for logging to CLI (#25388) · 48f30902
  Nicolò Lucchesi authored Oct 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  48f30902
27 Sep, 2025 1 commit
- [Core] Don't count preempted tokens in prefix cache hit rate (#25787) · 8bf8f458
  Zhuohan Li authored Sep 26, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  8bf8f458
26 Sep, 2025 1 commit

[ray][metrics] Replace ':' with '_' for OpenTelemetry compatibility in Ray (#25439) · 8d52f2b3

Seiji Eicher authored Sep 26, 2025

Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>

8d52f2b3

25 Sep, 2025 1 commit
- [Core] Enable command line logging for LLMEngine (#25610) · 8c435c9b
  Zhuohan Li authored Sep 25, 2025
```
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  8c435c9b
24 Sep, 2025 1 commit
- [V1][Metrics] Add per-request TPOT histogram (#24015) · d06b5a95
  baxingpiaochong authored Sep 24, 2025
```
Signed-off-by: baxingpiaochong <771405853@qq.com>
```
  d06b5a95
19 Sep, 2025 1 commit
- [P/D][Nixl] Introduce `KVTransferMetrics` and aggregation strategy (#22188) · a3d087ad
  Nicolò Lucchesi authored Sep 19, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a3d087ad
16 Sep, 2025 1 commit
- [Metrics] Hide deprecated metrics with gpu_ prefix (#24245) · 2942970d
  Mark McLoughlin authored Sep 16, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  2942970d
14 Sep, 2025 1 commit

[Spec Decoding]Support Spec Decoding Metrics in DP Mode (#24049) · 90f3f7d7

wuhang authored Sep 15, 2025


Signed-off-by: wuhang <wuhang6@huawei.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

90f3f7d7

12 Sep, 2025 1 commit

[V1] feat:add engine v1 tracing (#20372) · 40b6c912

RichardoMu authored Sep 12, 2025


Signed-off-by: Mu Huai <tianbowen.tbw@antgroup.com>
Signed-off-by: Ye Zhang <zhysishu@gmail.com>
Signed-off-by: RichardoMu <44485717+RichardoMrMu@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Ye Zhang <zhysishu@gmail.com>
Co-authored-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: 瑜琮 <ly186375@antfin.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

40b6c912

08 Sep, 2025 1 commit
- [Bugfix] Disable the statslogger if the api_server_count is greater than 1 (#22227) · e680723e
  Chauncey authored Sep 09, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  e680723e
04 Sep, 2025 1 commit

[Misc] Have AsyncLLM `custom_stat_loggers` extend default logger list (#20952) · 60b755cb

Seiji Eicher authored Sep 04, 2025


Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

60b755cb

02 Sep, 2025 2 commits
- [Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
  Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  24177984
- [Doc]: fix typos in Python comments (#24042) · 0235103c
  Didier Durand authored Sep 02, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0235103c
27 Aug, 2025 1 commit
- [Docs] Fix warnings in `mkdocs build` (continued) (#23743) · 4e4d017b
  Hyogeun Oh (오효근) authored Aug 28, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
```
  4e4d017b
02 Aug, 2025 1 commit
- [BugFix] Improve internal DP load balancing (#21617) · 8d524ce7
  Nick Hill authored Aug 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8d524ce7
27 Jul, 2025 1 commit
- Refactor: Remove numpy dependency from LoggingStatLogger (#20529) · a8936e51
  ZiTian.Zhao authored Jul 27, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  a8936e51
21 Jul, 2025 1 commit

[DP] Fix Prometheus Logging (#21257) · 29d1ffc5

Robert Shaw authored Jul 21, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

29d1ffc5

20 Jul, 2025 1 commit
- Enable v1 metrics tests (#20953) · d1fb65bd
  Seiji Eicher authored Jul 19, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  d1fb65bd
20 Jun, 2025 1 commit
- Export NaNs in logits to scheduler_stats if output is corrupted (#18777) · 2e3e3c86
  Vlad Tiberiu Mihailescu authored Jun 20, 2025
```
Signed-off-by: Vlad Mihailescu <vtmihailescu@gmail.com>
```
  2e3e3c86
19 Jun, 2025 1 commit

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

14 Jun, 2025 1 commit
- [V1][Metrics] Deprecate metrics with gpu_ prefix for non GPU specific metrics. (#18354) · d1e34cc9
  Saheli Bhattacharjee authored Jun 14, 2025
```
Signed-off-by: Saheli Bhattacharjee <saheli@krai.ai>
```
  d1e34cc9
04 Jun, 2025 1 commit
- Fix ValueError: Missing value for tag key(s): model_name,engine. (#19113) · 2669a0d7
  Seiji Eicher authored Jun 04, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  2669a0d7
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
01 Jun, 2025 1 commit
- [BugFix] Fix incorrect metrics shutdown error log message (#18992) · 2b102d51
  Nick Hill authored May 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2b102d51
30 May, 2025 1 commit
- [Perf] API-server scaleout with many-to-many server-engine comms (#17546) · 2dbe8c07
  Nick Hill authored May 30, 2025
  
  2dbe8c07
27 May, 2025 1 commit
- [V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010) · 06a03380
  Mark McLoughlin authored May 27, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  06a03380
16 May, 2025 1 commit
- [Misc] Add Ray Prometheus logger to V1 (#17925) · 54181767
  Seiji Eicher authored May 16, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  54181767