Commits · 6e650f56a16618db87147d97f699fa407ed1205d · OpenDAS / vllm_cscc · GitLab

23 Jan, 2025 1 commit
- [torch.compile] decouple compile sizes and cudagraph sizes (#12243) · 6e650f56
  youkaichao authored Jan 24, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6e650f56
10 Dec, 2024 1 commit
- monitor metrics of tokens per step using cudagraph batchsizes (#11031) · ebf77806
  youkaichao authored Dec 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ebf77806
03 Dec, 2024 1 commit
- [Frontend] correctly record prefill and decode time metrics (#10853) · 7c32b686
  tomeras91 authored Dec 03, 2024
```
Signed-off-by: Tomer Asida <tomera@ai21.com>
```
  7c32b686
02 Dec, 2024 1 commit
- [core] Avoid metrics log noise when idle - include speculative decodi… (#10809) · b7954776
  cduk authored Dec 02, 2024
  
  b7954776
19 Nov, 2024 2 commits
- [Core] Avoid metrics log noise when idle (#8868) · efa90846
  Russell Bryant authored Nov 19, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  efa90846
- [Bugfix] Guard for negative counter metrics to prevent crash (#10430) · 272e31c0
  Travis Johnson authored Nov 18, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  272e31c0
11 Nov, 2024 1 commit

[Metrics] add more metrics (#4464) · 874f551b

harrywu authored Nov 12, 2024


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

874f551b

04 Nov, 2024 1 commit
- [Frontend] Add max_tokens prometheus metric (#9881) · ac04a97a
  tomeras91 authored Nov 05, 2024
```
Signed-off-by: Tomer Asida <tomera@ai21.com>
```
  ac04a97a
29 Oct, 2024 2 commits
- [MISC] Set label value to timestamp over 0, to keep track of recent history (#9777) · 0ad216f5
  Kunjan authored Oct 29, 2024
```
Signed-off-by: Kunjan Patel <kunjanp@google.com>
```
  0ad216f5
- [Misc] Add metrics for request queue time, forward time, and execute time (#9659) · 74fc2d77
  科英 authored Oct 30, 2024
  
  74fc2d77
18 Oct, 2024 1 commit

[MISC] Add lora requests to metrics (#9477) · 9bb10a7d

Kunjan authored Oct 18, 2024


Co-authored-by: Kunjan Patel <kunjanp_google_com@vllm.us-central1-a.c.kunjanp-gke-dev-2.internal>

9bb10a7d

16 Oct, 2024 1 commit
- [CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267) · 776dbd74
  Russell Bryant authored Oct 16, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  776dbd74
11 Oct, 2024 1 commit
- [misc] hide best_of from engine (#9261) · cbc2ef55
  youkaichao authored Oct 10, 2024
```
Co-authored-by: Brendan Wong <bjwpokemon@gmail.com>
```
  cbc2ef55
19 Aug, 2024 1 commit
- [MISC] Add prefix cache hit rate to metrics (#7606) · 3ac50b47
  Cody Yu authored Aug 19, 2024
  
  3ac50b47
18 Aug, 2024 1 commit
- [ Bugfix ] Fix Prometheus Metrics With `zeromq` Frontend (#7279) · e3b31821
  Robert Shaw authored Aug 18, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  e3b31821
23 Jul, 2024 1 commit
- [Bugfix] StatLoggers: cache spec decode metrics when they get collected. (#6645) · 2f808e69
  Thomas Parnell authored Jul 24, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  2f808e69
17 Jul, 2024 1 commit
- [Bugfix] Fix Ray Metrics API usage (#6354) · 5f0b9933
  Antoni Baum authored Jul 17, 2024
  
  5f0b9933
16 Jul, 2024 2 commits
- [Misc] Log spec decode metrics (#6454) · 160e1d8c
  Cody Yu authored Jul 16, 2024
  
  160e1d8c
- [Misc] Fix typos in spec. decode metrics logging. (#6470) · 7508a3dc
  Thomas Parnell authored Jul 16, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  7508a3dc
01 Jul, 2024 1 commit
- [Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker (#5348) · 80ca1e6a
  sroy745 authored Jul 01, 2024
  
  80ca1e6a
29 Jun, 2024 1 commit
- [Misc] Extend vLLM Metrics logging API (#5925) · 906a19cd
  William Lin authored Jun 28, 2024
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  906a19cd
15 Jun, 2024 1 commit
- [mypy] Enable type checking for test directory (#5017) · 0e9164b4
  Cyrus Leung authored Jun 15, 2024
  
  0e9164b4
13 May, 2024 1 commit
- [Scheduler] Warning upon preemption and Swapping (#4647) · e7c46b95
  SangBin Cho authored May 13, 2024
```
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
```
  e7c46b95
01 May, 2024 1 commit
- [Bugfix] Fix 307 Redirect for `/metrics` (#4523) · 4dc8026d
  Robert Shaw authored May 01, 2024
  
  4dc8026d
28 Apr, 2024 1 commit

Add more Prometheus metrics (#2764) · bf480c53

Ronen Schaffer authored Apr 29, 2024


Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

bf480c53

27 Apr, 2024 1 commit
- [Misc] Fix logger format typo (#4396) · 87f545ba
  Roy authored Apr 27, 2024
  
  87f545ba
26 Apr, 2024 1 commit
- [CI] Disable non-lazy string operation on logging (#4326) · a88081bf
  SangBin Cho authored Apr 26, 2024
```
Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>
```
  a88081bf
23 Apr, 2024 1 commit
- [Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951) · 62b8aebc
  Cade Daniel authored Apr 23, 2024
  
  62b8aebc
13 Apr, 2024 1 commit
- [Bugfix] fix_log_time_in_metrics (#4050) · ec8e3c69
  zspo authored Apr 13, 2024
  
  ec8e3c69
12 Apr, 2024 1 commit
- [Doc] Add typing hints / mypy types cleanup (#3816) · c2b4a1bc
  Michael Feil authored Apr 11, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  c2b4a1bc
25 Mar, 2024 1 commit
- [CI] Try introducing isort. (#3495) · 01bfb22b
  SangBin Cho authored Mar 25, 2024
  
  01bfb22b
11 Mar, 2024 1 commit
- Re-enable the 80 char line width limit (#3305) · 2f8844ba
  Zhuohan Li authored Mar 10, 2024
  
  2f8844ba
01 Mar, 2024 1 commit
- allow user chose log level by --log-level instead of fixed 'info'. (#3109) · 29e70e3e
  Allen.Dou authored Mar 02, 2024
```
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  29e70e3e
29 Feb, 2024 1 commit
- add cache_config's info to prometheus metrics. (#3100) · 9289e577
  Allen.Dou authored Feb 29, 2024
  
  9289e577
25 Feb, 2024 1 commit
- Port metrics from `aioprometheus` to `prometheus_client` (#2730) · ef978fe4
  Harry Mellor authored Feb 25, 2024
  
  ef978fe4
31 Jan, 2024 1 commit
- Refactor Prometheus and Add Request Level Metrics (#2316) · 93b38bea
  Robert Shaw authored Jan 31, 2024
  
  93b38bea
03 Dec, 2023 1 commit
- Add Production Metrics in Prometheus format (#1890) · 5313c2cb
  Simon Mo authored Dec 02, 2023
  
  5313c2cb