Commits · 2f808e69ab16a8775cd58849b15b465d4f11b92e · OpenDAS / vllm_cscc

23 Jul, 2024 1 commit
- [Bugfix] StatLoggers: cache spec decode metrics when they get collected. (#6645) · 2f808e69
  Thomas Parnell authored Jul 24, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  2f808e69
17 Jul, 2024 1 commit
- [Bugfix] Fix Ray Metrics API usage (#6354) · 5f0b9933
  Antoni Baum authored Jul 17, 2024
  
  5f0b9933
16 Jul, 2024 1 commit
- [Misc] Log spec decode metrics (#6454) · 160e1d8c
  Cody Yu authored Jul 16, 2024
  
  160e1d8c
29 Jun, 2024 1 commit
- [Misc] Extend vLLM Metrics logging API (#5925) · 906a19cd
  William Lin authored Jun 28, 2024
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  906a19cd
08 Jun, 2024 1 commit
- [CI/Test] improve robustness of test (vllm_runner) (#5357) · 8ea5e44a
  youkaichao authored Jun 08, 2024
```
[CI/Test] improve robustness of test by replacing del with context manager (vllm_runner) (#5357)
```
  8ea5e44a
04 May, 2024 1 commit
- [Bugfix] Fix inappropriate content of model_name tag in Prometheus metrics (#3937) · 43029870
  DearPlanet authored May 05, 2024
  
  43029870
02 May, 2024 1 commit
- [CI]Add regression tests to ensure the async engine generates metrics (#4524) · 5e401bce
  Ronen Schaffer authored May 02, 2024
  
  5e401bce
11 Mar, 2024 1 commit
- Re-enable the 80 char line width limit (#3305) · 2f8844ba
  Zhuohan Li authored Mar 10, 2024
  
  2f8844ba
25 Feb, 2024 1 commit
- Port metrics from `aioprometheus` to `prometheus_client` (#2730) · ef978fe4
  Harry Mellor authored Feb 25, 2024
  
  ef978fe4
22 Feb, 2024 1 commit
- Include tokens from prompt phase in `counter_generation_tokens` (#2802) · 4caf7044
  Ronen Schaffer authored Feb 23, 2024
  
  4caf7044
19 Feb, 2024 1 commit
- Fix `vllm:prompt_tokens_total` metric calculation (#2869) · e433c115
  Ronen Schaffer authored Feb 19, 2024
  
  e433c115