Commits · afd0da2186c1d58fb48e138df0a2f548612b5d7d · OpenDAS / vllm_cscc · GitLab

29 Jan, 2025 1 commit
- [V1][Metrics] Add TTFT and TPOT histograms (#12530) · 46fb0567
  Mark McLoughlin authored Jan 29, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  46fb0567
28 Jan, 2025 1 commit
- [V1][Metrics] Add per-request prompt/generation_tokens histograms (#12516) · c386c43c
  Mark McLoughlin authored Jan 28, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  c386c43c
22 Jan, 2025 1 commit
- [Frontend][V1] Online serving performance improvements (#12287) · aea94362
  Nick Hill authored Jan 22, 2025
  
  aea94362
13 Jan, 2025 1 commit
- [V1] [2/n] Logging and Metrics - `OutputProcessor` Abstraction (#11973) · 619ae268
  Robert Shaw authored Jan 12, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
  619ae268