Commits · 880be2b1b80fb2d18c32b0ee5a95174cf2e37c7d · OpenDAS / vllm_cscc

20 Mar, 2026 1 commit
- [Metrics] Some small refactoring for better maintainability (#33898) · 880be2b1
  Martin Hickey authored Mar 20, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  880be2b1
18 Mar, 2026 1 commit
- [Bugfix] Expand quantization method support in perf metrics (#37231) · 828f862a
  Thillai Chithambaram authored Mar 18, 2026
```
Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>
```
  828f862a
23 Feb, 2026 1 commit

[Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950) · 5cc7c445

Mark McLoughlin authored Feb 23, 2026



Export the existing Model FLOPs Utilization (MFU) metrics via Prometheus.

`--enable-mfu-metrics` is required for these to be exposed.
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>

5cc7c445

27 Jan, 2026 1 commit

[Metrics][MFU] Fix UnembedMetrics FLOP overcounting for prefill (#33045) (#33045) · 5ec44056

omkhalil authored Jan 27, 2026

Fix UnembedMetrics to correctly count FLOPs for the unembedding (LM head) layer.

The bug: UnembedMetrics used total_num_tokens() which counts all tokens in the
batch for projection flops, vocab projections are run on just the last token for the
autoregressive use case.
Co-authored-by: Omar Mohamed Khalil <omarkhalil@meta.com>

5ec44056

18 Dec, 2025 1 commit

[Metrics] Model FLOPs Utilization estimation (#30738) · a0b782f9

SungMinCho authored Dec 17, 2025


Signed-off-by: SungMinCho <tjdals4565@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

a0b782f9