Unverified Commit 3555b72f authored by GuanLuo's avatar GuanLuo Committed by GitHub
Browse files

chore: relax DynamoStatLoggerPublisher.record() signature (#3986)


Signed-off-by: default avatarGuan Luo <41310872+GuanLuo@users.noreply.github.com>
parent ba99d24a
......@@ -63,6 +63,8 @@ class DynamoStatLoggerPublisher(StatLoggerBase):
scheduler_stats: SchedulerStats,
iteration_stats: Optional[IterationStats],
engine_idx: int = 0,
*args,
**kwargs,
):
# request_total_slots and kv_total_blocks are properties of model + gpu
# we should only publish them once, not every metric update
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment