Unverified Commit 2c58742d authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[UX] Change kv-cache-memory log level to debug (#25479)


Signed-off-by: default avatarMichael Goin <mgoin64@gmail.com>
parent 4c966e44
......@@ -389,7 +389,7 @@ class Worker(WorkerBase):
f"utilize gpu memory. Current kv cache memory in use is "
f"{int(self.available_kv_cache_memory_bytes)} bytes.")
logger.info(msg)
logger.debug(msg)
# Warm up sampler and preallocate memory buffer for logits and other
# sampling related tensors of max possible shape to avoid memory
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment