Unverified Commit 4d29e91b authored by Divakar Verma's avatar Divakar Verma Committed by GitHub
Browse files

[Misc] sort torch profiler table by kernel timing (#11813)

parent 91445c7b
...@@ -52,7 +52,7 @@ def main(args: argparse.Namespace): ...@@ -52,7 +52,7 @@ def main(args: argparse.Namespace):
llm.generate(dummy_prompts, llm.generate(dummy_prompts,
sampling_params=sampling_params, sampling_params=sampling_params,
use_tqdm=False) use_tqdm=False)
print(p.key_averages()) print(p.key_averages().table(sort_by="self_cuda_time_total"))
else: else:
start_time = time.perf_counter() start_time = time.perf_counter()
llm.generate(dummy_prompts, llm.generate(dummy_prompts,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment