Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
getting_started_jax.out 1014 Bytes
Newer Older
Paweł Gadziński's avatar
[docs] Getting started refactor (#2534)  
Paweł Gadziński committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34 
pyxis: importing docker image: gitlab-master.nvidia.com/dl/transformerengine/transformerengine:main-jax-py3-devel
pyxis: imported docker image: gitlab-master.nvidia.com/dl/transformerengine/transformerengine:main-jax-py3-devel
# BENCHMARK_BASELINE_OUTPUT_START
Baseline Flax:
Mean time: 86.580 ms
# BENCHMARK_BASELINE_OUTPUT_END

# BENCHMARK_TE_UNFUSED_OUTPUT_START
TE Unfused:
Mean time: 42.252 ms
# BENCHMARK_TE_UNFUSED_OUTPUT_END

# BENCHMARK_TE_UNFUSED_ATTN_OUTPUT_START
TE Unfused + TE Attention:
Mean time: 35.054 ms
# BENCHMARK_TE_UNFUSED_ATTN_OUTPUT_END

# BENCHMARK_TE_UNFUSED_FP8_OUTPUT_START
TE Unfused + TE Attention + FP8:
Mean time: 22.638 ms
# BENCHMARK_TE_UNFUSED_FP8_OUTPUT_END

# BENCHMARK_TE_FUSED_FP8_OUTPUT_START
TE Fused + TE Attention + FP8:
Mean time: 23.703 ms
# BENCHMARK_TE_FUSED_FP8_OUTPUT_END

# BENCHMARK_TE_TRANSFORMER_LAYER_OUTPUT_START
TE TransformerLayer + FP8:
Mean time: 22.812 ms
# BENCHMARK_TE_TRANSFORMER_LAYER_OUTPUT_END


Summary written to getting_started_jax_summary.csv