GitLab

Getting rid of profiling and adding route for index (it sees the root of the project as the megatron subdirectory for some reason)

hidden_size % attention_heads == 0 is handled above when dealing with kv_channels.

Adding check for decoder sequence length.