* support megatron v3.0.2 * keep num_experts for lower version of megatron
Attach a file by drag & drop or click to upload
