Skip to content

GitLab

"megatron/legacy/model/language_model.py" did not exist on "03d09af09be0f759ad6c9dd60b36e22da67b7c44"
Switch branch/tag
Find file BlameHistoryPermalink
  • Lucy Fox's avatar
    Enable MLIR bridge by default for NHNet and Bert2Bert training. · fe682959
    Lucy Fox authored 
    Testing: Trained Bert2Bert model with MLIR bridge enabled and then NHNet based on Bert2Bert checkpoint, also with MLIR bridge enabled. Exported this to a saved model, ran inference, and confirmed model performance, accuracy, and prediction parity with the model trained without the MLIR bridge enabled.
PiperOrigin-RevId: 326734770
    fe682959
trainer.py 8.75 KB