"megatron/vscode:/vscode.git/clone" did not exist on "d8c85650ed9b946703383f4b6e12691597c40ccd"
[Pipelines] Encode to max length of input not max length of tokenizer for batch input (#3857)
* remove max_length = tokenizer.max_length when encoding * make style
Showing
Please register or sign in to comment