megatron/text_generation_server.py · 0bb597b42c53355a567aba2a1357cc34b9d99ddd · OpenDAS / Megatron-LM

Jared Casper authored Jul 20, 2022

Adding checks for total number of tokens to keep server from crashing

See merge request ADLR/megatron-lm!428

0bb597b4

text_generation_server.py 10.1 KB