GitLab

Adds some backward compatibility code so old inference code still works.

A temperature value between 0.0 and 100.0 can now be specified via the API
while running the text generation server. The value passed to
--temperature while running the text generation server is kept as the
default value for all API calls that don't include temperature, even if
different values were manually specified previously.
Signed-Off-By: Robert Clark <roclark@nvidia.com>

Changing the interface to the lm eval harness and fixing bugs caused by misunderstanding out_seq_length

allreduce overlap with wgrad gemm

change custom delay to dummy add