GitLab

fix potential race in `cuComputeGradInput` in `layer_norm_cuda_kernel.cu`

See merge request ADLR/megatron-lm!340

fix race in `cuApplyLayerNorm`

See merge request ADLR/megatron-lm!336

Update text generation section of README. Fix line continuation in example scripts.

See merge request ADLR/megatron-lm!338

API improvements.

See merge request ADLR/megatron-lm!337

Fix inference after T5 pipeline merge

See merge request ADLR/megatron-lm!332

jit function argument type specification

See merge request ADLR/megatron-lm!334

THC/THCDeviceUtils.cuh -> ATen/cuda/DeviceUtils.cuh in fused layer norm

See merge request ADLR/megatron-lm!333

Fixing bug where temperature was never actually broadcast

See merge request ADLR/megatron-lm!330

Adds some backward compatibility code so old inference code still works.

Pipeline parallelism for T5 model

See merge request ADLR/megatron-lm!288

Remove outdated packaging files.

See merge request ADLR/megatron-lm!331

Add Beginning of Sentence token option and adding semaphore while multi-threading to prevent crashes and hangs due to connection keep-alives

See merge request ADLR/megatron-lm!328

Fixing memory bug caused by DDP during task

See merge request ADLR/megatron-lm!329

Inference context optimization

See merge request ADLR/megatron-lm!321

Add temperature to the server API

See merge request ADLR/megatron-lm!325

A temperature value between 0.0 and 100.0 can now be specified via the API
while running the text generation server. The value passed to
--temperature while running the text generation server is kept as the
default value for all API calls that don't include temperature, even if
different values were manually specified previously.
Signed-Off-By: Robert Clark <roclark@nvidia.com>

Fixes a bug in broadcasting that was causing hanging

See merge request ADLR/megatron-lm!327

Changing API to fix LM Harness Evaluation and make API less confusing/terrible

See merge request ADLR/megatron-lm!326