Commits · 8f7c0d112e8c627d2a5e88bcaec0c449e56f0c5e · OpenDAS / Megatron-LM

12 Oct, 2021 3 commits
- Merge branch 'main' into inference · 8f7c0d11
  mshoeybi authored Oct 12, 2021
  
  8f7c0d11
- Merge branch 'eddiey-main-patch-57472' into 'main' · 5478d67e
  Jared Casper authored Oct 12, 2021
```
fix potential race in `cuComputeGradInput` in `layer_norm_cuda_kernel.cu`

See merge request ADLR/megatron-lm!340
```
  5478d67e
- Update layer_norm_cuda_kernel.cu · f1295380
  Eddie Yan authored Oct 12, 2021
  
  f1295380
11 Oct, 2021 2 commits
- added new inference to the server · a5bfc296
  mshoeybi authored Oct 10, 2021
  
  a5bfc296
- merged main · ed6d28b1
  mshoeybi authored Oct 10, 2021
  
  ed6d28b1
10 Oct, 2021 1 commit
- tested and working · 8c119d80
  mshoeybi authored Oct 10, 2021
  
  8c119d80
09 Oct, 2021 3 commits
- Merge branch 'eddiey-main-patch-12774' into 'main' · 1ec6b0e9
  Jared Casper authored Oct 08, 2021
```
fix race in `cuApplyLayerNorm`

See merge request ADLR/megatron-lm!336
```
  1ec6b0e9
- Merge branch 'textgen-readme' into 'main' · 3497e4da
  Jared Casper authored Oct 08, 2021
```
Update text generation section of README. Fix line continuation in example scripts.

See merge request ADLR/megatron-lm!338
```
  3497e4da
- Merge branch 'api_change' into 'main' · d46aa964
  Jared Casper authored Oct 08, 2021
```
API improvements.

See merge request ADLR/megatron-lm!337
```
  d46aa964
08 Oct, 2021 4 commits
- Updating text_generation_cli.py · 0694205c
  Jared Casper authored Oct 08, 2021
  
  0694205c
- Merge branch 'main' into api_change · da77a836
  Jared Casper authored Oct 08, 2021
  
  da77a836
- Update text generation section of README. Fix line continuation in example scripts. · a2cde4b3
  Jared Casper authored Oct 08, 2021
  
  a2cde4b3
- pipelining works · a7539b0f
  mshoeybi authored Oct 07, 2021
  
  a7539b0f
07 Oct, 2021 3 commits
- Merge branch 'fix-inference' into 'main' · b31e1296
  Jared Casper authored Oct 07, 2021
```
Fix inference after T5 pipeline merge

See merge request ADLR/megatron-lm!332
```
  b31e1296
- Forgot to have the outputs named text instead of prompts · 397714f5
  rprenger authored Oct 07, 2021
  
  397714f5
- Update layer_norm_cuda_kernel.cu · 4831071c
  Eddie Yan authored Oct 06, 2021
  
  4831071c
06 Oct, 2021 3 commits
- Merge branch 'slym/jit_arg_typing' into 'main' · cdc614cf
  Jared Casper authored Oct 06, 2021
```
jit function argument type specification

See merge request ADLR/megatron-lm!334
```
  cdc614cf
- Merge branch 'layer-norm-kerne-include' into 'main' · 99559280
  Jared Casper authored Oct 06, 2021
```
THC/THCDeviceUtils.cuh -> ATen/cuda/DeviceUtils.cuh in fused layer norm

See merge request ADLR/megatron-lm!333
```
  99559280
- jit function argument type specification · 838af7d9
  Sangkug Lym authored Oct 05, 2021
  
  838af7d9
05 Oct, 2021 1 commit
- use newer DeviceUtils header · 75e521a0
  Masaki Kozuki authored Oct 06, 2021
  
  75e521a0
02 Oct, 2021 1 commit
- Adding top_p, top_k, logprobs, prompts, and api endpoint to API · 4b11fd9d
  rprenger authored Oct 01, 2021
  
  4b11fd9d
01 Oct, 2021 3 commits
- Merge branch 'fix_temp' into 'main' · 386923b5
  Ryan Prenger authored Oct 01, 2021
```
Fixing bug where temperature was never actually broadcast

See merge request ADLR/megatron-lm!330
```
  386923b5
- Fix inference after T5 pipeline merge · f2c35bb0
  Jared Casper authored Oct 01, 2021
```
Adds some backward compatibility code so old inference code still works.
```
  f2c35bb0
- simple pipelining works · 8f160844
  mshoeybi authored Oct 01, 2021
  
  8f160844
30 Sep, 2021 5 commits
- Merge branch 't5_pipeline_parallelism' into 'main' · 5ac5571b
  Jared Casper authored Sep 30, 2021
```
Pipeline parallelism for T5 model

See merge request ADLR/megatron-lm!288
```
  5ac5571b
- Merge branch 'remove-pkg' into 'main' · 9f5eabcf
  Mohammad Shoeybi authored Sep 30, 2021
```
Remove outdated packaging files.

See merge request ADLR/megatron-lm!331
```
  9f5eabcf
- Merge branch 'main' into inference · dee8707e
  mshoeybi authored Sep 29, 2021
  
  dee8707e
- added BOS · 24684cbb
  mshoeybi authored Sep 29, 2021
  
  24684cbb
- further refactoring · ff2f0a05
  mshoeybi authored Sep 29, 2021
  
  ff2f0a05
29 Sep, 2021 5 commits
- Merge branch 'main' into t5_pipeline_parallelism · cb00a196
  Jared Casper authored Sep 29, 2021
  
  cb00a196
- Remove outdated packaging files. · 6c00f448
  Jared Casper authored Sep 29, 2021
  
  6c00f448
- added multi-batch inference · 390ddef8
  mshoeybi authored Sep 29, 2021
  
  390ddef8
- working · b6555b71
  mshoeybi authored Sep 28, 2021
  
  b6555b71
- working · 6c40f892
  mshoeybi authored Sep 28, 2021
  
  6c40f892
27 Sep, 2021 1 commit
- refactoring, tested and working · 25f9c3f0
  mshoeybi authored Sep 26, 2021
  
  25f9c3f0
24 Sep, 2021 1 commit
- tested and woking · e722c4a9
  mshoeybi authored Sep 23, 2021
  
  e722c4a9
23 Sep, 2021 4 commits
- Had bugs in the fix that I didn't notice until using the big server · 02c00ce6
  rprenger authored Sep 23, 2021
  
  02c00ce6
- Fixing bug where temperature was never actually broadcast · a33e1b35
  rprenger authored Sep 22, 2021
  
  a33e1b35
- working · 107c29e8
  mshoeybi authored Sep 22, 2021
  
  107c29e8
- Merge branch 'add_BOS' into 'main' · 5ab64637
  Mohammad Shoeybi authored Sep 22, 2021
```
Add Beginning of Sentence token option and adding semaphore while multi-threading to prevent crashes and hangs due to connection keep-alives

See merge request ADLR/megatron-lm!328
```
  5ab64637