Commits · 554bb2621e6d90edde555b610c85962eca36f7cb · OpenDAS / Megatron-LM

19 Oct, 2021 1 commit
- Code that keeps it from dying when the input prompts are too long · 554bb262
  rprenger authored Oct 19, 2021
  
  554bb262
18 Oct, 2021 1 commit
- Fixing logic in server accepting tokens_to_generate=0 · a3770921
  rprenger authored Oct 18, 2021
  
  a3770921
16 Oct, 2021 3 commits
- Fixing a bug in merge · 87d08f4b
  rprenger authored Oct 15, 2021
  
  87d08f4b
- cleaning up merge conflicts · 803ae5ee
  rprenger authored Oct 15, 2021
  
  803ae5ee
- Getting tokens_to_generate=0 to work · 9cc286ba
  rprenger authored Oct 15, 2021
  
  9cc286ba
15 Oct, 2021 4 commits
- Merge branch 'inference' into 'main' · 0b0e37f0
  Jared Casper authored Oct 15, 2021
```
Inference refactoring

See merge request ADLR/megatron-lm!339
```
  0b0e37f0
- Allowing for a 0 tokens/just scoring mode · 21d2b0fe
  rprenger authored Oct 15, 2021
  
  21d2b0fe
- removed greedy argument · 71359e1f
  mshoeybi authored Oct 15, 2021
  
  71359e1f
- removed return all probs · c6e7c7fd
  mshoeybi authored Oct 15, 2021
  
  c6e7c7fd
14 Oct, 2021 1 commit
- Changing defaults and query sanitation to keep it from crashing on reasonable queries · 8d405805
  rprenger authored Oct 14, 2021
  
  8d405805
13 Oct, 2021 3 commits
- tested and working · 0dd5cc75
  mshoeybi authored Oct 13, 2021
  
  0dd5cc75
- changed inference to text generation · ee536123
  mshoeybi authored Oct 13, 2021
  
  ee536123
- addressed Jareds comments · 8126d777
  mshoeybi authored Oct 13, 2021
  
  8126d777
12 Oct, 2021 4 commits
- fixed a bug · b10ca211
  mshoeybi authored Oct 12, 2021
  
  b10ca211
- Merge branch 'main' into inference · 8f7c0d11
  mshoeybi authored Oct 12, 2021
  
  8f7c0d11
- Merge branch 'eddiey-main-patch-57472' into 'main' · 5478d67e
  Jared Casper authored Oct 12, 2021
```
fix potential race in `cuComputeGradInput` in `layer_norm_cuda_kernel.cu`

See merge request ADLR/megatron-lm!340
```
  5478d67e
- Update layer_norm_cuda_kernel.cu · f1295380
  Eddie Yan authored Oct 12, 2021
  
  f1295380
11 Oct, 2021 2 commits
- added new inference to the server · a5bfc296
  mshoeybi authored Oct 10, 2021
  
  a5bfc296
- merged main · ed6d28b1
  mshoeybi authored Oct 10, 2021
  
  ed6d28b1
10 Oct, 2021 1 commit
- tested and working · 8c119d80
  mshoeybi authored Oct 10, 2021
  
  8c119d80
09 Oct, 2021 3 commits
- Merge branch 'eddiey-main-patch-12774' into 'main' · 1ec6b0e9
  Jared Casper authored Oct 08, 2021
```
fix race in `cuApplyLayerNorm`

See merge request ADLR/megatron-lm!336
```
  1ec6b0e9
- Merge branch 'textgen-readme' into 'main' · 3497e4da
  Jared Casper authored Oct 08, 2021
```
Update text generation section of README. Fix line continuation in example scripts.

See merge request ADLR/megatron-lm!338
```
  3497e4da
- Merge branch 'api_change' into 'main' · d46aa964
  Jared Casper authored Oct 08, 2021
```
API improvements.

See merge request ADLR/megatron-lm!337
```
  d46aa964
08 Oct, 2021 4 commits
- Updating text_generation_cli.py · 0694205c
  Jared Casper authored Oct 08, 2021
  
  0694205c
- Merge branch 'main' into api_change · da77a836
  Jared Casper authored Oct 08, 2021
  
  da77a836
- Update text generation section of README. Fix line continuation in example scripts. · a2cde4b3
  Jared Casper authored Oct 08, 2021
  
  a2cde4b3
- pipelining works · a7539b0f
  mshoeybi authored Oct 07, 2021
  
  a7539b0f
07 Oct, 2021 3 commits
- Merge branch 'fix-inference' into 'main' · b31e1296
  Jared Casper authored Oct 07, 2021
```
Fix inference after T5 pipeline merge

See merge request ADLR/megatron-lm!332
```
  b31e1296
- Forgot to have the outputs named text instead of prompts · 397714f5
  rprenger authored Oct 07, 2021
  
  397714f5
- Update layer_norm_cuda_kernel.cu · 4831071c
  Eddie Yan authored Oct 06, 2021
  
  4831071c
06 Oct, 2021 3 commits
- Merge branch 'slym/jit_arg_typing' into 'main' · cdc614cf
  Jared Casper authored Oct 06, 2021
```
jit function argument type specification

See merge request ADLR/megatron-lm!334
```
  cdc614cf
- Merge branch 'layer-norm-kerne-include' into 'main' · 99559280
  Jared Casper authored Oct 06, 2021
```
THC/THCDeviceUtils.cuh -> ATen/cuda/DeviceUtils.cuh in fused layer norm

See merge request ADLR/megatron-lm!333
```
  99559280
- jit function argument type specification · 838af7d9
  Sangkug Lym authored Oct 05, 2021
  
  838af7d9
05 Oct, 2021 1 commit
- use newer DeviceUtils header · 75e521a0
  Masaki Kozuki authored Oct 06, 2021
  
  75e521a0
02 Oct, 2021 1 commit
- Adding top_p, top_k, logprobs, prompts, and api endpoint to API · 4b11fd9d
  rprenger authored Oct 01, 2021
  
  4b11fd9d
01 Oct, 2021 3 commits
- Merge branch 'fix_temp' into 'main' · 386923b5
  Ryan Prenger authored Oct 01, 2021
```
Fixing bug where temperature was never actually broadcast

See merge request ADLR/megatron-lm!330
```
  386923b5
- Fix inference after T5 pipeline merge · f2c35bb0
  Jared Casper authored Oct 01, 2021
```
Adds some backward compatibility code so old inference code still works.
```
  f2c35bb0
- simple pipelining works · 8f160844
  mshoeybi authored Oct 01, 2021
  
  8f160844
30 Sep, 2021 2 commits
- Merge branch 't5_pipeline_parallelism' into 'main' · 5ac5571b
  Jared Casper authored Sep 30, 2021
```
Pipeline parallelism for T5 model

See merge request ADLR/megatron-lm!288
```
  5ac5571b
- Merge branch 'remove-pkg' into 'main' · 9f5eabcf
  Mohammad Shoeybi authored Sep 30, 2021
```
Remove outdated packaging files.

See merge request ADLR/megatron-lm!331
```
  9f5eabcf