Commits · 9e0ee6fd24b23ebf07cbea10a7582aa8aaa10de9 · OpenDAS / Megatron-LM

22 Oct, 2021 1 commit
- Hacked in way to to have stop tokens · 9e0ee6fd
  rprenger authored Oct 22, 2021
  
  9e0ee6fd
20 Oct, 2021 1 commit
- getting rid of unnecessary just_score · 5ab28fd1
  rprenger authored Oct 20, 2021
  
  5ab28fd1
19 Oct, 2021 1 commit
- Code that keeps it from dying when the input prompts are too long · 554bb262
  rprenger authored Oct 19, 2021
  
  554bb262
18 Oct, 2021 1 commit
- Fixing logic in server accepting tokens_to_generate=0 · a3770921
  rprenger authored Oct 18, 2021
  
  a3770921
16 Oct, 2021 2 commits
- Fixing a bug in merge · 87d08f4b
  rprenger authored Oct 15, 2021
  
  87d08f4b
- Getting tokens_to_generate=0 to work · 9cc286ba
  rprenger authored Oct 15, 2021
  
  9cc286ba
15 Oct, 2021 3 commits
- Allowing for a 0 tokens/just scoring mode · 21d2b0fe
  rprenger authored Oct 15, 2021
  
  21d2b0fe
- removed greedy argument · 71359e1f
  mshoeybi authored Oct 15, 2021
  
  71359e1f
- removed return all probs · c6e7c7fd
  mshoeybi authored Oct 15, 2021
  
  c6e7c7fd
14 Oct, 2021 1 commit
- Changing defaults and query sanitation to keep it from crashing on reasonable queries · 8d405805
  rprenger authored Oct 14, 2021
  
  8d405805
13 Oct, 2021 3 commits
- tested and working · 0dd5cc75
  mshoeybi authored Oct 13, 2021
  
  0dd5cc75
- changed inference to text generation · ee536123
  mshoeybi authored Oct 13, 2021
  
  ee536123
- addressed Jareds comments · 8126d777
  mshoeybi authored Oct 13, 2021
  
  8126d777
12 Oct, 2021 2 commits
- fixed a bug · b10ca211
  mshoeybi authored Oct 12, 2021
  
  b10ca211
- Update layer_norm_cuda_kernel.cu · f1295380
  Eddie Yan authored Oct 12, 2021
  
  f1295380
11 Oct, 2021 1 commit
- added new inference to the server · a5bfc296
  mshoeybi authored Oct 10, 2021
  
  a5bfc296
10 Oct, 2021 1 commit
- tested and working · 8c119d80
  mshoeybi authored Oct 10, 2021
  
  8c119d80
08 Oct, 2021 1 commit
- pipelining works · a7539b0f
  mshoeybi authored Oct 07, 2021
  
  a7539b0f
07 Oct, 2021 2 commits
- Forgot to have the outputs named text instead of prompts · 397714f5
  rprenger authored Oct 07, 2021
  
  397714f5
- Update layer_norm_cuda_kernel.cu · 4831071c
  Eddie Yan authored Oct 06, 2021
  
  4831071c
06 Oct, 2021 1 commit
- jit function argument type specification · 838af7d9
  Sangkug Lym authored Oct 05, 2021
  
  838af7d9
05 Oct, 2021 1 commit
- use newer DeviceUtils header · 75e521a0
  Masaki Kozuki authored Oct 06, 2021
  
  75e521a0
02 Oct, 2021 1 commit
- Adding top_p, top_k, logprobs, prompts, and api endpoint to API · 4b11fd9d
  rprenger authored Oct 01, 2021
  
  4b11fd9d
01 Oct, 2021 2 commits
- Fix inference after T5 pipeline merge · f2c35bb0
  Jared Casper authored Oct 01, 2021
```
Adds some backward compatibility code so old inference code still works.
```
  f2c35bb0
- simple pipelining works · 8f160844
  mshoeybi authored Oct 01, 2021
  
  8f160844
30 Sep, 2021 2 commits
- added BOS · 24684cbb
  mshoeybi authored Sep 29, 2021
  
  24684cbb
- further refactoring · ff2f0a05
  mshoeybi authored Sep 29, 2021
  
  ff2f0a05
29 Sep, 2021 4 commits
- Remove outdated packaging files. · 6c00f448
  Jared Casper authored Sep 29, 2021
  
  6c00f448
- added multi-batch inference · 390ddef8
  mshoeybi authored Sep 29, 2021
  
  390ddef8
- working · b6555b71
  mshoeybi authored Sep 28, 2021
  
  b6555b71
- working · 6c40f892
  mshoeybi authored Sep 28, 2021
  
  6c40f892
27 Sep, 2021 1 commit
- refactoring, tested and working · 25f9c3f0
  mshoeybi authored Sep 26, 2021
  
  25f9c3f0
24 Sep, 2021 1 commit
- tested and woking · e722c4a9
  mshoeybi authored Sep 23, 2021
  
  e722c4a9
23 Sep, 2021 5 commits
- Had bugs in the fix that I didn't notice until using the big server · 02c00ce6
  rprenger authored Sep 23, 2021
  
  02c00ce6
- Fixing bug where temperature was never actually broadcast · a33e1b35
  rprenger authored Sep 22, 2021
  
  a33e1b35
- working · 107c29e8
  mshoeybi authored Sep 22, 2021
  
  107c29e8
- switching from semaphore to lock · 7b293d9b
  rprenger authored Sep 22, 2021
  
  7b293d9b
- added batching · 2f08c0c3
  mshoeybi authored Sep 22, 2021
  
  2f08c0c3
22 Sep, 2021 2 commits
- sampling · 554d1cc0
  mshoeybi authored Sep 22, 2021
  
  554d1cc0
- sampling · 018c270a
  mshoeybi authored Sep 21, 2021
  
  018c270a