Commits · ac74f3452e5205fae10362c4745eeb2847dddec7 · OpenDAS / apex

09 Mar, 2019 1 commit
- Fix momentum in non-nesterov case · ac74f345
  Simon Layton authored Mar 08, 2019
  
  ac74f345
08 Mar, 2019 5 commits
- Simplify noop exit condition · 6d6f0bc2
  Simon Layton authored Mar 08, 2019
  
  6d6f0bc2
- Handle fp16 weights case without forcing fp16 math · a2799893
  Simon Layton authored Mar 08, 2019
```
Incorrect types used in a few places
```
  a2799893
- Simplify C++-side logic · 75c8a97a
  Simon Layton authored Mar 08, 2019
```
Only support the 4 specific cases we care about
Remove more general set of switch statements
```
  75c8a97a
- Code cleanup, add fused fp16 read / write · cac061a1
  Simon Layton authored Mar 08, 2019
```
Fuse in fp16 gradient -> fp32 convert
Additional option fp16 weight copy written out
```
  cac061a1
- Fused multi-tensor SGD · cadad920
  Simon Layton authored Mar 08, 2019
```
Initial implementation, all fp32
Tested against torch.optim.sgd
```
  cadad920