Commits · 27d8beaa0ea7e20a8ee3a692004072017929dcf9 · OpenDAS / FastMoE

"docs/basic_usage/deepseek.md" did not exist on "b55a621ffbcf1bf677947803e69b44dc49919202"

09 Jan, 2021 8 commits
- make backward pass test · 27d8beaa
  Rick Ho authored Jan 09, 2021
  
  27d8beaa
- moe backward (cannot pass test) · 92f1774a
  Rick Ho authored Jan 09, 2021
  
  92f1774a
- modify performance test · c91dfad8
  Rick Ho authored Jan 09, 2021
  
  c91dfad8
- split operators and make forward run · 49732231
  Rick Ho authored Jan 09, 2021
  
  49732231
- update stream manager · 143e21cc
  Rick Ho authored Jan 09, 2021
  
  143e21cc
- stream manager fixed · 2565f2fa
  Rick Ho authored Jan 09, 2021
  
  2565f2fa
- fix bugs to pass test · b8a212ef
  Rick Ho authored Jan 09, 2021
  
  b8a212ef
- degrade to single fc fwd · 284f1424
  Rick Ho authored Jan 09, 2021
  
  284f1424
04 Jan, 2021 1 commit
- stream manager object instead of pointer · ef83c893
  Jiezhong Qiu authored Jan 04, 2021
  
  ef83c893
03 Jan, 2021 8 commits
- fix memory leak · e52c0380
  Jiezhong Qiu authored Jan 03, 2021
  
  e52c0380
- 2 out of 32 experts · 6429fa29
  Jiezhong Qiu authored Jan 03, 2021
  
  6429fa29
- cudafree malloced memory · 1bde1726
  Jiezhong Qiu authored Jan 03, 2021
  
  1bde1726
- can train now · 97a2b1be
  Jiezhong Qiu authored Jan 03, 2021
  
  97a2b1be
- update · 3be6ac10
  Jiezhong Qiu authored Jan 03, 2021
  
  3be6ac10
- update · 6212aa28
  Jiezhong Qiu authored Jan 03, 2021
  
  6212aa28
- make cudaStreamManager thread local · 27af1828
  Jiezhong Qiu authored Jan 03, 2021
  
  27af1828
- test data parallel (FAILED!) · f5cc759c
  Jiezhong Qiu authored Jan 03, 2021
  
  f5cc759c
02 Jan, 2021 6 commits
- fix bug · 7945bce6
  Jiezhong Qiu authored Jan 03, 2021
  
  7945bce6
- CUDA error at moe_cuda_kernel.cu:86 code=13(CUBLAS_STATUS_EXECUTION_FAILED) · 85306aa7
  Jiezhong Qiu authored Jan 03, 2021
  
  85306aa7
- update · 20cc924b
  Jiezhong Qiu authored Jan 03, 2021
  
  20cc924b
- set device according to input · 046455a8
  Jiezhong Qiu authored Jan 03, 2021
  
  046455a8
- incoporate customized cuda moe input xfmr-xl · 2338a26e
  Jiezhong Qiu authored Jan 03, 2021
  
  2338a26e
- add moe debug flag · d036918c
  Jiezhong Qiu authored Jan 02, 2021
  
  d036918c
30 Dec, 2020 15 commits
- manual batched scatter and gather kernels · d690c7b2
  Rick Ho authored Dec 30, 2020
  
  d690c7b2
- test support for fused fw and bw · 254ad118
  Rick Ho authored Dec 30, 2020
  
  254ad118
- two-level matmul fix transpose · 35addec6
  Rick Ho authored Dec 30, 2020
  
  35addec6
- better timing · 191c1e46
  Rick Ho authored Dec 30, 2020
  
  191c1e46
- update test script · 365b6f01
  Rick Ho authored Dec 30, 2020
  
  365b6f01
- limit max streams support · 7af4a1c1
  Rick Ho authored Dec 30, 2020
  
  7af4a1c1
- limit max streams · bf60a846
  Rick Ho authored Dec 30, 2020
  
  bf60a846
- naive memcpy batch with buffer · 9cae3294
  Rick Ho authored Dec 30, 2020
  
  9cae3294
- fix timing bug · 0d9c540f
  Rick Ho authored Dec 30, 2020
  
  0d9c540f
- tide up C code · 8cff6ad7
  Rick Ho authored Dec 30, 2020
  
  8cff6ad7
- update · 2ba58797
  Jiezhong Qiu authored Dec 30, 2020
  
  2ba58797
- sync every stream · 560d3f1b
  Jiezhong Qiu authored Dec 30, 2020
  
  560d3f1b
- update · 5d076dcf
  Jiezhong Qiu authored Dec 30, 2020
  
  5d076dcf
- performance test in python · cb6aadaa
  Rick Ho authored Dec 30, 2020
  
  cb6aadaa
- fix python global variable · 57191b14
  Rick Ho authored Dec 30, 2020
  
  57191b14
29 Dec, 2020 2 commits
- update · 0ab605cc
  Jiezhong Qiu authored Dec 29, 2020
  
  0ab605cc
- optional cuda helper path by environ var · fff1994e
  Rick Ho authored Dec 29, 2020
  
  fff1994e