tests/test_moe/test_top2.py · 1559c0df410ebea6b0c64cee2362c8da7e93e8f4 · OpenDAS / ColossalAI · GitLab

Find file Blame History Permalink

Optimized MoE layer and fixed some bugs; · 219df6e6
1SAA authored Feb 18, 2022
```
Decreased moe tests;

Added FFNExperts and ViTMoE model
```
219df6e6

test_top2.py 3.27 KB