• アマデウス's avatar
    moved env variables to global variables; (#215) · 9ee197d0
    アマデウス authored
    added branch context;
    added vocab parallel layers;
    moved split_batch from load_batch to tensor parallel embedding layers;
    updated gpt model;
    updated unit test cases;
    fixed few collective communicator bugs
    9ee197d0
test_3d.py 1.9 KB