Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
libai.layers.rst 458 Bytes
Newer Older
yuguo960516's avatar
bloom  
yuguo960516 committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21 
libai.layers
##############################

.. currentmodule:: libai.layers
.. automodule:: libai.layers
    :members: 
        Embedding,
        VocabEmbedding,
        SinePositionalEmbedding,
        PatchEmbedding,
        drop_path,
        DropPath,
        build_activation,
        Linear,
        Linear1D,
        MLP,
        LayerNorm,
        RMSLayerNorm,
        MultiheadAttention,
        TransformerLayer,
        ParallelCrossEntropyLoss