transformer_engine/paddle/csrc/custom_ops.cu · 379c1ee38e57f451fbaeb0ba9b9034f35fb39bb6 · OpenDAS / TransformerEngine

"vllm/vscode:/vscode.git/clone" did not exist on "953f28cf9a8440f3b61bb99013c12638368581ec"

Shijie authored Jan 27, 2024



* use separate qkv
Signed-off-by: jaywan <jaywan@nvidia.com>

* add support for GQA
Signed-off-by: jaywan <jaywan@nvidia.com>

* minor changes
Signed-off-by: Shijie Wang <jaywan@nvidia.com>

* change rtol
Signed-off-by: Shijie Wang <jaywan@nvidia.com>

* fix reshape issue
Signed-off-by: Shijie Wang <jaywan@nvidia.com>

---------
Signed-off-by: jaywan <jaywan@nvidia.com>
Signed-off-by: Shijie Wang <jaywan@nvidia.com>

bd7fd0a6

custom_ops.cu 78.3 KB

Replace custom_ops.cu