GitLab

* support hidden size 8192

* refactor code

* fix assert

Co-authored-by: zhiyi Hu <zhiyihu@U-NYQQMGK0-2250.local>

enhance warp copy

* Remove memory fence in NVLink barrier.

* Move `__syncthread` and fence into barrier.

* Fix bugs

---------
Co-authored-by: Chenggang Zhao <chenggangz@deepseek.com>

* Support bias.

* Fix.

* Fix style.

* Add `get_comm_stream`.

* Fix style.

* Add draft

* Add fast-debugging flags

* Fix several bugs

* Add sender timeout checks

* Fix stuck

* Fix bugs

* Fix bugs

* Increase the test round.

* Add warp synchronization.

* Shuffle the send warps.

* Add time elapsed into bench result.

Set `device_id` to suppress pytorch warning.

* Fix the tail loading issue.

* Modify the sync offset.

* Fix warp synchronization.

* Another fix.

* Add automatic warp count control for low-latency dispatch

* Add automatic warp count control for low-latency combine

* More assertions

let the sender SM use the channel_id, and the receiver SM use channel_id + num_channels

* Use `pynvml` to detect NVLink connections

* Add a TODO

* Add shutdown

* Fix comments

* Update README

* Update `setup.py`

* Fix headers

* Add `DISABLE_NVSHMEM` for APIs

* Fix launch

* Fix TMA settings

* Fix TMA usages

* Fix dlink

* Separate layout kernels

* Update version

* Add `is_sm90_compiled`

* Fix tests

* Add NVLink connection checks

* Update README

* Fix tests

* Add some comments

* Minor fix

* Minor fix

* Fix bugs