Skip to content

GitLab

"megatron/model/realm_model.py" did not exist on "b7f1b05071b041309f36698d197eaae54b9fcbea"
Switch branch/tag
Find file BlameHistoryPermalink
  • q.yao's avatar
    Tensor Parallel python api (#82) · 7cbfe2ea
    q.yao authored 
    * wip

* profile disable tp

* fix profile

* lint

* fix dlpack

* remove comment

* add tp flag

* add session len check

* add eos

* remove tp and session len inputs

* warp tokenizer

* multithread load weight

* update profile

* refactor tokenizer

* remove pre/post process

* remove mpi4py requirement

* remove

* remove bind

* remove mpi requirement

* check backend_tokenizer
    7cbfe2ea
tokenizer.py 5.18 KB