"awq/vscode:/vscode.git/clone" did not exist on "9c3dfa078f82b164d886c1378784e8d1510a2a97"
  • q.yao's avatar
    Tensor Parallel python api (#82) · 7cbfe2ea
    q.yao authored
    * wip
    
    * profile disable tp
    
    * fix profile
    
    * lint
    
    * fix dlpack
    
    * remove comment
    
    * add tp flag
    
    * add session len check
    
    * add eos
    
    * remove tp and session len inputs
    
    * warp tokenizer
    
    * multithread load weight
    
    * update profile
    
    * refactor tokenizer
    
    * remove pre/post process
    
    * remove mpi4py requirement
    
    * remove
    
    * remove bind
    
    * remove mpi requirement
    
    * check backend_tokenizer
    7cbfe2ea
profile_generation.py 4.89 KB