• Baber Abbasi's avatar
    Vllm update DP+TP (#1508) · e5e35fca
    Baber Abbasi authored
    * use `@ray.remote` with distributed vLLM
    
    * update versions
    
    * bugfix
    
    * unpin vllm
    
    * fix pre-commit
    
    * added version assertion error
    
    * Revert "added version assertion error"
    
    This reverts commit 8041e9b78e95eea9f4f4d0dc260115ba8698e9cc.
    
    * added version assertion for DP
    
    * expand DP note
    
    * add warning
    
    * nit
    
    * pin vllm
    
    * fix typos
    e5e35fca
janitor_util.cpp 6.59 KB