• Sourab Mangrulkar's avatar
    Migrate HFDeepSpeedConfig from trfrs to accelerate (#17623) · 21a77242
    Sourab Mangrulkar authored
    
    
    * Migrate HFDeepSpeedConfig from trfrs to accelerate
    
    * add `accelerate` to testing dep
    
    * addressing comments
    
    * addressing comments
    
    Using `_shared_state` and avoiding object creation. This is necessary as `notebook_launcher` in `launcers.py` checks `len(AcceleratorState._shared_state)>0` to throw an error.
    
    * resolving comments
    
    1. Use simple API from accelerate to manage the deepspeed config integration
    2. Update the related documentation
    
    * reverting changes and addressing comments
    
    * docstring correction
    
    * addressing nits
    
    * addressing nits
    
    * addressing nits 3
    
    * bumping up the accelerate version to 0.10.0
    
    * resolving import
    
    * update setup.py to include deepspeed dependencies
    
    * Update dependency_versions_table.py
    
    * fixing imports
    
    * reverting changes to CI dependencies for "run_tests_pipelines_tf*" tests
    
    These changes didn't help with resolving the failures and I believe this needs to be addressed in another PR.
    
    * removing `accelerate` as hard dependency
    
    Resolves issues related to CI Tests
    
    * adding `accelerate` as dependency for building docs
    
    resolves failure in Build PR Documentation test
    
    * adding `accelerate` as dependency in "dev" to resolve doc build issue
    
    * resolving comments
    
    1. adding `accelerate` to extras["all"]
    2. Including check for accelerate too before import HFDeepSpeedConfig from there
    Co-Authored-By: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    
    * resolving comments
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    21a77242
setup.py 14.3 KB