• Zaida Zhou's avatar
    [Feature] Upload checkpoints and logs to ceph (#1375) · 32e09f49
    Zaida Zhou authored
    * [Feature] Choose storage backend by the prefix of filepath
    
    * refactor FileClient and add unittest
    
    * support loading from different backends
    
    * polish docstring
    
    * fix unittet
    
    * rename attribute str_like_obj to is_str_like_obj
    
    * [Docs] Upload checkpoint to petrel oss
    
    * add infer_client method
    
    * Support uploading checkpoint to petrel oss
    
    * add check_exist method
    
    * refactor CheckpointHook
    
    * support uploading logs to ceph
    
    * rename var client to file_client
    
    * polish docstring
    
    * enhance load_from_ceph
    
    * refactor load_from_ceph
    
    * refactor TextLoggerHook
    
    * change the meaning of out_dir argument
    
    * fix test_checkpoint_hook.py
    
    * add join_paths method
    
    * remove join_paths and add _format_path
    
    * enhance unittest
    
    * refactor unittest
    
    * add a unittest for EvalHook when file backend is petrel
    
    * singleton pattern
    
    * fix test_clientio.py
    
    * deprecate CephBackend
    
    * add warning in load_from_ceph
    
    * fix type of out_suffix
    
    * enhance docstring
    
    * refactor unittest for petrel
    
    * refactor unittest for disk backend
    
    * update io.md
    
    * add concat_paths method
    
    * fix CI
    
    * mock check_exist
    
    * improve docstring
    
    * improve docstring
    
    * improve docstring
    
    * improve docstring
    
    * add isdir and copyfile for file backend
    
    * delete copyfile and add get_local_path
    
    * remove isdir method of petrel
    
    * fix typo
    
    * rename check_exists to exists
    
    * refactor code and polish docstring
    
    * fix windows ci
    
    * add comment and polish docstring
    
    * polish docstring
    
    * polish docstring
    
    * rename _path_mapping to _map_path
    
    * polish docstring and fix typo
    
    * refactor get_local_path
    
    * add list_dir_or_file for FileClient
    
    * add list_dir_or_file for PetrelBackend
    
    * fix windows ci
    
    * Add return docstring
    
    * polish docstring
    
    * fix typo
    
    * fix typo
    
    * fix typo
    
    * fix error when mocking PetrelBackend
    
    * deprecate the conversion from Path to str
    
    * add docs for loading checkpoints with FileClient
    
    * rename keep_log to keep_local
    
    * refactor map_path
    
    * add _ensure_methods to ensure methods have been implemented
    
    * fix list_dir_or_file
    
    * rename _ensure_method_implemented to has_method
    
    * refactor
    
    * polish information
    
    * format information
    32e09f49
test_eval_hook.py 16.5 KB