1. 24 Oct, 2021 1 commit
    • Zaida Zhou's avatar
      [Feature] Upload checkpoints and logs to ceph (#1375) · 32e09f49
      Zaida Zhou authored
      * [Feature] Choose storage backend by the prefix of filepath
      
      * refactor FileClient and add unittest
      
      * support loading from different backends
      
      * polish docstring
      
      * fix unittet
      
      * rename attribute str_like_obj to is_str_like_obj
      
      * [Docs] Upload checkpoint to petrel oss
      
      * add infer_client method
      
      * Support uploading checkpoint to petrel oss
      
      * add check_exist method
      
      * refactor CheckpointHook
      
      * support uploading logs to ceph
      
      * rename var client to file_client
      
      * polish docstring
      
      * enhance load_from_ceph
      
      * refactor load_from_ceph
      
      * refactor TextLoggerHook
      
      * change the meaning of out_dir argument
      
      * fix test_checkpoint_hook.py
      
      * add join_paths method
      
      * remove join_paths and add _format_path
      
      * enhance unittest
      
      * refactor unittest
      
      * add a unittest for EvalHook when file backend is petrel
      
      * singleton pattern
      
      * fix test_clientio.py
      
      * deprecate CephBackend
      
      * add warning in load_from_ceph
      
      * fix type of out_suffix
      
      * enhance docstring
      
      * refactor unittest for petrel
      
      * refactor unittest for disk backend
      
      * update io.md
      
      * add concat_paths method
      
      * fix CI
      
      * mock check_exist
      
      * improve docstring
      
      * improve docstring
      
      * improve docstring
      
      * improve docstring
      
      * add isdir and copyfile for file backend
      
      * delete copyfile and add get_local_path
      
      * remove isdir method of petrel
      
      * fix typo
      
      * rename check_exists to exists
      
      * refactor code and polish docstring
      
      * fix windows ci
      
      * add comment and polish docstring
      
      * polish docstring
      
      * polish docstring
      
      * rename _path_mapping to _map_path
      
      * polish docstring and fix typo
      
      * refactor get_local_path
      
      * add list_dir_or_file for FileClient
      
      * add list_dir_or_file for PetrelBackend
      
      * fix windows ci
      
      * Add return docstring
      
      * polish docstring
      
      * fix typo
      
      * fix typo
      
      * fix typo
      
      * fix error when mocking PetrelBackend
      
      * deprecate the conversion from Path to str
      
      * add docs for loading checkpoints with FileClient
      
      * rename keep_log to keep_local
      
      * refactor map_path
      
      * add _ensure_methods to ensure methods have been implemented
      
      * fix list_dir_or_file
      
      * rename _ensure_method_implemented to has_method
      
      * refactor
      
      * polish information
      
      * format information
      32e09f49
  2. 04 Oct, 2021 1 commit
  3. 11 Aug, 2021 1 commit
  4. 24 Jun, 2021 1 commit
  5. 13 May, 2021 1 commit
  6. 08 Apr, 2021 1 commit