1. 17 Jul, 2020 2 commits
  2. 30 Jun, 2020 1 commit
    • Chi Song's avatar
      Reuse OpenPAI jobs to run multiple trials (#2521) · 0b9d6ce6
      Chi Song authored
      Designed new interface to support reusable training service, currently only applies to OpenPAI, and default disabled.
      
      Replace trial_keeper.py to trial_runner.py, trial_runner holds an environment, and receives commands from nni manager to run or stop an trial, and return events to nni manager.
      Add trial dispatcher, which inherits from original trianing service interface. It uses to share as many as possible code of all training service, and isolate with training services.
      Add EnvironmentService interface to manage environment, including start/stop an environment, refresh status of environments.
      Add command channel on both nni manager and trial runner parts, it supports different ways to pass messages between them. Current supported channels are file, web sockets. and supported commands from nni manager are start, kill trial, send new parameters; from runner are initialized(support some channel doesn't know which runner connected), trial end, stdout ((new type), including metric like before), version check (new type), gpu info (new type).
      Add storage service to wrapper a storage to standard file operations, like NFS, azure storage and so on.
      Partial support run multiple trials in parallel on runner side, but not supported by trial dispatcher side.
      Other minor changes,
      
      Add log_level to TS UT, so that UT can show debug level log.
      Expose platform to start info.
      Add RouterTrainingService to keep origianl OpenPAI training service, and support dynamic IOC binding.
      Add more GPU info for future usage, including GPU mem total/free/used, gpu type.
      Make some license information consistence.
      Fix async/await problems on Array.forEach, this method doesn't support async actually.
      Fix IT errors on download data, which causes by my #2484 .
      Accelerate some run loop pattern by reducing sleep seconds.
      0b9d6ce6
  3. 19 Jun, 2020 1 commit
  4. 06 May, 2020 1 commit
  5. 01 Apr, 2020 1 commit
  6. 20 Mar, 2020 1 commit
  7. 17 Feb, 2020 1 commit
  8. 09 Feb, 2020 1 commit
  9. 07 Feb, 2020 1 commit
  10. 15 Jan, 2020 1 commit
  11. 02 Jan, 2020 1 commit
  12. 18 Dec, 2019 1 commit
  13. 11 Dec, 2019 1 commit
  14. 05 Dec, 2019 1 commit
  15. 20 Aug, 2019 1 commit
  16. 19 Jul, 2019 1 commit
  17. 10 Jul, 2019 1 commit
  18. 25 Jun, 2019 3 commits
  19. 24 Jun, 2019 2 commits
  20. 20 Jun, 2019 1 commit
  21. 03 Jan, 2019 1 commit
    • chicm-ms's avatar
      Code coverage report (#559) · 50697a2f
      chicm-ms authored
      * Add UT code coverage report
      
      * updates
      
      * updates
      
      * updates
      
      * updates
      
      * updates
      
      * updates
      
      * integration test python code coverage report
      50697a2f
  22. 29 Sep, 2018 2 commits
    • fishyds's avatar
      Merge branch V0.2 to Master (#143) · 2a28a578
      fishyds authored
      * webui logpath and document (#135)
      
      * Add webui document and logpath as a href
      
      * fix tslint
      
      * fix comments by Chengmin
      
      * Pai training service bug fix and enhancement (#136)
      
      * Add NNI installation scripts
      
      * Update pai script, update NNI_out_dir
      
      * Update NNI dir in nni sdk local.py
      
      * Create .nni folder in nni sdk local.py
      
      * Add check before creating .nni folder
      
      * Fix typo for PAI_INSTALL_NNI_SHELL_FORMAT
      
      * Improve annotation (#138)
      
      * Improve annotation
      
      * Minor bugfix
      
      * Selectively install through pip (#139)
      
      Selectively install through pip 
      * update setup.py
      
      * fix paiTrainingService bugs (#137)
      
      * fix nnictl bug
      
      * add hdfs host validation
      
      * fix bugs
      
      * fix dockerfile
      
      * fix install.sh
      
      * update install.sh
      
      * fix dockerfile
      
      * Set timeout for HDFSUtility exists function
      
      * remove unused TODO
      
      * fix sdk
      
      * add optional for outputDir and dataDir
      
      * refactor dockerfile.base
      
      * Remove unused import in hdfsclientUtility
      
      * Add documentation for NNI PAI mode experiment (#141)
      
      * Add documentation for NNI PAI mode
      
      * Fix typo based on PR comments
      
      * Exit with subprocess return code of trial keeper
      
      * Remove additional exit code
      
      * Fix typo based on PR comments
      
      * update doc for smac tuner (#140)
      
      * Revert "Selectively install through pip (#139)" due to potential pip install issue (#142)
      
      * Revert "Selectively install through pip (#139)"
      
      This reverts commit 1d174836.
      
      * Add exit code of subprocess for trial_keeper
      
      * Update README, add link to PAImode doc
      2a28a578
    • liuzhe-lz's avatar
      Improve annotation (#138) · 0619de20
      liuzhe-lz authored
      * Improve annotation
      
      * Minor bugfix
      0619de20
  23. 27 Sep, 2018 1 commit
    • fishyds's avatar
      PAI Training Service implementation (#128) · d3506e34
      fishyds authored
      * PAI Training service implementation
      **1. Implement PAITrainingService
      **2. Add trial-keeper python module, and modify setup.py to install the module
      **3. Add PAItrainingService rest server to collect metrics from PAI container.
      d3506e34
  24. 14 Sep, 2018 3 commits
    • chicm-ms's avatar
      Fix stderr path (#74) · 9f7cce63
      chicm-ms authored
      9f7cce63
    • fishyds's avatar
      Merge latest code changes into Github Master (#54) · 3d221da9
      fishyds authored
      * Merge latest code changes into Github Master
      
      * temporary modification for travis
      
      * temporary modification for travis
      3d221da9
    • liuzhe-lz's avatar
      Improve Makefile (#43) · c015421c
      liuzhe-lz authored
      * Improve Makefile
      
      * Bugfix
      
      * Add make target for remote machine workers
      
      * Update travis config
      
      * Debug travis
      
      * Debug travis
      
      * Debug travis
      
      * Debug travis
      
      * Debug travis
      
      * Debug travis
      
      * Debug travis
      
      * Install bash completion script
      c015421c
  25. 20 Aug, 2018 1 commit