• Philip Meier's avatar
    Download model weights in parallel for prototype CI (#4772) · 29f38f17
    Philip Meier authored
    * enable caching of model weights for prototype CI
    
    * syntax
    
    * syntax
    
    * make cache dir dynamic
    
    * increase verbosity
    
    * fix
    
    * use larget CI machine
    
    * revert debug output
    
    * [DEBUG] test env var usage in save_cache
    
    * retry
    
    * use checksum for caching
    
    * remove env vars because expansion is not working
    
    * syntax
    
    * cleanup
    
    * base caching on model-urls
    
    * relax regex
    
    * cleanup skips
    
    * cleanup
    
    * fix skipping logic
    
    * improve step name
    
    * benchmark without caching
    
    * benchmark with external download
    
    * debug
    
    * fix manual download location
    
    * debug again
    
    * download weights in the background
    
    * try parallel download
    
    * add missing import
    
    * use correct decoractor
    
    * up resource_class
    
    * fix wording
    
    * enable stdout passthrough to see download during test
    
    * remove linebreak
    
    * move checkout up
    
    * cleanup
    
    * debug failing test
    
    * temp fix
    
    * fix
    
    * cleanup
    
    * fix regex
    
    * remove explicit install of numpy
    29f38f17
common_utils.py 6.57 KB