2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_setup.py:_flush():76] Current SDK version is 0.17.0
2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_setup.py:_flush():76] Configure stats pid to 743
2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_setup.py:_flush():76] Loading settings from /root/.config/wandb/settings
2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_setup.py:_flush():76] Loading settings from /home/RepViT/wandb/settings
2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_setup.py:_flush():76] Loading settings from environment variables: {'mode': 'dryrun'}
2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False}
2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program_relpath': 'main.py', 'program_abspath': '/home/RepViT/main.py', 'program': '/home/RepViT/main.py'}
2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_init.py:_log_setup():520] Logging user logs to /home/RepViT/wandb/offline-run-20240521_181021-bidkup5v/logs/debug.log
2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_init.py:_log_setup():521] Logging internal logs to /home/RepViT/wandb/offline-run-20240521_181021-bidkup5v/logs/debug-internal.log
2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_init.py:init():560] calling init triggers
2024-05-21 18:10:21,262 INFO    MainThread:743 [wandb_init.py:init():567] wandb.init called with sweep_config: {}
config: {'batch_size': 256, 'epochs': 300, 'model': 'repvit_m0_9', 'input_size': 224, 'model_ema': True, 'model_ema_decay': 0.99996, 'model_ema_force_cpu': False, 'opt': 'adamw', 'opt_eps': 1e-08, 'opt_betas': None, 'clip_grad': 0.02, 'clip_mode': 'agc', 'momentum': 0.9, 'weight_decay': 0.025, 'sched': 'cosine', 'lr': 0.001, 'lr_noise': None, 'lr_noise_pct': 0.67, 'lr_noise_std': 1.0, 'warmup_lr': 1e-06, 'min_lr': 1e-05, 'decay_epochs': 30, 'warmup_epochs': 5, 'cooldown_epochs': 10, 'patience_epochs': 10, 'decay_rate': 0.1, 'ThreeAugment': False, 'color_jitter': 0.4, 'aa': 'rand-m9-mstd0.5-inc1', 'smoothing': 0.1, 'train_interpolation': 'bicubic', 'repeated_aug': True, 'reprob': 0.25, 'remode': 'pixel', 'recount': 1, 'resplit': False, 'mixup': 0.8, 'cutmix': 1.0, 'cutmix_minmax': None, 'mixup_prob': 1.0, 'mixup_switch_prob': 0.5, 'mixup_mode': 'batch', 'teacher_model': 'regnety_160', 'teacher_path': 'https://dl.fbaipublicfiles.com/deit/regnety_160-a5fe301d.pth', 'distillation_type': 'hard', 'distillation_alpha': 0.5, 'distillation_tau': 1.0, 'finetune': '', 'set_bn_eval': False, 'data_path': './imagenet', 'data_set': 'IMNET', 'inat_category': 'name', 'output_dir': 'checkpoints/repvit_m0_9/2024_05_21_18_10_18', 'device': 'cuda', 'seed': 0, 'resume': '', 'start_epoch': 0, 'eval': False, 'dist_eval': True, 'num_workers': 10, 'pin_mem': True, 'world_size': 4, 'dist_url': 'env://', 'save_freq': 1, 'deploy': False, 'project': 'repvit', 'rank': 0, 'gpu': 0, 'distributed': True, 'dist_backend': 'nccl'}
2024-05-21 18:10:21,263 INFO    MainThread:743 [wandb_init.py:init():610] starting backend
2024-05-21 18:10:21,263 INFO    MainThread:743 [wandb_init.py:init():614] setting up manager
2024-05-21 18:10:21,265 INFO    MainThread:743 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2024-05-21 18:10:21,267 INFO    MainThread:743 [wandb_init.py:init():622] backend started and connected
2024-05-21 18:10:21,272 INFO    MainThread:743 [wandb_init.py:init():711] updated telemetry
2024-05-21 18:10:21,329 INFO    MainThread:743 [wandb_init.py:init():744] communicating run to backend with 90.0 second timeout
2024-05-21 18:10:21,339 INFO    MainThread:743 [wandb_init.py:init():795] starting run threads in backend
2024-05-21 18:10:24,935 INFO    MainThread:743 [wandb_run.py:_console_start():2374] atexit reg
2024-05-21 18:10:24,936 INFO    MainThread:743 [wandb_run.py:_redirect():2229] redirect: wrap_raw
2024-05-21 18:10:24,936 INFO    MainThread:743 [wandb_run.py:_redirect():2294] Wrapping output streams.
2024-05-21 18:10:24,936 INFO    MainThread:743 [wandb_run.py:_redirect():2319] Redirects installed.
2024-05-21 18:10:24,938 INFO    MainThread:743 [wandb_init.py:init():838] run started, returning control to user process