2024-10-11 08:10:00,624 - ==> Logging on master GPU: 0 2024-10-11 08:10:00,624 - ==> Running Trainer: CLSTrainer 2024-10-11 08:10:00,624 - ==> Using GPU: [0, 1, 2, 3, 4, 5, 6, 7] for Training 2024-10-11 08:10:00,624 - ==> Building model 2024-10-11 08:10:00,785 - ==> Creating optimizer 2024-10-11 08:10:00,789 - ==> Native DDP 2024-10-11 08:10:00,963 - ==> Loading dataset: ImageFolderLMDB 2024-10-11 08:10:01,030 - ==> ********** cfg ********** seed : 42 size : 512 epoch_full : 300 warmup_epochs : 20 test_start_epoch : 200 batch_size : 1024 lr : 0.0015 weight_decay : 0.05 nb_classes : 1000 ft : False data.type : ImageFolderLMDB data.root : /dev/shm/tmp/imagenet data.loader_type : pil data.sampler : naive data.nb_classes : 1000 data.train_transforms : [{'type': 'timm_create_transform', 'input_size': 512, 'is_training': True, 'color_jitter': 0.4, 'auto_augment': 'rand-m9-mstd0.5-inc1', 'interpolation': 'random', 'mean': (0.485, 0.456, 0.406), 'std': (0.229, 0.224, 0.225), 're_prob': 0.25, 're_mode': 'pixel', 're_count': 1}] data.test_transforms : [{'type': 'Resize', 'size': 585, 'interpolation': }, {'type': 'CenterCrop', 'size': 512}, {'type': 'ToTensor'}, {'type': 'Normalize', 'mean': (0.485, 0.456, 0.406), 'std': (0.229, 0.224, 0.225), 'inplace': True}] data.train_size : 1251 data.test_size : 50 data.train_length : 1281167 data.test_length : 50000 model.name : MobileMamba_B4 model.model_kwargs : {'pretrained': False, 'checkpoint_path': '', 'ema': False, 'strict': True, 'num_classes': 1000} optim.lr : 0.003 optim.optim_kwargs : {'name': 'adamw', 'betas': (0.9, 0.999), 'eps': 1e-08, 'weight_decay': 0.05, 'amsgrad': False} trainer.name : CLSTrainer trainer.checkpoint : runs/mobilemamba trainer.resume_dir : trainer.cuda_deterministic : False trainer.epoch_full : 300 trainer.scheduler_kwargs : {'name': 'cosine', 'lr_noise': None, 'noise_pct': 0.67, 'noise_std': 1.0, 'noise_seed': 42, 'lr_min': 3e-05, 'warmup_lr': 3e-06, 'warmup_iters': -1, 'cooldown_iters': 0, 'warmup_epochs': 20, 'cooldown_epochs': 0, 'use_iters': True, 'patience_iters': 0, 'patience_epochs': 0, 'decay_iters': 0, 'decay_epochs': 0, 'cycle_decay': 0.1} trainer.data.batch_size : 1024 trainer.data.batch_size_per_gpu : 128 trainer.data.batch_size_test : 1000 trainer.data.batch_size_per_gpu_test : 125 trainer.data.num_workers_per_gpu : 8 trainer.data.drop_last : True trainer.data.pin_memory : True trainer.data.persistent_workers : False trainer.data.num_workers : 64 trainer.mixup_kwargs : {'mixup_alpha': 0.8, 'cutmix_alpha': 1.0, 'cutmix_minmax': None, 'prob': 1.0, 'switch_prob': 0.5, 'mode': 'batch', 'correct_lam': True, 'label_smoothing': 0.1, 'num_classes': 1000} trainer.scale_kwargs : {'n_scale': 0, 'base_h': 512, 'base_w': 512, 'min_h': 160, 'max_h': 320, 'min_w': 160, 'max_w': 320, 'check_scale_div_factor': 32} trainer.test_start_epoch : 200 trainer.test_per_epoch : 5 trainer.save_per_epoch : 15 trainer.find_unused_parameters : False trainer.sync_BN : none trainer.dist_BN : trainer.scaler : native trainer.ema : 0.9998 trainer.iter : 0 trainer.epoch : 0 trainer.topk_recorder : {'net_top1': [], 'net_top5': [], 'net_E_top1': [], 'net_E_top5': []} trainer.iter_full : 375300 tea_model.name : tresnet_l_v2 tea_model.model_kwargs : {'pretrained': False, 'checkpoint_path': 'pretrained/tresnet_l_v2_83_9.pth', 'ema': False, 'strict': True, 'num_classes': 1000} loss.loss_terms : [{'type': 'SoftTargetCE', 'name': 'CE', 'lam': 1.0, 'fp32': True}] loss.clip_grad : 5.0 loss.create_graph : False loss.retain_graph : False logging.log_terms_train : [{'name': 'batch_t', 'fmt': ':>5.3f', 'add_name': 'avg'}, {'name': 'data_t', 'fmt': ':>5.3f'}, {'name': 'optim_t', 'fmt': ':>5.3f'}, {'name': 'lr', 'fmt': ':>7.6f'}, {'name': 'CE', 'fmt': ':>5.3f', 'add_name': 'avg'}, {'name': 'KD', 'fmt': ':>5.3f', 'add_name': 'avg'}] logging.log_terms_test : [{'name': 'batch_t', 'fmt': ':>5.3f', 'add_name': 'avg'}, {'name': 'top1_cnt', 'fmt': ':>6.0f', 'show_name': 'sum'}, {'name': 'top5_cnt', 'fmt': ':>6.0f', 'show_name': 'sum'}, {'name': 'top_all', 'fmt': ':>6.0f', 'show_name': 'sum'}] logging.train_reset_log_per : 50 logging.train_log_per : 50 logging.test_log_per : 50 cfg_path : configs.mobilemamba.mobilemamba_b4 mode : train sleep : -1 memory : -1 dist_url : env:// logger_rank : 0 opts : ['model.name=MobileMamba_B4'] command : python3 -m torch.distributed.launch --nproc_per_node=$nproc_per_node --nnodes=$nnodes --node_rank=$node_rank --master_addr=$master_addr --master_port=$master_port --use_env run.py -c configs.mobilemamba.mobilemamba_b4 -m train --sleep -1 --memory -1 --dist_url env:// --logger_rank 0 model.name=MobileMamba_B4 task_start_time : 1494000.782544515 dist : True world_size : 8 rank : 0 local_rank : 0 ngpus_per_node : 8 nnodes : 1 master : True dist_backend : nccl logdir : runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000 logger.filters : [] logger.name : root logger.level : 20 logger.parent : None logger.propagate : True logger.disabled : False logdir_train : runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000/show_train logdir_test : runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000/show_test 2024-10-11 08:10:01,030 - ==> Starting training with 1 nodes x 8 GPUs 2024-10-11 08:10:36,370 - Train: 0.01% [50/375300] [0.0/300.0] [batch_t 0.307 (0.703)] [data_t 0.015] [optim_t 0.292] [lr 0.000009] [CE 6.955 (6.988)] [KD 0.000 (0.000)] 2024-10-11 08:10:57,633 - Train: 0.03% [100/375300] [0.1/300.0] [batch_t 0.467 (0.425)] [data_t 0.015] [optim_t 0.451] [lr 0.000015] [CE 6.950 (6.971)] [KD 0.000 (0.000)] 2024-10-11 08:11:19,439 - Train: 0.04% [150/375300] [0.1/300.0] [batch_t 0.471 (0.436)] [data_t 0.015] [optim_t 0.455] [lr 0.000021] [CE 6.950 (6.945)] [KD 0.000 (0.000)] 2024-10-11 08:11:40,824 - Train: 0.05% [200/375300] [0.2/300.0] [batch_t 0.443 (0.428)] [data_t 0.015] [optim_t 0.428] [lr 0.000027] [CE 6.944 (6.922)] [KD 0.000 (0.000)] 2024-10-11 08:12:02,260 - Train: 0.07% [250/375300] [0.2/300.0] [batch_t 0.439 (0.429)] [data_t 0.015] [optim_t 0.424] [lr 0.000033] [CE 6.878 (6.900)] [KD 0.000 (0.000)] 2024-10-11 08:12:23,531 - Train: 0.08% [300/375300] [0.2/300.0] [batch_t 0.310 (0.425)] [data_t 0.015] [optim_t 0.295] [lr 0.000039] [CE 6.877 (6.882)] [KD 0.000 (0.000)] 2024-10-11 08:12:44,732 - Train: 0.09% [350/375300] [0.3/300.0] [batch_t 0.485 (0.424)] [data_t 0.016] [optim_t 0.469] [lr 0.000045] [CE 6.843 (6.860)] [KD 0.000 (0.000)] 2024-10-11 08:13:05,912 - Train: 0.11% [400/375300] [0.3/300.0] [batch_t 0.421 (0.423)] [data_t 0.015] [optim_t 0.406] [lr 0.000051] [CE 6.809 (6.847)] [KD 0.000 (0.000)] 2024-10-11 08:13:26,988 - Train: 0.12% [450/375300] [0.4/300.0] [batch_t 0.448 (0.421)] [data_t 0.015] [optim_t 0.433] [lr 0.000057] [CE 6.821 (6.830)] [KD 0.000 (0.000)] 2024-10-11 08:13:47,851 - Train: 0.13% [500/375300] [0.4/300.0] [batch_t 0.448 (0.417)] [data_t 0.015] [optim_t 0.433] [lr 0.000063] [CE 6.812 (6.817)] [KD 0.000 (0.000)] 2024-10-11 08:14:08,512 - Train: 0.15% [550/375300] [0.4/300.0] [batch_t 0.437 (0.413)] [data_t 0.015] [optim_t 0.422] [lr 0.000069] [CE 6.799 (6.802)] [KD 0.000 (0.000)] 2024-10-11 08:14:29,447 - Train: 0.16% [600/375300] [0.5/300.0] [batch_t 0.444 (0.419)] [data_t 0.016] [optim_t 0.428] [lr 0.000075] [CE 6.777 (6.785)] [KD 0.000 (0.000)] 2024-10-11 08:14:50,896 - Train: 0.17% [650/375300] [0.5/300.0] [batch_t 0.401 (0.429)] [data_t 0.016] [optim_t 0.386] [lr 0.000081] [CE 6.789 (6.771)] [KD 0.000 (0.000)] 2024-10-11 08:15:12,315 - Train: 0.19% [700/375300] [0.6/300.0] [batch_t 0.458 (0.428)] [data_t 0.016] [optim_t 0.442] [lr 0.000087] [CE 6.723 (6.759)] [KD 0.000 (0.000)] 2024-10-11 08:15:32,622 - Train: 0.20% [750/375300] [0.6/300.0] [batch_t 0.439 (0.406)] [data_t 0.015] [optim_t 0.424] [lr 0.000093] [CE 6.722 (6.740)] [KD 0.000 (0.000)] 2024-10-11 08:15:53,283 - Train: 0.21% [800/375300] [0.6/300.0] [batch_t 0.450 (0.413)] [data_t 0.015] [optim_t 0.435] [lr 0.000099] [CE 6.791 (6.719)] [KD 0.000 (0.000)] 2024-10-11 08:16:14,361 - Train: 0.23% [850/375300] [0.7/300.0] [batch_t 0.356 (0.421)] [data_t 0.015] [optim_t 0.340] [lr 0.000105] [CE 6.722 (6.699)] [KD 0.000 (0.000)] 2024-10-11 08:16:35,366 - Train: 0.24% [900/375300] [0.7/300.0] [batch_t 0.391 (0.420)] [data_t 0.015] [optim_t 0.375] [lr 0.000111] [CE 6.655 (6.681)] [KD 0.000 (0.000)] 2024-10-11 08:16:56,456 - Train: 0.25% [950/375300] [0.8/300.0] [batch_t 0.378 (0.422)] [data_t 0.015] [optim_t 0.362] [lr 0.000117] [CE 6.621 (6.657)] [KD 0.000 (0.000)] 2024-10-11 08:17:17,138 - Train: 0.27% [1000/375300] [0.8/300.0] [batch_t 0.414 (0.414)] [data_t 0.015] [optim_t 0.399] [lr 0.000123] [CE 6.572 (6.638)] [KD 0.000 (0.000)] 2024-10-11 08:17:38,299 - Train: 0.28% [1050/375300] [0.8/300.0] [batch_t 0.455 (0.423)] [data_t 0.015] [optim_t 0.440] [lr 0.000129] [CE 6.649 (6.616)] [KD 0.000 (0.000)] 2024-10-11 08:17:58,986 - Train: 0.29% [1100/375300] [0.9/300.0] [batch_t 0.414 (0.414)] [data_t 0.016] [optim_t 0.398] [lr 0.000135] [CE 6.570 (6.604)] [KD 0.000 (0.000)] 2024-10-11 08:18:19,587 - Train: 0.31% [1150/375300] [0.9/300.0] [batch_t 0.395 (0.412)] [data_t 0.015] [optim_t 0.379] [lr 0.000141] [CE 6.592 (6.589)] [KD 0.000 (0.000)] 2024-10-11 08:18:41,185 - Train: 0.32% [1200/375300] [1.0/300.0] [batch_t 0.501 (0.432)] [data_t 0.015] [optim_t 0.485] [lr 0.000147] [CE 6.528 (6.574)] [KD 0.000 (0.000)] 2024-10-11 08:19:01,379 - Train: 0.33% [1250/375300] [1.0/300.0] [batch_t 0.308 (0.404)] [data_t 0.015] [optim_t 0.292] [lr 0.000153] [CE 6.486 (6.558)] [KD 0.000 (0.000)] 2024-10-11 08:19:01,687 - ==> Total time: 0:09:02 Eta: 1 day, 21:01:57 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 08:19:25,581 - Train: 0.35% [1300/375300] [1.0/300.0] [batch_t 0.307 (0.462)] [data_t 0.016] [optim_t 0.291] [lr 0.000159] [CE 6.445 (6.519)] [KD 0.000 (0.000)] 2024-10-11 08:19:46,198 - Train: 0.36% [1350/375300] [1.1/300.0] [batch_t 0.414 (0.412)] [data_t 0.015] [optim_t 0.399] [lr 0.000165] [CE 6.460 (6.511)] [KD 0.000 (0.000)] 2024-10-11 08:20:06,927 - Train: 0.37% [1400/375300] [1.1/300.0] [batch_t 0.407 (0.414)] [data_t 0.015] [optim_t 0.392] [lr 0.000171] [CE 6.386 (6.484)] [KD 0.000 (0.000)] 2024-10-11 08:20:27,852 - Train: 0.39% [1450/375300] [1.2/300.0] [batch_t 0.413 (0.418)] [data_t 0.015] [optim_t 0.398] [lr 0.000177] [CE 6.482 (6.472)] [KD 0.000 (0.000)] 2024-10-11 08:20:48,875 - Train: 0.40% [1500/375300] [1.2/300.0] [batch_t 0.365 (0.420)] [data_t 0.015] [optim_t 0.350] [lr 0.000183] [CE 6.519 (6.453)] [KD 0.000 (0.000)] 2024-10-11 08:21:10,821 - Train: 0.41% [1550/375300] [1.2/300.0] [batch_t 0.435 (0.439)] [data_t 0.015] [optim_t 0.420] [lr 0.000189] [CE 6.476 (6.443)] [KD 0.000 (0.000)] 2024-10-11 08:21:32,362 - Train: 0.43% [1600/375300] [1.3/300.0] [batch_t 0.401 (0.431)] [data_t 0.016] [optim_t 0.385] [lr 0.000195] [CE 6.405 (6.418)] [KD 0.000 (0.000)] 2024-10-11 08:21:54,148 - Train: 0.44% [1650/375300] [1.3/300.0] [batch_t 0.435 (0.436)] [data_t 0.015] [optim_t 0.420] [lr 0.000201] [CE 6.375 (6.386)] [KD 0.000 (0.000)] 2024-10-11 08:22:15,725 - Train: 0.45% [1700/375300] [1.4/300.0] [batch_t 0.428 (0.431)] [data_t 0.015] [optim_t 0.413] [lr 0.000207] [CE 6.366 (6.375)] [KD 0.000 (0.000)] 2024-10-11 08:22:37,295 - Train: 0.47% [1750/375300] [1.4/300.0] [batch_t 0.423 (0.431)] [data_t 0.015] [optim_t 0.408] [lr 0.000213] [CE 6.364 (6.337)] [KD 0.000 (0.000)] 2024-10-11 08:22:59,116 - Train: 0.48% [1800/375300] [1.4/300.0] [batch_t 0.399 (0.436)] [data_t 0.015] [optim_t 0.384] [lr 0.000218] [CE 6.341 (6.336)] [KD 0.000 (0.000)] 2024-10-11 08:23:20,440 - Train: 0.49% [1850/375300] [1.5/300.0] [batch_t 0.440 (0.426)] [data_t 0.015] [optim_t 0.424] [lr 0.000224] [CE 6.273 (6.301)] [KD 0.000 (0.000)] 2024-10-11 08:23:40,860 - Train: 0.51% [1900/375300] [1.5/300.0] [batch_t 0.385 (0.408)] [data_t 0.015] [optim_t 0.370] [lr 0.000230] [CE 6.285 (6.294)] [KD 0.000 (0.000)] 2024-10-11 08:24:00,571 - Train: 0.52% [1950/375300] [1.6/300.0] [batch_t 0.308 (0.394)] [data_t 0.015] [optim_t 0.292] [lr 0.000236] [CE 6.179 (6.253)] [KD 0.000 (0.000)] 2024-10-11 08:24:21,629 - Train: 0.53% [2000/375300] [1.6/300.0] [batch_t 0.517 (0.421)] [data_t 0.228] [optim_t 0.289] [lr 0.000242] [CE 6.268 (6.244)] [KD 0.000 (0.000)] 2024-10-11 08:24:42,660 - Train: 0.55% [2050/375300] [1.6/300.0] [batch_t 0.440 (0.421)] [data_t 0.150] [optim_t 0.289] [lr 0.000248] [CE 6.241 (6.231)] [KD 0.000 (0.000)] 2024-10-11 08:25:04,058 - Train: 0.56% [2100/375300] [1.7/300.0] [batch_t 0.497 (0.428)] [data_t 0.207] [optim_t 0.290] [lr 0.000254] [CE 6.259 (6.212)] [KD 0.000 (0.000)] 2024-10-11 08:25:24,914 - Train: 0.57% [2150/375300] [1.7/300.0] [batch_t 0.413 (0.417)] [data_t 0.122] [optim_t 0.291] [lr 0.000260] [CE 6.068 (6.168)] [KD 0.000 (0.000)] 2024-10-11 08:25:45,934 - Train: 0.59% [2200/375300] [1.8/300.0] [batch_t 0.462 (0.420)] [data_t 0.172] [optim_t 0.290] [lr 0.000266] [CE 6.118 (6.174)] [KD 0.000 (0.000)] 2024-10-11 08:26:06,630 - Train: 0.60% [2250/375300] [1.8/300.0] [batch_t 0.380 (0.414)] [data_t 0.091] [optim_t 0.290] [lr 0.000272] [CE 6.223 (6.153)] [KD 0.000 (0.000)] 2024-10-11 08:26:27,791 - Train: 0.61% [2300/375300] [1.8/300.0] [batch_t 0.447 (0.423)] [data_t 0.156] [optim_t 0.291] [lr 0.000278] [CE 6.168 (6.109)] [KD 0.000 (0.000)] 2024-10-11 08:26:48,681 - Train: 0.63% [2350/375300] [1.9/300.0] [batch_t 0.418 (0.418)] [data_t 0.129] [optim_t 0.289] [lr 0.000284] [CE 5.935 (6.106)] [KD 0.000 (0.000)] 2024-10-11 08:27:09,814 - Train: 0.64% [2400/375300] [1.9/300.0] [batch_t 0.477 (0.423)] [data_t 0.187] [optim_t 0.289] [lr 0.000290] [CE 6.052 (6.071)] [KD 0.000 (0.000)] 2024-10-11 08:27:30,640 - Train: 0.65% [2450/375300] [2.0/300.0] [batch_t 0.437 (0.416)] [data_t 0.142] [optim_t 0.295] [lr 0.000296] [CE 5.899 (6.047)] [KD 0.000 (0.000)] 2024-10-11 08:27:50,599 - Train: 0.67% [2500/375300] [2.0/300.0] [batch_t 0.304 (0.399)] [data_t 0.015] [optim_t 0.289] [lr 0.000302] [CE 6.071 (6.060)] [KD 0.000 (0.000)] 2024-10-11 08:27:51,209 - ==> Total time: 0:17:51 Eta: 1 day, 20:21:26 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 08:28:15,273 - Train: 0.68% [2550/375300] [2.0/300.0] [batch_t 0.398 (0.475)] [data_t 0.110] [optim_t 0.289] [lr 0.000308] [CE 6.081 (6.019)] [KD 0.000 (0.000)] 2024-10-11 08:28:36,603 - Train: 0.69% [2600/375300] [2.1/300.0] [batch_t 0.474 (0.427)] [data_t 0.187] [optim_t 0.287] [lr 0.000314] [CE 5.937 (5.996)] [KD 0.000 (0.000)] 2024-10-11 08:28:57,977 - Train: 0.71% [2650/375300] [2.1/300.0] [batch_t 0.413 (0.427)] [data_t 0.123] [optim_t 0.290] [lr 0.000320] [CE 6.164 (5.938)] [KD 0.000 (0.000)] 2024-10-11 08:29:19,164 - Train: 0.72% [2700/375300] [2.2/300.0] [batch_t 0.408 (0.424)] [data_t 0.118] [optim_t 0.290] [lr 0.000326] [CE 5.979 (5.957)] [KD 0.000 (0.000)] 2024-10-11 08:29:40,650 - Train: 0.73% [2750/375300] [2.2/300.0] [batch_t 0.448 (0.430)] [data_t 0.159] [optim_t 0.288] [lr 0.000332] [CE 5.836 (5.964)] [KD 0.000 (0.000)] 2024-10-11 08:30:01,762 - Train: 0.75% [2800/375300] [2.2/300.0] [batch_t 0.446 (0.422)] [data_t 0.155] [optim_t 0.291] [lr 0.000338] [CE 6.019 (5.928)] [KD 0.000 (0.000)] 2024-10-11 08:30:22,961 - Train: 0.76% [2850/375300] [2.3/300.0] [batch_t 0.367 (0.424)] [data_t 0.074] [optim_t 0.293] [lr 0.000344] [CE 5.999 (5.908)] [KD 0.000 (0.000)] 2024-10-11 08:30:43,782 - Train: 0.77% [2900/375300] [2.3/300.0] [batch_t 0.414 (0.416)] [data_t 0.121] [optim_t 0.293] [lr 0.000350] [CE 5.917 (5.867)] [KD 0.000 (0.000)] 2024-10-11 08:31:04,794 - Train: 0.79% [2950/375300] [2.4/300.0] [batch_t 0.446 (0.420)] [data_t 0.155] [optim_t 0.291] [lr 0.000356] [CE 5.994 (5.874)] [KD 0.000 (0.000)] 2024-10-11 08:31:25,687 - Train: 0.80% [3000/375300] [2.4/300.0] [batch_t 0.464 (0.418)] [data_t 0.170] [optim_t 0.294] [lr 0.000362] [CE 6.059 (5.875)] [KD 0.000 (0.000)] 2024-10-11 08:31:46,731 - Train: 0.81% [3050/375300] [2.4/300.0] [batch_t 0.496 (0.421)] [data_t 0.205] [optim_t 0.291] [lr 0.000368] [CE 5.827 (5.858)] [KD 0.000 (0.000)] 2024-10-11 08:32:07,958 - Train: 0.83% [3100/375300] [2.5/300.0] [batch_t 0.482 (0.424)] [data_t 0.188] [optim_t 0.294] [lr 0.000374] [CE 6.014 (5.836)] [KD 0.000 (0.000)] 2024-10-11 08:32:29,478 - Train: 0.84% [3150/375300] [2.5/300.0] [batch_t 0.463 (0.430)] [data_t 0.170] [optim_t 0.293] [lr 0.000380] [CE 5.644 (5.833)] [KD 0.000 (0.000)] 2024-10-11 08:32:50,385 - Train: 0.85% [3200/375300] [2.6/300.0] [batch_t 0.356 (0.418)] [data_t 0.067] [optim_t 0.289] [lr 0.000386] [CE 5.759 (5.792)] [KD 0.000 (0.000)] 2024-10-11 08:33:11,715 - Train: 0.87% [3250/375300] [2.6/300.0] [batch_t 0.403 (0.427)] [data_t 0.111] [optim_t 0.291] [lr 0.000392] [CE 5.829 (5.776)] [KD 0.000 (0.000)] 2024-10-11 08:33:32,816 - Train: 0.88% [3300/375300] [2.6/300.0] [batch_t 0.439 (0.422)] [data_t 0.145] [optim_t 0.294] [lr 0.000398] [CE 5.646 (5.754)] [KD 0.000 (0.000)] 2024-10-11 08:33:53,825 - Train: 0.89% [3350/375300] [2.7/300.0] [batch_t 0.410 (0.420)] [data_t 0.119] [optim_t 0.290] [lr 0.000404] [CE 5.700 (5.774)] [KD 0.000 (0.000)] 2024-10-11 08:34:14,689 - Train: 0.91% [3400/375300] [2.7/300.0] [batch_t 0.434 (0.417)] [data_t 0.139] [optim_t 0.295] [lr 0.000410] [CE 5.847 (5.760)] [KD 0.000 (0.000)] 2024-10-11 08:34:35,570 - Train: 0.92% [3450/375300] [2.8/300.0] [batch_t 0.495 (0.417)] [data_t 0.203] [optim_t 0.292] [lr 0.000416] [CE 5.836 (5.691)] [KD 0.000 (0.000)] 2024-10-11 08:34:56,820 - Train: 0.93% [3500/375300] [2.8/300.0] [batch_t 0.436 (0.425)] [data_t 0.144] [optim_t 0.293] [lr 0.000422] [CE 5.722 (5.708)] [KD 0.000 (0.000)] 2024-10-11 08:35:17,955 - Train: 0.95% [3550/375300] [2.8/300.0] [batch_t 0.434 (0.423)] [data_t 0.142] [optim_t 0.292] [lr 0.000428] [CE 5.905 (5.670)] [KD 0.000 (0.000)] 2024-10-11 08:35:39,122 - Train: 0.96% [3600/375300] [2.9/300.0] [batch_t 0.444 (0.423)] [data_t 0.141] [optim_t 0.302] [lr 0.000434] [CE 5.610 (5.645)] [KD 0.000 (0.000)] 2024-10-11 08:36:00,116 - Train: 0.97% [3650/375300] [2.9/300.0] [batch_t 0.415 (0.420)] [data_t 0.123] [optim_t 0.292] [lr 0.000440] [CE 5.584 (5.645)] [KD 0.000 (0.000)] 2024-10-11 08:36:21,280 - Train: 0.99% [3700/375300] [3.0/300.0] [batch_t 0.395 (0.423)] [data_t 0.102] [optim_t 0.293] [lr 0.000446] [CE 5.681 (5.653)] [KD 0.000 (0.000)] 2024-10-11 08:36:41,062 - Train: 1.00% [3750/375300] [3.0/300.0] [batch_t 0.306 (0.396)] [data_t 0.015] [optim_t 0.291] [lr 0.000452] [CE 5.517 (5.633)] [KD 0.000 (0.000)] 2024-10-11 08:36:41,981 - ==> Total time: 0:26:42 Eta: 1 day, 20:04:06 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 08:37:05,465 - Train: 1.01% [3800/375300] [3.0/300.0] [batch_t 0.308 (0.474)] [data_t 0.015] [optim_t 0.293] [lr 0.000458] [CE 5.336 (5.618)] [KD 0.000 (0.000)] 2024-10-11 08:37:26,962 - Train: 1.03% [3850/375300] [3.1/300.0] [batch_t 0.349 (0.430)] [data_t 0.015] [optim_t 0.334] [lr 0.000464] [CE 5.697 (5.590)] [KD 0.000 (0.000)] 2024-10-11 08:37:48,184 - Train: 1.04% [3900/375300] [3.1/300.0] [batch_t 0.399 (0.424)] [data_t 0.015] [optim_t 0.384] [lr 0.000470] [CE 5.437 (5.607)] [KD 0.000 (0.000)] 2024-10-11 08:38:09,285 - Train: 1.05% [3950/375300] [3.2/300.0] [batch_t 0.453 (0.422)] [data_t 0.015] [optim_t 0.438] [lr 0.000476] [CE 5.705 (5.608)] [KD 0.000 (0.000)] 2024-10-11 08:38:30,176 - Train: 1.07% [4000/375300] [3.2/300.0] [batch_t 0.427 (0.418)] [data_t 0.015] [optim_t 0.411] [lr 0.000482] [CE 5.724 (5.569)] [KD 0.000 (0.000)] 2024-10-11 08:38:51,093 - Train: 1.08% [4050/375300] [3.2/300.0] [batch_t 0.431 (0.418)] [data_t 0.015] [optim_t 0.416] [lr 0.000488] [CE 5.491 (5.570)] [KD 0.000 (0.000)] 2024-10-11 08:39:11,604 - Train: 1.09% [4100/375300] [3.3/300.0] [batch_t 0.319 (0.410)] [data_t 0.015] [optim_t 0.304] [lr 0.000494] [CE 5.581 (5.599)] [KD 0.000 (0.000)] 2024-10-11 08:39:32,045 - Train: 1.11% [4150/375300] [3.3/300.0] [batch_t 0.373 (0.409)] [data_t 0.015] [optim_t 0.357] [lr 0.000500] [CE 5.419 (5.582)] [KD 0.000 (0.000)] 2024-10-11 08:39:53,228 - Train: 1.12% [4200/375300] [3.4/300.0] [batch_t 0.402 (0.424)] [data_t 0.015] [optim_t 0.387] [lr 0.000506] [CE 5.331 (5.497)] [KD 0.000 (0.000)] 2024-10-11 08:40:13,887 - Train: 1.13% [4250/375300] [3.4/300.0] [batch_t 0.511 (0.413)] [data_t 0.015] [optim_t 0.496] [lr 0.000512] [CE 5.332 (5.518)] [KD 0.000 (0.000)] 2024-10-11 08:40:34,978 - Train: 1.15% [4300/375300] [3.4/300.0] [batch_t 0.437 (0.422)] [data_t 0.015] [optim_t 0.421] [lr 0.000518] [CE 5.163 (5.527)] [KD 0.000 (0.000)] 2024-10-11 08:40:55,825 - Train: 1.16% [4350/375300] [3.5/300.0] [batch_t 0.383 (0.417)] [data_t 0.015] [optim_t 0.368] [lr 0.000524] [CE 5.594 (5.428)] [KD 0.000 (0.000)] 2024-10-11 08:41:16,904 - Train: 1.17% [4400/375300] [3.5/300.0] [batch_t 0.415 (0.421)] [data_t 0.015] [optim_t 0.400] [lr 0.000530] [CE 5.267 (5.441)] [KD 0.000 (0.000)] 2024-10-11 08:41:37,916 - Train: 1.19% [4450/375300] [3.6/300.0] [batch_t 0.496 (0.420)] [data_t 0.015] [optim_t 0.481] [lr 0.000536] [CE 5.425 (5.444)] [KD 0.000 (0.000)] 2024-10-11 08:41:59,115 - Train: 1.20% [4500/375300] [3.6/300.0] [batch_t 0.420 (0.424)] [data_t 0.015] [optim_t 0.405] [lr 0.000542] [CE 5.251 (5.439)] [KD 0.000 (0.000)] 2024-10-11 08:42:20,126 - Train: 1.21% [4550/375300] [3.6/300.0] [batch_t 0.400 (0.420)] [data_t 0.015] [optim_t 0.384] [lr 0.000548] [CE 5.507 (5.432)] [KD 0.000 (0.000)] 2024-10-11 08:42:41,341 - Train: 1.23% [4600/375300] [3.7/300.0] [batch_t 0.474 (0.424)] [data_t 0.015] [optim_t 0.459] [lr 0.000554] [CE 5.182 (5.386)] [KD 0.000 (0.000)] 2024-10-11 08:43:02,254 - Train: 1.24% [4650/375300] [3.7/300.0] [batch_t 0.482 (0.418)] [data_t 0.015] [optim_t 0.467] [lr 0.000560] [CE 5.501 (5.448)] [KD 0.000 (0.000)] 2024-10-11 08:43:23,041 - Train: 1.25% [4700/375300] [3.8/300.0] [batch_t 0.381 (0.416)] [data_t 0.015] [optim_t 0.365] [lr 0.000566] [CE 5.240 (5.442)] [KD 0.000 (0.000)] 2024-10-11 08:43:43,469 - Train: 1.27% [4750/375300] [3.8/300.0] [batch_t 0.426 (0.408)] [data_t 0.015] [optim_t 0.411] [lr 0.000572] [CE 5.625 (5.386)] [KD 0.000 (0.000)] 2024-10-11 08:44:03,913 - Train: 1.28% [4800/375300] [3.8/300.0] [batch_t 0.368 (0.409)] [data_t 0.015] [optim_t 0.352] [lr 0.000578] [CE 5.230 (5.378)] [KD 0.000 (0.000)] 2024-10-11 08:44:24,589 - Train: 1.29% [4850/375300] [3.9/300.0] [batch_t 0.488 (0.413)] [data_t 0.015] [optim_t 0.473] [lr 0.000584] [CE 5.495 (5.379)] [KD 0.000 (0.000)] 2024-10-11 08:44:45,516 - Train: 1.31% [4900/375300] [3.9/300.0] [batch_t 0.407 (0.418)] [data_t 0.015] [optim_t 0.391] [lr 0.000590] [CE 5.139 (5.340)] [KD 0.000 (0.000)] 2024-10-11 08:45:06,194 - Train: 1.32% [4950/375300] [4.0/300.0] [batch_t 0.359 (0.413)] [data_t 0.015] [optim_t 0.343] [lr 0.000596] [CE 5.344 (5.388)] [KD 0.000 (0.000)] 2024-10-11 08:45:26,061 - Train: 1.33% [5000/375300] [4.0/300.0] [batch_t 0.306 (0.397)] [data_t 0.015] [optim_t 0.291] [lr 0.000602] [CE 5.426 (5.341)] [KD 0.000 (0.000)] 2024-10-11 08:45:27,386 - ==> Total time: 0:35:27 Eta: 1 day, 19:44:24 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 08:45:51,000 - Train: 1.35% [5050/375300] [4.0/300.0] [batch_t 0.528 (0.487)] [data_t 0.074] [optim_t 0.454] [lr 0.000608] [CE 5.234 (5.307)] [KD 0.000 (0.000)] 2024-10-11 08:46:12,657 - Train: 1.36% [5100/375300] [4.1/300.0] [batch_t 0.429 (0.433)] [data_t 0.015] [optim_t 0.413] [lr 0.000614] [CE 5.499 (5.323)] [KD 0.000 (0.000)] 2024-10-11 08:46:34,177 - Train: 1.37% [5150/375300] [4.1/300.0] [batch_t 0.433 (0.430)] [data_t 0.015] [optim_t 0.418] [lr 0.000620] [CE 5.180 (5.276)] [KD 0.000 (0.000)] 2024-10-11 08:46:55,900 - Train: 1.39% [5200/375300] [4.2/300.0] [batch_t 0.525 (0.434)] [data_t 0.015] [optim_t 0.510] [lr 0.000626] [CE 5.311 (5.292)] [KD 0.000 (0.000)] 2024-10-11 08:47:16,962 - Train: 1.40% [5250/375300] [4.2/300.0] [batch_t 0.464 (0.421)] [data_t 0.015] [optim_t 0.448] [lr 0.000632] [CE 4.997 (5.301)] [KD 0.000 (0.000)] 2024-10-11 08:47:38,304 - Train: 1.41% [5300/375300] [4.2/300.0] [batch_t 0.454 (0.427)] [data_t 0.015] [optim_t 0.439] [lr 0.000638] [CE 5.325 (5.264)] [KD 0.000 (0.000)] 2024-10-11 08:47:59,361 - Train: 1.43% [5350/375300] [4.3/300.0] [batch_t 0.365 (0.421)] [data_t 0.015] [optim_t 0.350] [lr 0.000644] [CE 5.555 (5.280)] [KD 0.000 (0.000)] 2024-10-11 08:48:20,287 - Train: 1.44% [5400/375300] [4.3/300.0] [batch_t 0.446 (0.418)] [data_t 0.015] [optim_t 0.430] [lr 0.000650] [CE 5.292 (5.241)] [KD 0.000 (0.000)] 2024-10-11 08:48:40,946 - Train: 1.45% [5450/375300] [4.4/300.0] [batch_t 0.378 (0.413)] [data_t 0.015] [optim_t 0.362] [lr 0.000656] [CE 5.155 (5.275)] [KD 0.000 (0.000)] 2024-10-11 08:49:01,705 - Train: 1.47% [5500/375300] [4.4/300.0] [batch_t 0.420 (0.415)] [data_t 0.015] [optim_t 0.404] [lr 0.000662] [CE 5.292 (5.235)] [KD 0.000 (0.000)] 2024-10-11 08:49:22,436 - Train: 1.48% [5550/375300] [4.4/300.0] [batch_t 0.449 (0.415)] [data_t 0.015] [optim_t 0.434] [lr 0.000668] [CE 5.464 (5.261)] [KD 0.000 (0.000)] 2024-10-11 08:49:43,211 - Train: 1.49% [5600/375300] [4.5/300.0] [batch_t 0.391 (0.415)] [data_t 0.015] [optim_t 0.376] [lr 0.000674] [CE 5.237 (5.242)] [KD 0.000 (0.000)] 2024-10-11 08:50:04,570 - Train: 1.51% [5650/375300] [4.5/300.0] [batch_t 0.464 (0.427)] [data_t 0.015] [optim_t 0.448] [lr 0.000680] [CE 5.353 (5.261)] [KD 0.000 (0.000)] 2024-10-11 08:50:26,014 - Train: 1.52% [5700/375300] [4.6/300.0] [batch_t 0.344 (0.429)] [data_t 0.015] [optim_t 0.329] [lr 0.000686] [CE 4.948 (5.207)] [KD 0.000 (0.000)] 2024-10-11 08:50:47,066 - Train: 1.53% [5750/375300] [4.6/300.0] [batch_t 0.471 (0.421)] [data_t 0.015] [optim_t 0.455] [lr 0.000692] [CE 4.965 (5.222)] [KD 0.000 (0.000)] 2024-10-11 08:51:07,611 - Train: 1.55% [5800/375300] [4.6/300.0] [batch_t 0.409 (0.411)] [data_t 0.015] [optim_t 0.394] [lr 0.000698] [CE 5.304 (5.198)] [KD 0.000 (0.000)] 2024-10-11 08:51:28,654 - Train: 1.56% [5850/375300] [4.7/300.0] [batch_t 0.425 (0.421)] [data_t 0.015] [optim_t 0.410] [lr 0.000704] [CE 4.897 (5.154)] [KD 0.000 (0.000)] 2024-10-11 08:51:49,734 - Train: 1.57% [5900/375300] [4.7/300.0] [batch_t 0.418 (0.422)] [data_t 0.015] [optim_t 0.402] [lr 0.000710] [CE 5.373 (5.230)] [KD 0.000 (0.000)] 2024-10-11 08:52:11,100 - Train: 1.59% [5950/375300] [4.8/300.0] [batch_t 0.413 (0.427)] [data_t 0.015] [optim_t 0.398] [lr 0.000716] [CE 4.990 (5.142)] [KD 0.000 (0.000)] 2024-10-11 08:52:32,944 - Train: 1.60% [6000/375300] [4.8/300.0] [batch_t 0.396 (0.437)] [data_t 0.015] [optim_t 0.381] [lr 0.000722] [CE 5.127 (5.176)] [KD 0.000 (0.000)] 2024-10-11 08:52:54,118 - Train: 1.61% [6050/375300] [4.8/300.0] [batch_t 0.430 (0.423)] [data_t 0.015] [optim_t 0.414] [lr 0.000728] [CE 5.113 (5.231)] [KD 0.000 (0.000)] 2024-10-11 08:53:15,099 - Train: 1.63% [6100/375300] [4.9/300.0] [batch_t 0.419 (0.420)] [data_t 0.015] [optim_t 0.404] [lr 0.000734] [CE 5.175 (5.136)] [KD 0.000 (0.000)] 2024-10-11 08:53:35,925 - Train: 1.64% [6150/375300] [4.9/300.0] [batch_t 0.412 (0.416)] [data_t 0.015] [optim_t 0.397] [lr 0.000740] [CE 4.812 (5.126)] [KD 0.000 (0.000)] 2024-10-11 08:53:56,891 - Train: 1.65% [6200/375300] [5.0/300.0] [batch_t 0.408 (0.419)] [data_t 0.015] [optim_t 0.393] [lr 0.000746] [CE 5.198 (5.171)] [KD 0.000 (0.000)] 2024-10-11 08:54:17,200 - Train: 1.67% [6250/375300] [5.0/300.0] [batch_t 0.306 (0.406)] [data_t 0.015] [optim_t 0.291] [lr 0.000752] [CE 5.053 (5.131)] [KD 0.000 (0.000)] 2024-10-11 08:54:40,209 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.426)] [top1_cnt 21040] [top5_cnt 34187] [top_all 50000] 2024-10-11 08:54:40,210 - net: 42.080 (68.374) 2024-10-11 08:55:00,510 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.399)] [top1_cnt 59] [top5_cnt 283] [top_all 50000] 2024-10-11 08:55:00,510 - net_E: 0.118 (0.566) 2024-10-11 08:55:00,718 - Max [top1: 42.080 (epoch: 5)] [top1-ema: 0.118 (epoch: 5)] 2024-10-11 08:55:00,719 - ==> Total time: 0:45:01 Eta: 1 day, 20:16:12 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 08:55:28,111 - Train: 1.68% [6300/375300] [5.0/300.0] [batch_t 0.306 (0.395)] [data_t 0.015] [optim_t 0.290] [lr 0.000758] [CE 4.911 (5.044)] [KD 0.000 (0.000)] 2024-10-11 08:55:48,716 - Train: 1.69% [6350/375300] [5.1/300.0] [batch_t 0.423 (0.412)] [data_t 0.134] [optim_t 0.289] [lr 0.000764] [CE 5.100 (5.081)] [KD 0.000 (0.000)] 2024-10-11 08:56:09,340 - Train: 1.71% [6400/375300] [5.1/300.0] [batch_t 0.344 (0.412)] [data_t 0.052] [optim_t 0.293] [lr 0.000769] [CE 5.208 (5.098)] [KD 0.000 (0.000)] 2024-10-11 08:56:30,212 - Train: 1.72% [6450/375300] [5.2/300.0] [batch_t 0.463 (0.417)] [data_t 0.175] [optim_t 0.288] [lr 0.000775] [CE 5.138 (5.094)] [KD 0.000 (0.000)] 2024-10-11 08:56:50,656 - Train: 1.73% [6500/375300] [5.2/300.0] [batch_t 0.404 (0.409)] [data_t 0.117] [optim_t 0.287] [lr 0.000781] [CE 4.979 (5.051)] [KD 0.000 (0.000)] 2024-10-11 08:57:11,299 - Train: 1.75% [6550/375300] [5.2/300.0] [batch_t 0.391 (0.413)] [data_t 0.103] [optim_t 0.288] [lr 0.000787] [CE 4.749 (5.055)] [KD 0.000 (0.000)] 2024-10-11 08:57:32,024 - Train: 1.76% [6600/375300] [5.3/300.0] [batch_t 0.412 (0.414)] [data_t 0.124] [optim_t 0.288] [lr 0.000793] [CE 5.224 (5.067)] [KD 0.000 (0.000)] 2024-10-11 08:57:52,711 - Train: 1.77% [6650/375300] [5.3/300.0] [batch_t 0.414 (0.414)] [data_t 0.124] [optim_t 0.289] [lr 0.000799] [CE 4.992 (5.089)] [KD 0.000 (0.000)] 2024-10-11 08:58:13,584 - Train: 1.79% [6700/375300] [5.4/300.0] [batch_t 0.395 (0.417)] [data_t 0.103] [optim_t 0.292] [lr 0.000805] [CE 4.834 (5.030)] [KD 0.000 (0.000)] 2024-10-11 08:58:34,410 - Train: 1.80% [6750/375300] [5.4/300.0] [batch_t 0.435 (0.416)] [data_t 0.146] [optim_t 0.289] [lr 0.000811] [CE 4.901 (5.069)] [KD 0.000 (0.000)] 2024-10-11 08:58:55,259 - Train: 1.81% [6800/375300] [5.4/300.0] [batch_t 0.399 (0.417)] [data_t 0.110] [optim_t 0.289] [lr 0.000817] [CE 5.173 (5.026)] [KD 0.000 (0.000)] 2024-10-11 08:59:16,298 - Train: 1.83% [6850/375300] [5.5/300.0] [batch_t 0.477 (0.421)] [data_t 0.186] [optim_t 0.290] [lr 0.000823] [CE 4.870 (5.042)] [KD 0.000 (0.000)] 2024-10-11 08:59:37,001 - Train: 1.84% [6900/375300] [5.5/300.0] [batch_t 0.378 (0.414)] [data_t 0.090] [optim_t 0.287] [lr 0.000829] [CE 5.192 (5.016)] [KD 0.000 (0.000)] 2024-10-11 08:59:58,347 - Train: 1.85% [6950/375300] [5.6/300.0] [batch_t 0.384 (0.427)] [data_t 0.097] [optim_t 0.287] [lr 0.000835] [CE 5.167 (5.032)] [KD 0.000 (0.000)] 2024-10-11 09:00:19,076 - Train: 1.87% [7000/375300] [5.6/300.0] [batch_t 0.393 (0.414)] [data_t 0.102] [optim_t 0.291] [lr 0.000841] [CE 4.935 (4.986)] [KD 0.000 (0.000)] 2024-10-11 09:00:39,791 - Train: 1.88% [7050/375300] [5.6/300.0] [batch_t 0.395 (0.414)] [data_t 0.106] [optim_t 0.289] [lr 0.000847] [CE 4.957 (5.026)] [KD 0.000 (0.000)] 2024-10-11 09:01:00,705 - Train: 1.89% [7100/375300] [5.7/300.0] [batch_t 0.409 (0.418)] [data_t 0.015] [optim_t 0.394] [lr 0.000853] [CE 4.885 (5.017)] [KD 0.000 (0.000)] 2024-10-11 09:01:22,171 - Train: 1.91% [7150/375300] [5.7/300.0] [batch_t 0.453 (0.429)] [data_t 0.015] [optim_t 0.438] [lr 0.000859] [CE 4.813 (4.990)] [KD 0.000 (0.000)] 2024-10-11 09:01:43,217 - Train: 1.92% [7200/375300] [5.8/300.0] [batch_t 0.453 (0.421)] [data_t 0.015] [optim_t 0.437] [lr 0.000865] [CE 4.859 (5.011)] [KD 0.000 (0.000)] 2024-10-11 09:02:03,610 - Train: 1.93% [7250/375300] [5.8/300.0] [batch_t 0.364 (0.408)] [data_t 0.015] [optim_t 0.348] [lr 0.000871] [CE 5.176 (4.941)] [KD 0.000 (0.000)] 2024-10-11 09:02:24,189 - Train: 1.95% [7300/375300] [5.8/300.0] [batch_t 0.419 (0.411)] [data_t 0.015] [optim_t 0.404] [lr 0.000877] [CE 5.039 (4.962)] [KD 0.000 (0.000)] 2024-10-11 09:02:44,775 - Train: 1.96% [7350/375300] [5.9/300.0] [batch_t 0.426 (0.412)] [data_t 0.015] [optim_t 0.410] [lr 0.000883] [CE 4.987 (4.951)] [KD 0.000 (0.000)] 2024-10-11 09:03:05,387 - Train: 1.97% [7400/375300] [5.9/300.0] [batch_t 0.425 (0.412)] [data_t 0.015] [optim_t 0.410] [lr 0.000889] [CE 4.968 (4.995)] [KD 0.000 (0.000)] 2024-10-11 09:03:26,231 - Train: 1.99% [7450/375300] [6.0/300.0] [batch_t 0.377 (0.417)] [data_t 0.015] [optim_t 0.362] [lr 0.000895] [CE 4.990 (4.953)] [KD 0.000 (0.000)] 2024-10-11 09:03:46,607 - Train: 2.00% [7500/375300] [6.0/300.0] [batch_t 0.304 (0.407)] [data_t 0.015] [optim_t 0.289] [lr 0.000901] [CE 5.058 (4.968)] [KD 0.000 (0.000)] 2024-10-11 09:03:48,437 - ==> Total time: 0:53:48 Eta: 1 day, 19:56:58 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 09:04:09,998 - Train: 2.01% [7550/375300] [6.0/300.0] [batch_t 0.436 (0.462)] [data_t 0.148] [optim_t 0.288] [lr 0.000907] [CE 4.414 (4.895)] [KD 0.000 (0.000)] 2024-10-11 09:04:30,592 - Train: 2.03% [7600/375300] [6.1/300.0] [batch_t 0.433 (0.412)] [data_t 0.144] [optim_t 0.289] [lr 0.000913] [CE 5.027 (4.963)] [KD 0.000 (0.000)] 2024-10-11 09:04:51,259 - Train: 2.04% [7650/375300] [6.1/300.0] [batch_t 0.414 (0.413)] [data_t 0.123] [optim_t 0.290] [lr 0.000919] [CE 5.137 (4.991)] [KD 0.000 (0.000)] 2024-10-11 09:05:12,059 - Train: 2.05% [7700/375300] [6.2/300.0] [batch_t 0.398 (0.416)] [data_t 0.015] [optim_t 0.382] [lr 0.000925] [CE 4.774 (4.914)] [KD 0.000 (0.000)] 2024-10-11 09:05:32,954 - Train: 2.07% [7750/375300] [6.2/300.0] [batch_t 0.408 (0.418)] [data_t 0.118] [optim_t 0.290] [lr 0.000931] [CE 4.559 (4.877)] [KD 0.000 (0.000)] 2024-10-11 09:05:53,775 - Train: 2.08% [7800/375300] [6.2/300.0] [batch_t 0.374 (0.416)] [data_t 0.086] [optim_t 0.288] [lr 0.000937] [CE 4.651 (4.911)] [KD 0.000 (0.000)] 2024-10-11 09:06:15,106 - Train: 2.09% [7850/375300] [6.3/300.0] [batch_t 0.393 (0.427)] [data_t 0.101] [optim_t 0.292] [lr 0.000943] [CE 4.728 (4.893)] [KD 0.000 (0.000)] 2024-10-11 09:06:35,710 - Train: 2.10% [7900/375300] [6.3/300.0] [batch_t 0.428 (0.412)] [data_t 0.140] [optim_t 0.288] [lr 0.000949] [CE 4.767 (4.929)] [KD 0.000 (0.000)] 2024-10-11 09:06:56,183 - Train: 2.12% [7950/375300] [6.4/300.0] [batch_t 0.400 (0.409)] [data_t 0.112] [optim_t 0.288] [lr 0.000955] [CE 5.175 (4.890)] [KD 0.000 (0.000)] 2024-10-11 09:07:16,976 - Train: 2.13% [8000/375300] [6.4/300.0] [batch_t 0.444 (0.416)] [data_t 0.154] [optim_t 0.290] [lr 0.000961] [CE 4.882 (4.906)] [KD 0.000 (0.000)] 2024-10-11 09:07:37,681 - Train: 2.14% [8050/375300] [6.4/300.0] [batch_t 0.392 (0.414)] [data_t 0.105] [optim_t 0.287] [lr 0.000967] [CE 4.996 (4.895)] [KD 0.000 (0.000)] 2024-10-11 09:07:58,058 - Train: 2.16% [8100/375300] [6.5/300.0] [batch_t 0.397 (0.407)] [data_t 0.105] [optim_t 0.291] [lr 0.000973] [CE 4.739 (4.924)] [KD 0.000 (0.000)] 2024-10-11 09:08:18,463 - Train: 2.17% [8150/375300] [6.5/300.0] [batch_t 0.347 (0.408)] [data_t 0.059] [optim_t 0.288] [lr 0.000979] [CE 4.479 (4.878)] [KD 0.000 (0.000)] 2024-10-11 09:08:39,336 - Train: 2.18% [8200/375300] [6.6/300.0] [batch_t 0.464 (0.417)] [data_t 0.174] [optim_t 0.290] [lr 0.000985] [CE 4.877 (4.889)] [KD 0.000 (0.000)] 2024-10-11 09:09:00,052 - Train: 2.20% [8250/375300] [6.6/300.0] [batch_t 0.430 (0.414)] [data_t 0.142] [optim_t 0.288] [lr 0.000991] [CE 4.729 (4.903)] [KD 0.000 (0.000)] 2024-10-11 09:09:21,016 - Train: 2.21% [8300/375300] [6.6/300.0] [batch_t 0.462 (0.419)] [data_t 0.174] [optim_t 0.288] [lr 0.000997] [CE 4.525 (4.865)] [KD 0.000 (0.000)] 2024-10-11 09:09:42,126 - Train: 2.22% [8350/375300] [6.7/300.0] [batch_t 0.412 (0.422)] [data_t 0.015] [optim_t 0.397] [lr 0.001003] [CE 4.855 (4.858)] [KD 0.000 (0.000)] 2024-10-11 09:10:03,579 - Train: 2.24% [8400/375300] [6.7/300.0] [batch_t 0.377 (0.429)] [data_t 0.015] [optim_t 0.361] [lr 0.001009] [CE 4.643 (4.870)] [KD 0.000 (0.000)] 2024-10-11 09:10:24,899 - Train: 2.25% [8450/375300] [6.8/300.0] [batch_t 0.438 (0.426)] [data_t 0.015] [optim_t 0.423] [lr 0.001015] [CE 4.947 (4.871)] [KD 0.000 (0.000)] 2024-10-11 09:10:46,282 - Train: 2.26% [8500/375300] [6.8/300.0] [batch_t 0.435 (0.428)] [data_t 0.015] [optim_t 0.420] [lr 0.001021] [CE 4.934 (4.828)] [KD 0.000 (0.000)] 2024-10-11 09:11:07,605 - Train: 2.28% [8550/375300] [6.8/300.0] [batch_t 0.472 (0.426)] [data_t 0.015] [optim_t 0.456] [lr 0.001027] [CE 4.841 (4.812)] [KD 0.000 (0.000)] 2024-10-11 09:11:28,527 - Train: 2.29% [8600/375300] [6.9/300.0] [batch_t 0.396 (0.418)] [data_t 0.015] [optim_t 0.381] [lr 0.001033] [CE 4.571 (4.823)] [KD 0.000 (0.000)] 2024-10-11 09:11:49,804 - Train: 2.30% [8650/375300] [6.9/300.0] [batch_t 0.485 (0.425)] [data_t 0.015] [optim_t 0.470] [lr 0.001039] [CE 4.534 (4.813)] [KD 0.000 (0.000)] 2024-10-11 09:12:11,099 - Train: 2.32% [8700/375300] [7.0/300.0] [batch_t 0.447 (0.426)] [data_t 0.015] [optim_t 0.431] [lr 0.001045] [CE 4.877 (4.877)] [KD 0.000 (0.000)] 2024-10-11 09:12:31,636 - Train: 2.33% [8750/375300] [7.0/300.0] [batch_t 0.307 (0.411)] [data_t 0.015] [optim_t 0.292] [lr 0.001051] [CE 4.519 (4.799)] [KD 0.000 (0.000)] 2024-10-11 09:12:33,789 - ==> Total time: 1:02:34 Eta: 1 day, 19:39:04 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 09:12:55,378 - Train: 2.34% [8800/375300] [7.0/300.0] [batch_t 0.307 (0.475)] [data_t 0.015] [optim_t 0.292] [lr 0.001057] [CE 4.895 (4.814)] [KD 0.000 (0.000)] 2024-10-11 09:13:15,614 - Train: 2.36% [8850/375300] [7.1/300.0] [batch_t 0.373 (0.405)] [data_t 0.021] [optim_t 0.352] [lr 0.001063] [CE 5.048 (4.816)] [KD 0.000 (0.000)] 2024-10-11 09:13:36,943 - Train: 2.37% [8900/375300] [7.1/300.0] [batch_t 0.466 (0.426)] [data_t 0.015] [optim_t 0.450] [lr 0.001069] [CE 4.595 (4.807)] [KD 0.000 (0.000)] 2024-10-11 09:13:58,637 - Train: 2.38% [8950/375300] [7.2/300.0] [batch_t 0.306 (0.434)] [data_t 0.015] [optim_t 0.291] [lr 0.001075] [CE 5.068 (4.773)] [KD 0.000 (0.000)] 2024-10-11 09:14:20,056 - Train: 2.40% [9000/375300] [7.2/300.0] [batch_t 0.453 (0.428)] [data_t 0.015] [optim_t 0.438] [lr 0.001081] [CE 4.727 (4.847)] [KD 0.000 (0.000)] 2024-10-11 09:14:41,637 - Train: 2.41% [9050/375300] [7.2/300.0] [batch_t 0.447 (0.432)] [data_t 0.015] [optim_t 0.431] [lr 0.001087] [CE 4.308 (4.852)] [KD 0.000 (0.000)] 2024-10-11 09:15:02,968 - Train: 2.42% [9100/375300] [7.3/300.0] [batch_t 0.504 (0.427)] [data_t 0.015] [optim_t 0.489] [lr 0.001093] [CE 4.766 (4.776)] [KD 0.000 (0.000)] 2024-10-11 09:15:24,430 - Train: 2.44% [9150/375300] [7.3/300.0] [batch_t 0.432 (0.429)] [data_t 0.015] [optim_t 0.416] [lr 0.001099] [CE 4.585 (4.725)] [KD 0.000 (0.000)] 2024-10-11 09:15:45,041 - Train: 2.45% [9200/375300] [7.4/300.0] [batch_t 0.362 (0.412)] [data_t 0.015] [optim_t 0.347] [lr 0.001105] [CE 4.745 (4.756)] [KD 0.000 (0.000)] 2024-10-11 09:16:04,954 - Train: 2.46% [9250/375300] [7.4/300.0] [batch_t 0.388 (0.398)] [data_t 0.015] [optim_t 0.373] [lr 0.001111] [CE 4.724 (4.738)] [KD 0.000 (0.000)] 2024-10-11 09:16:25,064 - Train: 2.48% [9300/375300] [7.4/300.0] [batch_t 0.392 (0.402)] [data_t 0.015] [optim_t 0.377] [lr 0.001117] [CE 4.857 (4.834)] [KD 0.000 (0.000)] 2024-10-11 09:16:44,971 - Train: 2.49% [9350/375300] [7.5/300.0] [batch_t 0.365 (0.398)] [data_t 0.015] [optim_t 0.350] [lr 0.001123] [CE 4.931 (4.799)] [KD 0.000 (0.000)] 2024-10-11 09:17:06,271 - Train: 2.50% [9400/375300] [7.5/300.0] [batch_t 0.414 (0.426)] [data_t 0.126] [optim_t 0.288] [lr 0.001129] [CE 4.913 (4.778)] [KD 0.000 (0.000)] 2024-10-11 09:17:27,639 - Train: 2.52% [9450/375300] [7.6/300.0] [batch_t 0.375 (0.427)] [data_t 0.085] [optim_t 0.290] [lr 0.001135] [CE 4.427 (4.777)] [KD 0.000 (0.000)] 2024-10-11 09:17:48,854 - Train: 2.53% [9500/375300] [7.6/300.0] [batch_t 0.445 (0.424)] [data_t 0.154] [optim_t 0.291] [lr 0.001141] [CE 5.081 (4.799)] [KD 0.000 (0.000)] 2024-10-11 09:18:09,701 - Train: 2.54% [9550/375300] [7.6/300.0] [batch_t 0.451 (0.417)] [data_t 0.163] [optim_t 0.288] [lr 0.001147] [CE 4.686 (4.727)] [KD 0.000 (0.000)] 2024-10-11 09:18:30,563 - Train: 2.56% [9600/375300] [7.7/300.0] [batch_t 0.425 (0.417)] [data_t 0.136] [optim_t 0.289] [lr 0.001153] [CE 4.749 (4.703)] [KD 0.000 (0.000)] 2024-10-11 09:18:51,667 - Train: 2.57% [9650/375300] [7.7/300.0] [batch_t 0.403 (0.422)] [data_t 0.114] [optim_t 0.290] [lr 0.001159] [CE 4.632 (4.737)] [KD 0.000 (0.000)] 2024-10-11 09:19:12,543 - Train: 2.58% [9700/375300] [7.8/300.0] [batch_t 0.419 (0.417)] [data_t 0.128] [optim_t 0.291] [lr 0.001165] [CE 4.502 (4.714)] [KD 0.000 (0.000)] 2024-10-11 09:19:33,999 - Train: 2.60% [9750/375300] [7.8/300.0] [batch_t 0.489 (0.429)] [data_t 0.198] [optim_t 0.290] [lr 0.001171] [CE 4.525 (4.738)] [KD 0.000 (0.000)] 2024-10-11 09:19:54,929 - Train: 2.61% [9800/375300] [7.8/300.0] [batch_t 0.406 (0.418)] [data_t 0.115] [optim_t 0.291] [lr 0.001177] [CE 4.642 (4.729)] [KD 0.000 (0.000)] 2024-10-11 09:20:16,047 - Train: 2.62% [9850/375300] [7.9/300.0] [batch_t 0.468 (0.422)] [data_t 0.181] [optim_t 0.288] [lr 0.001183] [CE 4.695 (4.681)] [KD 0.000 (0.000)] 2024-10-11 09:20:37,142 - Train: 2.64% [9900/375300] [7.9/300.0] [batch_t 0.421 (0.422)] [data_t 0.134] [optim_t 0.287] [lr 0.001189] [CE 5.082 (4.752)] [KD 0.000 (0.000)] 2024-10-11 09:20:58,333 - Train: 2.65% [9950/375300] [8.0/300.0] [batch_t 0.472 (0.424)] [data_t 0.184] [optim_t 0.288] [lr 0.001195] [CE 4.562 (4.717)] [KD 0.000 (0.000)] 2024-10-11 09:21:19,039 - Train: 2.66% [10000/375300] [8.0/300.0] [batch_t 0.308 (0.414)] [data_t 0.015] [optim_t 0.292] [lr 0.001201] [CE 4.771 (4.722)] [KD 0.000 (0.000)] 2024-10-11 09:21:21,491 - ==> Total time: 1:11:22 Eta: 1 day, 19:24:53 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 09:21:42,942 - Train: 2.68% [10050/375300] [8.0/300.0] [batch_t 0.443 (0.476)] [data_t 0.015] [optim_t 0.428] [lr 0.001207] [CE 4.616 (4.711)] [KD 0.000 (0.000)] 2024-10-11 09:22:03,931 - Train: 2.69% [10100/375300] [8.1/300.0] [batch_t 0.417 (0.420)] [data_t 0.015] [optim_t 0.402] [lr 0.001213] [CE 4.838 (4.675)] [KD 0.000 (0.000)] 2024-10-11 09:22:25,795 - Train: 2.70% [10150/375300] [8.1/300.0] [batch_t 0.470 (0.437)] [data_t 0.015] [optim_t 0.455] [lr 0.001219] [CE 4.690 (4.634)] [KD 0.000 (0.000)] 2024-10-11 09:22:47,028 - Train: 2.72% [10200/375300] [8.2/300.0] [batch_t 0.502 (0.425)] [data_t 0.015] [optim_t 0.487] [lr 0.001225] [CE 5.064 (4.668)] [KD 0.000 (0.000)] 2024-10-11 09:23:08,885 - Train: 2.73% [10250/375300] [8.2/300.0] [batch_t 0.483 (0.437)] [data_t 0.015] [optim_t 0.467] [lr 0.001231] [CE 4.556 (4.657)] [KD 0.000 (0.000)] 2024-10-11 09:23:30,632 - Train: 2.74% [10300/375300] [8.2/300.0] [batch_t 0.494 (0.435)] [data_t 0.015] [optim_t 0.479] [lr 0.001237] [CE 4.735 (4.680)] [KD 0.000 (0.000)] 2024-10-11 09:23:52,382 - Train: 2.76% [10350/375300] [8.3/300.0] [batch_t 0.456 (0.435)] [data_t 0.015] [optim_t 0.441] [lr 0.001243] [CE 4.453 (4.723)] [KD 0.000 (0.000)] 2024-10-11 09:24:13,913 - Train: 2.77% [10400/375300] [8.3/300.0] [batch_t 0.430 (0.431)] [data_t 0.015] [optim_t 0.415] [lr 0.001249] [CE 4.640 (4.653)] [KD 0.000 (0.000)] 2024-10-11 09:24:35,576 - Train: 2.78% [10450/375300] [8.4/300.0] [batch_t 0.442 (0.433)] [data_t 0.015] [optim_t 0.427] [lr 0.001255] [CE 4.774 (4.700)] [KD 0.000 (0.000)] 2024-10-11 09:24:57,201 - Train: 2.80% [10500/375300] [8.4/300.0] [batch_t 0.410 (0.432)] [data_t 0.015] [optim_t 0.395] [lr 0.001261] [CE 4.819 (4.618)] [KD 0.000 (0.000)] 2024-10-11 09:25:18,876 - Train: 2.81% [10550/375300] [8.4/300.0] [batch_t 0.460 (0.433)] [data_t 0.015] [optim_t 0.444] [lr 0.001267] [CE 4.631 (4.690)] [KD 0.000 (0.000)] 2024-10-11 09:25:40,620 - Train: 2.82% [10600/375300] [8.5/300.0] [batch_t 0.445 (0.435)] [data_t 0.015] [optim_t 0.429] [lr 0.001273] [CE 4.658 (4.649)] [KD 0.000 (0.000)] 2024-10-11 09:26:02,337 - Train: 2.84% [10650/375300] [8.5/300.0] [batch_t 0.447 (0.434)] [data_t 0.015] [optim_t 0.432] [lr 0.001279] [CE 4.567 (4.667)] [KD 0.000 (0.000)] 2024-10-11 09:26:23,737 - Train: 2.85% [10700/375300] [8.6/300.0] [batch_t 0.353 (0.428)] [data_t 0.015] [optim_t 0.338] [lr 0.001285] [CE 4.635 (4.739)] [KD 0.000 (0.000)] 2024-10-11 09:26:44,567 - Train: 2.86% [10750/375300] [8.6/300.0] [batch_t 0.374 (0.417)] [data_t 0.015] [optim_t 0.359] [lr 0.001291] [CE 4.602 (4.665)] [KD 0.000 (0.000)] 2024-10-11 09:27:05,369 - Train: 2.88% [10800/375300] [8.6/300.0] [batch_t 0.470 (0.416)] [data_t 0.015] [optim_t 0.455] [lr 0.001297] [CE 4.525 (4.667)] [KD 0.000 (0.000)] 2024-10-11 09:27:26,161 - Train: 2.89% [10850/375300] [8.7/300.0] [batch_t 0.424 (0.416)] [data_t 0.015] [optim_t 0.409] [lr 0.001303] [CE 4.557 (4.648)] [KD 0.000 (0.000)] 2024-10-11 09:27:46,813 - Train: 2.90% [10900/375300] [8.7/300.0] [batch_t 0.424 (0.413)] [data_t 0.015] [optim_t 0.409] [lr 0.001309] [CE 4.405 (4.619)] [KD 0.000 (0.000)] 2024-10-11 09:28:07,711 - Train: 2.92% [10950/375300] [8.8/300.0] [batch_t 0.346 (0.418)] [data_t 0.015] [optim_t 0.331] [lr 0.001315] [CE 4.484 (4.667)] [KD 0.000 (0.000)] 2024-10-11 09:28:28,583 - Train: 2.93% [11000/375300] [8.8/300.0] [batch_t 0.451 (0.417)] [data_t 0.015] [optim_t 0.436] [lr 0.001321] [CE 4.459 (4.616)] [KD 0.000 (0.000)] 2024-10-11 09:28:49,687 - Train: 2.94% [11050/375300] [8.8/300.0] [batch_t 0.409 (0.422)] [data_t 0.015] [optim_t 0.394] [lr 0.001326] [CE 4.590 (4.640)] [KD 0.000 (0.000)] 2024-10-11 09:29:10,690 - Train: 2.96% [11100/375300] [8.9/300.0] [batch_t 0.412 (0.420)] [data_t 0.015] [optim_t 0.397] [lr 0.001332] [CE 4.564 (4.654)] [KD 0.000 (0.000)] 2024-10-11 09:29:31,647 - Train: 2.97% [11150/375300] [8.9/300.0] [batch_t 0.405 (0.419)] [data_t 0.015] [optim_t 0.390] [lr 0.001338] [CE 5.128 (4.623)] [KD 0.000 (0.000)] 2024-10-11 09:29:52,341 - Train: 2.98% [11200/375300] [9.0/300.0] [batch_t 0.382 (0.414)] [data_t 0.015] [optim_t 0.367] [lr 0.001344] [CE 4.829 (4.673)] [KD 0.000 (0.000)] 2024-10-11 09:30:13,114 - Train: 3.00% [11250/375300] [9.0/300.0] [batch_t 0.305 (0.415)] [data_t 0.015] [optim_t 0.290] [lr 0.001350] [CE 4.166 (4.645)] [KD 0.000 (0.000)] 2024-10-11 09:30:15,861 - ==> Total time: 1:20:16 Eta: 1 day, 19:15:29 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 09:30:36,732 - Train: 3.01% [11300/375300] [9.0/300.0] [batch_t 0.385 (0.465)] [data_t 0.095] [optim_t 0.290] [lr 0.001356] [CE 4.510 (4.614)] [KD 0.000 (0.000)] 2024-10-11 09:30:57,607 - Train: 3.02% [11350/375300] [9.1/300.0] [batch_t 0.307 (0.417)] [data_t 0.015] [optim_t 0.291] [lr 0.001362] [CE 4.686 (4.623)] [KD 0.000 (0.000)] 2024-10-11 09:31:18,658 - Train: 3.04% [11400/375300] [9.1/300.0] [batch_t 0.388 (0.421)] [data_t 0.099] [optim_t 0.290] [lr 0.001368] [CE 4.630 (4.569)] [KD 0.000 (0.000)] 2024-10-11 09:31:39,830 - Train: 3.05% [11450/375300] [9.2/300.0] [batch_t 0.544 (0.423)] [data_t 0.252] [optim_t 0.291] [lr 0.001374] [CE 4.892 (4.589)] [KD 0.000 (0.000)] 2024-10-11 09:32:00,894 - Train: 3.06% [11500/375300] [9.2/300.0] [batch_t 0.426 (0.421)] [data_t 0.138] [optim_t 0.288] [lr 0.001380] [CE 4.428 (4.589)] [KD 0.000 (0.000)] 2024-10-11 09:32:21,787 - Train: 3.08% [11550/375300] [9.2/300.0] [batch_t 0.382 (0.418)] [data_t 0.093] [optim_t 0.289] [lr 0.001386] [CE 4.435 (4.586)] [KD 0.000 (0.000)] 2024-10-11 09:32:42,512 - Train: 3.09% [11600/375300] [9.3/300.0] [batch_t 0.435 (0.414)] [data_t 0.148] [optim_t 0.287] [lr 0.001392] [CE 4.456 (4.584)] [KD 0.000 (0.000)] 2024-10-11 09:33:03,611 - Train: 3.10% [11650/375300] [9.3/300.0] [batch_t 0.431 (0.422)] [data_t 0.140] [optim_t 0.290] [lr 0.001398] [CE 4.140 (4.578)] [KD 0.000 (0.000)] 2024-10-11 09:33:24,591 - Train: 3.12% [11700/375300] [9.4/300.0] [batch_t 0.392 (0.420)] [data_t 0.101] [optim_t 0.290] [lr 0.001404] [CE 4.972 (4.558)] [KD 0.000 (0.000)] 2024-10-11 09:33:45,402 - Train: 3.13% [11750/375300] [9.4/300.0] [batch_t 0.394 (0.416)] [data_t 0.103] [optim_t 0.290] [lr 0.001410] [CE 5.030 (4.575)] [KD 0.000 (0.000)] 2024-10-11 09:34:06,812 - Train: 3.14% [11800/375300] [9.4/300.0] [batch_t 0.397 (0.428)] [data_t 0.107] [optim_t 0.290] [lr 0.001416] [CE 4.761 (4.591)] [KD 0.000 (0.000)] 2024-10-11 09:34:28,403 - Train: 3.16% [11850/375300] [9.5/300.0] [batch_t 0.454 (0.432)] [data_t 0.165] [optim_t 0.290] [lr 0.001422] [CE 4.656 (4.556)] [KD 0.000 (0.000)] 2024-10-11 09:34:49,643 - Train: 3.17% [11900/375300] [9.5/300.0] [batch_t 0.408 (0.425)] [data_t 0.120] [optim_t 0.288] [lr 0.001428] [CE 4.665 (4.574)] [KD 0.000 (0.000)] 2024-10-11 09:35:10,946 - Train: 3.18% [11950/375300] [9.6/300.0] [batch_t 0.307 (0.426)] [data_t 0.015] [optim_t 0.292] [lr 0.001434] [CE 4.538 (4.565)] [KD 0.000 (0.000)] 2024-10-11 09:35:32,606 - Train: 3.20% [12000/375300] [9.6/300.0] [batch_t 0.469 (0.433)] [data_t 0.181] [optim_t 0.288] [lr 0.001440] [CE 4.816 (4.618)] [KD 0.000 (0.000)] 2024-10-11 09:35:53,648 - Train: 3.21% [12050/375300] [9.6/300.0] [batch_t 0.464 (0.421)] [data_t 0.177] [optim_t 0.287] [lr 0.001446] [CE 4.773 (4.556)] [KD 0.000 (0.000)] 2024-10-11 09:36:14,844 - Train: 3.22% [12100/375300] [9.7/300.0] [batch_t 0.402 (0.424)] [data_t 0.115] [optim_t 0.287] [lr 0.001452] [CE 4.661 (4.531)] [KD 0.000 (0.000)] 2024-10-11 09:36:36,008 - Train: 3.24% [12150/375300] [9.7/300.0] [batch_t 0.390 (0.423)] [data_t 0.102] [optim_t 0.288] [lr 0.001458] [CE 4.610 (4.606)] [KD 0.000 (0.000)] 2024-10-11 09:36:57,242 - Train: 3.25% [12200/375300] [9.8/300.0] [batch_t 0.485 (0.425)] [data_t 0.196] [optim_t 0.290] [lr 0.001464] [CE 4.768 (4.584)] [KD 0.000 (0.000)] 2024-10-11 09:37:18,394 - Train: 3.26% [12250/375300] [9.8/300.0] [batch_t 0.496 (0.423)] [data_t 0.208] [optim_t 0.288] [lr 0.001470] [CE 4.651 (4.590)] [KD 0.000 (0.000)] 2024-10-11 09:37:39,734 - Train: 3.28% [12300/375300] [9.8/300.0] [batch_t 0.414 (0.427)] [data_t 0.124] [optim_t 0.291] [lr 0.001476] [CE 4.138 (4.568)] [KD 0.000 (0.000)] 2024-10-11 09:38:01,123 - Train: 3.29% [12350/375300] [9.9/300.0] [batch_t 0.403 (0.428)] [data_t 0.113] [optim_t 0.290] [lr 0.001482] [CE 4.570 (4.569)] [KD 0.000 (0.000)] 2024-10-11 09:38:22,461 - Train: 3.30% [12400/375300] [9.9/300.0] [batch_t 0.428 (0.427)] [data_t 0.139] [optim_t 0.289] [lr 0.001488] [CE 4.496 (4.566)] [KD 0.000 (0.000)] 2024-10-11 09:38:43,541 - Train: 3.32% [12450/375300] [10.0/300.0] [batch_t 0.373 (0.422)] [data_t 0.082] [optim_t 0.291] [lr 0.001494] [CE 4.286 (4.491)] [KD 0.000 (0.000)] 2024-10-11 09:39:03,847 - Train: 3.33% [12500/375300] [10.0/300.0] [batch_t 0.304 (0.406)] [data_t 0.015] [optim_t 0.289] [lr 0.001500] [CE 5.034 (4.559)] [KD 0.000 (0.000)] 2024-10-11 09:39:27,038 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.399)] [top1_cnt 28177] [top5_cnt 40488] [top_all 50000] 2024-10-11 09:39:27,039 - net: 56.354 (80.976) 2024-10-11 09:39:47,976 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.412)] [top1_cnt 917] [top5_cnt 2999] [top_all 50000] 2024-10-11 09:39:47,977 - net_E: 1.834 (5.998) 2024-10-11 09:39:48,135 - Max [top1: 56.354 (epoch: 10)] [top1-ema: 1.834 (epoch: 10)] 2024-10-11 09:39:48,135 - ==> Total time: 1:29:48 Eta: 1 day, 19:24:30 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 09:40:10,069 - Train: 3.34% [12550/375300] [10.0/300.0] [batch_t 0.306 (0.403)] [data_t 0.015] [optim_t 0.291] [lr 0.001506] [CE 4.896 (4.565)] [KD 0.000 (0.000)] 2024-10-11 09:40:31,082 - Train: 3.36% [12600/375300] [10.1/300.0] [batch_t 0.398 (0.420)] [data_t 0.109] [optim_t 0.289] [lr 0.001512] [CE 4.696 (4.521)] [KD 0.000 (0.000)] 2024-10-11 09:40:52,260 - Train: 3.37% [12650/375300] [10.1/300.0] [batch_t 0.466 (0.423)] [data_t 0.179] [optim_t 0.287] [lr 0.001518] [CE 4.103 (4.501)] [KD 0.000 (0.000)] 2024-10-11 09:41:13,309 - Train: 3.38% [12700/375300] [10.2/300.0] [batch_t 0.371 (0.421)] [data_t 0.080] [optim_t 0.292] [lr 0.001524] [CE 4.356 (4.541)] [KD 0.000 (0.000)] 2024-10-11 09:41:34,361 - Train: 3.40% [12750/375300] [10.2/300.0] [batch_t 0.438 (0.421)] [data_t 0.146] [optim_t 0.291] [lr 0.001530] [CE 4.606 (4.544)] [KD 0.000 (0.000)] 2024-10-11 09:41:55,275 - Train: 3.41% [12800/375300] [10.2/300.0] [batch_t 0.434 (0.418)] [data_t 0.144] [optim_t 0.290] [lr 0.001536] [CE 4.589 (4.511)] [KD 0.000 (0.000)] 2024-10-11 09:42:16,464 - Train: 3.42% [12850/375300] [10.3/300.0] [batch_t 0.335 (0.424)] [data_t 0.047] [optim_t 0.288] [lr 0.001542] [CE 4.333 (4.498)] [KD 0.000 (0.000)] 2024-10-11 09:42:37,664 - Train: 3.44% [12900/375300] [10.3/300.0] [batch_t 0.377 (0.424)] [data_t 0.086] [optim_t 0.291] [lr 0.001548] [CE 4.343 (4.508)] [KD 0.000 (0.000)] 2024-10-11 09:42:58,877 - Train: 3.45% [12950/375300] [10.4/300.0] [batch_t 0.405 (0.424)] [data_t 0.115] [optim_t 0.290] [lr 0.001554] [CE 4.430 (4.505)] [KD 0.000 (0.000)] 2024-10-11 09:43:19,894 - Train: 3.46% [13000/375300] [10.4/300.0] [batch_t 0.450 (0.420)] [data_t 0.158] [optim_t 0.293] [lr 0.001560] [CE 4.438 (4.554)] [KD 0.000 (0.000)] 2024-10-11 09:43:40,868 - Train: 3.48% [13050/375300] [10.4/300.0] [batch_t 0.374 (0.419)] [data_t 0.084] [optim_t 0.290] [lr 0.001566] [CE 4.385 (4.517)] [KD 0.000 (0.000)] 2024-10-11 09:44:02,116 - Train: 3.49% [13100/375300] [10.5/300.0] [batch_t 0.482 (0.425)] [data_t 0.192] [optim_t 0.290] [lr 0.001572] [CE 4.562 (4.493)] [KD 0.000 (0.000)] 2024-10-11 09:44:22,690 - Train: 3.50% [13150/375300] [10.5/300.0] [batch_t 0.446 (0.411)] [data_t 0.156] [optim_t 0.290] [lr 0.001578] [CE 4.261 (4.475)] [KD 0.000 (0.000)] 2024-10-11 09:44:43,822 - Train: 3.52% [13200/375300] [10.6/300.0] [batch_t 0.436 (0.423)] [data_t 0.146] [optim_t 0.290] [lr 0.001584] [CE 4.538 (4.484)] [KD 0.000 (0.000)] 2024-10-11 09:45:04,683 - Train: 3.53% [13250/375300] [10.6/300.0] [batch_t 0.419 (0.417)] [data_t 0.130] [optim_t 0.289] [lr 0.001590] [CE 4.244 (4.450)] [KD 0.000 (0.000)] 2024-10-11 09:45:25,430 - Train: 3.54% [13300/375300] [10.6/300.0] [batch_t 0.488 (0.415)] [data_t 0.197] [optim_t 0.291] [lr 0.001596] [CE 4.660 (4.497)] [KD 0.000 (0.000)] 2024-10-11 09:45:46,249 - Train: 3.56% [13350/375300] [10.7/300.0] [batch_t 0.419 (0.416)] [data_t 0.128] [optim_t 0.290] [lr 0.001602] [CE 4.534 (4.519)] [KD 0.000 (0.000)] 2024-10-11 09:46:07,229 - Train: 3.57% [13400/375300] [10.7/300.0] [batch_t 0.431 (0.419)] [data_t 0.142] [optim_t 0.289] [lr 0.001608] [CE 4.322 (4.476)] [KD 0.000 (0.000)] 2024-10-11 09:46:27,782 - Train: 3.58% [13450/375300] [10.8/300.0] [batch_t 0.384 (0.411)] [data_t 0.095] [optim_t 0.289] [lr 0.001614] [CE 4.573 (4.476)] [KD 0.000 (0.000)] 2024-10-11 09:46:48,939 - Train: 3.60% [13500/375300] [10.8/300.0] [batch_t 0.444 (0.423)] [data_t 0.015] [optim_t 0.429] [lr 0.001620] [CE 4.312 (4.485)] [KD 0.000 (0.000)] 2024-10-11 09:47:10,322 - Train: 3.61% [13550/375300] [10.8/300.0] [batch_t 0.433 (0.428)] [data_t 0.015] [optim_t 0.418] [lr 0.001626] [CE 4.838 (4.492)] [KD 0.000 (0.000)] 2024-10-11 09:47:31,381 - Train: 3.62% [13600/375300] [10.9/300.0] [batch_t 0.419 (0.421)] [data_t 0.015] [optim_t 0.404] [lr 0.001632] [CE 4.101 (4.462)] [KD 0.000 (0.000)] 2024-10-11 09:47:53,043 - Train: 3.64% [13650/375300] [10.9/300.0] [batch_t 0.463 (0.433)] [data_t 0.016] [optim_t 0.448] [lr 0.001638] [CE 4.745 (4.494)] [KD 0.000 (0.000)] 2024-10-11 09:48:14,351 - Train: 3.65% [13700/375300] [11.0/300.0] [batch_t 0.438 (0.426)] [data_t 0.015] [optim_t 0.422] [lr 0.001644] [CE 4.478 (4.484)] [KD 0.000 (0.000)] 2024-10-11 09:48:34,640 - Train: 3.66% [13750/375300] [11.0/300.0] [batch_t 0.319 (0.406)] [data_t 0.015] [optim_t 0.304] [lr 0.001650] [CE 4.512 (4.493)] [KD 0.000 (0.000)] 2024-10-11 09:48:38,077 - ==> Total time: 1:38:38 Eta: 1 day, 19:11:37 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 09:48:58,435 - Train: 3.68% [13800/375300] [11.0/300.0] [batch_t 0.432 (0.486)] [data_t 0.144] [optim_t 0.288] [lr 0.001656] [CE 4.835 (4.387)] [KD 0.000 (0.000)] 2024-10-11 09:49:19,472 - Train: 3.69% [13850/375300] [11.1/300.0] [batch_t 0.409 (0.421)] [data_t 0.121] [optim_t 0.288] [lr 0.001662] [CE 4.303 (4.473)] [KD 0.000 (0.000)] 2024-10-11 09:49:40,829 - Train: 3.70% [13900/375300] [11.1/300.0] [batch_t 0.436 (0.427)] [data_t 0.147] [optim_t 0.289] [lr 0.001668] [CE 4.287 (4.468)] [KD 0.000 (0.000)] 2024-10-11 09:50:02,080 - Train: 3.72% [13950/375300] [11.2/300.0] [batch_t 0.352 (0.425)] [data_t 0.058] [optim_t 0.294] [lr 0.001674] [CE 4.582 (4.463)] [KD 0.000 (0.000)] 2024-10-11 09:50:23,354 - Train: 3.73% [14000/375300] [11.2/300.0] [batch_t 0.388 (0.425)] [data_t 0.097] [optim_t 0.291] [lr 0.001680] [CE 4.691 (4.429)] [KD 0.000 (0.000)] 2024-10-11 09:50:44,734 - Train: 3.74% [14050/375300] [11.2/300.0] [batch_t 0.388 (0.427)] [data_t 0.096] [optim_t 0.291] [lr 0.001686] [CE 4.030 (4.462)] [KD 0.000 (0.000)] 2024-10-11 09:51:05,835 - Train: 3.76% [14100/375300] [11.3/300.0] [batch_t 0.458 (0.422)] [data_t 0.167] [optim_t 0.291] [lr 0.001692] [CE 4.636 (4.420)] [KD 0.000 (0.000)] 2024-10-11 09:51:27,314 - Train: 3.77% [14150/375300] [11.3/300.0] [batch_t 0.389 (0.429)] [data_t 0.099] [optim_t 0.290] [lr 0.001698] [CE 4.408 (4.512)] [KD 0.000 (0.000)] 2024-10-11 09:51:48,263 - Train: 3.78% [14200/375300] [11.4/300.0] [batch_t 0.446 (0.419)] [data_t 0.153] [optim_t 0.292] [lr 0.001704] [CE 4.419 (4.432)] [KD 0.000 (0.000)] 2024-10-11 09:52:09,248 - Train: 3.80% [14250/375300] [11.4/300.0] [batch_t 0.439 (0.420)] [data_t 0.148] [optim_t 0.291] [lr 0.001710] [CE 4.880 (4.458)] [KD 0.000 (0.000)] 2024-10-11 09:52:30,475 - Train: 3.81% [14300/375300] [11.4/300.0] [batch_t 0.379 (0.424)] [data_t 0.085] [optim_t 0.293] [lr 0.001716] [CE 4.465 (4.457)] [KD 0.000 (0.000)] 2024-10-11 09:52:51,655 - Train: 3.82% [14350/375300] [11.5/300.0] [batch_t 0.405 (0.423)] [data_t 0.015] [optim_t 0.390] [lr 0.001722] [CE 4.812 (4.485)] [KD 0.000 (0.000)] 2024-10-11 09:53:12,966 - Train: 3.84% [14400/375300] [11.5/300.0] [batch_t 0.533 (0.426)] [data_t 0.015] [optim_t 0.518] [lr 0.001728] [CE 3.885 (4.480)] [KD 0.000 (0.000)] 2024-10-11 09:53:34,101 - Train: 3.85% [14450/375300] [11.6/300.0] [batch_t 0.437 (0.423)] [data_t 0.015] [optim_t 0.422] [lr 0.001734] [CE 4.472 (4.469)] [KD 0.000 (0.000)] 2024-10-11 09:53:55,552 - Train: 3.86% [14500/375300] [11.6/300.0] [batch_t 0.421 (0.429)] [data_t 0.015] [optim_t 0.406] [lr 0.001740] [CE 4.417 (4.483)] [KD 0.000 (0.000)] 2024-10-11 09:54:16,614 - Train: 3.88% [14550/375300] [11.6/300.0] [batch_t 0.435 (0.421)] [data_t 0.015] [optim_t 0.419] [lr 0.001746] [CE 4.242 (4.449)] [KD 0.000 (0.000)] 2024-10-11 09:54:37,911 - Train: 3.89% [14600/375300] [11.7/300.0] [batch_t 0.427 (0.426)] [data_t 0.015] [optim_t 0.412] [lr 0.001752] [CE 4.537 (4.473)] [KD 0.000 (0.000)] 2024-10-11 09:54:59,321 - Train: 3.90% [14650/375300] [11.7/300.0] [batch_t 0.447 (0.428)] [data_t 0.015] [optim_t 0.432] [lr 0.001758] [CE 4.779 (4.464)] [KD 0.000 (0.000)] 2024-10-11 09:55:20,891 - Train: 3.92% [14700/375300] [11.8/300.0] [batch_t 0.398 (0.431)] [data_t 0.015] [optim_t 0.382] [lr 0.001764] [CE 4.308 (4.468)] [KD 0.000 (0.000)] 2024-10-11 09:55:42,636 - Train: 3.93% [14750/375300] [11.8/300.0] [batch_t 0.397 (0.435)] [data_t 0.015] [optim_t 0.382] [lr 0.001770] [CE 4.522 (4.439)] [KD 0.000 (0.000)] 2024-10-11 09:56:03,784 - Train: 3.94% [14800/375300] [11.8/300.0] [batch_t 0.476 (0.423)] [data_t 0.015] [optim_t 0.461] [lr 0.001776] [CE 4.341 (4.446)] [KD 0.000 (0.000)] 2024-10-11 09:56:25,387 - Train: 3.96% [14850/375300] [11.9/300.0] [batch_t 0.493 (0.432)] [data_t 0.016] [optim_t 0.478] [lr 0.001782] [CE 4.248 (4.432)] [KD 0.000 (0.000)] 2024-10-11 09:56:46,159 - Train: 3.97% [14900/375300] [11.9/300.0] [batch_t 0.392 (0.415)] [data_t 0.015] [optim_t 0.376] [lr 0.001788] [CE 4.374 (4.457)] [KD 0.000 (0.000)] 2024-10-11 09:57:06,852 - Train: 3.98% [14950/375300] [12.0/300.0] [batch_t 0.356 (0.414)] [data_t 0.015] [optim_t 0.341] [lr 0.001794] [CE 4.643 (4.436)] [KD 0.000 (0.000)] 2024-10-11 09:57:28,104 - Train: 4.00% [15000/375300] [12.0/300.0] [batch_t 0.305 (0.425)] [data_t 0.015] [optim_t 0.290] [lr 0.001800] [CE 4.209 (4.439)] [KD 0.000 (0.000)] 2024-10-11 09:57:31,773 - ==> Total time: 1:47:32 Eta: 1 day, 19:00:54 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 09:57:51,073 - Train: 4.01% [15050/375300] [12.0/300.0] [batch_t 0.359 (0.471)] [data_t 0.016] [optim_t 0.343] [lr 0.001806] [CE 4.734 (4.470)] [KD 0.000 (0.000)] 2024-10-11 09:58:11,754 - Train: 4.02% [15100/375300] [12.1/300.0] [batch_t 0.405 (0.413)] [data_t 0.015] [optim_t 0.389] [lr 0.001812] [CE 4.532 (4.422)] [KD 0.000 (0.000)] 2024-10-11 09:58:32,332 - Train: 4.04% [15150/375300] [12.1/300.0] [batch_t 0.402 (0.411)] [data_t 0.015] [optim_t 0.386] [lr 0.001818] [CE 3.879 (4.403)] [KD 0.000 (0.000)] 2024-10-11 09:58:52,818 - Train: 4.05% [15200/375300] [12.2/300.0] [batch_t 0.437 (0.410)] [data_t 0.015] [optim_t 0.422] [lr 0.001824] [CE 4.324 (4.382)] [KD 0.000 (0.000)] 2024-10-11 09:59:14,600 - Train: 4.06% [15250/375300] [12.2/300.0] [batch_t 0.458 (0.436)] [data_t 0.015] [optim_t 0.443] [lr 0.001830] [CE 4.278 (4.427)] [KD 0.000 (0.000)] 2024-10-11 09:59:36,057 - Train: 4.08% [15300/375300] [12.2/300.0] [batch_t 0.427 (0.429)] [data_t 0.015] [optim_t 0.412] [lr 0.001836] [CE 4.299 (4.473)] [KD 0.000 (0.000)] 2024-10-11 09:59:57,121 - Train: 4.09% [15350/375300] [12.3/300.0] [batch_t 0.391 (0.421)] [data_t 0.015] [optim_t 0.375] [lr 0.001842] [CE 4.245 (4.436)] [KD 0.000 (0.000)] 2024-10-11 10:00:17,905 - Train: 4.10% [15400/375300] [12.3/300.0] [batch_t 0.356 (0.416)] [data_t 0.015] [optim_t 0.340] [lr 0.001848] [CE 4.817 (4.421)] [KD 0.000 (0.000)] 2024-10-11 10:00:38,339 - Train: 4.12% [15450/375300] [12.4/300.0] [batch_t 0.486 (0.409)] [data_t 0.015] [optim_t 0.470] [lr 0.001854] [CE 4.203 (4.365)] [KD 0.000 (0.000)] 2024-10-11 10:00:59,151 - Train: 4.13% [15500/375300] [12.4/300.0] [batch_t 0.365 (0.416)] [data_t 0.015] [optim_t 0.350] [lr 0.001860] [CE 4.260 (4.397)] [KD 0.000 (0.000)] 2024-10-11 10:01:19,858 - Train: 4.14% [15550/375300] [12.4/300.0] [batch_t 0.379 (0.414)] [data_t 0.016] [optim_t 0.364] [lr 0.001866] [CE 4.653 (4.476)] [KD 0.000 (0.000)] 2024-10-11 10:01:40,510 - Train: 4.16% [15600/375300] [12.5/300.0] [batch_t 0.392 (0.413)] [data_t 0.015] [optim_t 0.377] [lr 0.001872] [CE 4.234 (4.354)] [KD 0.000 (0.000)] 2024-10-11 10:02:01,427 - Train: 4.17% [15650/375300] [12.5/300.0] [batch_t 0.418 (0.418)] [data_t 0.015] [optim_t 0.402] [lr 0.001878] [CE 4.337 (4.379)] [KD 0.000 (0.000)] 2024-10-11 10:02:22,393 - Train: 4.18% [15700/375300] [12.5/300.0] [batch_t 0.443 (0.419)] [data_t 0.015] [optim_t 0.427] [lr 0.001883] [CE 4.208 (4.378)] [KD 0.000 (0.000)] 2024-10-11 10:02:43,106 - Train: 4.20% [15750/375300] [12.6/300.0] [batch_t 0.414 (0.414)] [data_t 0.015] [optim_t 0.399] [lr 0.001889] [CE 4.514 (4.383)] [KD 0.000 (0.000)] 2024-10-11 10:03:03,504 - Train: 4.21% [15800/375300] [12.6/300.0] [batch_t 0.434 (0.408)] [data_t 0.015] [optim_t 0.418] [lr 0.001895] [CE 4.226 (4.396)] [KD 0.000 (0.000)] 2024-10-11 10:03:24,743 - Train: 4.22% [15850/375300] [12.7/300.0] [batch_t 0.452 (0.425)] [data_t 0.015] [optim_t 0.437] [lr 0.001901] [CE 4.218 (4.403)] [KD 0.000 (0.000)] 2024-10-11 10:03:46,667 - Train: 4.24% [15900/375300] [12.7/300.0] [batch_t 0.310 (0.438)] [data_t 0.015] [optim_t 0.295] [lr 0.001907] [CE 4.427 (4.426)] [KD 0.000 (0.000)] 2024-10-11 10:04:07,975 - Train: 4.25% [15950/375300] [12.7/300.0] [batch_t 0.397 (0.426)] [data_t 0.015] [optim_t 0.382] [lr 0.001913] [CE 4.424 (4.391)] [KD 0.000 (0.000)] 2024-10-11 10:04:29,248 - Train: 4.26% [16000/375300] [12.8/300.0] [batch_t 0.471 (0.425)] [data_t 0.015] [optim_t 0.456] [lr 0.001919] [CE 4.341 (4.403)] [KD 0.000 (0.000)] 2024-10-11 10:04:48,519 - Train: 4.28% [16050/375300] [12.8/300.0] [batch_t 0.342 (0.385)] [data_t 0.015] [optim_t 0.326] [lr 0.001925] [CE 4.492 (4.370)] [KD 0.000 (0.000)] 2024-10-11 10:05:09,112 - Train: 4.29% [16100/375300] [12.9/300.0] [batch_t 0.464 (0.412)] [data_t 0.015] [optim_t 0.449] [lr 0.001931] [CE 4.228 (4.384)] [KD 0.000 (0.000)] 2024-10-11 10:05:29,986 - Train: 4.30% [16150/375300] [12.9/300.0] [batch_t 0.369 (0.417)] [data_t 0.015] [optim_t 0.353] [lr 0.001937] [CE 4.534 (4.381)] [KD 0.000 (0.000)] 2024-10-11 10:05:50,721 - Train: 4.32% [16200/375300] [12.9/300.0] [batch_t 0.451 (0.415)] [data_t 0.015] [optim_t 0.436] [lr 0.001943] [CE 4.034 (4.362)] [KD 0.000 (0.000)] 2024-10-11 10:06:12,457 - Train: 4.33% [16250/375300] [13.0/300.0] [batch_t 0.459 (0.435)] [data_t 0.015] [optim_t 0.444] [lr 0.001949] [CE 4.648 (4.403)] [KD 0.000 (0.000)] 2024-10-11 10:06:16,488 - ==> Total time: 1:56:17 Eta: 1 day, 18:47:10 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 10:06:35,545 - Train: 4.34% [16300/375300] [13.0/300.0] [batch_t 0.469 (0.480)] [data_t 0.015] [optim_t 0.453] [lr 0.001955] [CE 4.644 (4.324)] [KD 0.000 (0.000)] 2024-10-11 10:06:55,598 - Train: 4.36% [16350/375300] [13.1/300.0] [batch_t 0.426 (0.401)] [data_t 0.015] [optim_t 0.410] [lr 0.001961] [CE 4.703 (4.366)] [KD 0.000 (0.000)] 2024-10-11 10:07:16,571 - Train: 4.37% [16400/375300] [13.1/300.0] [batch_t 0.401 (0.419)] [data_t 0.015] [optim_t 0.385] [lr 0.001967] [CE 4.397 (4.324)] [KD 0.000 (0.000)] 2024-10-11 10:07:37,455 - Train: 4.38% [16450/375300] [13.1/300.0] [batch_t 0.413 (0.418)] [data_t 0.015] [optim_t 0.397] [lr 0.001973] [CE 4.201 (4.331)] [KD 0.000 (0.000)] 2024-10-11 10:07:58,315 - Train: 4.40% [16500/375300] [13.2/300.0] [batch_t 0.386 (0.417)] [data_t 0.015] [optim_t 0.371] [lr 0.001979] [CE 4.362 (4.429)] [KD 0.000 (0.000)] 2024-10-11 10:08:18,982 - Train: 4.41% [16550/375300] [13.2/300.0] [batch_t 0.426 (0.413)] [data_t 0.015] [optim_t 0.411] [lr 0.001985] [CE 4.749 (4.343)] [KD 0.000 (0.000)] 2024-10-11 10:08:39,798 - Train: 4.42% [16600/375300] [13.3/300.0] [batch_t 0.401 (0.416)] [data_t 0.015] [optim_t 0.385] [lr 0.001991] [CE 4.329 (4.336)] [KD 0.000 (0.000)] 2024-10-11 10:09:00,260 - Train: 4.44% [16650/375300] [13.3/300.0] [batch_t 0.400 (0.409)] [data_t 0.015] [optim_t 0.385] [lr 0.001997] [CE 4.548 (4.380)] [KD 0.000 (0.000)] 2024-10-11 10:09:20,733 - Train: 4.45% [16700/375300] [13.3/300.0] [batch_t 0.429 (0.409)] [data_t 0.015] [optim_t 0.413] [lr 0.002003] [CE 4.288 (4.327)] [KD 0.000 (0.000)] 2024-10-11 10:09:41,384 - Train: 4.46% [16750/375300] [13.4/300.0] [batch_t 0.364 (0.413)] [data_t 0.015] [optim_t 0.349] [lr 0.002009] [CE 4.238 (4.370)] [KD 0.000 (0.000)] 2024-10-11 10:10:02,157 - Train: 4.48% [16800/375300] [13.4/300.0] [batch_t 0.467 (0.415)] [data_t 0.015] [optim_t 0.452] [lr 0.002015] [CE 4.492 (4.342)] [KD 0.000 (0.000)] 2024-10-11 10:10:22,697 - Train: 4.49% [16850/375300] [13.5/300.0] [batch_t 0.438 (0.411)] [data_t 0.015] [optim_t 0.423] [lr 0.002021] [CE 4.768 (4.346)] [KD 0.000 (0.000)] 2024-10-11 10:10:43,289 - Train: 4.50% [16900/375300] [13.5/300.0] [batch_t 0.453 (0.412)] [data_t 0.015] [optim_t 0.438] [lr 0.002027] [CE 4.238 (4.361)] [KD 0.000 (0.000)] 2024-10-11 10:11:04,235 - Train: 4.52% [16950/375300] [13.5/300.0] [batch_t 0.375 (0.419)] [data_t 0.015] [optim_t 0.360] [lr 0.002033] [CE 4.361 (4.406)] [KD 0.000 (0.000)] 2024-10-11 10:11:25,223 - Train: 4.53% [17000/375300] [13.6/300.0] [batch_t 0.450 (0.420)] [data_t 0.015] [optim_t 0.435] [lr 0.002039] [CE 4.181 (4.366)] [KD 0.000 (0.000)] 2024-10-11 10:11:46,166 - Train: 4.54% [17050/375300] [13.6/300.0] [batch_t 0.435 (0.419)] [data_t 0.015] [optim_t 0.419] [lr 0.002045] [CE 4.616 (4.377)] [KD 0.000 (0.000)] 2024-10-11 10:12:06,929 - Train: 4.56% [17100/375300] [13.7/300.0] [batch_t 0.441 (0.415)] [data_t 0.015] [optim_t 0.426] [lr 0.002051] [CE 3.910 (4.331)] [KD 0.000 (0.000)] 2024-10-11 10:12:27,891 - Train: 4.57% [17150/375300] [13.7/300.0] [batch_t 0.410 (0.419)] [data_t 0.015] [optim_t 0.394] [lr 0.002057] [CE 4.574 (4.348)] [KD 0.000 (0.000)] 2024-10-11 10:12:49,115 - Train: 4.58% [17200/375300] [13.7/300.0] [batch_t 0.394 (0.424)] [data_t 0.015] [optim_t 0.379] [lr 0.002063] [CE 4.408 (4.369)] [KD 0.000 (0.000)] 2024-10-11 10:13:10,088 - Train: 4.60% [17250/375300] [13.8/300.0] [batch_t 0.448 (0.419)] [data_t 0.015] [optim_t 0.432] [lr 0.002069] [CE 4.135 (4.414)] [KD 0.000 (0.000)] 2024-10-11 10:13:31,033 - Train: 4.61% [17300/375300] [13.8/300.0] [batch_t 0.480 (0.419)] [data_t 0.015] [optim_t 0.464] [lr 0.002075] [CE 4.832 (4.368)] [KD 0.000 (0.000)] 2024-10-11 10:13:52,117 - Train: 4.62% [17350/375300] [13.9/300.0] [batch_t 0.403 (0.422)] [data_t 0.015] [optim_t 0.388] [lr 0.002081] [CE 4.177 (4.319)] [KD 0.000 (0.000)] 2024-10-11 10:14:13,457 - Train: 4.64% [17400/375300] [13.9/300.0] [batch_t 0.501 (0.427)] [data_t 0.016] [optim_t 0.486] [lr 0.002087] [CE 4.201 (4.343)] [KD 0.000 (0.000)] 2024-10-11 10:14:34,866 - Train: 4.65% [17450/375300] [13.9/300.0] [batch_t 0.443 (0.428)] [data_t 0.015] [optim_t 0.427] [lr 0.002093] [CE 4.452 (4.352)] [KD 0.000 (0.000)] 2024-10-11 10:14:56,123 - Train: 4.66% [17500/375300] [14.0/300.0] [batch_t 0.354 (0.425)] [data_t 0.015] [optim_t 0.339] [lr 0.002099] [CE 4.555 (4.411)] [KD 0.000 (0.000)] 2024-10-11 10:15:00,462 - ==> Total time: 2:05:00 Eta: 1 day, 18:33:54 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 10:15:19,071 - Train: 4.68% [17550/375300] [14.0/300.0] [batch_t 0.371 (0.475)] [data_t 0.015] [optim_t 0.356] [lr 0.002105] [CE 4.488 (4.383)] [KD 0.000 (0.000)] 2024-10-11 10:15:39,859 - Train: 4.69% [17600/375300] [14.1/300.0] [batch_t 0.410 (0.416)] [data_t 0.015] [optim_t 0.395] [lr 0.002111] [CE 4.253 (4.348)] [KD 0.000 (0.000)] 2024-10-11 10:16:00,481 - Train: 4.70% [17650/375300] [14.1/300.0] [batch_t 0.454 (0.412)] [data_t 0.015] [optim_t 0.439] [lr 0.002117] [CE 4.376 (4.313)] [KD 0.000 (0.000)] 2024-10-11 10:16:21,808 - Train: 4.72% [17700/375300] [14.1/300.0] [batch_t 0.493 (0.426)] [data_t 0.015] [optim_t 0.477] [lr 0.002123] [CE 3.712 (4.365)] [KD 0.000 (0.000)] 2024-10-11 10:16:42,880 - Train: 4.73% [17750/375300] [14.2/300.0] [batch_t 0.478 (0.421)] [data_t 0.015] [optim_t 0.463] [lr 0.002129] [CE 4.328 (4.293)] [KD 0.000 (0.000)] 2024-10-11 10:17:03,847 - Train: 4.74% [17800/375300] [14.2/300.0] [batch_t 0.471 (0.419)] [data_t 0.015] [optim_t 0.456] [lr 0.002135] [CE 4.297 (4.306)] [KD 0.000 (0.000)] 2024-10-11 10:17:24,485 - Train: 4.76% [17850/375300] [14.3/300.0] [batch_t 0.311 (0.413)] [data_t 0.016] [optim_t 0.295] [lr 0.002141] [CE 4.150 (4.263)] [KD 0.000 (0.000)] 2024-10-11 10:17:45,378 - Train: 4.77% [17900/375300] [14.3/300.0] [batch_t 0.416 (0.418)] [data_t 0.016] [optim_t 0.400] [lr 0.002147] [CE 4.605 (4.329)] [KD 0.000 (0.000)] 2024-10-11 10:18:06,579 - Train: 4.78% [17950/375300] [14.3/300.0] [batch_t 0.446 (0.424)] [data_t 0.015] [optim_t 0.430] [lr 0.002153] [CE 4.407 (4.314)] [KD 0.000 (0.000)] 2024-10-11 10:18:27,329 - Train: 4.80% [18000/375300] [14.4/300.0] [batch_t 0.418 (0.415)] [data_t 0.015] [optim_t 0.403] [lr 0.002159] [CE 4.445 (4.288)] [KD 0.000 (0.000)] 2024-10-11 10:18:48,402 - Train: 4.81% [18050/375300] [14.4/300.0] [batch_t 0.379 (0.421)] [data_t 0.015] [optim_t 0.363] [lr 0.002165] [CE 4.536 (4.356)] [KD 0.000 (0.000)] 2024-10-11 10:19:09,602 - Train: 4.82% [18100/375300] [14.5/300.0] [batch_t 0.356 (0.424)] [data_t 0.015] [optim_t 0.340] [lr 0.002171] [CE 4.375 (4.301)] [KD 0.000 (0.000)] 2024-10-11 10:19:30,532 - Train: 4.84% [18150/375300] [14.5/300.0] [batch_t 0.431 (0.419)] [data_t 0.015] [optim_t 0.416] [lr 0.002177] [CE 4.428 (4.368)] [KD 0.000 (0.000)] 2024-10-11 10:19:51,454 - Train: 4.85% [18200/375300] [14.5/300.0] [batch_t 0.492 (0.418)] [data_t 0.015] [optim_t 0.477] [lr 0.002183] [CE 4.166 (4.289)] [KD 0.000 (0.000)] 2024-10-11 10:20:12,454 - Train: 4.86% [18250/375300] [14.6/300.0] [batch_t 0.343 (0.420)] [data_t 0.015] [optim_t 0.327] [lr 0.002189] [CE 4.386 (4.292)] [KD 0.000 (0.000)] 2024-10-11 10:20:33,697 - Train: 4.88% [18300/375300] [14.6/300.0] [batch_t 0.386 (0.425)] [data_t 0.015] [optim_t 0.370] [lr 0.002195] [CE 4.417 (4.333)] [KD 0.000 (0.000)] 2024-10-11 10:20:54,395 - Train: 4.89% [18350/375300] [14.7/300.0] [batch_t 0.362 (0.414)] [data_t 0.015] [optim_t 0.347] [lr 0.002201] [CE 4.480 (4.350)] [KD 0.000 (0.000)] 2024-10-11 10:21:15,356 - Train: 4.90% [18400/375300] [14.7/300.0] [batch_t 0.446 (0.419)] [data_t 0.015] [optim_t 0.431] [lr 0.002207] [CE 4.389 (4.243)] [KD 0.000 (0.000)] 2024-10-11 10:21:36,324 - Train: 4.92% [18450/375300] [14.7/300.0] [batch_t 0.395 (0.419)] [data_t 0.015] [optim_t 0.379] [lr 0.002213] [CE 4.557 (4.316)] [KD 0.000 (0.000)] 2024-10-11 10:21:57,490 - Train: 4.93% [18500/375300] [14.8/300.0] [batch_t 0.385 (0.423)] [data_t 0.015] [optim_t 0.370] [lr 0.002219] [CE 4.008 (4.266)] [KD 0.000 (0.000)] 2024-10-11 10:22:18,462 - Train: 4.94% [18550/375300] [14.8/300.0] [batch_t 0.401 (0.419)] [data_t 0.015] [optim_t 0.386] [lr 0.002225] [CE 4.310 (4.278)] [KD 0.000 (0.000)] 2024-10-11 10:22:39,662 - Train: 4.96% [18600/375300] [14.9/300.0] [batch_t 0.527 (0.424)] [data_t 0.015] [optim_t 0.511] [lr 0.002231] [CE 4.486 (4.280)] [KD 0.000 (0.000)] 2024-10-11 10:23:01,122 - Train: 4.97% [18650/375300] [14.9/300.0] [batch_t 0.460 (0.429)] [data_t 0.015] [optim_t 0.445] [lr 0.002237] [CE 4.160 (4.347)] [KD 0.000 (0.000)] 2024-10-11 10:23:22,080 - Train: 4.98% [18700/375300] [14.9/300.0] [batch_t 0.383 (0.419)] [data_t 0.015] [optim_t 0.368] [lr 0.002243] [CE 4.181 (4.314)] [KD 0.000 (0.000)] 2024-10-11 10:23:43,200 - Train: 5.00% [18750/375300] [15.0/300.0] [batch_t 0.427 (0.422)] [data_t 0.027] [optim_t 0.399] [lr 0.002249] [CE 3.981 (4.277)] [KD 0.000 (0.000)] 2024-10-11 10:24:08,629 - Test (net): 100.00% [50/50] [batch_t 0.151 (0.405)] [top1_cnt 30782] [top5_cnt 42332] [top_all 50000] 2024-10-11 10:24:08,629 - net: 61.564 (84.664) 2024-10-11 10:24:29,654 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.413)] [top1_cnt 20498] [top5_cnt 33542] [top_all 50000] 2024-10-11 10:24:29,655 - net_E: 40.996 (67.084) 2024-10-11 10:24:29,848 - Max [top1: 61.564 (epoch: 15)] [top1-ema: 40.996 (epoch: 15)] 2024-10-11 10:24:29,848 - ==> Total time: 2:14:30 Eta: 1 day, 18:35:36 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 10:24:50,178 - Train: 5.01% [18800/375300] [15.0/300.0] [batch_t 0.462 (0.421)] [data_t 0.015] [optim_t 0.446] [lr 0.002255] [CE 4.010 (4.299)] [KD 0.000 (0.000)] 2024-10-11 10:25:11,416 - Train: 5.02% [18850/375300] [15.1/300.0] [batch_t 0.345 (0.425)] [data_t 0.015] [optim_t 0.330] [lr 0.002261] [CE 4.720 (4.323)] [KD 0.000 (0.000)] 2024-10-11 10:25:32,432 - Train: 5.04% [18900/375300] [15.1/300.0] [batch_t 0.401 (0.420)] [data_t 0.015] [optim_t 0.385] [lr 0.002267] [CE 4.459 (4.265)] [KD 0.000 (0.000)] 2024-10-11 10:25:53,153 - Train: 5.05% [18950/375300] [15.1/300.0] [batch_t 0.307 (0.414)] [data_t 0.015] [optim_t 0.292] [lr 0.002273] [CE 4.196 (4.294)] [KD 0.000 (0.000)] 2024-10-11 10:26:13,718 - Train: 5.06% [19000/375300] [15.2/300.0] [batch_t 0.443 (0.411)] [data_t 0.015] [optim_t 0.427] [lr 0.002279] [CE 4.207 (4.287)] [KD 0.000 (0.000)] 2024-10-11 10:26:34,184 - Train: 5.08% [19050/375300] [15.2/300.0] [batch_t 0.415 (0.409)] [data_t 0.015] [optim_t 0.400] [lr 0.002285] [CE 4.313 (4.267)] [KD 0.000 (0.000)] 2024-10-11 10:26:54,610 - Train: 5.09% [19100/375300] [15.3/300.0] [batch_t 0.422 (0.408)] [data_t 0.015] [optim_t 0.406] [lr 0.002291] [CE 4.227 (4.330)] [KD 0.000 (0.000)] 2024-10-11 10:27:15,023 - Train: 5.10% [19150/375300] [15.3/300.0] [batch_t 0.392 (0.408)] [data_t 0.015] [optim_t 0.377] [lr 0.002297] [CE 4.241 (4.295)] [KD 0.000 (0.000)] 2024-10-11 10:27:35,330 - Train: 5.12% [19200/375300] [15.3/300.0] [batch_t 0.413 (0.406)] [data_t 0.015] [optim_t 0.398] [lr 0.002303] [CE 4.537 (4.304)] [KD 0.000 (0.000)] 2024-10-11 10:27:55,930 - Train: 5.13% [19250/375300] [15.4/300.0] [batch_t 0.433 (0.412)] [data_t 0.015] [optim_t 0.418] [lr 0.002309] [CE 4.350 (4.286)] [KD 0.000 (0.000)] 2024-10-11 10:28:16,769 - Train: 5.14% [19300/375300] [15.4/300.0] [batch_t 0.467 (0.417)] [data_t 0.179] [optim_t 0.287] [lr 0.002315] [CE 4.101 (4.267)] [KD 0.000 (0.000)] 2024-10-11 10:28:37,944 - Train: 5.16% [19350/375300] [15.5/300.0] [batch_t 0.378 (0.423)] [data_t 0.088] [optim_t 0.289] [lr 0.002321] [CE 4.488 (4.293)] [KD 0.000 (0.000)] 2024-10-11 10:28:59,159 - Train: 5.17% [19400/375300] [15.5/300.0] [batch_t 0.428 (0.424)] [data_t 0.138] [optim_t 0.290] [lr 0.002327] [CE 4.362 (4.264)] [KD 0.000 (0.000)] 2024-10-11 10:29:20,481 - Train: 5.18% [19450/375300] [15.5/300.0] [batch_t 0.412 (0.426)] [data_t 0.121] [optim_t 0.290] [lr 0.002333] [CE 3.900 (4.291)] [KD 0.000 (0.000)] 2024-10-11 10:29:41,635 - Train: 5.20% [19500/375300] [15.6/300.0] [batch_t 0.406 (0.423)] [data_t 0.113] [optim_t 0.293] [lr 0.002339] [CE 4.380 (4.286)] [KD 0.000 (0.000)] 2024-10-11 10:30:02,484 - Train: 5.21% [19550/375300] [15.6/300.0] [batch_t 0.395 (0.417)] [data_t 0.107] [optim_t 0.288] [lr 0.002345] [CE 4.220 (4.335)] [KD 0.000 (0.000)] 2024-10-11 10:30:23,447 - Train: 5.22% [19600/375300] [15.7/300.0] [batch_t 0.406 (0.419)] [data_t 0.119] [optim_t 0.287] [lr 0.002351] [CE 4.165 (4.291)] [KD 0.000 (0.000)] 2024-10-11 10:30:44,391 - Train: 5.24% [19650/375300] [15.7/300.0] [batch_t 0.509 (0.419)] [data_t 0.096] [optim_t 0.413] [lr 0.002357] [CE 4.296 (4.292)] [KD 0.000 (0.000)] 2024-10-11 10:31:04,966 - Train: 5.25% [19700/375300] [15.7/300.0] [batch_t 0.424 (0.411)] [data_t 0.133] [optim_t 0.291] [lr 0.002363] [CE 4.088 (4.261)] [KD 0.000 (0.000)] 2024-10-11 10:31:25,763 - Train: 5.26% [19750/375300] [15.8/300.0] [batch_t 0.393 (0.416)] [data_t 0.103] [optim_t 0.290] [lr 0.002369] [CE 4.026 (4.288)] [KD 0.000 (0.000)] 2024-10-11 10:31:46,984 - Train: 5.28% [19800/375300] [15.8/300.0] [batch_t 0.381 (0.424)] [data_t 0.090] [optim_t 0.291] [lr 0.002375] [CE 4.130 (4.278)] [KD 0.000 (0.000)] 2024-10-11 10:32:07,844 - Train: 5.29% [19850/375300] [15.9/300.0] [batch_t 0.480 (0.417)] [data_t 0.191] [optim_t 0.289] [lr 0.002381] [CE 4.292 (4.310)] [KD 0.000 (0.000)] 2024-10-11 10:32:28,657 - Train: 5.30% [19900/375300] [15.9/300.0] [batch_t 0.393 (0.416)] [data_t 0.102] [optim_t 0.291] [lr 0.002387] [CE 4.363 (4.261)] [KD 0.000 (0.000)] 2024-10-11 10:32:49,753 - Train: 5.32% [19950/375300] [15.9/300.0] [batch_t 0.404 (0.422)] [data_t 0.114] [optim_t 0.290] [lr 0.002393] [CE 4.253 (4.299)] [KD 0.000 (0.000)] 2024-10-11 10:33:10,658 - Train: 5.33% [20000/375300] [16.0/300.0] [batch_t 0.457 (0.418)] [data_t 0.168] [optim_t 0.289] [lr 0.002399] [CE 4.414 (4.321)] [KD 0.000 (0.000)] 2024-10-11 10:33:15,958 - ==> Total time: 2:23:16 Eta: 1 day, 18:23:07 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 10:33:33,515 - Train: 5.34% [20050/375300] [16.0/300.0] [batch_t 0.458 (0.473)] [data_t 0.015] [optim_t 0.443] [lr 0.002405] [CE 4.316 (4.291)] [KD 0.000 (0.000)] 2024-10-11 10:33:53,354 - Train: 5.36% [20100/375300] [16.1/300.0] [batch_t 0.412 (0.397)] [data_t 0.060] [optim_t 0.351] [lr 0.002411] [CE 4.484 (4.276)] [KD 0.000 (0.000)] 2024-10-11 10:34:13,873 - Train: 5.37% [20150/375300] [16.1/300.0] [batch_t 0.417 (0.410)] [data_t 0.015] [optim_t 0.401] [lr 0.002417] [CE 3.988 (4.269)] [KD 0.000 (0.000)] 2024-10-11 10:34:34,080 - Train: 5.38% [20200/375300] [16.1/300.0] [batch_t 0.393 (0.404)] [data_t 0.104] [optim_t 0.290] [lr 0.002423] [CE 4.102 (4.302)] [KD 0.000 (0.000)] 2024-10-11 10:34:54,499 - Train: 5.40% [20250/375300] [16.2/300.0] [batch_t 0.393 (0.408)] [data_t 0.104] [optim_t 0.288] [lr 0.002429] [CE 4.991 (4.310)] [KD 0.000 (0.000)] 2024-10-11 10:35:15,230 - Train: 5.41% [20300/375300] [16.2/300.0] [batch_t 0.437 (0.415)] [data_t 0.124] [optim_t 0.313] [lr 0.002434] [CE 4.440 (4.283)] [KD 0.000 (0.000)] 2024-10-11 10:35:36,182 - Train: 5.42% [20350/375300] [16.3/300.0] [batch_t 0.421 (0.419)] [data_t 0.015] [optim_t 0.406] [lr 0.002440] [CE 4.235 (4.247)] [KD 0.000 (0.000)] 2024-10-11 10:35:56,913 - Train: 5.44% [20400/375300] [16.3/300.0] [batch_t 0.466 (0.415)] [data_t 0.015] [optim_t 0.450] [lr 0.002446] [CE 4.075 (4.253)] [KD 0.000 (0.000)] 2024-10-11 10:36:17,461 - Train: 5.45% [20450/375300] [16.3/300.0] [batch_t 0.376 (0.411)] [data_t 0.015] [optim_t 0.361] [lr 0.002452] [CE 4.097 (4.296)] [KD 0.000 (0.000)] 2024-10-11 10:36:38,502 - Train: 5.46% [20500/375300] [16.4/300.0] [batch_t 0.425 (0.421)] [data_t 0.015] [optim_t 0.410] [lr 0.002458] [CE 4.385 (4.316)] [KD 0.000 (0.000)] 2024-10-11 10:36:58,966 - Train: 5.48% [20550/375300] [16.4/300.0] [batch_t 0.393 (0.409)] [data_t 0.015] [optim_t 0.378] [lr 0.002464] [CE 3.936 (4.312)] [KD 0.000 (0.000)] 2024-10-11 10:37:19,689 - Train: 5.49% [20600/375300] [16.5/300.0] [batch_t 0.444 (0.414)] [data_t 0.015] [optim_t 0.429] [lr 0.002470] [CE 4.247 (4.277)] [KD 0.000 (0.000)] 2024-10-11 10:37:40,441 - Train: 5.50% [20650/375300] [16.5/300.0] [batch_t 0.404 (0.415)] [data_t 0.015] [optim_t 0.389] [lr 0.002476] [CE 4.111 (4.294)] [KD 0.000 (0.000)] 2024-10-11 10:38:01,197 - Train: 5.52% [20700/375300] [16.5/300.0] [batch_t 0.416 (0.415)] [data_t 0.015] [optim_t 0.401] [lr 0.002482] [CE 4.240 (4.244)] [KD 0.000 (0.000)] 2024-10-11 10:38:22,319 - Train: 5.53% [20750/375300] [16.6/300.0] [batch_t 0.402 (0.422)] [data_t 0.015] [optim_t 0.387] [lr 0.002488] [CE 4.468 (4.241)] [KD 0.000 (0.000)] 2024-10-11 10:38:42,910 - Train: 5.54% [20800/375300] [16.6/300.0] [batch_t 0.476 (0.412)] [data_t 0.016] [optim_t 0.460] [lr 0.002494] [CE 4.174 (4.289)] [KD 0.000 (0.000)] 2024-10-11 10:39:03,531 - Train: 5.56% [20850/375300] [16.7/300.0] [batch_t 0.388 (0.412)] [data_t 0.015] [optim_t 0.372] [lr 0.002500] [CE 4.236 (4.284)] [KD 0.000 (0.000)] 2024-10-11 10:39:24,577 - Train: 5.57% [20900/375300] [16.7/300.0] [batch_t 0.399 (0.421)] [data_t 0.015] [optim_t 0.384] [lr 0.002506] [CE 4.060 (4.265)] [KD 0.000 (0.000)] 2024-10-11 10:39:45,273 - Train: 5.58% [20950/375300] [16.7/300.0] [batch_t 0.400 (0.414)] [data_t 0.015] [optim_t 0.384] [lr 0.002512] [CE 4.377 (4.277)] [KD 0.000 (0.000)] 2024-10-11 10:40:05,934 - Train: 5.60% [21000/375300] [16.8/300.0] [batch_t 0.519 (0.413)] [data_t 0.016] [optim_t 0.504] [lr 0.002518] [CE 4.667 (4.303)] [KD 0.000 (0.000)] 2024-10-11 10:40:26,765 - Train: 5.61% [21050/375300] [16.8/300.0] [batch_t 0.415 (0.416)] [data_t 0.016] [optim_t 0.400] [lr 0.002524] [CE 4.335 (4.255)] [KD 0.000 (0.000)] 2024-10-11 10:40:47,779 - Train: 5.62% [21100/375300] [16.9/300.0] [batch_t 0.400 (0.420)] [data_t 0.015] [optim_t 0.385] [lr 0.002530] [CE 4.434 (4.284)] [KD 0.000 (0.000)] 2024-10-11 10:41:08,759 - Train: 5.64% [21150/375300] [16.9/300.0] [batch_t 0.373 (0.419)] [data_t 0.015] [optim_t 0.358] [lr 0.002536] [CE 4.105 (4.246)] [KD 0.000 (0.000)] 2024-10-11 10:41:29,656 - Train: 5.65% [21200/375300] [16.9/300.0] [batch_t 0.391 (0.418)] [data_t 0.015] [optim_t 0.376] [lr 0.002542] [CE 4.443 (4.250)] [KD 0.000 (0.000)] 2024-10-11 10:41:50,449 - Train: 5.66% [21250/375300] [17.0/300.0] [batch_t 0.401 (0.416)] [data_t 0.015] [optim_t 0.385] [lr 0.002548] [CE 4.141 (4.253)] [KD 0.000 (0.000)] 2024-10-11 10:41:56,240 - ==> Total time: 2:31:56 Eta: 1 day, 18:09:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 10:42:13,371 - Train: 5.68% [21300/375300] [17.0/300.0] [batch_t 0.308 (0.475)] [data_t 0.016] [optim_t 0.292] [lr 0.002554] [CE 3.556 (4.191)] [KD 0.000 (0.000)] 2024-10-11 10:42:33,745 - Train: 5.69% [21350/375300] [17.1/300.0] [batch_t 0.435 (0.407)] [data_t 0.015] [optim_t 0.420] [lr 0.002560] [CE 4.288 (4.209)] [KD 0.000 (0.000)] 2024-10-11 10:42:54,265 - Train: 5.70% [21400/375300] [17.1/300.0] [batch_t 0.389 (0.410)] [data_t 0.015] [optim_t 0.373] [lr 0.002566] [CE 4.048 (4.185)] [KD 0.000 (0.000)] 2024-10-11 10:43:14,806 - Train: 5.72% [21450/375300] [17.1/300.0] [batch_t 0.389 (0.411)] [data_t 0.015] [optim_t 0.374] [lr 0.002572] [CE 4.263 (4.223)] [KD 0.000 (0.000)] 2024-10-11 10:43:35,671 - Train: 5.73% [21500/375300] [17.2/300.0] [batch_t 0.398 (0.417)] [data_t 0.015] [optim_t 0.383] [lr 0.002578] [CE 4.294 (4.262)] [KD 0.000 (0.000)] 2024-10-11 10:43:56,282 - Train: 5.74% [21550/375300] [17.2/300.0] [batch_t 0.436 (0.412)] [data_t 0.016] [optim_t 0.420] [lr 0.002584] [CE 4.419 (4.260)] [KD 0.000 (0.000)] 2024-10-11 10:44:17,014 - Train: 5.76% [21600/375300] [17.3/300.0] [batch_t 0.464 (0.415)] [data_t 0.015] [optim_t 0.449] [lr 0.002590] [CE 4.246 (4.303)] [KD 0.000 (0.000)] 2024-10-11 10:44:37,670 - Train: 5.77% [21650/375300] [17.3/300.0] [batch_t 0.408 (0.413)] [data_t 0.015] [optim_t 0.392] [lr 0.002596] [CE 4.506 (4.282)] [KD 0.000 (0.000)] 2024-10-11 10:44:58,094 - Train: 5.78% [21700/375300] [17.3/300.0] [batch_t 0.433 (0.408)] [data_t 0.016] [optim_t 0.418] [lr 0.002602] [CE 4.455 (4.218)] [KD 0.000 (0.000)] 2024-10-11 10:45:18,647 - Train: 5.80% [21750/375300] [17.4/300.0] [batch_t 0.423 (0.411)] [data_t 0.015] [optim_t 0.408] [lr 0.002608] [CE 4.547 (4.265)] [KD 0.000 (0.000)] 2024-10-11 10:45:39,529 - Train: 5.81% [21800/375300] [17.4/300.0] [batch_t 0.410 (0.418)] [data_t 0.015] [optim_t 0.394] [lr 0.002614] [CE 4.307 (4.202)] [KD 0.000 (0.000)] 2024-10-11 10:46:00,418 - Train: 5.82% [21850/375300] [17.5/300.0] [batch_t 0.505 (0.418)] [data_t 0.015] [optim_t 0.490] [lr 0.002620] [CE 4.397 (4.305)] [KD 0.000 (0.000)] 2024-10-11 10:46:21,467 - Train: 5.84% [21900/375300] [17.5/300.0] [batch_t 0.427 (0.421)] [data_t 0.015] [optim_t 0.411] [lr 0.002626] [CE 4.421 (4.196)] [KD 0.000 (0.000)] 2024-10-11 10:46:43,137 - Train: 5.85% [21950/375300] [17.5/300.0] [batch_t 0.399 (0.433)] [data_t 0.109] [optim_t 0.290] [lr 0.002632] [CE 3.918 (4.242)] [KD 0.000 (0.000)] 2024-10-11 10:47:04,911 - Train: 5.86% [22000/375300] [17.6/300.0] [batch_t 0.499 (0.435)] [data_t 0.208] [optim_t 0.291] [lr 0.002638] [CE 4.088 (4.217)] [KD 0.000 (0.000)] 2024-10-11 10:47:26,787 - Train: 5.88% [22050/375300] [17.6/300.0] [batch_t 0.448 (0.437)] [data_t 0.157] [optim_t 0.291] [lr 0.002644] [CE 3.925 (4.276)] [KD 0.000 (0.000)] 2024-10-11 10:47:48,641 - Train: 5.89% [22100/375300] [17.7/300.0] [batch_t 0.435 (0.437)] [data_t 0.144] [optim_t 0.291] [lr 0.002650] [CE 3.964 (4.277)] [KD 0.000 (0.000)] 2024-10-11 10:48:10,238 - Train: 5.90% [22150/375300] [17.7/300.0] [batch_t 0.380 (0.432)] [data_t 0.089] [optim_t 0.291] [lr 0.002656] [CE 3.914 (4.232)] [KD 0.000 (0.000)] 2024-10-11 10:48:32,211 - Train: 5.92% [22200/375300] [17.7/300.0] [batch_t 0.446 (0.439)] [data_t 0.153] [optim_t 0.293] [lr 0.002662] [CE 4.175 (4.236)] [KD 0.000 (0.000)] 2024-10-11 10:48:54,199 - Train: 5.93% [22250/375300] [17.8/300.0] [batch_t 0.439 (0.440)] [data_t 0.148] [optim_t 0.291] [lr 0.002668] [CE 4.204 (4.282)] [KD 0.000 (0.000)] 2024-10-11 10:49:15,851 - Train: 5.94% [22300/375300] [17.8/300.0] [batch_t 0.437 (0.433)] [data_t 0.145] [optim_t 0.292] [lr 0.002674] [CE 4.382 (4.278)] [KD 0.000 (0.000)] 2024-10-11 10:49:36,738 - Train: 5.96% [22350/375300] [17.9/300.0] [batch_t 0.370 (0.418)] [data_t 0.076] [optim_t 0.293] [lr 0.002680] [CE 3.969 (4.209)] [KD 0.000 (0.000)] 2024-10-11 10:49:57,875 - Train: 5.97% [22400/375300] [17.9/300.0] [batch_t 0.446 (0.423)] [data_t 0.157] [optim_t 0.289] [lr 0.002686] [CE 4.199 (4.332)] [KD 0.000 (0.000)] 2024-10-11 10:50:18,735 - Train: 5.98% [22450/375300] [17.9/300.0] [batch_t 0.449 (0.417)] [data_t 0.158] [optim_t 0.291] [lr 0.002692] [CE 4.575 (4.219)] [KD 0.000 (0.000)] 2024-10-11 10:50:40,268 - Train: 6.00% [22500/375300] [18.0/300.0] [batch_t 0.440 (0.431)] [data_t 0.015] [optim_t 0.424] [lr 0.002698] [CE 4.558 (4.251)] [KD 0.000 (0.000)] 2024-10-11 10:50:46,734 - ==> Total time: 2:40:47 Eta: 1 day, 17:59:00 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 10:51:04,034 - Train: 6.01% [22550/375300] [18.0/300.0] [batch_t 0.488 (0.499)] [data_t 0.016] [optim_t 0.472] [lr 0.002704] [CE 4.342 (4.234)] [KD 0.000 (0.000)] 2024-10-11 10:51:25,109 - Train: 6.02% [22600/375300] [18.1/300.0] [batch_t 0.441 (0.421)] [data_t 0.015] [optim_t 0.425] [lr 0.002710] [CE 4.046 (4.168)] [KD 0.000 (0.000)] 2024-10-11 10:51:46,452 - Train: 6.04% [22650/375300] [18.1/300.0] [batch_t 0.394 (0.426)] [data_t 0.015] [optim_t 0.379] [lr 0.002716] [CE 4.364 (4.263)] [KD 0.000 (0.000)] 2024-10-11 10:52:07,353 - Train: 6.05% [22700/375300] [18.1/300.0] [batch_t 0.419 (0.418)] [data_t 0.015] [optim_t 0.404] [lr 0.002722] [CE 4.323 (4.248)] [KD 0.000 (0.000)] 2024-10-11 10:52:28,859 - Train: 6.06% [22750/375300] [18.2/300.0] [batch_t 0.451 (0.430)] [data_t 0.015] [optim_t 0.436] [lr 0.002728] [CE 4.273 (4.313)] [KD 0.000 (0.000)] 2024-10-11 10:52:50,488 - Train: 6.08% [22800/375300] [18.2/300.0] [batch_t 0.414 (0.432)] [data_t 0.015] [optim_t 0.399] [lr 0.002734] [CE 4.225 (4.264)] [KD 0.000 (0.000)] 2024-10-11 10:53:11,718 - Train: 6.09% [22850/375300] [18.3/300.0] [batch_t 0.427 (0.424)] [data_t 0.015] [optim_t 0.412] [lr 0.002740] [CE 4.491 (4.231)] [KD 0.000 (0.000)] 2024-10-11 10:53:32,922 - Train: 6.10% [22900/375300] [18.3/300.0] [batch_t 0.417 (0.424)] [data_t 0.015] [optim_t 0.401] [lr 0.002746] [CE 4.025 (4.253)] [KD 0.000 (0.000)] 2024-10-11 10:53:54,640 - Train: 6.12% [22950/375300] [18.3/300.0] [batch_t 0.509 (0.434)] [data_t 0.015] [optim_t 0.493] [lr 0.002752] [CE 4.110 (4.194)] [KD 0.000 (0.000)] 2024-10-11 10:54:16,148 - Train: 6.13% [23000/375300] [18.4/300.0] [batch_t 0.432 (0.430)] [data_t 0.015] [optim_t 0.417] [lr 0.002758] [CE 4.683 (4.237)] [KD 0.000 (0.000)] 2024-10-11 10:54:37,499 - Train: 6.14% [23050/375300] [18.4/300.0] [batch_t 0.461 (0.427)] [data_t 0.015] [optim_t 0.446] [lr 0.002764] [CE 4.285 (4.209)] [KD 0.000 (0.000)] 2024-10-11 10:54:58,522 - Train: 6.16% [23100/375300] [18.5/300.0] [batch_t 0.423 (0.420)] [data_t 0.015] [optim_t 0.407] [lr 0.002770] [CE 4.145 (4.225)] [KD 0.000 (0.000)] 2024-10-11 10:55:19,769 - Train: 6.17% [23150/375300] [18.5/300.0] [batch_t 0.428 (0.425)] [data_t 0.015] [optim_t 0.413] [lr 0.002776] [CE 4.113 (4.217)] [KD 0.000 (0.000)] 2024-10-11 10:55:40,908 - Train: 6.18% [23200/375300] [18.5/300.0] [batch_t 0.440 (0.423)] [data_t 0.015] [optim_t 0.424] [lr 0.002782] [CE 4.355 (4.208)] [KD 0.000 (0.000)] 2024-10-11 10:56:02,317 - Train: 6.20% [23250/375300] [18.6/300.0] [batch_t 0.403 (0.428)] [data_t 0.015] [optim_t 0.387] [lr 0.002788] [CE 4.189 (4.222)] [KD 0.000 (0.000)] 2024-10-11 10:56:23,514 - Train: 6.21% [23300/375300] [18.6/300.0] [batch_t 0.428 (0.424)] [data_t 0.015] [optim_t 0.413] [lr 0.002794] [CE 4.264 (4.248)] [KD 0.000 (0.000)] 2024-10-11 10:56:44,228 - Train: 6.22% [23350/375300] [18.7/300.0] [batch_t 0.469 (0.414)] [data_t 0.015] [optim_t 0.454] [lr 0.002800] [CE 4.261 (4.253)] [KD 0.000 (0.000)] 2024-10-11 10:57:04,508 - Train: 6.24% [23400/375300] [18.7/300.0] [batch_t 0.388 (0.405)] [data_t 0.015] [optim_t 0.372] [lr 0.002806] [CE 4.198 (4.205)] [KD 0.000 (0.000)] 2024-10-11 10:57:25,865 - Train: 6.25% [23450/375300] [18.7/300.0] [batch_t 0.484 (0.427)] [data_t 0.015] [optim_t 0.469] [lr 0.002812] [CE 4.401 (4.238)] [KD 0.000 (0.000)] 2024-10-11 10:57:47,687 - Train: 6.26% [23500/375300] [18.8/300.0] [batch_t 0.458 (0.436)] [data_t 0.015] [optim_t 0.443] [lr 0.002818] [CE 4.222 (4.213)] [KD 0.000 (0.000)] 2024-10-11 10:58:09,445 - Train: 6.27% [23550/375300] [18.8/300.0] [batch_t 0.433 (0.435)] [data_t 0.015] [optim_t 0.418] [lr 0.002824] [CE 4.381 (4.260)] [KD 0.000 (0.000)] 2024-10-11 10:58:31,008 - Train: 6.29% [23600/375300] [18.9/300.0] [batch_t 0.452 (0.431)] [data_t 0.015] [optim_t 0.436] [lr 0.002830] [CE 4.386 (4.235)] [KD 0.000 (0.000)] 2024-10-11 10:58:52,884 - Train: 6.30% [23650/375300] [18.9/300.0] [batch_t 0.476 (0.437)] [data_t 0.015] [optim_t 0.461] [lr 0.002836] [CE 4.136 (4.235)] [KD 0.000 (0.000)] 2024-10-11 10:59:14,251 - Train: 6.31% [23700/375300] [18.9/300.0] [batch_t 0.372 (0.427)] [data_t 0.015] [optim_t 0.357] [lr 0.002842] [CE 4.103 (4.259)] [KD 0.000 (0.000)] 2024-10-11 10:59:35,878 - Train: 6.33% [23750/375300] [19.0/300.0] [batch_t 0.391 (0.432)] [data_t 0.016] [optim_t 0.376] [lr 0.002848] [CE 3.894 (4.233)] [KD 0.000 (0.000)] 2024-10-11 10:59:42,771 - ==> Total time: 2:49:43 Eta: 1 day, 17:50:05 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 10:59:59,338 - Train: 6.34% [23800/375300] [19.0/300.0] [batch_t 0.445 (0.491)] [data_t 0.113] [optim_t 0.332] [lr 0.002854] [CE 4.469 (4.234)] [KD 0.000 (0.000)] 2024-10-11 11:00:20,337 - Train: 6.35% [23850/375300] [19.1/300.0] [batch_t 0.465 (0.420)] [data_t 0.015] [optim_t 0.450] [lr 0.002860] [CE 3.858 (4.205)] [KD 0.000 (0.000)] 2024-10-11 11:00:41,419 - Train: 6.37% [23900/375300] [19.1/300.0] [batch_t 0.422 (0.422)] [data_t 0.015] [optim_t 0.407] [lr 0.002866] [CE 4.745 (4.186)] [KD 0.000 (0.000)] 2024-10-11 11:01:02,120 - Train: 6.38% [23950/375300] [19.1/300.0] [batch_t 0.420 (0.414)] [data_t 0.015] [optim_t 0.405] [lr 0.002872] [CE 4.096 (4.254)] [KD 0.000 (0.000)] 2024-10-11 11:01:22,863 - Train: 6.39% [24000/375300] [19.2/300.0] [batch_t 0.450 (0.415)] [data_t 0.015] [optim_t 0.435] [lr 0.002878] [CE 4.124 (4.194)] [KD 0.000 (0.000)] 2024-10-11 11:01:43,710 - Train: 6.41% [24050/375300] [19.2/300.0] [batch_t 0.444 (0.417)] [data_t 0.015] [optim_t 0.429] [lr 0.002884] [CE 4.070 (4.240)] [KD 0.000 (0.000)] 2024-10-11 11:02:04,383 - Train: 6.42% [24100/375300] [19.3/300.0] [batch_t 0.423 (0.413)] [data_t 0.015] [optim_t 0.408] [lr 0.002890] [CE 4.131 (4.246)] [KD 0.000 (0.000)] 2024-10-11 11:02:25,374 - Train: 6.43% [24150/375300] [19.3/300.0] [batch_t 0.402 (0.420)] [data_t 0.015] [optim_t 0.386] [lr 0.002896] [CE 4.268 (4.245)] [KD 0.000 (0.000)] 2024-10-11 11:02:46,605 - Train: 6.45% [24200/375300] [19.3/300.0] [batch_t 0.425 (0.425)] [data_t 0.015] [optim_t 0.410] [lr 0.002902] [CE 4.317 (4.214)] [KD 0.000 (0.000)] 2024-10-11 11:03:07,651 - Train: 6.46% [24250/375300] [19.4/300.0] [batch_t 0.405 (0.421)] [data_t 0.015] [optim_t 0.390] [lr 0.002908] [CE 4.262 (4.216)] [KD 0.000 (0.000)] 2024-10-11 11:03:28,758 - Train: 6.47% [24300/375300] [19.4/300.0] [batch_t 0.394 (0.422)] [data_t 0.015] [optim_t 0.379] [lr 0.002914] [CE 3.901 (4.240)] [KD 0.000 (0.000)] 2024-10-11 11:03:49,720 - Train: 6.49% [24350/375300] [19.5/300.0] [batch_t 0.436 (0.419)] [data_t 0.015] [optim_t 0.421] [lr 0.002920] [CE 4.244 (4.180)] [KD 0.000 (0.000)] 2024-10-11 11:04:11,576 - Train: 6.50% [24400/375300] [19.5/300.0] [batch_t 0.443 (0.437)] [data_t 0.015] [optim_t 0.428] [lr 0.002926] [CE 4.443 (4.180)] [KD 0.000 (0.000)] 2024-10-11 11:04:33,136 - Train: 6.51% [24450/375300] [19.5/300.0] [batch_t 0.492 (0.431)] [data_t 0.015] [optim_t 0.476] [lr 0.002932] [CE 4.037 (4.257)] [KD 0.000 (0.000)] 2024-10-11 11:04:54,771 - Train: 6.53% [24500/375300] [19.6/300.0] [batch_t 0.349 (0.433)] [data_t 0.015] [optim_t 0.334] [lr 0.002938] [CE 4.029 (4.220)] [KD 0.000 (0.000)] 2024-10-11 11:05:16,585 - Train: 6.54% [24550/375300] [19.6/300.0] [batch_t 0.461 (0.436)] [data_t 0.015] [optim_t 0.446] [lr 0.002944] [CE 4.243 (4.217)] [KD 0.000 (0.000)] 2024-10-11 11:05:38,308 - Train: 6.55% [24600/375300] [19.7/300.0] [batch_t 0.410 (0.434)] [data_t 0.015] [optim_t 0.395] [lr 0.002950] [CE 4.067 (4.219)] [KD 0.000 (0.000)] 2024-10-11 11:05:59,909 - Train: 6.57% [24650/375300] [19.7/300.0] [batch_t 0.477 (0.432)] [data_t 0.015] [optim_t 0.462] [lr 0.002956] [CE 4.223 (4.200)] [KD 0.000 (0.000)] 2024-10-11 11:06:21,662 - Train: 6.58% [24700/375300] [19.7/300.0] [batch_t 0.319 (0.435)] [data_t 0.015] [optim_t 0.304] [lr 0.002962] [CE 4.288 (4.201)] [KD 0.000 (0.000)] 2024-10-11 11:06:43,761 - Train: 6.59% [24750/375300] [19.8/300.0] [batch_t 0.454 (0.442)] [data_t 0.015] [optim_t 0.439] [lr 0.002968] [CE 4.527 (4.257)] [KD 0.000 (0.000)] 2024-10-11 11:07:04,716 - Train: 6.61% [24800/375300] [19.8/300.0] [batch_t 0.357 (0.419)] [data_t 0.015] [optim_t 0.342] [lr 0.002974] [CE 4.383 (4.234)] [KD 0.000 (0.000)] 2024-10-11 11:07:25,001 - Train: 6.62% [24850/375300] [19.9/300.0] [batch_t 0.361 (0.406)] [data_t 0.015] [optim_t 0.345] [lr 0.002980] [CE 4.132 (4.193)] [KD 0.000 (0.000)] 2024-10-11 11:07:45,579 - Train: 6.63% [24900/375300] [19.9/300.0] [batch_t 0.370 (0.411)] [data_t 0.015] [optim_t 0.354] [lr 0.002986] [CE 4.397 (4.243)] [KD 0.000 (0.000)] 2024-10-11 11:08:06,235 - Train: 6.65% [24950/375300] [19.9/300.0] [batch_t 0.420 (0.413)] [data_t 0.015] [optim_t 0.405] [lr 0.002991] [CE 4.246 (4.246)] [KD 0.000 (0.000)] 2024-10-11 11:08:28,198 - Train: 6.66% [25000/375300] [20.0/300.0] [batch_t 0.459 (0.439)] [data_t 0.015] [optim_t 0.444] [lr 0.002997] [CE 4.443 (4.239)] [KD 0.000 (0.000)] 2024-10-11 11:08:55,844 - Test (net): 100.00% [50/50] [batch_t 0.162 (0.405)] [top1_cnt 31468] [top5_cnt 42654] [top_all 50000] 2024-10-11 11:08:55,845 - net: 62.936 (85.308) 2024-10-11 11:09:16,447 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.405)] [top1_cnt 30322] [top5_cnt 41925] [top_all 50000] 2024-10-11 11:09:16,448 - net_E: 60.644 (83.850) 2024-10-11 11:09:16,664 - Max [top1: 62.936 (epoch: 20)] [top1-ema: 60.644 (epoch: 20)] 2024-10-11 11:09:16,664 - ==> Total time: 2:59:17 Eta: 1 day, 17:50:00 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 11:09:37,177 - Train: 6.67% [25050/375300] [20.0/300.0] [batch_t 0.307 (0.418)] [data_t 0.015] [optim_t 0.292] [lr 0.002967] [CE 4.107 (4.270)] [KD 0.000 (0.000)] 2024-10-11 11:09:56,309 - Train: 6.69% [25100/375300] [20.1/300.0] [batch_t 0.438 (0.383)] [data_t 0.146] [optim_t 0.292] [lr 0.002967] [CE 4.474 (4.162)] [KD 0.000 (0.000)] 2024-10-11 11:10:16,605 - Train: 6.70% [25150/375300] [20.1/300.0] [batch_t 0.387 (0.406)] [data_t 0.097] [optim_t 0.291] [lr 0.002967] [CE 4.224 (4.216)] [KD 0.000 (0.000)] 2024-10-11 11:10:36,998 - Train: 6.71% [25200/375300] [20.1/300.0] [batch_t 0.420 (0.408)] [data_t 0.129] [optim_t 0.291] [lr 0.002967] [CE 4.071 (4.255)] [KD 0.000 (0.000)] 2024-10-11 11:10:58,199 - Train: 6.73% [25250/375300] [20.2/300.0] [batch_t 0.389 (0.424)] [data_t 0.099] [optim_t 0.290] [lr 0.002967] [CE 4.518 (4.214)] [KD 0.000 (0.000)] 2024-10-11 11:11:19,978 - Train: 6.74% [25300/375300] [20.2/300.0] [batch_t 0.384 (0.435)] [data_t 0.097] [optim_t 0.287] [lr 0.002967] [CE 4.144 (4.193)] [KD 0.000 (0.000)] 2024-10-11 11:11:41,213 - Train: 6.75% [25350/375300] [20.3/300.0] [batch_t 0.459 (0.425)] [data_t 0.170] [optim_t 0.289] [lr 0.002967] [CE 3.817 (4.214)] [KD 0.000 (0.000)] 2024-10-11 11:12:02,376 - Train: 6.77% [25400/375300] [20.3/300.0] [batch_t 0.485 (0.423)] [data_t 0.194] [optim_t 0.291] [lr 0.002967] [CE 3.883 (4.244)] [KD 0.000 (0.000)] 2024-10-11 11:12:23,782 - Train: 6.78% [25450/375300] [20.3/300.0] [batch_t 0.363 (0.428)] [data_t 0.074] [optim_t 0.290] [lr 0.002966] [CE 3.883 (4.214)] [KD 0.000 (0.000)] 2024-10-11 11:12:45,055 - Train: 6.79% [25500/375300] [20.4/300.0] [batch_t 0.405 (0.425)] [data_t 0.117] [optim_t 0.288] [lr 0.002966] [CE 3.806 (4.164)] [KD 0.000 (0.000)] 2024-10-11 11:13:06,113 - Train: 6.81% [25550/375300] [20.4/300.0] [batch_t 0.406 (0.421)] [data_t 0.116] [optim_t 0.290] [lr 0.002966] [CE 4.200 (4.207)] [KD 0.000 (0.000)] 2024-10-11 11:13:27,058 - Train: 6.82% [25600/375300] [20.5/300.0] [batch_t 0.452 (0.419)] [data_t 0.162] [optim_t 0.290] [lr 0.002966] [CE 4.016 (4.208)] [KD 0.000 (0.000)] 2024-10-11 11:13:48,668 - Train: 6.83% [25650/375300] [20.5/300.0] [batch_t 0.404 (0.432)] [data_t 0.112] [optim_t 0.291] [lr 0.002966] [CE 4.258 (4.184)] [KD 0.000 (0.000)] 2024-10-11 11:14:09,778 - Train: 6.85% [25700/375300] [20.5/300.0] [batch_t 0.362 (0.422)] [data_t 0.073] [optim_t 0.289] [lr 0.002966] [CE 4.641 (4.181)] [KD 0.000 (0.000)] 2024-10-11 11:14:31,319 - Train: 6.86% [25750/375300] [20.6/300.0] [batch_t 0.412 (0.431)] [data_t 0.118] [optim_t 0.294] [lr 0.002966] [CE 3.751 (4.219)] [KD 0.000 (0.000)] 2024-10-11 11:14:52,506 - Train: 6.87% [25800/375300] [20.6/300.0] [batch_t 0.459 (0.424)] [data_t 0.170] [optim_t 0.289] [lr 0.002966] [CE 4.043 (4.208)] [KD 0.000 (0.000)] 2024-10-11 11:15:13,900 - Train: 6.89% [25850/375300] [20.7/300.0] [batch_t 0.335 (0.428)] [data_t 0.043] [optim_t 0.292] [lr 0.002965] [CE 4.357 (4.173)] [KD 0.000 (0.000)] 2024-10-11 11:15:35,208 - Train: 6.90% [25900/375300] [20.7/300.0] [batch_t 0.346 (0.426)] [data_t 0.055] [optim_t 0.291] [lr 0.002965] [CE 4.064 (4.219)] [KD 0.000 (0.000)] 2024-10-11 11:15:57,143 - Train: 6.91% [25950/375300] [20.7/300.0] [batch_t 0.408 (0.439)] [data_t 0.119] [optim_t 0.289] [lr 0.002965] [CE 4.171 (4.188)] [KD 0.000 (0.000)] 2024-10-11 11:16:18,811 - Train: 6.93% [26000/375300] [20.8/300.0] [batch_t 0.450 (0.433)] [data_t 0.159] [optim_t 0.291] [lr 0.002965] [CE 4.113 (4.227)] [KD 0.000 (0.000)] 2024-10-11 11:16:40,496 - Train: 6.94% [26050/375300] [20.8/300.0] [batch_t 0.405 (0.434)] [data_t 0.115] [optim_t 0.290] [lr 0.002965] [CE 3.887 (4.197)] [KD 0.000 (0.000)] 2024-10-11 11:17:02,285 - Train: 6.95% [26100/375300] [20.9/300.0] [batch_t 0.387 (0.436)] [data_t 0.095] [optim_t 0.292] [lr 0.002965] [CE 3.912 (4.239)] [KD 0.000 (0.000)] 2024-10-11 11:17:24,180 - Train: 6.97% [26150/375300] [20.9/300.0] [batch_t 0.454 (0.438)] [data_t 0.165] [optim_t 0.289] [lr 0.002965] [CE 3.854 (4.230)] [KD 0.000 (0.000)] 2024-10-11 11:17:45,655 - Train: 6.98% [26200/375300] [20.9/300.0] [batch_t 0.498 (0.429)] [data_t 0.209] [optim_t 0.289] [lr 0.002964] [CE 4.221 (4.081)] [KD 0.000 (0.000)] 2024-10-11 11:18:07,058 - Train: 6.99% [26250/375300] [21.0/300.0] [batch_t 0.364 (0.428)] [data_t 0.076] [optim_t 0.288] [lr 0.002964] [CE 4.120 (4.154)] [KD 0.000 (0.000)] 2024-10-11 11:18:14,661 - ==> Total time: 3:08:15 Eta: 1 day, 17:41:04 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 11:18:29,754 - Train: 7.01% [26300/375300] [21.0/300.0] [batch_t 0.307 (0.464)] [data_t 0.015] [optim_t 0.292] [lr 0.002964] [CE 4.112 (4.199)] [KD 0.000 (0.000)] 2024-10-11 11:18:50,397 - Train: 7.02% [26350/375300] [21.1/300.0] [batch_t 0.419 (0.413)] [data_t 0.015] [optim_t 0.404] [lr 0.002964] [CE 4.017 (4.179)] [KD 0.000 (0.000)] 2024-10-11 11:19:10,727 - Train: 7.03% [26400/375300] [21.1/300.0] [batch_t 0.392 (0.407)] [data_t 0.015] [optim_t 0.376] [lr 0.002964] [CE 3.871 (4.146)] [KD 0.000 (0.000)] 2024-10-11 11:19:31,391 - Train: 7.05% [26450/375300] [21.1/300.0] [batch_t 0.412 (0.413)] [data_t 0.015] [optim_t 0.397] [lr 0.002964] [CE 3.963 (4.177)] [KD 0.000 (0.000)] 2024-10-11 11:19:52,491 - Train: 7.06% [26500/375300] [21.2/300.0] [batch_t 0.467 (0.422)] [data_t 0.015] [optim_t 0.451] [lr 0.002964] [CE 4.065 (4.156)] [KD 0.000 (0.000)] 2024-10-11 11:20:13,668 - Train: 7.07% [26550/375300] [21.2/300.0] [batch_t 0.402 (0.423)] [data_t 0.015] [optim_t 0.386] [lr 0.002963] [CE 4.464 (4.215)] [KD 0.000 (0.000)] 2024-10-11 11:20:34,646 - Train: 7.09% [26600/375300] [21.3/300.0] [batch_t 0.439 (0.419)] [data_t 0.015] [optim_t 0.424] [lr 0.002963] [CE 4.312 (4.191)] [KD 0.000 (0.000)] 2024-10-11 11:20:55,632 - Train: 7.10% [26650/375300] [21.3/300.0] [batch_t 0.402 (0.420)] [data_t 0.016] [optim_t 0.387] [lr 0.002963] [CE 4.069 (4.150)] [KD 0.000 (0.000)] 2024-10-11 11:21:16,451 - Train: 7.11% [26700/375300] [21.3/300.0] [batch_t 0.468 (0.416)] [data_t 0.015] [optim_t 0.452] [lr 0.002963] [CE 4.088 (4.196)] [KD 0.000 (0.000)] 2024-10-11 11:21:37,111 - Train: 7.13% [26750/375300] [21.4/300.0] [batch_t 0.408 (0.413)] [data_t 0.016] [optim_t 0.393] [lr 0.002963] [CE 4.338 (4.182)] [KD 0.000 (0.000)] 2024-10-11 11:21:57,856 - Train: 7.14% [26800/375300] [21.4/300.0] [batch_t 0.482 (0.415)] [data_t 0.015] [optim_t 0.467] [lr 0.002963] [CE 4.188 (4.184)] [KD 0.000 (0.000)] 2024-10-11 11:22:18,489 - Train: 7.15% [26850/375300] [21.5/300.0] [batch_t 0.474 (0.413)] [data_t 0.016] [optim_t 0.459] [lr 0.002963] [CE 4.343 (4.171)] [KD 0.000 (0.000)] 2024-10-11 11:22:39,808 - Train: 7.17% [26900/375300] [21.5/300.0] [batch_t 0.366 (0.426)] [data_t 0.016] [optim_t 0.351] [lr 0.002963] [CE 4.047 (4.159)] [KD 0.000 (0.000)] 2024-10-11 11:23:01,388 - Train: 7.18% [26950/375300] [21.5/300.0] [batch_t 0.439 (0.431)] [data_t 0.015] [optim_t 0.423] [lr 0.002962] [CE 4.296 (4.196)] [KD 0.000 (0.000)] 2024-10-11 11:23:22,610 - Train: 7.19% [27000/375300] [21.6/300.0] [batch_t 0.444 (0.424)] [data_t 0.016] [optim_t 0.428] [lr 0.002962] [CE 4.269 (4.186)] [KD 0.000 (0.000)] 2024-10-11 11:23:43,581 - Train: 7.21% [27050/375300] [21.6/300.0] [batch_t 0.312 (0.419)] [data_t 0.015] [optim_t 0.296] [lr 0.002962] [CE 4.248 (4.141)] [KD 0.000 (0.000)] 2024-10-11 11:24:04,698 - Train: 7.22% [27100/375300] [21.7/300.0] [batch_t 0.399 (0.422)] [data_t 0.015] [optim_t 0.384] [lr 0.002962] [CE 4.044 (4.176)] [KD 0.000 (0.000)] 2024-10-11 11:24:25,920 - Train: 7.23% [27150/375300] [21.7/300.0] [batch_t 0.402 (0.424)] [data_t 0.016] [optim_t 0.386] [lr 0.002962] [CE 4.237 (4.139)] [KD 0.000 (0.000)] 2024-10-11 11:24:47,191 - Train: 7.25% [27200/375300] [21.7/300.0] [batch_t 0.419 (0.425)] [data_t 0.015] [optim_t 0.403] [lr 0.002962] [CE 4.456 (4.187)] [KD 0.000 (0.000)] 2024-10-11 11:25:07,804 - Train: 7.26% [27250/375300] [21.8/300.0] [batch_t 0.435 (0.412)] [data_t 0.015] [optim_t 0.420] [lr 0.002962] [CE 4.258 (4.191)] [KD 0.000 (0.000)] 2024-10-11 11:25:28,772 - Train: 7.27% [27300/375300] [21.8/300.0] [batch_t 0.457 (0.419)] [data_t 0.015] [optim_t 0.441] [lr 0.002961] [CE 4.191 (4.153)] [KD 0.000 (0.000)] 2024-10-11 11:25:49,370 - Train: 7.29% [27350/375300] [21.9/300.0] [batch_t 0.418 (0.412)] [data_t 0.015] [optim_t 0.402] [lr 0.002961] [CE 4.153 (4.167)] [KD 0.000 (0.000)] 2024-10-11 11:26:10,037 - Train: 7.30% [27400/375300] [21.9/300.0] [batch_t 0.424 (0.413)] [data_t 0.015] [optim_t 0.409] [lr 0.002961] [CE 4.172 (4.152)] [KD 0.000 (0.000)] 2024-10-11 11:26:30,647 - Train: 7.31% [27450/375300] [21.9/300.0] [batch_t 0.421 (0.412)] [data_t 0.015] [optim_t 0.406] [lr 0.002961] [CE 4.093 (4.154)] [KD 0.000 (0.000)] 2024-10-11 11:26:51,398 - Train: 7.33% [27500/375300] [22.0/300.0] [batch_t 0.424 (0.415)] [data_t 0.015] [optim_t 0.408] [lr 0.002961] [CE 3.780 (4.158)] [KD 0.000 (0.000)] 2024-10-11 11:26:59,509 - ==> Total time: 3:17:00 Eta: 1 day, 17:29:22 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 11:27:14,952 - Train: 7.34% [27550/375300] [22.0/300.0] [batch_t 0.356 (0.497)] [data_t 0.064] [optim_t 0.292] [lr 0.002961] [CE 4.254 (4.132)] [KD 0.000 (0.000)] 2024-10-11 11:27:37,343 - Train: 7.35% [27600/375300] [22.1/300.0] [batch_t 0.495 (0.448)] [data_t 0.203] [optim_t 0.292] [lr 0.002961] [CE 3.997 (4.120)] [KD 0.000 (0.000)] 2024-10-11 11:27:58,202 - Train: 7.37% [27650/375300] [22.1/300.0] [batch_t 0.398 (0.417)] [data_t 0.108] [optim_t 0.290] [lr 0.002960] [CE 4.032 (4.148)] [KD 0.000 (0.000)] 2024-10-11 11:28:19,139 - Train: 7.38% [27700/375300] [22.1/300.0] [batch_t 0.348 (0.419)] [data_t 0.015] [optim_t 0.333] [lr 0.002960] [CE 4.106 (4.192)] [KD 0.000 (0.000)] 2024-10-11 11:28:40,196 - Train: 7.39% [27750/375300] [22.2/300.0] [batch_t 0.371 (0.421)] [data_t 0.015] [optim_t 0.356] [lr 0.002960] [CE 4.174 (4.162)] [KD 0.000 (0.000)] 2024-10-11 11:29:01,626 - Train: 7.41% [27800/375300] [22.2/300.0] [batch_t 0.504 (0.428)] [data_t 0.015] [optim_t 0.489] [lr 0.002960] [CE 3.700 (4.164)] [KD 0.000 (0.000)] 2024-10-11 11:29:22,841 - Train: 7.42% [27850/375300] [22.3/300.0] [batch_t 0.473 (0.424)] [data_t 0.015] [optim_t 0.457] [lr 0.002960] [CE 4.373 (4.153)] [KD 0.000 (0.000)] 2024-10-11 11:29:43,438 - Train: 7.43% [27900/375300] [22.3/300.0] [batch_t 0.379 (0.412)] [data_t 0.015] [optim_t 0.364] [lr 0.002960] [CE 4.278 (4.176)] [KD 0.000 (0.000)] 2024-10-11 11:30:04,025 - Train: 7.45% [27950/375300] [22.3/300.0] [batch_t 0.362 (0.412)] [data_t 0.015] [optim_t 0.346] [lr 0.002960] [CE 4.228 (4.136)] [KD 0.000 (0.000)] 2024-10-11 11:30:24,250 - Train: 7.46% [28000/375300] [22.4/300.0] [batch_t 0.428 (0.404)] [data_t 0.015] [optim_t 0.413] [lr 0.002959] [CE 4.007 (4.160)] [KD 0.000 (0.000)] 2024-10-11 11:30:45,322 - Train: 7.47% [28050/375300] [22.4/300.0] [batch_t 0.510 (0.421)] [data_t 0.015] [optim_t 0.494] [lr 0.002959] [CE 4.203 (4.179)] [KD 0.000 (0.000)] 2024-10-11 11:31:05,760 - Train: 7.49% [28100/375300] [22.5/300.0] [batch_t 0.324 (0.409)] [data_t 0.015] [optim_t 0.309] [lr 0.002959] [CE 3.848 (4.141)] [KD 0.000 (0.000)] 2024-10-11 11:31:26,610 - Train: 7.50% [28150/375300] [22.5/300.0] [batch_t 0.418 (0.417)] [data_t 0.015] [optim_t 0.403] [lr 0.002959] [CE 4.152 (4.117)] [KD 0.000 (0.000)] 2024-10-11 11:31:47,396 - Train: 7.51% [28200/375300] [22.5/300.0] [batch_t 0.455 (0.416)] [data_t 0.015] [optim_t 0.440] [lr 0.002959] [CE 4.023 (4.113)] [KD 0.000 (0.000)] 2024-10-11 11:32:08,521 - Train: 7.53% [28250/375300] [22.6/300.0] [batch_t 0.552 (0.415)] [data_t 0.015] [optim_t 0.536] [lr 0.002959] [CE 4.178 (4.190)] [KD 0.000 (0.000)] 2024-10-11 11:32:29,147 - Train: 7.54% [28300/375300] [22.6/300.0] [batch_t 0.389 (0.412)] [data_t 0.015] [optim_t 0.373] [lr 0.002959] [CE 4.309 (4.152)] [KD 0.000 (0.000)] 2024-10-11 11:32:49,887 - Train: 7.55% [28350/375300] [22.7/300.0] [batch_t 0.426 (0.415)] [data_t 0.015] [optim_t 0.411] [lr 0.002958] [CE 4.356 (4.112)] [KD 0.000 (0.000)] 2024-10-11 11:33:10,615 - Train: 7.57% [28400/375300] [22.7/300.0] [batch_t 0.396 (0.414)] [data_t 0.015] [optim_t 0.380] [lr 0.002958] [CE 4.170 (4.149)] [KD 0.000 (0.000)] 2024-10-11 11:33:31,265 - Train: 7.58% [28450/375300] [22.7/300.0] [batch_t 0.415 (0.413)] [data_t 0.015] [optim_t 0.400] [lr 0.002958] [CE 4.117 (4.164)] [KD 0.000 (0.000)] 2024-10-11 11:33:52,475 - Train: 7.59% [28500/375300] [22.8/300.0] [batch_t 0.473 (0.424)] [data_t 0.015] [optim_t 0.457] [lr 0.002958] [CE 4.121 (4.119)] [KD 0.000 (0.000)] 2024-10-11 11:34:13,551 - Train: 7.61% [28550/375300] [22.8/300.0] [batch_t 0.441 (0.421)] [data_t 0.015] [optim_t 0.426] [lr 0.002958] [CE 4.236 (4.163)] [KD 0.000 (0.000)] 2024-10-11 11:34:34,888 - Train: 7.62% [28600/375300] [22.9/300.0] [batch_t 0.492 (0.427)] [data_t 0.015] [optim_t 0.477] [lr 0.002958] [CE 4.180 (4.161)] [KD 0.000 (0.000)] 2024-10-11 11:34:55,627 - Train: 7.63% [28650/375300] [22.9/300.0] [batch_t 0.344 (0.415)] [data_t 0.015] [optim_t 0.328] [lr 0.002958] [CE 3.919 (4.154)] [KD 0.000 (0.000)] 2024-10-11 11:35:16,872 - Train: 7.65% [28700/375300] [22.9/300.0] [batch_t 0.413 (0.425)] [data_t 0.015] [optim_t 0.398] [lr 0.002957] [CE 4.061 (4.147)] [KD 0.000 (0.000)] 2024-10-11 11:35:38,553 - Train: 7.66% [28750/375300] [23.0/300.0] [batch_t 0.475 (0.434)] [data_t 0.015] [optim_t 0.459] [lr 0.002957] [CE 3.952 (4.121)] [KD 0.000 (0.000)] 2024-10-11 11:35:46,787 - ==> Total time: 3:25:47 Eta: 1 day, 17:18:24 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 11:36:02,225 - Train: 7.67% [28800/375300] [23.0/300.0] [batch_t 0.513 (0.518)] [data_t 0.087] [optim_t 0.426] [lr 0.002957] [CE 3.752 (4.140)] [KD 0.000 (0.000)] 2024-10-11 11:36:23,713 - Train: 7.69% [28850/375300] [23.1/300.0] [batch_t 0.425 (0.430)] [data_t 0.015] [optim_t 0.409] [lr 0.002957] [CE 4.145 (4.150)] [KD 0.000 (0.000)] 2024-10-11 11:36:46,424 - Train: 7.70% [28900/375300] [23.1/300.0] [batch_t 0.303 (0.454)] [data_t 0.016] [optim_t 0.287] [lr 0.002957] [CE 3.896 (4.163)] [KD 0.000 (0.000)] 2024-10-11 11:37:07,477 - Train: 7.71% [28950/375300] [23.1/300.0] [batch_t 0.403 (0.421)] [data_t 0.113] [optim_t 0.290] [lr 0.002957] [CE 4.085 (4.152)] [KD 0.000 (0.000)] 2024-10-11 11:37:29,206 - Train: 7.73% [29000/375300] [23.2/300.0] [batch_t 0.354 (0.434)] [data_t 0.064] [optim_t 0.290] [lr 0.002956] [CE 4.439 (4.100)] [KD 0.000 (0.000)] 2024-10-11 11:37:50,887 - Train: 7.74% [29050/375300] [23.2/300.0] [batch_t 0.441 (0.434)] [data_t 0.148] [optim_t 0.293] [lr 0.002956] [CE 4.266 (4.162)] [KD 0.000 (0.000)] 2024-10-11 11:38:12,243 - Train: 7.75% [29100/375300] [23.3/300.0] [batch_t 0.473 (0.427)] [data_t 0.183] [optim_t 0.290] [lr 0.002956] [CE 4.638 (4.149)] [KD 0.000 (0.000)] 2024-10-11 11:38:33,333 - Train: 7.77% [29150/375300] [23.3/300.0] [batch_t 0.420 (0.422)] [data_t 0.132] [optim_t 0.288] [lr 0.002956] [CE 4.241 (4.097)] [KD 0.000 (0.000)] 2024-10-11 11:38:54,399 - Train: 7.78% [29200/375300] [23.3/300.0] [batch_t 0.364 (0.421)] [data_t 0.076] [optim_t 0.288] [lr 0.002956] [CE 4.345 (4.100)] [KD 0.000 (0.000)] 2024-10-11 11:39:16,004 - Train: 7.79% [29250/375300] [23.4/300.0] [batch_t 0.421 (0.432)] [data_t 0.133] [optim_t 0.288] [lr 0.002956] [CE 4.178 (4.146)] [KD 0.000 (0.000)] 2024-10-11 11:39:36,979 - Train: 7.81% [29300/375300] [23.4/300.0] [batch_t 0.353 (0.419)] [data_t 0.063] [optim_t 0.289] [lr 0.002956] [CE 3.942 (4.139)] [KD 0.000 (0.000)] 2024-10-11 11:39:57,727 - Train: 7.82% [29350/375300] [23.5/300.0] [batch_t 0.440 (0.415)] [data_t 0.151] [optim_t 0.290] [lr 0.002955] [CE 4.179 (4.097)] [KD 0.000 (0.000)] 2024-10-11 11:40:18,191 - Train: 7.83% [29400/375300] [23.5/300.0] [batch_t 0.423 (0.409)] [data_t 0.134] [optim_t 0.289] [lr 0.002955] [CE 4.328 (4.120)] [KD 0.000 (0.000)] 2024-10-11 11:40:38,610 - Train: 7.85% [29450/375300] [23.5/300.0] [batch_t 0.306 (0.408)] [data_t 0.015] [optim_t 0.290] [lr 0.002955] [CE 3.749 (4.051)] [KD 0.000 (0.000)] 2024-10-11 11:40:59,454 - Train: 7.86% [29500/375300] [23.6/300.0] [batch_t 0.394 (0.417)] [data_t 0.102] [optim_t 0.292] [lr 0.002955] [CE 4.222 (4.142)] [KD 0.000 (0.000)] 2024-10-11 11:41:19,956 - Train: 7.87% [29550/375300] [23.6/300.0] [batch_t 0.345 (0.410)] [data_t 0.054] [optim_t 0.291] [lr 0.002955] [CE 4.199 (4.121)] [KD 0.000 (0.000)] 2024-10-11 11:41:40,881 - Train: 7.89% [29600/375300] [23.7/300.0] [batch_t 0.417 (0.418)] [data_t 0.015] [optim_t 0.402] [lr 0.002955] [CE 4.347 (4.142)] [KD 0.000 (0.000)] 2024-10-11 11:42:02,023 - Train: 7.90% [29650/375300] [23.7/300.0] [batch_t 0.474 (0.423)] [data_t 0.016] [optim_t 0.459] [lr 0.002954] [CE 3.993 (4.147)] [KD 0.000 (0.000)] 2024-10-11 11:42:23,205 - Train: 7.91% [29700/375300] [23.7/300.0] [batch_t 0.323 (0.424)] [data_t 0.015] [optim_t 0.308] [lr 0.002954] [CE 4.286 (4.127)] [KD 0.000 (0.000)] 2024-10-11 11:42:44,510 - Train: 7.93% [29750/375300] [23.8/300.0] [batch_t 0.445 (0.426)] [data_t 0.015] [optim_t 0.429] [lr 0.002954] [CE 4.357 (4.163)] [KD 0.000 (0.000)] 2024-10-11 11:43:06,145 - Train: 7.94% [29800/375300] [23.8/300.0] [batch_t 0.362 (0.433)] [data_t 0.015] [optim_t 0.347] [lr 0.002954] [CE 3.868 (4.084)] [KD 0.000 (0.000)] 2024-10-11 11:43:27,990 - Train: 7.95% [29850/375300] [23.9/300.0] [batch_t 0.307 (0.437)] [data_t 0.015] [optim_t 0.292] [lr 0.002954] [CE 3.680 (4.125)] [KD 0.000 (0.000)] 2024-10-11 11:43:50,098 - Train: 7.97% [29900/375300] [23.9/300.0] [batch_t 0.490 (0.442)] [data_t 0.015] [optim_t 0.475] [lr 0.002954] [CE 3.798 (4.137)] [KD 0.000 (0.000)] 2024-10-11 11:44:11,231 - Train: 7.98% [29950/375300] [23.9/300.0] [batch_t 0.527 (0.423)] [data_t 0.015] [optim_t 0.512] [lr 0.002954] [CE 4.094 (4.124)] [KD 0.000 (0.000)] 2024-10-11 11:44:32,150 - Train: 7.99% [30000/375300] [24.0/300.0] [batch_t 0.476 (0.418)] [data_t 0.015] [optim_t 0.461] [lr 0.002953] [CE 4.291 (4.159)] [KD 0.000 (0.000)] 2024-10-11 11:44:40,744 - ==> Total time: 3:34:41 Eta: 1 day, 17:08:54 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 11:44:55,657 - Train: 8.01% [30050/375300] [24.0/300.0] [batch_t 0.540 (0.520)] [data_t 0.015] [optim_t 0.524] [lr 0.002953] [CE 4.396 (4.097)] [KD 0.000 (0.000)] 2024-10-11 11:45:16,140 - Train: 8.02% [30100/375300] [24.1/300.0] [batch_t 0.489 (0.410)] [data_t 0.015] [optim_t 0.474] [lr 0.002953] [CE 4.190 (4.054)] [KD 0.000 (0.000)] 2024-10-11 11:45:37,179 - Train: 8.03% [30150/375300] [24.1/300.0] [batch_t 0.433 (0.421)] [data_t 0.015] [optim_t 0.418] [lr 0.002953] [CE 4.309 (4.099)] [KD 0.000 (0.000)] 2024-10-11 11:45:58,299 - Train: 8.05% [30200/375300] [24.1/300.0] [batch_t 0.502 (0.422)] [data_t 0.015] [optim_t 0.487] [lr 0.002953] [CE 4.095 (4.113)] [KD 0.000 (0.000)] 2024-10-11 11:46:19,468 - Train: 8.06% [30250/375300] [24.2/300.0] [batch_t 0.422 (0.423)] [data_t 0.015] [optim_t 0.407] [lr 0.002953] [CE 4.265 (4.124)] [KD 0.000 (0.000)] 2024-10-11 11:46:40,681 - Train: 8.07% [30300/375300] [24.2/300.0] [batch_t 0.387 (0.424)] [data_t 0.015] [optim_t 0.372] [lr 0.002952] [CE 3.707 (4.093)] [KD 0.000 (0.000)] 2024-10-11 11:47:01,637 - Train: 8.09% [30350/375300] [24.3/300.0] [batch_t 0.469 (0.419)] [data_t 0.015] [optim_t 0.454] [lr 0.002952] [CE 4.232 (4.092)] [KD 0.000 (0.000)] 2024-10-11 11:47:22,843 - Train: 8.10% [30400/375300] [24.3/300.0] [batch_t 0.419 (0.424)] [data_t 0.015] [optim_t 0.404] [lr 0.002952] [CE 3.815 (4.103)] [KD 0.000 (0.000)] 2024-10-11 11:47:43,873 - Train: 8.11% [30450/375300] [24.3/300.0] [batch_t 0.436 (0.421)] [data_t 0.015] [optim_t 0.420] [lr 0.002952] [CE 3.827 (4.086)] [KD 0.000 (0.000)] 2024-10-11 11:48:04,928 - Train: 8.13% [30500/375300] [24.4/300.0] [batch_t 0.367 (0.421)] [data_t 0.015] [optim_t 0.352] [lr 0.002952] [CE 4.243 (4.128)] [KD 0.000 (0.000)] 2024-10-11 11:48:25,412 - Train: 8.14% [30550/375300] [24.4/300.0] [batch_t 0.416 (0.410)] [data_t 0.015] [optim_t 0.401] [lr 0.002952] [CE 4.075 (4.145)] [KD 0.000 (0.000)] 2024-10-11 11:48:46,283 - Train: 8.15% [30600/375300] [24.5/300.0] [batch_t 0.472 (0.417)] [data_t 0.015] [optim_t 0.457] [lr 0.002952] [CE 4.522 (4.065)] [KD 0.000 (0.000)] 2024-10-11 11:49:06,858 - Train: 8.17% [30650/375300] [24.5/300.0] [batch_t 0.459 (0.411)] [data_t 0.015] [optim_t 0.444] [lr 0.002951] [CE 3.820 (4.108)] [KD 0.000 (0.000)] 2024-10-11 11:49:27,762 - Train: 8.18% [30700/375300] [24.5/300.0] [batch_t 0.372 (0.418)] [data_t 0.015] [optim_t 0.357] [lr 0.002951] [CE 3.748 (4.080)] [KD 0.000 (0.000)] 2024-10-11 11:49:48,481 - Train: 8.19% [30750/375300] [24.6/300.0] [batch_t 0.415 (0.414)] [data_t 0.015] [optim_t 0.399] [lr 0.002951] [CE 4.060 (4.102)] [KD 0.000 (0.000)] 2024-10-11 11:50:09,129 - Train: 8.21% [30800/375300] [24.6/300.0] [batch_t 0.371 (0.413)] [data_t 0.015] [optim_t 0.355] [lr 0.002951] [CE 3.875 (4.102)] [KD 0.000 (0.000)] 2024-10-11 11:50:29,941 - Train: 8.22% [30850/375300] [24.7/300.0] [batch_t 0.408 (0.416)] [data_t 0.015] [optim_t 0.392] [lr 0.002951] [CE 4.086 (4.108)] [KD 0.000 (0.000)] 2024-10-11 11:50:50,566 - Train: 8.23% [30900/375300] [24.7/300.0] [batch_t 0.361 (0.412)] [data_t 0.015] [optim_t 0.346] [lr 0.002951] [CE 4.010 (4.150)] [KD 0.000 (0.000)] 2024-10-11 11:51:11,317 - Train: 8.25% [30950/375300] [24.7/300.0] [batch_t 0.437 (0.415)] [data_t 0.015] [optim_t 0.421] [lr 0.002950] [CE 3.904 (4.146)] [KD 0.000 (0.000)] 2024-10-11 11:51:32,376 - Train: 8.26% [31000/375300] [24.8/300.0] [batch_t 0.512 (0.421)] [data_t 0.015] [optim_t 0.497] [lr 0.002950] [CE 3.802 (4.074)] [KD 0.000 (0.000)] 2024-10-11 11:51:53,416 - Train: 8.27% [31050/375300] [24.8/300.0] [batch_t 0.387 (0.421)] [data_t 0.015] [optim_t 0.371] [lr 0.002950] [CE 3.951 (4.118)] [KD 0.000 (0.000)] 2024-10-11 11:52:14,546 - Train: 8.29% [31100/375300] [24.9/300.0] [batch_t 0.413 (0.422)] [data_t 0.015] [optim_t 0.398] [lr 0.002950] [CE 4.136 (4.067)] [KD 0.000 (0.000)] 2024-10-11 11:52:35,566 - Train: 8.30% [31150/375300] [24.9/300.0] [batch_t 0.413 (0.420)] [data_t 0.015] [optim_t 0.398] [lr 0.002950] [CE 3.801 (4.098)] [KD 0.000 (0.000)] 2024-10-11 11:52:56,666 - Train: 8.31% [31200/375300] [24.9/300.0] [batch_t 0.400 (0.422)] [data_t 0.015] [optim_t 0.385] [lr 0.002950] [CE 3.837 (4.124)] [KD 0.000 (0.000)] 2024-10-11 11:53:17,450 - Train: 8.33% [31250/375300] [25.0/300.0] [batch_t 0.461 (0.416)] [data_t 0.015] [optim_t 0.445] [lr 0.002949] [CE 4.172 (4.061)] [KD 0.000 (0.000)] 2024-10-11 11:53:47,428 - Test (net): 100.00% [50/50] [batch_t 0.141 (0.412)] [top1_cnt 32457] [top5_cnt 43552] [top_all 50000] 2024-10-11 11:53:47,428 - net: 64.914 (87.104) 2024-10-11 11:54:08,127 - Test (net_E): 100.00% [50/50] [batch_t 0.153 (0.407)] [top1_cnt 34358] [top5_cnt 44585] [top_all 50000] 2024-10-11 11:54:08,128 - net_E: 68.716 (89.170) 2024-10-11 11:54:08,305 - Max [top1: 64.914 (epoch: 25)] [top1-ema: 68.716 (epoch: 25)] 2024-10-11 11:54:08,305 - ==> Total time: 3:44:08 Eta: 1 day, 17:05:36 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 11:54:24,551 - Train: 8.34% [31300/375300] [25.0/300.0] [batch_t 0.425 (0.411)] [data_t 0.015] [optim_t 0.410] [lr 0.002949] [CE 4.456 (4.045)] [KD 0.000 (0.000)] 2024-10-11 11:54:45,172 - Train: 8.35% [31350/375300] [25.1/300.0] [batch_t 0.429 (0.412)] [data_t 0.015] [optim_t 0.413] [lr 0.002949] [CE 4.035 (4.105)] [KD 0.000 (0.000)] 2024-10-11 11:55:06,332 - Train: 8.37% [31400/375300] [25.1/300.0] [batch_t 0.306 (0.423)] [data_t 0.016] [optim_t 0.291] [lr 0.002949] [CE 3.722 (4.096)] [KD 0.000 (0.000)] 2024-10-11 11:55:27,465 - Train: 8.38% [31450/375300] [25.1/300.0] [batch_t 0.433 (0.423)] [data_t 0.015] [optim_t 0.417] [lr 0.002949] [CE 4.151 (4.163)] [KD 0.000 (0.000)] 2024-10-11 11:55:48,745 - Train: 8.39% [31500/375300] [25.2/300.0] [batch_t 0.482 (0.425)] [data_t 0.015] [optim_t 0.466] [lr 0.002949] [CE 4.179 (4.125)] [KD 0.000 (0.000)] 2024-10-11 11:56:09,776 - Train: 8.41% [31550/375300] [25.2/300.0] [batch_t 0.397 (0.421)] [data_t 0.015] [optim_t 0.382] [lr 0.002949] [CE 3.934 (4.076)] [KD 0.000 (0.000)] 2024-10-11 11:56:30,664 - Train: 8.42% [31600/375300] [25.3/300.0] [batch_t 0.483 (0.418)] [data_t 0.015] [optim_t 0.468] [lr 0.002948] [CE 4.009 (4.103)] [KD 0.000 (0.000)] 2024-10-11 11:56:51,252 - Train: 8.43% [31650/375300] [25.3/300.0] [batch_t 0.402 (0.412)] [data_t 0.015] [optim_t 0.387] [lr 0.002948] [CE 4.271 (4.089)] [KD 0.000 (0.000)] 2024-10-11 11:57:12,417 - Train: 8.45% [31700/375300] [25.3/300.0] [batch_t 0.496 (0.423)] [data_t 0.015] [optim_t 0.481] [lr 0.002948] [CE 4.357 (4.101)] [KD 0.000 (0.000)] 2024-10-11 11:57:33,251 - Train: 8.46% [31750/375300] [25.4/300.0] [batch_t 0.445 (0.417)] [data_t 0.015] [optim_t 0.429] [lr 0.002948] [CE 4.221 (4.118)] [KD 0.000 (0.000)] 2024-10-11 11:57:54,360 - Train: 8.47% [31800/375300] [25.4/300.0] [batch_t 0.308 (0.422)] [data_t 0.015] [optim_t 0.293] [lr 0.002948] [CE 4.096 (4.088)] [KD 0.000 (0.000)] 2024-10-11 11:58:15,016 - Train: 8.49% [31850/375300] [25.5/300.0] [batch_t 0.401 (0.413)] [data_t 0.015] [optim_t 0.385] [lr 0.002948] [CE 4.240 (4.077)] [KD 0.000 (0.000)] 2024-10-11 11:58:35,857 - Train: 8.50% [31900/375300] [25.5/300.0] [batch_t 0.421 (0.417)] [data_t 0.015] [optim_t 0.406] [lr 0.002947] [CE 4.197 (4.100)] [KD 0.000 (0.000)] 2024-10-11 11:58:56,773 - Train: 8.51% [31950/375300] [25.5/300.0] [batch_t 0.411 (0.418)] [data_t 0.015] [optim_t 0.396] [lr 0.002947] [CE 3.911 (4.073)] [KD 0.000 (0.000)] 2024-10-11 11:59:17,692 - Train: 8.53% [32000/375300] [25.6/300.0] [batch_t 0.422 (0.418)] [data_t 0.015] [optim_t 0.407] [lr 0.002947] [CE 4.215 (4.104)] [KD 0.000 (0.000)] 2024-10-11 11:59:38,195 - Train: 8.54% [32050/375300] [25.6/300.0] [batch_t 0.414 (0.410)] [data_t 0.015] [optim_t 0.398] [lr 0.002947] [CE 3.916 (4.080)] [KD 0.000 (0.000)] 2024-10-11 11:59:59,067 - Train: 8.55% [32100/375300] [25.7/300.0] [batch_t 0.407 (0.417)] [data_t 0.015] [optim_t 0.392] [lr 0.002947] [CE 4.112 (4.095)] [KD 0.000 (0.000)] 2024-10-11 12:00:20,005 - Train: 8.57% [32150/375300] [25.7/300.0] [batch_t 0.425 (0.419)] [data_t 0.015] [optim_t 0.410] [lr 0.002947] [CE 4.200 (4.123)] [KD 0.000 (0.000)] 2024-10-11 12:00:41,370 - Train: 8.58% [32200/375300] [25.7/300.0] [batch_t 0.496 (0.427)] [data_t 0.015] [optim_t 0.480] [lr 0.002946] [CE 3.852 (4.075)] [KD 0.000 (0.000)] 2024-10-11 12:01:02,419 - Train: 8.59% [32250/375300] [25.8/300.0] [batch_t 0.394 (0.421)] [data_t 0.015] [optim_t 0.379] [lr 0.002946] [CE 4.061 (4.063)] [KD 0.000 (0.000)] 2024-10-11 12:01:24,045 - Train: 8.61% [32300/375300] [25.8/300.0] [batch_t 0.467 (0.432)] [data_t 0.015] [optim_t 0.452] [lr 0.002946] [CE 4.115 (4.039)] [KD 0.000 (0.000)] 2024-10-11 12:01:45,736 - Train: 8.62% [32350/375300] [25.9/300.0] [batch_t 0.409 (0.434)] [data_t 0.015] [optim_t 0.394] [lr 0.002946] [CE 4.384 (4.088)] [KD 0.000 (0.000)] 2024-10-11 12:02:07,064 - Train: 8.63% [32400/375300] [25.9/300.0] [batch_t 0.308 (0.426)] [data_t 0.015] [optim_t 0.293] [lr 0.002946] [CE 3.831 (4.057)] [KD 0.000 (0.000)] 2024-10-11 12:02:27,759 - Train: 8.65% [32450/375300] [25.9/300.0] [batch_t 0.310 (0.414)] [data_t 0.015] [optim_t 0.294] [lr 0.002946] [CE 4.098 (4.112)] [KD 0.000 (0.000)] 2024-10-11 12:02:49,187 - Train: 8.66% [32500/375300] [26.0/300.0] [batch_t 0.469 (0.428)] [data_t 0.015] [optim_t 0.453] [lr 0.002945] [CE 4.495 (4.021)] [KD 0.000 (0.000)] 2024-10-11 12:02:58,747 - ==> Total time: 3:52:59 Eta: 1 day, 16:55:19 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 12:03:12,576 - Train: 8.67% [32550/375300] [26.0/300.0] [batch_t 0.309 (0.523)] [data_t 0.015] [optim_t 0.294] [lr 0.002945] [CE 4.096 (4.098)] [KD 0.000 (0.000)] 2024-10-11 12:03:34,738 - Train: 8.69% [32600/375300] [26.1/300.0] [batch_t 0.462 (0.443)] [data_t 0.015] [optim_t 0.447] [lr 0.002945] [CE 4.120 (4.097)] [KD 0.000 (0.000)] 2024-10-11 12:03:56,534 - Train: 8.70% [32650/375300] [26.1/300.0] [batch_t 0.446 (0.436)] [data_t 0.015] [optim_t 0.431] [lr 0.002945] [CE 4.065 (4.030)] [KD 0.000 (0.000)] 2024-10-11 12:04:18,052 - Train: 8.71% [32700/375300] [26.1/300.0] [batch_t 0.438 (0.430)] [data_t 0.015] [optim_t 0.423] [lr 0.002945] [CE 4.164 (4.048)] [KD 0.000 (0.000)] 2024-10-11 12:04:39,654 - Train: 8.73% [32750/375300] [26.2/300.0] [batch_t 0.378 (0.432)] [data_t 0.015] [optim_t 0.363] [lr 0.002945] [CE 4.159 (4.061)] [KD 0.000 (0.000)] 2024-10-11 12:05:01,136 - Train: 8.74% [32800/375300] [26.2/300.0] [batch_t 0.435 (0.430)] [data_t 0.015] [optim_t 0.419] [lr 0.002944] [CE 4.141 (4.086)] [KD 0.000 (0.000)] 2024-10-11 12:05:22,876 - Train: 8.75% [32850/375300] [26.3/300.0] [batch_t 0.436 (0.435)] [data_t 0.015] [optim_t 0.420] [lr 0.002944] [CE 3.949 (4.039)] [KD 0.000 (0.000)] 2024-10-11 12:05:43,170 - Train: 8.77% [32900/375300] [26.3/300.0] [batch_t 0.402 (0.406)] [data_t 0.015] [optim_t 0.386] [lr 0.002944] [CE 3.987 (4.049)] [KD 0.000 (0.000)] 2024-10-11 12:06:02,448 - Train: 8.78% [32950/375300] [26.3/300.0] [batch_t 0.345 (0.385)] [data_t 0.016] [optim_t 0.329] [lr 0.002944] [CE 4.001 (4.097)] [KD 0.000 (0.000)] 2024-10-11 12:06:23,328 - Train: 8.79% [33000/375300] [26.4/300.0] [batch_t 0.391 (0.417)] [data_t 0.099] [optim_t 0.292] [lr 0.002944] [CE 3.923 (4.059)] [KD 0.000 (0.000)] 2024-10-11 12:06:44,596 - Train: 8.81% [33050/375300] [26.4/300.0] [batch_t 0.451 (0.425)] [data_t 0.158] [optim_t 0.292] [lr 0.002944] [CE 4.350 (4.086)] [KD 0.000 (0.000)] 2024-10-11 12:07:06,246 - Train: 8.82% [33100/375300] [26.5/300.0] [batch_t 0.373 (0.433)] [data_t 0.081] [optim_t 0.291] [lr 0.002943] [CE 3.537 (4.031)] [KD 0.000 (0.000)] 2024-10-11 12:07:27,786 - Train: 8.83% [33150/375300] [26.5/300.0] [batch_t 0.405 (0.431)] [data_t 0.113] [optim_t 0.292] [lr 0.002943] [CE 3.854 (4.030)] [KD 0.000 (0.000)] 2024-10-11 12:07:49,295 - Train: 8.85% [33200/375300] [26.5/300.0] [batch_t 0.451 (0.430)] [data_t 0.158] [optim_t 0.293] [lr 0.002943] [CE 3.949 (4.049)] [KD 0.000 (0.000)] 2024-10-11 12:08:10,860 - Train: 8.86% [33250/375300] [26.6/300.0] [batch_t 0.428 (0.431)] [data_t 0.137] [optim_t 0.291] [lr 0.002943] [CE 3.692 (4.038)] [KD 0.000 (0.000)] 2024-10-11 12:08:32,042 - Train: 8.87% [33300/375300] [26.6/300.0] [batch_t 0.465 (0.424)] [data_t 0.173] [optim_t 0.291] [lr 0.002943] [CE 3.844 (4.090)] [KD 0.000 (0.000)] 2024-10-11 12:08:53,056 - Train: 8.89% [33350/375300] [26.7/300.0] [batch_t 0.459 (0.420)] [data_t 0.165] [optim_t 0.294] [lr 0.002943] [CE 3.797 (4.068)] [KD 0.000 (0.000)] 2024-10-11 12:09:13,867 - Train: 8.90% [33400/375300] [26.7/300.0] [batch_t 0.440 (0.416)] [data_t 0.149] [optim_t 0.291] [lr 0.002942] [CE 4.246 (4.113)] [KD 0.000 (0.000)] 2024-10-11 12:09:34,837 - Train: 8.91% [33450/375300] [26.7/300.0] [batch_t 0.308 (0.419)] [data_t 0.016] [optim_t 0.292] [lr 0.002942] [CE 4.147 (4.053)] [KD 0.000 (0.000)] 2024-10-11 12:09:55,528 - Train: 8.93% [33500/375300] [26.8/300.0] [batch_t 0.454 (0.414)] [data_t 0.162] [optim_t 0.292] [lr 0.002942] [CE 3.906 (4.062)] [KD 0.000 (0.000)] 2024-10-11 12:10:16,519 - Train: 8.94% [33550/375300] [26.8/300.0] [batch_t 0.484 (0.420)] [data_t 0.191] [optim_t 0.292] [lr 0.002942] [CE 3.840 (4.052)] [KD 0.000 (0.000)] 2024-10-11 12:10:37,742 - Train: 8.95% [33600/375300] [26.9/300.0] [batch_t 0.487 (0.424)] [data_t 0.194] [optim_t 0.293] [lr 0.002942] [CE 4.229 (3.995)] [KD 0.000 (0.000)] 2024-10-11 12:10:58,760 - Train: 8.97% [33650/375300] [26.9/300.0] [batch_t 0.337 (0.420)] [data_t 0.046] [optim_t 0.291] [lr 0.002941] [CE 3.857 (4.079)] [KD 0.000 (0.000)] 2024-10-11 12:11:19,864 - Train: 8.98% [33700/375300] [26.9/300.0] [batch_t 0.482 (0.422)] [data_t 0.191] [optim_t 0.290] [lr 0.002941] [CE 4.070 (4.055)] [KD 0.000 (0.000)] 2024-10-11 12:11:41,178 - Train: 8.99% [33750/375300] [27.0/300.0] [batch_t 0.567 (0.426)] [data_t 0.275] [optim_t 0.292] [lr 0.002941] [CE 3.437 (4.069)] [KD 0.000 (0.000)] 2024-10-11 12:11:51,093 - ==> Total time: 4:01:51 Eta: 1 day, 16:45:28 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 12:12:04,924 - Train: 9.01% [33800/375300] [27.0/300.0] [batch_t 0.311 (0.538)] [data_t 0.016] [optim_t 0.296] [lr 0.002941] [CE 4.171 (4.050)] [KD 0.000 (0.000)] 2024-10-11 12:12:25,218 - Train: 9.02% [33850/375300] [27.1/300.0] [batch_t 0.487 (0.406)] [data_t 0.015] [optim_t 0.471] [lr 0.002941] [CE 4.076 (4.038)] [KD 0.000 (0.000)] 2024-10-11 12:12:47,007 - Train: 9.03% [33900/375300] [27.1/300.0] [batch_t 0.363 (0.436)] [data_t 0.015] [optim_t 0.347] [lr 0.002941] [CE 4.217 (3.996)] [KD 0.000 (0.000)] 2024-10-11 12:13:09,491 - Train: 9.05% [33950/375300] [27.1/300.0] [batch_t 0.505 (0.450)] [data_t 0.015] [optim_t 0.490] [lr 0.002940] [CE 4.264 (4.063)] [KD 0.000 (0.000)] 2024-10-11 12:13:31,828 - Train: 9.06% [34000/375300] [27.2/300.0] [batch_t 0.524 (0.447)] [data_t 0.015] [optim_t 0.508] [lr 0.002940] [CE 4.233 (4.029)] [KD 0.000 (0.000)] 2024-10-11 12:13:53,870 - Train: 9.07% [34050/375300] [27.2/300.0] [batch_t 0.349 (0.441)] [data_t 0.015] [optim_t 0.333] [lr 0.002940] [CE 3.659 (4.075)] [KD 0.000 (0.000)] 2024-10-11 12:14:16,412 - Train: 9.09% [34100/375300] [27.3/300.0] [batch_t 0.597 (0.451)] [data_t 0.015] [optim_t 0.582] [lr 0.002940] [CE 4.348 (4.092)] [KD 0.000 (0.000)] 2024-10-11 12:14:38,265 - Train: 9.10% [34150/375300] [27.3/300.0] [batch_t 0.465 (0.437)] [data_t 0.015] [optim_t 0.450] [lr 0.002940] [CE 4.183 (4.023)] [KD 0.000 (0.000)] 2024-10-11 12:15:00,019 - Train: 9.11% [34200/375300] [27.3/300.0] [batch_t 0.385 (0.435)] [data_t 0.016] [optim_t 0.370] [lr 0.002940] [CE 4.038 (4.023)] [KD 0.000 (0.000)] 2024-10-11 12:15:21,296 - Train: 9.13% [34250/375300] [27.4/300.0] [batch_t 0.436 (0.425)] [data_t 0.015] [optim_t 0.420] [lr 0.002939] [CE 4.155 (4.008)] [KD 0.000 (0.000)] 2024-10-11 12:15:42,246 - Train: 9.14% [34300/375300] [27.4/300.0] [batch_t 0.411 (0.419)] [data_t 0.015] [optim_t 0.395] [lr 0.002939] [CE 3.993 (4.018)] [KD 0.000 (0.000)] 2024-10-11 12:16:03,091 - Train: 9.15% [34350/375300] [27.5/300.0] [batch_t 0.472 (0.417)] [data_t 0.015] [optim_t 0.456] [lr 0.002939] [CE 3.879 (3.995)] [KD 0.000 (0.000)] 2024-10-11 12:16:23,867 - Train: 9.17% [34400/375300] [27.5/300.0] [batch_t 0.379 (0.415)] [data_t 0.015] [optim_t 0.364] [lr 0.002939] [CE 3.965 (4.071)] [KD 0.000 (0.000)] 2024-10-11 12:16:44,936 - Train: 9.18% [34450/375300] [27.5/300.0] [batch_t 0.389 (0.421)] [data_t 0.097] [optim_t 0.293] [lr 0.002939] [CE 4.008 (4.055)] [KD 0.000 (0.000)] 2024-10-11 12:17:06,617 - Train: 9.19% [34500/375300] [27.6/300.0] [batch_t 0.419 (0.433)] [data_t 0.126] [optim_t 0.293] [lr 0.002939] [CE 4.127 (4.102)] [KD 0.000 (0.000)] 2024-10-11 12:17:28,131 - Train: 9.21% [34550/375300] [27.6/300.0] [batch_t 0.431 (0.430)] [data_t 0.139] [optim_t 0.292] [lr 0.002938] [CE 3.852 (4.049)] [KD 0.000 (0.000)] 2024-10-11 12:17:50,158 - Train: 9.22% [34600/375300] [27.7/300.0] [batch_t 0.647 (0.440)] [data_t 0.356] [optim_t 0.291] [lr 0.002938] [CE 3.692 (4.087)] [KD 0.000 (0.000)] 2024-10-11 12:18:11,336 - Train: 9.23% [34650/375300] [27.7/300.0] [batch_t 0.322 (0.423)] [data_t 0.030] [optim_t 0.292] [lr 0.002938] [CE 3.754 (4.041)] [KD 0.000 (0.000)] 2024-10-11 12:18:32,505 - Train: 9.25% [34700/375300] [27.7/300.0] [batch_t 0.398 (0.423)] [data_t 0.105] [optim_t 0.293] [lr 0.002938] [CE 4.004 (4.059)] [KD 0.000 (0.000)] 2024-10-11 12:18:53,878 - Train: 9.26% [34750/375300] [27.8/300.0] [batch_t 0.421 (0.427)] [data_t 0.129] [optim_t 0.292] [lr 0.002938] [CE 4.435 (4.062)] [KD 0.000 (0.000)] 2024-10-11 12:19:14,848 - Train: 9.27% [34800/375300] [27.8/300.0] [batch_t 0.424 (0.419)] [data_t 0.133] [optim_t 0.291] [lr 0.002937] [CE 4.411 (4.054)] [KD 0.000 (0.000)] 2024-10-11 12:19:35,837 - Train: 9.29% [34850/375300] [27.9/300.0] [batch_t 0.306 (0.420)] [data_t 0.015] [optim_t 0.291] [lr 0.002937] [CE 4.348 (4.066)] [KD 0.000 (0.000)] 2024-10-11 12:19:56,827 - Train: 9.30% [34900/375300] [27.9/300.0] [batch_t 0.370 (0.420)] [data_t 0.080] [optim_t 0.289] [lr 0.002937] [CE 3.949 (4.053)] [KD 0.000 (0.000)] 2024-10-11 12:20:18,259 - Train: 9.31% [34950/375300] [27.9/300.0] [batch_t 0.448 (0.429)] [data_t 0.154] [optim_t 0.294] [lr 0.002937] [CE 4.307 (4.041)] [KD 0.000 (0.000)] 2024-10-11 12:20:39,711 - Train: 9.33% [35000/375300] [28.0/300.0] [batch_t 0.447 (0.429)] [data_t 0.156] [optim_t 0.291] [lr 0.002937] [CE 4.221 (4.034)] [KD 0.000 (0.000)] 2024-10-11 12:20:50,385 - ==> Total time: 4:10:50 Eta: 1 day, 16:36:48 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 12:21:03,616 - Train: 9.34% [35050/375300] [28.0/300.0] [batch_t 0.308 (0.545)] [data_t 0.015] [optim_t 0.292] [lr 0.002937] [CE 4.231 (3.981)] [KD 0.000 (0.000)] 2024-10-11 12:21:24,189 - Train: 9.35% [35100/375300] [28.1/300.0] [batch_t 0.388 (0.411)] [data_t 0.015] [optim_t 0.373] [lr 0.002936] [CE 4.001 (4.046)] [KD 0.000 (0.000)] 2024-10-11 12:21:45,309 - Train: 9.37% [35150/375300] [28.1/300.0] [batch_t 0.432 (0.422)] [data_t 0.015] [optim_t 0.417] [lr 0.002936] [CE 4.189 (4.086)] [KD 0.000 (0.000)] 2024-10-11 12:22:06,860 - Train: 9.38% [35200/375300] [28.1/300.0] [batch_t 0.425 (0.431)] [data_t 0.015] [optim_t 0.409] [lr 0.002936] [CE 3.900 (4.038)] [KD 0.000 (0.000)] 2024-10-11 12:22:28,047 - Train: 9.39% [35250/375300] [28.2/300.0] [batch_t 0.446 (0.424)] [data_t 0.015] [optim_t 0.430] [lr 0.002936] [CE 4.139 (4.071)] [KD 0.000 (0.000)] 2024-10-11 12:22:49,271 - Train: 9.41% [35300/375300] [28.2/300.0] [batch_t 0.438 (0.424)] [data_t 0.016] [optim_t 0.422] [lr 0.002936] [CE 4.325 (4.022)] [KD 0.000 (0.000)] 2024-10-11 12:23:10,136 - Train: 9.42% [35350/375300] [28.3/300.0] [batch_t 0.388 (0.417)] [data_t 0.015] [optim_t 0.372] [lr 0.002935] [CE 4.055 (3.993)] [KD 0.000 (0.000)] 2024-10-11 12:23:30,654 - Train: 9.43% [35400/375300] [28.3/300.0] [batch_t 0.409 (0.410)] [data_t 0.015] [optim_t 0.394] [lr 0.002935] [CE 3.929 (3.999)] [KD 0.000 (0.000)] 2024-10-11 12:23:51,805 - Train: 9.45% [35450/375300] [28.3/300.0] [batch_t 0.481 (0.423)] [data_t 0.015] [optim_t 0.466] [lr 0.002935] [CE 3.791 (4.037)] [KD 0.000 (0.000)] 2024-10-11 12:24:12,997 - Train: 9.46% [35500/375300] [28.4/300.0] [batch_t 0.419 (0.424)] [data_t 0.015] [optim_t 0.404] [lr 0.002935] [CE 3.943 (4.072)] [KD 0.000 (0.000)] 2024-10-11 12:24:34,894 - Train: 9.47% [35550/375300] [28.4/300.0] [batch_t 0.465 (0.438)] [data_t 0.015] [optim_t 0.450] [lr 0.002935] [CE 4.006 (4.025)] [KD 0.000 (0.000)] 2024-10-11 12:24:56,589 - Train: 9.49% [35600/375300] [28.5/300.0] [batch_t 0.417 (0.434)] [data_t 0.015] [optim_t 0.402] [lr 0.002935] [CE 4.243 (4.052)] [KD 0.000 (0.000)] 2024-10-11 12:25:18,239 - Train: 9.50% [35650/375300] [28.5/300.0] [batch_t 0.422 (0.433)] [data_t 0.015] [optim_t 0.406] [lr 0.002934] [CE 3.979 (4.015)] [KD 0.000 (0.000)] 2024-10-11 12:25:39,539 - Train: 9.51% [35700/375300] [28.5/300.0] [batch_t 0.394 (0.426)] [data_t 0.015] [optim_t 0.379] [lr 0.002934] [CE 3.982 (3.963)] [KD 0.000 (0.000)] 2024-10-11 12:26:01,365 - Train: 9.53% [35750/375300] [28.6/300.0] [batch_t 0.373 (0.436)] [data_t 0.016] [optim_t 0.358] [lr 0.002934] [CE 4.113 (4.049)] [KD 0.000 (0.000)] 2024-10-11 12:26:22,624 - Train: 9.54% [35800/375300] [28.6/300.0] [batch_t 0.444 (0.425)] [data_t 0.015] [optim_t 0.428] [lr 0.002934] [CE 4.184 (4.065)] [KD 0.000 (0.000)] 2024-10-11 12:26:44,309 - Train: 9.55% [35850/375300] [28.7/300.0] [batch_t 0.480 (0.434)] [data_t 0.015] [optim_t 0.465] [lr 0.002934] [CE 4.007 (3.951)] [KD 0.000 (0.000)] 2024-10-11 12:27:05,908 - Train: 9.57% [35900/375300] [28.7/300.0] [batch_t 0.461 (0.432)] [data_t 0.015] [optim_t 0.446] [lr 0.002933] [CE 3.857 (4.052)] [KD 0.000 (0.000)] 2024-10-11 12:27:27,383 - Train: 9.58% [35950/375300] [28.7/300.0] [batch_t 0.373 (0.429)] [data_t 0.015] [optim_t 0.358] [lr 0.002933] [CE 4.202 (4.044)] [KD 0.000 (0.000)] 2024-10-11 12:27:48,847 - Train: 9.59% [36000/375300] [28.8/300.0] [batch_t 0.418 (0.429)] [data_t 0.015] [optim_t 0.403] [lr 0.002933] [CE 4.079 (4.018)] [KD 0.000 (0.000)] 2024-10-11 12:28:10,259 - Train: 9.61% [36050/375300] [28.8/300.0] [batch_t 0.391 (0.428)] [data_t 0.015] [optim_t 0.376] [lr 0.002933] [CE 3.922 (4.011)] [KD 0.000 (0.000)] 2024-10-11 12:28:30,377 - Train: 9.62% [36100/375300] [28.9/300.0] [batch_t 0.368 (0.402)] [data_t 0.015] [optim_t 0.353] [lr 0.002933] [CE 4.154 (4.092)] [KD 0.000 (0.000)] 2024-10-11 12:28:50,676 - Train: 9.63% [36150/375300] [28.9/300.0] [batch_t 0.458 (0.406)] [data_t 0.015] [optim_t 0.443] [lr 0.002933] [CE 4.110 (4.014)] [KD 0.000 (0.000)] 2024-10-11 12:29:11,179 - Train: 9.65% [36200/375300] [28.9/300.0] [batch_t 0.436 (0.410)] [data_t 0.015] [optim_t 0.421] [lr 0.002932] [CE 3.730 (4.034)] [KD 0.000 (0.000)] 2024-10-11 12:29:32,030 - Train: 9.66% [36250/375300] [29.0/300.0] [batch_t 0.403 (0.417)] [data_t 0.015] [optim_t 0.388] [lr 0.002932] [CE 4.037 (4.039)] [KD 0.000 (0.000)] 2024-10-11 12:29:42,910 - ==> Total time: 4:19:43 Eta: 1 day, 16:27:04 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 12:29:56,610 - Train: 9.67% [36300/375300] [29.0/300.0] [batch_t 0.311 (0.594)] [data_t 0.015] [optim_t 0.296] [lr 0.002932] [CE 4.028 (4.114)] [KD 0.000 (0.000)] 2024-10-11 12:30:16,878 - Train: 9.69% [36350/375300] [29.1/300.0] [batch_t 0.437 (0.405)] [data_t 0.016] [optim_t 0.422] [lr 0.002932] [CE 3.306 (4.020)] [KD 0.000 (0.000)] 2024-10-11 12:30:38,369 - Train: 9.70% [36400/375300] [29.1/300.0] [batch_t 0.477 (0.430)] [data_t 0.015] [optim_t 0.461] [lr 0.002932] [CE 3.930 (4.025)] [KD 0.000 (0.000)] 2024-10-11 12:30:59,747 - Train: 9.71% [36450/375300] [29.1/300.0] [batch_t 0.478 (0.427)] [data_t 0.015] [optim_t 0.463] [lr 0.002931] [CE 3.630 (4.010)] [KD 0.000 (0.000)] 2024-10-11 12:31:21,266 - Train: 9.73% [36500/375300] [29.2/300.0] [batch_t 0.427 (0.430)] [data_t 0.015] [optim_t 0.411] [lr 0.002931] [CE 3.918 (4.007)] [KD 0.000 (0.000)] 2024-10-11 12:31:42,655 - Train: 9.74% [36550/375300] [29.2/300.0] [batch_t 0.438 (0.428)] [data_t 0.015] [optim_t 0.423] [lr 0.002931] [CE 4.336 (4.001)] [KD 0.000 (0.000)] 2024-10-11 12:32:03,026 - Train: 9.75% [36600/375300] [29.3/300.0] [batch_t 0.426 (0.407)] [data_t 0.016] [optim_t 0.411] [lr 0.002931] [CE 4.120 (4.080)] [KD 0.000 (0.000)] 2024-10-11 12:32:23,584 - Train: 9.77% [36650/375300] [29.3/300.0] [batch_t 0.397 (0.411)] [data_t 0.015] [optim_t 0.381] [lr 0.002931] [CE 3.957 (4.014)] [KD 0.000 (0.000)] 2024-10-11 12:32:44,462 - Train: 9.78% [36700/375300] [29.3/300.0] [batch_t 0.456 (0.417)] [data_t 0.015] [optim_t 0.441] [lr 0.002930] [CE 3.822 (3.979)] [KD 0.000 (0.000)] 2024-10-11 12:33:06,004 - Train: 9.79% [36750/375300] [29.4/300.0] [batch_t 0.469 (0.431)] [data_t 0.015] [optim_t 0.454] [lr 0.002930] [CE 3.908 (4.011)] [KD 0.000 (0.000)] 2024-10-11 12:33:27,449 - Train: 9.81% [36800/375300] [29.4/300.0] [batch_t 0.424 (0.429)] [data_t 0.015] [optim_t 0.409] [lr 0.002930] [CE 3.939 (4.081)] [KD 0.000 (0.000)] 2024-10-11 12:33:48,961 - Train: 9.82% [36850/375300] [29.5/300.0] [batch_t 0.505 (0.430)] [data_t 0.015] [optim_t 0.489] [lr 0.002930] [CE 3.984 (4.009)] [KD 0.000 (0.000)] 2024-10-11 12:34:09,781 - Train: 9.83% [36900/375300] [29.5/300.0] [batch_t 0.400 (0.416)] [data_t 0.015] [optim_t 0.385] [lr 0.002930] [CE 4.012 (4.016)] [KD 0.000 (0.000)] 2024-10-11 12:34:30,685 - Train: 9.85% [36950/375300] [29.5/300.0] [batch_t 0.445 (0.418)] [data_t 0.015] [optim_t 0.430] [lr 0.002930] [CE 4.435 (4.025)] [KD 0.000 (0.000)] 2024-10-11 12:34:51,402 - Train: 9.86% [37000/375300] [29.6/300.0] [batch_t 0.351 (0.414)] [data_t 0.015] [optim_t 0.336] [lr 0.002929] [CE 4.016 (4.022)] [KD 0.000 (0.000)] 2024-10-11 12:35:12,508 - Train: 9.87% [37050/375300] [29.6/300.0] [batch_t 0.382 (0.422)] [data_t 0.015] [optim_t 0.366] [lr 0.002929] [CE 4.460 (4.092)] [KD 0.000 (0.000)] 2024-10-11 12:35:33,140 - Train: 9.89% [37100/375300] [29.7/300.0] [batch_t 0.392 (0.413)] [data_t 0.015] [optim_t 0.377] [lr 0.002929] [CE 4.308 (4.026)] [KD 0.000 (0.000)] 2024-10-11 12:35:53,461 - Train: 9.90% [37150/375300] [29.7/300.0] [batch_t 0.414 (0.406)] [data_t 0.015] [optim_t 0.398] [lr 0.002929] [CE 3.890 (4.033)] [KD 0.000 (0.000)] 2024-10-11 12:36:14,554 - Train: 9.91% [37200/375300] [29.7/300.0] [batch_t 0.415 (0.422)] [data_t 0.015] [optim_t 0.400] [lr 0.002929] [CE 4.145 (4.013)] [KD 0.000 (0.000)] 2024-10-11 12:36:36,002 - Train: 9.93% [37250/375300] [29.8/300.0] [batch_t 0.537 (0.429)] [data_t 0.015] [optim_t 0.521] [lr 0.002928] [CE 3.902 (4.070)] [KD 0.000 (0.000)] 2024-10-11 12:36:57,425 - Train: 9.94% [37300/375300] [29.8/300.0] [batch_t 0.379 (0.428)] [data_t 0.015] [optim_t 0.364] [lr 0.002928] [CE 4.049 (4.000)] [KD 0.000 (0.000)] 2024-10-11 12:37:18,821 - Train: 9.95% [37350/375300] [29.9/300.0] [batch_t 0.410 (0.428)] [data_t 0.015] [optim_t 0.395] [lr 0.002928] [CE 3.980 (4.072)] [KD 0.000 (0.000)] 2024-10-11 12:37:40,451 - Train: 9.97% [37400/375300] [29.9/300.0] [batch_t 0.507 (0.433)] [data_t 0.015] [optim_t 0.492] [lr 0.002928] [CE 4.075 (4.080)] [KD 0.000 (0.000)] 2024-10-11 12:38:01,939 - Train: 9.98% [37450/375300] [29.9/300.0] [batch_t 0.407 (0.430)] [data_t 0.015] [optim_t 0.391] [lr 0.002928] [CE 3.857 (3.949)] [KD 0.000 (0.000)] 2024-10-11 12:38:23,451 - Train: 9.99% [37500/375300] [30.0/300.0] [batch_t 0.407 (0.430)] [data_t 0.015] [optim_t 0.392] [lr 0.002927] [CE 3.634 (3.998)] [KD 0.000 (0.000)] 2024-10-11 12:38:55,462 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.409)] [top1_cnt 32967] [top5_cnt 43737] [top_all 50000] 2024-10-11 12:38:55,463 - net: 65.934 (87.474) 2024-10-11 12:39:16,685 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.417)] [top1_cnt 35851] [top5_cnt 45451] [top_all 50000] 2024-10-11 12:39:16,686 - net_E: 71.702 (90.902) 2024-10-11 12:39:16,864 - Max [top1: 65.934 (epoch: 30)] [top1-ema: 71.702 (epoch: 30)] 2024-10-11 12:39:16,864 - ==> Total time: 4:29:17 Eta: 1 day, 16:23:36 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 12:39:32,388 - Train: 10.01% [37550/375300] [30.0/300.0] [batch_t 0.309 (0.415)] [data_t 0.015] [optim_t 0.293] [lr 0.002927] [CE 3.970 (4.017)] [KD 0.000 (0.000)] 2024-10-11 12:39:51,738 - Train: 10.02% [37600/375300] [30.1/300.0] [batch_t 0.432 (0.387)] [data_t 0.145] [optim_t 0.287] [lr 0.002927] [CE 4.090 (4.013)] [KD 0.000 (0.000)] 2024-10-11 12:40:12,579 - Train: 10.03% [37650/375300] [30.1/300.0] [batch_t 0.426 (0.417)] [data_t 0.133] [optim_t 0.293] [lr 0.002927] [CE 3.573 (4.008)] [KD 0.000 (0.000)] 2024-10-11 12:40:33,871 - Train: 10.05% [37700/375300] [30.1/300.0] [batch_t 0.410 (0.426)] [data_t 0.015] [optim_t 0.394] [lr 0.002927] [CE 3.975 (3.992)] [KD 0.000 (0.000)] 2024-10-11 12:40:55,439 - Train: 10.06% [37750/375300] [30.2/300.0] [batch_t 0.397 (0.431)] [data_t 0.015] [optim_t 0.381] [lr 0.002926] [CE 4.351 (4.032)] [KD 0.000 (0.000)] 2024-10-11 12:41:16,778 - Train: 10.07% [37800/375300] [30.2/300.0] [batch_t 0.424 (0.427)] [data_t 0.015] [optim_t 0.409] [lr 0.002926] [CE 3.823 (4.002)] [KD 0.000 (0.000)] 2024-10-11 12:41:37,810 - Train: 10.09% [37850/375300] [30.3/300.0] [batch_t 0.475 (0.421)] [data_t 0.015] [optim_t 0.459] [lr 0.002926] [CE 4.173 (4.016)] [KD 0.000 (0.000)] 2024-10-11 12:41:58,049 - Train: 10.10% [37900/375300] [30.3/300.0] [batch_t 0.380 (0.405)] [data_t 0.015] [optim_t 0.365] [lr 0.002926] [CE 4.288 (4.048)] [KD 0.000 (0.000)] 2024-10-11 12:42:18,359 - Train: 10.11% [37950/375300] [30.3/300.0] [batch_t 0.344 (0.406)] [data_t 0.015] [optim_t 0.328] [lr 0.002926] [CE 4.254 (4.025)] [KD 0.000 (0.000)] 2024-10-11 12:42:38,384 - Train: 10.13% [38000/375300] [30.4/300.0] [batch_t 0.392 (0.400)] [data_t 0.015] [optim_t 0.377] [lr 0.002926] [CE 3.832 (3.993)] [KD 0.000 (0.000)] 2024-10-11 12:42:58,555 - Train: 10.14% [38050/375300] [30.4/300.0] [batch_t 0.432 (0.403)] [data_t 0.015] [optim_t 0.417] [lr 0.002925] [CE 4.115 (4.022)] [KD 0.000 (0.000)] 2024-10-11 12:43:18,655 - Train: 10.15% [38100/375300] [30.5/300.0] [batch_t 0.403 (0.402)] [data_t 0.015] [optim_t 0.387] [lr 0.002925] [CE 3.774 (3.995)] [KD 0.000 (0.000)] 2024-10-11 12:43:39,053 - Train: 10.17% [38150/375300] [30.5/300.0] [batch_t 0.380 (0.408)] [data_t 0.015] [optim_t 0.365] [lr 0.002925] [CE 3.718 (3.999)] [KD 0.000 (0.000)] 2024-10-11 12:43:59,584 - Train: 10.18% [38200/375300] [30.5/300.0] [batch_t 0.433 (0.411)] [data_t 0.015] [optim_t 0.418] [lr 0.002925] [CE 3.983 (4.020)] [KD 0.000 (0.000)] 2024-10-11 12:44:19,968 - Train: 10.19% [38250/375300] [30.6/300.0] [batch_t 0.421 (0.408)] [data_t 0.015] [optim_t 0.406] [lr 0.002925] [CE 3.735 (3.993)] [KD 0.000 (0.000)] 2024-10-11 12:44:40,976 - Train: 10.21% [38300/375300] [30.6/300.0] [batch_t 0.398 (0.420)] [data_t 0.015] [optim_t 0.382] [lr 0.002924] [CE 3.754 (4.030)] [KD 0.000 (0.000)] 2024-10-11 12:45:02,167 - Train: 10.22% [38350/375300] [30.7/300.0] [batch_t 0.465 (0.424)] [data_t 0.015] [optim_t 0.449] [lr 0.002924] [CE 3.761 (4.029)] [KD 0.000 (0.000)] 2024-10-11 12:45:22,738 - Train: 10.23% [38400/375300] [30.7/300.0] [batch_t 0.433 (0.411)] [data_t 0.015] [optim_t 0.418] [lr 0.002924] [CE 4.217 (4.000)] [KD 0.000 (0.000)] 2024-10-11 12:45:43,575 - Train: 10.25% [38450/375300] [30.7/300.0] [batch_t 0.402 (0.417)] [data_t 0.015] [optim_t 0.386] [lr 0.002924] [CE 3.880 (4.053)] [KD 0.000 (0.000)] 2024-10-11 12:46:04,109 - Train: 10.26% [38500/375300] [30.8/300.0] [batch_t 0.357 (0.411)] [data_t 0.015] [optim_t 0.342] [lr 0.002924] [CE 3.934 (3.984)] [KD 0.000 (0.000)] 2024-10-11 12:46:24,798 - Train: 10.27% [38550/375300] [30.8/300.0] [batch_t 0.377 (0.414)] [data_t 0.015] [optim_t 0.362] [lr 0.002923] [CE 4.494 (4.073)] [KD 0.000 (0.000)] 2024-10-11 12:46:45,556 - Train: 10.29% [38600/375300] [30.9/300.0] [batch_t 0.449 (0.415)] [data_t 0.015] [optim_t 0.433] [lr 0.002923] [CE 4.060 (4.063)] [KD 0.000 (0.000)] 2024-10-11 12:47:06,196 - Train: 10.30% [38650/375300] [30.9/300.0] [batch_t 0.378 (0.413)] [data_t 0.016] [optim_t 0.362] [lr 0.002923] [CE 4.083 (4.050)] [KD 0.000 (0.000)] 2024-10-11 12:47:27,029 - Train: 10.31% [38700/375300] [30.9/300.0] [batch_t 0.394 (0.417)] [data_t 0.015] [optim_t 0.379] [lr 0.002923] [CE 3.666 (3.981)] [KD 0.000 (0.000)] 2024-10-11 12:47:47,722 - Train: 10.33% [38750/375300] [31.0/300.0] [batch_t 0.423 (0.414)] [data_t 0.015] [optim_t 0.407] [lr 0.002923] [CE 3.966 (4.063)] [KD 0.000 (0.000)] 2024-10-11 12:47:59,414 - ==> Total time: 4:37:59 Eta: 1 day, 16:12:18 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 12:48:11,447 - Train: 10.34% [38800/375300] [31.0/300.0] [batch_t 0.307 (0.564)] [data_t 0.015] [optim_t 0.292] [lr 0.002922] [CE 3.748 (4.044)] [KD 0.000 (0.000)] 2024-10-11 12:48:32,477 - Train: 10.35% [38850/375300] [31.1/300.0] [batch_t 0.440 (0.421)] [data_t 0.015] [optim_t 0.425] [lr 0.002922] [CE 3.945 (3.977)] [KD 0.000 (0.000)] 2024-10-11 12:48:54,326 - Train: 10.37% [38900/375300] [31.1/300.0] [batch_t 0.490 (0.437)] [data_t 0.015] [optim_t 0.474] [lr 0.002922] [CE 3.742 (3.984)] [KD 0.000 (0.000)] 2024-10-11 12:49:15,968 - Train: 10.38% [38950/375300] [31.1/300.0] [batch_t 0.443 (0.433)] [data_t 0.015] [optim_t 0.428] [lr 0.002922] [CE 4.188 (3.995)] [KD 0.000 (0.000)] 2024-10-11 12:49:36,338 - Train: 10.39% [39000/375300] [31.2/300.0] [batch_t 0.447 (0.407)] [data_t 0.015] [optim_t 0.432] [lr 0.002922] [CE 3.709 (4.037)] [KD 0.000 (0.000)] 2024-10-11 12:49:57,311 - Train: 10.41% [39050/375300] [31.2/300.0] [batch_t 0.441 (0.419)] [data_t 0.015] [optim_t 0.425] [lr 0.002921] [CE 3.978 (4.029)] [KD 0.000 (0.000)] 2024-10-11 12:50:18,193 - Train: 10.42% [39100/375300] [31.3/300.0] [batch_t 0.381 (0.418)] [data_t 0.015] [optim_t 0.366] [lr 0.002921] [CE 4.256 (4.004)] [KD 0.000 (0.000)] 2024-10-11 12:50:39,263 - Train: 10.43% [39150/375300] [31.3/300.0] [batch_t 0.415 (0.421)] [data_t 0.015] [optim_t 0.400] [lr 0.002921] [CE 4.139 (4.011)] [KD 0.000 (0.000)] 2024-10-11 12:51:00,810 - Train: 10.44% [39200/375300] [31.3/300.0] [batch_t 0.427 (0.431)] [data_t 0.015] [optim_t 0.411] [lr 0.002921] [CE 3.896 (3.970)] [KD 0.000 (0.000)] 2024-10-11 12:51:22,442 - Train: 10.46% [39250/375300] [31.4/300.0] [batch_t 0.383 (0.433)] [data_t 0.015] [optim_t 0.368] [lr 0.002921] [CE 4.139 (4.015)] [KD 0.000 (0.000)] 2024-10-11 12:51:43,993 - Train: 10.47% [39300/375300] [31.4/300.0] [batch_t 0.393 (0.431)] [data_t 0.015] [optim_t 0.378] [lr 0.002920] [CE 4.118 (4.004)] [KD 0.000 (0.000)] 2024-10-11 12:52:05,684 - Train: 10.48% [39350/375300] [31.5/300.0] [batch_t 0.483 (0.434)] [data_t 0.015] [optim_t 0.468] [lr 0.002920] [CE 4.156 (4.043)] [KD 0.000 (0.000)] 2024-10-11 12:52:26,272 - Train: 10.50% [39400/375300] [31.5/300.0] [batch_t 0.401 (0.412)] [data_t 0.015] [optim_t 0.386] [lr 0.002920] [CE 3.987 (3.988)] [KD 0.000 (0.000)] 2024-10-11 12:52:46,833 - Train: 10.51% [39450/375300] [31.5/300.0] [batch_t 0.394 (0.411)] [data_t 0.015] [optim_t 0.379] [lr 0.002920] [CE 4.028 (3.982)] [KD 0.000 (0.000)] 2024-10-11 12:53:07,730 - Train: 10.52% [39500/375300] [31.6/300.0] [batch_t 0.506 (0.418)] [data_t 0.015] [optim_t 0.491] [lr 0.002920] [CE 3.899 (3.969)] [KD 0.000 (0.000)] 2024-10-11 12:53:28,795 - Train: 10.54% [39550/375300] [31.6/300.0] [batch_t 0.327 (0.421)] [data_t 0.015] [optim_t 0.311] [lr 0.002919] [CE 3.811 (3.961)] [KD 0.000 (0.000)] 2024-10-11 12:53:49,520 - Train: 10.55% [39600/375300] [31.7/300.0] [batch_t 0.427 (0.414)] [data_t 0.015] [optim_t 0.412] [lr 0.002919] [CE 4.153 (3.965)] [KD 0.000 (0.000)] 2024-10-11 12:54:10,707 - Train: 10.56% [39650/375300] [31.7/300.0] [batch_t 0.454 (0.424)] [data_t 0.015] [optim_t 0.439] [lr 0.002919] [CE 3.854 (4.001)] [KD 0.000 (0.000)] 2024-10-11 12:54:32,004 - Train: 10.58% [39700/375300] [31.7/300.0] [batch_t 0.359 (0.426)] [data_t 0.015] [optim_t 0.344] [lr 0.002919] [CE 3.763 (3.990)] [KD 0.000 (0.000)] 2024-10-11 12:54:53,513 - Train: 10.59% [39750/375300] [31.8/300.0] [batch_t 0.536 (0.430)] [data_t 0.015] [optim_t 0.521] [lr 0.002919] [CE 3.998 (4.002)] [KD 0.000 (0.000)] 2024-10-11 12:55:14,739 - Train: 10.60% [39800/375300] [31.8/300.0] [batch_t 0.447 (0.424)] [data_t 0.015] [optim_t 0.432] [lr 0.002918] [CE 4.263 (4.055)] [KD 0.000 (0.000)] 2024-10-11 12:55:35,489 - Train: 10.62% [39850/375300] [31.9/300.0] [batch_t 0.440 (0.415)] [data_t 0.015] [optim_t 0.425] [lr 0.002918] [CE 4.076 (4.015)] [KD 0.000 (0.000)] 2024-10-11 12:55:55,880 - Train: 10.63% [39900/375300] [31.9/300.0] [batch_t 0.467 (0.408)] [data_t 0.015] [optim_t 0.452] [lr 0.002918] [CE 4.142 (4.034)] [KD 0.000 (0.000)] 2024-10-11 12:56:16,401 - Train: 10.64% [39950/375300] [31.9/300.0] [batch_t 0.409 (0.410)] [data_t 0.015] [optim_t 0.394] [lr 0.002918] [CE 3.970 (4.033)] [KD 0.000 (0.000)] 2024-10-11 12:56:36,902 - Train: 10.66% [40000/375300] [32.0/300.0] [batch_t 0.376 (0.410)] [data_t 0.015] [optim_t 0.360] [lr 0.002918] [CE 4.009 (4.020)] [KD 0.000 (0.000)] 2024-10-11 12:56:49,031 - ==> Total time: 4:46:49 Eta: 1 day, 16:02:09 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 12:57:01,312 - Train: 10.67% [40050/375300] [32.0/300.0] [batch_t 0.307 (0.614)] [data_t 0.015] [optim_t 0.292] [lr 0.002917] [CE 3.708 (3.961)] [KD 0.000 (0.000)] 2024-10-11 12:57:20,732 - Train: 10.68% [40100/375300] [32.1/300.0] [batch_t 0.433 (0.388)] [data_t 0.015] [optim_t 0.418] [lr 0.002917] [CE 4.256 (3.977)] [KD 0.000 (0.000)] 2024-10-11 12:57:41,382 - Train: 10.70% [40150/375300] [32.1/300.0] [batch_t 0.435 (0.413)] [data_t 0.015] [optim_t 0.420] [lr 0.002917] [CE 3.742 (3.964)] [KD 0.000 (0.000)] 2024-10-11 12:58:03,112 - Train: 10.71% [40200/375300] [32.1/300.0] [batch_t 0.482 (0.435)] [data_t 0.015] [optim_t 0.467] [lr 0.002917] [CE 4.224 (3.977)] [KD 0.000 (0.000)] 2024-10-11 12:58:24,493 - Train: 10.72% [40250/375300] [32.2/300.0] [batch_t 0.396 (0.428)] [data_t 0.015] [optim_t 0.381] [lr 0.002917] [CE 3.940 (3.987)] [KD 0.000 (0.000)] 2024-10-11 12:58:45,967 - Train: 10.74% [40300/375300] [32.2/300.0] [batch_t 0.364 (0.429)] [data_t 0.015] [optim_t 0.349] [lr 0.002916] [CE 3.859 (4.009)] [KD 0.000 (0.000)] 2024-10-11 12:59:06,719 - Train: 10.75% [40350/375300] [32.3/300.0] [batch_t 0.388 (0.415)] [data_t 0.015] [optim_t 0.372] [lr 0.002916] [CE 4.103 (3.949)] [KD 0.000 (0.000)] 2024-10-11 12:59:27,783 - Train: 10.76% [40400/375300] [32.3/300.0] [batch_t 0.445 (0.421)] [data_t 0.015] [optim_t 0.430] [lr 0.002916] [CE 3.761 (3.937)] [KD 0.000 (0.000)] 2024-10-11 12:59:48,749 - Train: 10.78% [40450/375300] [32.3/300.0] [batch_t 0.473 (0.419)] [data_t 0.015] [optim_t 0.458] [lr 0.002916] [CE 4.043 (4.032)] [KD 0.000 (0.000)] 2024-10-11 13:00:10,205 - Train: 10.79% [40500/375300] [32.4/300.0] [batch_t 0.404 (0.429)] [data_t 0.015] [optim_t 0.388] [lr 0.002915] [CE 3.900 (3.980)] [KD 0.000 (0.000)] 2024-10-11 13:00:32,081 - Train: 10.80% [40550/375300] [32.4/300.0] [batch_t 0.468 (0.437)] [data_t 0.015] [optim_t 0.453] [lr 0.002915] [CE 3.988 (3.980)] [KD 0.000 (0.000)] 2024-10-11 13:00:53,731 - Train: 10.82% [40600/375300] [32.5/300.0] [batch_t 0.485 (0.433)] [data_t 0.015] [optim_t 0.470] [lr 0.002915] [CE 4.153 (3.967)] [KD 0.000 (0.000)] 2024-10-11 13:01:15,077 - Train: 10.83% [40650/375300] [32.5/300.0] [batch_t 0.307 (0.427)] [data_t 0.015] [optim_t 0.292] [lr 0.002915] [CE 3.880 (4.000)] [KD 0.000 (0.000)] 2024-10-11 13:01:36,279 - Train: 10.84% [40700/375300] [32.5/300.0] [batch_t 0.413 (0.424)] [data_t 0.015] [optim_t 0.397] [lr 0.002915] [CE 3.895 (3.949)] [KD 0.000 (0.000)] 2024-10-11 13:01:57,529 - Train: 10.86% [40750/375300] [32.6/300.0] [batch_t 0.461 (0.425)] [data_t 0.015] [optim_t 0.446] [lr 0.002914] [CE 3.945 (3.996)] [KD 0.000 (0.000)] 2024-10-11 13:02:18,689 - Train: 10.87% [40800/375300] [32.6/300.0] [batch_t 0.375 (0.423)] [data_t 0.015] [optim_t 0.360] [lr 0.002914] [CE 3.596 (4.032)] [KD 0.000 (0.000)] 2024-10-11 13:02:39,347 - Train: 10.88% [40850/375300] [32.7/300.0] [batch_t 0.399 (0.413)] [data_t 0.015] [optim_t 0.383] [lr 0.002914] [CE 4.459 (3.970)] [KD 0.000 (0.000)] 2024-10-11 13:03:00,566 - Train: 10.90% [40900/375300] [32.7/300.0] [batch_t 0.423 (0.424)] [data_t 0.015] [optim_t 0.408] [lr 0.002914] [CE 3.833 (3.994)] [KD 0.000 (0.000)] 2024-10-11 13:03:21,211 - Train: 10.91% [40950/375300] [32.7/300.0] [batch_t 0.476 (0.413)] [data_t 0.015] [optim_t 0.460] [lr 0.002914] [CE 4.260 (4.001)] [KD 0.000 (0.000)] 2024-10-11 13:03:42,087 - Train: 10.92% [41000/375300] [32.8/300.0] [batch_t 0.453 (0.417)] [data_t 0.015] [optim_t 0.438] [lr 0.002913] [CE 3.820 (4.029)] [KD 0.000 (0.000)] 2024-10-11 13:04:03,550 - Train: 10.94% [41050/375300] [32.8/300.0] [batch_t 0.473 (0.429)] [data_t 0.015] [optim_t 0.457] [lr 0.002913] [CE 3.452 (3.997)] [KD 0.000 (0.000)] 2024-10-11 13:04:25,252 - Train: 10.95% [41100/375300] [32.9/300.0] [batch_t 0.549 (0.434)] [data_t 0.256] [optim_t 0.293] [lr 0.002913] [CE 3.949 (3.973)] [KD 0.000 (0.000)] 2024-10-11 13:04:46,792 - Train: 10.96% [41150/375300] [32.9/300.0] [batch_t 0.405 (0.431)] [data_t 0.113] [optim_t 0.291] [lr 0.002913] [CE 4.085 (4.019)] [KD 0.000 (0.000)] 2024-10-11 13:05:08,687 - Train: 10.98% [41200/375300] [32.9/300.0] [batch_t 0.462 (0.438)] [data_t 0.015] [optim_t 0.446] [lr 0.002913] [CE 4.248 (3.992)] [KD 0.000 (0.000)] 2024-10-11 13:05:30,591 - Train: 10.99% [41250/375300] [33.0/300.0] [batch_t 0.423 (0.438)] [data_t 0.015] [optim_t 0.408] [lr 0.002912] [CE 4.259 (4.007)] [KD 0.000 (0.000)] 2024-10-11 13:05:43,058 - ==> Total time: 4:55:43 Eta: 1 day, 15:52:41 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 13:05:54,613 - Train: 11.00% [41300/375300] [33.0/300.0] [batch_t 0.310 (0.601)] [data_t 0.015] [optim_t 0.294] [lr 0.002912] [CE 3.823 (3.987)] [KD 0.000 (0.000)] 2024-10-11 13:06:15,894 - Train: 11.02% [41350/375300] [33.1/300.0] [batch_t 0.409 (0.425)] [data_t 0.015] [optim_t 0.394] [lr 0.002912] [CE 3.752 (3.978)] [KD 0.000 (0.000)] 2024-10-11 13:06:37,410 - Train: 11.03% [41400/375300] [33.1/300.0] [batch_t 0.459 (0.430)] [data_t 0.015] [optim_t 0.443] [lr 0.002912] [CE 4.433 (3.996)] [KD 0.000 (0.000)] 2024-10-11 13:06:58,481 - Train: 11.04% [41450/375300] [33.1/300.0] [batch_t 0.417 (0.421)] [data_t 0.015] [optim_t 0.402] [lr 0.002912] [CE 4.102 (3.995)] [KD 0.000 (0.000)] 2024-10-11 13:07:19,105 - Train: 11.06% [41500/375300] [33.2/300.0] [batch_t 0.454 (0.412)] [data_t 0.015] [optim_t 0.438] [lr 0.002911] [CE 3.936 (3.980)] [KD 0.000 (0.000)] 2024-10-11 13:07:39,444 - Train: 11.07% [41550/375300] [33.2/300.0] [batch_t 0.425 (0.407)] [data_t 0.130] [optim_t 0.295] [lr 0.002911] [CE 3.999 (4.001)] [KD 0.000 (0.000)] 2024-10-11 13:08:00,474 - Train: 11.08% [41600/375300] [33.3/300.0] [batch_t 0.385 (0.421)] [data_t 0.092] [optim_t 0.293] [lr 0.002911] [CE 3.675 (3.949)] [KD 0.000 (0.000)] 2024-10-11 13:08:20,823 - Train: 11.10% [41650/375300] [33.3/300.0] [batch_t 0.430 (0.407)] [data_t 0.140] [optim_t 0.290] [lr 0.002911] [CE 3.924 (3.990)] [KD 0.000 (0.000)] 2024-10-11 13:08:41,251 - Train: 11.11% [41700/375300] [33.3/300.0] [batch_t 0.378 (0.408)] [data_t 0.089] [optim_t 0.289] [lr 0.002910] [CE 3.904 (3.992)] [KD 0.000 (0.000)] 2024-10-11 13:09:01,867 - Train: 11.12% [41750/375300] [33.4/300.0] [batch_t 0.326 (0.412)] [data_t 0.037] [optim_t 0.289] [lr 0.002910] [CE 3.806 (3.993)] [KD 0.000 (0.000)] 2024-10-11 13:09:22,227 - Train: 11.14% [41800/375300] [33.4/300.0] [batch_t 0.369 (0.407)] [data_t 0.079] [optim_t 0.290] [lr 0.002910] [CE 4.040 (3.943)] [KD 0.000 (0.000)] 2024-10-11 13:09:42,250 - Train: 11.15% [41850/375300] [33.5/300.0] [batch_t 0.406 (0.400)] [data_t 0.114] [optim_t 0.292] [lr 0.002910] [CE 4.110 (3.996)] [KD 0.000 (0.000)] 2024-10-11 13:10:03,303 - Train: 11.16% [41900/375300] [33.5/300.0] [batch_t 0.407 (0.421)] [data_t 0.111] [optim_t 0.295] [lr 0.002910] [CE 4.008 (3.949)] [KD 0.000 (0.000)] 2024-10-11 13:10:24,709 - Train: 11.18% [41950/375300] [33.5/300.0] [batch_t 0.379 (0.428)] [data_t 0.091] [optim_t 0.288] [lr 0.002909] [CE 4.448 (3.926)] [KD 0.000 (0.000)] 2024-10-11 13:10:45,973 - Train: 11.19% [42000/375300] [33.6/300.0] [batch_t 0.309 (0.425)] [data_t 0.015] [optim_t 0.294] [lr 0.002909] [CE 4.050 (4.005)] [KD 0.000 (0.000)] 2024-10-11 13:11:06,231 - Train: 11.20% [42050/375300] [33.6/300.0] [batch_t 0.366 (0.405)] [data_t 0.076] [optim_t 0.290] [lr 0.002909] [CE 3.924 (3.990)] [KD 0.000 (0.000)] 2024-10-11 13:11:26,722 - Train: 11.22% [42100/375300] [33.7/300.0] [batch_t 0.403 (0.410)] [data_t 0.111] [optim_t 0.291] [lr 0.002909] [CE 4.165 (3.983)] [KD 0.000 (0.000)] 2024-10-11 13:11:46,986 - Train: 11.23% [42150/375300] [33.7/300.0] [batch_t 0.450 (0.405)] [data_t 0.160] [optim_t 0.290] [lr 0.002909] [CE 4.072 (3.935)] [KD 0.000 (0.000)] 2024-10-11 13:12:07,486 - Train: 11.24% [42200/375300] [33.7/300.0] [batch_t 0.359 (0.410)] [data_t 0.068] [optim_t 0.291] [lr 0.002908] [CE 3.705 (3.952)] [KD 0.000 (0.000)] 2024-10-11 13:12:27,739 - Train: 11.26% [42250/375300] [33.8/300.0] [batch_t 0.370 (0.405)] [data_t 0.079] [optim_t 0.291] [lr 0.002908] [CE 3.795 (4.024)] [KD 0.000 (0.000)] 2024-10-11 13:12:48,361 - Train: 11.27% [42300/375300] [33.8/300.0] [batch_t 0.422 (0.412)] [data_t 0.130] [optim_t 0.291] [lr 0.002908] [CE 3.888 (3.954)] [KD 0.000 (0.000)] 2024-10-11 13:13:08,996 - Train: 11.28% [42350/375300] [33.9/300.0] [batch_t 0.439 (0.413)] [data_t 0.148] [optim_t 0.291] [lr 0.002908] [CE 3.989 (3.987)] [KD 0.000 (0.000)] 2024-10-11 13:13:29,614 - Train: 11.30% [42400/375300] [33.9/300.0] [batch_t 0.412 (0.412)] [data_t 0.121] [optim_t 0.291] [lr 0.002907] [CE 3.740 (3.961)] [KD 0.000 (0.000)] 2024-10-11 13:13:50,598 - Train: 11.31% [42450/375300] [33.9/300.0] [batch_t 0.448 (0.420)] [data_t 0.015] [optim_t 0.433] [lr 0.002907] [CE 4.087 (3.949)] [KD 0.000 (0.000)] 2024-10-11 13:14:11,725 - Train: 11.32% [42500/375300] [34.0/300.0] [batch_t 0.389 (0.422)] [data_t 0.015] [optim_t 0.374] [lr 0.002907] [CE 4.011 (3.982)] [KD 0.000 (0.000)] 2024-10-11 13:14:24,501 - ==> Total time: 5:04:25 Eta: 1 day, 15:41:36 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 13:14:36,042 - Train: 11.34% [42550/375300] [34.0/300.0] [batch_t 0.307 (0.642)] [data_t 0.015] [optim_t 0.292] [lr 0.002907] [CE 3.854 (3.951)] [KD 0.000 (0.000)] 2024-10-11 13:14:56,244 - Train: 11.35% [42600/375300] [34.1/300.0] [batch_t 0.465 (0.404)] [data_t 0.015] [optim_t 0.450] [lr 0.002907] [CE 3.947 (3.961)] [KD 0.000 (0.000)] 2024-10-11 13:15:17,513 - Train: 11.36% [42650/375300] [34.1/300.0] [batch_t 0.482 (0.425)] [data_t 0.015] [optim_t 0.467] [lr 0.002906] [CE 3.917 (3.954)] [KD 0.000 (0.000)] 2024-10-11 13:15:38,870 - Train: 11.38% [42700/375300] [34.1/300.0] [batch_t 0.403 (0.427)] [data_t 0.015] [optim_t 0.388] [lr 0.002906] [CE 3.732 (3.980)] [KD 0.000 (0.000)] 2024-10-11 13:15:59,687 - Train: 11.39% [42750/375300] [34.2/300.0] [batch_t 0.432 (0.416)] [data_t 0.015] [optim_t 0.417] [lr 0.002906] [CE 3.582 (3.967)] [KD 0.000 (0.000)] 2024-10-11 13:16:20,635 - Train: 11.40% [42800/375300] [34.2/300.0] [batch_t 0.408 (0.419)] [data_t 0.015] [optim_t 0.393] [lr 0.002906] [CE 3.935 (3.938)] [KD 0.000 (0.000)] 2024-10-11 13:16:41,441 - Train: 11.42% [42850/375300] [34.3/300.0] [batch_t 0.419 (0.416)] [data_t 0.015] [optim_t 0.404] [lr 0.002905] [CE 4.277 (3.985)] [KD 0.000 (0.000)] 2024-10-11 13:17:02,240 - Train: 11.43% [42900/375300] [34.3/300.0] [batch_t 0.377 (0.416)] [data_t 0.015] [optim_t 0.362] [lr 0.002905] [CE 4.049 (3.979)] [KD 0.000 (0.000)] 2024-10-11 13:17:23,458 - Train: 11.44% [42950/375300] [34.3/300.0] [batch_t 0.401 (0.424)] [data_t 0.015] [optim_t 0.386] [lr 0.002905] [CE 4.037 (3.999)] [KD 0.000 (0.000)] 2024-10-11 13:17:44,645 - Train: 11.46% [43000/375300] [34.4/300.0] [batch_t 0.495 (0.424)] [data_t 0.015] [optim_t 0.480] [lr 0.002905] [CE 4.157 (3.974)] [KD 0.000 (0.000)] 2024-10-11 13:18:05,338 - Train: 11.47% [43050/375300] [34.4/300.0] [batch_t 0.352 (0.414)] [data_t 0.015] [optim_t 0.337] [lr 0.002905] [CE 3.848 (4.029)] [KD 0.000 (0.000)] 2024-10-11 13:18:26,056 - Train: 11.48% [43100/375300] [34.5/300.0] [batch_t 0.446 (0.414)] [data_t 0.015] [optim_t 0.431] [lr 0.002904] [CE 3.916 (3.990)] [KD 0.000 (0.000)] 2024-10-11 13:18:47,500 - Train: 11.50% [43150/375300] [34.5/300.0] [batch_t 0.444 (0.429)] [data_t 0.015] [optim_t 0.428] [lr 0.002904] [CE 3.962 (4.015)] [KD 0.000 (0.000)] 2024-10-11 13:19:08,814 - Train: 11.51% [43200/375300] [34.5/300.0] [batch_t 0.431 (0.426)] [data_t 0.015] [optim_t 0.416] [lr 0.002904] [CE 3.935 (3.952)] [KD 0.000 (0.000)] 2024-10-11 13:19:30,222 - Train: 11.52% [43250/375300] [34.6/300.0] [batch_t 0.415 (0.428)] [data_t 0.015] [optim_t 0.399] [lr 0.002904] [CE 3.926 (3.947)] [KD 0.000 (0.000)] 2024-10-11 13:19:50,999 - Train: 11.54% [43300/375300] [34.6/300.0] [batch_t 0.372 (0.415)] [data_t 0.015] [optim_t 0.356] [lr 0.002904] [CE 4.177 (3.961)] [KD 0.000 (0.000)] 2024-10-11 13:20:11,769 - Train: 11.55% [43350/375300] [34.7/300.0] [batch_t 0.434 (0.415)] [data_t 0.015] [optim_t 0.419] [lr 0.002903] [CE 3.789 (3.973)] [KD 0.000 (0.000)] 2024-10-11 13:20:33,279 - Train: 11.56% [43400/375300] [34.7/300.0] [batch_t 0.460 (0.430)] [data_t 0.015] [optim_t 0.445] [lr 0.002903] [CE 4.038 (4.010)] [KD 0.000 (0.000)] 2024-10-11 13:20:54,058 - Train: 11.58% [43450/375300] [34.7/300.0] [batch_t 0.348 (0.415)] [data_t 0.015] [optim_t 0.332] [lr 0.002903] [CE 3.812 (3.998)] [KD 0.000 (0.000)] 2024-10-11 13:21:14,920 - Train: 11.59% [43500/375300] [34.8/300.0] [batch_t 0.339 (0.417)] [data_t 0.015] [optim_t 0.324] [lr 0.002903] [CE 4.046 (3.956)] [KD 0.000 (0.000)] 2024-10-11 13:21:35,391 - Train: 11.60% [43550/375300] [34.8/300.0] [batch_t 0.418 (0.409)] [data_t 0.015] [optim_t 0.403] [lr 0.002902] [CE 4.055 (3.972)] [KD 0.000 (0.000)] 2024-10-11 13:21:56,134 - Train: 11.62% [43600/375300] [34.9/300.0] [batch_t 0.433 (0.415)] [data_t 0.015] [optim_t 0.418] [lr 0.002902] [CE 4.254 (3.960)] [KD 0.000 (0.000)] 2024-10-11 13:22:16,867 - Train: 11.63% [43650/375300] [34.9/300.0] [batch_t 0.403 (0.415)] [data_t 0.015] [optim_t 0.388] [lr 0.002902] [CE 4.102 (3.994)] [KD 0.000 (0.000)] 2024-10-11 13:22:37,151 - Train: 11.64% [43700/375300] [34.9/300.0] [batch_t 0.449 (0.406)] [data_t 0.015] [optim_t 0.433] [lr 0.002902] [CE 4.128 (3.994)] [KD 0.000 (0.000)] 2024-10-11 13:22:57,855 - Train: 11.66% [43750/375300] [35.0/300.0] [batch_t 0.482 (0.414)] [data_t 0.015] [optim_t 0.467] [lr 0.002902] [CE 4.024 (3.971)] [KD 0.000 (0.000)] 2024-10-11 13:23:31,522 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.407)] [top1_cnt 33741] [top5_cnt 44357] [top_all 50000] 2024-10-11 13:23:31,522 - net: 67.482 (88.714) 2024-10-11 13:23:52,534 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.413)] [top1_cnt 36559] [top5_cnt 45849] [top_all 50000] 2024-10-11 13:23:52,535 - net_E: 73.118 (91.698) 2024-10-11 13:23:52,707 - Max [top1: 67.482 (epoch: 35)] [top1-ema: 73.118 (epoch: 35)] 2024-10-11 13:23:52,708 - ==> Total time: 5:13:53 Eta: 1 day, 15:36:34 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 13:24:06,645 - Train: 11.67% [43800/375300] [35.0/300.0] [batch_t 0.310 (0.421)] [data_t 0.016] [optim_t 0.294] [lr 0.002901] [CE 4.007 (3.936)] [KD 0.000 (0.000)] 2024-10-11 13:24:27,560 - Train: 11.68% [43850/375300] [35.1/300.0] [batch_t 0.391 (0.418)] [data_t 0.100] [optim_t 0.290] [lr 0.002901] [CE 4.109 (3.951)] [KD 0.000 (0.000)] 2024-10-11 13:24:49,043 - Train: 11.70% [43900/375300] [35.1/300.0] [batch_t 0.505 (0.430)] [data_t 0.212] [optim_t 0.293] [lr 0.002901] [CE 3.738 (3.964)] [KD 0.000 (0.000)] 2024-10-11 13:25:10,604 - Train: 11.71% [43950/375300] [35.1/300.0] [batch_t 0.368 (0.431)] [data_t 0.077] [optim_t 0.291] [lr 0.002901] [CE 3.575 (3.973)] [KD 0.000 (0.000)] 2024-10-11 13:25:31,930 - Train: 11.72% [44000/375300] [35.2/300.0] [batch_t 0.411 (0.426)] [data_t 0.122] [optim_t 0.289] [lr 0.002900] [CE 3.908 (4.026)] [KD 0.000 (0.000)] 2024-10-11 13:25:51,768 - Train: 11.74% [44050/375300] [35.2/300.0] [batch_t 0.468 (0.397)] [data_t 0.177] [optim_t 0.291] [lr 0.002900] [CE 3.734 (4.003)] [KD 0.000 (0.000)] 2024-10-11 13:26:12,393 - Train: 11.75% [44100/375300] [35.3/300.0] [batch_t 0.416 (0.412)] [data_t 0.015] [optim_t 0.401] [lr 0.002900] [CE 3.878 (3.949)] [KD 0.000 (0.000)] 2024-10-11 13:26:34,127 - Train: 11.76% [44150/375300] [35.3/300.0] [batch_t 0.426 (0.435)] [data_t 0.015] [optim_t 0.411] [lr 0.002900] [CE 3.600 (3.989)] [KD 0.000 (0.000)] 2024-10-11 13:26:55,160 - Train: 11.78% [44200/375300] [35.3/300.0] [batch_t 0.379 (0.421)] [data_t 0.015] [optim_t 0.364] [lr 0.002900] [CE 4.049 (4.016)] [KD 0.000 (0.000)] 2024-10-11 13:27:16,148 - Train: 11.79% [44250/375300] [35.4/300.0] [batch_t 0.475 (0.420)] [data_t 0.015] [optim_t 0.460] [lr 0.002899] [CE 3.653 (3.910)] [KD 0.000 (0.000)] 2024-10-11 13:27:36,811 - Train: 11.80% [44300/375300] [35.4/300.0] [batch_t 0.399 (0.413)] [data_t 0.015] [optim_t 0.384] [lr 0.002899] [CE 4.201 (3.997)] [KD 0.000 (0.000)] 2024-10-11 13:27:57,675 - Train: 11.82% [44350/375300] [35.5/300.0] [batch_t 0.441 (0.417)] [data_t 0.015] [optim_t 0.426] [lr 0.002899] [CE 3.931 (3.937)] [KD 0.000 (0.000)] 2024-10-11 13:28:19,327 - Train: 11.83% [44400/375300] [35.5/300.0] [batch_t 0.522 (0.433)] [data_t 0.015] [optim_t 0.507] [lr 0.002899] [CE 3.696 (3.944)] [KD 0.000 (0.000)] 2024-10-11 13:28:40,656 - Train: 11.84% [44450/375300] [35.5/300.0] [batch_t 0.433 (0.426)] [data_t 0.015] [optim_t 0.418] [lr 0.002898] [CE 3.350 (3.951)] [KD 0.000 (0.000)] 2024-10-11 13:29:02,413 - Train: 11.86% [44500/375300] [35.6/300.0] [batch_t 0.373 (0.435)] [data_t 0.015] [optim_t 0.357] [lr 0.002898] [CE 4.109 (3.954)] [KD 0.000 (0.000)] 2024-10-11 13:29:24,531 - Train: 11.87% [44550/375300] [35.6/300.0] [batch_t 0.427 (0.442)] [data_t 0.015] [optim_t 0.412] [lr 0.002898] [CE 3.986 (3.938)] [KD 0.000 (0.000)] 2024-10-11 13:29:46,116 - Train: 11.88% [44600/375300] [35.7/300.0] [batch_t 0.435 (0.432)] [data_t 0.015] [optim_t 0.420] [lr 0.002898] [CE 4.052 (3.922)] [KD 0.000 (0.000)] 2024-10-11 13:30:07,811 - Train: 11.90% [44650/375300] [35.7/300.0] [batch_t 0.445 (0.434)] [data_t 0.015] [optim_t 0.429] [lr 0.002897] [CE 3.933 (3.984)] [KD 0.000 (0.000)] 2024-10-11 13:30:29,007 - Train: 11.91% [44700/375300] [35.7/300.0] [batch_t 0.431 (0.424)] [data_t 0.015] [optim_t 0.416] [lr 0.002897] [CE 3.842 (3.951)] [KD 0.000 (0.000)] 2024-10-11 13:30:49,976 - Train: 11.92% [44750/375300] [35.8/300.0] [batch_t 0.432 (0.419)] [data_t 0.015] [optim_t 0.417] [lr 0.002897] [CE 3.774 (3.991)] [KD 0.000 (0.000)] 2024-10-11 13:31:10,601 - Train: 11.94% [44800/375300] [35.8/300.0] [batch_t 0.364 (0.412)] [data_t 0.015] [optim_t 0.349] [lr 0.002897] [CE 3.917 (3.965)] [KD 0.000 (0.000)] 2024-10-11 13:31:31,986 - Train: 11.95% [44850/375300] [35.9/300.0] [batch_t 0.307 (0.428)] [data_t 0.015] [optim_t 0.291] [lr 0.002897] [CE 4.173 (3.960)] [KD 0.000 (0.000)] 2024-10-11 13:31:53,061 - Train: 11.96% [44900/375300] [35.9/300.0] [batch_t 0.454 (0.421)] [data_t 0.015] [optim_t 0.438] [lr 0.002896] [CE 4.329 (3.974)] [KD 0.000 (0.000)] 2024-10-11 13:32:14,443 - Train: 11.98% [44950/375300] [35.9/300.0] [batch_t 0.496 (0.428)] [data_t 0.015] [optim_t 0.481] [lr 0.002896] [CE 4.074 (3.949)] [KD 0.000 (0.000)] 2024-10-11 13:32:35,681 - Train: 11.99% [45000/375300] [36.0/300.0] [batch_t 0.433 (0.425)] [data_t 0.015] [optim_t 0.418] [lr 0.002896] [CE 4.096 (3.917)] [KD 0.000 (0.000)] 2024-10-11 13:32:49,433 - ==> Total time: 5:22:49 Eta: 1 day, 15:27:26 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 13:33:00,119 - Train: 12.00% [45050/375300] [36.0/300.0] [batch_t 0.310 (0.664)] [data_t 0.015] [optim_t 0.294] [lr 0.002896] [CE 3.932 (3.972)] [KD 0.000 (0.000)] 2024-10-11 13:33:19,195 - Train: 12.02% [45100/375300] [36.1/300.0] [batch_t 0.409 (0.381)] [data_t 0.015] [optim_t 0.394] [lr 0.002895] [CE 4.018 (3.953)] [KD 0.000 (0.000)] 2024-10-11 13:33:39,734 - Train: 12.03% [45150/375300] [36.1/300.0] [batch_t 0.435 (0.411)] [data_t 0.087] [optim_t 0.348] [lr 0.002895] [CE 3.785 (3.947)] [KD 0.000 (0.000)] 2024-10-11 13:34:00,896 - Train: 12.04% [45200/375300] [36.1/300.0] [batch_t 0.435 (0.423)] [data_t 0.080] [optim_t 0.356] [lr 0.002895] [CE 3.728 (3.920)] [KD 0.000 (0.000)] 2024-10-11 13:34:21,924 - Train: 12.06% [45250/375300] [36.2/300.0] [batch_t 0.450 (0.420)] [data_t 0.015] [optim_t 0.435] [lr 0.002895] [CE 3.638 (3.953)] [KD 0.000 (0.000)] 2024-10-11 13:34:42,691 - Train: 12.07% [45300/375300] [36.2/300.0] [batch_t 0.347 (0.415)] [data_t 0.015] [optim_t 0.331] [lr 0.002895] [CE 4.101 (3.924)] [KD 0.000 (0.000)] 2024-10-11 13:35:03,422 - Train: 12.08% [45350/375300] [36.3/300.0] [batch_t 0.399 (0.415)] [data_t 0.109] [optim_t 0.290] [lr 0.002894] [CE 3.696 (3.955)] [KD 0.000 (0.000)] 2024-10-11 13:35:24,564 - Train: 12.10% [45400/375300] [36.3/300.0] [batch_t 0.475 (0.423)] [data_t 0.187] [optim_t 0.288] [lr 0.002894] [CE 3.587 (3.967)] [KD 0.000 (0.000)] 2024-10-11 13:35:45,856 - Train: 12.11% [45450/375300] [36.3/300.0] [batch_t 0.424 (0.426)] [data_t 0.015] [optim_t 0.409] [lr 0.002894] [CE 4.238 (3.953)] [KD 0.000 (0.000)] 2024-10-11 13:36:07,169 - Train: 12.12% [45500/375300] [36.4/300.0] [batch_t 0.399 (0.426)] [data_t 0.015] [optim_t 0.384] [lr 0.002894] [CE 3.759 (3.935)] [KD 0.000 (0.000)] 2024-10-11 13:36:28,171 - Train: 12.14% [45550/375300] [36.4/300.0] [batch_t 0.378 (0.420)] [data_t 0.015] [optim_t 0.363] [lr 0.002893] [CE 3.900 (3.958)] [KD 0.000 (0.000)] 2024-10-11 13:36:49,263 - Train: 12.15% [45600/375300] [36.5/300.0] [batch_t 0.464 (0.422)] [data_t 0.015] [optim_t 0.448] [lr 0.002893] [CE 3.766 (3.980)] [KD 0.000 (0.000)] 2024-10-11 13:37:10,382 - Train: 12.16% [45650/375300] [36.5/300.0] [batch_t 0.462 (0.422)] [data_t 0.015] [optim_t 0.447] [lr 0.002893] [CE 4.079 (3.961)] [KD 0.000 (0.000)] 2024-10-11 13:37:31,595 - Train: 12.18% [45700/375300] [36.5/300.0] [batch_t 0.381 (0.424)] [data_t 0.015] [optim_t 0.366] [lr 0.002893] [CE 3.754 (3.922)] [KD 0.000 (0.000)] 2024-10-11 13:37:52,518 - Train: 12.19% [45750/375300] [36.6/300.0] [batch_t 0.434 (0.418)] [data_t 0.015] [optim_t 0.419] [lr 0.002892] [CE 3.884 (3.973)] [KD 0.000 (0.000)] 2024-10-11 13:38:13,930 - Train: 12.20% [45800/375300] [36.6/300.0] [batch_t 0.399 (0.428)] [data_t 0.015] [optim_t 0.384] [lr 0.002892] [CE 4.172 (3.975)] [KD 0.000 (0.000)] 2024-10-11 13:38:35,632 - Train: 12.22% [45850/375300] [36.7/300.0] [batch_t 0.466 (0.434)] [data_t 0.015] [optim_t 0.451] [lr 0.002892] [CE 3.715 (3.982)] [KD 0.000 (0.000)] 2024-10-11 13:38:56,685 - Train: 12.23% [45900/375300] [36.7/300.0] [batch_t 0.449 (0.421)] [data_t 0.015] [optim_t 0.434] [lr 0.002892] [CE 3.573 (3.940)] [KD 0.000 (0.000)] 2024-10-11 13:39:17,571 - Train: 12.24% [45950/375300] [36.7/300.0] [batch_t 0.455 (0.418)] [data_t 0.015] [optim_t 0.440] [lr 0.002891] [CE 3.555 (3.931)] [KD 0.000 (0.000)] 2024-10-11 13:39:38,813 - Train: 12.26% [46000/375300] [36.8/300.0] [batch_t 0.374 (0.425)] [data_t 0.015] [optim_t 0.359] [lr 0.002891] [CE 4.288 (3.934)] [KD 0.000 (0.000)] 2024-10-11 13:39:59,733 - Train: 12.27% [46050/375300] [36.8/300.0] [batch_t 0.344 (0.418)] [data_t 0.015] [optim_t 0.329] [lr 0.002891] [CE 3.889 (3.966)] [KD 0.000 (0.000)] 2024-10-11 13:40:20,814 - Train: 12.28% [46100/375300] [36.9/300.0] [batch_t 0.371 (0.422)] [data_t 0.015] [optim_t 0.356] [lr 0.002891] [CE 3.876 (4.008)] [KD 0.000 (0.000)] 2024-10-11 13:40:42,309 - Train: 12.30% [46150/375300] [36.9/300.0] [batch_t 0.363 (0.430)] [data_t 0.015] [optim_t 0.348] [lr 0.002891] [CE 4.034 (3.949)] [KD 0.000 (0.000)] 2024-10-11 13:41:03,625 - Train: 12.31% [46200/375300] [36.9/300.0] [batch_t 0.430 (0.426)] [data_t 0.015] [optim_t 0.415] [lr 0.002890] [CE 3.608 (3.957)] [KD 0.000 (0.000)] 2024-10-11 13:41:24,831 - Train: 12.32% [46250/375300] [37.0/300.0] [batch_t 0.376 (0.424)] [data_t 0.015] [optim_t 0.361] [lr 0.002890] [CE 3.924 (3.937)] [KD 0.000 (0.000)] 2024-10-11 13:41:39,047 - ==> Total time: 5:31:39 Eta: 1 day, 15:17:28 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 13:41:49,312 - Train: 12.34% [46300/375300] [37.0/300.0] [batch_t 0.307 (0.677)] [data_t 0.015] [optim_t 0.292] [lr 0.002890] [CE 3.425 (3.909)] [KD 0.000 (0.000)] 2024-10-11 13:42:08,521 - Train: 12.35% [46350/375300] [37.1/300.0] [batch_t 0.411 (0.384)] [data_t 0.123] [optim_t 0.288] [lr 0.002890] [CE 4.103 (3.924)] [KD 0.000 (0.000)] 2024-10-11 13:42:28,945 - Train: 12.36% [46400/375300] [37.1/300.0] [batch_t 0.440 (0.408)] [data_t 0.148] [optim_t 0.292] [lr 0.002889] [CE 3.989 (3.919)] [KD 0.000 (0.000)] 2024-10-11 13:42:49,318 - Train: 12.38% [46450/375300] [37.1/300.0] [batch_t 0.425 (0.407)] [data_t 0.133] [optim_t 0.292] [lr 0.002889] [CE 3.998 (3.938)] [KD 0.000 (0.000)] 2024-10-11 13:43:10,015 - Train: 12.39% [46500/375300] [37.2/300.0] [batch_t 0.341 (0.414)] [data_t 0.048] [optim_t 0.293] [lr 0.002889] [CE 3.657 (3.930)] [KD 0.000 (0.000)] 2024-10-11 13:43:30,509 - Train: 12.40% [46550/375300] [37.2/300.0] [batch_t 0.435 (0.410)] [data_t 0.143] [optim_t 0.292] [lr 0.002889] [CE 3.685 (3.911)] [KD 0.000 (0.000)] 2024-10-11 13:43:51,315 - Train: 12.42% [46600/375300] [37.3/300.0] [batch_t 0.437 (0.416)] [data_t 0.141] [optim_t 0.296] [lr 0.002888] [CE 3.910 (3.976)] [KD 0.000 (0.000)] 2024-10-11 13:44:11,956 - Train: 12.43% [46650/375300] [37.3/300.0] [batch_t 0.486 (0.413)] [data_t 0.185] [optim_t 0.302] [lr 0.002888] [CE 4.173 (3.962)] [KD 0.000 (0.000)] 2024-10-11 13:44:32,515 - Train: 12.44% [46700/375300] [37.3/300.0] [batch_t 0.405 (0.411)] [data_t 0.015] [optim_t 0.390] [lr 0.002888] [CE 3.955 (3.953)] [KD 0.000 (0.000)] 2024-10-11 13:44:53,274 - Train: 12.46% [46750/375300] [37.4/300.0] [batch_t 0.406 (0.415)] [data_t 0.015] [optim_t 0.391] [lr 0.002888] [CE 3.912 (3.948)] [KD 0.000 (0.000)] 2024-10-11 13:45:13,964 - Train: 12.47% [46800/375300] [37.4/300.0] [batch_t 0.405 (0.414)] [data_t 0.016] [optim_t 0.390] [lr 0.002888] [CE 4.326 (3.950)] [KD 0.000 (0.000)] 2024-10-11 13:45:34,569 - Train: 12.48% [46850/375300] [37.5/300.0] [batch_t 0.416 (0.412)] [data_t 0.015] [optim_t 0.400] [lr 0.002887] [CE 3.811 (3.975)] [KD 0.000 (0.000)] 2024-10-11 13:45:55,501 - Train: 12.50% [46900/375300] [37.5/300.0] [batch_t 0.403 (0.419)] [data_t 0.016] [optim_t 0.387] [lr 0.002887] [CE 4.374 (3.939)] [KD 0.000 (0.000)] 2024-10-11 13:46:15,927 - Train: 12.51% [46950/375300] [37.5/300.0] [batch_t 0.575 (0.408)] [data_t 0.015] [optim_t 0.560] [lr 0.002887] [CE 3.624 (3.922)] [KD 0.000 (0.000)] 2024-10-11 13:46:36,316 - Train: 12.52% [47000/375300] [37.6/300.0] [batch_t 0.403 (0.408)] [data_t 0.015] [optim_t 0.388] [lr 0.002887] [CE 4.293 (3.929)] [KD 0.000 (0.000)] 2024-10-11 13:46:57,028 - Train: 12.54% [47050/375300] [37.6/300.0] [batch_t 0.440 (0.414)] [data_t 0.015] [optim_t 0.424] [lr 0.002886] [CE 3.598 (3.984)] [KD 0.000 (0.000)] 2024-10-11 13:47:17,359 - Train: 12.55% [47100/375300] [37.6/300.0] [batch_t 0.355 (0.406)] [data_t 0.015] [optim_t 0.340] [lr 0.002886] [CE 4.099 (3.908)] [KD 0.000 (0.000)] 2024-10-11 13:47:37,969 - Train: 12.56% [47150/375300] [37.7/300.0] [batch_t 0.422 (0.412)] [data_t 0.015] [optim_t 0.407] [lr 0.002886] [CE 3.997 (3.953)] [KD 0.000 (0.000)] 2024-10-11 13:47:58,882 - Train: 12.58% [47200/375300] [37.7/300.0] [batch_t 0.404 (0.418)] [data_t 0.015] [optim_t 0.389] [lr 0.002886] [CE 3.687 (3.888)] [KD 0.000 (0.000)] 2024-10-11 13:48:18,814 - Train: 12.59% [47250/375300] [37.8/300.0] [batch_t 0.430 (0.399)] [data_t 0.015] [optim_t 0.415] [lr 0.002885] [CE 4.063 (3.914)] [KD 0.000 (0.000)] 2024-10-11 13:48:39,125 - Train: 12.60% [47300/375300] [37.8/300.0] [batch_t 0.389 (0.406)] [data_t 0.015] [optim_t 0.374] [lr 0.002885] [CE 4.023 (3.900)] [KD 0.000 (0.000)] 2024-10-11 13:48:59,831 - Train: 12.62% [47350/375300] [37.8/300.0] [batch_t 0.341 (0.414)] [data_t 0.015] [optim_t 0.326] [lr 0.002885] [CE 3.971 (4.013)] [KD 0.000 (0.000)] 2024-10-11 13:49:20,744 - Train: 12.63% [47400/375300] [37.9/300.0] [batch_t 0.383 (0.418)] [data_t 0.015] [optim_t 0.368] [lr 0.002885] [CE 4.078 (3.947)] [KD 0.000 (0.000)] 2024-10-11 13:49:41,225 - Train: 12.64% [47450/375300] [37.9/300.0] [batch_t 0.361 (0.410)] [data_t 0.015] [optim_t 0.346] [lr 0.002884] [CE 3.939 (3.933)] [KD 0.000 (0.000)] 2024-10-11 13:50:01,894 - Train: 12.66% [47500/375300] [38.0/300.0] [batch_t 0.435 (0.413)] [data_t 0.015] [optim_t 0.420] [lr 0.002884] [CE 3.919 (3.958)] [KD 0.000 (0.000)] 2024-10-11 13:50:16,237 - ==> Total time: 5:40:16 Eta: 1 day, 15:06:08 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 13:50:26,068 - Train: 12.67% [47550/375300] [38.0/300.0] [batch_t 0.308 (0.718)] [data_t 0.015] [optim_t 0.293] [lr 0.002884] [CE 4.044 (3.883)] [KD 0.000 (0.000)] 2024-10-11 13:50:45,530 - Train: 12.68% [47600/375300] [38.0/300.0] [batch_t 0.490 (0.389)] [data_t 0.015] [optim_t 0.475] [lr 0.002884] [CE 3.408 (3.917)] [KD 0.000 (0.000)] 2024-10-11 13:51:06,346 - Train: 12.70% [47650/375300] [38.1/300.0] [batch_t 0.384 (0.416)] [data_t 0.015] [optim_t 0.368] [lr 0.002883] [CE 4.237 (3.935)] [KD 0.000 (0.000)] 2024-10-11 13:51:26,741 - Train: 12.71% [47700/375300] [38.1/300.0] [batch_t 0.411 (0.408)] [data_t 0.015] [optim_t 0.396] [lr 0.002883] [CE 3.761 (3.931)] [KD 0.000 (0.000)] 2024-10-11 13:51:47,496 - Train: 12.72% [47750/375300] [38.2/300.0] [batch_t 0.432 (0.415)] [data_t 0.015] [optim_t 0.417] [lr 0.002883] [CE 3.811 (3.960)] [KD 0.000 (0.000)] 2024-10-11 13:52:07,945 - Train: 12.74% [47800/375300] [38.2/300.0] [batch_t 0.436 (0.409)] [data_t 0.015] [optim_t 0.421] [lr 0.002883] [CE 3.806 (3.961)] [KD 0.000 (0.000)] 2024-10-11 13:52:28,968 - Train: 12.75% [47850/375300] [38.2/300.0] [batch_t 0.396 (0.420)] [data_t 0.015] [optim_t 0.381] [lr 0.002882] [CE 4.074 (3.889)] [KD 0.000 (0.000)] 2024-10-11 13:52:49,227 - Train: 12.76% [47900/375300] [38.3/300.0] [batch_t 0.386 (0.405)] [data_t 0.015] [optim_t 0.371] [lr 0.002882] [CE 3.768 (3.949)] [KD 0.000 (0.000)] 2024-10-11 13:53:09,693 - Train: 12.78% [47950/375300] [38.3/300.0] [batch_t 0.420 (0.409)] [data_t 0.015] [optim_t 0.405] [lr 0.002882] [CE 4.101 (3.940)] [KD 0.000 (0.000)] 2024-10-11 13:53:30,609 - Train: 12.79% [48000/375300] [38.4/300.0] [batch_t 0.496 (0.418)] [data_t 0.015] [optim_t 0.481] [lr 0.002882] [CE 4.020 (3.941)] [KD 0.000 (0.000)] 2024-10-11 13:53:51,380 - Train: 12.80% [48050/375300] [38.4/300.0] [batch_t 0.426 (0.415)] [data_t 0.015] [optim_t 0.411] [lr 0.002881] [CE 3.766 (3.930)] [KD 0.000 (0.000)] 2024-10-11 13:54:12,268 - Train: 12.82% [48100/375300] [38.4/300.0] [batch_t 0.402 (0.418)] [data_t 0.015] [optim_t 0.386] [lr 0.002881] [CE 3.870 (3.996)] [KD 0.000 (0.000)] 2024-10-11 13:54:33,079 - Train: 12.83% [48150/375300] [38.5/300.0] [batch_t 0.383 (0.416)] [data_t 0.016] [optim_t 0.367] [lr 0.002881] [CE 3.758 (3.944)] [KD 0.000 (0.000)] 2024-10-11 13:54:53,983 - Train: 12.84% [48200/375300] [38.5/300.0] [batch_t 0.502 (0.418)] [data_t 0.015] [optim_t 0.487] [lr 0.002881] [CE 3.852 (3.927)] [KD 0.000 (0.000)] 2024-10-11 13:55:14,765 - Train: 12.86% [48250/375300] [38.6/300.0] [batch_t 0.449 (0.416)] [data_t 0.015] [optim_t 0.434] [lr 0.002881] [CE 3.976 (3.900)] [KD 0.000 (0.000)] 2024-10-11 13:55:35,549 - Train: 12.87% [48300/375300] [38.6/300.0] [batch_t 0.396 (0.416)] [data_t 0.015] [optim_t 0.381] [lr 0.002880] [CE 4.064 (3.951)] [KD 0.000 (0.000)] 2024-10-11 13:55:56,540 - Train: 12.88% [48350/375300] [38.6/300.0] [batch_t 0.432 (0.420)] [data_t 0.015] [optim_t 0.416] [lr 0.002880] [CE 3.838 (3.893)] [KD 0.000 (0.000)] 2024-10-11 13:56:17,202 - Train: 12.90% [48400/375300] [38.7/300.0] [batch_t 0.498 (0.413)] [data_t 0.015] [optim_t 0.483] [lr 0.002880] [CE 3.793 (3.986)] [KD 0.000 (0.000)] 2024-10-11 13:56:37,912 - Train: 12.91% [48450/375300] [38.7/300.0] [batch_t 0.402 (0.414)] [data_t 0.015] [optim_t 0.387] [lr 0.002880] [CE 4.191 (4.020)] [KD 0.000 (0.000)] 2024-10-11 13:56:58,028 - Train: 12.92% [48500/375300] [38.8/300.0] [batch_t 0.368 (0.402)] [data_t 0.016] [optim_t 0.352] [lr 0.002879] [CE 3.968 (3.964)] [KD 0.000 (0.000)] 2024-10-11 13:57:18,205 - Train: 12.94% [48550/375300] [38.8/300.0] [batch_t 0.397 (0.403)] [data_t 0.016] [optim_t 0.381] [lr 0.002879] [CE 3.756 (3.946)] [KD 0.000 (0.000)] 2024-10-11 13:57:38,647 - Train: 12.95% [48600/375300] [38.8/300.0] [batch_t 0.310 (0.409)] [data_t 0.015] [optim_t 0.294] [lr 0.002879] [CE 4.389 (3.949)] [KD 0.000 (0.000)] 2024-10-11 13:57:59,552 - Train: 12.96% [48650/375300] [38.9/300.0] [batch_t 0.407 (0.418)] [data_t 0.015] [optim_t 0.392] [lr 0.002879] [CE 3.716 (3.952)] [KD 0.000 (0.000)] 2024-10-11 13:58:20,568 - Train: 12.98% [48700/375300] [38.9/300.0] [batch_t 0.550 (0.420)] [data_t 0.015] [optim_t 0.534] [lr 0.002878] [CE 3.711 (3.944)] [KD 0.000 (0.000)] 2024-10-11 13:58:41,075 - Train: 12.99% [48750/375300] [39.0/300.0] [batch_t 0.353 (0.410)] [data_t 0.015] [optim_t 0.338] [lr 0.002878] [CE 3.850 (3.945)] [KD 0.000 (0.000)] 2024-10-11 13:58:55,870 - ==> Total time: 5:48:56 Eta: 1 day, 14:55:12 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 13:59:05,709 - Train: 13.00% [48800/375300] [39.0/300.0] [batch_t 0.308 (0.753)] [data_t 0.015] [optim_t 0.293] [lr 0.002878] [CE 4.052 (4.007)] [KD 0.000 (0.000)] 2024-10-11 13:59:24,559 - Train: 13.02% [48850/375300] [39.0/300.0] [batch_t 0.399 (0.377)] [data_t 0.015] [optim_t 0.383] [lr 0.002878] [CE 3.796 (3.879)] [KD 0.000 (0.000)] 2024-10-11 13:59:45,637 - Train: 13.03% [48900/375300] [39.1/300.0] [batch_t 0.870 (0.421)] [data_t 0.015] [optim_t 0.855] [lr 0.002877] [CE 3.988 (3.944)] [KD 0.000 (0.000)] 2024-10-11 14:00:05,984 - Train: 13.04% [48950/375300] [39.1/300.0] [batch_t 0.371 (0.407)] [data_t 0.015] [optim_t 0.356] [lr 0.002877] [CE 3.914 (3.945)] [KD 0.000 (0.000)] 2024-10-11 14:00:26,748 - Train: 13.06% [49000/375300] [39.2/300.0] [batch_t 0.430 (0.415)] [data_t 0.015] [optim_t 0.414] [lr 0.002877] [CE 3.936 (3.900)] [KD 0.000 (0.000)] 2024-10-11 14:00:47,579 - Train: 13.07% [49050/375300] [39.2/300.0] [batch_t 0.430 (0.416)] [data_t 0.015] [optim_t 0.415] [lr 0.002877] [CE 3.988 (3.882)] [KD 0.000 (0.000)] 2024-10-11 14:01:08,586 - Train: 13.08% [49100/375300] [39.2/300.0] [batch_t 0.493 (0.420)] [data_t 0.015] [optim_t 0.478] [lr 0.002876] [CE 3.926 (3.951)] [KD 0.000 (0.000)] 2024-10-11 14:01:30,000 - Train: 13.10% [49150/375300] [39.3/300.0] [batch_t 0.340 (0.428)] [data_t 0.015] [optim_t 0.324] [lr 0.002876] [CE 3.916 (3.906)] [KD 0.000 (0.000)] 2024-10-11 14:01:51,193 - Train: 13.11% [49200/375300] [39.3/300.0] [batch_t 0.368 (0.424)] [data_t 0.015] [optim_t 0.352] [lr 0.002876] [CE 3.853 (3.901)] [KD 0.000 (0.000)] 2024-10-11 14:02:12,509 - Train: 13.12% [49250/375300] [39.4/300.0] [batch_t 0.365 (0.426)] [data_t 0.015] [optim_t 0.349] [lr 0.002876] [CE 4.017 (3.951)] [KD 0.000 (0.000)] 2024-10-11 14:02:34,070 - Train: 13.14% [49300/375300] [39.4/300.0] [batch_t 0.502 (0.431)] [data_t 0.015] [optim_t 0.486] [lr 0.002875] [CE 3.912 (3.879)] [KD 0.000 (0.000)] 2024-10-11 14:02:54,966 - Train: 13.15% [49350/375300] [39.4/300.0] [batch_t 0.379 (0.418)] [data_t 0.015] [optim_t 0.363] [lr 0.002875] [CE 3.956 (3.931)] [KD 0.000 (0.000)] 2024-10-11 14:03:15,513 - Train: 13.16% [49400/375300] [39.5/300.0] [batch_t 0.414 (0.411)] [data_t 0.015] [optim_t 0.398] [lr 0.002875] [CE 3.978 (3.925)] [KD 0.000 (0.000)] 2024-10-11 14:03:36,450 - Train: 13.18% [49450/375300] [39.5/300.0] [batch_t 0.366 (0.419)] [data_t 0.015] [optim_t 0.351] [lr 0.002875] [CE 3.980 (3.914)] [KD 0.000 (0.000)] 2024-10-11 14:03:57,129 - Train: 13.19% [49500/375300] [39.6/300.0] [batch_t 0.393 (0.413)] [data_t 0.015] [optim_t 0.378] [lr 0.002874] [CE 3.858 (3.926)] [KD 0.000 (0.000)] 2024-10-11 14:04:18,373 - Train: 13.20% [49550/375300] [39.6/300.0] [batch_t 0.416 (0.425)] [data_t 0.015] [optim_t 0.400] [lr 0.002874] [CE 3.967 (3.922)] [KD 0.000 (0.000)] 2024-10-11 14:04:39,401 - Train: 13.22% [49600/375300] [39.6/300.0] [batch_t 0.357 (0.420)] [data_t 0.015] [optim_t 0.341] [lr 0.002874] [CE 4.105 (3.965)] [KD 0.000 (0.000)] 2024-10-11 14:05:00,886 - Train: 13.23% [49650/375300] [39.7/300.0] [batch_t 0.479 (0.430)] [data_t 0.015] [optim_t 0.464] [lr 0.002874] [CE 3.946 (3.909)] [KD 0.000 (0.000)] 2024-10-11 14:05:22,450 - Train: 13.24% [49700/375300] [39.7/300.0] [batch_t 0.449 (0.431)] [data_t 0.015] [optim_t 0.433] [lr 0.002873] [CE 3.898 (3.891)] [KD 0.000 (0.000)] 2024-10-11 14:05:43,890 - Train: 13.26% [49750/375300] [39.8/300.0] [batch_t 0.359 (0.429)] [data_t 0.015] [optim_t 0.344] [lr 0.002873] [CE 3.894 (3.936)] [KD 0.000 (0.000)] 2024-10-11 14:06:04,899 - Train: 13.27% [49800/375300] [39.8/300.0] [batch_t 0.466 (0.420)] [data_t 0.015] [optim_t 0.451] [lr 0.002873] [CE 4.204 (3.947)] [KD 0.000 (0.000)] 2024-10-11 14:06:24,944 - Train: 13.28% [49850/375300] [39.8/300.0] [batch_t 0.369 (0.401)] [data_t 0.015] [optim_t 0.353] [lr 0.002873] [CE 3.991 (3.943)] [KD 0.000 (0.000)] 2024-10-11 14:06:45,022 - Train: 13.30% [49900/375300] [39.9/300.0] [batch_t 0.386 (0.401)] [data_t 0.015] [optim_t 0.371] [lr 0.002872] [CE 4.201 (3.972)] [KD 0.000 (0.000)] 2024-10-11 14:07:05,722 - Train: 13.31% [49950/375300] [39.9/300.0] [batch_t 0.417 (0.414)] [data_t 0.015] [optim_t 0.402] [lr 0.002872] [CE 3.854 (3.985)] [KD 0.000 (0.000)] 2024-10-11 14:07:26,088 - Train: 13.32% [50000/375300] [40.0/300.0] [batch_t 0.432 (0.407)] [data_t 0.015] [optim_t 0.417] [lr 0.002872] [CE 4.479 (3.930)] [KD 0.000 (0.000)] 2024-10-11 14:08:01,727 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.406)] [top1_cnt 34147] [top5_cnt 44670] [top_all 50000] 2024-10-11 14:08:01,727 - net: 68.294 (89.340) 2024-10-11 14:08:22,044 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.400)] [top1_cnt 37028] [top5_cnt 46096] [top_all 50000] 2024-10-11 14:08:22,044 - net_E: 74.056 (92.192) 2024-10-11 14:08:22,236 - Max [top1: 68.294 (epoch: 40)] [top1-ema: 74.056 (epoch: 40)] 2024-10-11 14:08:22,236 - ==> Total time: 5:58:22 Eta: 1 day, 14:49:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 14:08:32,831 - Train: 13.34% [50050/375300] [40.0/300.0] [batch_t 0.308 (0.548)] [data_t 0.015] [optim_t 0.293] [lr 0.002872] [CE 3.591 (3.880)] [KD 0.000 (0.000)] 2024-10-11 14:08:51,365 - Train: 13.35% [50100/375300] [40.0/300.0] [batch_t 0.362 (0.371)] [data_t 0.066] [optim_t 0.296] [lr 0.002871] [CE 3.937 (3.828)] [KD 0.000 (0.000)] 2024-10-11 14:09:12,248 - Train: 13.36% [50150/375300] [40.1/300.0] [batch_t 0.406 (0.418)] [data_t 0.015] [optim_t 0.391] [lr 0.002871] [CE 4.377 (3.969)] [KD 0.000 (0.000)] 2024-10-11 14:09:32,836 - Train: 13.38% [50200/375300] [40.1/300.0] [batch_t 0.424 (0.412)] [data_t 0.015] [optim_t 0.409] [lr 0.002871] [CE 3.759 (3.850)] [KD 0.000 (0.000)] 2024-10-11 14:09:54,222 - Train: 13.39% [50250/375300] [40.2/300.0] [batch_t 0.494 (0.428)] [data_t 0.015] [optim_t 0.479] [lr 0.002871] [CE 3.824 (3.893)] [KD 0.000 (0.000)] 2024-10-11 14:10:15,267 - Train: 13.40% [50300/375300] [40.2/300.0] [batch_t 0.368 (0.421)] [data_t 0.015] [optim_t 0.353] [lr 0.002870] [CE 3.563 (3.916)] [KD 0.000 (0.000)] 2024-10-11 14:10:36,863 - Train: 13.42% [50350/375300] [40.2/300.0] [batch_t 0.537 (0.432)] [data_t 0.015] [optim_t 0.521] [lr 0.002870] [CE 4.104 (3.925)] [KD 0.000 (0.000)] 2024-10-11 14:10:57,671 - Train: 13.43% [50400/375300] [40.3/300.0] [batch_t 0.381 (0.416)] [data_t 0.015] [optim_t 0.366] [lr 0.002870] [CE 3.942 (3.907)] [KD 0.000 (0.000)] 2024-10-11 14:11:18,465 - Train: 13.44% [50450/375300] [40.3/300.0] [batch_t 0.432 (0.416)] [data_t 0.015] [optim_t 0.417] [lr 0.002870] [CE 3.815 (3.882)] [KD 0.000 (0.000)] 2024-10-11 14:11:39,360 - Train: 13.46% [50500/375300] [40.4/300.0] [batch_t 0.395 (0.418)] [data_t 0.015] [optim_t 0.380] [lr 0.002869] [CE 3.495 (3.973)] [KD 0.000 (0.000)] 2024-10-11 14:12:00,149 - Train: 13.47% [50550/375300] [40.4/300.0] [batch_t 0.393 (0.416)] [data_t 0.015] [optim_t 0.377] [lr 0.002869] [CE 4.054 (3.906)] [KD 0.000 (0.000)] 2024-10-11 14:12:20,706 - Train: 13.48% [50600/375300] [40.4/300.0] [batch_t 0.388 (0.411)] [data_t 0.015] [optim_t 0.372] [lr 0.002869] [CE 4.035 (3.943)] [KD 0.000 (0.000)] 2024-10-11 14:12:41,187 - Train: 13.50% [50650/375300] [40.5/300.0] [batch_t 0.384 (0.410)] [data_t 0.015] [optim_t 0.368] [lr 0.002869] [CE 4.052 (3.977)] [KD 0.000 (0.000)] 2024-10-11 14:13:01,734 - Train: 13.51% [50700/375300] [40.5/300.0] [batch_t 0.445 (0.411)] [data_t 0.015] [optim_t 0.429] [lr 0.002868] [CE 3.778 (3.959)] [KD 0.000 (0.000)] 2024-10-11 14:13:22,315 - Train: 13.52% [50750/375300] [40.6/300.0] [batch_t 0.381 (0.412)] [data_t 0.015] [optim_t 0.365] [lr 0.002868] [CE 3.950 (3.910)] [KD 0.000 (0.000)] 2024-10-11 14:13:42,816 - Train: 13.54% [50800/375300] [40.6/300.0] [batch_t 0.400 (0.410)] [data_t 0.015] [optim_t 0.385] [lr 0.002868] [CE 3.879 (3.962)] [KD 0.000 (0.000)] 2024-10-11 14:14:03,573 - Train: 13.55% [50850/375300] [40.6/300.0] [batch_t 0.444 (0.415)] [data_t 0.015] [optim_t 0.428] [lr 0.002867] [CE 4.271 (3.934)] [KD 0.000 (0.000)] 2024-10-11 14:14:24,324 - Train: 13.56% [50900/375300] [40.7/300.0] [batch_t 0.413 (0.415)] [data_t 0.015] [optim_t 0.398] [lr 0.002867] [CE 3.931 (3.924)] [KD 0.000 (0.000)] 2024-10-11 14:14:45,070 - Train: 13.58% [50950/375300] [40.7/300.0] [batch_t 0.402 (0.415)] [data_t 0.016] [optim_t 0.386] [lr 0.002867] [CE 3.822 (3.943)] [KD 0.000 (0.000)] 2024-10-11 14:15:05,870 - Train: 13.59% [51000/375300] [40.8/300.0] [batch_t 0.417 (0.416)] [data_t 0.015] [optim_t 0.401] [lr 0.002867] [CE 3.900 (3.917)] [KD 0.000 (0.000)] 2024-10-11 14:15:26,547 - Train: 13.60% [51050/375300] [40.8/300.0] [batch_t 0.439 (0.413)] [data_t 0.015] [optim_t 0.423] [lr 0.002866] [CE 3.805 (3.912)] [KD 0.000 (0.000)] 2024-10-11 14:15:47,131 - Train: 13.62% [51100/375300] [40.8/300.0] [batch_t 0.397 (0.412)] [data_t 0.015] [optim_t 0.382] [lr 0.002866] [CE 3.915 (3.890)] [KD 0.000 (0.000)] 2024-10-11 14:16:07,655 - Train: 13.63% [51150/375300] [40.9/300.0] [batch_t 0.376 (0.410)] [data_t 0.015] [optim_t 0.361] [lr 0.002866] [CE 4.386 (3.987)] [KD 0.000 (0.000)] 2024-10-11 14:16:28,285 - Train: 13.64% [51200/375300] [40.9/300.0] [batch_t 0.418 (0.412)] [data_t 0.015] [optim_t 0.403] [lr 0.002866] [CE 4.018 (3.915)] [KD 0.000 (0.000)] 2024-10-11 14:16:48,986 - Train: 13.66% [51250/375300] [41.0/300.0] [batch_t 0.390 (0.414)] [data_t 0.015] [optim_t 0.375] [lr 0.002865] [CE 4.032 (3.887)] [KD 0.000 (0.000)] 2024-10-11 14:17:04,394 - ==> Total time: 6:07:04 Eta: 1 day, 14:38:52 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 14:17:14,188 - Train: 13.67% [51300/375300] [41.0/300.0] [batch_t 0.308 (0.688)] [data_t 0.015] [optim_t 0.293] [lr 0.002865] [CE 4.019 (3.921)] [KD 0.000 (0.000)] 2024-10-11 14:17:33,337 - Train: 13.68% [51350/375300] [41.0/300.0] [batch_t 0.323 (0.383)] [data_t 0.035] [optim_t 0.288] [lr 0.002865] [CE 3.791 (3.896)] [KD 0.000 (0.000)] 2024-10-11 14:17:54,203 - Train: 13.70% [51400/375300] [41.1/300.0] [batch_t 0.406 (0.417)] [data_t 0.015] [optim_t 0.390] [lr 0.002865] [CE 4.308 (3.911)] [KD 0.000 (0.000)] 2024-10-11 14:18:15,486 - Train: 13.71% [51450/375300] [41.1/300.0] [batch_t 0.479 (0.426)] [data_t 0.015] [optim_t 0.464] [lr 0.002864] [CE 3.969 (3.898)] [KD 0.000 (0.000)] 2024-10-11 14:18:36,711 - Train: 13.72% [51500/375300] [41.2/300.0] [batch_t 0.455 (0.424)] [data_t 0.015] [optim_t 0.439] [lr 0.002864] [CE 3.863 (3.912)] [KD 0.000 (0.000)] 2024-10-11 14:18:57,299 - Train: 13.74% [51550/375300] [41.2/300.0] [batch_t 0.352 (0.412)] [data_t 0.015] [optim_t 0.336] [lr 0.002864] [CE 3.733 (3.918)] [KD 0.000 (0.000)] 2024-10-11 14:19:18,277 - Train: 13.75% [51600/375300] [41.2/300.0] [batch_t 0.495 (0.419)] [data_t 0.015] [optim_t 0.480] [lr 0.002864] [CE 4.180 (3.941)] [KD 0.000 (0.000)] 2024-10-11 14:19:39,216 - Train: 13.76% [51650/375300] [41.3/300.0] [batch_t 0.380 (0.419)] [data_t 0.015] [optim_t 0.364] [lr 0.002863] [CE 3.944 (3.892)] [KD 0.000 (0.000)] 2024-10-11 14:20:00,244 - Train: 13.78% [51700/375300] [41.3/300.0] [batch_t 0.364 (0.420)] [data_t 0.015] [optim_t 0.348] [lr 0.002863] [CE 3.893 (3.924)] [KD 0.000 (0.000)] 2024-10-11 14:20:21,124 - Train: 13.79% [51750/375300] [41.4/300.0] [batch_t 0.464 (0.417)] [data_t 0.015] [optim_t 0.449] [lr 0.002863] [CE 4.424 (3.894)] [KD 0.000 (0.000)] 2024-10-11 14:20:41,495 - Train: 13.80% [51800/375300] [41.4/300.0] [batch_t 0.391 (0.407)] [data_t 0.015] [optim_t 0.375] [lr 0.002863] [CE 4.162 (3.901)] [KD 0.000 (0.000)] 2024-10-11 14:21:02,179 - Train: 13.82% [51850/375300] [41.4/300.0] [batch_t 0.456 (0.414)] [data_t 0.015] [optim_t 0.440] [lr 0.002862] [CE 4.075 (3.919)] [KD 0.000 (0.000)] 2024-10-11 14:21:23,022 - Train: 13.83% [51900/375300] [41.5/300.0] [batch_t 0.402 (0.417)] [data_t 0.015] [optim_t 0.387] [lr 0.002862] [CE 3.934 (3.933)] [KD 0.000 (0.000)] 2024-10-11 14:21:43,925 - Train: 13.84% [51950/375300] [41.5/300.0] [batch_t 0.353 (0.418)] [data_t 0.015] [optim_t 0.338] [lr 0.002862] [CE 3.888 (3.868)] [KD 0.000 (0.000)] 2024-10-11 14:22:04,745 - Train: 13.86% [52000/375300] [41.6/300.0] [batch_t 0.466 (0.416)] [data_t 0.015] [optim_t 0.451] [lr 0.002862] [CE 4.067 (3.938)] [KD 0.000 (0.000)] 2024-10-11 14:22:25,351 - Train: 13.87% [52050/375300] [41.6/300.0] [batch_t 0.308 (0.412)] [data_t 0.015] [optim_t 0.292] [lr 0.002861] [CE 3.688 (3.938)] [KD 0.000 (0.000)] 2024-10-11 14:22:46,436 - Train: 13.88% [52100/375300] [41.6/300.0] [batch_t 0.393 (0.422)] [data_t 0.015] [optim_t 0.378] [lr 0.002861] [CE 4.211 (3.937)] [KD 0.000 (0.000)] 2024-10-11 14:23:07,559 - Train: 13.90% [52150/375300] [41.7/300.0] [batch_t 0.375 (0.422)] [data_t 0.015] [optim_t 0.360] [lr 0.002861] [CE 3.957 (3.926)] [KD 0.000 (0.000)] 2024-10-11 14:23:28,683 - Train: 13.91% [52200/375300] [41.7/300.0] [batch_t 0.448 (0.422)] [data_t 0.015] [optim_t 0.432] [lr 0.002860] [CE 4.250 (4.012)] [KD 0.000 (0.000)] 2024-10-11 14:23:50,044 - Train: 13.92% [52250/375300] [41.8/300.0] [batch_t 0.357 (0.427)] [data_t 0.015] [optim_t 0.342] [lr 0.002860] [CE 4.120 (3.936)] [KD 0.000 (0.000)] 2024-10-11 14:24:11,302 - Train: 13.94% [52300/375300] [41.8/300.0] [batch_t 0.470 (0.425)] [data_t 0.015] [optim_t 0.455] [lr 0.002860] [CE 3.955 (3.942)] [KD 0.000 (0.000)] 2024-10-11 14:24:32,885 - Train: 13.95% [52350/375300] [41.8/300.0] [batch_t 0.388 (0.432)] [data_t 0.015] [optim_t 0.372] [lr 0.002860] [CE 3.925 (3.958)] [KD 0.000 (0.000)] 2024-10-11 14:24:54,671 - Train: 13.96% [52400/375300] [41.9/300.0] [batch_t 0.452 (0.436)] [data_t 0.015] [optim_t 0.437] [lr 0.002859] [CE 4.013 (3.924)] [KD 0.000 (0.000)] 2024-10-11 14:25:16,315 - Train: 13.98% [52450/375300] [41.9/300.0] [batch_t 0.392 (0.433)] [data_t 0.015] [optim_t 0.376] [lr 0.002859] [CE 4.271 (3.965)] [KD 0.000 (0.000)] 2024-10-11 14:25:37,420 - Train: 13.99% [52500/375300] [42.0/300.0] [batch_t 0.391 (0.422)] [data_t 0.015] [optim_t 0.375] [lr 0.002859] [CE 3.900 (3.927)] [KD 0.000 (0.000)] 2024-10-11 14:25:53,414 - ==> Total time: 6:15:53 Eta: 1 day, 14:29:05 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 14:26:01,809 - Train: 14.00% [52550/375300] [42.0/300.0] [batch_t 0.310 (0.839)] [data_t 0.015] [optim_t 0.295] [lr 0.002859] [CE 4.050 (3.982)] [KD 0.000 (0.000)] 2024-10-11 14:26:20,775 - Train: 14.02% [52600/375300] [42.0/300.0] [batch_t 0.422 (0.379)] [data_t 0.015] [optim_t 0.407] [lr 0.002858] [CE 4.052 (3.893)] [KD 0.000 (0.000)] 2024-10-11 14:26:41,475 - Train: 14.03% [52650/375300] [42.1/300.0] [batch_t 0.391 (0.414)] [data_t 0.015] [optim_t 0.375] [lr 0.002858] [CE 3.866 (3.975)] [KD 0.000 (0.000)] 2024-10-11 14:27:02,105 - Train: 14.04% [52700/375300] [42.1/300.0] [batch_t 0.427 (0.412)] [data_t 0.016] [optim_t 0.411] [lr 0.002858] [CE 3.789 (3.885)] [KD 0.000 (0.000)] 2024-10-11 14:27:22,619 - Train: 14.06% [52750/375300] [42.2/300.0] [batch_t 0.385 (0.410)] [data_t 0.015] [optim_t 0.369] [lr 0.002858] [CE 3.826 (3.962)] [KD 0.000 (0.000)] 2024-10-11 14:27:43,102 - Train: 14.07% [52800/375300] [42.2/300.0] [batch_t 0.411 (0.410)] [data_t 0.015] [optim_t 0.396] [lr 0.002857] [CE 3.957 (3.917)] [KD 0.000 (0.000)] 2024-10-11 14:28:03,559 - Train: 14.08% [52850/375300] [42.2/300.0] [batch_t 0.413 (0.409)] [data_t 0.015] [optim_t 0.397] [lr 0.002857] [CE 4.075 (3.911)] [KD 0.000 (0.000)] 2024-10-11 14:28:23,796 - Train: 14.10% [52900/375300] [42.3/300.0] [batch_t 0.407 (0.405)] [data_t 0.015] [optim_t 0.391] [lr 0.002857] [CE 3.651 (3.891)] [KD 0.000 (0.000)] 2024-10-11 14:28:43,900 - Train: 14.11% [52950/375300] [42.3/300.0] [batch_t 0.404 (0.402)] [data_t 0.015] [optim_t 0.389] [lr 0.002857] [CE 3.650 (3.925)] [KD 0.000 (0.000)] 2024-10-11 14:29:03,923 - Train: 14.12% [53000/375300] [42.4/300.0] [batch_t 0.402 (0.400)] [data_t 0.015] [optim_t 0.386] [lr 0.002856] [CE 3.808 (3.922)] [KD 0.000 (0.000)] 2024-10-11 14:29:24,035 - Train: 14.14% [53050/375300] [42.4/300.0] [batch_t 0.402 (0.402)] [data_t 0.015] [optim_t 0.387] [lr 0.002856] [CE 4.046 (3.922)] [KD 0.000 (0.000)] 2024-10-11 14:29:44,286 - Train: 14.15% [53100/375300] [42.4/300.0] [batch_t 0.412 (0.405)] [data_t 0.015] [optim_t 0.397] [lr 0.002856] [CE 3.844 (3.880)] [KD 0.000 (0.000)] 2024-10-11 14:30:04,742 - Train: 14.16% [53150/375300] [42.5/300.0] [batch_t 0.406 (0.409)] [data_t 0.015] [optim_t 0.391] [lr 0.002855] [CE 3.629 (3.859)] [KD 0.000 (0.000)] 2024-10-11 14:30:25,125 - Train: 14.18% [53200/375300] [42.5/300.0] [batch_t 0.390 (0.408)] [data_t 0.015] [optim_t 0.375] [lr 0.002855] [CE 4.067 (3.888)] [KD 0.000 (0.000)] 2024-10-11 14:30:45,673 - Train: 14.19% [53250/375300] [42.6/300.0] [batch_t 0.392 (0.411)] [data_t 0.015] [optim_t 0.377] [lr 0.002855] [CE 3.775 (3.933)] [KD 0.000 (0.000)] 2024-10-11 14:31:06,049 - Train: 14.20% [53300/375300] [42.6/300.0] [batch_t 0.424 (0.407)] [data_t 0.015] [optim_t 0.408] [lr 0.002855] [CE 3.882 (3.937)] [KD 0.000 (0.000)] 2024-10-11 14:31:27,033 - Train: 14.22% [53350/375300] [42.6/300.0] [batch_t 0.457 (0.420)] [data_t 0.015] [optim_t 0.441] [lr 0.002854] [CE 3.900 (3.969)] [KD 0.000 (0.000)] 2024-10-11 14:31:47,488 - Train: 14.23% [53400/375300] [42.7/300.0] [batch_t 0.392 (0.409)] [data_t 0.015] [optim_t 0.377] [lr 0.002854] [CE 3.901 (3.969)] [KD 0.000 (0.000)] 2024-10-11 14:32:08,138 - Train: 14.24% [53450/375300] [42.7/300.0] [batch_t 0.417 (0.413)] [data_t 0.015] [optim_t 0.402] [lr 0.002854] [CE 3.816 (3.876)] [KD 0.000 (0.000)] 2024-10-11 14:32:28,453 - Train: 14.26% [53500/375300] [42.8/300.0] [batch_t 0.436 (0.406)] [data_t 0.015] [optim_t 0.421] [lr 0.002854] [CE 3.994 (3.919)] [KD 0.000 (0.000)] 2024-10-11 14:32:49,229 - Train: 14.27% [53550/375300] [42.8/300.0] [batch_t 0.441 (0.415)] [data_t 0.015] [optim_t 0.426] [lr 0.002853] [CE 4.021 (3.944)] [KD 0.000 (0.000)] 2024-10-11 14:33:10,252 - Train: 14.28% [53600/375300] [42.8/300.0] [batch_t 0.430 (0.420)] [data_t 0.015] [optim_t 0.414] [lr 0.002853] [CE 3.774 (3.977)] [KD 0.000 (0.000)] 2024-10-11 14:33:30,980 - Train: 14.30% [53650/375300] [42.9/300.0] [batch_t 0.414 (0.414)] [data_t 0.016] [optim_t 0.399] [lr 0.002853] [CE 3.971 (3.905)] [KD 0.000 (0.000)] 2024-10-11 14:33:52,179 - Train: 14.31% [53700/375300] [42.9/300.0] [batch_t 0.424 (0.424)] [data_t 0.015] [optim_t 0.408] [lr 0.002852] [CE 4.279 (3.955)] [KD 0.000 (0.000)] 2024-10-11 14:34:13,388 - Train: 14.32% [53750/375300] [43.0/300.0] [batch_t 0.404 (0.424)] [data_t 0.015] [optim_t 0.388] [lr 0.002852] [CE 3.560 (3.879)] [KD 0.000 (0.000)] 2024-10-11 14:34:29,856 - ==> Total time: 6:24:30 Eta: 1 day, 14:18:05 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 14:34:38,312 - Train: 14.34% [53800/375300] [43.0/300.0] [batch_t 0.307 (1.010)] [data_t 0.015] [optim_t 0.292] [lr 0.002852] [CE 4.009 (3.895)] [KD 0.000 (0.000)] 2024-10-11 14:34:57,595 - Train: 14.35% [53850/375300] [43.0/300.0] [batch_t 0.510 (0.386)] [data_t 0.015] [optim_t 0.495] [lr 0.002852] [CE 3.650 (3.912)] [KD 0.000 (0.000)] 2024-10-11 14:35:19,094 - Train: 14.36% [53900/375300] [43.1/300.0] [batch_t 0.409 (0.430)] [data_t 0.015] [optim_t 0.394] [lr 0.002851] [CE 3.760 (3.862)] [KD 0.000 (0.000)] 2024-10-11 14:35:39,934 - Train: 14.38% [53950/375300] [43.1/300.0] [batch_t 0.422 (0.417)] [data_t 0.015] [optim_t 0.407] [lr 0.002851] [CE 3.916 (3.959)] [KD 0.000 (0.000)] 2024-10-11 14:36:01,235 - Train: 14.39% [54000/375300] [43.2/300.0] [batch_t 0.428 (0.426)] [data_t 0.015] [optim_t 0.413] [lr 0.002851] [CE 3.900 (3.904)] [KD 0.000 (0.000)] 2024-10-11 14:36:22,744 - Train: 14.40% [54050/375300] [43.2/300.0] [batch_t 0.443 (0.430)] [data_t 0.015] [optim_t 0.427] [lr 0.002851] [CE 3.923 (3.927)] [KD 0.000 (0.000)] 2024-10-11 14:36:43,746 - Train: 14.42% [54100/375300] [43.2/300.0] [batch_t 0.403 (0.420)] [data_t 0.015] [optim_t 0.387] [lr 0.002850] [CE 3.888 (3.905)] [KD 0.000 (0.000)] 2024-10-11 14:37:04,660 - Train: 14.43% [54150/375300] [43.3/300.0] [batch_t 0.450 (0.418)] [data_t 0.015] [optim_t 0.435] [lr 0.002850] [CE 4.121 (3.876)] [KD 0.000 (0.000)] 2024-10-11 14:37:25,417 - Train: 14.44% [54200/375300] [43.3/300.0] [batch_t 0.411 (0.415)] [data_t 0.015] [optim_t 0.396] [lr 0.002850] [CE 3.937 (3.878)] [KD 0.000 (0.000)] 2024-10-11 14:37:46,156 - Train: 14.46% [54250/375300] [43.4/300.0] [batch_t 0.447 (0.415)] [data_t 0.015] [optim_t 0.432] [lr 0.002849] [CE 3.929 (3.880)] [KD 0.000 (0.000)] 2024-10-11 14:38:07,141 - Train: 14.47% [54300/375300] [43.4/300.0] [batch_t 0.437 (0.420)] [data_t 0.015] [optim_t 0.422] [lr 0.002849] [CE 4.011 (3.912)] [KD 0.000 (0.000)] 2024-10-11 14:38:27,660 - Train: 14.48% [54350/375300] [43.4/300.0] [batch_t 0.403 (0.410)] [data_t 0.015] [optim_t 0.388] [lr 0.002849] [CE 4.135 (3.920)] [KD 0.000 (0.000)] 2024-10-11 14:38:48,360 - Train: 14.50% [54400/375300] [43.5/300.0] [batch_t 0.450 (0.414)] [data_t 0.015] [optim_t 0.434] [lr 0.002849] [CE 3.457 (3.888)] [KD 0.000 (0.000)] 2024-10-11 14:39:09,155 - Train: 14.51% [54450/375300] [43.5/300.0] [batch_t 0.492 (0.416)] [data_t 0.015] [optim_t 0.476] [lr 0.002848] [CE 3.545 (3.929)] [KD 0.000 (0.000)] 2024-10-11 14:39:29,768 - Train: 14.52% [54500/375300] [43.6/300.0] [batch_t 0.340 (0.412)] [data_t 0.015] [optim_t 0.325] [lr 0.002848] [CE 3.732 (3.924)] [KD 0.000 (0.000)] 2024-10-11 14:39:50,899 - Train: 14.54% [54550/375300] [43.6/300.0] [batch_t 0.401 (0.423)] [data_t 0.015] [optim_t 0.385] [lr 0.002848] [CE 3.948 (3.910)] [KD 0.000 (0.000)] 2024-10-11 14:40:11,667 - Train: 14.55% [54600/375300] [43.6/300.0] [batch_t 0.419 (0.415)] [data_t 0.015] [optim_t 0.404] [lr 0.002848] [CE 3.817 (3.927)] [KD 0.000 (0.000)] 2024-10-11 14:40:32,481 - Train: 14.56% [54650/375300] [43.7/300.0] [batch_t 0.463 (0.416)] [data_t 0.015] [optim_t 0.448] [lr 0.002847] [CE 3.531 (3.870)] [KD 0.000 (0.000)] 2024-10-11 14:40:53,373 - Train: 14.58% [54700/375300] [43.7/300.0] [batch_t 0.402 (0.418)] [data_t 0.015] [optim_t 0.386] [lr 0.002847] [CE 4.066 (3.923)] [KD 0.000 (0.000)] 2024-10-11 14:41:14,138 - Train: 14.59% [54750/375300] [43.8/300.0] [batch_t 0.418 (0.415)] [data_t 0.015] [optim_t 0.403] [lr 0.002847] [CE 3.824 (3.906)] [KD 0.000 (0.000)] 2024-10-11 14:41:34,815 - Train: 14.60% [54800/375300] [43.8/300.0] [batch_t 0.361 (0.413)] [data_t 0.015] [optim_t 0.345] [lr 0.002846] [CE 3.847 (3.925)] [KD 0.000 (0.000)] 2024-10-11 14:41:55,585 - Train: 14.61% [54850/375300] [43.8/300.0] [batch_t 0.454 (0.415)] [data_t 0.015] [optim_t 0.438] [lr 0.002846] [CE 3.913 (3.858)] [KD 0.000 (0.000)] 2024-10-11 14:42:16,637 - Train: 14.63% [54900/375300] [43.9/300.0] [batch_t 0.501 (0.421)] [data_t 0.015] [optim_t 0.486] [lr 0.002846] [CE 3.969 (3.944)] [KD 0.000 (0.000)] 2024-10-11 14:42:37,369 - Train: 14.64% [54950/375300] [43.9/300.0] [batch_t 0.457 (0.415)] [data_t 0.015] [optim_t 0.441] [lr 0.002846] [CE 4.248 (3.924)] [KD 0.000 (0.000)] 2024-10-11 14:42:58,239 - Train: 14.65% [55000/375300] [44.0/300.0] [batch_t 0.366 (0.417)] [data_t 0.015] [optim_t 0.350] [lr 0.002845] [CE 3.816 (3.904)] [KD 0.000 (0.000)] 2024-10-11 14:43:15,891 - ==> Total time: 6:33:16 Eta: 1 day, 14:08:08 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 14:43:23,576 - Train: 14.67% [55050/375300] [44.0/300.0] [batch_t 0.308 (1.057)] [data_t 0.015] [optim_t 0.293] [lr 0.002845] [CE 3.898 (3.977)] [KD 0.000 (0.000)] 2024-10-11 14:43:43,202 - Train: 14.68% [55100/375300] [44.0/300.0] [batch_t 0.461 (0.392)] [data_t 0.170] [optim_t 0.291] [lr 0.002845] [CE 4.105 (3.836)] [KD 0.000 (0.000)] 2024-10-11 14:44:04,089 - Train: 14.69% [55150/375300] [44.1/300.0] [batch_t 0.413 (0.418)] [data_t 0.123] [optim_t 0.290] [lr 0.002845] [CE 3.745 (3.887)] [KD 0.000 (0.000)] 2024-10-11 14:44:25,086 - Train: 14.71% [55200/375300] [44.1/300.0] [batch_t 0.391 (0.420)] [data_t 0.099] [optim_t 0.291] [lr 0.002844] [CE 4.119 (3.881)] [KD 0.000 (0.000)] 2024-10-11 14:44:45,730 - Train: 14.72% [55250/375300] [44.2/300.0] [batch_t 0.433 (0.413)] [data_t 0.143] [optim_t 0.290] [lr 0.002844] [CE 3.930 (3.916)] [KD 0.000 (0.000)] 2024-10-11 14:45:06,262 - Train: 14.73% [55300/375300] [44.2/300.0] [batch_t 0.420 (0.411)] [data_t 0.131] [optim_t 0.289] [lr 0.002844] [CE 3.971 (3.852)] [KD 0.000 (0.000)] 2024-10-11 14:45:27,755 - Train: 14.75% [55350/375300] [44.2/300.0] [batch_t 0.504 (0.430)] [data_t 0.196] [optim_t 0.308] [lr 0.002843] [CE 3.742 (3.893)] [KD 0.000 (0.000)] 2024-10-11 14:45:48,970 - Train: 14.76% [55400/375300] [44.3/300.0] [batch_t 0.404 (0.424)] [data_t 0.113] [optim_t 0.290] [lr 0.002843] [CE 3.540 (3.928)] [KD 0.000 (0.000)] 2024-10-11 14:46:09,792 - Train: 14.77% [55450/375300] [44.3/300.0] [batch_t 0.344 (0.416)] [data_t 0.055] [optim_t 0.289] [lr 0.002843] [CE 3.916 (3.941)] [KD 0.000 (0.000)] 2024-10-11 14:46:30,558 - Train: 14.79% [55500/375300] [44.4/300.0] [batch_t 0.401 (0.415)] [data_t 0.111] [optim_t 0.290] [lr 0.002843] [CE 4.035 (3.879)] [KD 0.000 (0.000)] 2024-10-11 14:46:51,443 - Train: 14.80% [55550/375300] [44.4/300.0] [batch_t 0.391 (0.418)] [data_t 0.101] [optim_t 0.289] [lr 0.002842] [CE 4.247 (3.904)] [KD 0.000 (0.000)] 2024-10-11 14:47:12,411 - Train: 14.81% [55600/375300] [44.4/300.0] [batch_t 0.403 (0.419)] [data_t 0.112] [optim_t 0.291] [lr 0.002842] [CE 3.886 (3.929)] [KD 0.000 (0.000)] 2024-10-11 14:47:33,417 - Train: 14.83% [55650/375300] [44.5/300.0] [batch_t 0.316 (0.420)] [data_t 0.027] [optim_t 0.289] [lr 0.002842] [CE 3.732 (3.860)] [KD 0.000 (0.000)] 2024-10-11 14:47:54,448 - Train: 14.84% [55700/375300] [44.5/300.0] [batch_t 0.454 (0.421)] [data_t 0.166] [optim_t 0.288] [lr 0.002841] [CE 3.808 (3.946)] [KD 0.000 (0.000)] 2024-10-11 14:48:15,362 - Train: 14.85% [55750/375300] [44.6/300.0] [batch_t 0.452 (0.418)] [data_t 0.161] [optim_t 0.291] [lr 0.002841] [CE 3.887 (3.911)] [KD 0.000 (0.000)] 2024-10-11 14:48:36,335 - Train: 14.87% [55800/375300] [44.6/300.0] [batch_t 0.371 (0.419)] [data_t 0.080] [optim_t 0.291] [lr 0.002841] [CE 4.017 (3.897)] [KD 0.000 (0.000)] 2024-10-11 14:48:57,372 - Train: 14.88% [55850/375300] [44.6/300.0] [batch_t 0.383 (0.421)] [data_t 0.095] [optim_t 0.288] [lr 0.002841] [CE 4.145 (3.966)] [KD 0.000 (0.000)] 2024-10-11 14:49:17,883 - Train: 14.89% [55900/375300] [44.7/300.0] [batch_t 0.431 (0.410)] [data_t 0.140] [optim_t 0.291] [lr 0.002840] [CE 3.866 (3.878)] [KD 0.000 (0.000)] 2024-10-11 14:49:38,950 - Train: 14.91% [55950/375300] [44.7/300.0] [batch_t 0.489 (0.421)] [data_t 0.197] [optim_t 0.292] [lr 0.002840] [CE 3.852 (3.900)] [KD 0.000 (0.000)] 2024-10-11 14:49:59,863 - Train: 14.92% [56000/375300] [44.8/300.0] [batch_t 0.366 (0.418)] [data_t 0.076] [optim_t 0.290] [lr 0.002840] [CE 3.905 (3.912)] [KD 0.000 (0.000)] 2024-10-11 14:50:21,193 - Train: 14.93% [56050/375300] [44.8/300.0] [batch_t 0.374 (0.426)] [data_t 0.083] [optim_t 0.291] [lr 0.002840] [CE 4.279 (3.879)] [KD 0.000 (0.000)] 2024-10-11 14:50:41,892 - Train: 14.95% [56100/375300] [44.8/300.0] [batch_t 0.413 (0.414)] [data_t 0.122] [optim_t 0.291] [lr 0.002839] [CE 3.805 (3.910)] [KD 0.000 (0.000)] 2024-10-11 14:51:02,869 - Train: 14.96% [56150/375300] [44.9/300.0] [batch_t 0.391 (0.419)] [data_t 0.100] [optim_t 0.290] [lr 0.002839] [CE 3.981 (3.932)] [KD 0.000 (0.000)] 2024-10-11 14:51:24,193 - Train: 14.97% [56200/375300] [44.9/300.0] [batch_t 0.410 (0.426)] [data_t 0.121] [optim_t 0.289] [lr 0.002839] [CE 3.984 (3.893)] [KD 0.000 (0.000)] 2024-10-11 14:51:45,373 - Train: 14.99% [56250/375300] [45.0/300.0] [batch_t 0.402 (0.424)] [data_t 0.110] [optim_t 0.293] [lr 0.002838] [CE 3.663 (3.865)] [KD 0.000 (0.000)] 2024-10-11 14:52:23,170 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.401)] [top1_cnt 34264] [top5_cnt 44626] [top_all 50000] 2024-10-11 14:52:23,170 - net: 68.528 (89.252) 2024-10-11 14:52:43,667 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.403)] [top1_cnt 37402] [top5_cnt 46285] [top_all 50000] 2024-10-11 14:52:43,667 - net_E: 74.804 (92.570) 2024-10-11 14:52:43,823 - Max [top1: 68.528 (epoch: 45)] [top1-ema: 74.804 (epoch: 45)] 2024-10-11 14:52:43,823 - ==> Total time: 6:42:44 Eta: 1 day, 14:02:11 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 14:52:54,009 - Train: 15.00% [56300/375300] [45.0/300.0] [batch_t 0.306 (0.650)] [data_t 0.015] [optim_t 0.290] [lr 0.002838] [CE 3.987 (3.966)] [KD 0.000 (0.000)] 2024-10-11 14:53:12,780 - Train: 15.01% [56350/375300] [45.0/300.0] [batch_t 0.434 (0.375)] [data_t 0.144] [optim_t 0.290] [lr 0.002838] [CE 3.828 (3.853)] [KD 0.000 (0.000)] 2024-10-11 14:53:33,497 - Train: 15.03% [56400/375300] [45.1/300.0] [batch_t 0.400 (0.414)] [data_t 0.112] [optim_t 0.288] [lr 0.002838] [CE 3.790 (3.916)] [KD 0.000 (0.000)] 2024-10-11 14:53:54,150 - Train: 15.04% [56450/375300] [45.1/300.0] [batch_t 0.428 (0.413)] [data_t 0.015] [optim_t 0.413] [lr 0.002837] [CE 4.254 (3.897)] [KD 0.000 (0.000)] 2024-10-11 14:54:15,366 - Train: 15.05% [56500/375300] [45.2/300.0] [batch_t 0.491 (0.424)] [data_t 0.015] [optim_t 0.476] [lr 0.002837] [CE 3.884 (3.870)] [KD 0.000 (0.000)] 2024-10-11 14:54:35,929 - Train: 15.07% [56550/375300] [45.2/300.0] [batch_t 0.385 (0.411)] [data_t 0.016] [optim_t 0.370] [lr 0.002837] [CE 3.942 (3.889)] [KD 0.000 (0.000)] 2024-10-11 14:54:56,815 - Train: 15.08% [56600/375300] [45.2/300.0] [batch_t 0.421 (0.418)] [data_t 0.015] [optim_t 0.406] [lr 0.002836] [CE 3.997 (3.902)] [KD 0.000 (0.000)] 2024-10-11 14:55:17,638 - Train: 15.09% [56650/375300] [45.3/300.0] [batch_t 0.415 (0.416)] [data_t 0.015] [optim_t 0.400] [lr 0.002836] [CE 3.769 (3.855)] [KD 0.000 (0.000)] 2024-10-11 14:55:38,218 - Train: 15.11% [56700/375300] [45.3/300.0] [batch_t 0.398 (0.411)] [data_t 0.015] [optim_t 0.382] [lr 0.002836] [CE 3.924 (3.852)] [KD 0.000 (0.000)] 2024-10-11 14:55:59,093 - Train: 15.12% [56750/375300] [45.4/300.0] [batch_t 0.405 (0.417)] [data_t 0.015] [optim_t 0.390] [lr 0.002836] [CE 4.008 (3.909)] [KD 0.000 (0.000)] 2024-10-11 14:56:19,903 - Train: 15.13% [56800/375300] [45.4/300.0] [batch_t 0.438 (0.416)] [data_t 0.015] [optim_t 0.423] [lr 0.002835] [CE 4.194 (3.911)] [KD 0.000 (0.000)] 2024-10-11 14:56:40,595 - Train: 15.15% [56850/375300] [45.4/300.0] [batch_t 0.367 (0.414)] [data_t 0.015] [optim_t 0.352] [lr 0.002835] [CE 3.998 (3.913)] [KD 0.000 (0.000)] 2024-10-11 14:57:01,334 - Train: 15.16% [56900/375300] [45.5/300.0] [batch_t 0.450 (0.415)] [data_t 0.015] [optim_t 0.435] [lr 0.002835] [CE 3.614 (3.872)] [KD 0.000 (0.000)] 2024-10-11 14:57:21,965 - Train: 15.17% [56950/375300] [45.5/300.0] [batch_t 0.436 (0.412)] [data_t 0.015] [optim_t 0.421] [lr 0.002834] [CE 4.206 (3.919)] [KD 0.000 (0.000)] 2024-10-11 14:57:42,491 - Train: 15.19% [57000/375300] [45.6/300.0] [batch_t 0.396 (0.410)] [data_t 0.015] [optim_t 0.381] [lr 0.002834] [CE 4.116 (3.919)] [KD 0.000 (0.000)] 2024-10-11 14:58:03,463 - Train: 15.20% [57050/375300] [45.6/300.0] [batch_t 0.394 (0.419)] [data_t 0.015] [optim_t 0.379] [lr 0.002834] [CE 4.173 (3.864)] [KD 0.000 (0.000)] 2024-10-11 14:58:23,921 - Train: 15.21% [57100/375300] [45.6/300.0] [batch_t 0.362 (0.409)] [data_t 0.015] [optim_t 0.347] [lr 0.002834] [CE 3.808 (3.960)] [KD 0.000 (0.000)] 2024-10-11 14:58:44,644 - Train: 15.23% [57150/375300] [45.7/300.0] [batch_t 0.389 (0.414)] [data_t 0.015] [optim_t 0.374] [lr 0.002833] [CE 4.055 (3.889)] [KD 0.000 (0.000)] 2024-10-11 14:59:06,065 - Train: 15.24% [57200/375300] [45.7/300.0] [batch_t 0.422 (0.428)] [data_t 0.015] [optim_t 0.406] [lr 0.002833] [CE 4.112 (3.898)] [KD 0.000 (0.000)] 2024-10-11 14:59:27,038 - Train: 15.25% [57250/375300] [45.8/300.0] [batch_t 0.429 (0.419)] [data_t 0.015] [optim_t 0.414] [lr 0.002833] [CE 3.912 (3.952)] [KD 0.000 (0.000)] 2024-10-11 14:59:47,926 - Train: 15.27% [57300/375300] [45.8/300.0] [batch_t 0.407 (0.418)] [data_t 0.015] [optim_t 0.391] [lr 0.002832] [CE 4.046 (3.869)] [KD 0.000 (0.000)] 2024-10-11 15:00:08,886 - Train: 15.28% [57350/375300] [45.8/300.0] [batch_t 0.400 (0.419)] [data_t 0.015] [optim_t 0.384] [lr 0.002832] [CE 4.070 (3.899)] [KD 0.000 (0.000)] 2024-10-11 15:00:29,916 - Train: 15.29% [57400/375300] [45.9/300.0] [batch_t 0.397 (0.420)] [data_t 0.015] [optim_t 0.382] [lr 0.002832] [CE 3.779 (3.879)] [KD 0.000 (0.000)] 2024-10-11 15:00:50,876 - Train: 15.31% [57450/375300] [45.9/300.0] [batch_t 0.423 (0.419)] [data_t 0.016] [optim_t 0.408] [lr 0.002832] [CE 3.841 (3.905)] [KD 0.000 (0.000)] 2024-10-11 15:01:12,345 - Train: 15.32% [57500/375300] [46.0/300.0] [batch_t 0.405 (0.429)] [data_t 0.015] [optim_t 0.389] [lr 0.002831] [CE 3.916 (3.871)] [KD 0.000 (0.000)] 2024-10-11 15:01:30,934 - ==> Total time: 6:51:31 Eta: 1 day, 13:52:19 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 15:01:38,806 - Train: 15.33% [57550/375300] [46.0/300.0] [batch_t 0.307 (1.637)] [data_t 0.015] [optim_t 0.291] [lr 0.002831] [CE 4.043 (3.863)] [KD 0.000 (0.000)] 2024-10-11 15:01:57,062 - Train: 15.35% [57600/375300] [46.0/300.0] [batch_t 0.421 (0.365)] [data_t 0.015] [optim_t 0.406] [lr 0.002831] [CE 4.197 (3.931)] [KD 0.000 (0.000)] 2024-10-11 15:02:17,446 - Train: 15.36% [57650/375300] [46.1/300.0] [batch_t 0.390 (0.408)] [data_t 0.015] [optim_t 0.375] [lr 0.002830] [CE 4.126 (3.937)] [KD 0.000 (0.000)] 2024-10-11 15:02:38,183 - Train: 15.37% [57700/375300] [46.1/300.0] [batch_t 0.393 (0.415)] [data_t 0.101] [optim_t 0.292] [lr 0.002830] [CE 3.898 (3.898)] [KD 0.000 (0.000)] 2024-10-11 15:02:59,153 - Train: 15.39% [57750/375300] [46.2/300.0] [batch_t 0.373 (0.419)] [data_t 0.015] [optim_t 0.358] [lr 0.002830] [CE 4.052 (3.870)] [KD 0.000 (0.000)] 2024-10-11 15:03:20,046 - Train: 15.40% [57800/375300] [46.2/300.0] [batch_t 0.417 (0.418)] [data_t 0.015] [optim_t 0.402] [lr 0.002830] [CE 3.908 (3.877)] [KD 0.000 (0.000)] 2024-10-11 15:03:40,575 - Train: 15.41% [57850/375300] [46.2/300.0] [batch_t 0.392 (0.410)] [data_t 0.015] [optim_t 0.377] [lr 0.002829] [CE 3.731 (3.857)] [KD 0.000 (0.000)] 2024-10-11 15:04:01,153 - Train: 15.43% [57900/375300] [46.3/300.0] [batch_t 0.428 (0.411)] [data_t 0.015] [optim_t 0.413] [lr 0.002829] [CE 3.927 (3.884)] [KD 0.000 (0.000)] 2024-10-11 15:04:21,906 - Train: 15.44% [57950/375300] [46.3/300.0] [batch_t 0.444 (0.415)] [data_t 0.015] [optim_t 0.428] [lr 0.002829] [CE 3.603 (3.870)] [KD 0.000 (0.000)] 2024-10-11 15:04:42,985 - Train: 15.45% [58000/375300] [46.4/300.0] [batch_t 0.408 (0.421)] [data_t 0.015] [optim_t 0.393] [lr 0.002828] [CE 3.774 (3.849)] [KD 0.000 (0.000)] 2024-10-11 15:05:04,020 - Train: 15.47% [58050/375300] [46.4/300.0] [batch_t 0.470 (0.421)] [data_t 0.015] [optim_t 0.455] [lr 0.002828] [CE 3.879 (3.882)] [KD 0.000 (0.000)] 2024-10-11 15:05:24,629 - Train: 15.48% [58100/375300] [46.4/300.0] [batch_t 0.404 (0.412)] [data_t 0.015] [optim_t 0.389] [lr 0.002828] [CE 4.033 (3.854)] [KD 0.000 (0.000)] 2024-10-11 15:05:45,414 - Train: 15.49% [58150/375300] [46.5/300.0] [batch_t 0.389 (0.416)] [data_t 0.015] [optim_t 0.374] [lr 0.002828] [CE 3.776 (3.869)] [KD 0.000 (0.000)] 2024-10-11 15:06:06,147 - Train: 15.51% [58200/375300] [46.5/300.0] [batch_t 0.418 (0.415)] [data_t 0.015] [optim_t 0.403] [lr 0.002827] [CE 4.070 (3.857)] [KD 0.000 (0.000)] 2024-10-11 15:06:27,133 - Train: 15.52% [58250/375300] [46.6/300.0] [batch_t 0.385 (0.420)] [data_t 0.015] [optim_t 0.370] [lr 0.002827] [CE 4.227 (3.884)] [KD 0.000 (0.000)] 2024-10-11 15:06:48,408 - Train: 15.53% [58300/375300] [46.6/300.0] [batch_t 0.358 (0.425)] [data_t 0.015] [optim_t 0.343] [lr 0.002827] [CE 3.947 (3.883)] [KD 0.000 (0.000)] 2024-10-11 15:07:09,368 - Train: 15.55% [58350/375300] [46.6/300.0] [batch_t 0.432 (0.419)] [data_t 0.015] [optim_t 0.417] [lr 0.002826] [CE 4.110 (3.832)] [KD 0.000 (0.000)] 2024-10-11 15:07:30,047 - Train: 15.56% [58400/375300] [46.7/300.0] [batch_t 0.377 (0.413)] [data_t 0.033] [optim_t 0.343] [lr 0.002826] [CE 3.962 (3.875)] [KD 0.000 (0.000)] 2024-10-11 15:07:51,506 - Train: 15.57% [58450/375300] [46.7/300.0] [batch_t 0.409 (0.429)] [data_t 0.119] [optim_t 0.289] [lr 0.002826] [CE 3.885 (3.916)] [KD 0.000 (0.000)] 2024-10-11 15:08:13,091 - Train: 15.59% [58500/375300] [46.8/300.0] [batch_t 0.452 (0.432)] [data_t 0.163] [optim_t 0.288] [lr 0.002825] [CE 4.023 (3.894)] [KD 0.000 (0.000)] 2024-10-11 15:08:34,479 - Train: 15.60% [58550/375300] [46.8/300.0] [batch_t 0.400 (0.428)] [data_t 0.109] [optim_t 0.290] [lr 0.002825] [CE 4.032 (3.894)] [KD 0.000 (0.000)] 2024-10-11 15:08:55,628 - Train: 15.61% [58600/375300] [46.8/300.0] [batch_t 0.476 (0.423)] [data_t 0.188] [optim_t 0.288] [lr 0.002825] [CE 3.985 (3.909)] [KD 0.000 (0.000)] 2024-10-11 15:09:16,580 - Train: 15.63% [58650/375300] [46.9/300.0] [batch_t 0.496 (0.419)] [data_t 0.207] [optim_t 0.289] [lr 0.002825] [CE 3.821 (3.829)] [KD 0.000 (0.000)] 2024-10-11 15:09:37,573 - Train: 15.64% [58700/375300] [46.9/300.0] [batch_t 0.390 (0.420)] [data_t 0.100] [optim_t 0.290] [lr 0.002824] [CE 3.722 (3.941)] [KD 0.000 (0.000)] 2024-10-11 15:09:58,883 - Train: 15.65% [58750/375300] [47.0/300.0] [batch_t 0.463 (0.426)] [data_t 0.170] [optim_t 0.293] [lr 0.002824] [CE 3.379 (3.904)] [KD 0.000 (0.000)] 2024-10-11 15:10:17,345 - ==> Total time: 7:00:17 Eta: 1 day, 13:42:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 15:10:24,496 - Train: 15.67% [58800/375300] [47.0/300.0] [batch_t 0.307 (1.899)] [data_t 0.015] [optim_t 0.291] [lr 0.002824] [CE 3.954 (3.786)] [KD 0.000 (0.000)] 2024-10-11 15:10:42,799 - Train: 15.68% [58850/375300] [47.0/300.0] [batch_t 0.373 (0.366)] [data_t 0.015] [optim_t 0.358] [lr 0.002823] [CE 3.994 (3.879)] [KD 0.000 (0.000)] 2024-10-11 15:11:03,010 - Train: 15.69% [58900/375300] [47.1/300.0] [batch_t 0.376 (0.404)] [data_t 0.015] [optim_t 0.361] [lr 0.002823] [CE 4.064 (3.892)] [KD 0.000 (0.000)] 2024-10-11 15:11:23,409 - Train: 15.71% [58950/375300] [47.1/300.0] [batch_t 0.420 (0.408)] [data_t 0.015] [optim_t 0.405] [lr 0.002823] [CE 3.494 (3.932)] [KD 0.000 (0.000)] 2024-10-11 15:11:43,966 - Train: 15.72% [59000/375300] [47.2/300.0] [batch_t 0.441 (0.411)] [data_t 0.015] [optim_t 0.425] [lr 0.002823] [CE 4.015 (3.883)] [KD 0.000 (0.000)] 2024-10-11 15:12:04,149 - Train: 15.73% [59050/375300] [47.2/300.0] [batch_t 0.388 (0.404)] [data_t 0.015] [optim_t 0.372] [lr 0.002822] [CE 4.016 (3.874)] [KD 0.000 (0.000)] 2024-10-11 15:12:24,633 - Train: 15.75% [59100/375300] [47.2/300.0] [batch_t 0.414 (0.410)] [data_t 0.015] [optim_t 0.399] [lr 0.002822] [CE 3.667 (3.886)] [KD 0.000 (0.000)] 2024-10-11 15:12:45,301 - Train: 15.76% [59150/375300] [47.3/300.0] [batch_t 0.398 (0.413)] [data_t 0.015] [optim_t 0.383] [lr 0.002822] [CE 4.120 (3.934)] [KD 0.000 (0.000)] 2024-10-11 15:13:05,976 - Train: 15.77% [59200/375300] [47.3/300.0] [batch_t 0.406 (0.413)] [data_t 0.015] [optim_t 0.391] [lr 0.002821] [CE 4.198 (3.901)] [KD 0.000 (0.000)] 2024-10-11 15:13:26,512 - Train: 15.79% [59250/375300] [47.4/300.0] [batch_t 0.358 (0.411)] [data_t 0.015] [optim_t 0.342] [lr 0.002821] [CE 3.995 (3.890)] [KD 0.000 (0.000)] 2024-10-11 15:13:47,317 - Train: 15.80% [59300/375300] [47.4/300.0] [batch_t 0.425 (0.416)] [data_t 0.050] [optim_t 0.376] [lr 0.002821] [CE 4.025 (3.958)] [KD 0.000 (0.000)] 2024-10-11 15:14:08,300 - Train: 15.81% [59350/375300] [47.4/300.0] [batch_t 0.463 (0.420)] [data_t 0.170] [optim_t 0.293] [lr 0.002820] [CE 3.546 (3.923)] [KD 0.000 (0.000)] 2024-10-11 15:14:29,129 - Train: 15.83% [59400/375300] [47.5/300.0] [batch_t 0.417 (0.416)] [data_t 0.126] [optim_t 0.291] [lr 0.002820] [CE 3.950 (3.890)] [KD 0.000 (0.000)] 2024-10-11 15:14:50,409 - Train: 15.84% [59450/375300] [47.5/300.0] [batch_t 0.427 (0.425)] [data_t 0.136] [optim_t 0.291] [lr 0.002820] [CE 4.066 (3.896)] [KD 0.000 (0.000)] 2024-10-11 15:15:11,244 - Train: 15.85% [59500/375300] [47.6/300.0] [batch_t 0.425 (0.417)] [data_t 0.129] [optim_t 0.296] [lr 0.002820] [CE 3.983 (3.886)] [KD 0.000 (0.000)] 2024-10-11 15:15:32,206 - Train: 15.87% [59550/375300] [47.6/300.0] [batch_t 0.378 (0.419)] [data_t 0.087] [optim_t 0.291] [lr 0.002819] [CE 4.131 (3.914)] [KD 0.000 (0.000)] 2024-10-11 15:15:52,759 - Train: 15.88% [59600/375300] [47.6/300.0] [batch_t 0.424 (0.411)] [data_t 0.131] [optim_t 0.293] [lr 0.002819] [CE 3.771 (3.886)] [KD 0.000 (0.000)] 2024-10-11 15:16:14,061 - Train: 15.89% [59650/375300] [47.7/300.0] [batch_t 0.569 (0.426)] [data_t 0.112] [optim_t 0.457] [lr 0.002819] [CE 3.941 (3.909)] [KD 0.000 (0.000)] 2024-10-11 15:16:35,023 - Train: 15.91% [59700/375300] [47.7/300.0] [batch_t 0.361 (0.419)] [data_t 0.068] [optim_t 0.293] [lr 0.002818] [CE 3.380 (3.892)] [KD 0.000 (0.000)] 2024-10-11 15:16:55,822 - Train: 15.92% [59750/375300] [47.8/300.0] [batch_t 0.362 (0.416)] [data_t 0.015] [optim_t 0.346] [lr 0.002818] [CE 3.999 (3.833)] [KD 0.000 (0.000)] 2024-10-11 15:17:16,828 - Train: 15.93% [59800/375300] [47.8/300.0] [batch_t 0.420 (0.420)] [data_t 0.016] [optim_t 0.404] [lr 0.002818] [CE 3.974 (3.840)] [KD 0.000 (0.000)] 2024-10-11 15:17:37,685 - Train: 15.95% [59850/375300] [47.8/300.0] [batch_t 0.450 (0.417)] [data_t 0.015] [optim_t 0.434] [lr 0.002818] [CE 3.996 (3.927)] [KD 0.000 (0.000)] 2024-10-11 15:17:58,651 - Train: 15.96% [59900/375300] [47.9/300.0] [batch_t 0.431 (0.419)] [data_t 0.015] [optim_t 0.415] [lr 0.002817] [CE 4.222 (3.891)] [KD 0.000 (0.000)] 2024-10-11 15:18:19,598 - Train: 15.97% [59950/375300] [47.9/300.0] [batch_t 0.326 (0.419)] [data_t 0.015] [optim_t 0.310] [lr 0.002817] [CE 3.619 (3.900)] [KD 0.000 (0.000)] 2024-10-11 15:18:41,056 - Train: 15.99% [60000/375300] [48.0/300.0] [batch_t 0.445 (0.429)] [data_t 0.015] [optim_t 0.430] [lr 0.002817] [CE 3.916 (3.920)] [KD 0.000 (0.000)] 2024-10-11 15:18:59,774 - ==> Total time: 7:09:00 Eta: 1 day, 13:32:16 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 15:19:06,616 - Train: 16.00% [60050/375300] [48.0/300.0] [batch_t 0.375 (2.690)] [data_t 0.015] [optim_t 0.360] [lr 0.002816] [CE 4.023 (4.026)] [KD 0.000 (0.000)] 2024-10-11 15:19:26,670 - Train: 16.01% [60100/375300] [48.0/300.0] [batch_t 0.422 (0.401)] [data_t 0.015] [optim_t 0.406] [lr 0.002816] [CE 3.901 (3.830)] [KD 0.000 (0.000)] 2024-10-11 15:19:48,008 - Train: 16.03% [60150/375300] [48.1/300.0] [batch_t 0.447 (0.427)] [data_t 0.015] [optim_t 0.432] [lr 0.002816] [CE 3.662 (3.850)] [KD 0.000 (0.000)] 2024-10-11 15:20:09,403 - Train: 16.04% [60200/375300] [48.1/300.0] [batch_t 0.434 (0.428)] [data_t 0.015] [optim_t 0.418] [lr 0.002815] [CE 3.842 (3.918)] [KD 0.000 (0.000)] 2024-10-11 15:20:30,251 - Train: 16.05% [60250/375300] [48.2/300.0] [batch_t 0.422 (0.417)] [data_t 0.016] [optim_t 0.406] [lr 0.002815] [CE 4.080 (3.873)] [KD 0.000 (0.000)] 2024-10-11 15:20:51,713 - Train: 16.07% [60300/375300] [48.2/300.0] [batch_t 0.464 (0.429)] [data_t 0.015] [optim_t 0.449] [lr 0.002815] [CE 3.808 (3.830)] [KD 0.000 (0.000)] 2024-10-11 15:21:12,319 - Train: 16.08% [60350/375300] [48.2/300.0] [batch_t 0.405 (0.412)] [data_t 0.015] [optim_t 0.390] [lr 0.002815] [CE 3.772 (3.905)] [KD 0.000 (0.000)] 2024-10-11 15:21:32,514 - Train: 16.09% [60400/375300] [48.3/300.0] [batch_t 0.398 (0.404)] [data_t 0.015] [optim_t 0.382] [lr 0.002814] [CE 3.706 (3.867)] [KD 0.000 (0.000)] 2024-10-11 15:21:52,687 - Train: 16.11% [60450/375300] [48.3/300.0] [batch_t 0.355 (0.403)] [data_t 0.015] [optim_t 0.340] [lr 0.002814] [CE 3.865 (3.904)] [KD 0.000 (0.000)] 2024-10-11 15:22:13,267 - Train: 16.12% [60500/375300] [48.4/300.0] [batch_t 0.342 (0.411)] [data_t 0.015] [optim_t 0.327] [lr 0.002814] [CE 3.545 (3.871)] [KD 0.000 (0.000)] 2024-10-11 15:22:34,334 - Train: 16.13% [60550/375300] [48.4/300.0] [batch_t 0.474 (0.421)] [data_t 0.015] [optim_t 0.458] [lr 0.002813] [CE 3.930 (3.857)] [KD 0.000 (0.000)] 2024-10-11 15:22:54,886 - Train: 16.15% [60600/375300] [48.4/300.0] [batch_t 0.396 (0.411)] [data_t 0.015] [optim_t 0.381] [lr 0.002813] [CE 3.742 (3.838)] [KD 0.000 (0.000)] 2024-10-11 15:23:15,938 - Train: 16.16% [60650/375300] [48.5/300.0] [batch_t 0.426 (0.421)] [data_t 0.015] [optim_t 0.411] [lr 0.002813] [CE 3.644 (3.944)] [KD 0.000 (0.000)] 2024-10-11 15:23:37,354 - Train: 16.17% [60700/375300] [48.5/300.0] [batch_t 0.361 (0.428)] [data_t 0.015] [optim_t 0.346] [lr 0.002812] [CE 4.015 (3.870)] [KD 0.000 (0.000)] 2024-10-11 15:23:58,383 - Train: 16.19% [60750/375300] [48.6/300.0] [batch_t 0.414 (0.420)] [data_t 0.015] [optim_t 0.399] [lr 0.002812] [CE 4.141 (3.925)] [KD 0.000 (0.000)] 2024-10-11 15:24:19,592 - Train: 16.20% [60800/375300] [48.6/300.0] [batch_t 0.456 (0.424)] [data_t 0.015] [optim_t 0.441] [lr 0.002812] [CE 3.923 (3.923)] [KD 0.000 (0.000)] 2024-10-11 15:24:40,565 - Train: 16.21% [60850/375300] [48.6/300.0] [batch_t 0.410 (0.419)] [data_t 0.015] [optim_t 0.394] [lr 0.002811] [CE 3.819 (3.833)] [KD 0.000 (0.000)] 2024-10-11 15:25:01,329 - Train: 16.23% [60900/375300] [48.7/300.0] [batch_t 0.405 (0.415)] [data_t 0.015] [optim_t 0.390] [lr 0.002811] [CE 3.485 (3.828)] [KD 0.000 (0.000)] 2024-10-11 15:25:21,928 - Train: 16.24% [60950/375300] [48.7/300.0] [batch_t 0.360 (0.412)] [data_t 0.016] [optim_t 0.344] [lr 0.002811] [CE 3.765 (3.851)] [KD 0.000 (0.000)] 2024-10-11 15:25:43,167 - Train: 16.25% [61000/375300] [48.8/300.0] [batch_t 0.534 (0.425)] [data_t 0.015] [optim_t 0.519] [lr 0.002811] [CE 3.885 (3.868)] [KD 0.000 (0.000)] 2024-10-11 15:26:04,042 - Train: 16.27% [61050/375300] [48.8/300.0] [batch_t 0.391 (0.417)] [data_t 0.015] [optim_t 0.376] [lr 0.002810] [CE 3.800 (3.902)] [KD 0.000 (0.000)] 2024-10-11 15:26:25,060 - Train: 16.28% [61100/375300] [48.8/300.0] [batch_t 0.355 (0.420)] [data_t 0.015] [optim_t 0.340] [lr 0.002810] [CE 4.006 (3.926)] [KD 0.000 (0.000)] 2024-10-11 15:26:45,791 - Train: 16.29% [61150/375300] [48.9/300.0] [batch_t 0.385 (0.415)] [data_t 0.015] [optim_t 0.370] [lr 0.002810] [CE 4.011 (3.880)] [KD 0.000 (0.000)] 2024-10-11 15:27:07,702 - Train: 16.31% [61200/375300] [48.9/300.0] [batch_t 0.471 (0.438)] [data_t 0.015] [optim_t 0.456] [lr 0.002809] [CE 3.939 (3.901)] [KD 0.000 (0.000)] 2024-10-11 15:27:29,448 - Train: 16.32% [61250/375300] [49.0/300.0] [batch_t 0.395 (0.435)] [data_t 0.015] [optim_t 0.380] [lr 0.002809] [CE 3.847 (3.857)] [KD 0.000 (0.000)] 2024-10-11 15:27:48,937 - ==> Total time: 7:17:49 Eta: 1 day, 13:22:43 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 15:27:54,124 - Train: 16.33% [61300/375300] [49.0/300.0] [batch_t 3.615 (3.615)] [data_t 2.236] [optim_t 1.379] [lr 0.002809] [CE 3.796 (3.796)] [KD 0.000 (0.000)] 2024-10-11 15:28:14,001 - Train: 16.35% [61350/375300] [49.0/300.0] [batch_t 0.370 (0.397)] [data_t 0.015] [optim_t 0.355] [lr 0.002808] [CE 3.901 (3.874)] [KD 0.000 (0.000)] 2024-10-11 15:28:35,886 - Train: 16.36% [61400/375300] [49.1/300.0] [batch_t 0.494 (0.438)] [data_t 0.015] [optim_t 0.479] [lr 0.002808] [CE 4.013 (3.843)] [KD 0.000 (0.000)] 2024-10-11 15:28:57,612 - Train: 16.37% [61450/375300] [49.1/300.0] [batch_t 0.459 (0.434)] [data_t 0.015] [optim_t 0.444] [lr 0.002808] [CE 3.713 (3.884)] [KD 0.000 (0.000)] 2024-10-11 15:29:18,830 - Train: 16.39% [61500/375300] [49.2/300.0] [batch_t 0.417 (0.424)] [data_t 0.015] [optim_t 0.401] [lr 0.002808] [CE 3.392 (3.882)] [KD 0.000 (0.000)] 2024-10-11 15:29:40,286 - Train: 16.40% [61550/375300] [49.2/300.0] [batch_t 0.397 (0.429)] [data_t 0.015] [optim_t 0.381] [lr 0.002807] [CE 4.104 (3.877)] [KD 0.000 (0.000)] 2024-10-11 15:30:01,800 - Train: 16.41% [61600/375300] [49.2/300.0] [batch_t 0.432 (0.430)] [data_t 0.015] [optim_t 0.416] [lr 0.002807] [CE 4.130 (3.919)] [KD 0.000 (0.000)] 2024-10-11 15:30:23,300 - Train: 16.43% [61650/375300] [49.3/300.0] [batch_t 0.481 (0.430)] [data_t 0.015] [optim_t 0.466] [lr 0.002807] [CE 4.197 (3.902)] [KD 0.000 (0.000)] 2024-10-11 15:30:45,343 - Train: 16.44% [61700/375300] [49.3/300.0] [batch_t 0.464 (0.441)] [data_t 0.015] [optim_t 0.448] [lr 0.002806] [CE 4.025 (3.843)] [KD 0.000 (0.000)] 2024-10-11 15:31:06,697 - Train: 16.45% [61750/375300] [49.4/300.0] [batch_t 0.422 (0.427)] [data_t 0.015] [optim_t 0.407] [lr 0.002806] [CE 3.671 (3.856)] [KD 0.000 (0.000)] 2024-10-11 15:31:27,961 - Train: 16.47% [61800/375300] [49.4/300.0] [batch_t 0.426 (0.425)] [data_t 0.015] [optim_t 0.410] [lr 0.002806] [CE 3.691 (3.855)] [KD 0.000 (0.000)] 2024-10-11 15:31:49,783 - Train: 16.48% [61850/375300] [49.4/300.0] [batch_t 0.395 (0.436)] [data_t 0.015] [optim_t 0.380] [lr 0.002805] [CE 4.404 (3.910)] [KD 0.000 (0.000)] 2024-10-11 19:04:44,440 - ==> Logging on master GPU: 0 2024-10-11 19:04:44,443 - ==> Running Trainer: CLSTrainer 2024-10-11 19:04:44,443 - ==> Using GPU: [0, 1, 2, 3, 4, 5, 6, 7] for Training 2024-10-11 19:04:44,443 - ==> Building model 2024-10-11 19:04:44,844 - ==> Load checkpoint: runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000/latest_ckpt.pth 2024-10-11 19:04:44,844 - ==> Creating optimizer 2024-10-11 19:04:44,850 - ==> Native DDP 2024-10-11 19:04:45,210 - ==> Loading dataset: ImageFolderLMDB 2024-10-11 19:04:45,522 - ==> ********** cfg ********** seed : 42 size : 512 epoch_full : 300 warmup_epochs : 20 test_start_epoch : 200 batch_size : 1024 lr : 0.0015 weight_decay : 0.05 nb_classes : 1000 ft : False data.type : ImageFolderLMDB data.root : /dev/shm/tmp/imagenet data.loader_type : pil data.sampler : naive data.nb_classes : 1000 data.train_transforms : [{'type': 'timm_create_transform', 'input_size': 512, 'is_training': True, 'color_jitter': 0.4, 'auto_augment': 'rand-m9-mstd0.5-inc1', 'interpolation': 'random', 'mean': (0.485, 0.456, 0.406), 'std': (0.229, 0.224, 0.225), 're_prob': 0.25, 're_mode': 'pixel', 're_count': 1}] data.test_transforms : [{'type': 'Resize', 'size': 585, 'interpolation': }, {'type': 'CenterCrop', 'size': 512}, {'type': 'ToTensor'}, {'type': 'Normalize', 'mean': (0.485, 0.456, 0.406), 'std': (0.229, 0.224, 0.225), 'inplace': True}] data.train_size : 1251 data.test_size : 50 data.train_length : 1281167 data.test_length : 50000 model.name : MobileMamba_B4 model.model_kwargs : {'pretrained': False, 'checkpoint_path': 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000/latest_ckpt.pth', 'ema': False, 'strict': True, 'num_classes': 1000} optim.lr : 0.003 optim.optim_kwargs : {'name': 'adamw', 'betas': (0.9, 0.999), 'eps': 1e-08, 'weight_decay': 0.05, 'amsgrad': False} trainer.name : CLSTrainer trainer.checkpoint : runs/mobilemamba trainer.resume_dir : CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000 trainer.cuda_deterministic : False trainer.epoch_full : 300 trainer.scheduler_kwargs : {'name': 'cosine', 'lr_noise': None, 'noise_pct': 0.67, 'noise_std': 1.0, 'noise_seed': 42, 'lr_min': 3e-05, 'warmup_lr': 3e-06, 'warmup_iters': -1, 'cooldown_iters': 0, 'warmup_epochs': 20, 'cooldown_epochs': 0, 'use_iters': True, 'patience_iters': 0, 'patience_epochs': 0, 'decay_iters': 0, 'decay_epochs': 0, 'cycle_decay': 0.1} trainer.data.batch_size : 1024 trainer.data.batch_size_per_gpu : 128 trainer.data.batch_size_test : 1000 trainer.data.batch_size_per_gpu_test : 125 trainer.data.num_workers_per_gpu : 8 trainer.data.drop_last : True trainer.data.pin_memory : True trainer.data.persistent_workers : False trainer.data.num_workers : 64 trainer.mixup_kwargs : {'mixup_alpha': 0.8, 'cutmix_alpha': 1.0, 'cutmix_minmax': None, 'prob': 1.0, 'switch_prob': 0.5, 'mode': 'batch', 'correct_lam': True, 'label_smoothing': 0.1, 'num_classes': 1000} trainer.scale_kwargs : {'n_scale': 0, 'base_h': 512, 'base_w': 512, 'min_h': 160, 'max_h': 320, 'min_w': 160, 'max_w': 320, 'check_scale_div_factor': 32} trainer.test_start_epoch : 200 trainer.test_per_epoch : 5 trainer.save_per_epoch : 15 trainer.find_unused_parameters : False trainer.sync_BN : none trainer.dist_BN : trainer.scaler : native trainer.ema : 0.9998 trainer.iter : 61299 trainer.epoch : 49 trainer.topk_recorder : {'net_top1': [0, 0, 0, 0, 42.08, 0, 0, 0, 0, 56.354, 0, 0, 0, 0, 61.564, 0, 0, 0, 0, 62.936, 0, 0, 0, 0, 64.914, 0, 0, 0, 0, 65.934, 0, 0, 0, 0, 67.482, 0, 0, 0, 0, 68.294, 0, 0, 0, 0, 68.528, 0, 0, 0, 0], 'net_top5': [0, 0, 0, 0, 68.374, 0, 0, 0, 0, 80.976, 0, 0, 0, 0, 84.664, 0, 0, 0, 0, 85.308, 0, 0, 0, 0, 87.104, 0, 0, 0, 0, 87.474, 0, 0, 0, 0, 88.714, 0, 0, 0, 0, 89.34, 0, 0, 0, 0, 89.252, 0, 0, 0, 0], 'net_E_top1': [0, 0, 0, 0, 0.118, 0, 0, 0, 0, 1.834, 0, 0, 0, 0, 40.996, 0, 0, 0, 0, 60.644, 0, 0, 0, 0, 68.716, 0, 0, 0, 0, 71.702, 0, 0, 0, 0, 73.118, 0, 0, 0, 0, 74.056, 0, 0, 0, 0, 74.804, 0, 0, 0, 0], 'net_E_top5': [0, 0, 0, 0, 0.566, 0, 0, 0, 0, 5.998, 0, 0, 0, 0, 67.084, 0, 0, 0, 0, 83.85, 0, 0, 0, 0, 89.17, 0, 0, 0, 0, 90.902, 0, 0, 0, 0, 91.698, 0, 0, 0, 0, 92.192, 0, 0, 0, 0, 92.57, 0, 0, 0, 0]} trainer.iter_full : 375300 tea_model.name : tresnet_l_v2 tea_model.model_kwargs : {'pretrained': False, 'checkpoint_path': 'pretrained/tresnet_l_v2_83_9.pth', 'ema': False, 'strict': True, 'num_classes': 1000} loss.loss_terms : [{'type': 'SoftTargetCE', 'name': 'CE', 'lam': 1.0, 'fp32': True}] loss.clip_grad : 5.0 loss.create_graph : False loss.retain_graph : False logging.log_terms_train : [{'name': 'batch_t', 'fmt': ':>5.3f', 'add_name': 'avg'}, {'name': 'data_t', 'fmt': ':>5.3f'}, {'name': 'optim_t', 'fmt': ':>5.3f'}, {'name': 'lr', 'fmt': ':>7.6f'}, {'name': 'CE', 'fmt': ':>5.3f', 'add_name': 'avg'}, {'name': 'KD', 'fmt': ':>5.3f', 'add_name': 'avg'}] logging.log_terms_test : [{'name': 'batch_t', 'fmt': ':>5.3f', 'add_name': 'avg'}, {'name': 'top1_cnt', 'fmt': ':>6.0f', 'show_name': 'sum'}, {'name': 'top5_cnt', 'fmt': ':>6.0f', 'show_name': 'sum'}, {'name': 'top_all', 'fmt': ':>6.0f', 'show_name': 'sum'}] logging.train_reset_log_per : 50 logging.train_log_per : 50 logging.test_log_per : 50 cfg_path : configs.mobilemamba.mobilemamba_b4 mode : train sleep : -1 memory : -1 dist_url : env:// logger_rank : 0 opts : ['model.name=MobileMamba_B4', 'trainer.resume_dir=CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000'] command : python3 -m torch.distributed.launch --nproc_per_node=$nproc_per_node --nnodes=$nnodes --node_rank=$node_rank --master_addr=$master_addr --master_port=$master_port --use_env run.py -c configs.mobilemamba.mobilemamba_b4 -m train --sleep -1 --memory -1 --dist_url env:// --logger_rank 0 model.name=MobileMamba_B4 trainer.resume_dir=CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000 task_start_time : 1679819.368315654 dist : True world_size : 8 rank : 0 local_rank : 0 ngpus_per_node : 8 nnodes : 1 master : True dist_backend : nccl logdir : runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000 logger.filters : [] logger.name : root logger.level : 20 logger.parent : None logger.propagate : True logger.disabled : False logdir_train : runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000/show_train logdir_test : runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000/show_test 2024-10-11 19:04:45,525 - ==> Starting training with 1 nodes x 8 GPUs 2024-10-11 19:05:06,289 - Train: 16.33% [61300/375300] [49.0/300.0] [batch_t 20.574 (20.574)] [data_t 7.803] [optim_t 12.771] [lr 0.002809] [CE 4.243 (4.243)] [KD 0.000 (0.000)] 2024-10-11 19:05:24,800 - Train: 16.35% [61350/375300] [49.0/300.0] [batch_t 0.478 (0.370)] [data_t 0.015] [optim_t 0.462] [lr 0.002808] [CE 3.659 (3.856)] [KD 0.000 (0.000)] 2024-10-11 19:05:46,291 - Train: 16.36% [61400/375300] [49.1/300.0] [batch_t 0.364 (0.430)] [data_t 0.015] [optim_t 0.349] [lr 0.002808] [CE 3.863 (3.825)] [KD 0.000 (0.000)] 2024-10-11 19:06:08,126 - Train: 16.37% [61450/375300] [49.1/300.0] [batch_t 0.431 (0.437)] [data_t 0.015] [optim_t 0.415] [lr 0.002808] [CE 4.014 (3.880)] [KD 0.000 (0.000)] 2024-10-11 19:06:30,067 - Train: 16.39% [61500/375300] [49.2/300.0] [batch_t 0.469 (0.439)] [data_t 0.015] [optim_t 0.454] [lr 0.002808] [CE 3.783 (3.909)] [KD 0.000 (0.000)] 2024-10-11 19:06:51,756 - Train: 16.40% [61550/375300] [49.2/300.0] [batch_t 0.523 (0.434)] [data_t 0.015] [optim_t 0.507] [lr 0.002807] [CE 3.862 (3.907)] [KD 0.000 (0.000)] 2024-10-11 19:07:13,867 - Train: 16.41% [61600/375300] [49.2/300.0] [batch_t 0.398 (0.442)] [data_t 0.015] [optim_t 0.382] [lr 0.002807] [CE 3.317 (3.816)] [KD 0.000 (0.000)] 2024-10-11 19:07:36,081 - Train: 16.43% [61650/375300] [49.3/300.0] [batch_t 0.434 (0.444)] [data_t 0.015] [optim_t 0.419] [lr 0.002807] [CE 3.927 (3.940)] [KD 0.000 (0.000)] 2024-10-11 19:07:58,363 - Train: 16.44% [61700/375300] [49.3/300.0] [batch_t 0.435 (0.446)] [data_t 0.015] [optim_t 0.420] [lr 0.002806] [CE 3.930 (3.870)] [KD 0.000 (0.000)] 2024-10-11 19:08:20,052 - Train: 16.45% [61750/375300] [49.4/300.0] [batch_t 0.474 (0.434)] [data_t 0.015] [optim_t 0.459] [lr 0.002806] [CE 3.921 (3.848)] [KD 0.000 (0.000)] 2024-10-11 19:08:42,050 - Train: 16.47% [61800/375300] [49.4/300.0] [batch_t 0.487 (0.440)] [data_t 0.016] [optim_t 0.471] [lr 0.002806] [CE 3.572 (3.917)] [KD 0.000 (0.000)] 2024-10-11 19:09:03,407 - Train: 16.48% [61850/375300] [49.4/300.0] [batch_t 0.433 (0.427)] [data_t 0.015] [optim_t 0.418] [lr 0.002805] [CE 4.031 (3.890)] [KD 0.000 (0.000)] 2024-10-11 19:09:24,934 - Train: 16.49% [61900/375300] [49.5/300.0] [batch_t 0.414 (0.430)] [data_t 0.015] [optim_t 0.398] [lr 0.002805] [CE 3.993 (3.864)] [KD 0.000 (0.000)] 2024-10-11 19:09:46,922 - Train: 16.51% [61950/375300] [49.5/300.0] [batch_t 0.455 (0.440)] [data_t 0.016] [optim_t 0.439] [lr 0.002805] [CE 3.944 (3.861)] [KD 0.000 (0.000)] 2024-10-11 19:10:08,673 - Train: 16.52% [62000/375300] [49.6/300.0] [batch_t 0.423 (0.435)] [data_t 0.015] [optim_t 0.408] [lr 0.002804] [CE 3.454 (3.874)] [KD 0.000 (0.000)] 2024-10-11 19:10:30,419 - Train: 16.53% [62050/375300] [49.6/300.0] [batch_t 0.481 (0.435)] [data_t 0.015] [optim_t 0.465] [lr 0.002804] [CE 4.224 (3.918)] [KD 0.000 (0.000)] 2024-10-11 19:10:51,917 - Train: 16.55% [62100/375300] [49.6/300.0] [batch_t 0.451 (0.430)] [data_t 0.016] [optim_t 0.435] [lr 0.002804] [CE 3.783 (3.828)] [KD 0.000 (0.000)] 2024-10-11 19:11:13,461 - Train: 16.56% [62150/375300] [49.7/300.0] [batch_t 0.379 (0.431)] [data_t 0.016] [optim_t 0.363] [lr 0.002804] [CE 3.446 (3.833)] [KD 0.000 (0.000)] 2024-10-11 19:11:35,143 - Train: 16.57% [62200/375300] [49.7/300.0] [batch_t 0.487 (0.434)] [data_t 0.015] [optim_t 0.472] [lr 0.002803] [CE 3.866 (3.882)] [KD 0.000 (0.000)] 2024-10-11 19:11:56,115 - Train: 16.59% [62250/375300] [49.8/300.0] [batch_t 0.317 (0.419)] [data_t 0.016] [optim_t 0.301] [lr 0.002803] [CE 4.315 (3.869)] [KD 0.000 (0.000)] 2024-10-11 19:12:16,702 - Train: 16.60% [62300/375300] [49.8/300.0] [batch_t 0.385 (0.412)] [data_t 0.016] [optim_t 0.368] [lr 0.002803] [CE 3.977 (3.855)] [KD 0.000 (0.000)] 2024-10-11 19:12:37,736 - Train: 16.61% [62350/375300] [49.8/300.0] [batch_t 0.458 (0.421)] [data_t 0.015] [optim_t 0.442] [lr 0.002802] [CE 3.751 (3.845)] [KD 0.000 (0.000)] 2024-10-11 19:12:59,210 - Train: 16.63% [62400/375300] [49.9/300.0] [batch_t 0.418 (0.429)] [data_t 0.016] [optim_t 0.402] [lr 0.002802] [CE 3.431 (3.858)] [KD 0.000 (0.000)] 2024-10-11 19:13:21,132 - Train: 16.64% [62450/375300] [49.9/300.0] [batch_t 0.469 (0.438)] [data_t 0.016] [optim_t 0.453] [lr 0.002802] [CE 3.633 (3.893)] [KD 0.000 (0.000)] 2024-10-11 19:13:43,013 - Train: 16.65% [62500/375300] [50.0/300.0] [batch_t 0.495 (0.438)] [data_t 0.016] [optim_t 0.480] [lr 0.002801] [CE 4.145 (3.915)] [KD 0.000 (0.000)] 2024-10-11 19:14:03,286 - Train: 16.67% [62550/375300] [50.0/300.0] [batch_t 0.310 (0.405)] [data_t 0.015] [optim_t 0.295] [lr 0.002801] [CE 3.919 (3.935)] [KD 0.000 (0.000)] 2024-10-11 19:14:26,802 - Test (net): 100.00% [50/50] [batch_t 0.134 (0.467)] [top1_cnt 34588] [top5_cnt 44938] [top_all 50000] 2024-10-11 19:14:26,802 - net: 69.176 (89.876) 2024-10-11 19:14:48,522 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.428)] [top1_cnt 37603] [top5_cnt 46422] [top_all 50000] 2024-10-11 19:14:48,523 - net_E: 75.206 (92.844) 2024-10-11 19:14:48,670 - Max [top1: 69.176 (epoch: 50)] [top1-ema: 75.206 (epoch: 50)] 2024-10-11 19:14:48,670 - ==> Total time: 7:27:52 Eta: 1 day, 13:19:22 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 19:15:17,649 - Train: 16.68% [62600/375300] [50.0/300.0] [batch_t 0.494 (0.440)] [data_t 0.201] [optim_t 0.293] [lr 0.002801] [CE 4.050 (3.810)] [KD 0.000 (0.000)] 2024-10-11 19:15:39,751 - Train: 16.69% [62650/375300] [50.1/300.0] [batch_t 0.489 (0.442)] [data_t 0.016] [optim_t 0.473] [lr 0.002800] [CE 3.981 (3.854)] [KD 0.000 (0.000)] 2024-10-11 19:16:01,372 - Train: 16.71% [62700/375300] [50.1/300.0] [batch_t 0.375 (0.432)] [data_t 0.080] [optim_t 0.295] [lr 0.002800] [CE 3.643 (3.847)] [KD 0.000 (0.000)] 2024-10-11 19:16:23,426 - Train: 16.72% [62750/375300] [50.2/300.0] [batch_t 0.477 (0.441)] [data_t 0.184] [optim_t 0.294] [lr 0.002800] [CE 3.771 (3.887)] [KD 0.000 (0.000)] 2024-10-11 19:16:45,653 - Train: 16.73% [62800/375300] [50.2/300.0] [batch_t 0.474 (0.444)] [data_t 0.179] [optim_t 0.295] [lr 0.002799] [CE 4.137 (3.897)] [KD 0.000 (0.000)] 2024-10-11 19:17:07,509 - Train: 16.75% [62850/375300] [50.2/300.0] [batch_t 0.411 (0.437)] [data_t 0.118] [optim_t 0.293] [lr 0.002799] [CE 3.949 (3.930)] [KD 0.000 (0.000)] 2024-10-11 19:17:29,052 - Train: 16.76% [62900/375300] [50.3/300.0] [batch_t 0.472 (0.431)] [data_t 0.176] [optim_t 0.297] [lr 0.002799] [CE 3.346 (3.896)] [KD 0.000 (0.000)] 2024-10-11 19:17:50,752 - Train: 16.77% [62950/375300] [50.3/300.0] [batch_t 0.418 (0.434)] [data_t 0.121] [optim_t 0.298] [lr 0.002799] [CE 3.845 (3.857)] [KD 0.000 (0.000)] 2024-10-11 19:18:12,031 - Train: 16.79% [63000/375300] [50.4/300.0] [batch_t 0.317 (0.425)] [data_t 0.015] [optim_t 0.301] [lr 0.002798] [CE 3.541 (3.887)] [KD 0.000 (0.000)] 2024-10-11 19:18:33,281 - Train: 16.80% [63050/375300] [50.4/300.0] [batch_t 0.429 (0.425)] [data_t 0.133] [optim_t 0.296] [lr 0.002798] [CE 3.401 (3.841)] [KD 0.000 (0.000)] 2024-10-11 19:18:54,154 - Train: 16.81% [63100/375300] [50.4/300.0] [batch_t 0.410 (0.417)] [data_t 0.116] [optim_t 0.294] [lr 0.002798] [CE 3.848 (3.906)] [KD 0.000 (0.000)] 2024-10-11 19:19:15,854 - Train: 16.83% [63150/375300] [50.5/300.0] [batch_t 0.444 (0.434)] [data_t 0.015] [optim_t 0.429] [lr 0.002797] [CE 3.928 (3.865)] [KD 0.000 (0.000)] 2024-10-11 19:19:37,861 - Train: 16.84% [63200/375300] [50.5/300.0] [batch_t 0.493 (0.440)] [data_t 0.016] [optim_t 0.478] [lr 0.002797] [CE 3.849 (3.902)] [KD 0.000 (0.000)] 2024-10-11 19:19:59,424 - Train: 16.85% [63250/375300] [50.6/300.0] [batch_t 0.431 (0.431)] [data_t 0.133] [optim_t 0.298] [lr 0.002797] [CE 3.813 (3.847)] [KD 0.000 (0.000)] 2024-10-11 19:20:21,274 - Train: 16.87% [63300/375300] [50.6/300.0] [batch_t 0.437 (0.437)] [data_t 0.136] [optim_t 0.301] [lr 0.002796] [CE 3.773 (3.897)] [KD 0.000 (0.000)] 2024-10-11 19:20:43,524 - Train: 16.88% [63350/375300] [50.6/300.0] [batch_t 0.370 (0.445)] [data_t 0.072] [optim_t 0.298] [lr 0.002796] [CE 3.687 (3.887)] [KD 0.000 (0.000)] 2024-10-11 19:21:05,586 - Train: 16.89% [63400/375300] [50.7/300.0] [batch_t 0.449 (0.441)] [data_t 0.152] [optim_t 0.297] [lr 0.002796] [CE 3.507 (3.894)] [KD 0.000 (0.000)] 2024-10-11 19:21:27,352 - Train: 16.91% [63450/375300] [50.7/300.0] [batch_t 0.425 (0.435)] [data_t 0.124] [optim_t 0.301] [lr 0.002795] [CE 3.966 (3.831)] [KD 0.000 (0.000)] 2024-10-11 19:21:49,342 - Train: 16.92% [63500/375300] [50.8/300.0] [batch_t 0.481 (0.440)] [data_t 0.180] [optim_t 0.301] [lr 0.002795] [CE 3.539 (3.884)] [KD 0.000 (0.000)] 2024-10-11 19:22:11,015 - Train: 16.93% [63550/375300] [50.8/300.0] [batch_t 0.347 (0.433)] [data_t 0.051] [optim_t 0.295] [lr 0.002795] [CE 3.867 (3.914)] [KD 0.000 (0.000)] 2024-10-11 19:22:32,178 - Train: 16.95% [63600/375300] [50.8/300.0] [batch_t 0.403 (0.423)] [data_t 0.105] [optim_t 0.299] [lr 0.002794] [CE 3.788 (3.842)] [KD 0.000 (0.000)] 2024-10-11 19:22:54,058 - Train: 16.96% [63650/375300] [50.9/300.0] [batch_t 0.456 (0.437)] [data_t 0.016] [optim_t 0.440] [lr 0.002794] [CE 3.888 (3.885)] [KD 0.000 (0.000)] 2024-10-11 19:23:15,626 - Train: 16.97% [63700/375300] [50.9/300.0] [batch_t 0.451 (0.431)] [data_t 0.016] [optim_t 0.435] [lr 0.002794] [CE 3.786 (3.856)] [KD 0.000 (0.000)] 2024-10-11 19:23:37,443 - Train: 16.99% [63750/375300] [51.0/300.0] [batch_t 0.433 (0.436)] [data_t 0.135] [optim_t 0.298] [lr 0.002794] [CE 3.879 (3.866)] [KD 0.000 (0.000)] 2024-10-11 19:23:58,416 - Train: 17.00% [63800/375300] [51.0/300.0] [batch_t 0.316 (0.419)] [data_t 0.015] [optim_t 0.300] [lr 0.002793] [CE 3.668 (3.921)] [KD 0.000 (0.000)] 2024-10-11 19:23:58,739 - ==> Total time: 7:37:02 Eta: 1 day, 13:11:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 19:24:23,744 - Train: 17.01% [63850/375300] [51.0/300.0] [batch_t 0.445 (0.480)] [data_t 0.142] [optim_t 0.303] [lr 0.002793] [CE 3.865 (3.860)] [KD 0.000 (0.000)] 2024-10-11 19:24:44,712 - Train: 17.03% [63900/375300] [51.1/300.0] [batch_t 0.474 (0.419)] [data_t 0.091] [optim_t 0.383] [lr 0.002793] [CE 3.463 (3.851)] [KD 0.000 (0.000)] 2024-10-11 19:25:06,084 - Train: 17.04% [63950/375300] [51.1/300.0] [batch_t 0.313 (0.427)] [data_t 0.015] [optim_t 0.298] [lr 0.002792] [CE 4.057 (3.803)] [KD 0.000 (0.000)] 2024-10-11 19:25:27,156 - Train: 17.05% [64000/375300] [51.2/300.0] [batch_t 0.416 (0.421)] [data_t 0.016] [optim_t 0.400] [lr 0.002792] [CE 3.940 (3.850)] [KD 0.000 (0.000)] 2024-10-11 19:25:49,539 - Train: 17.07% [64050/375300] [51.2/300.0] [batch_t 0.401 (0.448)] [data_t 0.016] [optim_t 0.385] [lr 0.002792] [CE 3.428 (3.862)] [KD 0.000 (0.000)] 2024-10-11 19:26:11,877 - Train: 17.08% [64100/375300] [51.2/300.0] [batch_t 0.466 (0.447)] [data_t 0.015] [optim_t 0.451] [lr 0.002791] [CE 3.894 (3.882)] [KD 0.000 (0.000)] 2024-10-11 19:26:33,229 - Train: 17.09% [64150/375300] [51.3/300.0] [batch_t 0.316 (0.427)] [data_t 0.016] [optim_t 0.300] [lr 0.002791] [CE 3.866 (3.854)] [KD 0.000 (0.000)] 2024-10-11 19:26:54,930 - Train: 17.11% [64200/375300] [51.3/300.0] [batch_t 0.425 (0.434)] [data_t 0.016] [optim_t 0.410] [lr 0.002791] [CE 3.650 (3.824)] [KD 0.000 (0.000)] 2024-10-11 19:27:16,736 - Train: 17.12% [64250/375300] [51.4/300.0] [batch_t 0.470 (0.436)] [data_t 0.015] [optim_t 0.454] [lr 0.002790] [CE 3.926 (3.884)] [KD 0.000 (0.000)] 2024-10-11 19:27:38,805 - Train: 17.13% [64300/375300] [51.4/300.0] [batch_t 0.426 (0.441)] [data_t 0.016] [optim_t 0.410] [lr 0.002790] [CE 4.162 (3.896)] [KD 0.000 (0.000)] 2024-10-11 19:28:01,054 - Train: 17.15% [64350/375300] [51.4/300.0] [batch_t 0.494 (0.445)] [data_t 0.016] [optim_t 0.478] [lr 0.002790] [CE 3.905 (3.881)] [KD 0.000 (0.000)] 2024-10-11 19:28:23,234 - Train: 17.16% [64400/375300] [51.5/300.0] [batch_t 0.459 (0.443)] [data_t 0.016] [optim_t 0.444] [lr 0.002789] [CE 3.893 (3.896)] [KD 0.000 (0.000)] 2024-10-11 19:28:45,161 - Train: 17.17% [64450/375300] [51.5/300.0] [batch_t 0.497 (0.438)] [data_t 0.016] [optim_t 0.481] [lr 0.002789] [CE 3.714 (3.880)] [KD 0.000 (0.000)] 2024-10-11 19:29:07,168 - Train: 17.19% [64500/375300] [51.6/300.0] [batch_t 0.457 (0.440)] [data_t 0.016] [optim_t 0.442] [lr 0.002789] [CE 4.041 (3.890)] [KD 0.000 (0.000)] 2024-10-11 19:29:29,312 - Train: 17.20% [64550/375300] [51.6/300.0] [batch_t 0.424 (0.443)] [data_t 0.016] [optim_t 0.408] [lr 0.002788] [CE 3.408 (3.846)] [KD 0.000 (0.000)] 2024-10-11 19:29:51,670 - Train: 17.21% [64600/375300] [51.6/300.0] [batch_t 0.446 (0.447)] [data_t 0.016] [optim_t 0.430] [lr 0.002788] [CE 3.990 (3.870)] [KD 0.000 (0.000)] 2024-10-11 19:30:13,068 - Train: 17.23% [64650/375300] [51.7/300.0] [batch_t 0.459 (0.428)] [data_t 0.016] [optim_t 0.444] [lr 0.002788] [CE 4.109 (3.909)] [KD 0.000 (0.000)] 2024-10-11 19:30:34,690 - Train: 17.24% [64700/375300] [51.7/300.0] [batch_t 0.422 (0.432)] [data_t 0.016] [optim_t 0.406] [lr 0.002787] [CE 4.112 (3.892)] [KD 0.000 (0.000)] 2024-10-11 19:30:56,492 - Train: 17.25% [64750/375300] [51.8/300.0] [batch_t 0.435 (0.436)] [data_t 0.015] [optim_t 0.419] [lr 0.002787] [CE 3.392 (3.821)] [KD 0.000 (0.000)] 2024-10-11 19:31:18,429 - Train: 17.27% [64800/375300] [51.8/300.0] [batch_t 0.436 (0.439)] [data_t 0.016] [optim_t 0.420] [lr 0.002787] [CE 3.654 (3.892)] [KD 0.000 (0.000)] 2024-10-11 19:31:40,758 - Train: 17.28% [64850/375300] [51.8/300.0] [batch_t 0.458 (0.446)] [data_t 0.016] [optim_t 0.442] [lr 0.002787] [CE 3.619 (3.833)] [KD 0.000 (0.000)] 2024-10-11 19:32:02,599 - Train: 17.29% [64900/375300] [51.9/300.0] [batch_t 0.414 (0.437)] [data_t 0.015] [optim_t 0.398] [lr 0.002786] [CE 3.724 (3.836)] [KD 0.000 (0.000)] 2024-10-11 19:32:24,696 - Train: 17.31% [64950/375300] [51.9/300.0] [batch_t 0.483 (0.442)] [data_t 0.015] [optim_t 0.468] [lr 0.002786] [CE 3.882 (3.842)] [KD 0.000 (0.000)] 2024-10-11 19:32:46,679 - Train: 17.32% [65000/375300] [52.0/300.0] [batch_t 0.538 (0.440)] [data_t 0.015] [optim_t 0.523] [lr 0.002786] [CE 4.233 (3.908)] [KD 0.000 (0.000)] 2024-10-11 19:33:07,894 - Train: 17.33% [65050/375300] [52.0/300.0] [batch_t 0.316 (0.424)] [data_t 0.015] [optim_t 0.300] [lr 0.002785] [CE 3.858 (3.885)] [KD 0.000 (0.000)] 2024-10-11 19:33:08,516 - ==> Total time: 7:46:12 Eta: 1 day, 13:03:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 19:33:34,674 - Train: 17.35% [65100/375300] [52.0/300.0] [batch_t 0.487 (0.515)] [data_t 0.016] [optim_t 0.472] [lr 0.002785] [CE 3.622 (3.851)] [KD 0.000 (0.000)] 2024-10-11 19:33:57,008 - Train: 17.36% [65150/375300] [52.1/300.0] [batch_t 0.455 (0.447)] [data_t 0.016] [optim_t 0.440] [lr 0.002785] [CE 3.830 (3.846)] [KD 0.000 (0.000)] 2024-10-11 19:34:19,534 - Train: 17.37% [65200/375300] [52.1/300.0] [batch_t 0.482 (0.450)] [data_t 0.016] [optim_t 0.466] [lr 0.002784] [CE 3.999 (3.871)] [KD 0.000 (0.000)] 2024-10-11 19:34:41,645 - Train: 17.39% [65250/375300] [52.2/300.0] [batch_t 0.352 (0.442)] [data_t 0.016] [optim_t 0.336] [lr 0.002784] [CE 3.668 (3.888)] [KD 0.000 (0.000)] 2024-10-11 19:35:04,131 - Train: 17.40% [65300/375300] [52.2/300.0] [batch_t 0.316 (0.450)] [data_t 0.015] [optim_t 0.300] [lr 0.002784] [CE 3.962 (3.876)] [KD 0.000 (0.000)] 2024-10-11 19:35:26,423 - Train: 17.41% [65350/375300] [52.2/300.0] [batch_t 0.398 (0.446)] [data_t 0.016] [optim_t 0.382] [lr 0.002783] [CE 3.806 (3.870)] [KD 0.000 (0.000)] 2024-10-11 19:35:49,515 - Train: 17.43% [65400/375300] [52.3/300.0] [batch_t 0.450 (0.462)] [data_t 0.015] [optim_t 0.435] [lr 0.002783] [CE 3.988 (3.929)] [KD 0.000 (0.000)] 2024-10-11 19:36:12,800 - Train: 17.44% [65450/375300] [52.3/300.0] [batch_t 0.498 (0.466)] [data_t 0.016] [optim_t 0.482] [lr 0.002783] [CE 4.032 (3.896)] [KD 0.000 (0.000)] 2024-10-11 19:36:34,315 - Train: 17.45% [65500/375300] [52.4/300.0] [batch_t 0.449 (0.430)] [data_t 0.015] [optim_t 0.433] [lr 0.002782] [CE 3.660 (3.820)] [KD 0.000 (0.000)] 2024-10-11 19:36:56,300 - Train: 17.47% [65550/375300] [52.4/300.0] [batch_t 0.495 (0.440)] [data_t 0.015] [optim_t 0.480] [lr 0.002782] [CE 4.158 (3.876)] [KD 0.000 (0.000)] 2024-10-11 19:37:18,303 - Train: 17.48% [65600/375300] [52.4/300.0] [batch_t 0.424 (0.440)] [data_t 0.015] [optim_t 0.409] [lr 0.002782] [CE 3.987 (3.899)] [KD 0.000 (0.000)] 2024-10-11 19:37:39,854 - Train: 17.49% [65650/375300] [52.5/300.0] [batch_t 0.393 (0.431)] [data_t 0.015] [optim_t 0.378] [lr 0.002781] [CE 4.118 (3.799)] [KD 0.000 (0.000)] 2024-10-11 19:38:01,502 - Train: 17.51% [65700/375300] [52.5/300.0] [batch_t 0.505 (0.433)] [data_t 0.015] [optim_t 0.490] [lr 0.002781] [CE 3.596 (3.808)] [KD 0.000 (0.000)] 2024-10-11 19:38:23,371 - Train: 17.52% [65750/375300] [52.6/300.0] [batch_t 0.457 (0.437)] [data_t 0.015] [optim_t 0.441] [lr 0.002781] [CE 3.920 (3.821)] [KD 0.000 (0.000)] 2024-10-11 19:38:45,447 - Train: 17.53% [65800/375300] [52.6/300.0] [batch_t 0.512 (0.441)] [data_t 0.015] [optim_t 0.496] [lr 0.002780] [CE 3.723 (3.832)] [KD 0.000 (0.000)] 2024-10-11 19:39:08,299 - Train: 17.55% [65850/375300] [52.6/300.0] [batch_t 0.473 (0.457)] [data_t 0.015] [optim_t 0.458] [lr 0.002780] [CE 3.932 (3.861)] [KD 0.000 (0.000)] 2024-10-11 19:39:30,040 - Train: 17.56% [65900/375300] [52.7/300.0] [batch_t 0.413 (0.435)] [data_t 0.016] [optim_t 0.398] [lr 0.002780] [CE 4.030 (3.802)] [KD 0.000 (0.000)] 2024-10-11 19:39:51,690 - Train: 17.57% [65950/375300] [52.7/300.0] [batch_t 0.526 (0.433)] [data_t 0.016] [optim_t 0.511] [lr 0.002779] [CE 3.938 (3.894)] [KD 0.000 (0.000)] 2024-10-11 19:40:13,435 - Train: 17.59% [66000/375300] [52.8/300.0] [batch_t 0.397 (0.435)] [data_t 0.015] [optim_t 0.381] [lr 0.002779] [CE 4.124 (3.911)] [KD 0.000 (0.000)] 2024-10-11 19:40:35,046 - Train: 17.60% [66050/375300] [52.8/300.0] [batch_t 0.447 (0.432)] [data_t 0.016] [optim_t 0.432] [lr 0.002779] [CE 4.022 (3.848)] [KD 0.000 (0.000)] 2024-10-11 19:40:57,730 - Train: 17.61% [66100/375300] [52.8/300.0] [batch_t 0.508 (0.454)] [data_t 0.016] [optim_t 0.493] [lr 0.002778] [CE 4.122 (3.857)] [KD 0.000 (0.000)] 2024-10-11 19:41:20,074 - Train: 17.63% [66150/375300] [52.9/300.0] [batch_t 0.502 (0.447)] [data_t 0.016] [optim_t 0.486] [lr 0.002778] [CE 3.744 (3.883)] [KD 0.000 (0.000)] 2024-10-11 19:41:42,519 - Train: 17.64% [66200/375300] [52.9/300.0] [batch_t 0.466 (0.449)] [data_t 0.015] [optim_t 0.451] [lr 0.002778] [CE 4.055 (3.847)] [KD 0.000 (0.000)] 2024-10-11 19:42:05,078 - Train: 17.65% [66250/375300] [53.0/300.0] [batch_t 0.450 (0.451)] [data_t 0.015] [optim_t 0.435] [lr 0.002777] [CE 3.981 (3.896)] [KD 0.000 (0.000)] 2024-10-11 19:42:26,564 - Train: 17.67% [66300/375300] [53.0/300.0] [batch_t 0.314 (0.430)] [data_t 0.015] [optim_t 0.299] [lr 0.002777] [CE 3.971 (3.864)] [KD 0.000 (0.000)] 2024-10-11 19:42:27,514 - ==> Total time: 7:55:31 Eta: 1 day, 12:56:07 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 19:42:51,942 - Train: 17.68% [66350/375300] [53.0/300.0] [batch_t 0.442 (0.486)] [data_t 0.090] [optim_t 0.351] [lr 0.002777] [CE 3.886 (3.820)] [KD 0.000 (0.000)] 2024-10-11 19:43:14,432 - Train: 17.69% [66400/375300] [53.1/300.0] [batch_t 0.432 (0.450)] [data_t 0.015] [optim_t 0.416] [lr 0.002776] [CE 4.032 (3.850)] [KD 0.000 (0.000)] 2024-10-11 19:43:36,680 - Train: 17.71% [66450/375300] [53.1/300.0] [batch_t 0.426 (0.445)] [data_t 0.015] [optim_t 0.411] [lr 0.002776] [CE 4.046 (3.815)] [KD 0.000 (0.000)] 2024-10-11 19:43:58,321 - Train: 17.72% [66500/375300] [53.2/300.0] [batch_t 0.454 (0.433)] [data_t 0.016] [optim_t 0.439] [lr 0.002776] [CE 3.581 (3.826)] [KD 0.000 (0.000)] 2024-10-11 19:44:20,290 - Train: 17.73% [66550/375300] [53.2/300.0] [batch_t 0.497 (0.439)] [data_t 0.016] [optim_t 0.482] [lr 0.002775] [CE 3.599 (3.861)] [KD 0.000 (0.000)] 2024-10-11 19:44:41,793 - Train: 17.75% [66600/375300] [53.2/300.0] [batch_t 0.391 (0.430)] [data_t 0.015] [optim_t 0.376] [lr 0.002775] [CE 3.902 (3.836)] [KD 0.000 (0.000)] 2024-10-11 19:45:04,199 - Train: 17.76% [66650/375300] [53.3/300.0] [batch_t 0.422 (0.448)] [data_t 0.015] [optim_t 0.407] [lr 0.002775] [CE 3.830 (3.870)] [KD 0.000 (0.000)] 2024-10-11 19:45:26,848 - Train: 17.77% [66700/375300] [53.3/300.0] [batch_t 0.470 (0.453)] [data_t 0.015] [optim_t 0.454] [lr 0.002774] [CE 4.015 (3.858)] [KD 0.000 (0.000)] 2024-10-11 19:45:49,239 - Train: 17.79% [66750/375300] [53.4/300.0] [batch_t 0.456 (0.448)] [data_t 0.015] [optim_t 0.440] [lr 0.002774] [CE 3.713 (3.857)] [KD 0.000 (0.000)] 2024-10-11 19:46:10,663 - Train: 17.80% [66800/375300] [53.4/300.0] [batch_t 0.410 (0.428)] [data_t 0.016] [optim_t 0.395] [lr 0.002774] [CE 3.797 (3.835)] [KD 0.000 (0.000)] 2024-10-11 19:46:31,636 - Train: 17.81% [66850/375300] [53.4/300.0] [batch_t 0.448 (0.419)] [data_t 0.016] [optim_t 0.433] [lr 0.002774] [CE 3.930 (3.882)] [KD 0.000 (0.000)] 2024-10-11 19:46:53,802 - Train: 17.83% [66900/375300] [53.5/300.0] [batch_t 0.411 (0.443)] [data_t 0.016] [optim_t 0.395] [lr 0.002773] [CE 3.981 (3.865)] [KD 0.000 (0.000)] 2024-10-11 19:47:16,083 - Train: 17.84% [66950/375300] [53.5/300.0] [batch_t 0.450 (0.445)] [data_t 0.015] [optim_t 0.435] [lr 0.002773] [CE 3.618 (3.877)] [KD 0.000 (0.000)] 2024-10-11 19:47:38,005 - Train: 17.85% [67000/375300] [53.6/300.0] [batch_t 0.414 (0.438)] [data_t 0.016] [optim_t 0.398] [lr 0.002773] [CE 3.754 (3.857)] [KD 0.000 (0.000)] 2024-10-11 19:48:00,270 - Train: 17.87% [67050/375300] [53.6/300.0] [batch_t 0.457 (0.445)] [data_t 0.016] [optim_t 0.441] [lr 0.002772] [CE 3.899 (3.881)] [KD 0.000 (0.000)] 2024-10-11 19:48:21,655 - Train: 17.88% [67100/375300] [53.6/300.0] [batch_t 0.367 (0.428)] [data_t 0.015] [optim_t 0.351] [lr 0.002772] [CE 3.862 (3.869)] [KD 0.000 (0.000)] 2024-10-11 19:48:42,637 - Train: 17.89% [67150/375300] [53.7/300.0] [batch_t 0.446 (0.420)] [data_t 0.016] [optim_t 0.430] [lr 0.002772] [CE 3.819 (3.809)] [KD 0.000 (0.000)] 2024-10-11 19:49:04,118 - Train: 17.91% [67200/375300] [53.7/300.0] [batch_t 0.391 (0.429)] [data_t 0.015] [optim_t 0.376] [lr 0.002771] [CE 3.818 (3.913)] [KD 0.000 (0.000)] 2024-10-11 19:49:25,625 - Train: 17.92% [67250/375300] [53.8/300.0] [batch_t 0.466 (0.430)] [data_t 0.016] [optim_t 0.451] [lr 0.002771] [CE 3.702 (3.812)] [KD 0.000 (0.000)] 2024-10-11 19:49:47,341 - Train: 17.93% [67300/375300] [53.8/300.0] [batch_t 0.449 (0.434)] [data_t 0.015] [optim_t 0.434] [lr 0.002771] [CE 3.956 (3.876)] [KD 0.000 (0.000)] 2024-10-11 19:50:08,798 - Train: 17.95% [67350/375300] [53.8/300.0] [batch_t 0.424 (0.429)] [data_t 0.016] [optim_t 0.408] [lr 0.002770] [CE 3.735 (3.935)] [KD 0.000 (0.000)] 2024-10-11 19:50:29,834 - Train: 17.96% [67400/375300] [53.9/300.0] [batch_t 0.447 (0.421)] [data_t 0.016] [optim_t 0.431] [lr 0.002770] [CE 3.853 (3.850)] [KD 0.000 (0.000)] 2024-10-11 19:50:51,070 - Train: 17.97% [67450/375300] [53.9/300.0] [batch_t 0.413 (0.425)] [data_t 0.015] [optim_t 0.397] [lr 0.002770] [CE 3.803 (3.870)] [KD 0.000 (0.000)] 2024-10-11 19:51:12,323 - Train: 17.99% [67500/375300] [54.0/300.0] [batch_t 0.412 (0.425)] [data_t 0.015] [optim_t 0.396] [lr 0.002769] [CE 4.006 (3.903)] [KD 0.000 (0.000)] 2024-10-11 19:51:33,041 - Train: 18.00% [67550/375300] [54.0/300.0] [batch_t 0.307 (0.414)] [data_t 0.015] [optim_t 0.291] [lr 0.002769] [CE 3.685 (3.867)] [KD 0.000 (0.000)] 2024-10-11 19:51:34,271 - ==> Total time: 8:04:38 Eta: 1 day, 12:47:47 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 19:51:59,672 - Train: 18.01% [67600/375300] [54.0/300.0] [batch_t 0.527 (0.519)] [data_t 0.015] [optim_t 0.512] [lr 0.002769] [CE 3.742 (3.780)] [KD 0.000 (0.000)] 2024-10-11 19:52:22,163 - Train: 18.03% [67650/375300] [54.1/300.0] [batch_t 0.423 (0.450)] [data_t 0.015] [optim_t 0.408] [lr 0.002768] [CE 3.586 (3.808)] [KD 0.000 (0.000)] 2024-10-11 19:52:44,818 - Train: 18.04% [67700/375300] [54.1/300.0] [batch_t 0.645 (0.453)] [data_t 0.016] [optim_t 0.630] [lr 0.002768] [CE 3.585 (3.854)] [KD 0.000 (0.000)] 2024-10-11 19:53:07,032 - Train: 18.05% [67750/375300] [54.2/300.0] [batch_t 0.497 (0.444)] [data_t 0.015] [optim_t 0.482] [lr 0.002768] [CE 4.087 (3.854)] [KD 0.000 (0.000)] 2024-10-11 19:53:28,477 - Train: 18.07% [67800/375300] [54.2/300.0] [batch_t 0.415 (0.429)] [data_t 0.015] [optim_t 0.399] [lr 0.002767] [CE 3.832 (3.809)] [KD 0.000 (0.000)] 2024-10-11 19:53:49,319 - Train: 18.08% [67850/375300] [54.2/300.0] [batch_t 0.461 (0.417)] [data_t 0.016] [optim_t 0.445] [lr 0.002767] [CE 3.592 (3.822)] [KD 0.000 (0.000)] 2024-10-11 19:54:10,527 - Train: 18.09% [67900/375300] [54.3/300.0] [batch_t 0.389 (0.424)] [data_t 0.016] [optim_t 0.374] [lr 0.002767] [CE 3.755 (3.861)] [KD 0.000 (0.000)] 2024-10-11 19:54:31,682 - Train: 18.11% [67950/375300] [54.3/300.0] [batch_t 0.420 (0.423)] [data_t 0.016] [optim_t 0.404] [lr 0.002766] [CE 3.657 (3.871)] [KD 0.000 (0.000)] 2024-10-11 19:54:52,965 - Train: 18.12% [68000/375300] [54.4/300.0] [batch_t 0.428 (0.426)] [data_t 0.016] [optim_t 0.412] [lr 0.002766] [CE 3.899 (3.841)] [KD 0.000 (0.000)] 2024-10-11 19:55:14,484 - Train: 18.13% [68050/375300] [54.4/300.0] [batch_t 0.424 (0.430)] [data_t 0.015] [optim_t 0.408] [lr 0.002766] [CE 4.039 (3.874)] [KD 0.000 (0.000)] 2024-10-11 19:55:36,109 - Train: 18.15% [68100/375300] [54.4/300.0] [batch_t 0.391 (0.432)] [data_t 0.098] [optim_t 0.293] [lr 0.002765] [CE 3.860 (3.815)] [KD 0.000 (0.000)] 2024-10-11 19:55:58,046 - Train: 18.16% [68150/375300] [54.5/300.0] [batch_t 0.466 (0.439)] [data_t 0.133] [optim_t 0.333] [lr 0.002765] [CE 3.831 (3.854)] [KD 0.000 (0.000)] 2024-10-11 19:56:20,021 - Train: 18.17% [68200/375300] [54.5/300.0] [batch_t 0.448 (0.439)] [data_t 0.151] [optim_t 0.297] [lr 0.002765] [CE 3.461 (3.835)] [KD 0.000 (0.000)] 2024-10-11 19:56:41,973 - Train: 18.19% [68250/375300] [54.6/300.0] [batch_t 0.389 (0.439)] [data_t 0.092] [optim_t 0.297] [lr 0.002764] [CE 3.791 (3.884)] [KD 0.000 (0.000)] 2024-10-11 19:57:03,948 - Train: 18.20% [68300/375300] [54.6/300.0] [batch_t 0.497 (0.439)] [data_t 0.166] [optim_t 0.331] [lr 0.002764] [CE 3.964 (3.824)] [KD 0.000 (0.000)] 2024-10-11 19:57:25,708 - Train: 18.21% [68350/375300] [54.6/300.0] [batch_t 0.590 (0.435)] [data_t 0.132] [optim_t 0.458] [lr 0.002764] [CE 3.622 (3.845)] [KD 0.000 (0.000)] 2024-10-11 19:57:47,456 - Train: 18.23% [68400/375300] [54.7/300.0] [batch_t 0.445 (0.435)] [data_t 0.147] [optim_t 0.298] [lr 0.002763] [CE 3.873 (3.858)] [KD 0.000 (0.000)] 2024-10-11 19:58:09,561 - Train: 18.24% [68450/375300] [54.7/300.0] [batch_t 0.469 (0.442)] [data_t 0.130] [optim_t 0.340] [lr 0.002763] [CE 3.832 (3.852)] [KD 0.000 (0.000)] 2024-10-11 19:58:30,619 - Train: 18.25% [68500/375300] [54.8/300.0] [batch_t 0.448 (0.421)] [data_t 0.153] [optim_t 0.294] [lr 0.002762] [CE 3.741 (3.874)] [KD 0.000 (0.000)] 2024-10-11 19:58:51,812 - Train: 18.27% [68550/375300] [54.8/300.0] [batch_t 0.412 (0.424)] [data_t 0.111] [optim_t 0.301] [lr 0.002762] [CE 3.649 (3.808)] [KD 0.000 (0.000)] 2024-10-11 19:59:12,813 - Train: 18.28% [68600/375300] [54.8/300.0] [batch_t 0.441 (0.420)] [data_t 0.106] [optim_t 0.334] [lr 0.002762] [CE 3.672 (3.838)] [KD 0.000 (0.000)] 2024-10-11 19:59:33,713 - Train: 18.29% [68650/375300] [54.9/300.0] [batch_t 0.371 (0.418)] [data_t 0.074] [optim_t 0.297] [lr 0.002761] [CE 3.442 (3.818)] [KD 0.000 (0.000)] 2024-10-11 19:59:55,213 - Train: 18.31% [68700/375300] [54.9/300.0] [batch_t 0.435 (0.430)] [data_t 0.136] [optim_t 0.298] [lr 0.002761] [CE 3.690 (3.887)] [KD 0.000 (0.000)] 2024-10-11 20:00:17,018 - Train: 18.32% [68750/375300] [55.0/300.0] [batch_t 0.354 (0.436)] [data_t 0.016] [optim_t 0.339] [lr 0.002761] [CE 3.673 (3.844)] [KD 0.000 (0.000)] 2024-10-11 20:00:37,621 - Train: 18.33% [68800/375300] [55.0/300.0] [batch_t 0.315 (0.412)] [data_t 0.015] [optim_t 0.300] [lr 0.002760] [CE 4.066 (3.874)] [KD 0.000 (0.000)] 2024-10-11 20:01:00,641 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.424)] [top1_cnt 34456] [top5_cnt 44898] [top_all 50000] 2024-10-11 20:01:00,641 - net: 68.912 (89.796) 2024-10-11 20:01:22,412 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.426)] [top1_cnt 37791] [top5_cnt 46564] [top_all 50000] 2024-10-11 20:01:22,412 - net_E: 75.582 (93.128) 2024-10-11 20:01:22,588 - Max [top1: 69.176 (epoch: 50)] [top1-ema: 75.582 (epoch: 55)] 2024-10-11 20:01:22,588 - ==> Total time: 8:14:26 Eta: 1 day, 12:42:30 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 20:01:47,645 - Train: 18.35% [68850/375300] [55.0/300.0] [batch_t 0.317 (0.440)] [data_t 0.016] [optim_t 0.301] [lr 0.002760] [CE 3.871 (3.803)] [KD 0.000 (0.000)] 2024-10-11 20:02:09,120 - Train: 18.36% [68900/375300] [55.1/300.0] [batch_t 0.472 (0.429)] [data_t 0.016] [optim_t 0.456] [lr 0.002760] [CE 4.004 (3.873)] [KD 0.000 (0.000)] 2024-10-11 20:02:30,340 - Train: 18.37% [68950/375300] [55.1/300.0] [batch_t 0.468 (0.424)] [data_t 0.016] [optim_t 0.452] [lr 0.002759] [CE 3.869 (3.887)] [KD 0.000 (0.000)] 2024-10-11 20:02:52,164 - Train: 18.39% [69000/375300] [55.2/300.0] [batch_t 0.481 (0.436)] [data_t 0.016] [optim_t 0.465] [lr 0.002759] [CE 4.016 (3.844)] [KD 0.000 (0.000)] 2024-10-11 20:03:13,976 - Train: 18.40% [69050/375300] [55.2/300.0] [batch_t 0.415 (0.436)] [data_t 0.016] [optim_t 0.399] [lr 0.002759] [CE 3.973 (3.821)] [KD 0.000 (0.000)] 2024-10-11 20:03:36,032 - Train: 18.41% [69100/375300] [55.2/300.0] [batch_t 0.424 (0.441)] [data_t 0.016] [optim_t 0.409] [lr 0.002758] [CE 3.632 (3.835)] [KD 0.000 (0.000)] 2024-10-11 20:03:57,187 - Train: 18.43% [69150/375300] [55.3/300.0] [batch_t 0.459 (0.423)] [data_t 0.015] [optim_t 0.443] [lr 0.002758] [CE 3.308 (3.814)] [KD 0.000 (0.000)] 2024-10-11 20:04:18,075 - Train: 18.44% [69200/375300] [55.3/300.0] [batch_t 0.472 (0.418)] [data_t 0.016] [optim_t 0.456] [lr 0.002758] [CE 3.627 (3.883)] [KD 0.000 (0.000)] 2024-10-11 20:04:39,325 - Train: 18.45% [69250/375300] [55.4/300.0] [batch_t 0.376 (0.425)] [data_t 0.015] [optim_t 0.360] [lr 0.002757] [CE 3.968 (3.837)] [KD 0.000 (0.000)] 2024-10-11 20:05:01,193 - Train: 18.47% [69300/375300] [55.4/300.0] [batch_t 0.437 (0.437)] [data_t 0.015] [optim_t 0.421] [lr 0.002757] [CE 3.973 (3.838)] [KD 0.000 (0.000)] 2024-10-11 20:05:23,113 - Train: 18.48% [69350/375300] [55.4/300.0] [batch_t 0.455 (0.438)] [data_t 0.016] [optim_t 0.439] [lr 0.002757] [CE 3.606 (3.853)] [KD 0.000 (0.000)] 2024-10-11 20:05:45,128 - Train: 18.49% [69400/375300] [55.5/300.0] [batch_t 0.451 (0.440)] [data_t 0.015] [optim_t 0.436] [lr 0.002756] [CE 3.989 (3.880)] [KD 0.000 (0.000)] 2024-10-11 20:06:07,398 - Train: 18.51% [69450/375300] [55.5/300.0] [batch_t 0.466 (0.445)] [data_t 0.015] [optim_t 0.450] [lr 0.002756] [CE 3.915 (3.850)] [KD 0.000 (0.000)] 2024-10-11 20:06:29,449 - Train: 18.52% [69500/375300] [55.6/300.0] [batch_t 0.466 (0.441)] [data_t 0.015] [optim_t 0.451] [lr 0.002756] [CE 3.869 (3.859)] [KD 0.000 (0.000)] 2024-10-11 20:06:51,647 - Train: 18.53% [69550/375300] [55.6/300.0] [batch_t 0.433 (0.444)] [data_t 0.015] [optim_t 0.417] [lr 0.002755] [CE 3.590 (3.862)] [KD 0.000 (0.000)] 2024-10-11 20:07:13,455 - Train: 18.55% [69600/375300] [55.6/300.0] [batch_t 0.460 (0.436)] [data_t 0.016] [optim_t 0.445] [lr 0.002755] [CE 4.213 (3.856)] [KD 0.000 (0.000)] 2024-10-11 20:07:35,911 - Train: 18.56% [69650/375300] [55.7/300.0] [batch_t 0.427 (0.449)] [data_t 0.015] [optim_t 0.412] [lr 0.002755] [CE 4.004 (3.857)] [KD 0.000 (0.000)] 2024-10-11 20:07:56,960 - Train: 18.57% [69700/375300] [55.7/300.0] [batch_t 0.435 (0.421)] [data_t 0.016] [optim_t 0.419] [lr 0.002754] [CE 3.991 (3.840)] [KD 0.000 (0.000)] 2024-10-11 20:08:17,595 - Train: 18.59% [69750/375300] [55.8/300.0] [batch_t 0.419 (0.413)] [data_t 0.016] [optim_t 0.403] [lr 0.002754] [CE 3.633 (3.860)] [KD 0.000 (0.000)] 2024-10-11 20:08:38,817 - Train: 18.60% [69800/375300] [55.8/300.0] [batch_t 0.513 (0.424)] [data_t 0.016] [optim_t 0.497] [lr 0.002754] [CE 3.951 (3.837)] [KD 0.000 (0.000)] 2024-10-11 20:08:59,936 - Train: 18.61% [69850/375300] [55.8/300.0] [batch_t 0.430 (0.422)] [data_t 0.016] [optim_t 0.414] [lr 0.002753] [CE 3.468 (3.802)] [KD 0.000 (0.000)] 2024-10-11 20:09:21,316 - Train: 18.63% [69900/375300] [55.9/300.0] [batch_t 0.379 (0.427)] [data_t 0.016] [optim_t 0.363] [lr 0.002753] [CE 4.086 (3.852)] [KD 0.000 (0.000)] 2024-10-11 20:09:41,854 - Train: 18.64% [69950/375300] [55.9/300.0] [batch_t 0.413 (0.411)] [data_t 0.016] [optim_t 0.398] [lr 0.002753] [CE 3.926 (3.816)] [KD 0.000 (0.000)] 2024-10-11 20:10:02,657 - Train: 18.65% [70000/375300] [56.0/300.0] [batch_t 0.366 (0.416)] [data_t 0.015] [optim_t 0.351] [lr 0.002752] [CE 4.047 (3.913)] [KD 0.000 (0.000)] 2024-10-11 20:10:23,335 - Train: 18.67% [70050/375300] [56.0/300.0] [batch_t 0.307 (0.413)] [data_t 0.015] [optim_t 0.292] [lr 0.002752] [CE 3.927 (3.832)] [KD 0.000 (0.000)] 2024-10-11 20:10:25,193 - ==> Total time: 8:23:29 Eta: 1 day, 12:33:45 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 20:10:49,348 - Train: 18.68% [70100/375300] [56.0/300.0] [batch_t 0.524 (0.513)] [data_t 0.015] [optim_t 0.509] [lr 0.002752] [CE 4.074 (3.836)] [KD 0.000 (0.000)] 2024-10-11 20:11:10,707 - Train: 18.69% [70150/375300] [56.1/300.0] [batch_t 0.466 (0.427)] [data_t 0.015] [optim_t 0.451] [lr 0.002751] [CE 3.800 (3.827)] [KD 0.000 (0.000)] 2024-10-11 20:11:32,163 - Train: 18.71% [70200/375300] [56.1/300.0] [batch_t 0.467 (0.429)] [data_t 0.016] [optim_t 0.452] [lr 0.002751] [CE 3.855 (3.869)] [KD 0.000 (0.000)] 2024-10-11 20:11:53,709 - Train: 18.72% [70250/375300] [56.2/300.0] [batch_t 0.405 (0.431)] [data_t 0.016] [optim_t 0.389] [lr 0.002751] [CE 4.018 (3.825)] [KD 0.000 (0.000)] 2024-10-11 20:12:15,325 - Train: 18.73% [70300/375300] [56.2/300.0] [batch_t 0.463 (0.432)] [data_t 0.016] [optim_t 0.448] [lr 0.002750] [CE 3.943 (3.865)] [KD 0.000 (0.000)] 2024-10-11 20:12:36,582 - Train: 18.75% [70350/375300] [56.2/300.0] [batch_t 0.399 (0.425)] [data_t 0.015] [optim_t 0.384] [lr 0.002750] [CE 3.323 (3.878)] [KD 0.000 (0.000)] 2024-10-11 20:12:57,935 - Train: 18.76% [70400/375300] [56.3/300.0] [batch_t 0.432 (0.427)] [data_t 0.015] [optim_t 0.417] [lr 0.002750] [CE 3.777 (3.845)] [KD 0.000 (0.000)] 2024-10-11 20:13:18,853 - Train: 18.77% [70450/375300] [56.3/300.0] [batch_t 0.316 (0.418)] [data_t 0.016] [optim_t 0.300] [lr 0.002749] [CE 4.140 (3.792)] [KD 0.000 (0.000)] 2024-10-11 20:13:40,335 - Train: 18.78% [70500/375300] [56.4/300.0] [batch_t 0.431 (0.430)] [data_t 0.015] [optim_t 0.416] [lr 0.002749] [CE 3.843 (3.818)] [KD 0.000 (0.000)] 2024-10-11 20:14:02,311 - Train: 18.80% [70550/375300] [56.4/300.0] [batch_t 0.450 (0.439)] [data_t 0.015] [optim_t 0.434] [lr 0.002748] [CE 3.889 (3.822)] [KD 0.000 (0.000)] 2024-10-11 20:14:24,387 - Train: 18.81% [70600/375300] [56.4/300.0] [batch_t 0.445 (0.441)] [data_t 0.016] [optim_t 0.430] [lr 0.002748] [CE 3.563 (3.909)] [KD 0.000 (0.000)] 2024-10-11 20:14:46,568 - Train: 18.82% [70650/375300] [56.5/300.0] [batch_t 0.473 (0.444)] [data_t 0.016] [optim_t 0.457] [lr 0.002748] [CE 3.907 (3.870)] [KD 0.000 (0.000)] 2024-10-11 20:15:08,154 - Train: 18.84% [70700/375300] [56.5/300.0] [batch_t 0.318 (0.432)] [data_t 0.016] [optim_t 0.302] [lr 0.002747] [CE 3.920 (3.851)] [KD 0.000 (0.000)] 2024-10-11 20:15:29,557 - Train: 18.85% [70750/375300] [56.6/300.0] [batch_t 0.434 (0.428)] [data_t 0.015] [optim_t 0.419] [lr 0.002747] [CE 4.161 (3.858)] [KD 0.000 (0.000)] 2024-10-11 20:15:50,806 - Train: 18.86% [70800/375300] [56.6/300.0] [batch_t 0.429 (0.425)] [data_t 0.016] [optim_t 0.414] [lr 0.002747] [CE 4.072 (3.890)] [KD 0.000 (0.000)] 2024-10-11 20:16:13,027 - Train: 18.88% [70850/375300] [56.6/300.0] [batch_t 0.311 (0.444)] [data_t 0.016] [optim_t 0.296] [lr 0.002746] [CE 3.906 (3.815)] [KD 0.000 (0.000)] 2024-10-11 20:16:33,417 - Train: 18.89% [70900/375300] [56.7/300.0] [batch_t 0.413 (0.408)] [data_t 0.016] [optim_t 0.397] [lr 0.002746] [CE 3.614 (3.808)] [KD 0.000 (0.000)] 2024-10-11 20:16:54,281 - Train: 18.90% [70950/375300] [56.7/300.0] [batch_t 0.403 (0.417)] [data_t 0.015] [optim_t 0.387] [lr 0.002746] [CE 3.821 (3.852)] [KD 0.000 (0.000)] 2024-10-11 20:17:16,315 - Train: 18.92% [71000/375300] [56.8/300.0] [batch_t 0.478 (0.441)] [data_t 0.016] [optim_t 0.462] [lr 0.002745] [CE 3.784 (3.837)] [KD 0.000 (0.000)] 2024-10-11 20:17:37,419 - Train: 18.93% [71050/375300] [56.8/300.0] [batch_t 0.468 (0.422)] [data_t 0.016] [optim_t 0.453] [lr 0.002745] [CE 3.694 (3.866)] [KD 0.000 (0.000)] 2024-10-11 20:17:59,696 - Train: 18.94% [71100/375300] [56.8/300.0] [batch_t 0.512 (0.445)] [data_t 0.015] [optim_t 0.497] [lr 0.002745] [CE 3.763 (3.826)] [KD 0.000 (0.000)] 2024-10-11 20:18:21,706 - Train: 18.96% [71150/375300] [56.9/300.0] [batch_t 0.404 (0.440)] [data_t 0.016] [optim_t 0.388] [lr 0.002744] [CE 3.840 (3.809)] [KD 0.000 (0.000)] 2024-10-11 20:18:44,032 - Train: 18.97% [71200/375300] [56.9/300.0] [batch_t 0.533 (0.446)] [data_t 0.016] [optim_t 0.518] [lr 0.002744] [CE 3.906 (3.887)] [KD 0.000 (0.000)] 2024-10-11 20:19:06,053 - Train: 18.98% [71250/375300] [57.0/300.0] [batch_t 0.484 (0.440)] [data_t 0.016] [optim_t 0.469] [lr 0.002744] [CE 4.057 (3.858)] [KD 0.000 (0.000)] 2024-10-11 20:19:27,005 - Train: 19.00% [71300/375300] [57.0/300.0] [batch_t 0.308 (0.419)] [data_t 0.015] [optim_t 0.293] [lr 0.002743] [CE 3.835 (3.843)] [KD 0.000 (0.000)] 2024-10-11 20:19:29,167 - ==> Total time: 8:32:33 Eta: 1 day, 12:25:05 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 20:19:52,250 - Train: 19.01% [71350/375300] [57.0/300.0] [batch_t 0.344 (0.491)] [data_t 0.016] [optim_t 0.329] [lr 0.002743] [CE 3.535 (3.819)] [KD 0.000 (0.000)] 2024-10-11 20:20:14,151 - Train: 19.02% [71400/375300] [57.1/300.0] [batch_t 0.474 (0.438)] [data_t 0.015] [optim_t 0.458] [lr 0.002743] [CE 3.805 (3.804)] [KD 0.000 (0.000)] 2024-10-11 20:20:35,147 - Train: 19.04% [71450/375300] [57.1/300.0] [batch_t 0.472 (0.420)] [data_t 0.016] [optim_t 0.457] [lr 0.002742] [CE 4.085 (3.788)] [KD 0.000 (0.000)] 2024-10-11 20:20:56,722 - Train: 19.05% [71500/375300] [57.2/300.0] [batch_t 0.461 (0.431)] [data_t 0.015] [optim_t 0.445] [lr 0.002742] [CE 3.625 (3.812)] [KD 0.000 (0.000)] 2024-10-11 20:21:18,330 - Train: 19.06% [71550/375300] [57.2/300.0] [batch_t 0.325 (0.432)] [data_t 0.016] [optim_t 0.310] [lr 0.002742] [CE 3.946 (3.795)] [KD 0.000 (0.000)] 2024-10-11 20:21:39,539 - Train: 19.08% [71600/375300] [57.2/300.0] [batch_t 0.397 (0.424)] [data_t 0.016] [optim_t 0.381] [lr 0.002741] [CE 4.127 (3.848)] [KD 0.000 (0.000)] 2024-10-11 20:22:01,214 - Train: 19.09% [71650/375300] [57.3/300.0] [batch_t 0.451 (0.433)] [data_t 0.016] [optim_t 0.436] [lr 0.002741] [CE 4.116 (3.848)] [KD 0.000 (0.000)] 2024-10-11 20:22:23,147 - Train: 19.10% [71700/375300] [57.3/300.0] [batch_t 0.514 (0.439)] [data_t 0.016] [optim_t 0.498] [lr 0.002740] [CE 3.780 (3.817)] [KD 0.000 (0.000)] 2024-10-11 20:22:45,151 - Train: 19.12% [71750/375300] [57.4/300.0] [batch_t 0.387 (0.440)] [data_t 0.015] [optim_t 0.372] [lr 0.002740] [CE 3.299 (3.849)] [KD 0.000 (0.000)] 2024-10-11 20:23:06,816 - Train: 19.13% [71800/375300] [57.4/300.0] [batch_t 0.414 (0.433)] [data_t 0.016] [optim_t 0.398] [lr 0.002740] [CE 3.992 (3.814)] [KD 0.000 (0.000)] 2024-10-11 20:23:28,381 - Train: 19.14% [71850/375300] [57.4/300.0] [batch_t 0.417 (0.431)] [data_t 0.015] [optim_t 0.401] [lr 0.002739] [CE 3.919 (3.865)] [KD 0.000 (0.000)] 2024-10-11 20:23:49,763 - Train: 19.16% [71900/375300] [57.5/300.0] [batch_t 0.411 (0.428)] [data_t 0.015] [optim_t 0.395] [lr 0.002739] [CE 3.814 (3.826)] [KD 0.000 (0.000)] 2024-10-11 20:24:11,701 - Train: 19.17% [71950/375300] [57.5/300.0] [batch_t 0.416 (0.439)] [data_t 0.016] [optim_t 0.400] [lr 0.002739] [CE 3.742 (3.845)] [KD 0.000 (0.000)] 2024-10-11 20:24:33,584 - Train: 19.18% [72000/375300] [57.6/300.0] [batch_t 0.412 (0.438)] [data_t 0.016] [optim_t 0.396] [lr 0.002738] [CE 3.986 (3.915)] [KD 0.000 (0.000)] 2024-10-11 20:24:55,216 - Train: 19.20% [72050/375300] [57.6/300.0] [batch_t 0.432 (0.433)] [data_t 0.016] [optim_t 0.416] [lr 0.002738] [CE 3.522 (3.852)] [KD 0.000 (0.000)] 2024-10-11 20:25:17,011 - Train: 19.21% [72100/375300] [57.6/300.0] [batch_t 0.407 (0.436)] [data_t 0.016] [optim_t 0.391] [lr 0.002738] [CE 4.031 (3.881)] [KD 0.000 (0.000)] 2024-10-11 20:25:38,869 - Train: 19.22% [72150/375300] [57.7/300.0] [batch_t 0.403 (0.437)] [data_t 0.016] [optim_t 0.387] [lr 0.002737] [CE 3.702 (3.829)] [KD 0.000 (0.000)] 2024-10-11 20:26:01,438 - Train: 19.24% [72200/375300] [57.7/300.0] [batch_t 0.355 (0.451)] [data_t 0.016] [optim_t 0.339] [lr 0.002737] [CE 3.858 (3.823)] [KD 0.000 (0.000)] 2024-10-11 20:26:23,175 - Train: 19.25% [72250/375300] [57.8/300.0] [batch_t 0.408 (0.435)] [data_t 0.016] [optim_t 0.392] [lr 0.002737] [CE 3.829 (3.867)] [KD 0.000 (0.000)] 2024-10-11 20:26:45,193 - Train: 19.26% [72300/375300] [57.8/300.0] [batch_t 0.429 (0.440)] [data_t 0.016] [optim_t 0.413] [lr 0.002736] [CE 3.539 (3.832)] [KD 0.000 (0.000)] 2024-10-11 20:27:06,266 - Train: 19.28% [72350/375300] [57.8/300.0] [batch_t 0.379 (0.421)] [data_t 0.015] [optim_t 0.363] [lr 0.002736] [CE 4.070 (3.874)] [KD 0.000 (0.000)] 2024-10-11 20:27:28,075 - Train: 19.29% [72400/375300] [57.9/300.0] [batch_t 0.413 (0.436)] [data_t 0.015] [optim_t 0.398] [lr 0.002736] [CE 3.900 (3.876)] [KD 0.000 (0.000)] 2024-10-11 20:27:49,183 - Train: 19.30% [72450/375300] [57.9/300.0] [batch_t 0.379 (0.422)] [data_t 0.016] [optim_t 0.363] [lr 0.002735] [CE 3.689 (3.849)] [KD 0.000 (0.000)] 2024-10-11 20:28:10,743 - Train: 19.32% [72500/375300] [58.0/300.0] [batch_t 0.490 (0.431)] [data_t 0.016] [optim_t 0.475] [lr 0.002735] [CE 4.116 (3.888)] [KD 0.000 (0.000)] 2024-10-11 20:28:31,665 - Train: 19.33% [72550/375300] [58.0/300.0] [batch_t 0.312 (0.418)] [data_t 0.015] [optim_t 0.297] [lr 0.002734] [CE 3.859 (3.867)] [KD 0.000 (0.000)] 2024-10-11 20:28:34,170 - ==> Total time: 8:41:38 Eta: 1 day, 12:16:28 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 20:28:57,376 - Train: 19.34% [72600/375300] [58.0/300.0] [batch_t 0.317 (0.513)] [data_t 0.016] [optim_t 0.302] [lr 0.002734] [CE 3.525 (3.809)] [KD 0.000 (0.000)] 2024-10-11 20:29:18,600 - Train: 19.36% [72650/375300] [58.1/300.0] [batch_t 0.388 (0.424)] [data_t 0.091] [optim_t 0.298] [lr 0.002734] [CE 3.617 (3.840)] [KD 0.000 (0.000)] 2024-10-11 20:29:39,378 - Train: 19.37% [72700/375300] [58.1/300.0] [batch_t 0.407 (0.415)] [data_t 0.107] [optim_t 0.301] [lr 0.002733] [CE 4.021 (3.796)] [KD 0.000 (0.000)] 2024-10-11 20:30:00,874 - Train: 19.38% [72750/375300] [58.2/300.0] [batch_t 0.918 (0.430)] [data_t 0.625] [optim_t 0.293] [lr 0.002733] [CE 3.968 (3.820)] [KD 0.000 (0.000)] 2024-10-11 20:30:21,316 - Train: 19.40% [72800/375300] [58.2/300.0] [batch_t 0.314 (0.409)] [data_t 0.015] [optim_t 0.299] [lr 0.002733] [CE 3.932 (3.828)] [KD 0.000 (0.000)] 2024-10-11 20:30:42,073 - Train: 19.41% [72850/375300] [58.2/300.0] [batch_t 0.416 (0.415)] [data_t 0.124] [optim_t 0.292] [lr 0.002732] [CE 3.770 (3.818)] [KD 0.000 (0.000)] 2024-10-11 20:31:02,902 - Train: 19.42% [72900/375300] [58.3/300.0] [batch_t 0.435 (0.416)] [data_t 0.139] [optim_t 0.296] [lr 0.002732] [CE 3.992 (3.834)] [KD 0.000 (0.000)] 2024-10-11 20:31:24,164 - Train: 19.44% [72950/375300] [58.3/300.0] [batch_t 0.458 (0.425)] [data_t 0.163] [optim_t 0.295] [lr 0.002732] [CE 3.584 (3.793)] [KD 0.000 (0.000)] 2024-10-11 20:31:46,626 - Train: 19.45% [73000/375300] [58.4/300.0] [batch_t 0.362 (0.449)] [data_t 0.015] [optim_t 0.347] [lr 0.002731] [CE 3.995 (3.808)] [KD 0.000 (0.000)] 2024-10-11 20:32:09,084 - Train: 19.46% [73050/375300] [58.4/300.0] [batch_t 0.474 (0.449)] [data_t 0.015] [optim_t 0.458] [lr 0.002731] [CE 3.506 (3.814)] [KD 0.000 (0.000)] 2024-10-11 20:32:31,322 - Train: 19.48% [73100/375300] [58.4/300.0] [batch_t 0.438 (0.445)] [data_t 0.016] [optim_t 0.423] [lr 0.002731] [CE 3.578 (3.878)] [KD 0.000 (0.000)] 2024-10-11 20:32:54,009 - Train: 19.49% [73150/375300] [58.5/300.0] [batch_t 0.513 (0.454)] [data_t 0.016] [optim_t 0.497] [lr 0.002730] [CE 3.935 (3.823)] [KD 0.000 (0.000)] 2024-10-11 20:33:15,199 - Train: 19.50% [73200/375300] [58.5/300.0] [batch_t 0.411 (0.424)] [data_t 0.015] [optim_t 0.395] [lr 0.002730] [CE 3.851 (3.825)] [KD 0.000 (0.000)] 2024-10-11 20:33:35,884 - Train: 19.52% [73250/375300] [58.6/300.0] [batch_t 0.473 (0.414)] [data_t 0.016] [optim_t 0.457] [lr 0.002729] [CE 3.952 (3.835)] [KD 0.000 (0.000)] 2024-10-11 20:33:57,028 - Train: 19.53% [73300/375300] [58.6/300.0] [batch_t 0.387 (0.423)] [data_t 0.016] [optim_t 0.372] [lr 0.002729] [CE 3.753 (3.863)] [KD 0.000 (0.000)] 2024-10-11 20:34:18,100 - Train: 19.54% [73350/375300] [58.6/300.0] [batch_t 0.311 (0.421)] [data_t 0.016] [optim_t 0.296] [lr 0.002729] [CE 3.947 (3.814)] [KD 0.000 (0.000)] 2024-10-11 20:34:38,577 - Train: 19.56% [73400/375300] [58.7/300.0] [batch_t 0.415 (0.409)] [data_t 0.016] [optim_t 0.399] [lr 0.002728] [CE 3.901 (3.798)] [KD 0.000 (0.000)] 2024-10-11 20:35:00,006 - Train: 19.57% [73450/375300] [58.7/300.0] [batch_t 0.408 (0.428)] [data_t 0.016] [optim_t 0.392] [lr 0.002728] [CE 3.906 (3.882)] [KD 0.000 (0.000)] 2024-10-11 20:35:21,504 - Train: 19.58% [73500/375300] [58.8/300.0] [batch_t 0.473 (0.430)] [data_t 0.016] [optim_t 0.457] [lr 0.002728] [CE 4.095 (3.872)] [KD 0.000 (0.000)] 2024-10-11 20:35:43,275 - Train: 19.60% [73550/375300] [58.8/300.0] [batch_t 0.394 (0.435)] [data_t 0.016] [optim_t 0.379] [lr 0.002727] [CE 3.702 (3.855)] [KD 0.000 (0.000)] 2024-10-11 20:36:04,853 - Train: 19.61% [73600/375300] [58.8/300.0] [batch_t 0.863 (0.431)] [data_t 0.016] [optim_t 0.847] [lr 0.002727] [CE 3.909 (3.864)] [KD 0.000 (0.000)] 2024-10-11 20:36:26,022 - Train: 19.62% [73650/375300] [58.9/300.0] [batch_t 0.443 (0.423)] [data_t 0.015] [optim_t 0.427] [lr 0.002727] [CE 4.142 (3.852)] [KD 0.000 (0.000)] 2024-10-11 20:36:47,299 - Train: 19.64% [73700/375300] [58.9/300.0] [batch_t 0.519 (0.425)] [data_t 0.016] [optim_t 0.504] [lr 0.002726] [CE 3.666 (3.847)] [KD 0.000 (0.000)] 2024-10-11 20:37:08,576 - Train: 19.65% [73750/375300] [59.0/300.0] [batch_t 0.321 (0.425)] [data_t 0.015] [optim_t 0.306] [lr 0.002726] [CE 3.075 (3.796)] [KD 0.000 (0.000)] 2024-10-11 20:37:30,190 - Train: 19.66% [73800/375300] [59.0/300.0] [batch_t 0.314 (0.432)] [data_t 0.015] [optim_t 0.299] [lr 0.002726] [CE 4.056 (3.883)] [KD 0.000 (0.000)] 2024-10-11 20:37:33,050 - ==> Total time: 8:50:36 Eta: 1 day, 12:07:25 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 20:37:55,752 - Train: 19.68% [73850/375300] [59.0/300.0] [batch_t 0.321 (0.512)] [data_t 0.016] [optim_t 0.305] [lr 0.002725] [CE 4.159 (3.849)] [KD 0.000 (0.000)] 2024-10-11 20:38:18,881 - Train: 19.69% [73900/375300] [59.1/300.0] [batch_t 0.435 (0.461)] [data_t 0.016] [optim_t 0.419] [lr 0.002725] [CE 4.304 (3.812)] [KD 0.000 (0.000)] 2024-10-11 20:38:41,716 - Train: 19.70% [73950/375300] [59.1/300.0] [batch_t 0.518 (0.457)] [data_t 0.016] [optim_t 0.503] [lr 0.002724] [CE 3.556 (3.793)] [KD 0.000 (0.000)] 2024-10-11 20:39:04,508 - Train: 19.72% [74000/375300] [59.2/300.0] [batch_t 0.318 (0.456)] [data_t 0.016] [optim_t 0.303] [lr 0.002724] [CE 3.946 (3.853)] [KD 0.000 (0.000)] 2024-10-11 20:39:27,066 - Train: 19.73% [74050/375300] [59.2/300.0] [batch_t 0.357 (0.451)] [data_t 0.016] [optim_t 0.341] [lr 0.002724] [CE 3.762 (3.844)] [KD 0.000 (0.000)] 2024-10-11 20:39:49,926 - Train: 19.74% [74100/375300] [59.2/300.0] [batch_t 0.576 (0.457)] [data_t 0.015] [optim_t 0.561] [lr 0.002723] [CE 3.626 (3.815)] [KD 0.000 (0.000)] 2024-10-11 20:40:13,161 - Train: 19.76% [74150/375300] [59.3/300.0] [batch_t 0.521 (0.465)] [data_t 0.015] [optim_t 0.505] [lr 0.002723] [CE 3.720 (3.819)] [KD 0.000 (0.000)] 2024-10-11 20:40:35,886 - Train: 19.77% [74200/375300] [59.3/300.0] [batch_t 0.484 (0.454)] [data_t 0.015] [optim_t 0.468] [lr 0.002723] [CE 3.860 (3.812)] [KD 0.000 (0.000)] 2024-10-11 20:40:57,769 - Train: 19.78% [74250/375300] [59.4/300.0] [batch_t 0.462 (0.438)] [data_t 0.016] [optim_t 0.446] [lr 0.002722] [CE 3.827 (3.825)] [KD 0.000 (0.000)] 2024-10-11 20:41:20,908 - Train: 19.80% [74300/375300] [59.4/300.0] [batch_t 0.445 (0.463)] [data_t 0.016] [optim_t 0.429] [lr 0.002722] [CE 3.876 (3.884)] [KD 0.000 (0.000)] 2024-10-11 20:41:43,820 - Train: 19.81% [74350/375300] [59.4/300.0] [batch_t 0.466 (0.458)] [data_t 0.015] [optim_t 0.450] [lr 0.002722] [CE 4.078 (3.840)] [KD 0.000 (0.000)] 2024-10-11 20:42:06,139 - Train: 19.82% [74400/375300] [59.5/300.0] [batch_t 0.412 (0.446)] [data_t 0.015] [optim_t 0.396] [lr 0.002721] [CE 3.733 (3.804)] [KD 0.000 (0.000)] 2024-10-11 20:42:27,634 - Train: 19.84% [74450/375300] [59.5/300.0] [batch_t 0.452 (0.430)] [data_t 0.015] [optim_t 0.437] [lr 0.002721] [CE 3.883 (3.801)] [KD 0.000 (0.000)] 2024-10-11 20:42:49,649 - Train: 19.85% [74500/375300] [59.6/300.0] [batch_t 0.476 (0.440)] [data_t 0.016] [optim_t 0.461] [lr 0.002720] [CE 3.648 (3.808)] [KD 0.000 (0.000)] 2024-10-11 20:43:11,783 - Train: 19.86% [74550/375300] [59.6/300.0] [batch_t 0.323 (0.443)] [data_t 0.016] [optim_t 0.308] [lr 0.002720] [CE 3.803 (3.778)] [KD 0.000 (0.000)] 2024-10-11 20:43:34,244 - Train: 19.88% [74600/375300] [59.6/300.0] [batch_t 0.400 (0.449)] [data_t 0.016] [optim_t 0.384] [lr 0.002720] [CE 3.940 (3.837)] [KD 0.000 (0.000)] 2024-10-11 20:43:56,243 - Train: 19.89% [74650/375300] [59.7/300.0] [batch_t 0.458 (0.440)] [data_t 0.015] [optim_t 0.443] [lr 0.002719] [CE 3.561 (3.845)] [KD 0.000 (0.000)] 2024-10-11 20:44:18,471 - Train: 19.90% [74700/375300] [59.7/300.0] [batch_t 0.480 (0.444)] [data_t 0.016] [optim_t 0.464] [lr 0.002719] [CE 4.054 (3.837)] [KD 0.000 (0.000)] 2024-10-11 20:44:41,009 - Train: 19.92% [74750/375300] [59.8/300.0] [batch_t 0.520 (0.451)] [data_t 0.016] [optim_t 0.505] [lr 0.002719] [CE 3.704 (3.844)] [KD 0.000 (0.000)] 2024-10-11 20:45:03,137 - Train: 19.93% [74800/375300] [59.8/300.0] [batch_t 0.428 (0.442)] [data_t 0.016] [optim_t 0.413] [lr 0.002718] [CE 4.128 (3.829)] [KD 0.000 (0.000)] 2024-10-11 20:45:25,595 - Train: 19.94% [74850/375300] [59.8/300.0] [batch_t 0.474 (0.449)] [data_t 0.016] [optim_t 0.458] [lr 0.002718] [CE 3.555 (3.835)] [KD 0.000 (0.000)] 2024-10-11 20:45:47,802 - Train: 19.96% [74900/375300] [59.9/300.0] [batch_t 0.472 (0.444)] [data_t 0.015] [optim_t 0.456] [lr 0.002718] [CE 4.041 (3.820)] [KD 0.000 (0.000)] 2024-10-11 20:46:10,703 - Train: 19.97% [74950/375300] [59.9/300.0] [batch_t 0.470 (0.458)] [data_t 0.016] [optim_t 0.454] [lr 0.002717] [CE 3.961 (3.844)] [KD 0.000 (0.000)] 2024-10-11 20:46:33,521 - Train: 19.98% [75000/375300] [60.0/300.0] [batch_t 0.464 (0.456)] [data_t 0.015] [optim_t 0.448] [lr 0.002717] [CE 3.768 (3.821)] [KD 0.000 (0.000)] 2024-10-11 20:46:55,642 - Train: 20.00% [75050/375300] [60.0/300.0] [batch_t 0.320 (0.442)] [data_t 0.015] [optim_t 0.305] [lr 0.002716] [CE 4.099 (3.857)] [KD 0.000 (0.000)] 2024-10-11 20:47:20,921 - Test (net): 100.00% [50/50] [batch_t 0.131 (0.438)] [top1_cnt 34902] [top5_cnt 45018] [top_all 50000] 2024-10-11 20:47:20,922 - net: 69.804 (90.036) 2024-10-11 20:47:43,982 - Test (net_E): 100.00% [50/50] [batch_t 0.138 (0.453)] [top1_cnt 37948] [top5_cnt 46605] [top_all 50000] 2024-10-11 20:47:43,982 - net_E: 75.896 (93.210) 2024-10-11 20:47:44,166 - Max [top1: 69.804 (epoch: 60)] [top1-ema: 75.896 (epoch: 60)] 2024-10-11 20:47:44,166 - ==> Total time: 9:00:48 Eta: 1 day, 12:03:12 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 20:48:08,123 - Train: 20.01% [75100/375300] [60.0/300.0] [batch_t 0.318 (0.422)] [data_t 0.016] [optim_t 0.303] [lr 0.002716] [CE 3.759 (3.752)] [KD 0.000 (0.000)] 2024-10-11 20:48:29,635 - Train: 20.02% [75150/375300] [60.1/300.0] [batch_t 0.318 (0.430)] [data_t 0.016] [optim_t 0.302] [lr 0.002716] [CE 4.002 (3.850)] [KD 0.000 (0.000)] 2024-10-11 20:48:50,726 - Train: 20.04% [75200/375300] [60.1/300.0] [batch_t 0.327 (0.422)] [data_t 0.015] [optim_t 0.312] [lr 0.002715] [CE 3.617 (3.812)] [KD 0.000 (0.000)] 2024-10-11 20:49:12,131 - Train: 20.05% [75250/375300] [60.2/300.0] [batch_t 0.473 (0.428)] [data_t 0.075] [optim_t 0.398] [lr 0.002715] [CE 3.900 (3.817)] [KD 0.000 (0.000)] 2024-10-11 20:49:33,689 - Train: 20.06% [75300/375300] [60.2/300.0] [batch_t 0.494 (0.431)] [data_t 0.016] [optim_t 0.479] [lr 0.002715] [CE 4.262 (3.797)] [KD 0.000 (0.000)] 2024-10-11 20:49:55,455 - Train: 20.08% [75350/375300] [60.2/300.0] [batch_t 0.439 (0.435)] [data_t 0.016] [optim_t 0.424] [lr 0.002714] [CE 3.434 (3.802)] [KD 0.000 (0.000)] 2024-10-11 20:50:17,108 - Train: 20.09% [75400/375300] [60.3/300.0] [batch_t 0.371 (0.433)] [data_t 0.015] [optim_t 0.356] [lr 0.002714] [CE 3.471 (3.791)] [KD 0.000 (0.000)] 2024-10-11 20:50:39,418 - Train: 20.10% [75450/375300] [60.3/300.0] [batch_t 0.466 (0.446)] [data_t 0.016] [optim_t 0.451] [lr 0.002714] [CE 3.827 (3.870)] [KD 0.000 (0.000)] 2024-10-11 20:51:01,104 - Train: 20.12% [75500/375300] [60.4/300.0] [batch_t 0.403 (0.434)] [data_t 0.016] [optim_t 0.387] [lr 0.002713] [CE 3.923 (3.812)] [KD 0.000 (0.000)] 2024-10-11 20:51:22,732 - Train: 20.13% [75550/375300] [60.4/300.0] [batch_t 0.465 (0.432)] [data_t 0.016] [optim_t 0.450] [lr 0.002713] [CE 3.999 (3.827)] [KD 0.000 (0.000)] 2024-10-11 20:51:44,904 - Train: 20.14% [75600/375300] [60.4/300.0] [batch_t 0.439 (0.443)] [data_t 0.015] [optim_t 0.423] [lr 0.002712] [CE 3.673 (3.833)] [KD 0.000 (0.000)] 2024-10-11 20:52:07,544 - Train: 20.16% [75650/375300] [60.5/300.0] [batch_t 0.406 (0.453)] [data_t 0.016] [optim_t 0.390] [lr 0.002712] [CE 3.867 (3.888)] [KD 0.000 (0.000)] 2024-10-11 20:52:28,909 - Train: 20.17% [75700/375300] [60.5/300.0] [batch_t 0.366 (0.427)] [data_t 0.016] [optim_t 0.350] [lr 0.002712] [CE 4.208 (3.865)] [KD 0.000 (0.000)] 2024-10-11 20:52:50,644 - Train: 20.18% [75750/375300] [60.6/300.0] [batch_t 0.393 (0.435)] [data_t 0.016] [optim_t 0.378] [lr 0.002711] [CE 3.978 (3.825)] [KD 0.000 (0.000)] 2024-10-11 20:53:12,095 - Train: 20.20% [75800/375300] [60.6/300.0] [batch_t 0.330 (0.429)] [data_t 0.016] [optim_t 0.315] [lr 0.002711] [CE 4.181 (3.856)] [KD 0.000 (0.000)] 2024-10-11 20:53:33,378 - Train: 20.21% [75850/375300] [60.6/300.0] [batch_t 0.529 (0.426)] [data_t 0.016] [optim_t 0.514] [lr 0.002711] [CE 3.746 (3.821)] [KD 0.000 (0.000)] 2024-10-11 20:53:55,359 - Train: 20.22% [75900/375300] [60.7/300.0] [batch_t 0.501 (0.439)] [data_t 0.016] [optim_t 0.485] [lr 0.002710] [CE 3.817 (3.867)] [KD 0.000 (0.000)] 2024-10-11 20:54:17,954 - Train: 20.24% [75950/375300] [60.7/300.0] [batch_t 0.451 (0.452)] [data_t 0.015] [optim_t 0.436] [lr 0.002710] [CE 3.697 (3.830)] [KD 0.000 (0.000)] 2024-10-11 20:54:40,364 - Train: 20.25% [76000/375300] [60.8/300.0] [batch_t 0.448 (0.448)] [data_t 0.016] [optim_t 0.432] [lr 0.002709] [CE 3.964 (3.868)] [KD 0.000 (0.000)] 2024-10-11 20:55:02,535 - Train: 20.26% [76050/375300] [60.8/300.0] [batch_t 0.452 (0.443)] [data_t 0.016] [optim_t 0.436] [lr 0.002709] [CE 3.751 (3.837)] [KD 0.000 (0.000)] 2024-10-11 20:55:24,361 - Train: 20.28% [76100/375300] [60.8/300.0] [batch_t 0.459 (0.436)] [data_t 0.016] [optim_t 0.443] [lr 0.002709] [CE 3.852 (3.844)] [KD 0.000 (0.000)] 2024-10-11 20:55:46,266 - Train: 20.29% [76150/375300] [60.9/300.0] [batch_t 0.469 (0.438)] [data_t 0.016] [optim_t 0.453] [lr 0.002708] [CE 3.744 (3.826)] [KD 0.000 (0.000)] 2024-10-11 20:56:08,651 - Train: 20.30% [76200/375300] [60.9/300.0] [batch_t 0.318 (0.448)] [data_t 0.016] [optim_t 0.303] [lr 0.002708] [CE 3.848 (3.858)] [KD 0.000 (0.000)] 2024-10-11 20:56:30,000 - Train: 20.32% [76250/375300] [61.0/300.0] [batch_t 0.428 (0.427)] [data_t 0.015] [optim_t 0.412] [lr 0.002708] [CE 3.743 (3.823)] [KD 0.000 (0.000)] 2024-10-11 20:56:51,269 - Train: 20.33% [76300/375300] [61.0/300.0] [batch_t 0.312 (0.425)] [data_t 0.015] [optim_t 0.296] [lr 0.002707] [CE 3.676 (3.850)] [KD 0.000 (0.000)] 2024-10-11 20:56:54,735 - ==> Total time: 9:09:58 Eta: 1 day, 11:54:49 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 20:57:16,202 - Train: 20.34% [76350/375300] [61.0/300.0] [batch_t 0.318 (0.511)] [data_t 0.016] [optim_t 0.303] [lr 0.002707] [CE 3.821 (3.873)] [KD 0.000 (0.000)] 2024-10-11 20:57:37,821 - Train: 20.36% [76400/375300] [61.1/300.0] [batch_t 0.375 (0.432)] [data_t 0.016] [optim_t 0.359] [lr 0.002707] [CE 3.786 (3.819)] [KD 0.000 (0.000)] 2024-10-11 20:57:59,496 - Train: 20.37% [76450/375300] [61.1/300.0] [batch_t 0.447 (0.433)] [data_t 0.016] [optim_t 0.431] [lr 0.002706] [CE 3.412 (3.815)] [KD 0.000 (0.000)] 2024-10-11 20:58:22,015 - Train: 20.38% [76500/375300] [61.2/300.0] [batch_t 0.525 (0.450)] [data_t 0.016] [optim_t 0.509] [lr 0.002706] [CE 3.718 (3.778)] [KD 0.000 (0.000)] 2024-10-11 20:58:44,786 - Train: 20.40% [76550/375300] [61.2/300.0] [batch_t 0.493 (0.455)] [data_t 0.016] [optim_t 0.477] [lr 0.002705] [CE 3.720 (3.823)] [KD 0.000 (0.000)] 2024-10-11 20:59:06,686 - Train: 20.41% [76600/375300] [61.2/300.0] [batch_t 0.382 (0.438)] [data_t 0.016] [optim_t 0.366] [lr 0.002705] [CE 3.824 (3.884)] [KD 0.000 (0.000)] 2024-10-11 20:59:29,301 - Train: 20.42% [76650/375300] [61.3/300.0] [batch_t 0.449 (0.452)] [data_t 0.016] [optim_t 0.433] [lr 0.002705] [CE 3.705 (3.868)] [KD 0.000 (0.000)] 2024-10-11 20:59:52,136 - Train: 20.44% [76700/375300] [61.3/300.0] [batch_t 0.857 (0.457)] [data_t 0.016] [optim_t 0.841] [lr 0.002704] [CE 3.943 (3.861)] [KD 0.000 (0.000)] 2024-10-11 21:00:13,799 - Train: 20.45% [76750/375300] [61.4/300.0] [batch_t 0.315 (0.433)] [data_t 0.016] [optim_t 0.299] [lr 0.002704] [CE 3.401 (3.764)] [KD 0.000 (0.000)] 2024-10-11 21:00:35,745 - Train: 20.46% [76800/375300] [61.4/300.0] [batch_t 0.483 (0.439)] [data_t 0.016] [optim_t 0.468] [lr 0.002704] [CE 3.827 (3.816)] [KD 0.000 (0.000)] 2024-10-11 21:00:57,523 - Train: 20.48% [76850/375300] [61.4/300.0] [batch_t 0.402 (0.435)] [data_t 0.016] [optim_t 0.387] [lr 0.002703] [CE 3.813 (3.884)] [KD 0.000 (0.000)] 2024-10-11 21:01:18,803 - Train: 20.49% [76900/375300] [61.5/300.0] [batch_t 0.416 (0.425)] [data_t 0.016] [optim_t 0.400] [lr 0.002703] [CE 3.660 (3.785)] [KD 0.000 (0.000)] 2024-10-11 21:01:40,073 - Train: 20.50% [76950/375300] [61.5/300.0] [batch_t 0.407 (0.425)] [data_t 0.016] [optim_t 0.392] [lr 0.002702] [CE 3.813 (3.807)] [KD 0.000 (0.000)] 2024-10-11 21:02:02,863 - Train: 20.52% [77000/375300] [61.6/300.0] [batch_t 0.441 (0.456)] [data_t 0.016] [optim_t 0.425] [lr 0.002702] [CE 4.130 (3.815)] [KD 0.000 (0.000)] 2024-10-11 21:02:24,945 - Train: 20.53% [77050/375300] [61.6/300.0] [batch_t 0.423 (0.442)] [data_t 0.016] [optim_t 0.407] [lr 0.002702] [CE 3.708 (3.786)] [KD 0.000 (0.000)] 2024-10-11 21:02:47,247 - Train: 20.54% [77100/375300] [61.6/300.0] [batch_t 0.346 (0.446)] [data_t 0.015] [optim_t 0.330] [lr 0.002701] [CE 3.833 (3.831)] [KD 0.000 (0.000)] 2024-10-11 21:03:09,154 - Train: 20.56% [77150/375300] [61.7/300.0] [batch_t 0.485 (0.438)] [data_t 0.015] [optim_t 0.470] [lr 0.002701] [CE 3.890 (3.825)] [KD 0.000 (0.000)] 2024-10-11 21:03:31,230 - Train: 20.57% [77200/375300] [61.7/300.0] [batch_t 0.450 (0.441)] [data_t 0.015] [optim_t 0.435] [lr 0.002701] [CE 3.589 (3.838)] [KD 0.000 (0.000)] 2024-10-11 21:03:52,504 - Train: 20.58% [77250/375300] [61.8/300.0] [batch_t 0.417 (0.425)] [data_t 0.015] [optim_t 0.402] [lr 0.002700] [CE 4.028 (3.842)] [KD 0.000 (0.000)] 2024-10-11 21:04:15,524 - Train: 20.60% [77300/375300] [61.8/300.0] [batch_t 0.441 (0.460)] [data_t 0.015] [optim_t 0.426] [lr 0.002700] [CE 3.947 (3.840)] [KD 0.000 (0.000)] 2024-10-11 21:04:38,827 - Train: 20.61% [77350/375300] [61.8/300.0] [batch_t 0.529 (0.466)] [data_t 0.015] [optim_t 0.514] [lr 0.002699] [CE 4.002 (3.799)] [KD 0.000 (0.000)] 2024-10-11 21:05:02,250 - Train: 20.62% [77400/375300] [61.9/300.0] [batch_t 0.469 (0.468)] [data_t 0.016] [optim_t 0.453] [lr 0.002699] [CE 3.736 (3.805)] [KD 0.000 (0.000)] 2024-10-11 21:05:24,690 - Train: 20.64% [77450/375300] [61.9/300.0] [batch_t 0.473 (0.449)] [data_t 0.015] [optim_t 0.458] [lr 0.002699] [CE 3.993 (3.810)] [KD 0.000 (0.000)] 2024-10-11 21:05:46,454 - Train: 20.65% [77500/375300] [62.0/300.0] [batch_t 0.409 (0.435)] [data_t 0.015] [optim_t 0.394] [lr 0.002698] [CE 3.613 (3.809)] [KD 0.000 (0.000)] 2024-10-11 21:06:09,001 - Train: 20.66% [77550/375300] [62.0/300.0] [batch_t 0.365 (0.451)] [data_t 0.015] [optim_t 0.349] [lr 0.002698] [CE 3.520 (3.858)] [KD 0.000 (0.000)] 2024-10-11 21:06:12,929 - ==> Total time: 9:19:16 Eta: 1 day, 11:46:55 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 21:06:34,325 - Train: 20.68% [77600/375300] [62.0/300.0] [batch_t 0.456 (0.523)] [data_t 0.016] [optim_t 0.440] [lr 0.002698] [CE 3.802 (3.771)] [KD 0.000 (0.000)] 2024-10-11 21:06:57,130 - Train: 20.69% [77650/375300] [62.1/300.0] [batch_t 0.433 (0.456)] [data_t 0.015] [optim_t 0.417] [lr 0.002697] [CE 3.694 (3.812)] [KD 0.000 (0.000)] 2024-10-11 21:07:19,510 - Train: 20.70% [77700/375300] [62.1/300.0] [batch_t 0.517 (0.447)] [data_t 0.015] [optim_t 0.501] [lr 0.002697] [CE 3.569 (3.773)] [KD 0.000 (0.000)] 2024-10-11 21:07:41,865 - Train: 20.72% [77750/375300] [62.2/300.0] [batch_t 0.359 (0.447)] [data_t 0.016] [optim_t 0.343] [lr 0.002696] [CE 3.944 (3.780)] [KD 0.000 (0.000)] 2024-10-11 21:08:03,957 - Train: 20.73% [77800/375300] [62.2/300.0] [batch_t 0.388 (0.442)] [data_t 0.015] [optim_t 0.372] [lr 0.002696] [CE 3.788 (3.851)] [KD 0.000 (0.000)] 2024-10-11 21:08:26,251 - Train: 20.74% [77850/375300] [62.2/300.0] [batch_t 0.459 (0.446)] [data_t 0.016] [optim_t 0.444] [lr 0.002696] [CE 3.846 (3.789)] [KD 0.000 (0.000)] 2024-10-11 21:08:48,251 - Train: 20.76% [77900/375300] [62.3/300.0] [batch_t 0.472 (0.440)] [data_t 0.016] [optim_t 0.456] [lr 0.002695] [CE 3.696 (3.797)] [KD 0.000 (0.000)] 2024-10-11 21:09:09,808 - Train: 20.77% [77950/375300] [62.3/300.0] [batch_t 0.376 (0.431)] [data_t 0.016] [optim_t 0.361] [lr 0.002695] [CE 3.746 (3.844)] [KD 0.000 (0.000)] 2024-10-11 21:09:31,368 - Train: 20.78% [78000/375300] [62.4/300.0] [batch_t 0.439 (0.431)] [data_t 0.016] [optim_t 0.423] [lr 0.002695] [CE 3.680 (3.776)] [KD 0.000 (0.000)] 2024-10-11 21:09:53,116 - Train: 20.80% [78050/375300] [62.4/300.0] [batch_t 0.503 (0.435)] [data_t 0.016] [optim_t 0.488] [lr 0.002694] [CE 3.967 (3.820)] [KD 0.000 (0.000)] 2024-10-11 21:10:15,099 - Train: 20.81% [78100/375300] [62.4/300.0] [batch_t 0.467 (0.440)] [data_t 0.015] [optim_t 0.451] [lr 0.002694] [CE 3.822 (3.801)] [KD 0.000 (0.000)] 2024-10-11 21:10:36,886 - Train: 20.82% [78150/375300] [62.5/300.0] [batch_t 0.440 (0.436)] [data_t 0.016] [optim_t 0.424] [lr 0.002693] [CE 3.801 (3.807)] [KD 0.000 (0.000)] 2024-10-11 21:10:58,554 - Train: 20.84% [78200/375300] [62.5/300.0] [batch_t 0.485 (0.433)] [data_t 0.016] [optim_t 0.469] [lr 0.002693] [CE 3.657 (3.815)] [KD 0.000 (0.000)] 2024-10-11 21:11:20,116 - Train: 20.85% [78250/375300] [62.5/300.0] [batch_t 0.424 (0.431)] [data_t 0.015] [optim_t 0.409] [lr 0.002693] [CE 3.973 (3.868)] [KD 0.000 (0.000)] 2024-10-11 21:11:41,639 - Train: 20.86% [78300/375300] [62.6/300.0] [batch_t 0.497 (0.430)] [data_t 0.016] [optim_t 0.481] [lr 0.002692] [CE 3.747 (3.827)] [KD 0.000 (0.000)] 2024-10-11 21:12:03,092 - Train: 20.88% [78350/375300] [62.6/300.0] [batch_t 0.411 (0.429)] [data_t 0.015] [optim_t 0.395] [lr 0.002692] [CE 3.195 (3.819)] [KD 0.000 (0.000)] 2024-10-11 21:12:25,369 - Train: 20.89% [78400/375300] [62.7/300.0] [batch_t 0.509 (0.445)] [data_t 0.016] [optim_t 0.493] [lr 0.002692] [CE 3.887 (3.814)] [KD 0.000 (0.000)] 2024-10-11 21:12:47,269 - Train: 20.90% [78450/375300] [62.7/300.0] [batch_t 0.471 (0.438)] [data_t 0.015] [optim_t 0.456] [lr 0.002691] [CE 3.817 (3.804)] [KD 0.000 (0.000)] 2024-10-11 21:13:09,697 - Train: 20.92% [78500/375300] [62.7/300.0] [batch_t 0.435 (0.448)] [data_t 0.016] [optim_t 0.419] [lr 0.002691] [CE 3.828 (3.831)] [KD 0.000 (0.000)] 2024-10-11 21:13:31,109 - Train: 20.93% [78550/375300] [62.8/300.0] [batch_t 0.441 (0.428)] [data_t 0.016] [optim_t 0.425] [lr 0.002690] [CE 3.831 (3.875)] [KD 0.000 (0.000)] 2024-10-11 21:13:53,039 - Train: 20.94% [78600/375300] [62.8/300.0] [batch_t 0.477 (0.438)] [data_t 0.016] [optim_t 0.461] [lr 0.002690] [CE 4.011 (3.825)] [KD 0.000 (0.000)] 2024-10-11 21:14:15,364 - Train: 20.96% [78650/375300] [62.9/300.0] [batch_t 0.512 (0.446)] [data_t 0.016] [optim_t 0.496] [lr 0.002690] [CE 4.090 (3.788)] [KD 0.000 (0.000)] 2024-10-11 21:14:36,853 - Train: 20.97% [78700/375300] [62.9/300.0] [batch_t 0.420 (0.430)] [data_t 0.016] [optim_t 0.404] [lr 0.002689] [CE 4.097 (3.822)] [KD 0.000 (0.000)] 2024-10-11 21:14:58,766 - Train: 20.98% [78750/375300] [62.9/300.0] [batch_t 0.473 (0.438)] [data_t 0.015] [optim_t 0.458] [lr 0.002689] [CE 3.785 (3.835)] [KD 0.000 (0.000)] 2024-10-11 21:15:20,491 - Train: 21.00% [78800/375300] [63.0/300.0] [batch_t 0.313 (0.434)] [data_t 0.015] [optim_t 0.298] [lr 0.002688] [CE 4.021 (3.882)] [KD 0.000 (0.000)] 2024-10-11 21:15:24,621 - ==> Total time: 9:28:28 Eta: 1 day, 11:38:33 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 21:15:45,630 - Train: 21.01% [78850/375300] [63.0/300.0] [batch_t 0.527 (0.528)] [data_t 0.015] [optim_t 0.512] [lr 0.002688] [CE 3.883 (3.855)] [KD 0.000 (0.000)] 2024-10-11 21:16:08,582 - Train: 21.02% [78900/375300] [63.1/300.0] [batch_t 0.432 (0.459)] [data_t 0.016] [optim_t 0.417] [lr 0.002688] [CE 3.540 (3.839)] [KD 0.000 (0.000)] 2024-10-11 21:16:29,855 - Train: 21.04% [78950/375300] [63.1/300.0] [batch_t 0.339 (0.425)] [data_t 0.015] [optim_t 0.324] [lr 0.002687] [CE 3.937 (3.801)] [KD 0.000 (0.000)] 2024-10-11 21:16:51,431 - Train: 21.05% [79000/375300] [63.1/300.0] [batch_t 0.314 (0.431)] [data_t 0.015] [optim_t 0.299] [lr 0.002687] [CE 3.834 (3.826)] [KD 0.000 (0.000)] 2024-10-11 21:17:12,803 - Train: 21.06% [79050/375300] [63.2/300.0] [batch_t 0.425 (0.427)] [data_t 0.015] [optim_t 0.410] [lr 0.002687] [CE 3.702 (3.778)] [KD 0.000 (0.000)] 2024-10-11 21:17:34,242 - Train: 21.08% [79100/375300] [63.2/300.0] [batch_t 0.424 (0.429)] [data_t 0.016] [optim_t 0.408] [lr 0.002686] [CE 3.483 (3.774)] [KD 0.000 (0.000)] 2024-10-11 21:17:55,660 - Train: 21.09% [79150/375300] [63.3/300.0] [batch_t 0.460 (0.428)] [data_t 0.016] [optim_t 0.444] [lr 0.002686] [CE 4.043 (3.750)] [KD 0.000 (0.000)] 2024-10-11 21:18:18,195 - Train: 21.10% [79200/375300] [63.3/300.0] [batch_t 0.445 (0.451)] [data_t 0.015] [optim_t 0.429] [lr 0.002685] [CE 3.901 (3.828)] [KD 0.000 (0.000)] 2024-10-11 21:18:39,084 - Train: 21.12% [79250/375300] [63.3/300.0] [batch_t 0.386 (0.418)] [data_t 0.016] [optim_t 0.371] [lr 0.002685] [CE 3.784 (3.800)] [KD 0.000 (0.000)] 2024-10-11 21:18:59,848 - Train: 21.13% [79300/375300] [63.4/300.0] [batch_t 0.384 (0.415)] [data_t 0.015] [optim_t 0.369] [lr 0.002685] [CE 3.850 (3.780)] [KD 0.000 (0.000)] 2024-10-11 21:19:21,623 - Train: 21.14% [79350/375300] [63.4/300.0] [batch_t 0.439 (0.435)] [data_t 0.016] [optim_t 0.424] [lr 0.002684] [CE 4.009 (3.848)] [KD 0.000 (0.000)] 2024-10-11 21:19:44,466 - Train: 21.16% [79400/375300] [63.5/300.0] [batch_t 0.364 (0.457)] [data_t 0.015] [optim_t 0.349] [lr 0.002684] [CE 4.013 (3.783)] [KD 0.000 (0.000)] 2024-10-11 21:20:06,886 - Train: 21.17% [79450/375300] [63.5/300.0] [batch_t 0.521 (0.448)] [data_t 0.015] [optim_t 0.506] [lr 0.002684] [CE 3.824 (3.851)] [KD 0.000 (0.000)] 2024-10-11 21:20:28,524 - Train: 21.18% [79500/375300] [63.5/300.0] [batch_t 0.461 (0.433)] [data_t 0.016] [optim_t 0.446] [lr 0.002683] [CE 3.822 (3.784)] [KD 0.000 (0.000)] 2024-10-11 21:20:50,106 - Train: 21.20% [79550/375300] [63.6/300.0] [batch_t 0.403 (0.432)] [data_t 0.016] [optim_t 0.388] [lr 0.002683] [CE 3.746 (3.790)] [KD 0.000 (0.000)] 2024-10-11 21:21:11,796 - Train: 21.21% [79600/375300] [63.6/300.0] [batch_t 0.482 (0.434)] [data_t 0.016] [optim_t 0.467] [lr 0.002682] [CE 3.781 (3.820)] [KD 0.000 (0.000)] 2024-10-11 21:21:33,124 - Train: 21.22% [79650/375300] [63.7/300.0] [batch_t 0.488 (0.426)] [data_t 0.015] [optim_t 0.473] [lr 0.002682] [CE 3.714 (3.836)] [KD 0.000 (0.000)] 2024-10-11 21:21:54,641 - Train: 21.24% [79700/375300] [63.7/300.0] [batch_t 0.427 (0.430)] [data_t 0.016] [optim_t 0.411] [lr 0.002682] [CE 3.933 (3.743)] [KD 0.000 (0.000)] 2024-10-11 21:22:15,772 - Train: 21.25% [79750/375300] [63.7/300.0] [batch_t 0.447 (0.423)] [data_t 0.016] [optim_t 0.431] [lr 0.002681] [CE 3.891 (3.826)] [KD 0.000 (0.000)] 2024-10-11 21:22:36,795 - Train: 21.26% [79800/375300] [63.8/300.0] [batch_t 0.452 (0.420)] [data_t 0.016] [optim_t 0.436] [lr 0.002681] [CE 3.689 (3.776)] [KD 0.000 (0.000)] 2024-10-11 21:22:58,532 - Train: 21.28% [79850/375300] [63.8/300.0] [batch_t 0.394 (0.435)] [data_t 0.015] [optim_t 0.378] [lr 0.002680] [CE 3.970 (3.798)] [KD 0.000 (0.000)] 2024-10-11 21:23:19,977 - Train: 21.29% [79900/375300] [63.9/300.0] [batch_t 0.411 (0.429)] [data_t 0.016] [optim_t 0.396] [lr 0.002680] [CE 4.324 (3.786)] [KD 0.000 (0.000)] 2024-10-11 21:23:41,255 - Train: 21.30% [79950/375300] [63.9/300.0] [batch_t 0.320 (0.425)] [data_t 0.015] [optim_t 0.305] [lr 0.002680] [CE 3.732 (3.841)] [KD 0.000 (0.000)] 2024-10-11 21:24:01,840 - Train: 21.32% [80000/375300] [63.9/300.0] [batch_t 0.490 (0.412)] [data_t 0.016] [optim_t 0.474] [lr 0.002679] [CE 3.634 (3.818)] [KD 0.000 (0.000)] 2024-10-11 21:24:22,830 - Train: 21.33% [80050/375300] [64.0/300.0] [batch_t 0.403 (0.420)] [data_t 0.015] [optim_t 0.388] [lr 0.002679] [CE 3.565 (3.765)] [KD 0.000 (0.000)] 2024-10-11 21:24:27,411 - ==> Total time: 9:37:31 Eta: 1 day, 11:29:36 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 21:24:47,407 - Train: 21.34% [80100/375300] [64.0/300.0] [batch_t 0.398 (0.516)] [data_t 0.016] [optim_t 0.383] [lr 0.002679] [CE 3.833 (3.780)] [KD 0.000 (0.000)] 2024-10-11 21:25:08,782 - Train: 21.36% [80150/375300] [64.1/300.0] [batch_t 0.483 (0.427)] [data_t 0.016] [optim_t 0.467] [lr 0.002678] [CE 3.999 (3.816)] [KD 0.000 (0.000)] 2024-10-11 21:25:30,721 - Train: 21.37% [80200/375300] [64.1/300.0] [batch_t 0.438 (0.439)] [data_t 0.015] [optim_t 0.423] [lr 0.002678] [CE 3.877 (3.775)] [KD 0.000 (0.000)] 2024-10-11 21:25:52,630 - Train: 21.38% [80250/375300] [64.1/300.0] [batch_t 0.422 (0.438)] [data_t 0.016] [optim_t 0.407] [lr 0.002677] [CE 3.847 (3.803)] [KD 0.000 (0.000)] 2024-10-11 21:26:14,252 - Train: 21.40% [80300/375300] [64.2/300.0] [batch_t 0.456 (0.432)] [data_t 0.016] [optim_t 0.441] [lr 0.002677] [CE 3.767 (3.791)] [KD 0.000 (0.000)] 2024-10-11 21:26:36,249 - Train: 21.41% [80350/375300] [64.2/300.0] [batch_t 0.478 (0.440)] [data_t 0.015] [optim_t 0.463] [lr 0.002677] [CE 3.905 (3.777)] [KD 0.000 (0.000)] 2024-10-11 21:26:58,157 - Train: 21.42% [80400/375300] [64.3/300.0] [batch_t 0.457 (0.438)] [data_t 0.015] [optim_t 0.442] [lr 0.002676] [CE 4.157 (3.838)] [KD 0.000 (0.000)] 2024-10-11 21:27:20,231 - Train: 21.44% [80450/375300] [64.3/300.0] [batch_t 0.441 (0.441)] [data_t 0.015] [optim_t 0.426] [lr 0.002676] [CE 4.206 (3.813)] [KD 0.000 (0.000)] 2024-10-11 21:27:41,961 - Train: 21.45% [80500/375300] [64.3/300.0] [batch_t 0.380 (0.434)] [data_t 0.016] [optim_t 0.365] [lr 0.002675] [CE 4.096 (3.804)] [KD 0.000 (0.000)] 2024-10-11 21:28:03,781 - Train: 21.46% [80550/375300] [64.4/300.0] [batch_t 0.431 (0.436)] [data_t 0.015] [optim_t 0.415] [lr 0.002675] [CE 3.938 (3.805)] [KD 0.000 (0.000)] 2024-10-11 21:28:25,083 - Train: 21.48% [80600/375300] [64.4/300.0] [batch_t 0.412 (0.426)] [data_t 0.015] [optim_t 0.397] [lr 0.002675] [CE 3.963 (3.787)] [KD 0.000 (0.000)] 2024-10-11 21:28:46,101 - Train: 21.49% [80650/375300] [64.5/300.0] [batch_t 0.383 (0.420)] [data_t 0.016] [optim_t 0.368] [lr 0.002674] [CE 3.835 (3.811)] [KD 0.000 (0.000)] 2024-10-11 21:29:07,668 - Train: 21.50% [80700/375300] [64.5/300.0] [batch_t 0.348 (0.431)] [data_t 0.016] [optim_t 0.332] [lr 0.002674] [CE 3.453 (3.765)] [KD 0.000 (0.000)] 2024-10-11 21:29:29,000 - Train: 21.52% [80750/375300] [64.5/300.0] [batch_t 0.450 (0.427)] [data_t 0.016] [optim_t 0.435] [lr 0.002673] [CE 3.897 (3.809)] [KD 0.000 (0.000)] 2024-10-11 21:29:51,080 - Train: 21.53% [80800/375300] [64.6/300.0] [batch_t 0.424 (0.441)] [data_t 0.016] [optim_t 0.408] [lr 0.002673] [CE 3.896 (3.817)] [KD 0.000 (0.000)] 2024-10-11 21:30:13,007 - Train: 21.54% [80850/375300] [64.6/300.0] [batch_t 0.558 (0.438)] [data_t 0.015] [optim_t 0.543] [lr 0.002673] [CE 3.963 (3.853)] [KD 0.000 (0.000)] 2024-10-11 21:30:34,859 - Train: 21.56% [80900/375300] [64.7/300.0] [batch_t 0.495 (0.437)] [data_t 0.016] [optim_t 0.479] [lr 0.002672] [CE 3.443 (3.798)] [KD 0.000 (0.000)] 2024-10-11 21:30:55,860 - Train: 21.57% [80950/375300] [64.7/300.0] [batch_t 0.435 (0.420)] [data_t 0.016] [optim_t 0.419] [lr 0.002672] [CE 3.820 (3.829)] [KD 0.000 (0.000)] 2024-10-11 21:31:17,995 - Train: 21.58% [81000/375300] [64.7/300.0] [batch_t 0.419 (0.443)] [data_t 0.016] [optim_t 0.403] [lr 0.002672] [CE 4.041 (3.789)] [KD 0.000 (0.000)] 2024-10-11 21:31:39,868 - Train: 21.60% [81050/375300] [64.8/300.0] [batch_t 0.428 (0.437)] [data_t 0.015] [optim_t 0.412] [lr 0.002671] [CE 3.948 (3.803)] [KD 0.000 (0.000)] 2024-10-11 21:32:01,636 - Train: 21.61% [81100/375300] [64.8/300.0] [batch_t 0.437 (0.435)] [data_t 0.016] [optim_t 0.422] [lr 0.002671] [CE 3.790 (3.797)] [KD 0.000 (0.000)] 2024-10-11 21:32:22,891 - Train: 21.62% [81150/375300] [64.9/300.0] [batch_t 0.465 (0.425)] [data_t 0.016] [optim_t 0.449] [lr 0.002670] [CE 3.940 (3.829)] [KD 0.000 (0.000)] 2024-10-11 21:32:44,148 - Train: 21.64% [81200/375300] [64.9/300.0] [batch_t 0.367 (0.425)] [data_t 0.015] [optim_t 0.352] [lr 0.002670] [CE 4.164 (3.779)] [KD 0.000 (0.000)] 2024-10-11 21:33:04,994 - Train: 21.65% [81250/375300] [64.9/300.0] [batch_t 0.400 (0.417)] [data_t 0.016] [optim_t 0.384] [lr 0.002670] [CE 3.545 (3.807)] [KD 0.000 (0.000)] 2024-10-11 21:33:27,381 - Train: 21.66% [81300/375300] [65.0/300.0] [batch_t 0.405 (0.448)] [data_t 0.027] [optim_t 0.378] [lr 0.002669] [CE 4.067 (3.856)] [KD 0.000 (0.000)] 2024-10-11 21:33:54,254 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.429)] [top1_cnt 34976] [top5_cnt 45156] [top_all 50000] 2024-10-11 21:33:54,255 - net: 69.952 (90.312) 2024-10-11 21:34:16,145 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.429)] [top1_cnt 38054] [top5_cnt 46680] [top_all 50000] 2024-10-11 21:34:16,145 - net_E: 76.108 (93.360) 2024-10-11 21:34:16,323 - Max [top1: 69.952 (epoch: 65)] [top1-ema: 76.108 (epoch: 65)] 2024-10-11 21:34:16,324 - ==> Total time: 9:47:20 Eta: 1 day, 11:23:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 21:34:38,110 - Train: 21.68% [81350/375300] [65.0/300.0] [batch_t 0.320 (0.415)] [data_t 0.017] [optim_t 0.303] [lr 0.002669] [CE 3.666 (3.822)] [KD 0.000 (0.000)] 2024-10-11 21:34:59,281 - Train: 21.69% [81400/375300] [65.1/300.0] [batch_t 0.428 (0.423)] [data_t 0.016] [optim_t 0.413] [lr 0.002668] [CE 3.994 (3.796)] [KD 0.000 (0.000)] 2024-10-11 21:35:22,647 - Train: 21.70% [81450/375300] [65.1/300.0] [batch_t 0.505 (0.467)] [data_t 0.015] [optim_t 0.489] [lr 0.002668] [CE 3.399 (3.777)] [KD 0.000 (0.000)] 2024-10-11 21:35:45,148 - Train: 21.72% [81500/375300] [65.1/300.0] [batch_t 0.468 (0.450)] [data_t 0.015] [optim_t 0.452] [lr 0.002668] [CE 4.013 (3.839)] [KD 0.000 (0.000)] 2024-10-11 21:36:07,327 - Train: 21.73% [81550/375300] [65.2/300.0] [batch_t 0.396 (0.443)] [data_t 0.015] [optim_t 0.381] [lr 0.002667] [CE 3.969 (3.832)] [KD 0.000 (0.000)] 2024-10-11 21:36:28,591 - Train: 21.74% [81600/375300] [65.2/300.0] [batch_t 0.364 (0.425)] [data_t 0.015] [optim_t 0.348] [lr 0.002667] [CE 3.947 (3.802)] [KD 0.000 (0.000)] 2024-10-11 21:36:49,372 - Train: 21.76% [81650/375300] [65.3/300.0] [batch_t 0.415 (0.415)] [data_t 0.016] [optim_t 0.400] [lr 0.002666] [CE 3.943 (3.784)] [KD 0.000 (0.000)] 2024-10-11 21:37:11,208 - Train: 21.77% [81700/375300] [65.3/300.0] [batch_t 0.450 (0.437)] [data_t 0.156] [optim_t 0.294] [lr 0.002666] [CE 4.269 (3.774)] [KD 0.000 (0.000)] 2024-10-11 21:37:33,009 - Train: 21.78% [81750/375300] [65.3/300.0] [batch_t 0.441 (0.436)] [data_t 0.015] [optim_t 0.426] [lr 0.002666] [CE 4.024 (3.839)] [KD 0.000 (0.000)] 2024-10-11 21:37:55,119 - Train: 21.80% [81800/375300] [65.4/300.0] [batch_t 0.506 (0.442)] [data_t 0.015] [optim_t 0.490] [lr 0.002665] [CE 4.008 (3.826)] [KD 0.000 (0.000)] 2024-10-11 21:38:16,903 - Train: 21.81% [81850/375300] [65.4/300.0] [batch_t 0.347 (0.436)] [data_t 0.016] [optim_t 0.332] [lr 0.002665] [CE 3.862 (3.834)] [KD 0.000 (0.000)] 2024-10-11 21:38:38,643 - Train: 21.82% [81900/375300] [65.5/300.0] [batch_t 0.427 (0.435)] [data_t 0.016] [optim_t 0.411] [lr 0.002664] [CE 3.798 (3.800)] [KD 0.000 (0.000)] 2024-10-11 21:39:00,640 - Train: 21.84% [81950/375300] [65.5/300.0] [batch_t 0.323 (0.440)] [data_t 0.017] [optim_t 0.307] [lr 0.002664] [CE 4.147 (3.831)] [KD 0.000 (0.000)] 2024-10-11 21:39:21,694 - Train: 21.85% [82000/375300] [65.5/300.0] [batch_t 0.321 (0.421)] [data_t 0.016] [optim_t 0.305] [lr 0.002664] [CE 3.772 (3.777)] [KD 0.000 (0.000)] 2024-10-11 21:39:43,654 - Train: 21.86% [82050/375300] [65.6/300.0] [batch_t 0.500 (0.439)] [data_t 0.016] [optim_t 0.483] [lr 0.002663] [CE 3.520 (3.794)] [KD 0.000 (0.000)] 2024-10-11 21:40:05,170 - Train: 21.88% [82100/375300] [65.6/300.0] [batch_t 0.433 (0.430)] [data_t 0.016] [optim_t 0.417] [lr 0.002663] [CE 3.931 (3.811)] [KD 0.000 (0.000)] 2024-10-11 21:40:27,003 - Train: 21.89% [82150/375300] [65.7/300.0] [batch_t 0.424 (0.436)] [data_t 0.016] [optim_t 0.408] [lr 0.002663] [CE 3.815 (3.834)] [KD 0.000 (0.000)] 2024-10-11 21:40:48,737 - Train: 21.90% [82200/375300] [65.7/300.0] [batch_t 0.387 (0.435)] [data_t 0.016] [optim_t 0.371] [lr 0.002662] [CE 3.718 (3.796)] [KD 0.000 (0.000)] 2024-10-11 21:41:10,792 - Train: 21.92% [82250/375300] [65.7/300.0] [batch_t 0.419 (0.441)] [data_t 0.016] [optim_t 0.404] [lr 0.002662] [CE 3.668 (3.783)] [KD 0.000 (0.000)] 2024-10-11 21:41:33,068 - Train: 21.93% [82300/375300] [65.8/300.0] [batch_t 0.445 (0.445)] [data_t 0.016] [optim_t 0.430] [lr 0.002661] [CE 3.853 (3.843)] [KD 0.000 (0.000)] 2024-10-11 21:41:54,907 - Train: 21.94% [82350/375300] [65.8/300.0] [batch_t 0.420 (0.437)] [data_t 0.016] [optim_t 0.404] [lr 0.002661] [CE 4.142 (3.803)] [KD 0.000 (0.000)] 2024-10-11 21:42:16,240 - Train: 21.96% [82400/375300] [65.9/300.0] [batch_t 0.446 (0.426)] [data_t 0.016] [optim_t 0.430] [lr 0.002661] [CE 4.005 (3.804)] [KD 0.000 (0.000)] 2024-10-11 21:42:37,491 - Train: 21.97% [82450/375300] [65.9/300.0] [batch_t 0.443 (0.425)] [data_t 0.016] [optim_t 0.427] [lr 0.002660] [CE 4.156 (3.789)] [KD 0.000 (0.000)] 2024-10-11 21:42:58,872 - Train: 21.98% [82500/375300] [65.9/300.0] [batch_t 0.320 (0.427)] [data_t 0.016] [optim_t 0.304] [lr 0.002660] [CE 3.534 (3.793)] [KD 0.000 (0.000)] 2024-10-11 21:43:20,059 - Train: 22.00% [82550/375300] [66.0/300.0] [batch_t 0.423 (0.424)] [data_t 0.017] [optim_t 0.406] [lr 0.002659] [CE 3.675 (3.806)] [KD 0.000 (0.000)] 2024-10-11 21:43:25,719 - ==> Total time: 9:56:29 Eta: 1 day, 11:14:50 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 21:43:44,193 - Train: 22.01% [82600/375300] [66.0/300.0] [batch_t 0.444 (0.479)] [data_t 0.047] [optim_t 0.397] [lr 0.002659] [CE 3.812 (3.748)] [KD 0.000 (0.000)] 2024-10-11 21:44:06,589 - Train: 22.02% [82650/375300] [66.1/300.0] [batch_t 0.322 (0.448)] [data_t 0.016] [optim_t 0.307] [lr 0.002659] [CE 3.533 (3.752)] [KD 0.000 (0.000)] 2024-10-11 21:44:29,337 - Train: 22.04% [82700/375300] [66.1/300.0] [batch_t 0.680 (0.455)] [data_t 0.016] [optim_t 0.665] [lr 0.002658] [CE 4.308 (3.741)] [KD 0.000 (0.000)] 2024-10-11 21:44:51,790 - Train: 22.05% [82750/375300] [66.1/300.0] [batch_t 0.408 (0.449)] [data_t 0.109] [optim_t 0.299] [lr 0.002658] [CE 4.344 (3.782)] [KD 0.000 (0.000)] 2024-10-11 21:45:13,559 - Train: 22.06% [82800/375300] [66.2/300.0] [batch_t 0.427 (0.435)] [data_t 0.015] [optim_t 0.412] [lr 0.002657] [CE 3.821 (3.809)] [KD 0.000 (0.000)] 2024-10-11 21:45:35,401 - Train: 22.08% [82850/375300] [66.2/300.0] [batch_t 0.447 (0.437)] [data_t 0.016] [optim_t 0.431] [lr 0.002657] [CE 3.863 (3.790)] [KD 0.000 (0.000)] 2024-10-11 21:45:57,525 - Train: 22.09% [82900/375300] [66.3/300.0] [batch_t 0.479 (0.442)] [data_t 0.016] [optim_t 0.463] [lr 0.002657] [CE 3.668 (3.845)] [KD 0.000 (0.000)] 2024-10-11 21:46:19,239 - Train: 22.10% [82950/375300] [66.3/300.0] [batch_t 0.438 (0.434)] [data_t 0.016] [optim_t 0.422] [lr 0.002656] [CE 3.146 (3.792)] [KD 0.000 (0.000)] 2024-10-11 21:46:40,794 - Train: 22.12% [83000/375300] [66.3/300.0] [batch_t 0.777 (0.431)] [data_t 0.481] [optim_t 0.295] [lr 0.002656] [CE 3.844 (3.794)] [KD 0.000 (0.000)] 2024-10-11 21:47:01,962 - Train: 22.13% [83050/375300] [66.4/300.0] [batch_t 0.440 (0.423)] [data_t 0.016] [optim_t 0.425] [lr 0.002655] [CE 3.787 (3.813)] [KD 0.000 (0.000)] 2024-10-11 21:47:24,041 - Train: 22.14% [83100/375300] [66.4/300.0] [batch_t 0.397 (0.441)] [data_t 0.015] [optim_t 0.381] [lr 0.002655] [CE 3.450 (3.747)] [KD 0.000 (0.000)] 2024-10-11 21:47:45,772 - Train: 22.16% [83150/375300] [66.5/300.0] [batch_t 0.457 (0.429)] [data_t 0.015] [optim_t 0.441] [lr 0.002655] [CE 3.670 (3.843)] [KD 0.000 (0.000)] 2024-10-11 21:48:07,337 - Train: 22.17% [83200/375300] [66.5/300.0] [batch_t 0.403 (0.431)] [data_t 0.016] [optim_t 0.387] [lr 0.002654] [CE 3.731 (3.749)] [KD 0.000 (0.000)] 2024-10-11 21:48:29,596 - Train: 22.18% [83250/375300] [66.5/300.0] [batch_t 0.474 (0.445)] [data_t 0.015] [optim_t 0.459] [lr 0.002654] [CE 3.734 (3.795)] [KD 0.000 (0.000)] 2024-10-11 21:48:51,084 - Train: 22.20% [83300/375300] [66.6/300.0] [batch_t 0.446 (0.430)] [data_t 0.015] [optim_t 0.430] [lr 0.002653] [CE 3.738 (3.783)] [KD 0.000 (0.000)] 2024-10-11 21:49:12,766 - Train: 22.21% [83350/375300] [66.6/300.0] [batch_t 0.316 (0.434)] [data_t 0.016] [optim_t 0.301] [lr 0.002653] [CE 3.856 (3.817)] [KD 0.000 (0.000)] 2024-10-11 21:49:34,455 - Train: 22.22% [83400/375300] [66.7/300.0] [batch_t 0.433 (0.434)] [data_t 0.016] [optim_t 0.418] [lr 0.002653] [CE 3.757 (3.821)] [KD 0.000 (0.000)] 2024-10-11 21:49:55,850 - Train: 22.24% [83450/375300] [66.7/300.0] [batch_t 0.373 (0.428)] [data_t 0.015] [optim_t 0.358] [lr 0.002652] [CE 3.661 (3.794)] [KD 0.000 (0.000)] 2024-10-11 21:50:18,073 - Train: 22.25% [83500/375300] [66.7/300.0] [batch_t 0.434 (0.444)] [data_t 0.016] [optim_t 0.418] [lr 0.002652] [CE 3.807 (3.777)] [KD 0.000 (0.000)] 2024-10-11 21:50:40,344 - Train: 22.26% [83550/375300] [66.8/300.0] [batch_t 0.383 (0.445)] [data_t 0.016] [optim_t 0.367] [lr 0.002651] [CE 3.957 (3.834)] [KD 0.000 (0.000)] 2024-10-11 21:51:02,525 - Train: 22.28% [83600/375300] [66.8/300.0] [batch_t 0.434 (0.443)] [data_t 0.016] [optim_t 0.419] [lr 0.002651] [CE 3.753 (3.812)] [KD 0.000 (0.000)] 2024-10-11 21:51:24,517 - Train: 22.29% [83650/375300] [66.9/300.0] [batch_t 0.466 (0.440)] [data_t 0.016] [optim_t 0.450] [lr 0.002651] [CE 3.657 (3.778)] [KD 0.000 (0.000)] 2024-10-11 21:51:46,172 - Train: 22.30% [83700/375300] [66.9/300.0] [batch_t 0.491 (0.433)] [data_t 0.015] [optim_t 0.475] [lr 0.002650] [CE 3.755 (3.874)] [KD 0.000 (0.000)] 2024-10-11 21:52:08,490 - Train: 22.32% [83750/375300] [66.9/300.0] [batch_t 0.450 (0.446)] [data_t 0.016] [optim_t 0.434] [lr 0.002650] [CE 3.847 (3.774)] [KD 0.000 (0.000)] 2024-10-11 21:52:30,282 - Train: 22.33% [83800/375300] [67.0/300.0] [batch_t 0.442 (0.436)] [data_t 0.015] [optim_t 0.427] [lr 0.002649] [CE 3.875 (3.809)] [KD 0.000 (0.000)] 2024-10-11 21:52:36,245 - ==> Total time: 10:05:40 Eta: 1 day, 11:06:17 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 21:52:55,214 - Train: 22.34% [83850/375300] [67.0/300.0] [batch_t 0.315 (0.528)] [data_t 0.016] [optim_t 0.299] [lr 0.002649] [CE 3.715 (3.796)] [KD 0.000 (0.000)] 2024-10-11 21:53:16,614 - Train: 22.36% [83900/375300] [67.1/300.0] [batch_t 0.468 (0.428)] [data_t 0.015] [optim_t 0.452] [lr 0.002649] [CE 3.920 (3.707)] [KD 0.000 (0.000)] 2024-10-11 21:53:39,295 - Train: 22.37% [83950/375300] [67.1/300.0] [batch_t 0.559 (0.454)] [data_t 0.016] [optim_t 0.544] [lr 0.002648] [CE 3.944 (3.804)] [KD 0.000 (0.000)] 2024-10-11 21:54:01,388 - Train: 22.38% [84000/375300] [67.1/300.0] [batch_t 0.423 (0.442)] [data_t 0.015] [optim_t 0.408] [lr 0.002648] [CE 3.982 (3.805)] [KD 0.000 (0.000)] 2024-10-11 21:54:23,914 - Train: 22.40% [84050/375300] [67.2/300.0] [batch_t 0.489 (0.450)] [data_t 0.015] [optim_t 0.473] [lr 0.002647] [CE 4.036 (3.855)] [KD 0.000 (0.000)] 2024-10-11 21:54:46,584 - Train: 22.41% [84100/375300] [67.2/300.0] [batch_t 0.449 (0.453)] [data_t 0.015] [optim_t 0.434] [lr 0.002647] [CE 3.750 (3.803)] [KD 0.000 (0.000)] 2024-10-11 21:55:09,382 - Train: 22.42% [84150/375300] [67.3/300.0] [batch_t 0.399 (0.456)] [data_t 0.015] [optim_t 0.384] [lr 0.002647] [CE 3.805 (3.800)] [KD 0.000 (0.000)] 2024-10-11 21:55:31,940 - Train: 22.44% [84200/375300] [67.3/300.0] [batch_t 0.364 (0.451)] [data_t 0.016] [optim_t 0.348] [lr 0.002646] [CE 3.967 (3.797)] [KD 0.000 (0.000)] 2024-10-11 21:55:54,832 - Train: 22.45% [84250/375300] [67.3/300.0] [batch_t 0.494 (0.458)] [data_t 0.015] [optim_t 0.478] [lr 0.002646] [CE 3.500 (3.747)] [KD 0.000 (0.000)] 2024-10-11 21:56:17,328 - Train: 22.46% [84300/375300] [67.4/300.0] [batch_t 0.483 (0.450)] [data_t 0.016] [optim_t 0.467] [lr 0.002645] [CE 4.095 (3.805)] [KD 0.000 (0.000)] 2024-10-11 21:56:40,141 - Train: 22.48% [84350/375300] [67.4/300.0] [batch_t 0.471 (0.456)] [data_t 0.015] [optim_t 0.456] [lr 0.002645] [CE 3.475 (3.766)] [KD 0.000 (0.000)] 2024-10-11 21:57:02,553 - Train: 22.49% [84400/375300] [67.5/300.0] [batch_t 0.417 (0.448)] [data_t 0.015] [optim_t 0.402] [lr 0.002645] [CE 4.032 (3.803)] [KD 0.000 (0.000)] 2024-10-11 21:57:24,181 - Train: 22.50% [84450/375300] [67.5/300.0] [batch_t 0.495 (0.432)] [data_t 0.016] [optim_t 0.479] [lr 0.002644] [CE 3.957 (3.760)] [KD 0.000 (0.000)] 2024-10-11 21:57:45,871 - Train: 22.52% [84500/375300] [67.5/300.0] [batch_t 0.541 (0.434)] [data_t 0.016] [optim_t 0.526] [lr 0.002644] [CE 4.023 (3.773)] [KD 0.000 (0.000)] 2024-10-11 21:58:08,652 - Train: 22.53% [84550/375300] [67.6/300.0] [batch_t 0.488 (0.455)] [data_t 0.016] [optim_t 0.472] [lr 0.002643] [CE 3.874 (3.793)] [KD 0.000 (0.000)] 2024-10-11 21:58:30,736 - Train: 22.54% [84600/375300] [67.6/300.0] [batch_t 0.500 (0.442)] [data_t 0.016] [optim_t 0.485] [lr 0.002643] [CE 4.065 (3.807)] [KD 0.000 (0.000)] 2024-10-11 21:58:52,923 - Train: 22.56% [84650/375300] [67.7/300.0] [batch_t 0.488 (0.444)] [data_t 0.016] [optim_t 0.473] [lr 0.002643] [CE 3.878 (3.818)] [KD 0.000 (0.000)] 2024-10-11 21:59:14,820 - Train: 22.57% [84700/375300] [67.7/300.0] [batch_t 0.434 (0.438)] [data_t 0.015] [optim_t 0.418] [lr 0.002642] [CE 3.753 (3.784)] [KD 0.000 (0.000)] 2024-10-11 21:59:37,192 - Train: 22.58% [84750/375300] [67.7/300.0] [batch_t 0.424 (0.447)] [data_t 0.015] [optim_t 0.409] [lr 0.002642] [CE 3.841 (3.803)] [KD 0.000 (0.000)] 2024-10-11 21:59:59,389 - Train: 22.60% [84800/375300] [67.8/300.0] [batch_t 0.465 (0.444)] [data_t 0.015] [optim_t 0.450] [lr 0.002641] [CE 3.949 (3.781)] [KD 0.000 (0.000)] 2024-10-11 22:00:21,527 - Train: 22.61% [84850/375300] [67.8/300.0] [batch_t 0.369 (0.443)] [data_t 0.016] [optim_t 0.353] [lr 0.002641] [CE 3.707 (3.802)] [KD 0.000 (0.000)] 2024-10-11 22:00:43,358 - Train: 22.62% [84900/375300] [67.9/300.0] [batch_t 0.428 (0.437)] [data_t 0.016] [optim_t 0.412] [lr 0.002641] [CE 3.833 (3.800)] [KD 0.000 (0.000)] 2024-10-11 22:01:04,377 - Train: 22.64% [84950/375300] [67.9/300.0] [batch_t 0.370 (0.420)] [data_t 0.016] [optim_t 0.355] [lr 0.002640] [CE 3.748 (3.799)] [KD 0.000 (0.000)] 2024-10-11 22:01:25,659 - Train: 22.65% [85000/375300] [67.9/300.0] [batch_t 0.454 (0.426)] [data_t 0.015] [optim_t 0.438] [lr 0.002640] [CE 3.730 (3.812)] [KD 0.000 (0.000)] 2024-10-11 22:01:48,115 - Train: 22.66% [85050/375300] [68.0/300.0] [batch_t 0.389 (0.449)] [data_t 0.015] [optim_t 0.374] [lr 0.002639] [CE 3.582 (3.808)] [KD 0.000 (0.000)] 2024-10-11 22:01:54,508 - ==> Total time: 10:14:58 Eta: 1 day, 10:58:08 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 22:02:13,352 - Train: 22.68% [85100/375300] [68.0/300.0] [batch_t 0.319 (0.532)] [data_t 0.015] [optim_t 0.303] [lr 0.002639] [CE 3.604 (3.786)] [KD 0.000 (0.000)] 2024-10-11 22:02:35,762 - Train: 22.69% [85150/375300] [68.1/300.0] [batch_t 0.453 (0.448)] [data_t 0.015] [optim_t 0.438] [lr 0.002638] [CE 3.629 (3.778)] [KD 0.000 (0.000)] 2024-10-11 22:02:57,973 - Train: 22.70% [85200/375300] [68.1/300.0] [batch_t 0.515 (0.444)] [data_t 0.016] [optim_t 0.499] [lr 0.002638] [CE 3.924 (3.737)] [KD 0.000 (0.000)] 2024-10-11 22:03:20,662 - Train: 22.72% [85250/375300] [68.1/300.0] [batch_t 0.551 (0.454)] [data_t 0.015] [optim_t 0.535] [lr 0.002638] [CE 3.476 (3.814)] [KD 0.000 (0.000)] 2024-10-11 22:03:42,841 - Train: 22.73% [85300/375300] [68.2/300.0] [batch_t 0.453 (0.443)] [data_t 0.016] [optim_t 0.438] [lr 0.002637] [CE 3.623 (3.772)] [KD 0.000 (0.000)] 2024-10-11 22:04:05,068 - Train: 22.74% [85350/375300] [68.2/300.0] [batch_t 0.438 (0.444)] [data_t 0.015] [optim_t 0.423] [lr 0.002637] [CE 4.185 (3.836)] [KD 0.000 (0.000)] 2024-10-11 22:04:26,910 - Train: 22.76% [85400/375300] [68.3/300.0] [batch_t 0.382 (0.437)] [data_t 0.016] [optim_t 0.366] [lr 0.002636] [CE 4.132 (3.818)] [KD 0.000 (0.000)] 2024-10-11 22:04:48,441 - Train: 22.77% [85450/375300] [68.3/300.0] [batch_t 0.497 (0.431)] [data_t 0.015] [optim_t 0.481] [lr 0.002636] [CE 3.592 (3.812)] [KD 0.000 (0.000)] 2024-10-11 22:05:10,015 - Train: 22.78% [85500/375300] [68.3/300.0] [batch_t 0.451 (0.431)] [data_t 0.016] [optim_t 0.435] [lr 0.002636] [CE 3.765 (3.783)] [KD 0.000 (0.000)] 2024-10-11 22:05:31,651 - Train: 22.80% [85550/375300] [68.4/300.0] [batch_t 0.527 (0.433)] [data_t 0.231] [optim_t 0.295] [lr 0.002635] [CE 3.712 (3.746)] [KD 0.000 (0.000)] 2024-10-11 22:05:54,575 - Train: 22.81% [85600/375300] [68.4/300.0] [batch_t 0.456 (0.458)] [data_t 0.157] [optim_t 0.299] [lr 0.002635] [CE 4.227 (3.834)] [KD 0.000 (0.000)] 2024-10-11 22:06:17,319 - Train: 22.82% [85650/375300] [68.5/300.0] [batch_t 0.467 (0.455)] [data_t 0.171] [optim_t 0.295] [lr 0.002634] [CE 4.026 (3.746)] [KD 0.000 (0.000)] 2024-10-11 22:06:39,948 - Train: 22.84% [85700/375300] [68.5/300.0] [batch_t 0.458 (0.452)] [data_t 0.167] [optim_t 0.291] [lr 0.002634] [CE 3.973 (3.768)] [KD 0.000 (0.000)] 2024-10-11 22:07:02,538 - Train: 22.85% [85750/375300] [68.5/300.0] [batch_t 0.317 (0.452)] [data_t 0.015] [optim_t 0.302] [lr 0.002634] [CE 3.559 (3.813)] [KD 0.000 (0.000)] 2024-10-11 22:07:25,259 - Train: 22.86% [85800/375300] [68.6/300.0] [batch_t 0.450 (0.454)] [data_t 0.156] [optim_t 0.295] [lr 0.002633] [CE 3.742 (3.794)] [KD 0.000 (0.000)] 2024-10-11 22:07:47,809 - Train: 22.88% [85850/375300] [68.6/300.0] [batch_t 0.437 (0.451)] [data_t 0.142] [optim_t 0.295] [lr 0.002633] [CE 4.098 (3.800)] [KD 0.000 (0.000)] 2024-10-11 22:08:09,006 - Train: 22.89% [85900/375300] [68.7/300.0] [batch_t 0.401 (0.424)] [data_t 0.105] [optim_t 0.296] [lr 0.002632] [CE 4.012 (3.786)] [KD 0.000 (0.000)] 2024-10-11 22:08:31,137 - Train: 22.90% [85950/375300] [68.7/300.0] [batch_t 0.437 (0.442)] [data_t 0.016] [optim_t 0.421] [lr 0.002632] [CE 4.073 (3.778)] [KD 0.000 (0.000)] 2024-10-11 22:08:53,120 - Train: 22.92% [86000/375300] [68.7/300.0] [batch_t 0.387 (0.440)] [data_t 0.015] [optim_t 0.372] [lr 0.002632] [CE 3.968 (3.745)] [KD 0.000 (0.000)] 2024-10-11 22:09:14,871 - Train: 22.93% [86050/375300] [68.8/300.0] [batch_t 0.389 (0.435)] [data_t 0.016] [optim_t 0.373] [lr 0.002631] [CE 3.733 (3.827)] [KD 0.000 (0.000)] 2024-10-11 22:09:36,714 - Train: 22.94% [86100/375300] [68.8/300.0] [batch_t 0.518 (0.437)] [data_t 0.015] [optim_t 0.503] [lr 0.002631] [CE 4.111 (3.831)] [KD 0.000 (0.000)] 2024-10-11 22:09:59,440 - Train: 22.95% [86150/375300] [68.9/300.0] [batch_t 0.569 (0.454)] [data_t 0.016] [optim_t 0.553] [lr 0.002630] [CE 3.633 (3.766)] [KD 0.000 (0.000)] 2024-10-11 22:10:21,122 - Train: 22.97% [86200/375300] [68.9/300.0] [batch_t 0.439 (0.434)] [data_t 0.016] [optim_t 0.423] [lr 0.002630] [CE 3.982 (3.821)] [KD 0.000 (0.000)] 2024-10-11 22:10:43,689 - Train: 22.98% [86250/375300] [68.9/300.0] [batch_t 0.421 (0.451)] [data_t 0.122] [optim_t 0.298] [lr 0.002629] [CE 3.534 (3.818)] [KD 0.000 (0.000)] 2024-10-11 22:11:06,327 - Train: 22.99% [86300/375300] [69.0/300.0] [batch_t 0.398 (0.453)] [data_t 0.099] [optim_t 0.299] [lr 0.002629] [CE 3.624 (3.793)] [KD 0.000 (0.000)] 2024-10-11 22:11:12,848 - ==> Total time: 10:24:16 Eta: 1 day, 10:49:58 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 22:11:30,858 - Train: 23.01% [86350/375300] [69.0/300.0] [batch_t 0.551 (0.528)] [data_t 0.197] [optim_t 0.354] [lr 0.002629] [CE 4.271 (3.842)] [KD 0.000 (0.000)] 2024-10-11 22:11:52,180 - Train: 23.02% [86400/375300] [69.1/300.0] [batch_t 0.490 (0.426)] [data_t 0.016] [optim_t 0.474] [lr 0.002628] [CE 3.976 (3.754)] [KD 0.000 (0.000)] 2024-10-11 22:12:14,736 - Train: 23.03% [86450/375300] [69.1/300.0] [batch_t 0.387 (0.451)] [data_t 0.015] [optim_t 0.372] [lr 0.002628] [CE 3.883 (3.782)] [KD 0.000 (0.000)] 2024-10-11 22:12:36,788 - Train: 23.05% [86500/375300] [69.1/300.0] [batch_t 0.441 (0.441)] [data_t 0.016] [optim_t 0.425] [lr 0.002627] [CE 3.567 (3.812)] [KD 0.000 (0.000)] 2024-10-11 22:12:58,185 - Train: 23.06% [86550/375300] [69.2/300.0] [batch_t 0.380 (0.428)] [data_t 0.015] [optim_t 0.365] [lr 0.002627] [CE 3.726 (3.791)] [KD 0.000 (0.000)] 2024-10-11 22:13:19,861 - Train: 23.07% [86600/375300] [69.2/300.0] [batch_t 0.411 (0.433)] [data_t 0.015] [optim_t 0.395] [lr 0.002627] [CE 3.820 (3.772)] [KD 0.000 (0.000)] 2024-10-11 22:13:41,889 - Train: 23.09% [86650/375300] [69.3/300.0] [batch_t 0.396 (0.440)] [data_t 0.015] [optim_t 0.380] [lr 0.002626] [CE 3.847 (3.798)] [KD 0.000 (0.000)] 2024-10-11 22:14:02,725 - Train: 23.10% [86700/375300] [69.3/300.0] [batch_t 0.416 (0.417)] [data_t 0.015] [optim_t 0.401] [lr 0.002626] [CE 4.025 (3.825)] [KD 0.000 (0.000)] 2024-10-11 22:14:24,906 - Train: 23.11% [86750/375300] [69.3/300.0] [batch_t 0.428 (0.444)] [data_t 0.016] [optim_t 0.412] [lr 0.002625] [CE 3.753 (3.786)] [KD 0.000 (0.000)] 2024-10-11 22:14:46,713 - Train: 23.13% [86800/375300] [69.4/300.0] [batch_t 0.453 (0.436)] [data_t 0.016] [optim_t 0.438] [lr 0.002625] [CE 3.775 (3.772)] [KD 0.000 (0.000)] 2024-10-11 22:15:08,693 - Train: 23.14% [86850/375300] [69.4/300.0] [batch_t 0.464 (0.439)] [data_t 0.015] [optim_t 0.449] [lr 0.002625] [CE 3.888 (3.794)] [KD 0.000 (0.000)] 2024-10-11 22:15:29,686 - Train: 23.15% [86900/375300] [69.5/300.0] [batch_t 0.434 (0.420)] [data_t 0.015] [optim_t 0.419] [lr 0.002624] [CE 3.799 (3.807)] [KD 0.000 (0.000)] 2024-10-11 22:15:51,351 - Train: 23.17% [86950/375300] [69.5/300.0] [batch_t 0.455 (0.433)] [data_t 0.015] [optim_t 0.440] [lr 0.002624] [CE 3.703 (3.761)] [KD 0.000 (0.000)] 2024-10-11 22:16:13,385 - Train: 23.18% [87000/375300] [69.5/300.0] [batch_t 0.493 (0.441)] [data_t 0.016] [optim_t 0.477] [lr 0.002623] [CE 3.736 (3.772)] [KD 0.000 (0.000)] 2024-10-11 22:16:34,809 - Train: 23.19% [87050/375300] [69.6/300.0] [batch_t 0.386 (0.428)] [data_t 0.016] [optim_t 0.370] [lr 0.002623] [CE 3.801 (3.814)] [KD 0.000 (0.000)] 2024-10-11 22:16:56,162 - Train: 23.21% [87100/375300] [69.6/300.0] [batch_t 0.410 (0.427)] [data_t 0.016] [optim_t 0.394] [lr 0.002622] [CE 3.715 (3.806)] [KD 0.000 (0.000)] 2024-10-11 22:17:17,763 - Train: 23.22% [87150/375300] [69.7/300.0] [batch_t 0.405 (0.432)] [data_t 0.016] [optim_t 0.389] [lr 0.002622] [CE 3.428 (3.764)] [KD 0.000 (0.000)] 2024-10-11 22:17:38,908 - Train: 23.23% [87200/375300] [69.7/300.0] [batch_t 0.499 (0.423)] [data_t 0.203] [optim_t 0.296] [lr 0.002622] [CE 4.003 (3.806)] [KD 0.000 (0.000)] 2024-10-11 22:18:00,339 - Train: 23.25% [87250/375300] [69.7/300.0] [batch_t 0.435 (0.429)] [data_t 0.141] [optim_t 0.294] [lr 0.002621] [CE 3.971 (3.787)] [KD 0.000 (0.000)] 2024-10-11 22:18:21,927 - Train: 23.26% [87300/375300] [69.8/300.0] [batch_t 0.380 (0.432)] [data_t 0.086] [optim_t 0.293] [lr 0.002621] [CE 3.942 (3.825)] [KD 0.000 (0.000)] 2024-10-11 22:18:44,095 - Train: 23.27% [87350/375300] [69.8/300.0] [batch_t 0.478 (0.443)] [data_t 0.182] [optim_t 0.296] [lr 0.002620] [CE 3.602 (3.805)] [KD 0.000 (0.000)] 2024-10-11 22:19:06,209 - Train: 23.29% [87400/375300] [69.9/300.0] [batch_t 0.397 (0.442)] [data_t 0.100] [optim_t 0.297] [lr 0.002620] [CE 3.989 (3.851)] [KD 0.000 (0.000)] 2024-10-11 22:19:28,248 - Train: 23.30% [87450/375300] [69.9/300.0] [batch_t 0.415 (0.441)] [data_t 0.117] [optim_t 0.298] [lr 0.002620] [CE 3.928 (3.827)] [KD 0.000 (0.000)] 2024-10-11 22:19:50,143 - Train: 23.31% [87500/375300] [69.9/300.0] [batch_t 0.379 (0.438)] [data_t 0.084] [optim_t 0.294] [lr 0.002619] [CE 4.039 (3.692)] [KD 0.000 (0.000)] 2024-10-11 22:20:12,191 - Train: 23.33% [87550/375300] [70.0/300.0] [batch_t 0.523 (0.441)] [data_t 0.227] [optim_t 0.296] [lr 0.002619] [CE 3.641 (3.745)] [KD 0.000 (0.000)] 2024-10-11 22:20:41,213 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.426)] [top1_cnt 35084] [top5_cnt 45085] [top_all 50000] 2024-10-11 22:20:41,213 - net: 70.168 (90.170) 2024-10-11 22:21:02,800 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.425)] [top1_cnt 38170] [top5_cnt 46762] [top_all 50000] 2024-10-11 22:21:02,800 - net_E: 76.340 (93.524) 2024-10-11 22:21:02,975 - Max [top1: 70.168 (epoch: 70)] [top1-ema: 76.340 (epoch: 70)] 2024-10-11 22:21:02,975 - ==> Total time: 10:34:06 Eta: 1 day, 10:43:31 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 22:21:24,790 - Train: 23.34% [87600/375300] [70.0/300.0] [batch_t 0.359 (0.436)] [data_t 0.063] [optim_t 0.296] [lr 0.002618] [CE 3.995 (3.804)] [KD 0.000 (0.000)] 2024-10-11 22:21:45,943 - Train: 23.35% [87650/375300] [70.1/300.0] [batch_t 0.441 (0.423)] [data_t 0.016] [optim_t 0.425] [lr 0.002618] [CE 3.701 (3.752)] [KD 0.000 (0.000)] 2024-10-11 22:22:08,590 - Train: 23.37% [87700/375300] [70.1/300.0] [batch_t 0.477 (0.453)] [data_t 0.015] [optim_t 0.461] [lr 0.002617] [CE 4.100 (3.774)] [KD 0.000 (0.000)] 2024-10-11 22:22:30,886 - Train: 23.38% [87750/375300] [70.1/300.0] [batch_t 0.447 (0.446)] [data_t 0.015] [optim_t 0.432] [lr 0.002617] [CE 4.159 (3.793)] [KD 0.000 (0.000)] 2024-10-11 22:22:52,718 - Train: 23.39% [87800/375300] [70.2/300.0] [batch_t 0.450 (0.437)] [data_t 0.015] [optim_t 0.434] [lr 0.002617] [CE 3.766 (3.766)] [KD 0.000 (0.000)] 2024-10-11 22:23:15,163 - Train: 23.41% [87850/375300] [70.2/300.0] [batch_t 0.317 (0.449)] [data_t 0.016] [optim_t 0.301] [lr 0.002616] [CE 3.623 (3.816)] [KD 0.000 (0.000)] 2024-10-11 22:23:35,852 - Train: 23.42% [87900/375300] [70.3/300.0] [batch_t 0.470 (0.414)] [data_t 0.015] [optim_t 0.454] [lr 0.002616] [CE 4.049 (3.809)] [KD 0.000 (0.000)] 2024-10-11 22:23:57,181 - Train: 23.43% [87950/375300] [70.3/300.0] [batch_t 0.442 (0.426)] [data_t 0.015] [optim_t 0.427] [lr 0.002615] [CE 3.855 (3.759)] [KD 0.000 (0.000)] 2024-10-11 22:24:19,216 - Train: 23.45% [88000/375300] [70.3/300.0] [batch_t 0.512 (0.441)] [data_t 0.016] [optim_t 0.497] [lr 0.002615] [CE 3.916 (3.812)] [KD 0.000 (0.000)] 2024-10-11 22:24:41,151 - Train: 23.46% [88050/375300] [70.4/300.0] [batch_t 0.388 (0.439)] [data_t 0.016] [optim_t 0.373] [lr 0.002615] [CE 3.765 (3.789)] [KD 0.000 (0.000)] 2024-10-11 22:25:02,598 - Train: 23.47% [88100/375300] [70.4/300.0] [batch_t 0.413 (0.429)] [data_t 0.015] [optim_t 0.398] [lr 0.002614] [CE 3.837 (3.805)] [KD 0.000 (0.000)] 2024-10-11 22:25:24,297 - Train: 23.49% [88150/375300] [70.5/300.0] [batch_t 0.429 (0.434)] [data_t 0.015] [optim_t 0.414] [lr 0.002614] [CE 4.042 (3.782)] [KD 0.000 (0.000)] 2024-10-11 22:25:46,338 - Train: 23.50% [88200/375300] [70.5/300.0] [batch_t 0.400 (0.441)] [data_t 0.016] [optim_t 0.384] [lr 0.002613] [CE 3.690 (3.766)] [KD 0.000 (0.000)] 2024-10-11 22:26:08,335 - Train: 23.51% [88250/375300] [70.5/300.0] [batch_t 0.460 (0.440)] [data_t 0.016] [optim_t 0.444] [lr 0.002613] [CE 3.816 (3.824)] [KD 0.000 (0.000)] 2024-10-11 22:26:30,013 - Train: 23.53% [88300/375300] [70.6/300.0] [batch_t 0.470 (0.433)] [data_t 0.016] [optim_t 0.454] [lr 0.002612] [CE 4.052 (3.809)] [KD 0.000 (0.000)] 2024-10-11 22:26:51,917 - Train: 23.54% [88350/375300] [70.6/300.0] [batch_t 0.439 (0.438)] [data_t 0.015] [optim_t 0.423] [lr 0.002612] [CE 4.117 (3.763)] [KD 0.000 (0.000)] 2024-10-11 22:27:13,837 - Train: 23.55% [88400/375300] [70.7/300.0] [batch_t 0.962 (0.438)] [data_t 0.015] [optim_t 0.947] [lr 0.002612] [CE 3.852 (3.774)] [KD 0.000 (0.000)] 2024-10-11 22:27:35,566 - Train: 23.57% [88450/375300] [70.7/300.0] [batch_t 0.432 (0.434)] [data_t 0.015] [optim_t 0.417] [lr 0.002611] [CE 4.017 (3.776)] [KD 0.000 (0.000)] 2024-10-11 22:27:56,827 - Train: 23.58% [88500/375300] [70.7/300.0] [batch_t 0.367 (0.425)] [data_t 0.016] [optim_t 0.351] [lr 0.002611] [CE 3.754 (3.797)] [KD 0.000 (0.000)] 2024-10-11 22:28:17,698 - Train: 23.59% [88550/375300] [70.8/300.0] [batch_t 0.434 (0.417)] [data_t 0.015] [optim_t 0.419] [lr 0.002610] [CE 3.837 (3.812)] [KD 0.000 (0.000)] 2024-10-11 22:28:38,411 - Train: 23.61% [88600/375300] [70.8/300.0] [batch_t 0.442 (0.414)] [data_t 0.016] [optim_t 0.427] [lr 0.002610] [CE 3.682 (3.761)] [KD 0.000 (0.000)] 2024-10-11 22:28:59,376 - Train: 23.62% [88650/375300] [70.9/300.0] [batch_t 0.443 (0.419)] [data_t 0.015] [optim_t 0.428] [lr 0.002610] [CE 3.642 (3.803)] [KD 0.000 (0.000)] 2024-10-11 22:29:21,186 - Train: 23.63% [88700/375300] [70.9/300.0] [batch_t 0.316 (0.436)] [data_t 0.016] [optim_t 0.300] [lr 0.002609] [CE 3.815 (3.787)] [KD 0.000 (0.000)] 2024-10-11 22:29:42,401 - Train: 23.65% [88750/375300] [70.9/300.0] [batch_t 0.385 (0.424)] [data_t 0.015] [optim_t 0.370] [lr 0.002609] [CE 3.767 (3.790)] [KD 0.000 (0.000)] 2024-10-11 22:30:04,313 - Train: 23.66% [88800/375300] [71.0/300.0] [batch_t 0.321 (0.438)] [data_t 0.015] [optim_t 0.305] [lr 0.002608] [CE 3.976 (3.793)] [KD 0.000 (0.000)] 2024-10-11 22:30:11,590 - ==> Total time: 10:43:15 Eta: 1 day, 10:34:44 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 22:30:28,887 - Train: 23.67% [88850/375300] [71.0/300.0] [batch_t 0.402 (0.543)] [data_t 0.112] [optim_t 0.290] [lr 0.002608] [CE 4.082 (3.780)] [KD 0.000 (0.000)] 2024-10-11 22:30:51,147 - Train: 23.69% [88900/375300] [71.1/300.0] [batch_t 0.455 (0.445)] [data_t 0.166] [optim_t 0.290] [lr 0.002607] [CE 3.901 (3.754)] [KD 0.000 (0.000)] 2024-10-11 22:31:13,040 - Train: 23.70% [88950/375300] [71.1/300.0] [batch_t 0.463 (0.438)] [data_t 0.024] [optim_t 0.439] [lr 0.002607] [CE 4.006 (3.789)] [KD 0.000 (0.000)] 2024-10-11 22:31:34,844 - Train: 23.71% [89000/375300] [71.1/300.0] [batch_t 0.482 (0.436)] [data_t 0.016] [optim_t 0.467] [lr 0.002607] [CE 3.483 (3.802)] [KD 0.000 (0.000)] 2024-10-11 22:31:56,736 - Train: 23.73% [89050/375300] [71.2/300.0] [batch_t 0.430 (0.438)] [data_t 0.015] [optim_t 0.414] [lr 0.002606] [CE 4.092 (3.791)] [KD 0.000 (0.000)] 2024-10-11 22:32:18,511 - Train: 23.74% [89100/375300] [71.2/300.0] [batch_t 0.407 (0.435)] [data_t 0.114] [optim_t 0.293] [lr 0.002606] [CE 3.866 (3.768)] [KD 0.000 (0.000)] 2024-10-11 22:32:40,657 - Train: 23.75% [89150/375300] [71.3/300.0] [batch_t 0.469 (0.443)] [data_t 0.015] [optim_t 0.454] [lr 0.002605] [CE 3.455 (3.775)] [KD 0.000 (0.000)] 2024-10-11 22:33:02,327 - Train: 23.77% [89200/375300] [71.3/300.0] [batch_t 0.437 (0.433)] [data_t 0.016] [optim_t 0.422] [lr 0.002605] [CE 3.683 (3.814)] [KD 0.000 (0.000)] 2024-10-11 22:33:24,713 - Train: 23.78% [89250/375300] [71.3/300.0] [batch_t 0.385 (0.448)] [data_t 0.015] [optim_t 0.370] [lr 0.002604] [CE 3.515 (3.753)] [KD 0.000 (0.000)] 2024-10-11 22:33:46,371 - Train: 23.79% [89300/375300] [71.4/300.0] [batch_t 0.357 (0.433)] [data_t 0.015] [optim_t 0.341] [lr 0.002604] [CE 3.747 (3.786)] [KD 0.000 (0.000)] 2024-10-11 22:34:07,787 - Train: 23.81% [89350/375300] [71.4/300.0] [batch_t 0.497 (0.428)] [data_t 0.015] [optim_t 0.481] [lr 0.002604] [CE 4.124 (3.805)] [KD 0.000 (0.000)] 2024-10-11 22:34:29,593 - Train: 23.82% [89400/375300] [71.5/300.0] [batch_t 0.437 (0.436)] [data_t 0.016] [optim_t 0.421] [lr 0.002603] [CE 3.480 (3.764)] [KD 0.000 (0.000)] 2024-10-11 22:34:51,474 - Train: 23.83% [89450/375300] [71.5/300.0] [batch_t 0.472 (0.438)] [data_t 0.016] [optim_t 0.456] [lr 0.002603] [CE 3.984 (3.765)] [KD 0.000 (0.000)] 2024-10-11 22:35:14,313 - Train: 23.85% [89500/375300] [71.5/300.0] [batch_t 0.482 (0.457)] [data_t 0.015] [optim_t 0.466] [lr 0.002602] [CE 4.135 (3.772)] [KD 0.000 (0.000)] 2024-10-11 22:35:37,020 - Train: 23.86% [89550/375300] [71.6/300.0] [batch_t 0.414 (0.454)] [data_t 0.015] [optim_t 0.399] [lr 0.002602] [CE 3.513 (3.813)] [KD 0.000 (0.000)] 2024-10-11 22:35:58,626 - Train: 23.87% [89600/375300] [71.6/300.0] [batch_t 0.409 (0.432)] [data_t 0.016] [optim_t 0.394] [lr 0.002602] [CE 3.916 (3.806)] [KD 0.000 (0.000)] 2024-10-11 22:36:19,482 - Train: 23.89% [89650/375300] [71.7/300.0] [batch_t 0.440 (0.417)] [data_t 0.016] [optim_t 0.425] [lr 0.002601] [CE 3.730 (3.750)] [KD 0.000 (0.000)] 2024-10-11 22:36:40,672 - Train: 23.90% [89700/375300] [71.7/300.0] [batch_t 0.467 (0.424)] [data_t 0.016] [optim_t 0.451] [lr 0.002601] [CE 4.029 (3.788)] [KD 0.000 (0.000)] 2024-10-11 22:37:02,231 - Train: 23.91% [89750/375300] [71.7/300.0] [batch_t 0.433 (0.431)] [data_t 0.015] [optim_t 0.417] [lr 0.002600] [CE 3.914 (3.802)] [KD 0.000 (0.000)] 2024-10-11 22:37:24,062 - Train: 23.93% [89800/375300] [71.8/300.0] [batch_t 0.435 (0.437)] [data_t 0.015] [optim_t 0.419] [lr 0.002600] [CE 3.731 (3.767)] [KD 0.000 (0.000)] 2024-10-11 22:37:45,615 - Train: 23.94% [89850/375300] [71.8/300.0] [batch_t 0.487 (0.431)] [data_t 0.016] [optim_t 0.472] [lr 0.002599] [CE 3.963 (3.807)] [KD 0.000 (0.000)] 2024-10-11 22:38:07,739 - Train: 23.95% [89900/375300] [71.9/300.0] [batch_t 0.391 (0.442)] [data_t 0.095] [optim_t 0.295] [lr 0.002599] [CE 4.076 (3.809)] [KD 0.000 (0.000)] 2024-10-11 22:38:29,830 - Train: 23.97% [89950/375300] [71.9/300.0] [batch_t 0.469 (0.442)] [data_t 0.170] [optim_t 0.299] [lr 0.002599] [CE 3.703 (3.771)] [KD 0.000 (0.000)] 2024-10-11 22:38:51,836 - Train: 23.98% [90000/375300] [71.9/300.0] [batch_t 0.407 (0.440)] [data_t 0.114] [optim_t 0.293] [lr 0.002598] [CE 3.731 (3.790)] [KD 0.000 (0.000)] 2024-10-11 22:39:13,678 - Train: 23.99% [90050/375300] [72.0/300.0] [batch_t 0.509 (0.437)] [data_t 0.215] [optim_t 0.294] [lr 0.002598] [CE 4.018 (3.784)] [KD 0.000 (0.000)] 2024-10-11 22:39:21,886 - ==> Total time: 10:52:25 Eta: 1 day, 10:26:01 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 22:39:38,793 - Train: 24.01% [90100/375300] [72.0/300.0] [batch_t 0.539 (0.554)] [data_t 0.015] [optim_t 0.523] [lr 0.002597] [CE 3.890 (3.791)] [KD 0.000 (0.000)] 2024-10-11 22:40:01,112 - Train: 24.02% [90150/375300] [72.1/300.0] [batch_t 0.422 (0.446)] [data_t 0.016] [optim_t 0.407] [lr 0.002597] [CE 4.030 (3.796)] [KD 0.000 (0.000)] 2024-10-11 22:40:23,521 - Train: 24.03% [90200/375300] [72.1/300.0] [batch_t 0.468 (0.448)] [data_t 0.015] [optim_t 0.452] [lr 0.002596] [CE 3.741 (3.801)] [KD 0.000 (0.000)] 2024-10-11 22:40:45,836 - Train: 24.05% [90250/375300] [72.1/300.0] [batch_t 0.461 (0.446)] [data_t 0.015] [optim_t 0.446] [lr 0.002596] [CE 3.532 (3.795)] [KD 0.000 (0.000)] 2024-10-11 22:41:08,276 - Train: 24.06% [90300/375300] [72.2/300.0] [batch_t 0.380 (0.449)] [data_t 0.016] [optim_t 0.364] [lr 0.002596] [CE 3.573 (3.724)] [KD 0.000 (0.000)] 2024-10-11 22:41:30,574 - Train: 24.07% [90350/375300] [72.2/300.0] [batch_t 0.388 (0.446)] [data_t 0.015] [optim_t 0.372] [lr 0.002595] [CE 4.020 (3.796)] [KD 0.000 (0.000)] 2024-10-11 22:41:53,029 - Train: 24.09% [90400/375300] [72.3/300.0] [batch_t 0.430 (0.449)] [data_t 0.015] [optim_t 0.415] [lr 0.002595] [CE 4.262 (3.798)] [KD 0.000 (0.000)] 2024-10-11 22:42:15,499 - Train: 24.10% [90450/375300] [72.3/300.0] [batch_t 0.435 (0.449)] [data_t 0.016] [optim_t 0.420] [lr 0.002594] [CE 3.865 (3.747)] [KD 0.000 (0.000)] 2024-10-11 22:42:37,779 - Train: 24.11% [90500/375300] [72.3/300.0] [batch_t 0.465 (0.445)] [data_t 0.015] [optim_t 0.449] [lr 0.002594] [CE 3.786 (3.745)] [KD 0.000 (0.000)] 2024-10-11 22:43:00,309 - Train: 24.13% [90550/375300] [72.4/300.0] [batch_t 0.417 (0.451)] [data_t 0.015] [optim_t 0.402] [lr 0.002593] [CE 3.909 (3.804)] [KD 0.000 (0.000)] 2024-10-11 22:43:22,451 - Train: 24.14% [90600/375300] [72.4/300.0] [batch_t 0.458 (0.443)] [data_t 0.015] [optim_t 0.443] [lr 0.002593] [CE 3.894 (3.795)] [KD 0.000 (0.000)] 2024-10-11 22:43:44,752 - Train: 24.15% [90650/375300] [72.5/300.0] [batch_t 0.486 (0.446)] [data_t 0.015] [optim_t 0.470] [lr 0.002593] [CE 3.940 (3.763)] [KD 0.000 (0.000)] 2024-10-11 22:44:07,016 - Train: 24.17% [90700/375300] [72.5/300.0] [batch_t 0.540 (0.445)] [data_t 0.016] [optim_t 0.524] [lr 0.002592] [CE 3.784 (3.762)] [KD 0.000 (0.000)] 2024-10-11 22:44:28,840 - Train: 24.18% [90750/375300] [72.5/300.0] [batch_t 0.464 (0.436)] [data_t 0.016] [optim_t 0.449] [lr 0.002592] [CE 3.743 (3.724)] [KD 0.000 (0.000)] 2024-10-11 22:44:50,223 - Train: 24.19% [90800/375300] [72.6/300.0] [batch_t 0.449 (0.428)] [data_t 0.016] [optim_t 0.433] [lr 0.002591] [CE 3.932 (3.791)] [KD 0.000 (0.000)] 2024-10-11 22:45:11,103 - Train: 24.21% [90850/375300] [72.6/300.0] [batch_t 0.404 (0.418)] [data_t 0.015] [optim_t 0.389] [lr 0.002591] [CE 3.709 (3.787)] [KD 0.000 (0.000)] 2024-10-11 22:45:33,718 - Train: 24.22% [90900/375300] [72.7/300.0] [batch_t 0.436 (0.452)] [data_t 0.015] [optim_t 0.421] [lr 0.002590] [CE 3.733 (3.801)] [KD 0.000 (0.000)] 2024-10-11 22:45:56,225 - Train: 24.23% [90950/375300] [72.7/300.0] [batch_t 0.407 (0.450)] [data_t 0.015] [optim_t 0.392] [lr 0.002590] [CE 3.540 (3.797)] [KD 0.000 (0.000)] 2024-10-11 22:46:17,965 - Train: 24.25% [91000/375300] [72.7/300.0] [batch_t 0.316 (0.435)] [data_t 0.015] [optim_t 0.300] [lr 0.002590] [CE 3.839 (3.799)] [KD 0.000 (0.000)] 2024-10-11 22:46:39,334 - Train: 24.26% [91050/375300] [72.8/300.0] [batch_t 0.430 (0.427)] [data_t 0.015] [optim_t 0.415] [lr 0.002589] [CE 3.565 (3.822)] [KD 0.000 (0.000)] 2024-10-11 22:47:01,035 - Train: 24.27% [91100/375300] [72.8/300.0] [batch_t 0.506 (0.434)] [data_t 0.015] [optim_t 0.491] [lr 0.002589] [CE 3.967 (3.748)] [KD 0.000 (0.000)] 2024-10-11 22:47:22,705 - Train: 24.29% [91150/375300] [72.9/300.0] [batch_t 0.376 (0.433)] [data_t 0.015] [optim_t 0.361] [lr 0.002588] [CE 3.588 (3.777)] [KD 0.000 (0.000)] 2024-10-11 22:47:44,865 - Train: 24.30% [91200/375300] [72.9/300.0] [batch_t 0.455 (0.443)] [data_t 0.015] [optim_t 0.439] [lr 0.002588] [CE 3.978 (3.795)] [KD 0.000 (0.000)] 2024-10-11 22:48:06,358 - Train: 24.31% [91250/375300] [72.9/300.0] [batch_t 0.444 (0.430)] [data_t 0.016] [optim_t 0.428] [lr 0.002587] [CE 3.777 (3.780)] [KD 0.000 (0.000)] 2024-10-11 22:48:27,435 - Train: 24.33% [91300/375300] [73.0/300.0] [batch_t 0.337 (0.421)] [data_t 0.015] [optim_t 0.322] [lr 0.002587] [CE 3.854 (3.819)] [KD 0.000 (0.000)] 2024-10-11 22:48:35,874 - ==> Total time: 11:01:39 Eta: 1 day, 10:17:30 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 22:48:52,291 - Train: 24.34% [91350/375300] [73.0/300.0] [batch_t 0.556 (0.556)] [data_t 0.016] [optim_t 0.540] [lr 0.002587] [CE 3.759 (3.732)] [KD 0.000 (0.000)] 2024-10-11 22:49:14,686 - Train: 24.35% [91400/375300] [73.1/300.0] [batch_t 0.538 (0.448)] [data_t 0.015] [optim_t 0.523] [lr 0.002586] [CE 3.718 (3.716)] [KD 0.000 (0.000)] 2024-10-11 22:49:36,994 - Train: 24.37% [91450/375300] [73.1/300.0] [batch_t 0.441 (0.446)] [data_t 0.015] [optim_t 0.425] [lr 0.002586] [CE 3.733 (3.781)] [KD 0.000 (0.000)] 2024-10-11 22:49:59,708 - Train: 24.38% [91500/375300] [73.1/300.0] [batch_t 0.410 (0.454)] [data_t 0.015] [optim_t 0.395] [lr 0.002585] [CE 3.855 (3.756)] [KD 0.000 (0.000)] 2024-10-11 22:50:22,337 - Train: 24.39% [91550/375300] [73.2/300.0] [batch_t 0.423 (0.452)] [data_t 0.015] [optim_t 0.408] [lr 0.002585] [CE 3.340 (3.772)] [KD 0.000 (0.000)] 2024-10-11 22:50:45,146 - Train: 24.41% [91600/375300] [73.2/300.0] [batch_t 0.441 (0.456)] [data_t 0.015] [optim_t 0.425] [lr 0.002584] [CE 3.780 (3.755)] [KD 0.000 (0.000)] 2024-10-11 22:51:07,313 - Train: 24.42% [91650/375300] [73.3/300.0] [batch_t 0.506 (0.443)] [data_t 0.015] [optim_t 0.491] [lr 0.002584] [CE 3.878 (3.771)] [KD 0.000 (0.000)] 2024-10-11 22:51:29,469 - Train: 24.43% [91700/375300] [73.3/300.0] [batch_t 0.491 (0.443)] [data_t 0.016] [optim_t 0.475] [lr 0.002584] [CE 3.695 (3.766)] [KD 0.000 (0.000)] 2024-10-11 22:51:51,692 - Train: 24.45% [91750/375300] [73.3/300.0] [batch_t 0.457 (0.444)] [data_t 0.016] [optim_t 0.441] [lr 0.002583] [CE 3.774 (3.749)] [KD 0.000 (0.000)] 2024-10-11 22:52:14,254 - Train: 24.46% [91800/375300] [73.4/300.0] [batch_t 0.497 (0.451)] [data_t 0.016] [optim_t 0.481] [lr 0.002583] [CE 3.820 (3.791)] [KD 0.000 (0.000)] 2024-10-11 22:52:36,755 - Train: 24.47% [91850/375300] [73.4/300.0] [batch_t 0.456 (0.450)] [data_t 0.015] [optim_t 0.440] [lr 0.002582] [CE 3.709 (3.807)] [KD 0.000 (0.000)] 2024-10-11 22:52:58,890 - Train: 24.49% [91900/375300] [73.5/300.0] [batch_t 0.438 (0.443)] [data_t 0.015] [optim_t 0.423] [lr 0.002582] [CE 3.657 (3.748)] [KD 0.000 (0.000)] 2024-10-11 22:53:19,920 - Train: 24.50% [91950/375300] [73.5/300.0] [batch_t 0.401 (0.420)] [data_t 0.016] [optim_t 0.386] [lr 0.002581] [CE 3.811 (3.795)] [KD 0.000 (0.000)] 2024-10-11 22:53:40,952 - Train: 24.51% [92000/375300] [73.5/300.0] [batch_t 0.440 (0.421)] [data_t 0.015] [optim_t 0.424] [lr 0.002581] [CE 3.743 (3.746)] [KD 0.000 (0.000)] 2024-10-11 22:54:02,970 - Train: 24.53% [92050/375300] [73.6/300.0] [batch_t 0.429 (0.440)] [data_t 0.015] [optim_t 0.413] [lr 0.002581] [CE 3.494 (3.757)] [KD 0.000 (0.000)] 2024-10-11 22:54:25,288 - Train: 24.54% [92100/375300] [73.6/300.0] [batch_t 0.443 (0.446)] [data_t 0.015] [optim_t 0.428] [lr 0.002580] [CE 3.595 (3.776)] [KD 0.000 (0.000)] 2024-10-11 22:54:47,304 - Train: 24.55% [92150/375300] [73.7/300.0] [batch_t 0.448 (0.440)] [data_t 0.015] [optim_t 0.432] [lr 0.002580] [CE 3.715 (3.782)] [KD 0.000 (0.000)] 2024-10-11 22:55:09,225 - Train: 24.57% [92200/375300] [73.7/300.0] [batch_t 0.469 (0.438)] [data_t 0.016] [optim_t 0.453] [lr 0.002579] [CE 3.904 (3.813)] [KD 0.000 (0.000)] 2024-10-11 22:55:31,553 - Train: 24.58% [92250/375300] [73.7/300.0] [batch_t 0.311 (0.446)] [data_t 0.016] [optim_t 0.296] [lr 0.002579] [CE 3.560 (3.814)] [KD 0.000 (0.000)] 2024-10-11 22:55:53,016 - Train: 24.59% [92300/375300] [73.8/300.0] [batch_t 0.443 (0.429)] [data_t 0.016] [optim_t 0.427] [lr 0.002578] [CE 3.896 (3.762)] [KD 0.000 (0.000)] 2024-10-11 22:56:15,076 - Train: 24.61% [92350/375300] [73.8/300.0] [batch_t 0.437 (0.441)] [data_t 0.015] [optim_t 0.422] [lr 0.002578] [CE 3.882 (3.790)] [KD 0.000 (0.000)] 2024-10-11 22:56:37,288 - Train: 24.62% [92400/375300] [73.9/300.0] [batch_t 0.461 (0.444)] [data_t 0.016] [optim_t 0.445] [lr 0.002578] [CE 3.762 (3.770)] [KD 0.000 (0.000)] 2024-10-11 22:56:59,218 - Train: 24.63% [92450/375300] [73.9/300.0] [batch_t 0.498 (0.438)] [data_t 0.015] [optim_t 0.483] [lr 0.002577] [CE 3.418 (3.781)] [KD 0.000 (0.000)] 2024-10-11 22:57:20,930 - Train: 24.65% [92500/375300] [73.9/300.0] [batch_t 0.407 (0.434)] [data_t 0.016] [optim_t 0.392] [lr 0.002577] [CE 3.767 (3.815)] [KD 0.000 (0.000)] 2024-10-11 22:57:42,289 - Train: 24.66% [92550/375300] [74.0/300.0] [batch_t 0.390 (0.427)] [data_t 0.015] [optim_t 0.374] [lr 0.002576] [CE 3.795 (3.772)] [KD 0.000 (0.000)] 2024-10-11 22:57:51,190 - ==> Total time: 11:10:55 Eta: 1 day, 10:09:01 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 22:58:06,759 - Train: 24.67% [92600/375300] [74.0/300.0] [batch_t 0.315 (0.540)] [data_t 0.016] [optim_t 0.300] [lr 0.002576] [CE 4.026 (3.754)] [KD 0.000 (0.000)] 2024-10-11 22:58:29,491 - Train: 24.69% [92650/375300] [74.1/300.0] [batch_t 0.371 (0.454)] [data_t 0.016] [optim_t 0.355] [lr 0.002575] [CE 3.658 (3.796)] [KD 0.000 (0.000)] 2024-10-11 22:58:51,747 - Train: 24.70% [92700/375300] [74.1/300.0] [batch_t 0.449 (0.445)] [data_t 0.016] [optim_t 0.434] [lr 0.002575] [CE 3.807 (3.780)] [KD 0.000 (0.000)] 2024-10-11 22:59:14,388 - Train: 24.71% [92750/375300] [74.1/300.0] [batch_t 0.475 (0.453)] [data_t 0.016] [optim_t 0.459] [lr 0.002574] [CE 3.622 (3.823)] [KD 0.000 (0.000)] 2024-10-11 22:59:36,397 - Train: 24.73% [92800/375300] [74.2/300.0] [batch_t 0.442 (0.440)] [data_t 0.015] [optim_t 0.427] [lr 0.002574] [CE 3.595 (3.801)] [KD 0.000 (0.000)] 2024-10-11 22:59:58,367 - Train: 24.74% [92850/375300] [74.2/300.0] [batch_t 0.437 (0.439)] [data_t 0.015] [optim_t 0.422] [lr 0.002574] [CE 3.440 (3.762)] [KD 0.000 (0.000)] 2024-10-11 23:00:20,910 - Train: 24.75% [92900/375300] [74.3/300.0] [batch_t 0.462 (0.451)] [data_t 0.015] [optim_t 0.447] [lr 0.002573] [CE 3.454 (3.777)] [KD 0.000 (0.000)] 2024-10-11 23:00:42,972 - Train: 24.77% [92950/375300] [74.3/300.0] [batch_t 0.462 (0.441)] [data_t 0.015] [optim_t 0.447] [lr 0.002573] [CE 3.508 (3.793)] [KD 0.000 (0.000)] 2024-10-11 23:01:04,732 - Train: 24.78% [93000/375300] [74.3/300.0] [batch_t 0.391 (0.435)] [data_t 0.015] [optim_t 0.375] [lr 0.002572] [CE 4.112 (3.791)] [KD 0.000 (0.000)] 2024-10-11 23:01:25,979 - Train: 24.79% [93050/375300] [74.4/300.0] [batch_t 0.471 (0.425)] [data_t 0.015] [optim_t 0.456] [lr 0.002572] [CE 4.011 (3.813)] [KD 0.000 (0.000)] 2024-10-11 23:01:46,613 - Train: 24.81% [93100/375300] [74.4/300.0] [batch_t 0.453 (0.413)] [data_t 0.015] [optim_t 0.438] [lr 0.002571] [CE 3.633 (3.763)] [KD 0.000 (0.000)] 2024-10-11 23:02:07,855 - Train: 24.82% [93150/375300] [74.5/300.0] [batch_t 0.438 (0.425)] [data_t 0.015] [optim_t 0.422] [lr 0.002571] [CE 3.929 (3.769)] [KD 0.000 (0.000)] 2024-10-11 23:02:29,070 - Train: 24.83% [93200/375300] [74.5/300.0] [batch_t 0.478 (0.424)] [data_t 0.015] [optim_t 0.463] [lr 0.002571] [CE 3.642 (3.777)] [KD 0.000 (0.000)] 2024-10-11 23:02:50,443 - Train: 24.85% [93250/375300] [74.5/300.0] [batch_t 0.420 (0.427)] [data_t 0.015] [optim_t 0.405] [lr 0.002570] [CE 3.861 (3.772)] [KD 0.000 (0.000)] 2024-10-11 23:03:12,591 - Train: 24.86% [93300/375300] [74.6/300.0] [batch_t 0.336 (0.443)] [data_t 0.015] [optim_t 0.321] [lr 0.002570] [CE 3.448 (3.777)] [KD 0.000 (0.000)] 2024-10-11 23:03:33,495 - Train: 24.87% [93350/375300] [74.6/300.0] [batch_t 0.439 (0.418)] [data_t 0.015] [optim_t 0.424] [lr 0.002569] [CE 3.555 (3.759)] [KD 0.000 (0.000)] 2024-10-11 23:03:54,661 - Train: 24.89% [93400/375300] [74.7/300.0] [batch_t 0.442 (0.423)] [data_t 0.016] [optim_t 0.427] [lr 0.002569] [CE 3.955 (3.799)] [KD 0.000 (0.000)] 2024-10-11 23:04:16,528 - Train: 24.90% [93450/375300] [74.7/300.0] [batch_t 0.470 (0.437)] [data_t 0.015] [optim_t 0.455] [lr 0.002568] [CE 3.792 (3.803)] [KD 0.000 (0.000)] 2024-10-11 23:04:38,515 - Train: 24.91% [93500/375300] [74.7/300.0] [batch_t 0.425 (0.440)] [data_t 0.015] [optim_t 0.410] [lr 0.002568] [CE 3.819 (3.774)] [KD 0.000 (0.000)] 2024-10-11 23:04:59,795 - Train: 24.93% [93550/375300] [74.8/300.0] [batch_t 0.405 (0.425)] [data_t 0.015] [optim_t 0.390] [lr 0.002567] [CE 3.297 (3.758)] [KD 0.000 (0.000)] 2024-10-11 23:05:20,912 - Train: 24.94% [93600/375300] [74.8/300.0] [batch_t 0.467 (0.422)] [data_t 0.015] [optim_t 0.451] [lr 0.002567] [CE 3.791 (3.733)] [KD 0.000 (0.000)] 2024-10-11 23:05:41,893 - Train: 24.95% [93650/375300] [74.9/300.0] [batch_t 0.388 (0.419)] [data_t 0.015] [optim_t 0.372] [lr 0.002567] [CE 3.617 (3.767)] [KD 0.000 (0.000)] 2024-10-11 23:06:03,311 - Train: 24.97% [93700/375300] [74.9/300.0] [batch_t 0.310 (0.428)] [data_t 0.015] [optim_t 0.294] [lr 0.002566] [CE 3.714 (3.755)] [KD 0.000 (0.000)] 2024-10-11 23:06:24,553 - Train: 24.98% [93750/375300] [74.9/300.0] [batch_t 0.481 (0.425)] [data_t 0.015] [optim_t 0.466] [lr 0.002566] [CE 3.625 (3.801)] [KD 0.000 (0.000)] 2024-10-11 23:06:46,244 - Train: 24.99% [93800/375300] [75.0/300.0] [batch_t 0.413 (0.434)] [data_t 0.015] [optim_t 0.398] [lr 0.002565] [CE 4.285 (3.734)] [KD 0.000 (0.000)] 2024-10-11 23:07:17,469 - Test (net): 100.00% [50/50] [batch_t 0.134 (0.437)] [top1_cnt 35589] [top5_cnt 45384] [top_all 50000] 2024-10-11 23:07:17,470 - net: 71.178 (90.768) 2024-10-11 23:07:39,774 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.439)] [top1_cnt 38252] [top5_cnt 46801] [top_all 50000] 2024-10-11 23:07:39,775 - net_E: 76.504 (93.602) 2024-10-11 23:07:39,951 - Max [top1: 71.178 (epoch: 75)] [top1-ema: 76.504 (epoch: 75)] 2024-10-11 23:07:39,952 - ==> Total time: 11:20:43 Eta: 1 day, 10:02:11 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 23:07:58,221 - Train: 25.01% [93850/375300] [75.0/300.0] [batch_t 0.315 (0.452)] [data_t 0.016] [optim_t 0.300] [lr 0.002565] [CE 3.650 (3.770)] [KD 0.000 (0.000)] 2024-10-11 23:08:18,694 - Train: 25.02% [93900/375300] [75.1/300.0] [batch_t 0.339 (0.409)] [data_t 0.045] [optim_t 0.294] [lr 0.002564] [CE 3.602 (3.776)] [KD 0.000 (0.000)] 2024-10-11 23:08:40,911 - Train: 25.03% [93950/375300] [75.1/300.0] [batch_t 0.426 (0.444)] [data_t 0.016] [optim_t 0.411] [lr 0.002564] [CE 3.733 (3.738)] [KD 0.000 (0.000)] 2024-10-11 23:09:03,405 - Train: 25.05% [94000/375300] [75.1/300.0] [batch_t 0.563 (0.450)] [data_t 0.015] [optim_t 0.547] [lr 0.002564] [CE 3.582 (3.751)] [KD 0.000 (0.000)] 2024-10-11 23:09:25,813 - Train: 25.06% [94050/375300] [75.2/300.0] [batch_t 0.442 (0.448)] [data_t 0.015] [optim_t 0.427] [lr 0.002563] [CE 3.914 (3.775)] [KD 0.000 (0.000)] 2024-10-11 23:09:48,277 - Train: 25.07% [94100/375300] [75.2/300.0] [batch_t 0.551 (0.449)] [data_t 0.016] [optim_t 0.535] [lr 0.002563] [CE 3.651 (3.772)] [KD 0.000 (0.000)] 2024-10-11 23:10:10,838 - Train: 25.09% [94150/375300] [75.3/300.0] [batch_t 0.423 (0.451)] [data_t 0.016] [optim_t 0.407] [lr 0.002562] [CE 4.055 (3.737)] [KD 0.000 (0.000)] 2024-10-11 23:10:32,323 - Train: 25.10% [94200/375300] [75.3/300.0] [batch_t 0.310 (0.430)] [data_t 0.016] [optim_t 0.294] [lr 0.002562] [CE 4.155 (3.737)] [KD 0.000 (0.000)] 2024-10-11 23:10:55,137 - Train: 25.11% [94250/375300] [75.3/300.0] [batch_t 0.415 (0.456)] [data_t 0.015] [optim_t 0.400] [lr 0.002561] [CE 3.575 (3.773)] [KD 0.000 (0.000)] 2024-10-11 23:11:17,347 - Train: 25.13% [94300/375300] [75.4/300.0] [batch_t 0.524 (0.444)] [data_t 0.015] [optim_t 0.509] [lr 0.002561] [CE 3.936 (3.773)] [KD 0.000 (0.000)] 2024-10-11 23:11:38,785 - Train: 25.14% [94350/375300] [75.4/300.0] [batch_t 0.317 (0.429)] [data_t 0.015] [optim_t 0.301] [lr 0.002560] [CE 3.840 (3.760)] [KD 0.000 (0.000)] 2024-10-11 23:12:00,949 - Train: 25.15% [94400/375300] [75.5/300.0] [batch_t 0.455 (0.443)] [data_t 0.015] [optim_t 0.440] [lr 0.002560] [CE 4.090 (3.761)] [KD 0.000 (0.000)] 2024-10-11 23:12:22,551 - Train: 25.17% [94450/375300] [75.5/300.0] [batch_t 0.393 (0.432)] [data_t 0.015] [optim_t 0.378] [lr 0.002560] [CE 3.865 (3.743)] [KD 0.000 (0.000)] 2024-10-11 23:12:44,654 - Train: 25.18% [94500/375300] [75.5/300.0] [batch_t 0.442 (0.442)] [data_t 0.015] [optim_t 0.426] [lr 0.002559] [CE 3.700 (3.744)] [KD 0.000 (0.000)] 2024-10-11 23:13:07,805 - Train: 25.19% [94550/375300] [75.6/300.0] [batch_t 0.486 (0.463)] [data_t 0.016] [optim_t 0.470] [lr 0.002559] [CE 3.844 (3.725)] [KD 0.000 (0.000)] 2024-10-11 23:13:29,698 - Train: 25.21% [94600/375300] [75.6/300.0] [batch_t 0.321 (0.438)] [data_t 0.016] [optim_t 0.305] [lr 0.002558] [CE 3.395 (3.780)] [KD 0.000 (0.000)] 2024-10-11 23:13:52,555 - Train: 25.22% [94650/375300] [75.7/300.0] [batch_t 0.394 (0.457)] [data_t 0.016] [optim_t 0.379] [lr 0.002558] [CE 3.609 (3.778)] [KD 0.000 (0.000)] 2024-10-11 23:14:13,749 - Train: 25.23% [94700/375300] [75.7/300.0] [batch_t 0.418 (0.424)] [data_t 0.015] [optim_t 0.403] [lr 0.002557] [CE 3.974 (3.821)] [KD 0.000 (0.000)] 2024-10-11 23:14:35,346 - Train: 25.25% [94750/375300] [75.7/300.0] [batch_t 0.409 (0.432)] [data_t 0.016] [optim_t 0.393] [lr 0.002557] [CE 3.404 (3.763)] [KD 0.000 (0.000)] 2024-10-11 23:14:56,544 - Train: 25.26% [94800/375300] [75.8/300.0] [batch_t 0.349 (0.424)] [data_t 0.016] [optim_t 0.333] [lr 0.002556] [CE 3.655 (3.767)] [KD 0.000 (0.000)] 2024-10-11 23:15:18,873 - Train: 25.27% [94850/375300] [75.8/300.0] [batch_t 0.494 (0.446)] [data_t 0.188] [optim_t 0.305] [lr 0.002556] [CE 3.476 (3.761)] [KD 0.000 (0.000)] 2024-10-11 23:15:40,860 - Train: 25.29% [94900/375300] [75.9/300.0] [batch_t 0.324 (0.440)] [data_t 0.026] [optim_t 0.298] [lr 0.002556] [CE 3.401 (3.719)] [KD 0.000 (0.000)] 2024-10-11 23:16:03,119 - Train: 25.30% [94950/375300] [75.9/300.0] [batch_t 0.370 (0.445)] [data_t 0.068] [optim_t 0.302] [lr 0.002555] [CE 4.023 (3.820)] [KD 0.000 (0.000)] 2024-10-11 23:16:24,508 - Train: 25.31% [95000/375300] [75.9/300.0] [batch_t 0.381 (0.428)] [data_t 0.083] [optim_t 0.298] [lr 0.002555] [CE 3.753 (3.762)] [KD 0.000 (0.000)] 2024-10-11 23:16:46,226 - Train: 25.33% [95050/375300] [76.0/300.0] [batch_t 0.407 (0.434)] [data_t 0.016] [optim_t 0.391] [lr 0.002554] [CE 3.454 (3.755)] [KD 0.000 (0.000)] 2024-10-11 23:16:55,853 - ==> Total time: 11:29:59 Eta: 1 day, 9:53:40 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 23:17:10,355 - Train: 25.34% [95100/375300] [76.0/300.0] [batch_t 0.322 (0.519)] [data_t 0.016] [optim_t 0.307] [lr 0.002554] [CE 3.792 (3.748)] [KD 0.000 (0.000)] 2024-10-11 23:17:33,141 - Train: 25.35% [95150/375300] [76.1/300.0] [batch_t 0.588 (0.456)] [data_t 0.016] [optim_t 0.573] [lr 0.002553] [CE 3.535 (3.727)] [KD 0.000 (0.000)] 2024-10-11 23:17:55,267 - Train: 25.37% [95200/375300] [76.1/300.0] [batch_t 0.419 (0.442)] [data_t 0.015] [optim_t 0.404] [lr 0.002553] [CE 3.700 (3.717)] [KD 0.000 (0.000)] 2024-10-11 23:18:17,208 - Train: 25.38% [95250/375300] [76.1/300.0] [batch_t 0.349 (0.439)] [data_t 0.016] [optim_t 0.333] [lr 0.002552] [CE 3.628 (3.764)] [KD 0.000 (0.000)] 2024-10-11 23:18:39,246 - Train: 25.39% [95300/375300] [76.2/300.0] [batch_t 0.391 (0.441)] [data_t 0.016] [optim_t 0.376] [lr 0.002552] [CE 3.431 (3.722)] [KD 0.000 (0.000)] 2024-10-11 23:19:00,992 - Train: 25.41% [95350/375300] [76.2/300.0] [batch_t 0.458 (0.435)] [data_t 0.015] [optim_t 0.442] [lr 0.002552] [CE 3.478 (3.796)] [KD 0.000 (0.000)] 2024-10-11 23:19:22,421 - Train: 25.42% [95400/375300] [76.3/300.0] [batch_t 0.452 (0.428)] [data_t 0.016] [optim_t 0.437] [lr 0.002551] [CE 3.937 (3.821)] [KD 0.000 (0.000)] 2024-10-11 23:19:44,059 - Train: 25.43% [95450/375300] [76.3/300.0] [batch_t 0.514 (0.433)] [data_t 0.015] [optim_t 0.498] [lr 0.002551] [CE 3.740 (3.714)] [KD 0.000 (0.000)] 2024-10-11 23:20:05,278 - Train: 25.45% [95500/375300] [76.3/300.0] [batch_t 0.469 (0.424)] [data_t 0.015] [optim_t 0.454] [lr 0.002550] [CE 3.720 (3.724)] [KD 0.000 (0.000)] 2024-10-11 23:20:26,519 - Train: 25.46% [95550/375300] [76.4/300.0] [batch_t 0.430 (0.425)] [data_t 0.015] [optim_t 0.414] [lr 0.002550] [CE 3.924 (3.740)] [KD 0.000 (0.000)] 2024-10-11 23:20:47,670 - Train: 25.47% [95600/375300] [76.4/300.0] [batch_t 0.423 (0.423)] [data_t 0.016] [optim_t 0.407] [lr 0.002549] [CE 3.767 (3.735)] [KD 0.000 (0.000)] 2024-10-11 23:21:09,356 - Train: 25.49% [95650/375300] [76.5/300.0] [batch_t 0.469 (0.434)] [data_t 0.016] [optim_t 0.454] [lr 0.002549] [CE 4.018 (3.716)] [KD 0.000 (0.000)] 2024-10-11 23:21:31,820 - Train: 25.50% [95700/375300] [76.5/300.0] [batch_t 0.312 (0.449)] [data_t 0.016] [optim_t 0.296] [lr 0.002548] [CE 4.345 (3.787)] [KD 0.000 (0.000)] 2024-10-11 23:21:54,229 - Train: 25.51% [95750/375300] [76.5/300.0] [batch_t 0.503 (0.448)] [data_t 0.015] [optim_t 0.487] [lr 0.002548] [CE 3.534 (3.752)] [KD 0.000 (0.000)] 2024-10-11 23:22:16,193 - Train: 25.53% [95800/375300] [76.6/300.0] [batch_t 0.452 (0.439)] [data_t 0.016] [optim_t 0.436] [lr 0.002548] [CE 3.942 (3.830)] [KD 0.000 (0.000)] 2024-10-11 23:22:38,645 - Train: 25.54% [95850/375300] [76.6/300.0] [batch_t 0.411 (0.449)] [data_t 0.015] [optim_t 0.395] [lr 0.002547] [CE 4.018 (3.777)] [KD 0.000 (0.000)] 2024-10-11 23:23:00,755 - Train: 25.55% [95900/375300] [76.7/300.0] [batch_t 0.508 (0.442)] [data_t 0.015] [optim_t 0.493] [lr 0.002547] [CE 3.754 (3.791)] [KD 0.000 (0.000)] 2024-10-11 23:23:22,613 - Train: 25.57% [95950/375300] [76.7/300.0] [batch_t 0.452 (0.437)] [data_t 0.015] [optim_t 0.436] [lr 0.002546] [CE 3.502 (3.753)] [KD 0.000 (0.000)] 2024-10-11 23:23:44,128 - Train: 25.58% [96000/375300] [76.7/300.0] [batch_t 0.533 (0.430)] [data_t 0.016] [optim_t 0.517] [lr 0.002546] [CE 3.846 (3.783)] [KD 0.000 (0.000)] 2024-10-11 23:24:06,113 - Train: 25.59% [96050/375300] [76.8/300.0] [batch_t 0.492 (0.440)] [data_t 0.015] [optim_t 0.476] [lr 0.002545] [CE 3.922 (3.796)] [KD 0.000 (0.000)] 2024-10-11 23:24:28,381 - Train: 25.61% [96100/375300] [76.8/300.0] [batch_t 0.451 (0.445)] [data_t 0.015] [optim_t 0.436] [lr 0.002545] [CE 3.853 (3.784)] [KD 0.000 (0.000)] 2024-10-11 23:24:50,631 - Train: 25.62% [96150/375300] [76.9/300.0] [batch_t 0.405 (0.445)] [data_t 0.016] [optim_t 0.390] [lr 0.002544] [CE 3.914 (3.796)] [KD 0.000 (0.000)] 2024-10-11 23:25:12,747 - Train: 25.63% [96200/375300] [76.9/300.0] [batch_t 0.527 (0.442)] [data_t 0.016] [optim_t 0.512] [lr 0.002544] [CE 3.848 (3.771)] [KD 0.000 (0.000)] 2024-10-11 23:25:34,398 - Train: 25.65% [96250/375300] [76.9/300.0] [batch_t 0.343 (0.433)] [data_t 0.015] [optim_t 0.327] [lr 0.002544] [CE 3.970 (3.750)] [KD 0.000 (0.000)] 2024-10-11 23:25:55,934 - Train: 25.66% [96300/375300] [77.0/300.0] [batch_t 0.477 (0.431)] [data_t 0.016] [optim_t 0.462] [lr 0.002543] [CE 3.403 (3.746)] [KD 0.000 (0.000)] 2024-10-11 23:26:06,057 - ==> Total time: 11:39:09 Eta: 1 day, 9:44:51 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 23:26:20,176 - Train: 25.67% [96350/375300] [77.0/300.0] [batch_t 0.585 (0.534)] [data_t 0.016] [optim_t 0.570] [lr 0.002543] [CE 3.717 (3.719)] [KD 0.000 (0.000)] 2024-10-11 23:26:41,606 - Train: 25.69% [96400/375300] [77.1/300.0] [batch_t 0.429 (0.428)] [data_t 0.132] [optim_t 0.297] [lr 0.002542] [CE 3.711 (3.749)] [KD 0.000 (0.000)] 2024-10-11 23:27:02,912 - Train: 25.70% [96450/375300] [77.1/300.0] [batch_t 0.316 (0.426)] [data_t 0.016] [optim_t 0.300] [lr 0.002542] [CE 3.533 (3.799)] [KD 0.000 (0.000)] 2024-10-11 23:27:24,378 - Train: 25.71% [96500/375300] [77.1/300.0] [batch_t 0.421 (0.429)] [data_t 0.016] [optim_t 0.406] [lr 0.002541] [CE 3.621 (3.760)] [KD 0.000 (0.000)] 2024-10-11 23:27:45,479 - Train: 25.73% [96550/375300] [77.2/300.0] [batch_t 0.314 (0.422)] [data_t 0.015] [optim_t 0.298] [lr 0.002541] [CE 3.805 (3.776)] [KD 0.000 (0.000)] 2024-10-11 23:28:07,118 - Train: 25.74% [96600/375300] [77.2/300.0] [batch_t 0.397 (0.433)] [data_t 0.015] [optim_t 0.382] [lr 0.002540] [CE 3.313 (3.726)] [KD 0.000 (0.000)] 2024-10-11 23:28:28,546 - Train: 25.75% [96650/375300] [77.3/300.0] [batch_t 0.425 (0.428)] [data_t 0.016] [optim_t 0.410] [lr 0.002540] [CE 3.896 (3.737)] [KD 0.000 (0.000)] 2024-10-11 23:28:50,776 - Train: 25.77% [96700/375300] [77.3/300.0] [batch_t 0.464 (0.444)] [data_t 0.016] [optim_t 0.449] [lr 0.002539] [CE 4.054 (3.720)] [KD 0.000 (0.000)] 2024-10-11 23:29:12,482 - Train: 25.78% [96750/375300] [77.3/300.0] [batch_t 0.397 (0.434)] [data_t 0.015] [optim_t 0.381] [lr 0.002539] [CE 3.980 (3.743)] [KD 0.000 (0.000)] 2024-10-11 23:29:34,441 - Train: 25.79% [96800/375300] [77.4/300.0] [batch_t 0.442 (0.439)] [data_t 0.016] [optim_t 0.426] [lr 0.002539] [CE 3.862 (3.793)] [KD 0.000 (0.000)] 2024-10-11 23:29:55,569 - Train: 25.81% [96850/375300] [77.4/300.0] [batch_t 0.402 (0.422)] [data_t 0.016] [optim_t 0.386] [lr 0.002538] [CE 3.612 (3.737)] [KD 0.000 (0.000)] 2024-10-11 23:30:16,829 - Train: 25.82% [96900/375300] [77.5/300.0] [batch_t 0.419 (0.425)] [data_t 0.016] [optim_t 0.404] [lr 0.002538] [CE 3.774 (3.772)] [KD 0.000 (0.000)] 2024-10-11 23:30:38,235 - Train: 25.83% [96950/375300] [77.5/300.0] [batch_t 0.443 (0.428)] [data_t 0.016] [optim_t 0.427] [lr 0.002537] [CE 3.535 (3.748)] [KD 0.000 (0.000)] 2024-10-11 23:30:59,473 - Train: 25.85% [97000/375300] [77.5/300.0] [batch_t 0.452 (0.425)] [data_t 0.016] [optim_t 0.436] [lr 0.002537] [CE 3.956 (3.723)] [KD 0.000 (0.000)] 2024-10-11 23:31:21,184 - Train: 25.86% [97050/375300] [77.6/300.0] [batch_t 0.443 (0.434)] [data_t 0.016] [optim_t 0.428] [lr 0.002536] [CE 3.837 (3.766)] [KD 0.000 (0.000)] 2024-10-11 23:31:43,340 - Train: 25.87% [97100/375300] [77.6/300.0] [batch_t 0.445 (0.443)] [data_t 0.015] [optim_t 0.429] [lr 0.002536] [CE 3.215 (3.765)] [KD 0.000 (0.000)] 2024-10-11 23:32:04,511 - Train: 25.89% [97150/375300] [77.7/300.0] [batch_t 0.372 (0.423)] [data_t 0.015] [optim_t 0.357] [lr 0.002535] [CE 3.785 (3.689)] [KD 0.000 (0.000)] 2024-10-11 23:32:26,097 - Train: 25.90% [97200/375300] [77.7/300.0] [batch_t 0.434 (0.432)] [data_t 0.016] [optim_t 0.419] [lr 0.002535] [CE 3.479 (3.776)] [KD 0.000 (0.000)] 2024-10-11 23:32:47,213 - Train: 25.91% [97250/375300] [77.7/300.0] [batch_t 0.317 (0.422)] [data_t 0.015] [optim_t 0.301] [lr 0.002535] [CE 3.861 (3.772)] [KD 0.000 (0.000)] 2024-10-11 23:33:08,495 - Train: 25.93% [97300/375300] [77.8/300.0] [batch_t 0.432 (0.426)] [data_t 0.015] [optim_t 0.416] [lr 0.002534] [CE 3.717 (3.746)] [KD 0.000 (0.000)] 2024-10-11 23:33:30,073 - Train: 25.94% [97350/375300] [77.8/300.0] [batch_t 0.445 (0.431)] [data_t 0.016] [optim_t 0.430] [lr 0.002534] [CE 3.822 (3.765)] [KD 0.000 (0.000)] 2024-10-11 23:33:52,479 - Train: 25.95% [97400/375300] [77.9/300.0] [batch_t 0.470 (0.448)] [data_t 0.016] [optim_t 0.454] [lr 0.002533] [CE 3.659 (3.800)] [KD 0.000 (0.000)] 2024-10-11 23:34:14,339 - Train: 25.97% [97450/375300] [77.9/300.0] [batch_t 0.389 (0.437)] [data_t 0.016] [optim_t 0.373] [lr 0.002533] [CE 3.777 (3.738)] [KD 0.000 (0.000)] 2024-10-11 23:34:35,819 - Train: 25.98% [97500/375300] [77.9/300.0] [batch_t 0.439 (0.429)] [data_t 0.016] [optim_t 0.424] [lr 0.002532] [CE 3.897 (3.772)] [KD 0.000 (0.000)] 2024-10-11 23:34:57,488 - Train: 25.99% [97550/375300] [78.0/300.0] [batch_t 0.416 (0.433)] [data_t 0.016] [optim_t 0.401] [lr 0.002532] [CE 3.949 (3.760)] [KD 0.000 (0.000)] 2024-10-11 23:35:08,058 - ==> Total time: 11:48:11 Eta: 1 day, 9:35:38 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 23:35:21,813 - Train: 26.01% [97600/375300] [78.0/300.0] [batch_t 0.319 (0.545)] [data_t 0.016] [optim_t 0.304] [lr 0.002531] [CE 3.733 (3.832)] [KD 0.000 (0.000)] 2024-10-11 23:35:42,924 - Train: 26.02% [97650/375300] [78.1/300.0] [batch_t 0.534 (0.422)] [data_t 0.098] [optim_t 0.436] [lr 0.002531] [CE 3.981 (3.748)] [KD 0.000 (0.000)] 2024-10-11 23:36:05,660 - Train: 26.03% [97700/375300] [78.1/300.0] [batch_t 0.483 (0.455)] [data_t 0.016] [optim_t 0.468] [lr 0.002530] [CE 3.616 (3.750)] [KD 0.000 (0.000)] 2024-10-11 23:36:27,977 - Train: 26.05% [97750/375300] [78.1/300.0] [batch_t 0.481 (0.446)] [data_t 0.015] [optim_t 0.466] [lr 0.002530] [CE 3.620 (3.749)] [KD 0.000 (0.000)] 2024-10-11 23:36:50,958 - Train: 26.06% [97800/375300] [78.2/300.0] [batch_t 0.420 (0.460)] [data_t 0.016] [optim_t 0.404] [lr 0.002530] [CE 4.170 (3.752)] [KD 0.000 (0.000)] 2024-10-11 23:37:13,443 - Train: 26.07% [97850/375300] [78.2/300.0] [batch_t 0.445 (0.450)] [data_t 0.015] [optim_t 0.430] [lr 0.002529] [CE 3.844 (3.735)] [KD 0.000 (0.000)] 2024-10-11 23:37:35,089 - Train: 26.09% [97900/375300] [78.3/300.0] [batch_t 0.418 (0.433)] [data_t 0.016] [optim_t 0.402] [lr 0.002529] [CE 3.576 (3.814)] [KD 0.000 (0.000)] 2024-10-11 23:37:57,469 - Train: 26.10% [97950/375300] [78.3/300.0] [batch_t 0.417 (0.447)] [data_t 0.016] [optim_t 0.401] [lr 0.002528] [CE 3.471 (3.737)] [KD 0.000 (0.000)] 2024-10-11 23:38:20,024 - Train: 26.11% [98000/375300] [78.3/300.0] [batch_t 0.516 (0.451)] [data_t 0.016] [optim_t 0.501] [lr 0.002528] [CE 4.164 (3.723)] [KD 0.000 (0.000)] 2024-10-11 23:38:41,729 - Train: 26.13% [98050/375300] [78.4/300.0] [batch_t 0.408 (0.434)] [data_t 0.016] [optim_t 0.393] [lr 0.002527] [CE 3.822 (3.734)] [KD 0.000 (0.000)] 2024-10-11 23:39:03,588 - Train: 26.14% [98100/375300] [78.4/300.0] [batch_t 0.418 (0.437)] [data_t 0.016] [optim_t 0.403] [lr 0.002527] [CE 3.685 (3.782)] [KD 0.000 (0.000)] 2024-10-11 23:39:25,235 - Train: 26.15% [98150/375300] [78.5/300.0] [batch_t 0.367 (0.433)] [data_t 0.016] [optim_t 0.351] [lr 0.002526] [CE 3.501 (3.753)] [KD 0.000 (0.000)] 2024-10-11 23:39:47,198 - Train: 26.17% [98200/375300] [78.5/300.0] [batch_t 0.447 (0.439)] [data_t 0.015] [optim_t 0.432] [lr 0.002526] [CE 3.610 (3.747)] [KD 0.000 (0.000)] 2024-10-11 23:40:09,779 - Train: 26.18% [98250/375300] [78.5/300.0] [batch_t 0.408 (0.451)] [data_t 0.016] [optim_t 0.392] [lr 0.002525] [CE 3.696 (3.753)] [KD 0.000 (0.000)] 2024-10-11 23:40:31,528 - Train: 26.19% [98300/375300] [78.6/300.0] [batch_t 0.440 (0.435)] [data_t 0.015] [optim_t 0.425] [lr 0.002525] [CE 4.048 (3.751)] [KD 0.000 (0.000)] 2024-10-11 23:40:53,362 - Train: 26.21% [98350/375300] [78.6/300.0] [batch_t 0.427 (0.437)] [data_t 0.015] [optim_t 0.411] [lr 0.002525] [CE 3.570 (3.806)] [KD 0.000 (0.000)] 2024-10-11 23:41:14,860 - Train: 26.22% [98400/375300] [78.7/300.0] [batch_t 0.403 (0.430)] [data_t 0.016] [optim_t 0.387] [lr 0.002524] [CE 3.697 (3.753)] [KD 0.000 (0.000)] 2024-10-11 23:41:36,970 - Train: 26.23% [98450/375300] [78.7/300.0] [batch_t 0.405 (0.442)] [data_t 0.016] [optim_t 0.390] [lr 0.002524] [CE 3.669 (3.739)] [KD 0.000 (0.000)] 2024-10-11 23:41:58,692 - Train: 26.25% [98500/375300] [78.7/300.0] [batch_t 0.409 (0.434)] [data_t 0.015] [optim_t 0.394] [lr 0.002523] [CE 3.660 (3.730)] [KD 0.000 (0.000)] 2024-10-11 23:42:19,670 - Train: 26.26% [98550/375300] [78.8/300.0] [batch_t 0.474 (0.419)] [data_t 0.015] [optim_t 0.459] [lr 0.002523] [CE 3.578 (3.826)] [KD 0.000 (0.000)] 2024-10-11 23:42:41,032 - Train: 26.27% [98600/375300] [78.8/300.0] [batch_t 0.453 (0.427)] [data_t 0.015] [optim_t 0.437] [lr 0.002522] [CE 3.708 (3.734)] [KD 0.000 (0.000)] 2024-10-11 23:43:02,888 - Train: 26.29% [98650/375300] [78.9/300.0] [batch_t 0.401 (0.437)] [data_t 0.016] [optim_t 0.386] [lr 0.002522] [CE 3.927 (3.797)] [KD 0.000 (0.000)] 2024-10-11 23:43:24,322 - Train: 26.30% [98700/375300] [78.9/300.0] [batch_t 0.379 (0.429)] [data_t 0.015] [optim_t 0.364] [lr 0.002521] [CE 3.870 (3.810)] [KD 0.000 (0.000)] 2024-10-11 23:43:46,099 - Train: 26.31% [98750/375300] [78.9/300.0] [batch_t 0.496 (0.435)] [data_t 0.015] [optim_t 0.481] [lr 0.002521] [CE 3.785 (3.696)] [KD 0.000 (0.000)] 2024-10-11 23:44:07,929 - Train: 26.33% [98800/375300] [79.0/300.0] [batch_t 0.445 (0.436)] [data_t 0.016] [optim_t 0.429] [lr 0.002520] [CE 4.040 (3.749)] [KD 0.000 (0.000)] 2024-10-11 23:44:18,958 - ==> Total time: 11:57:22 Eta: 1 day, 9:26:51 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 23:44:32,415 - Train: 26.34% [98850/375300] [79.0/300.0] [batch_t 0.320 (0.562)] [data_t 0.016] [optim_t 0.304] [lr 0.002520] [CE 3.633 (3.756)] [KD 0.000 (0.000)] 2024-10-11 23:44:54,802 - Train: 26.35% [98900/375300] [79.1/300.0] [batch_t 0.409 (0.448)] [data_t 0.016] [optim_t 0.393] [lr 0.002520] [CE 3.713 (3.745)] [KD 0.000 (0.000)] 2024-10-11 23:45:17,387 - Train: 26.37% [98950/375300] [79.1/300.0] [batch_t 0.488 (0.452)] [data_t 0.016] [optim_t 0.472] [lr 0.002519] [CE 3.963 (3.754)] [KD 0.000 (0.000)] 2024-10-11 23:45:39,431 - Train: 26.38% [99000/375300] [79.1/300.0] [batch_t 0.410 (0.441)] [data_t 0.016] [optim_t 0.394] [lr 0.002519] [CE 3.642 (3.734)] [KD 0.000 (0.000)] 2024-10-11 23:46:01,149 - Train: 26.39% [99050/375300] [79.2/300.0] [batch_t 0.428 (0.434)] [data_t 0.016] [optim_t 0.412] [lr 0.002518] [CE 3.916 (3.769)] [KD 0.000 (0.000)] 2024-10-11 23:46:22,956 - Train: 26.41% [99100/375300] [79.2/300.0] [batch_t 0.500 (0.436)] [data_t 0.016] [optim_t 0.485] [lr 0.002518] [CE 4.089 (3.748)] [KD 0.000 (0.000)] 2024-10-11 23:46:44,539 - Train: 26.42% [99150/375300] [79.3/300.0] [batch_t 0.404 (0.432)] [data_t 0.015] [optim_t 0.388] [lr 0.002517] [CE 3.684 (3.746)] [KD 0.000 (0.000)] 2024-10-11 23:47:05,296 - Train: 26.43% [99200/375300] [79.3/300.0] [batch_t 0.405 (0.415)] [data_t 0.016] [optim_t 0.390] [lr 0.002517] [CE 3.538 (3.771)] [KD 0.000 (0.000)] 2024-10-11 23:47:26,262 - Train: 26.45% [99250/375300] [79.3/300.0] [batch_t 0.410 (0.419)] [data_t 0.015] [optim_t 0.395] [lr 0.002516] [CE 3.477 (3.768)] [KD 0.000 (0.000)] 2024-10-11 23:47:48,324 - Train: 26.46% [99300/375300] [79.4/300.0] [batch_t 0.429 (0.441)] [data_t 0.015] [optim_t 0.413] [lr 0.002516] [CE 3.946 (3.749)] [KD 0.000 (0.000)] 2024-10-11 23:48:10,742 - Train: 26.47% [99350/375300] [79.4/300.0] [batch_t 0.374 (0.448)] [data_t 0.015] [optim_t 0.358] [lr 0.002515] [CE 3.643 (3.729)] [KD 0.000 (0.000)] 2024-10-11 23:48:33,170 - Train: 26.49% [99400/375300] [79.5/300.0] [batch_t 0.476 (0.448)] [data_t 0.016] [optim_t 0.460] [lr 0.002515] [CE 3.681 (3.740)] [KD 0.000 (0.000)] 2024-10-11 23:48:55,039 - Train: 26.50% [99450/375300] [79.5/300.0] [batch_t 0.393 (0.437)] [data_t 0.015] [optim_t 0.378] [lr 0.002514] [CE 3.188 (3.724)] [KD 0.000 (0.000)] 2024-10-11 23:49:16,538 - Train: 26.51% [99500/375300] [79.5/300.0] [batch_t 0.449 (0.430)] [data_t 0.015] [optim_t 0.434] [lr 0.002514] [CE 3.822 (3.768)] [KD 0.000 (0.000)] 2024-10-11 23:49:37,958 - Train: 26.53% [99550/375300] [79.6/300.0] [batch_t 0.417 (0.428)] [data_t 0.015] [optim_t 0.401] [lr 0.002514] [CE 3.800 (3.748)] [KD 0.000 (0.000)] 2024-10-11 23:49:58,884 - Train: 26.54% [99600/375300] [79.6/300.0] [batch_t 0.353 (0.418)] [data_t 0.015] [optim_t 0.338] [lr 0.002513] [CE 4.162 (3.775)] [KD 0.000 (0.000)] 2024-10-11 23:50:20,063 - Train: 26.55% [99650/375300] [79.7/300.0] [batch_t 0.403 (0.423)] [data_t 0.015] [optim_t 0.388] [lr 0.002513] [CE 3.822 (3.744)] [KD 0.000 (0.000)] 2024-10-11 23:50:41,292 - Train: 26.57% [99700/375300] [79.7/300.0] [batch_t 0.436 (0.424)] [data_t 0.016] [optim_t 0.420] [lr 0.002512] [CE 3.576 (3.751)] [KD 0.000 (0.000)] 2024-10-11 23:51:03,029 - Train: 26.58% [99750/375300] [79.7/300.0] [batch_t 0.427 (0.435)] [data_t 0.016] [optim_t 0.412] [lr 0.002512] [CE 3.847 (3.797)] [KD 0.000 (0.000)] 2024-10-11 23:51:24,475 - Train: 26.59% [99800/375300] [79.8/300.0] [batch_t 0.322 (0.429)] [data_t 0.015] [optim_t 0.306] [lr 0.002511] [CE 3.516 (3.714)] [KD 0.000 (0.000)] 2024-10-11 23:51:45,450 - Train: 26.61% [99850/375300] [79.8/300.0] [batch_t 0.321 (0.419)] [data_t 0.016] [optim_t 0.305] [lr 0.002511] [CE 3.446 (3.811)] [KD 0.000 (0.000)] 2024-10-11 23:52:06,944 - Train: 26.62% [99900/375300] [79.9/300.0] [batch_t 0.424 (0.430)] [data_t 0.016] [optim_t 0.408] [lr 0.002510] [CE 4.079 (3.808)] [KD 0.000 (0.000)] 2024-10-11 23:52:29,134 - Train: 26.63% [99950/375300] [79.9/300.0] [batch_t 0.499 (0.444)] [data_t 0.015] [optim_t 0.484] [lr 0.002510] [CE 4.016 (3.780)] [KD 0.000 (0.000)] 2024-10-11 23:52:51,646 - Train: 26.65% [100000/375300] [79.9/300.0] [batch_t 0.434 (0.450)] [data_t 0.015] [optim_t 0.418] [lr 0.002509] [CE 4.107 (3.751)] [KD 0.000 (0.000)] 2024-10-11 23:53:14,098 - Train: 26.66% [100050/375300] [80.0/300.0] [batch_t 0.437 (0.449)] [data_t 0.015] [optim_t 0.422] [lr 0.002509] [CE 3.749 (3.813)] [KD 0.000 (0.000)] 2024-10-11 23:53:48,169 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.444)] [top1_cnt 35614] [top5_cnt 45379] [top_all 50000] 2024-10-11 23:53:48,169 - net: 71.228 (90.758) 2024-10-11 23:54:10,297 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.435)] [top1_cnt 38441] [top5_cnt 46826] [top_all 50000] 2024-10-11 23:54:10,297 - net_E: 76.882 (93.652) 2024-10-11 23:54:10,461 - Max [top1: 71.228 (epoch: 80)] [top1-ema: 76.882 (epoch: 80)] 2024-10-11 23:54:10,461 - ==> Total time: 12:07:14 Eta: 1 day, 9:19:54 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-11 23:54:25,616 - Train: 26.67% [100100/375300] [80.0/300.0] [batch_t 0.324 (0.450)] [data_t 0.016] [optim_t 0.308] [lr 0.002508] [CE 3.826 (3.797)] [KD 0.000 (0.000)] 2024-10-11 23:54:46,399 - Train: 26.69% [100150/375300] [80.1/300.0] [batch_t 0.429 (0.416)] [data_t 0.132] [optim_t 0.297] [lr 0.002508] [CE 3.514 (3.714)] [KD 0.000 (0.000)] 2024-10-11 23:55:07,803 - Train: 26.70% [100200/375300] [80.1/300.0] [batch_t 0.473 (0.428)] [data_t 0.173] [optim_t 0.300] [lr 0.002508] [CE 3.679 (3.735)] [KD 0.000 (0.000)] 2024-10-11 23:55:29,829 - Train: 26.71% [100250/375300] [80.1/300.0] [batch_t 0.408 (0.440)] [data_t 0.015] [optim_t 0.392] [lr 0.002507] [CE 3.662 (3.733)] [KD 0.000 (0.000)] 2024-10-11 23:55:51,701 - Train: 26.73% [100300/375300] [80.2/300.0] [batch_t 0.409 (0.437)] [data_t 0.016] [optim_t 0.394] [lr 0.002507] [CE 4.069 (3.791)] [KD 0.000 (0.000)] 2024-10-11 23:56:13,525 - Train: 26.74% [100350/375300] [80.2/300.0] [batch_t 0.399 (0.436)] [data_t 0.016] [optim_t 0.384] [lr 0.002506] [CE 3.828 (3.772)] [KD 0.000 (0.000)] 2024-10-11 23:56:35,593 - Train: 26.75% [100400/375300] [80.3/300.0] [batch_t 0.510 (0.441)] [data_t 0.217] [optim_t 0.293] [lr 0.002506] [CE 3.445 (3.720)] [KD 0.000 (0.000)] 2024-10-11 23:56:57,641 - Train: 26.77% [100450/375300] [80.3/300.0] [batch_t 0.462 (0.441)] [data_t 0.167] [optim_t 0.295] [lr 0.002505] [CE 3.642 (3.773)] [KD 0.000 (0.000)] 2024-10-11 23:57:19,774 - Train: 26.78% [100500/375300] [80.3/300.0] [batch_t 0.426 (0.443)] [data_t 0.126] [optim_t 0.300] [lr 0.002505] [CE 3.842 (3.722)] [KD 0.000 (0.000)] 2024-10-11 23:57:41,092 - Train: 26.79% [100550/375300] [80.4/300.0] [batch_t 0.491 (0.426)] [data_t 0.099] [optim_t 0.392] [lr 0.002504] [CE 3.947 (3.759)] [KD 0.000 (0.000)] 2024-10-11 23:58:03,214 - Train: 26.81% [100600/375300] [80.4/300.0] [batch_t 0.414 (0.442)] [data_t 0.116] [optim_t 0.298] [lr 0.002504] [CE 3.706 (3.731)] [KD 0.000 (0.000)] 2024-10-11 23:58:24,827 - Train: 26.82% [100650/375300] [80.5/300.0] [batch_t 0.558 (0.432)] [data_t 0.259] [optim_t 0.299] [lr 0.002503] [CE 3.706 (3.793)] [KD 0.000 (0.000)] 2024-10-11 23:58:47,015 - Train: 26.83% [100700/375300] [80.5/300.0] [batch_t 0.456 (0.444)] [data_t 0.160] [optim_t 0.296] [lr 0.002503] [CE 3.708 (3.739)] [KD 0.000 (0.000)] 2024-10-11 23:59:09,494 - Train: 26.85% [100750/375300] [80.5/300.0] [batch_t 0.370 (0.449)] [data_t 0.016] [optim_t 0.354] [lr 0.002502] [CE 3.466 (3.724)] [KD 0.000 (0.000)] 2024-10-11 23:59:32,241 - Train: 26.86% [100800/375300] [80.6/300.0] [batch_t 0.534 (0.455)] [data_t 0.015] [optim_t 0.519] [lr 0.002502] [CE 3.441 (3.723)] [KD 0.000 (0.000)] 2024-10-11 23:59:53,948 - Train: 26.87% [100850/375300] [80.6/300.0] [batch_t 0.362 (0.434)] [data_t 0.016] [optim_t 0.347] [lr 0.002502] [CE 3.847 (3.715)] [KD 0.000 (0.000)] 2024-10-12 00:00:15,635 - Train: 26.89% [100900/375300] [80.7/300.0] [batch_t 0.423 (0.434)] [data_t 0.015] [optim_t 0.407] [lr 0.002501] [CE 3.715 (3.722)] [KD 0.000 (0.000)] 2024-10-12 00:00:37,628 - Train: 26.90% [100950/375300] [80.7/300.0] [batch_t 0.498 (0.440)] [data_t 0.205] [optim_t 0.293] [lr 0.002501] [CE 3.492 (3.763)] [KD 0.000 (0.000)] 2024-10-12 00:00:59,905 - Train: 26.91% [101000/375300] [80.7/300.0] [batch_t 0.421 (0.445)] [data_t 0.126] [optim_t 0.296] [lr 0.002500] [CE 3.589 (3.755)] [KD 0.000 (0.000)] 2024-10-12 00:01:21,785 - Train: 26.93% [101050/375300] [80.8/300.0] [batch_t 0.434 (0.437)] [data_t 0.139] [optim_t 0.295] [lr 0.002500] [CE 3.751 (3.756)] [KD 0.000 (0.000)] 2024-10-12 00:01:43,648 - Train: 26.94% [101100/375300] [80.8/300.0] [batch_t 0.458 (0.437)] [data_t 0.163] [optim_t 0.295] [lr 0.002499] [CE 3.575 (3.791)] [KD 0.000 (0.000)] 2024-10-12 00:02:05,439 - Train: 26.95% [101150/375300] [80.9/300.0] [batch_t 0.432 (0.436)] [data_t 0.135] [optim_t 0.297] [lr 0.002499] [CE 3.990 (3.773)] [KD 0.000 (0.000)] 2024-10-12 00:02:28,144 - Train: 26.97% [101200/375300] [80.9/300.0] [batch_t 0.317 (0.454)] [data_t 0.016] [optim_t 0.302] [lr 0.002498] [CE 3.652 (3.771)] [KD 0.000 (0.000)] 2024-10-12 00:02:50,259 - Train: 26.98% [101250/375300] [80.9/300.0] [batch_t 0.434 (0.442)] [data_t 0.137] [optim_t 0.298] [lr 0.002498] [CE 3.756 (3.784)] [KD 0.000 (0.000)] 2024-10-12 00:03:12,647 - Train: 26.99% [101300/375300] [81.0/300.0] [batch_t 0.457 (0.448)] [data_t 0.163] [optim_t 0.294] [lr 0.002497] [CE 3.698 (3.754)] [KD 0.000 (0.000)] 2024-10-12 00:03:24,914 - ==> Total time: 12:16:28 Eta: 1 day, 9:11:13 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 00:03:37,394 - Train: 27.01% [101350/375300] [81.0/300.0] [batch_t 0.316 (0.580)] [data_t 0.016] [optim_t 0.300] [lr 0.002497] [CE 3.916 (3.726)] [KD 0.000 (0.000)] 2024-10-12 00:03:59,630 - Train: 27.02% [101400/375300] [81.1/300.0] [batch_t 0.479 (0.445)] [data_t 0.016] [optim_t 0.464] [lr 0.002496] [CE 3.289 (3.725)] [KD 0.000 (0.000)] 2024-10-12 00:04:21,190 - Train: 27.03% [101450/375300] [81.1/300.0] [batch_t 0.426 (0.431)] [data_t 0.016] [optim_t 0.410] [lr 0.002496] [CE 3.843 (3.729)] [KD 0.000 (0.000)] 2024-10-12 00:04:42,987 - Train: 27.05% [101500/375300] [81.1/300.0] [batch_t 0.460 (0.436)] [data_t 0.016] [optim_t 0.444] [lr 0.002495] [CE 3.604 (3.728)] [KD 0.000 (0.000)] 2024-10-12 00:05:04,827 - Train: 27.06% [101550/375300] [81.2/300.0] [batch_t 0.956 (0.437)] [data_t 0.658] [optim_t 0.298] [lr 0.002495] [CE 3.900 (3.752)] [KD 0.000 (0.000)] 2024-10-12 00:05:25,759 - Train: 27.07% [101600/375300] [81.2/300.0] [batch_t 0.401 (0.419)] [data_t 0.106] [optim_t 0.295] [lr 0.002495] [CE 3.855 (3.759)] [KD 0.000 (0.000)] 2024-10-12 00:05:46,227 - Train: 27.08% [101650/375300] [81.3/300.0] [batch_t 0.387 (0.409)] [data_t 0.093] [optim_t 0.294] [lr 0.002494] [CE 3.882 (3.699)] [KD 0.000 (0.000)] 2024-10-12 00:06:07,648 - Train: 27.10% [101700/375300] [81.3/300.0] [batch_t 0.502 (0.428)] [data_t 0.016] [optim_t 0.486] [lr 0.002494] [CE 3.893 (3.698)] [KD 0.000 (0.000)] 2024-10-12 00:06:29,380 - Train: 27.11% [101750/375300] [81.3/300.0] [batch_t 0.447 (0.435)] [data_t 0.016] [optim_t 0.431] [lr 0.002493] [CE 4.013 (3.797)] [KD 0.000 (0.000)] 2024-10-12 00:06:50,858 - Train: 27.12% [101800/375300] [81.4/300.0] [batch_t 0.428 (0.429)] [data_t 0.016] [optim_t 0.413] [lr 0.002493] [CE 3.907 (3.725)] [KD 0.000 (0.000)] 2024-10-12 00:07:12,351 - Train: 27.14% [101850/375300] [81.4/300.0] [batch_t 0.377 (0.430)] [data_t 0.016] [optim_t 0.361] [lr 0.002492] [CE 3.741 (3.731)] [KD 0.000 (0.000)] 2024-10-12 00:07:33,686 - Train: 27.15% [101900/375300] [81.5/300.0] [batch_t 0.514 (0.427)] [data_t 0.015] [optim_t 0.499] [lr 0.002492] [CE 3.616 (3.730)] [KD 0.000 (0.000)] 2024-10-12 00:07:56,122 - Train: 27.16% [101950/375300] [81.5/300.0] [batch_t 0.483 (0.449)] [data_t 0.016] [optim_t 0.467] [lr 0.002491] [CE 3.759 (3.758)] [KD 0.000 (0.000)] 2024-10-12 00:08:17,910 - Train: 27.18% [102000/375300] [81.5/300.0] [batch_t 0.386 (0.436)] [data_t 0.016] [optim_t 0.370] [lr 0.002491] [CE 3.554 (3.718)] [KD 0.000 (0.000)] 2024-10-12 00:08:39,797 - Train: 27.19% [102050/375300] [81.6/300.0] [batch_t 0.437 (0.438)] [data_t 0.016] [optim_t 0.421] [lr 0.002490] [CE 3.932 (3.762)] [KD 0.000 (0.000)] 2024-10-12 00:09:01,148 - Train: 27.20% [102100/375300] [81.6/300.0] [batch_t 0.436 (0.427)] [data_t 0.015] [optim_t 0.421] [lr 0.002490] [CE 3.690 (3.782)] [KD 0.000 (0.000)] 2024-10-12 00:09:22,280 - Train: 27.22% [102150/375300] [81.7/300.0] [batch_t 0.414 (0.423)] [data_t 0.015] [optim_t 0.398] [lr 0.002489] [CE 3.660 (3.731)] [KD 0.000 (0.000)] 2024-10-12 00:09:43,733 - Train: 27.23% [102200/375300] [81.7/300.0] [batch_t 0.399 (0.429)] [data_t 0.016] [optim_t 0.383] [lr 0.002489] [CE 3.870 (3.762)] [KD 0.000 (0.000)] 2024-10-12 00:10:05,583 - Train: 27.24% [102250/375300] [81.7/300.0] [batch_t 0.445 (0.437)] [data_t 0.016] [optim_t 0.430] [lr 0.002488] [CE 3.750 (3.762)] [KD 0.000 (0.000)] 2024-10-12 00:10:26,824 - Train: 27.26% [102300/375300] [81.8/300.0] [batch_t 0.641 (0.425)] [data_t 0.015] [optim_t 0.626] [lr 0.002488] [CE 3.720 (3.794)] [KD 0.000 (0.000)] 2024-10-12 00:10:48,566 - Train: 27.27% [102350/375300] [81.8/300.0] [batch_t 0.430 (0.435)] [data_t 0.130] [optim_t 0.300] [lr 0.002488] [CE 3.818 (3.750)] [KD 0.000 (0.000)] 2024-10-12 00:11:10,708 - Train: 27.28% [102400/375300] [81.9/300.0] [batch_t 0.322 (0.443)] [data_t 0.016] [optim_t 0.306] [lr 0.002487] [CE 3.944 (3.719)] [KD 0.000 (0.000)] 2024-10-12 00:11:32,889 - Train: 27.30% [102450/375300] [81.9/300.0] [batch_t 0.426 (0.443)] [data_t 0.123] [optim_t 0.303] [lr 0.002487] [CE 3.930 (3.778)] [KD 0.000 (0.000)] 2024-10-12 00:11:53,976 - Train: 27.31% [102500/375300] [81.9/300.0] [batch_t 0.372 (0.422)] [data_t 0.067] [optim_t 0.305] [lr 0.002486] [CE 4.150 (3.753)] [KD 0.000 (0.000)] 2024-10-12 00:12:15,341 - Train: 27.32% [102550/375300] [82.0/300.0] [batch_t 0.795 (0.427)] [data_t 0.498] [optim_t 0.296] [lr 0.002486] [CE 3.955 (3.759)] [KD 0.000 (0.000)] 2024-10-12 00:12:27,386 - ==> Total time: 12:25:31 Eta: 1 day, 9:01:59 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 00:12:40,341 - Train: 27.34% [102600/375300] [82.0/300.0] [batch_t 0.319 (0.631)] [data_t 0.016] [optim_t 0.304] [lr 0.002485] [CE 3.516 (3.717)] [KD 0.000 (0.000)] 2024-10-12 00:13:01,620 - Train: 27.35% [102650/375300] [82.1/300.0] [batch_t 0.321 (0.425)] [data_t 0.015] [optim_t 0.306] [lr 0.002485] [CE 3.217 (3.737)] [KD 0.000 (0.000)] 2024-10-12 00:13:23,765 - Train: 27.36% [102700/375300] [82.1/300.0] [batch_t 0.397 (0.443)] [data_t 0.101] [optim_t 0.296] [lr 0.002484] [CE 3.715 (3.754)] [KD 0.000 (0.000)] 2024-10-12 00:13:45,685 - Train: 27.38% [102750/375300] [82.1/300.0] [batch_t 0.456 (0.438)] [data_t 0.156] [optim_t 0.300] [lr 0.002484] [CE 3.639 (3.765)] [KD 0.000 (0.000)] 2024-10-12 00:14:06,994 - Train: 27.39% [102800/375300] [82.2/300.0] [batch_t 0.434 (0.426)] [data_t 0.136] [optim_t 0.299] [lr 0.002483] [CE 3.915 (3.743)] [KD 0.000 (0.000)] 2024-10-12 00:14:28,709 - Train: 27.40% [102850/375300] [82.2/300.0] [batch_t 0.376 (0.434)] [data_t 0.082] [optim_t 0.294] [lr 0.002483] [CE 3.703 (3.736)] [KD 0.000 (0.000)] 2024-10-12 00:14:50,417 - Train: 27.42% [102900/375300] [82.3/300.0] [batch_t 0.428 (0.434)] [data_t 0.124] [optim_t 0.304] [lr 0.002482] [CE 3.791 (3.708)] [KD 0.000 (0.000)] 2024-10-12 00:15:12,422 - Train: 27.43% [102950/375300] [82.3/300.0] [batch_t 0.580 (0.440)] [data_t 0.284] [optim_t 0.296] [lr 0.002482] [CE 3.689 (3.730)] [KD 0.000 (0.000)] 2024-10-12 00:15:34,631 - Train: 27.44% [103000/375300] [82.3/300.0] [batch_t 0.456 (0.444)] [data_t 0.155] [optim_t 0.301] [lr 0.002481] [CE 3.739 (3.741)] [KD 0.000 (0.000)] 2024-10-12 00:15:56,801 - Train: 27.46% [103050/375300] [82.4/300.0] [batch_t 0.445 (0.443)] [data_t 0.149] [optim_t 0.296] [lr 0.002481] [CE 3.986 (3.765)] [KD 0.000 (0.000)] 2024-10-12 00:16:18,415 - Train: 27.47% [103100/375300] [82.4/300.0] [batch_t 0.509 (0.432)] [data_t 0.212] [optim_t 0.297] [lr 0.002480] [CE 3.674 (3.694)] [KD 0.000 (0.000)] 2024-10-12 00:16:40,056 - Train: 27.48% [103150/375300] [82.5/300.0] [batch_t 0.499 (0.433)] [data_t 0.199] [optim_t 0.300] [lr 0.002480] [CE 3.940 (3.745)] [KD 0.000 (0.000)] 2024-10-12 00:17:01,989 - Train: 27.50% [103200/375300] [82.5/300.0] [batch_t 0.390 (0.439)] [data_t 0.094] [optim_t 0.296] [lr 0.002480] [CE 3.461 (3.692)] [KD 0.000 (0.000)] 2024-10-12 00:17:23,333 - Train: 27.51% [103250/375300] [82.5/300.0] [batch_t 0.379 (0.427)] [data_t 0.082] [optim_t 0.297] [lr 0.002479] [CE 3.859 (3.695)] [KD 0.000 (0.000)] 2024-10-12 00:17:44,770 - Train: 27.52% [103300/375300] [82.6/300.0] [batch_t 0.447 (0.429)] [data_t 0.149] [optim_t 0.298] [lr 0.002479] [CE 4.155 (3.763)] [KD 0.000 (0.000)] 2024-10-12 00:18:06,606 - Train: 27.54% [103350/375300] [82.6/300.0] [batch_t 0.449 (0.437)] [data_t 0.150] [optim_t 0.300] [lr 0.002478] [CE 3.609 (3.735)] [KD 0.000 (0.000)] 2024-10-12 00:18:28,642 - Train: 27.55% [103400/375300] [82.7/300.0] [batch_t 0.467 (0.441)] [data_t 0.015] [optim_t 0.452] [lr 0.002478] [CE 3.607 (3.738)] [KD 0.000 (0.000)] 2024-10-12 00:18:50,403 - Train: 27.56% [103450/375300] [82.7/300.0] [batch_t 0.467 (0.435)] [data_t 0.015] [optim_t 0.451] [lr 0.002477] [CE 3.504 (3.696)] [KD 0.000 (0.000)] 2024-10-12 00:19:12,508 - Train: 27.58% [103500/375300] [82.7/300.0] [batch_t 0.424 (0.442)] [data_t 0.015] [optim_t 0.408] [lr 0.002477] [CE 4.265 (3.728)] [KD 0.000 (0.000)] 2024-10-12 00:19:35,415 - Train: 27.59% [103550/375300] [82.8/300.0] [batch_t 0.531 (0.458)] [data_t 0.016] [optim_t 0.516] [lr 0.002476] [CE 3.679 (3.774)] [KD 0.000 (0.000)] 2024-10-12 00:19:58,378 - Train: 27.60% [103600/375300] [82.8/300.0] [batch_t 0.453 (0.459)] [data_t 0.016] [optim_t 0.438] [lr 0.002476] [CE 3.701 (3.734)] [KD 0.000 (0.000)] 2024-10-12 00:20:20,324 - Train: 27.62% [103650/375300] [82.9/300.0] [batch_t 0.318 (0.439)] [data_t 0.015] [optim_t 0.303] [lr 0.002475] [CE 4.048 (3.772)] [KD 0.000 (0.000)] 2024-10-12 00:20:42,578 - Train: 27.63% [103700/375300] [82.9/300.0] [batch_t 0.438 (0.445)] [data_t 0.016] [optim_t 0.422] [lr 0.002475] [CE 3.449 (3.717)] [KD 0.000 (0.000)] 2024-10-12 00:21:04,613 - Train: 27.64% [103750/375300] [82.9/300.0] [batch_t 0.461 (0.441)] [data_t 0.016] [optim_t 0.446] [lr 0.002474] [CE 3.593 (3.732)] [KD 0.000 (0.000)] 2024-10-12 00:21:26,791 - Train: 27.66% [103800/375300] [83.0/300.0] [batch_t 0.495 (0.443)] [data_t 0.015] [optim_t 0.479] [lr 0.002474] [CE 3.746 (3.778)] [KD 0.000 (0.000)] 2024-10-12 00:21:39,703 - ==> Total time: 12:34:43 Eta: 1 day, 8:53:12 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 00:21:51,768 - Train: 27.67% [103850/375300] [83.0/300.0] [batch_t 0.314 (0.623)] [data_t 0.015] [optim_t 0.299] [lr 0.002473] [CE 3.827 (3.704)] [KD 0.000 (0.000)] 2024-10-12 00:22:13,465 - Train: 27.68% [103900/375300] [83.1/300.0] [batch_t 0.489 (0.434)] [data_t 0.015] [optim_t 0.474] [lr 0.002473] [CE 3.513 (3.731)] [KD 0.000 (0.000)] 2024-10-12 00:22:36,090 - Train: 27.70% [103950/375300] [83.1/300.0] [batch_t 0.394 (0.452)] [data_t 0.015] [optim_t 0.379] [lr 0.002472] [CE 3.529 (3.732)] [KD 0.000 (0.000)] 2024-10-12 00:22:58,117 - Train: 27.71% [104000/375300] [83.1/300.0] [batch_t 0.497 (0.440)] [data_t 0.015] [optim_t 0.481] [lr 0.002472] [CE 3.868 (3.734)] [KD 0.000 (0.000)] 2024-10-12 00:23:20,168 - Train: 27.72% [104050/375300] [83.2/300.0] [batch_t 0.446 (0.441)] [data_t 0.146] [optim_t 0.300] [lr 0.002471] [CE 3.951 (3.733)] [KD 0.000 (0.000)] 2024-10-12 00:23:42,665 - Train: 27.74% [104100/375300] [83.2/300.0] [batch_t 0.461 (0.450)] [data_t 0.163] [optim_t 0.297] [lr 0.002471] [CE 3.709 (3.675)] [KD 0.000 (0.000)] 2024-10-12 00:24:05,027 - Train: 27.75% [104150/375300] [83.3/300.0] [batch_t 0.385 (0.447)] [data_t 0.085] [optim_t 0.300] [lr 0.002471] [CE 3.572 (3.729)] [KD 0.000 (0.000)] 2024-10-12 00:24:26,054 - Train: 27.76% [104200/375300] [83.3/300.0] [batch_t 0.421 (0.420)] [data_t 0.125] [optim_t 0.295] [lr 0.002470] [CE 3.924 (3.755)] [KD 0.000 (0.000)] 2024-10-12 00:24:47,336 - Train: 27.78% [104250/375300] [83.3/300.0] [batch_t 0.469 (0.426)] [data_t 0.174] [optim_t 0.295] [lr 0.002470] [CE 3.992 (3.776)] [KD 0.000 (0.000)] 2024-10-12 00:25:08,970 - Train: 27.79% [104300/375300] [83.4/300.0] [batch_t 0.422 (0.433)] [data_t 0.015] [optim_t 0.406] [lr 0.002469] [CE 3.626 (3.742)] [KD 0.000 (0.000)] 2024-10-12 00:25:30,629 - Train: 27.80% [104350/375300] [83.4/300.0] [batch_t 0.420 (0.433)] [data_t 0.016] [optim_t 0.404] [lr 0.002469] [CE 3.351 (3.775)] [KD 0.000 (0.000)] 2024-10-12 00:25:52,447 - Train: 27.82% [104400/375300] [83.5/300.0] [batch_t 0.538 (0.436)] [data_t 0.016] [optim_t 0.522] [lr 0.002468] [CE 3.488 (3.754)] [KD 0.000 (0.000)] 2024-10-12 00:26:14,440 - Train: 27.83% [104450/375300] [83.5/300.0] [batch_t 0.345 (0.440)] [data_t 0.016] [optim_t 0.330] [lr 0.002468] [CE 3.717 (3.781)] [KD 0.000 (0.000)] 2024-10-12 00:26:36,757 - Train: 27.84% [104500/375300] [83.5/300.0] [batch_t 0.434 (0.446)] [data_t 0.015] [optim_t 0.419] [lr 0.002467] [CE 3.838 (3.724)] [KD 0.000 (0.000)] 2024-10-12 00:26:58,873 - Train: 27.86% [104550/375300] [83.6/300.0] [batch_t 0.453 (0.442)] [data_t 0.016] [optim_t 0.437] [lr 0.002467] [CE 3.940 (3.701)] [KD 0.000 (0.000)] 2024-10-12 00:27:21,372 - Train: 27.87% [104600/375300] [83.6/300.0] [batch_t 0.469 (0.450)] [data_t 0.016] [optim_t 0.454] [lr 0.002466] [CE 3.857 (3.724)] [KD 0.000 (0.000)] 2024-10-12 00:27:43,382 - Train: 27.88% [104650/375300] [83.7/300.0] [batch_t 0.422 (0.440)] [data_t 0.016] [optim_t 0.407] [lr 0.002466] [CE 3.521 (3.755)] [KD 0.000 (0.000)] 2024-10-12 00:28:05,228 - Train: 27.90% [104700/375300] [83.7/300.0] [batch_t 0.422 (0.437)] [data_t 0.016] [optim_t 0.406] [lr 0.002465] [CE 4.171 (3.761)] [KD 0.000 (0.000)] 2024-10-12 00:28:26,922 - Train: 27.91% [104750/375300] [83.7/300.0] [batch_t 0.433 (0.434)] [data_t 0.016] [optim_t 0.418] [lr 0.002465] [CE 3.925 (3.759)] [KD 0.000 (0.000)] 2024-10-12 00:28:49,215 - Train: 27.92% [104800/375300] [83.8/300.0] [batch_t 0.757 (0.446)] [data_t 0.016] [optim_t 0.742] [lr 0.002464] [CE 3.740 (3.708)] [KD 0.000 (0.000)] 2024-10-12 00:29:09,655 - Train: 27.94% [104850/375300] [83.8/300.0] [batch_t 0.411 (0.409)] [data_t 0.016] [optim_t 0.396] [lr 0.002464] [CE 3.687 (3.756)] [KD 0.000 (0.000)] 2024-10-12 00:29:31,201 - Train: 27.95% [104900/375300] [83.9/300.0] [batch_t 0.423 (0.431)] [data_t 0.015] [optim_t 0.407] [lr 0.002463] [CE 3.735 (3.734)] [KD 0.000 (0.000)] 2024-10-12 00:29:52,762 - Train: 27.96% [104950/375300] [83.9/300.0] [batch_t 0.471 (0.431)] [data_t 0.016] [optim_t 0.455] [lr 0.002463] [CE 3.608 (3.756)] [KD 0.000 (0.000)] 2024-10-12 00:30:14,741 - Train: 27.98% [105000/375300] [83.9/300.0] [batch_t 0.578 (0.439)] [data_t 0.016] [optim_t 0.563] [lr 0.002462] [CE 3.839 (3.753)] [KD 0.000 (0.000)] 2024-10-12 00:30:36,413 - Train: 27.99% [105050/375300] [84.0/300.0] [batch_t 0.495 (0.433)] [data_t 0.016] [optim_t 0.479] [lr 0.002462] [CE 3.534 (3.746)] [KD 0.000 (0.000)] 2024-10-12 00:30:49,763 - ==> Total time: 12:43:53 Eta: 1 day, 8:44:18 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 00:31:01,848 - Train: 28.00% [105100/375300] [84.0/300.0] [batch_t 0.318 (0.666)] [data_t 0.016] [optim_t 0.303] [lr 0.002461] [CE 3.775 (3.692)] [KD 0.000 (0.000)] 2024-10-12 00:31:23,317 - Train: 28.02% [105150/375300] [84.1/300.0] [batch_t 0.447 (0.429)] [data_t 0.016] [optim_t 0.431] [lr 0.002461] [CE 3.973 (3.740)] [KD 0.000 (0.000)] 2024-10-12 00:31:44,227 - Train: 28.03% [105200/375300] [84.1/300.0] [batch_t 0.315 (0.418)] [data_t 0.016] [optim_t 0.299] [lr 0.002460] [CE 3.453 (3.724)] [KD 0.000 (0.000)] 2024-10-12 00:32:05,842 - Train: 28.04% [105250/375300] [84.1/300.0] [batch_t 0.436 (0.432)] [data_t 0.015] [optim_t 0.421] [lr 0.002460] [CE 3.758 (3.739)] [KD 0.000 (0.000)] 2024-10-12 00:32:27,930 - Train: 28.06% [105300/375300] [84.2/300.0] [batch_t 0.476 (0.442)] [data_t 0.015] [optim_t 0.460] [lr 0.002460] [CE 4.001 (3.806)] [KD 0.000 (0.000)] 2024-10-12 00:32:50,157 - Train: 28.07% [105350/375300] [84.2/300.0] [batch_t 0.458 (0.444)] [data_t 0.016] [optim_t 0.442] [lr 0.002459] [CE 4.103 (3.773)] [KD 0.000 (0.000)] 2024-10-12 00:33:11,327 - Train: 28.08% [105400/375300] [84.3/300.0] [batch_t 0.320 (0.423)] [data_t 0.016] [optim_t 0.304] [lr 0.002459] [CE 3.848 (3.719)] [KD 0.000 (0.000)] 2024-10-12 00:33:32,982 - Train: 28.10% [105450/375300] [84.3/300.0] [batch_t 0.440 (0.433)] [data_t 0.016] [optim_t 0.425] [lr 0.002458] [CE 3.487 (3.738)] [KD 0.000 (0.000)] 2024-10-12 00:33:55,378 - Train: 28.11% [105500/375300] [84.3/300.0] [batch_t 0.450 (0.448)] [data_t 0.016] [optim_t 0.435] [lr 0.002458] [CE 3.533 (3.784)] [KD 0.000 (0.000)] 2024-10-12 00:34:17,895 - Train: 28.12% [105550/375300] [84.4/300.0] [batch_t 0.462 (0.450)] [data_t 0.015] [optim_t 0.447] [lr 0.002457] [CE 3.695 (3.693)] [KD 0.000 (0.000)] 2024-10-12 00:34:40,180 - Train: 28.14% [105600/375300] [84.4/300.0] [batch_t 0.492 (0.446)] [data_t 0.016] [optim_t 0.476] [lr 0.002457] [CE 3.714 (3.769)] [KD 0.000 (0.000)] 2024-10-12 00:35:01,800 - Train: 28.15% [105650/375300] [84.5/300.0] [batch_t 0.395 (0.432)] [data_t 0.016] [optim_t 0.379] [lr 0.002456] [CE 3.801 (3.712)] [KD 0.000 (0.000)] 2024-10-12 00:35:23,801 - Train: 28.16% [105700/375300] [84.5/300.0] [batch_t 0.469 (0.440)] [data_t 0.016] [optim_t 0.453] [lr 0.002456] [CE 3.619 (3.709)] [KD 0.000 (0.000)] 2024-10-12 00:35:45,239 - Train: 28.18% [105750/375300] [84.5/300.0] [batch_t 0.426 (0.429)] [data_t 0.015] [optim_t 0.411] [lr 0.002455] [CE 3.865 (3.744)] [KD 0.000 (0.000)] 2024-10-12 00:36:06,881 - Train: 28.19% [105800/375300] [84.6/300.0] [batch_t 0.398 (0.433)] [data_t 0.016] [optim_t 0.383] [lr 0.002455] [CE 3.489 (3.706)] [KD 0.000 (0.000)] 2024-10-12 00:36:28,189 - Train: 28.20% [105850/375300] [84.6/300.0] [batch_t 0.430 (0.426)] [data_t 0.015] [optim_t 0.414] [lr 0.002454] [CE 3.432 (3.720)] [KD 0.000 (0.000)] 2024-10-12 00:36:50,140 - Train: 28.22% [105900/375300] [84.7/300.0] [batch_t 0.477 (0.439)] [data_t 0.016] [optim_t 0.462] [lr 0.002454] [CE 3.569 (3.706)] [KD 0.000 (0.000)] 2024-10-12 00:37:11,949 - Train: 28.23% [105950/375300] [84.7/300.0] [batch_t 0.437 (0.436)] [data_t 0.015] [optim_t 0.421] [lr 0.002453] [CE 3.651 (3.762)] [KD 0.000 (0.000)] 2024-10-12 00:37:33,834 - Train: 28.24% [106000/375300] [84.7/300.0] [batch_t 0.450 (0.438)] [data_t 0.015] [optim_t 0.435] [lr 0.002453] [CE 3.872 (3.710)] [KD 0.000 (0.000)] 2024-10-12 00:37:56,003 - Train: 28.26% [106050/375300] [84.8/300.0] [batch_t 0.478 (0.443)] [data_t 0.016] [optim_t 0.463] [lr 0.002452] [CE 3.706 (3.766)] [KD 0.000 (0.000)] 2024-10-12 00:38:17,379 - Train: 28.27% [106100/375300] [84.8/300.0] [batch_t 0.469 (0.427)] [data_t 0.015] [optim_t 0.453] [lr 0.002452] [CE 3.609 (3.731)] [KD 0.000 (0.000)] 2024-10-12 00:38:38,724 - Train: 28.28% [106150/375300] [84.9/300.0] [batch_t 0.463 (0.427)] [data_t 0.015] [optim_t 0.448] [lr 0.002451] [CE 3.629 (3.744)] [KD 0.000 (0.000)] 2024-10-12 00:39:00,556 - Train: 28.30% [106200/375300] [84.9/300.0] [batch_t 0.485 (0.437)] [data_t 0.016] [optim_t 0.469] [lr 0.002451] [CE 3.884 (3.765)] [KD 0.000 (0.000)] 2024-10-12 00:39:22,547 - Train: 28.31% [106250/375300] [84.9/300.0] [batch_t 0.485 (0.440)] [data_t 0.015] [optim_t 0.469] [lr 0.002450] [CE 3.601 (3.718)] [KD 0.000 (0.000)] 2024-10-12 00:39:43,526 - Train: 28.32% [106300/375300] [85.0/300.0] [batch_t 0.443 (0.419)] [data_t 0.016] [optim_t 0.427] [lr 0.002450] [CE 3.960 (3.689)] [KD 0.000 (0.000)] 2024-10-12 00:40:18,362 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.424)] [top1_cnt 35909] [top5_cnt 45512] [top_all 50000] 2024-10-12 00:40:18,363 - net: 71.818 (91.024) 2024-10-12 00:40:40,524 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.434)] [top1_cnt 38509] [top5_cnt 46844] [top_all 50000] 2024-10-12 00:40:40,525 - net_E: 77.018 (93.688) 2024-10-12 00:40:40,692 - Max [top1: 71.818 (epoch: 85)] [top1-ema: 77.018 (epoch: 85)] 2024-10-12 00:40:40,692 - ==> Total time: 12:53:44 Eta: 1 day, 8:37:06 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 00:40:54,139 - Train: 28.34% [106350/375300] [85.0/300.0] [batch_t 0.317 (0.483)] [data_t 0.016] [optim_t 0.302] [lr 0.002449] [CE 3.750 (3.711)] [KD 0.000 (0.000)] 2024-10-12 00:41:15,602 - Train: 28.35% [106400/375300] [85.1/300.0] [batch_t 0.415 (0.429)] [data_t 0.016] [optim_t 0.399] [lr 0.002449] [CE 3.720 (3.711)] [KD 0.000 (0.000)] 2024-10-12 00:41:38,365 - Train: 28.36% [106450/375300] [85.1/300.0] [batch_t 0.432 (0.455)] [data_t 0.016] [optim_t 0.416] [lr 0.002448] [CE 3.604 (3.714)] [KD 0.000 (0.000)] 2024-10-12 00:42:00,463 - Train: 28.38% [106500/375300] [85.1/300.0] [batch_t 0.389 (0.442)] [data_t 0.016] [optim_t 0.373] [lr 0.002448] [CE 3.591 (3.706)] [KD 0.000 (0.000)] 2024-10-12 00:42:22,214 - Train: 28.39% [106550/375300] [85.2/300.0] [batch_t 0.469 (0.435)] [data_t 0.016] [optim_t 0.453] [lr 0.002447] [CE 3.408 (3.734)] [KD 0.000 (0.000)] 2024-10-12 00:42:44,457 - Train: 28.40% [106600/375300] [85.2/300.0] [batch_t 0.433 (0.445)] [data_t 0.016] [optim_t 0.418] [lr 0.002447] [CE 3.946 (3.699)] [KD 0.000 (0.000)] 2024-10-12 00:43:06,454 - Train: 28.42% [106650/375300] [85.3/300.0] [batch_t 0.452 (0.440)] [data_t 0.016] [optim_t 0.437] [lr 0.002447] [CE 3.679 (3.720)] [KD 0.000 (0.000)] 2024-10-12 00:43:28,416 - Train: 28.43% [106700/375300] [85.3/300.0] [batch_t 0.452 (0.439)] [data_t 0.016] [optim_t 0.436] [lr 0.002446] [CE 3.834 (3.726)] [KD 0.000 (0.000)] 2024-10-12 00:43:50,581 - Train: 28.44% [106750/375300] [85.3/300.0] [batch_t 0.449 (0.443)] [data_t 0.016] [optim_t 0.434] [lr 0.002446] [CE 3.446 (3.713)] [KD 0.000 (0.000)] 2024-10-12 00:44:12,758 - Train: 28.46% [106800/375300] [85.4/300.0] [batch_t 0.319 (0.443)] [data_t 0.015] [optim_t 0.303] [lr 0.002445] [CE 3.532 (3.719)] [KD 0.000 (0.000)] 2024-10-12 00:44:34,534 - Train: 28.47% [106850/375300] [85.4/300.0] [batch_t 0.463 (0.435)] [data_t 0.015] [optim_t 0.448] [lr 0.002445] [CE 3.913 (3.749)] [KD 0.000 (0.000)] 2024-10-12 00:44:55,281 - Train: 28.48% [106900/375300] [85.5/300.0] [batch_t 0.458 (0.415)] [data_t 0.163] [optim_t 0.295] [lr 0.002444] [CE 3.850 (3.757)] [KD 0.000 (0.000)] 2024-10-12 00:45:16,798 - Train: 28.50% [106950/375300] [85.5/300.0] [batch_t 0.474 (0.430)] [data_t 0.176] [optim_t 0.298] [lr 0.002444] [CE 3.566 (3.737)] [KD 0.000 (0.000)] 2024-10-12 00:45:38,874 - Train: 28.51% [107000/375300] [85.5/300.0] [batch_t 0.495 (0.441)] [data_t 0.198] [optim_t 0.297] [lr 0.002443] [CE 3.480 (3.710)] [KD 0.000 (0.000)] 2024-10-12 00:46:00,851 - Train: 28.52% [107050/375300] [85.6/300.0] [batch_t 0.474 (0.439)] [data_t 0.174] [optim_t 0.300] [lr 0.002443] [CE 3.979 (3.753)] [KD 0.000 (0.000)] 2024-10-12 00:46:22,948 - Train: 28.54% [107100/375300] [85.6/300.0] [batch_t 0.393 (0.442)] [data_t 0.092] [optim_t 0.301] [lr 0.002442] [CE 3.888 (3.753)] [KD 0.000 (0.000)] 2024-10-12 00:46:45,018 - Train: 28.55% [107150/375300] [85.7/300.0] [batch_t 0.442 (0.441)] [data_t 0.144] [optim_t 0.298] [lr 0.002442] [CE 4.020 (3.749)] [KD 0.000 (0.000)] 2024-10-12 00:47:07,337 - Train: 28.56% [107200/375300] [85.7/300.0] [batch_t 0.478 (0.446)] [data_t 0.182] [optim_t 0.296] [lr 0.002441] [CE 3.666 (3.715)] [KD 0.000 (0.000)] 2024-10-12 00:47:29,725 - Train: 28.58% [107250/375300] [85.7/300.0] [batch_t 0.486 (0.448)] [data_t 0.192] [optim_t 0.294] [lr 0.002441] [CE 3.798 (3.725)] [KD 0.000 (0.000)] 2024-10-12 00:47:52,032 - Train: 28.59% [107300/375300] [85.8/300.0] [batch_t 0.329 (0.446)] [data_t 0.032] [optim_t 0.298] [lr 0.002440] [CE 3.942 (3.721)] [KD 0.000 (0.000)] 2024-10-12 00:48:13,773 - Train: 28.60% [107350/375300] [85.8/300.0] [batch_t 0.445 (0.435)] [data_t 0.149] [optim_t 0.296] [lr 0.002440] [CE 3.647 (3.719)] [KD 0.000 (0.000)] 2024-10-12 00:48:35,039 - Train: 28.62% [107400/375300] [85.9/300.0] [batch_t 0.482 (0.425)] [data_t 0.180] [optim_t 0.301] [lr 0.002439] [CE 3.603 (3.777)] [KD 0.000 (0.000)] 2024-10-12 00:48:56,963 - Train: 28.63% [107450/375300] [85.9/300.0] [batch_t 0.401 (0.438)] [data_t 0.104] [optim_t 0.298] [lr 0.002439] [CE 3.699 (3.735)] [KD 0.000 (0.000)] 2024-10-12 00:49:18,444 - Train: 28.64% [107500/375300] [85.9/300.0] [batch_t 0.434 (0.430)] [data_t 0.134] [optim_t 0.300] [lr 0.002438] [CE 3.735 (3.727)] [KD 0.000 (0.000)] 2024-10-12 00:49:39,338 - Train: 28.66% [107550/375300] [86.0/300.0] [batch_t 0.433 (0.418)] [data_t 0.137] [optim_t 0.296] [lr 0.002438] [CE 4.019 (3.721)] [KD 0.000 (0.000)] 2024-10-12 00:49:53,399 - ==> Total time: 13:02:57 Eta: 1 day, 8:28:17 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 00:50:04,559 - Train: 28.67% [107600/375300] [86.0/300.0] [batch_t 0.323 (0.687)] [data_t 0.016] [optim_t 0.308] [lr 0.002437] [CE 3.827 (3.704)] [KD 0.000 (0.000)] 2024-10-12 00:50:24,600 - Train: 28.68% [107650/375300] [86.1/300.0] [batch_t 0.481 (0.401)] [data_t 0.016] [optim_t 0.465] [lr 0.002437] [CE 3.766 (3.717)] [KD 0.000 (0.000)] 2024-10-12 00:50:45,998 - Train: 28.70% [107700/375300] [86.1/300.0] [batch_t 0.392 (0.428)] [data_t 0.015] [optim_t 0.376] [lr 0.002436] [CE 3.737 (3.695)] [KD 0.000 (0.000)] 2024-10-12 00:51:07,601 - Train: 28.71% [107750/375300] [86.1/300.0] [batch_t 0.415 (0.432)] [data_t 0.016] [optim_t 0.399] [lr 0.002436] [CE 3.686 (3.721)] [KD 0.000 (0.000)] 2024-10-12 00:51:29,065 - Train: 28.72% [107800/375300] [86.2/300.0] [batch_t 0.514 (0.429)] [data_t 0.015] [optim_t 0.498] [lr 0.002435] [CE 3.719 (3.705)] [KD 0.000 (0.000)] 2024-10-12 00:51:50,852 - Train: 28.74% [107850/375300] [86.2/300.0] [batch_t 0.406 (0.436)] [data_t 0.015] [optim_t 0.391] [lr 0.002435] [CE 3.695 (3.713)] [KD 0.000 (0.000)] 2024-10-12 00:52:12,258 - Train: 28.75% [107900/375300] [86.3/300.0] [batch_t 0.465 (0.428)] [data_t 0.015] [optim_t 0.449] [lr 0.002434] [CE 3.360 (3.751)] [KD 0.000 (0.000)] 2024-10-12 00:52:33,499 - Train: 28.76% [107950/375300] [86.3/300.0] [batch_t 0.394 (0.425)] [data_t 0.015] [optim_t 0.379] [lr 0.002434] [CE 3.695 (3.742)] [KD 0.000 (0.000)] 2024-10-12 00:52:54,756 - Train: 28.78% [108000/375300] [86.3/300.0] [batch_t 0.495 (0.425)] [data_t 0.016] [optim_t 0.480] [lr 0.002433] [CE 3.904 (3.740)] [KD 0.000 (0.000)] 2024-10-12 00:53:16,167 - Train: 28.79% [108050/375300] [86.4/300.0] [batch_t 0.392 (0.428)] [data_t 0.016] [optim_t 0.376] [lr 0.002433] [CE 3.730 (3.717)] [KD 0.000 (0.000)] 2024-10-12 00:53:38,144 - Train: 28.80% [108100/375300] [86.4/300.0] [batch_t 0.429 (0.439)] [data_t 0.015] [optim_t 0.413] [lr 0.002432] [CE 3.758 (3.746)] [KD 0.000 (0.000)] 2024-10-12 00:53:59,971 - Train: 28.82% [108150/375300] [86.5/300.0] [batch_t 0.437 (0.436)] [data_t 0.016] [optim_t 0.422] [lr 0.002432] [CE 3.898 (3.745)] [KD 0.000 (0.000)] 2024-10-12 00:54:21,829 - Train: 28.83% [108200/375300] [86.5/300.0] [batch_t 0.467 (0.437)] [data_t 0.015] [optim_t 0.451] [lr 0.002431] [CE 3.693 (3.713)] [KD 0.000 (0.000)] 2024-10-12 00:54:43,463 - Train: 28.84% [108250/375300] [86.5/300.0] [batch_t 0.387 (0.433)] [data_t 0.016] [optim_t 0.372] [lr 0.002431] [CE 3.413 (3.687)] [KD 0.000 (0.000)] 2024-10-12 00:55:05,114 - Train: 28.86% [108300/375300] [86.6/300.0] [batch_t 0.425 (0.433)] [data_t 0.015] [optim_t 0.410] [lr 0.002430] [CE 4.055 (3.732)] [KD 0.000 (0.000)] 2024-10-12 00:55:26,128 - Train: 28.87% [108350/375300] [86.6/300.0] [batch_t 0.445 (0.420)] [data_t 0.015] [optim_t 0.430] [lr 0.002430] [CE 3.677 (3.759)] [KD 0.000 (0.000)] 2024-10-12 00:55:46,901 - Train: 28.88% [108400/375300] [86.7/300.0] [batch_t 0.370 (0.415)] [data_t 0.015] [optim_t 0.355] [lr 0.002429] [CE 3.330 (3.692)] [KD 0.000 (0.000)] 2024-10-12 00:56:08,785 - Train: 28.90% [108450/375300] [86.7/300.0] [batch_t 0.425 (0.438)] [data_t 0.015] [optim_t 0.410] [lr 0.002429] [CE 3.274 (3.741)] [KD 0.000 (0.000)] 2024-10-12 00:56:30,862 - Train: 28.91% [108500/375300] [86.7/300.0] [batch_t 0.480 (0.441)] [data_t 0.015] [optim_t 0.465] [lr 0.002428] [CE 3.802 (3.683)] [KD 0.000 (0.000)] 2024-10-12 00:56:52,910 - Train: 28.92% [108550/375300] [86.8/300.0] [batch_t 0.435 (0.441)] [data_t 0.015] [optim_t 0.419] [lr 0.002428] [CE 3.841 (3.708)] [KD 0.000 (0.000)] 2024-10-12 00:57:14,890 - Train: 28.94% [108600/375300] [86.8/300.0] [batch_t 0.398 (0.439)] [data_t 0.015] [optim_t 0.382] [lr 0.002428] [CE 4.098 (3.679)] [KD 0.000 (0.000)] 2024-10-12 00:57:37,342 - Train: 28.95% [108650/375300] [86.9/300.0] [batch_t 0.508 (0.449)] [data_t 0.204] [optim_t 0.305] [lr 0.002427] [CE 4.040 (3.796)] [KD 0.000 (0.000)] 2024-10-12 00:57:59,986 - Train: 28.96% [108700/375300] [86.9/300.0] [batch_t 0.448 (0.453)] [data_t 0.153] [optim_t 0.295] [lr 0.002427] [CE 3.940 (3.746)] [KD 0.000 (0.000)] 2024-10-12 00:58:22,629 - Train: 28.98% [108750/375300] [86.9/300.0] [batch_t 0.424 (0.453)] [data_t 0.132] [optim_t 0.292] [lr 0.002426] [CE 3.283 (3.703)] [KD 0.000 (0.000)] 2024-10-12 00:58:44,647 - Train: 28.99% [108800/375300] [87.0/300.0] [batch_t 0.440 (0.440)] [data_t 0.146] [optim_t 0.294] [lr 0.002426] [CE 3.635 (3.742)] [KD 0.000 (0.000)] 2024-10-12 00:58:59,144 - ==> Total time: 13:12:03 Eta: 1 day, 8:19:09 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 00:59:10,113 - Train: 29.00% [108850/375300] [87.0/300.0] [batch_t 0.314 (0.729)] [data_t 0.016] [optim_t 0.299] [lr 0.002425] [CE 3.917 (3.687)] [KD 0.000 (0.000)] 2024-10-12 00:59:30,609 - Train: 29.02% [108900/375300] [87.1/300.0] [batch_t 0.320 (0.410)] [data_t 0.015] [optim_t 0.304] [lr 0.002425] [CE 3.673 (3.703)] [KD 0.000 (0.000)] 2024-10-12 00:59:53,252 - Train: 29.03% [108950/375300] [87.1/300.0] [batch_t 0.741 (0.453)] [data_t 0.448] [optim_t 0.293] [lr 0.002424] [CE 3.557 (3.723)] [KD 0.000 (0.000)] 2024-10-12 01:00:14,744 - Train: 29.04% [109000/375300] [87.1/300.0] [batch_t 0.378 (0.430)] [data_t 0.086] [optim_t 0.292] [lr 0.002424] [CE 3.614 (3.719)] [KD 0.000 (0.000)] 2024-10-12 01:00:36,071 - Train: 29.06% [109050/375300] [87.2/300.0] [batch_t 0.464 (0.426)] [data_t 0.168] [optim_t 0.296] [lr 0.002423] [CE 3.685 (3.743)] [KD 0.000 (0.000)] 2024-10-12 01:00:58,423 - Train: 29.07% [109100/375300] [87.2/300.0] [batch_t 0.497 (0.447)] [data_t 0.197] [optim_t 0.299] [lr 0.002423] [CE 3.799 (3.732)] [KD 0.000 (0.000)] 2024-10-12 01:01:20,480 - Train: 29.08% [109150/375300] [87.3/300.0] [batch_t 0.430 (0.441)] [data_t 0.132] [optim_t 0.299] [lr 0.002422] [CE 3.671 (3.692)] [KD 0.000 (0.000)] 2024-10-12 01:01:41,980 - Train: 29.10% [109200/375300] [87.3/300.0] [batch_t 0.454 (0.430)] [data_t 0.154] [optim_t 0.300] [lr 0.002422] [CE 3.584 (3.729)] [KD 0.000 (0.000)] 2024-10-12 01:02:03,542 - Train: 29.11% [109250/375300] [87.3/300.0] [batch_t 0.398 (0.431)] [data_t 0.103] [optim_t 0.295] [lr 0.002421] [CE 3.558 (3.729)] [KD 0.000 (0.000)] 2024-10-12 01:02:24,903 - Train: 29.12% [109300/375300] [87.4/300.0] [batch_t 0.378 (0.427)] [data_t 0.077] [optim_t 0.300] [lr 0.002421] [CE 3.773 (3.722)] [KD 0.000 (0.000)] 2024-10-12 01:02:46,155 - Train: 29.14% [109350/375300] [87.4/300.0] [batch_t 0.449 (0.425)] [data_t 0.015] [optim_t 0.434] [lr 0.002420] [CE 3.714 (3.720)] [KD 0.000 (0.000)] 2024-10-12 01:03:07,355 - Train: 29.15% [109400/375300] [87.5/300.0] [batch_t 0.475 (0.424)] [data_t 0.181] [optim_t 0.294] [lr 0.002420] [CE 3.890 (3.793)] [KD 0.000 (0.000)] 2024-10-12 01:03:29,461 - Train: 29.16% [109450/375300] [87.5/300.0] [batch_t 0.468 (0.442)] [data_t 0.169] [optim_t 0.299] [lr 0.002419] [CE 3.572 (3.706)] [KD 0.000 (0.000)] 2024-10-12 01:03:51,859 - Train: 29.18% [109500/375300] [87.5/300.0] [batch_t 0.415 (0.448)] [data_t 0.115] [optim_t 0.299] [lr 0.002419] [CE 3.598 (3.725)] [KD 0.000 (0.000)] 2024-10-12 01:04:13,810 - Train: 29.19% [109550/375300] [87.6/300.0] [batch_t 0.409 (0.439)] [data_t 0.113] [optim_t 0.296] [lr 0.002418] [CE 3.697 (3.701)] [KD 0.000 (0.000)] 2024-10-12 01:04:35,533 - Train: 29.20% [109600/375300] [87.6/300.0] [batch_t 0.392 (0.434)] [data_t 0.095] [optim_t 0.297] [lr 0.002418] [CE 3.407 (3.737)] [KD 0.000 (0.000)] 2024-10-12 01:04:57,967 - Train: 29.22% [109650/375300] [87.6/300.0] [batch_t 0.449 (0.449)] [data_t 0.149] [optim_t 0.300] [lr 0.002417] [CE 3.500 (3.691)] [KD 0.000 (0.000)] 2024-10-12 01:05:19,449 - Train: 29.23% [109700/375300] [87.7/300.0] [batch_t 0.461 (0.430)] [data_t 0.163] [optim_t 0.298] [lr 0.002417] [CE 4.035 (3.763)] [KD 0.000 (0.000)] 2024-10-12 01:05:41,023 - Train: 29.24% [109750/375300] [87.7/300.0] [batch_t 0.392 (0.431)] [data_t 0.096] [optim_t 0.296] [lr 0.002416] [CE 3.527 (3.779)] [KD 0.000 (0.000)] 2024-10-12 01:06:02,330 - Train: 29.26% [109800/375300] [87.8/300.0] [batch_t 0.389 (0.426)] [data_t 0.094] [optim_t 0.295] [lr 0.002416] [CE 3.823 (3.748)] [KD 0.000 (0.000)] 2024-10-12 01:06:24,011 - Train: 29.27% [109850/375300] [87.8/300.0] [batch_t 0.431 (0.434)] [data_t 0.136] [optim_t 0.296] [lr 0.002415] [CE 3.646 (3.752)] [KD 0.000 (0.000)] 2024-10-12 01:06:45,769 - Train: 29.28% [109900/375300] [87.8/300.0] [batch_t 0.478 (0.435)] [data_t 0.180] [optim_t 0.297] [lr 0.002415] [CE 4.043 (3.738)] [KD 0.000 (0.000)] 2024-10-12 01:07:07,163 - Train: 29.30% [109950/375300] [87.9/300.0] [batch_t 0.363 (0.428)] [data_t 0.069] [optim_t 0.294] [lr 0.002414] [CE 3.793 (3.740)] [KD 0.000 (0.000)] 2024-10-12 01:07:28,717 - Train: 29.31% [110000/375300] [87.9/300.0] [batch_t 0.388 (0.431)] [data_t 0.094] [optim_t 0.294] [lr 0.002414] [CE 3.744 (3.750)] [KD 0.000 (0.000)] 2024-10-12 01:07:50,700 - Train: 29.32% [110050/375300] [88.0/300.0] [batch_t 0.368 (0.440)] [data_t 0.075] [optim_t 0.293] [lr 0.002413] [CE 3.598 (3.714)] [KD 0.000 (0.000)] 2024-10-12 01:08:05,966 - ==> Total time: 13:21:09 Eta: 1 day, 8:10:04 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 01:08:16,426 - Train: 29.34% [110100/375300] [88.0/300.0] [batch_t 0.324 (0.758)] [data_t 0.016] [optim_t 0.308] [lr 0.002413] [CE 4.094 (3.815)] [KD 0.000 (0.000)] 2024-10-12 01:08:36,167 - Train: 29.35% [110150/375300] [88.0/300.0] [batch_t 0.406 (0.395)] [data_t 0.015] [optim_t 0.390] [lr 0.002412] [CE 3.857 (3.666)] [KD 0.000 (0.000)] 2024-10-12 01:08:57,452 - Train: 29.36% [110200/375300] [88.1/300.0] [batch_t 0.403 (0.426)] [data_t 0.016] [optim_t 0.388] [lr 0.002412] [CE 3.866 (3.729)] [KD 0.000 (0.000)] 2024-10-12 01:09:19,211 - Train: 29.38% [110250/375300] [88.1/300.0] [batch_t 0.424 (0.435)] [data_t 0.015] [optim_t 0.409] [lr 0.002411] [CE 3.755 (3.729)] [KD 0.000 (0.000)] 2024-10-12 01:09:40,494 - Train: 29.39% [110300/375300] [88.2/300.0] [batch_t 0.406 (0.426)] [data_t 0.015] [optim_t 0.390] [lr 0.002411] [CE 3.398 (3.693)] [KD 0.000 (0.000)] 2024-10-12 01:10:02,408 - Train: 29.40% [110350/375300] [88.2/300.0] [batch_t 0.467 (0.438)] [data_t 0.016] [optim_t 0.451] [lr 0.002410] [CE 3.875 (3.686)] [KD 0.000 (0.000)] 2024-10-12 01:10:23,406 - Train: 29.42% [110400/375300] [88.2/300.0] [batch_t 0.419 (0.420)] [data_t 0.016] [optim_t 0.403] [lr 0.002410] [CE 3.914 (3.739)] [KD 0.000 (0.000)] 2024-10-12 01:10:45,810 - Train: 29.43% [110450/375300] [88.3/300.0] [batch_t 0.451 (0.448)] [data_t 0.016] [optim_t 0.435] [lr 0.002409] [CE 3.392 (3.677)] [KD 0.000 (0.000)] 2024-10-12 01:11:08,419 - Train: 29.44% [110500/375300] [88.3/300.0] [batch_t 0.457 (0.452)] [data_t 0.016] [optim_t 0.441] [lr 0.002409] [CE 3.869 (3.715)] [KD 0.000 (0.000)] 2024-10-12 01:11:30,904 - Train: 29.46% [110550/375300] [88.4/300.0] [batch_t 0.455 (0.450)] [data_t 0.016] [optim_t 0.439] [lr 0.002408] [CE 3.521 (3.733)] [KD 0.000 (0.000)] 2024-10-12 01:11:52,554 - Train: 29.47% [110600/375300] [88.4/300.0] [batch_t 0.362 (0.433)] [data_t 0.016] [optim_t 0.346] [lr 0.002408] [CE 4.148 (3.694)] [KD 0.000 (0.000)] 2024-10-12 01:12:14,027 - Train: 29.48% [110650/375300] [88.4/300.0] [batch_t 0.389 (0.429)] [data_t 0.015] [optim_t 0.374] [lr 0.002407] [CE 3.682 (3.728)] [KD 0.000 (0.000)] 2024-10-12 01:12:35,839 - Train: 29.50% [110700/375300] [88.5/300.0] [batch_t 0.425 (0.436)] [data_t 0.015] [optim_t 0.410] [lr 0.002407] [CE 3.443 (3.706)] [KD 0.000 (0.000)] 2024-10-12 01:12:57,182 - Train: 29.51% [110750/375300] [88.5/300.0] [batch_t 0.617 (0.427)] [data_t 0.016] [optim_t 0.602] [lr 0.002406] [CE 3.672 (3.715)] [KD 0.000 (0.000)] 2024-10-12 01:13:19,723 - Train: 29.52% [110800/375300] [88.6/300.0] [batch_t 0.410 (0.451)] [data_t 0.015] [optim_t 0.395] [lr 0.002406] [CE 3.770 (3.717)] [KD 0.000 (0.000)] 2024-10-12 01:13:41,375 - Train: 29.54% [110850/375300] [88.6/300.0] [batch_t 0.456 (0.433)] [data_t 0.016] [optim_t 0.440] [lr 0.002405] [CE 3.782 (3.728)] [KD 0.000 (0.000)] 2024-10-12 01:14:03,760 - Train: 29.55% [110900/375300] [88.6/300.0] [batch_t 0.523 (0.448)] [data_t 0.016] [optim_t 0.507] [lr 0.002405] [CE 3.822 (3.764)] [KD 0.000 (0.000)] 2024-10-12 01:14:26,282 - Train: 29.56% [110950/375300] [88.7/300.0] [batch_t 0.401 (0.450)] [data_t 0.015] [optim_t 0.386] [lr 0.002404] [CE 3.818 (3.698)] [KD 0.000 (0.000)] 2024-10-12 01:14:48,649 - Train: 29.58% [111000/375300] [88.7/300.0] [batch_t 0.373 (0.447)] [data_t 0.016] [optim_t 0.357] [lr 0.002404] [CE 3.720 (3.682)] [KD 0.000 (0.000)] 2024-10-12 01:15:10,488 - Train: 29.59% [111050/375300] [88.8/300.0] [batch_t 0.468 (0.437)] [data_t 0.016] [optim_t 0.453] [lr 0.002403] [CE 3.580 (3.730)] [KD 0.000 (0.000)] 2024-10-12 01:15:31,768 - Train: 29.60% [111100/375300] [88.8/300.0] [batch_t 0.464 (0.425)] [data_t 0.016] [optim_t 0.449] [lr 0.002403] [CE 3.708 (3.720)] [KD 0.000 (0.000)] 2024-10-12 01:15:52,936 - Train: 29.62% [111150/375300] [88.8/300.0] [batch_t 0.418 (0.423)] [data_t 0.015] [optim_t 0.403] [lr 0.002402] [CE 4.030 (3.746)] [KD 0.000 (0.000)] 2024-10-12 01:16:14,347 - Train: 29.63% [111200/375300] [88.9/300.0] [batch_t 0.380 (0.428)] [data_t 0.016] [optim_t 0.364] [lr 0.002402] [CE 3.625 (3.737)] [KD 0.000 (0.000)] 2024-10-12 01:16:36,530 - Train: 29.64% [111250/375300] [88.9/300.0] [batch_t 0.472 (0.444)] [data_t 0.015] [optim_t 0.456] [lr 0.002401] [CE 3.601 (3.760)] [KD 0.000 (0.000)] 2024-10-12 01:16:58,170 - Train: 29.66% [111300/375300] [89.0/300.0] [batch_t 0.419 (0.433)] [data_t 0.015] [optim_t 0.404] [lr 0.002401] [CE 3.837 (3.730)] [KD 0.000 (0.000)] 2024-10-12 01:17:13,662 - ==> Total time: 13:30:17 Eta: 1 day, 8:01:01 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 01:17:24,619 - Train: 29.67% [111350/375300] [89.0/300.0] [batch_t 0.526 (0.877)] [data_t 0.015] [optim_t 0.511] [lr 0.002400] [CE 3.425 (3.659)] [KD 0.000 (0.000)] 2024-10-12 01:17:45,694 - Train: 29.68% [111400/375300] [89.0/300.0] [batch_t 0.473 (0.421)] [data_t 0.181] [optim_t 0.292] [lr 0.002400] [CE 3.692 (3.644)] [KD 0.000 (0.000)] 2024-10-12 01:18:07,507 - Train: 29.70% [111450/375300] [89.1/300.0] [batch_t 0.424 (0.436)] [data_t 0.128] [optim_t 0.296] [lr 0.002399] [CE 3.974 (3.768)] [KD 0.000 (0.000)] 2024-10-12 01:18:29,996 - Train: 29.71% [111500/375300] [89.1/300.0] [batch_t 0.460 (0.450)] [data_t 0.167] [optim_t 0.294] [lr 0.002399] [CE 3.690 (3.669)] [KD 0.000 (0.000)] 2024-10-12 01:18:52,474 - Train: 29.72% [111550/375300] [89.2/300.0] [batch_t 0.371 (0.449)] [data_t 0.077] [optim_t 0.295] [lr 0.002398] [CE 4.064 (3.691)] [KD 0.000 (0.000)] 2024-10-12 01:19:14,360 - Train: 29.74% [111600/375300] [89.2/300.0] [batch_t 0.431 (0.438)] [data_t 0.135] [optim_t 0.297] [lr 0.002398] [CE 3.548 (3.718)] [KD 0.000 (0.000)] 2024-10-12 01:19:37,074 - Train: 29.75% [111650/375300] [89.2/300.0] [batch_t 0.348 (0.454)] [data_t 0.054] [optim_t 0.295] [lr 0.002397] [CE 3.449 (3.693)] [KD 0.000 (0.000)] 2024-10-12 01:19:59,085 - Train: 29.76% [111700/375300] [89.3/300.0] [batch_t 0.442 (0.440)] [data_t 0.143] [optim_t 0.299] [lr 0.002397] [CE 4.060 (3.715)] [KD 0.000 (0.000)] 2024-10-12 01:20:20,775 - Train: 29.78% [111750/375300] [89.3/300.0] [batch_t 0.455 (0.434)] [data_t 0.160] [optim_t 0.295] [lr 0.002396] [CE 3.401 (3.688)] [KD 0.000 (0.000)] 2024-10-12 01:20:42,043 - Train: 29.79% [111800/375300] [89.4/300.0] [batch_t 0.403 (0.425)] [data_t 0.103] [optim_t 0.300] [lr 0.002396] [CE 4.000 (3.778)] [KD 0.000 (0.000)] 2024-10-12 01:21:03,427 - Train: 29.80% [111850/375300] [89.4/300.0] [batch_t 0.444 (0.428)] [data_t 0.147] [optim_t 0.297] [lr 0.002395] [CE 3.546 (3.696)] [KD 0.000 (0.000)] 2024-10-12 01:21:25,450 - Train: 29.82% [111900/375300] [89.4/300.0] [batch_t 0.441 (0.440)] [data_t 0.144] [optim_t 0.297] [lr 0.002395] [CE 3.187 (3.727)] [KD 0.000 (0.000)] 2024-10-12 01:21:47,182 - Train: 29.83% [111950/375300] [89.5/300.0] [batch_t 0.448 (0.435)] [data_t 0.151] [optim_t 0.297] [lr 0.002394] [CE 3.887 (3.788)] [KD 0.000 (0.000)] 2024-10-12 01:22:08,922 - Train: 29.84% [112000/375300] [89.5/300.0] [batch_t 0.328 (0.435)] [data_t 0.028] [optim_t 0.299] [lr 0.002394] [CE 3.490 (3.757)] [KD 0.000 (0.000)] 2024-10-12 01:22:29,709 - Train: 29.86% [112050/375300] [89.6/300.0] [batch_t 0.429 (0.416)] [data_t 0.128] [optim_t 0.302] [lr 0.002393] [CE 3.674 (3.704)] [KD 0.000 (0.000)] 2024-10-12 01:22:50,705 - Train: 29.87% [112100/375300] [89.6/300.0] [batch_t 0.462 (0.420)] [data_t 0.042] [optim_t 0.419] [lr 0.002393] [CE 3.774 (3.735)] [KD 0.000 (0.000)] 2024-10-12 01:23:13,192 - Train: 29.88% [112150/375300] [89.6/300.0] [batch_t 0.456 (0.450)] [data_t 0.016] [optim_t 0.441] [lr 0.002392] [CE 3.761 (3.731)] [KD 0.000 (0.000)] 2024-10-12 01:23:35,438 - Train: 29.90% [112200/375300] [89.7/300.0] [batch_t 0.424 (0.445)] [data_t 0.016] [optim_t 0.408] [lr 0.002392] [CE 3.957 (3.718)] [KD 0.000 (0.000)] 2024-10-12 01:23:57,687 - Train: 29.91% [112250/375300] [89.7/300.0] [batch_t 0.452 (0.445)] [data_t 0.015] [optim_t 0.437] [lr 0.002391] [CE 3.619 (3.708)] [KD 0.000 (0.000)] 2024-10-12 01:24:19,629 - Train: 29.92% [112300/375300] [89.8/300.0] [batch_t 0.449 (0.439)] [data_t 0.016] [optim_t 0.433] [lr 0.002391] [CE 3.730 (3.712)] [KD 0.000 (0.000)] 2024-10-12 01:24:40,773 - Train: 29.94% [112350/375300] [89.8/300.0] [batch_t 0.418 (0.423)] [data_t 0.016] [optim_t 0.402] [lr 0.002390] [CE 3.225 (3.690)] [KD 0.000 (0.000)] 2024-10-12 01:25:01,762 - Train: 29.95% [112400/375300] [89.8/300.0] [batch_t 0.396 (0.420)] [data_t 0.015] [optim_t 0.381] [lr 0.002390] [CE 3.519 (3.700)] [KD 0.000 (0.000)] 2024-10-12 01:25:23,583 - Train: 29.96% [112450/375300] [89.9/300.0] [batch_t 0.423 (0.436)] [data_t 0.016] [optim_t 0.408] [lr 0.002389] [CE 3.594 (3.774)] [KD 0.000 (0.000)] 2024-10-12 01:25:45,334 - Train: 29.98% [112500/375300] [89.9/300.0] [batch_t 0.430 (0.435)] [data_t 0.016] [optim_t 0.415] [lr 0.002389] [CE 3.860 (3.714)] [KD 0.000 (0.000)] 2024-10-12 01:26:06,192 - Train: 29.99% [112550/375300] [90.0/300.0] [batch_t 0.401 (0.417)] [data_t 0.016] [optim_t 0.386] [lr 0.002388] [CE 3.442 (3.664)] [KD 0.000 (0.000)] 2024-10-12 01:26:44,010 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.438)] [top1_cnt 35828] [top5_cnt 45494] [top_all 50000] 2024-10-12 01:26:44,010 - net: 71.656 (90.988) 2024-10-12 01:27:05,519 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.423)] [top1_cnt 38650] [top5_cnt 46893] [top_all 50000] 2024-10-12 01:27:05,519 - net_E: 77.300 (93.786) 2024-10-12 01:27:05,667 - Max [top1: 71.818 (epoch: 85)] [top1-ema: 77.300 (epoch: 90)] 2024-10-12 01:27:05,667 - ==> Total time: 13:40:09 Eta: 1 day, 7:53:42 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 01:27:17,363 - Train: 30.00% [112600/375300] [90.0/300.0] [batch_t 0.315 (0.586)] [data_t 0.015] [optim_t 0.300] [lr 0.002388] [CE 3.809 (3.720)] [KD 0.000 (0.000)] 2024-10-12 01:27:37,616 - Train: 30.02% [112650/375300] [90.0/300.0] [batch_t 0.400 (0.405)] [data_t 0.015] [optim_t 0.385] [lr 0.002387] [CE 3.822 (3.702)] [KD 0.000 (0.000)] 2024-10-12 01:28:00,071 - Train: 30.03% [112700/375300] [90.1/300.0] [batch_t 0.449 (0.449)] [data_t 0.016] [optim_t 0.433] [lr 0.002387] [CE 3.774 (3.694)] [KD 0.000 (0.000)] 2024-10-12 01:28:21,808 - Train: 30.04% [112750/375300] [90.1/300.0] [batch_t 0.497 (0.435)] [data_t 0.015] [optim_t 0.482] [lr 0.002386] [CE 3.467 (3.677)] [KD 0.000 (0.000)] 2024-10-12 01:28:43,767 - Train: 30.06% [112800/375300] [90.2/300.0] [batch_t 0.315 (0.439)] [data_t 0.015] [optim_t 0.299] [lr 0.002386] [CE 3.809 (3.710)] [KD 0.000 (0.000)] 2024-10-12 01:29:04,939 - Train: 30.07% [112850/375300] [90.2/300.0] [batch_t 0.368 (0.423)] [data_t 0.016] [optim_t 0.352] [lr 0.002385] [CE 3.579 (3.703)] [KD 0.000 (0.000)] 2024-10-12 01:29:25,287 - Train: 30.08% [112900/375300] [90.2/300.0] [batch_t 0.319 (0.407)] [data_t 0.016] [optim_t 0.304] [lr 0.002385] [CE 3.878 (3.735)] [KD 0.000 (0.000)] 2024-10-12 01:29:45,719 - Train: 30.10% [112950/375300] [90.3/300.0] [batch_t 0.430 (0.409)] [data_t 0.016] [optim_t 0.414] [lr 0.002384] [CE 3.458 (3.688)] [KD 0.000 (0.000)] 2024-10-12 01:30:06,652 - Train: 30.11% [113000/375300] [90.3/300.0] [batch_t 0.318 (0.419)] [data_t 0.016] [optim_t 0.303] [lr 0.002384] [CE 3.807 (3.725)] [KD 0.000 (0.000)] 2024-10-12 01:30:28,521 - Train: 30.12% [113050/375300] [90.4/300.0] [batch_t 0.385 (0.437)] [data_t 0.016] [optim_t 0.370] [lr 0.002383] [CE 3.965 (3.700)] [KD 0.000 (0.000)] 2024-10-12 01:30:50,504 - Train: 30.14% [113100/375300] [90.4/300.0] [batch_t 0.379 (0.440)] [data_t 0.015] [optim_t 0.364] [lr 0.002383] [CE 3.815 (3.709)] [KD 0.000 (0.000)] 2024-10-12 01:31:12,109 - Train: 30.15% [113150/375300] [90.4/300.0] [batch_t 0.426 (0.432)] [data_t 0.015] [optim_t 0.411] [lr 0.002382] [CE 3.535 (3.712)] [KD 0.000 (0.000)] 2024-10-12 01:31:33,531 - Train: 30.16% [113200/375300] [90.5/300.0] [batch_t 0.443 (0.428)] [data_t 0.016] [optim_t 0.427] [lr 0.002382] [CE 3.493 (3.754)] [KD 0.000 (0.000)] 2024-10-12 01:31:54,988 - Train: 30.18% [113250/375300] [90.5/300.0] [batch_t 0.429 (0.429)] [data_t 0.015] [optim_t 0.414] [lr 0.002381] [CE 4.078 (3.690)] [KD 0.000 (0.000)] 2024-10-12 01:32:16,283 - Train: 30.19% [113300/375300] [90.6/300.0] [batch_t 0.471 (0.426)] [data_t 0.015] [optim_t 0.456] [lr 0.002381] [CE 3.501 (3.737)] [KD 0.000 (0.000)] 2024-10-12 01:32:38,306 - Train: 30.20% [113350/375300] [90.6/300.0] [batch_t 0.457 (0.440)] [data_t 0.015] [optim_t 0.441] [lr 0.002380] [CE 3.858 (3.745)] [KD 0.000 (0.000)] 2024-10-12 01:32:59,497 - Train: 30.22% [113400/375300] [90.6/300.0] [batch_t 0.329 (0.424)] [data_t 0.015] [optim_t 0.314] [lr 0.002380] [CE 3.630 (3.711)] [KD 0.000 (0.000)] 2024-10-12 01:33:21,407 - Train: 30.23% [113450/375300] [90.7/300.0] [batch_t 0.429 (0.438)] [data_t 0.016] [optim_t 0.414] [lr 0.002379] [CE 3.803 (3.721)] [KD 0.000 (0.000)] 2024-10-12 01:33:42,182 - Train: 30.24% [113500/375300] [90.7/300.0] [batch_t 0.385 (0.415)] [data_t 0.015] [optim_t 0.369] [lr 0.002379] [CE 3.894 (3.801)] [KD 0.000 (0.000)] 2024-10-12 01:34:03,412 - Train: 30.26% [113550/375300] [90.8/300.0] [batch_t 0.319 (0.424)] [data_t 0.016] [optim_t 0.303] [lr 0.002378] [CE 3.912 (3.727)] [KD 0.000 (0.000)] 2024-10-12 01:34:25,021 - Train: 30.27% [113600/375300] [90.8/300.0] [batch_t 0.439 (0.432)] [data_t 0.016] [optim_t 0.423] [lr 0.002378] [CE 3.650 (3.737)] [KD 0.000 (0.000)] 2024-10-12 01:34:47,072 - Train: 30.28% [113650/375300] [90.8/300.0] [batch_t 0.474 (0.441)] [data_t 0.015] [optim_t 0.458] [lr 0.002377] [CE 3.808 (3.752)] [KD 0.000 (0.000)] 2024-10-12 01:35:09,107 - Train: 30.30% [113700/375300] [90.9/300.0] [batch_t 0.480 (0.441)] [data_t 0.016] [optim_t 0.465] [lr 0.002377] [CE 3.323 (3.707)] [KD 0.000 (0.000)] 2024-10-12 01:35:31,260 - Train: 30.31% [113750/375300] [90.9/300.0] [batch_t 0.493 (0.443)] [data_t 0.016] [optim_t 0.477] [lr 0.002376] [CE 3.690 (3.766)] [KD 0.000 (0.000)] 2024-10-12 01:35:53,319 - Train: 30.32% [113800/375300] [91.0/300.0] [batch_t 0.518 (0.441)] [data_t 0.015] [optim_t 0.502] [lr 0.002376] [CE 3.700 (3.727)] [KD 0.000 (0.000)] 2024-10-12 01:36:09,720 - ==> Total time: 13:49:13 Eta: 1 day, 7:44:29 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 01:36:19,718 - Train: 30.34% [113850/375300] [91.0/300.0] [batch_t 0.795 (0.940)] [data_t 0.016] [optim_t 0.779] [lr 0.002375] [CE 3.478 (3.736)] [KD 0.000 (0.000)] 2024-10-12 01:36:41,162 - Train: 30.35% [113900/375300] [91.0/300.0] [batch_t 0.426 (0.429)] [data_t 0.127] [optim_t 0.299] [lr 0.002375] [CE 3.429 (3.703)] [KD 0.000 (0.000)] 2024-10-12 01:37:04,071 - Train: 30.36% [113950/375300] [91.1/300.0] [batch_t 0.461 (0.458)] [data_t 0.158] [optim_t 0.302] [lr 0.002374] [CE 3.527 (3.765)] [KD 0.000 (0.000)] 2024-10-12 01:37:26,620 - Train: 30.38% [114000/375300] [91.1/300.0] [batch_t 0.314 (0.451)] [data_t 0.016] [optim_t 0.299] [lr 0.002374] [CE 3.568 (3.692)] [KD 0.000 (0.000)] 2024-10-12 01:37:48,140 - Train: 30.39% [114050/375300] [91.2/300.0] [batch_t 0.517 (0.430)] [data_t 0.225] [optim_t 0.292] [lr 0.002373] [CE 3.707 (3.761)] [KD 0.000 (0.000)] 2024-10-12 01:38:09,792 - Train: 30.40% [114100/375300] [91.2/300.0] [batch_t 0.321 (0.433)] [data_t 0.016] [optim_t 0.306] [lr 0.002373] [CE 3.479 (3.724)] [KD 0.000 (0.000)] 2024-10-12 01:38:33,046 - Train: 30.42% [114150/375300] [91.2/300.0] [batch_t 0.810 (0.465)] [data_t 0.015] [optim_t 0.795] [lr 0.002372] [CE 3.637 (3.698)] [KD 0.000 (0.000)] 2024-10-12 01:38:55,843 - Train: 30.43% [114200/375300] [91.3/300.0] [batch_t 0.513 (0.456)] [data_t 0.016] [optim_t 0.497] [lr 0.002372] [CE 3.868 (3.683)] [KD 0.000 (0.000)] 2024-10-12 01:39:18,382 - Train: 30.44% [114250/375300] [91.3/300.0] [batch_t 0.351 (0.451)] [data_t 0.016] [optim_t 0.335] [lr 0.002371] [CE 3.540 (3.717)] [KD 0.000 (0.000)] 2024-10-12 01:39:40,239 - Train: 30.46% [114300/375300] [91.4/300.0] [batch_t 0.418 (0.437)] [data_t 0.015] [optim_t 0.402] [lr 0.002371] [CE 3.942 (3.733)] [KD 0.000 (0.000)] 2024-10-12 01:40:02,225 - Train: 30.47% [114350/375300] [91.4/300.0] [batch_t 0.503 (0.440)] [data_t 0.015] [optim_t 0.488] [lr 0.002370] [CE 3.735 (3.730)] [KD 0.000 (0.000)] 2024-10-12 01:40:24,198 - Train: 30.48% [114400/375300] [91.4/300.0] [batch_t 0.425 (0.439)] [data_t 0.016] [optim_t 0.409] [lr 0.002370] [CE 3.720 (3.702)] [KD 0.000 (0.000)] 2024-10-12 01:40:46,515 - Train: 30.50% [114450/375300] [91.5/300.0] [batch_t 0.400 (0.446)] [data_t 0.016] [optim_t 0.385] [lr 0.002369] [CE 3.569 (3.670)] [KD 0.000 (0.000)] 2024-10-12 01:41:09,130 - Train: 30.51% [114500/375300] [91.5/300.0] [batch_t 0.465 (0.452)] [data_t 0.016] [optim_t 0.450] [lr 0.002369] [CE 3.501 (3.686)] [KD 0.000 (0.000)] 2024-10-12 01:41:31,843 - Train: 30.52% [114550/375300] [91.6/300.0] [batch_t 0.314 (0.454)] [data_t 0.015] [optim_t 0.298] [lr 0.002368] [CE 3.708 (3.755)] [KD 0.000 (0.000)] 2024-10-12 01:41:54,490 - Train: 30.54% [114600/375300] [91.6/300.0] [batch_t 0.436 (0.453)] [data_t 0.016] [optim_t 0.420] [lr 0.002368] [CE 3.707 (3.733)] [KD 0.000 (0.000)] 2024-10-12 01:42:16,847 - Train: 30.55% [114650/375300] [91.6/300.0] [batch_t 0.358 (0.447)] [data_t 0.016] [optim_t 0.342] [lr 0.002367] [CE 3.700 (3.783)] [KD 0.000 (0.000)] 2024-10-12 01:42:38,826 - Train: 30.56% [114700/375300] [91.7/300.0] [batch_t 0.315 (0.439)] [data_t 0.016] [optim_t 0.299] [lr 0.002367] [CE 3.647 (3.764)] [KD 0.000 (0.000)] 2024-10-12 01:43:00,524 - Train: 30.58% [114750/375300] [91.7/300.0] [batch_t 0.504 (0.434)] [data_t 0.016] [optim_t 0.489] [lr 0.002366] [CE 3.595 (3.659)] [KD 0.000 (0.000)] 2024-10-12 01:43:22,335 - Train: 30.59% [114800/375300] [91.8/300.0] [batch_t 0.445 (0.436)] [data_t 0.146] [optim_t 0.298] [lr 0.002365] [CE 3.666 (3.725)] [KD 0.000 (0.000)] 2024-10-12 01:43:44,177 - Train: 30.60% [114850/375300] [91.8/300.0] [batch_t 0.517 (0.437)] [data_t 0.015] [optim_t 0.502] [lr 0.002365] [CE 3.952 (3.729)] [KD 0.000 (0.000)] 2024-10-12 01:44:06,394 - Train: 30.62% [114900/375300] [91.8/300.0] [batch_t 0.542 (0.444)] [data_t 0.016] [optim_t 0.526] [lr 0.002364] [CE 3.606 (3.793)] [KD 0.000 (0.000)] 2024-10-12 01:44:29,543 - Train: 30.63% [114950/375300] [91.9/300.0] [batch_t 0.557 (0.463)] [data_t 0.016] [optim_t 0.542] [lr 0.002364] [CE 3.438 (3.707)] [KD 0.000 (0.000)] 2024-10-12 01:44:51,650 - Train: 30.64% [115000/375300] [91.9/300.0] [batch_t 0.497 (0.442)] [data_t 0.016] [optim_t 0.481] [lr 0.002363] [CE 3.785 (3.750)] [KD 0.000 (0.000)] 2024-10-12 01:45:14,580 - Train: 30.66% [115050/375300] [92.0/300.0] [batch_t 0.518 (0.458)] [data_t 0.016] [optim_t 0.502] [lr 0.002363] [CE 3.540 (3.677)] [KD 0.000 (0.000)] 2024-10-12 01:45:31,895 - ==> Total time: 13:58:35 Eta: 1 day, 7:35:57 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 01:45:41,291 - Train: 30.67% [115100/375300] [92.0/300.0] [batch_t 0.312 (0.994)] [data_t 0.016] [optim_t 0.296] [lr 0.002362] [CE 3.735 (3.721)] [KD 0.000 (0.000)] 2024-10-12 01:46:01,273 - Train: 30.68% [115150/375300] [92.0/300.0] [batch_t 0.414 (0.399)] [data_t 0.016] [optim_t 0.398] [lr 0.002362] [CE 3.330 (3.706)] [KD 0.000 (0.000)] 2024-10-12 01:46:23,130 - Train: 30.70% [115200/375300] [92.1/300.0] [batch_t 0.439 (0.437)] [data_t 0.016] [optim_t 0.424] [lr 0.002361] [CE 3.555 (3.667)] [KD 0.000 (0.000)] 2024-10-12 01:46:44,553 - Train: 30.71% [115250/375300] [92.1/300.0] [batch_t 0.452 (0.428)] [data_t 0.015] [optim_t 0.436] [lr 0.002361] [CE 3.864 (3.747)] [KD 0.000 (0.000)] 2024-10-12 01:47:05,931 - Train: 30.72% [115300/375300] [92.2/300.0] [batch_t 0.499 (0.427)] [data_t 0.207] [optim_t 0.292] [lr 0.002360] [CE 3.527 (3.697)] [KD 0.000 (0.000)] 2024-10-12 01:47:28,019 - Train: 30.74% [115350/375300] [92.2/300.0] [batch_t 0.316 (0.442)] [data_t 0.016] [optim_t 0.300] [lr 0.002360] [CE 3.889 (3.719)] [KD 0.000 (0.000)] 2024-10-12 01:47:50,147 - Train: 30.75% [115400/375300] [92.2/300.0] [batch_t 0.449 (0.442)] [data_t 0.153] [optim_t 0.296] [lr 0.002359] [CE 3.615 (3.693)] [KD 0.000 (0.000)] 2024-10-12 01:48:11,997 - Train: 30.76% [115450/375300] [92.3/300.0] [batch_t 0.386 (0.437)] [data_t 0.090] [optim_t 0.296] [lr 0.002359] [CE 3.380 (3.685)] [KD 0.000 (0.000)] 2024-10-12 01:48:33,679 - Train: 30.78% [115500/375300] [92.3/300.0] [batch_t 0.416 (0.434)] [data_t 0.122] [optim_t 0.294] [lr 0.002358] [CE 3.885 (3.687)] [KD 0.000 (0.000)] 2024-10-12 01:48:56,501 - Train: 30.79% [115550/375300] [92.4/300.0] [batch_t 0.394 (0.456)] [data_t 0.015] [optim_t 0.379] [lr 0.002358] [CE 3.704 (3.681)] [KD 0.000 (0.000)] 2024-10-12 01:49:17,688 - Train: 30.80% [115600/375300] [92.4/300.0] [batch_t 0.433 (0.424)] [data_t 0.135] [optim_t 0.298] [lr 0.002357] [CE 3.741 (3.718)] [KD 0.000 (0.000)] 2024-10-12 01:49:39,706 - Train: 30.82% [115650/375300] [92.4/300.0] [batch_t 0.467 (0.440)] [data_t 0.015] [optim_t 0.452] [lr 0.002357] [CE 3.575 (3.730)] [KD 0.000 (0.000)] 2024-10-12 01:50:02,284 - Train: 30.83% [115700/375300] [92.5/300.0] [batch_t 0.415 (0.451)] [data_t 0.015] [optim_t 0.399] [lr 0.002356] [CE 3.454 (3.686)] [KD 0.000 (0.000)] 2024-10-12 01:50:24,588 - Train: 30.84% [115750/375300] [92.5/300.0] [batch_t 0.434 (0.446)] [data_t 0.016] [optim_t 0.418] [lr 0.002356] [CE 3.732 (3.735)] [KD 0.000 (0.000)] 2024-10-12 01:50:47,363 - Train: 30.86% [115800/375300] [92.6/300.0] [batch_t 0.430 (0.455)] [data_t 0.016] [optim_t 0.414] [lr 0.002355] [CE 3.644 (3.709)] [KD 0.000 (0.000)] 2024-10-12 01:51:08,123 - Train: 30.87% [115850/375300] [92.6/300.0] [batch_t 0.399 (0.415)] [data_t 0.016] [optim_t 0.383] [lr 0.002355] [CE 3.601 (3.717)] [KD 0.000 (0.000)] 2024-10-12 01:51:29,104 - Train: 30.88% [115900/375300] [92.6/300.0] [batch_t 0.411 (0.419)] [data_t 0.016] [optim_t 0.395] [lr 0.002354] [CE 3.758 (3.746)] [KD 0.000 (0.000)] 2024-10-12 01:51:51,332 - Train: 30.90% [115950/375300] [92.7/300.0] [batch_t 0.452 (0.444)] [data_t 0.155] [optim_t 0.296] [lr 0.002354] [CE 3.842 (3.674)] [KD 0.000 (0.000)] 2024-10-12 01:52:13,443 - Train: 30.91% [116000/375300] [92.7/300.0] [batch_t 0.474 (0.442)] [data_t 0.015] [optim_t 0.459] [lr 0.002353] [CE 3.573 (3.709)] [KD 0.000 (0.000)] 2024-10-12 01:52:35,231 - Train: 30.92% [116050/375300] [92.8/300.0] [batch_t 0.388 (0.436)] [data_t 0.016] [optim_t 0.373] [lr 0.002353] [CE 3.816 (3.710)] [KD 0.000 (0.000)] 2024-10-12 01:52:55,929 - Train: 30.94% [116100/375300] [92.8/300.0] [batch_t 0.318 (0.414)] [data_t 0.016] [optim_t 0.302] [lr 0.002352] [CE 3.900 (3.736)] [KD 0.000 (0.000)] 2024-10-12 01:53:17,368 - Train: 30.95% [116150/375300] [92.8/300.0] [batch_t 0.502 (0.429)] [data_t 0.015] [optim_t 0.487] [lr 0.002352] [CE 3.390 (3.660)] [KD 0.000 (0.000)] 2024-10-12 01:53:38,462 - Train: 30.96% [116200/375300] [92.9/300.0] [batch_t 0.464 (0.422)] [data_t 0.015] [optim_t 0.449] [lr 0.002351] [CE 3.925 (3.743)] [KD 0.000 (0.000)] 2024-10-12 01:53:59,801 - Train: 30.98% [116250/375300] [92.9/300.0] [batch_t 0.459 (0.427)] [data_t 0.015] [optim_t 0.444] [lr 0.002351] [CE 3.824 (3.736)] [KD 0.000 (0.000)] 2024-10-12 01:54:21,363 - Train: 30.99% [116300/375300] [93.0/300.0] [batch_t 0.316 (0.431)] [data_t 0.015] [optim_t 0.301] [lr 0.002350] [CE 3.677 (3.715)] [KD 0.000 (0.000)] 2024-10-12 01:54:38,478 - ==> Total time: 14:07:42 Eta: 1 day, 7:26:49 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 01:54:47,320 - Train: 31.00% [116350/375300] [93.0/300.0] [batch_t 0.313 (1.057)] [data_t 0.016] [optim_t 0.297] [lr 0.002350] [CE 3.528 (3.730)] [KD 0.000 (0.000)] 2024-10-12 01:55:06,963 - Train: 31.02% [116400/375300] [93.0/300.0] [batch_t 0.337 (0.393)] [data_t 0.015] [optim_t 0.321] [lr 0.002349] [CE 4.202 (3.647)] [KD 0.000 (0.000)] 2024-10-12 01:55:28,342 - Train: 31.03% [116450/375300] [93.1/300.0] [batch_t 0.335 (0.427)] [data_t 0.015] [optim_t 0.320] [lr 0.002349] [CE 3.547 (3.682)] [KD 0.000 (0.000)] 2024-10-12 01:55:50,495 - Train: 31.04% [116500/375300] [93.1/300.0] [batch_t 0.461 (0.443)] [data_t 0.015] [optim_t 0.445] [lr 0.002348] [CE 3.499 (3.685)] [KD 0.000 (0.000)] 2024-10-12 01:56:12,242 - Train: 31.06% [116550/375300] [93.2/300.0] [batch_t 0.459 (0.435)] [data_t 0.015] [optim_t 0.444] [lr 0.002348] [CE 3.834 (3.714)] [KD 0.000 (0.000)] 2024-10-12 01:56:33,478 - Train: 31.07% [116600/375300] [93.2/300.0] [batch_t 0.431 (0.425)] [data_t 0.015] [optim_t 0.416] [lr 0.002347] [CE 3.833 (3.666)] [KD 0.000 (0.000)] 2024-10-12 01:56:54,802 - Train: 31.08% [116650/375300] [93.2/300.0] [batch_t 0.368 (0.426)] [data_t 0.015] [optim_t 0.352] [lr 0.002347] [CE 3.775 (3.705)] [KD 0.000 (0.000)] 2024-10-12 01:57:16,221 - Train: 31.10% [116700/375300] [93.3/300.0] [batch_t 0.315 (0.428)] [data_t 0.016] [optim_t 0.300] [lr 0.002346] [CE 3.669 (3.731)] [KD 0.000 (0.000)] 2024-10-12 01:57:37,350 - Train: 31.11% [116750/375300] [93.3/300.0] [batch_t 0.422 (0.422)] [data_t 0.016] [optim_t 0.407] [lr 0.002346] [CE 3.420 (3.732)] [KD 0.000 (0.000)] 2024-10-12 01:57:58,858 - Train: 31.12% [116800/375300] [93.4/300.0] [batch_t 0.423 (0.430)] [data_t 0.016] [optim_t 0.407] [lr 0.002345] [CE 3.956 (3.687)] [KD 0.000 (0.000)] 2024-10-12 01:58:20,249 - Train: 31.14% [116850/375300] [93.4/300.0] [batch_t 0.402 (0.428)] [data_t 0.016] [optim_t 0.387] [lr 0.002344] [CE 3.591 (3.714)] [KD 0.000 (0.000)] 2024-10-12 01:58:42,066 - Train: 31.15% [116900/375300] [93.4/300.0] [batch_t 0.421 (0.436)] [data_t 0.016] [optim_t 0.405] [lr 0.002344] [CE 3.468 (3.724)] [KD 0.000 (0.000)] 2024-10-12 01:59:03,983 - Train: 31.16% [116950/375300] [93.5/300.0] [batch_t 0.480 (0.438)] [data_t 0.015] [optim_t 0.464] [lr 0.002343] [CE 3.892 (3.670)] [KD 0.000 (0.000)] 2024-10-12 01:59:25,638 - Train: 31.18% [117000/375300] [93.5/300.0] [batch_t 0.471 (0.433)] [data_t 0.016] [optim_t 0.456] [lr 0.002343] [CE 3.817 (3.754)] [KD 0.000 (0.000)] 2024-10-12 01:59:46,920 - Train: 31.19% [117050/375300] [93.6/300.0] [batch_t 0.471 (0.426)] [data_t 0.016] [optim_t 0.456] [lr 0.002342] [CE 3.822 (3.692)] [KD 0.000 (0.000)] 2024-10-12 02:00:08,127 - Train: 31.20% [117100/375300] [93.6/300.0] [batch_t 0.458 (0.424)] [data_t 0.015] [optim_t 0.443] [lr 0.002342] [CE 3.876 (3.703)] [KD 0.000 (0.000)] 2024-10-12 02:00:29,935 - Train: 31.22% [117150/375300] [93.6/300.0] [batch_t 0.435 (0.436)] [data_t 0.015] [optim_t 0.420] [lr 0.002341] [CE 3.555 (3.761)] [KD 0.000 (0.000)] 2024-10-12 02:00:51,663 - Train: 31.23% [117200/375300] [93.7/300.0] [batch_t 0.444 (0.434)] [data_t 0.015] [optim_t 0.429] [lr 0.002341] [CE 3.964 (3.699)] [KD 0.000 (0.000)] 2024-10-12 02:01:13,183 - Train: 31.24% [117250/375300] [93.7/300.0] [batch_t 0.474 (0.430)] [data_t 0.016] [optim_t 0.459] [lr 0.002340] [CE 3.857 (3.702)] [KD 0.000 (0.000)] 2024-10-12 02:01:34,578 - Train: 31.25% [117300/375300] [93.8/300.0] [batch_t 0.458 (0.428)] [data_t 0.016] [optim_t 0.442] [lr 0.002340] [CE 3.567 (3.719)] [KD 0.000 (0.000)] 2024-10-12 02:01:56,438 - Train: 31.27% [117350/375300] [93.8/300.0] [batch_t 0.385 (0.437)] [data_t 0.015] [optim_t 0.369] [lr 0.002339] [CE 3.362 (3.688)] [KD 0.000 (0.000)] 2024-10-12 02:02:17,799 - Train: 31.28% [117400/375300] [93.8/300.0] [batch_t 0.409 (0.427)] [data_t 0.015] [optim_t 0.393] [lr 0.002339] [CE 3.831 (3.713)] [KD 0.000 (0.000)] 2024-10-12 02:02:39,239 - Train: 31.29% [117450/375300] [93.9/300.0] [batch_t 0.389 (0.429)] [data_t 0.015] [optim_t 0.374] [lr 0.002338] [CE 3.718 (3.732)] [KD 0.000 (0.000)] 2024-10-12 02:03:01,646 - Train: 31.31% [117500/375300] [93.9/300.0] [batch_t 0.488 (0.448)] [data_t 0.016] [optim_t 0.473] [lr 0.002338] [CE 3.774 (3.702)] [KD 0.000 (0.000)] 2024-10-12 02:03:23,080 - Train: 31.32% [117550/375300] [94.0/300.0] [batch_t 0.467 (0.429)] [data_t 0.015] [optim_t 0.451] [lr 0.002337] [CE 3.591 (3.671)] [KD 0.000 (0.000)] 2024-10-12 02:03:40,673 - ==> Total time: 14:16:44 Eta: 1 day, 7:17:32 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 02:03:49,078 - Train: 31.33% [117600/375300] [94.0/300.0] [batch_t 0.316 (1.154)] [data_t 0.015] [optim_t 0.301] [lr 0.002337] [CE 3.649 (3.749)] [KD 0.000 (0.000)] 2024-10-12 02:04:09,786 - Train: 31.35% [117650/375300] [94.0/300.0] [batch_t 0.484 (0.414)] [data_t 0.015] [optim_t 0.469] [lr 0.002336] [CE 3.737 (3.656)] [KD 0.000 (0.000)] 2024-10-12 02:04:31,589 - Train: 31.36% [117700/375300] [94.1/300.0] [batch_t 0.444 (0.436)] [data_t 0.015] [optim_t 0.429] [lr 0.002336] [CE 3.887 (3.707)] [KD 0.000 (0.000)] 2024-10-12 02:04:53,690 - Train: 31.37% [117750/375300] [94.1/300.0] [batch_t 0.615 (0.442)] [data_t 0.016] [optim_t 0.599] [lr 0.002335] [CE 3.669 (3.689)] [KD 0.000 (0.000)] 2024-10-12 02:05:15,586 - Train: 31.39% [117800/375300] [94.2/300.0] [batch_t 0.449 (0.438)] [data_t 0.016] [optim_t 0.433] [lr 0.002335] [CE 3.740 (3.675)] [KD 0.000 (0.000)] 2024-10-12 02:05:37,978 - Train: 31.40% [117850/375300] [94.2/300.0] [batch_t 0.464 (0.448)] [data_t 0.015] [optim_t 0.448] [lr 0.002334] [CE 3.817 (3.684)] [KD 0.000 (0.000)] 2024-10-12 02:06:00,419 - Train: 31.41% [117900/375300] [94.2/300.0] [batch_t 0.449 (0.449)] [data_t 0.016] [optim_t 0.434] [lr 0.002334] [CE 3.568 (3.715)] [KD 0.000 (0.000)] 2024-10-12 02:06:22,153 - Train: 31.43% [117950/375300] [94.3/300.0] [batch_t 0.389 (0.435)] [data_t 0.015] [optim_t 0.374] [lr 0.002333] [CE 3.876 (3.679)] [KD 0.000 (0.000)] 2024-10-12 02:06:43,492 - Train: 31.44% [118000/375300] [94.3/300.0] [batch_t 0.415 (0.427)] [data_t 0.016] [optim_t 0.399] [lr 0.002333] [CE 4.042 (3.663)] [KD 0.000 (0.000)] 2024-10-12 02:07:04,988 - Train: 31.45% [118050/375300] [94.4/300.0] [batch_t 0.459 (0.430)] [data_t 0.016] [optim_t 0.443] [lr 0.002332] [CE 3.452 (3.698)] [KD 0.000 (0.000)] 2024-10-12 02:07:26,623 - Train: 31.47% [118100/375300] [94.4/300.0] [batch_t 0.325 (0.433)] [data_t 0.016] [optim_t 0.309] [lr 0.002332] [CE 3.591 (3.721)] [KD 0.000 (0.000)] 2024-10-12 02:07:48,648 - Train: 31.48% [118150/375300] [94.4/300.0] [batch_t 0.431 (0.440)] [data_t 0.016] [optim_t 0.415] [lr 0.002331] [CE 3.553 (3.723)] [KD 0.000 (0.000)] 2024-10-12 02:08:10,806 - Train: 31.49% [118200/375300] [94.5/300.0] [batch_t 0.487 (0.443)] [data_t 0.016] [optim_t 0.471] [lr 0.002331] [CE 3.899 (3.690)] [KD 0.000 (0.000)] 2024-10-12 02:08:32,633 - Train: 31.51% [118250/375300] [94.5/300.0] [batch_t 0.442 (0.436)] [data_t 0.016] [optim_t 0.427] [lr 0.002330] [CE 3.489 (3.713)] [KD 0.000 (0.000)] 2024-10-12 02:08:54,289 - Train: 31.52% [118300/375300] [94.6/300.0] [batch_t 0.429 (0.433)] [data_t 0.016] [optim_t 0.413] [lr 0.002329] [CE 3.404 (3.706)] [KD 0.000 (0.000)] 2024-10-12 02:09:15,921 - Train: 31.53% [118350/375300] [94.6/300.0] [batch_t 0.419 (0.432)] [data_t 0.016] [optim_t 0.403] [lr 0.002329] [CE 3.956 (3.699)] [KD 0.000 (0.000)] 2024-10-12 02:09:37,807 - Train: 31.55% [118400/375300] [94.6/300.0] [batch_t 0.424 (0.438)] [data_t 0.016] [optim_t 0.409] [lr 0.002328] [CE 3.911 (3.758)] [KD 0.000 (0.000)] 2024-10-12 02:09:59,092 - Train: 31.56% [118450/375300] [94.7/300.0] [batch_t 0.419 (0.426)] [data_t 0.016] [optim_t 0.404] [lr 0.002328] [CE 3.884 (3.681)] [KD 0.000 (0.000)] 2024-10-12 02:10:21,488 - Train: 31.57% [118500/375300] [94.7/300.0] [batch_t 0.479 (0.448)] [data_t 0.016] [optim_t 0.464] [lr 0.002327] [CE 3.614 (3.699)] [KD 0.000 (0.000)] 2024-10-12 02:10:43,052 - Train: 31.59% [118550/375300] [94.8/300.0] [batch_t 0.443 (0.431)] [data_t 0.016] [optim_t 0.428] [lr 0.002327] [CE 3.674 (3.759)] [KD 0.000 (0.000)] 2024-10-12 02:11:04,535 - Train: 31.60% [118600/375300] [94.8/300.0] [batch_t 0.512 (0.430)] [data_t 0.016] [optim_t 0.497] [lr 0.002326] [CE 3.972 (3.687)] [KD 0.000 (0.000)] 2024-10-12 02:11:26,637 - Train: 31.61% [118650/375300] [94.8/300.0] [batch_t 0.392 (0.442)] [data_t 0.016] [optim_t 0.377] [lr 0.002326] [CE 4.050 (3.723)] [KD 0.000 (0.000)] 2024-10-12 02:11:48,201 - Train: 31.63% [118700/375300] [94.9/300.0] [batch_t 0.441 (0.431)] [data_t 0.016] [optim_t 0.425] [lr 0.002325] [CE 3.660 (3.703)] [KD 0.000 (0.000)] 2024-10-12 02:12:09,903 - Train: 31.64% [118750/375300] [94.9/300.0] [batch_t 0.485 (0.434)] [data_t 0.016] [optim_t 0.469] [lr 0.002325] [CE 3.980 (3.715)] [KD 0.000 (0.000)] 2024-10-12 02:12:31,794 - Train: 31.65% [118800/375300] [95.0/300.0] [batch_t 0.409 (0.438)] [data_t 0.016] [optim_t 0.393] [lr 0.002324] [CE 3.560 (3.661)] [KD 0.000 (0.000)] 2024-10-12 02:13:11,462 - Test (net): 100.00% [50/50] [batch_t 0.134 (0.429)] [top1_cnt 35777] [top5_cnt 45587] [top_all 50000] 2024-10-12 02:13:11,462 - net: 71.554 (91.174) 2024-10-12 02:13:33,938 - Test (net_E): 100.00% [50/50] [batch_t 0.151 (0.440)] [top1_cnt 38763] [top5_cnt 46995] [top_all 50000] 2024-10-12 02:13:33,938 - net_E: 77.526 (93.990) 2024-10-12 02:13:34,179 - Max [top1: 71.818 (epoch: 85)] [top1-ema: 77.526 (epoch: 95)] 2024-10-12 02:13:34,179 - ==> Total time: 14:26:38 Eta: 1 day, 7:10:06 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 02:13:43,561 - Train: 31.67% [118850/375300] [95.0/300.0] [batch_t 0.309 (0.921)] [data_t 0.016] [optim_t 0.294] [lr 0.002324] [CE 3.495 (3.640)] [KD 0.000 (0.000)] 2024-10-12 02:14:02,765 - Train: 31.68% [118900/375300] [95.0/300.0] [batch_t 0.464 (0.384)] [data_t 0.165] [optim_t 0.299] [lr 0.002323] [CE 3.766 (3.745)] [KD 0.000 (0.000)] 2024-10-12 02:14:23,865 - Train: 31.69% [118950/375300] [95.1/300.0] [batch_t 0.409 (0.422)] [data_t 0.115] [optim_t 0.294] [lr 0.002323] [CE 3.877 (3.744)] [KD 0.000 (0.000)] 2024-10-12 02:14:45,695 - Train: 31.71% [119000/375300] [95.1/300.0] [batch_t 0.530 (0.436)] [data_t 0.153] [optim_t 0.377] [lr 0.002322] [CE 3.938 (3.719)] [KD 0.000 (0.000)] 2024-10-12 02:15:06,851 - Train: 31.72% [119050/375300] [95.2/300.0] [batch_t 0.432 (0.423)] [data_t 0.132] [optim_t 0.300] [lr 0.002322] [CE 3.701 (3.689)] [KD 0.000 (0.000)] 2024-10-12 02:15:28,253 - Train: 31.73% [119100/375300] [95.2/300.0] [batch_t 0.318 (0.428)] [data_t 0.016] [optim_t 0.302] [lr 0.002321] [CE 3.565 (3.687)] [KD 0.000 (0.000)] 2024-10-12 02:15:50,084 - Train: 31.75% [119150/375300] [95.2/300.0] [batch_t 0.430 (0.436)] [data_t 0.016] [optim_t 0.414] [lr 0.002321] [CE 3.546 (3.676)] [KD 0.000 (0.000)] 2024-10-12 02:16:12,371 - Train: 31.76% [119200/375300] [95.3/300.0] [batch_t 0.503 (0.446)] [data_t 0.209] [optim_t 0.294] [lr 0.002320] [CE 3.550 (3.693)] [KD 0.000 (0.000)] 2024-10-12 02:16:34,449 - Train: 31.77% [119250/375300] [95.3/300.0] [batch_t 0.399 (0.441)] [data_t 0.016] [optim_t 0.383] [lr 0.002320] [CE 3.727 (3.690)] [KD 0.000 (0.000)] 2024-10-12 02:16:56,026 - Train: 31.79% [119300/375300] [95.4/300.0] [batch_t 0.418 (0.431)] [data_t 0.016] [optim_t 0.403] [lr 0.002319] [CE 3.652 (3.667)] [KD 0.000 (0.000)] 2024-10-12 02:17:17,554 - Train: 31.80% [119350/375300] [95.4/300.0] [batch_t 0.455 (0.430)] [data_t 0.016] [optim_t 0.439] [lr 0.002319] [CE 3.669 (3.699)] [KD 0.000 (0.000)] 2024-10-12 02:17:39,776 - Train: 31.81% [119400/375300] [95.4/300.0] [batch_t 0.463 (0.444)] [data_t 0.016] [optim_t 0.447] [lr 0.002318] [CE 3.737 (3.660)] [KD 0.000 (0.000)] 2024-10-12 02:18:01,232 - Train: 31.83% [119450/375300] [95.5/300.0] [batch_t 0.422 (0.429)] [data_t 0.016] [optim_t 0.406] [lr 0.002317] [CE 3.511 (3.681)] [KD 0.000 (0.000)] 2024-10-12 02:18:22,873 - Train: 31.84% [119500/375300] [95.5/300.0] [batch_t 0.440 (0.433)] [data_t 0.016] [optim_t 0.424] [lr 0.002317] [CE 3.950 (3.682)] [KD 0.000 (0.000)] 2024-10-12 02:18:44,699 - Train: 31.85% [119550/375300] [95.6/300.0] [batch_t 0.455 (0.436)] [data_t 0.016] [optim_t 0.439] [lr 0.002316] [CE 3.973 (3.695)] [KD 0.000 (0.000)] 2024-10-12 02:19:07,236 - Train: 31.87% [119600/375300] [95.6/300.0] [batch_t 0.454 (0.451)] [data_t 0.016] [optim_t 0.438] [lr 0.002316] [CE 3.369 (3.695)] [KD 0.000 (0.000)] 2024-10-12 02:19:29,564 - Train: 31.88% [119650/375300] [95.6/300.0] [batch_t 0.478 (0.446)] [data_t 0.016] [optim_t 0.462] [lr 0.002315] [CE 4.103 (3.667)] [KD 0.000 (0.000)] 2024-10-12 02:19:52,138 - Train: 31.89% [119700/375300] [95.7/300.0] [batch_t 0.425 (0.451)] [data_t 0.015] [optim_t 0.409] [lr 0.002315] [CE 3.845 (3.688)] [KD 0.000 (0.000)] 2024-10-12 02:20:12,879 - Train: 31.91% [119750/375300] [95.7/300.0] [batch_t 0.322 (0.415)] [data_t 0.015] [optim_t 0.306] [lr 0.002314] [CE 3.170 (3.714)] [KD 0.000 (0.000)] 2024-10-12 02:20:33,985 - Train: 31.92% [119800/375300] [95.8/300.0] [batch_t 0.415 (0.422)] [data_t 0.016] [optim_t 0.400] [lr 0.002314] [CE 3.761 (3.742)] [KD 0.000 (0.000)] 2024-10-12 02:20:56,278 - Train: 31.93% [119850/375300] [95.8/300.0] [batch_t 0.953 (0.446)] [data_t 0.016] [optim_t 0.938] [lr 0.002313] [CE 3.706 (3.694)] [KD 0.000 (0.000)] 2024-10-12 02:21:17,726 - Train: 31.95% [119900/375300] [95.8/300.0] [batch_t 0.455 (0.429)] [data_t 0.016] [optim_t 0.439] [lr 0.002313] [CE 3.161 (3.721)] [KD 0.000 (0.000)] 2024-10-12 02:21:39,675 - Train: 31.96% [119950/375300] [95.9/300.0] [batch_t 0.482 (0.439)] [data_t 0.016] [optim_t 0.466] [lr 0.002312] [CE 3.749 (3.674)] [KD 0.000 (0.000)] 2024-10-12 02:22:00,979 - Train: 31.97% [120000/375300] [95.9/300.0] [batch_t 0.424 (0.426)] [data_t 0.016] [optim_t 0.409] [lr 0.002312] [CE 3.239 (3.735)] [KD 0.000 (0.000)] 2024-10-12 02:22:23,365 - Train: 31.99% [120050/375300] [96.0/300.0] [batch_t 0.495 (0.448)] [data_t 0.016] [optim_t 0.480] [lr 0.002311] [CE 3.941 (3.716)] [KD 0.000 (0.000)] 2024-10-12 02:22:42,464 - ==> Total time: 14:35:46 Eta: 1 day, 7:01:01 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 02:22:50,008 - Train: 32.00% [120100/375300] [96.0/300.0] [batch_t 0.315 (1.466)] [data_t 0.016] [optim_t 0.299] [lr 0.002311] [CE 3.788 (3.668)] [KD 0.000 (0.000)] 2024-10-12 02:23:09,807 - Train: 32.01% [120150/375300] [96.0/300.0] [batch_t 0.399 (0.396)] [data_t 0.015] [optim_t 0.384] [lr 0.002310] [CE 3.926 (3.699)] [KD 0.000 (0.000)] 2024-10-12 02:23:31,209 - Train: 32.03% [120200/375300] [96.1/300.0] [batch_t 0.467 (0.428)] [data_t 0.016] [optim_t 0.451] [lr 0.002310] [CE 3.850 (3.702)] [KD 0.000 (0.000)] 2024-10-12 02:23:52,927 - Train: 32.04% [120250/375300] [96.1/300.0] [batch_t 0.457 (0.434)] [data_t 0.015] [optim_t 0.442] [lr 0.002309] [CE 3.381 (3.724)] [KD 0.000 (0.000)] 2024-10-12 02:24:15,398 - Train: 32.05% [120300/375300] [96.2/300.0] [batch_t 0.434 (0.449)] [data_t 0.016] [optim_t 0.418] [lr 0.002309] [CE 3.814 (3.705)] [KD 0.000 (0.000)] 2024-10-12 02:24:37,237 - Train: 32.07% [120350/375300] [96.2/300.0] [batch_t 0.450 (0.437)] [data_t 0.016] [optim_t 0.434] [lr 0.002308] [CE 3.308 (3.681)] [KD 0.000 (0.000)] 2024-10-12 02:24:59,032 - Train: 32.08% [120400/375300] [96.2/300.0] [batch_t 0.423 (0.436)] [data_t 0.015] [optim_t 0.407] [lr 0.002308] [CE 3.631 (3.706)] [KD 0.000 (0.000)] 2024-10-12 02:25:21,144 - Train: 32.09% [120450/375300] [96.3/300.0] [batch_t 0.395 (0.442)] [data_t 0.016] [optim_t 0.379] [lr 0.002307] [CE 3.612 (3.715)] [KD 0.000 (0.000)] 2024-10-12 02:25:42,902 - Train: 32.11% [120500/375300] [96.3/300.0] [batch_t 0.427 (0.435)] [data_t 0.016] [optim_t 0.411] [lr 0.002306] [CE 3.806 (3.719)] [KD 0.000 (0.000)] 2024-10-12 02:26:05,302 - Train: 32.12% [120550/375300] [96.4/300.0] [batch_t 0.442 (0.448)] [data_t 0.016] [optim_t 0.426] [lr 0.002306] [CE 3.746 (3.700)] [KD 0.000 (0.000)] 2024-10-12 02:26:27,621 - Train: 32.13% [120600/375300] [96.4/300.0] [batch_t 0.471 (0.446)] [data_t 0.016] [optim_t 0.455] [lr 0.002305] [CE 3.900 (3.771)] [KD 0.000 (0.000)] 2024-10-12 02:26:49,853 - Train: 32.15% [120650/375300] [96.4/300.0] [batch_t 0.447 (0.445)] [data_t 0.016] [optim_t 0.431] [lr 0.002305] [CE 3.808 (3.743)] [KD 0.000 (0.000)] 2024-10-12 02:27:12,169 - Train: 32.16% [120700/375300] [96.5/300.0] [batch_t 0.470 (0.446)] [data_t 0.016] [optim_t 0.454] [lr 0.002304] [CE 3.439 (3.690)] [KD 0.000 (0.000)] 2024-10-12 02:27:34,654 - Train: 32.17% [120750/375300] [96.5/300.0] [batch_t 0.451 (0.450)] [data_t 0.016] [optim_t 0.436] [lr 0.002304] [CE 3.441 (3.716)] [KD 0.000 (0.000)] 2024-10-12 02:27:57,152 - Train: 32.19% [120800/375300] [96.6/300.0] [batch_t 0.411 (0.450)] [data_t 0.016] [optim_t 0.395] [lr 0.002303] [CE 3.560 (3.699)] [KD 0.000 (0.000)] 2024-10-12 02:28:19,271 - Train: 32.20% [120850/375300] [96.6/300.0] [batch_t 0.498 (0.442)] [data_t 0.016] [optim_t 0.482] [lr 0.002303] [CE 3.810 (3.747)] [KD 0.000 (0.000)] 2024-10-12 02:28:40,728 - Train: 32.21% [120900/375300] [96.6/300.0] [batch_t 0.388 (0.429)] [data_t 0.017] [optim_t 0.371] [lr 0.002302] [CE 3.621 (3.682)] [KD 0.000 (0.000)] 2024-10-12 02:29:02,104 - Train: 32.23% [120950/375300] [96.7/300.0] [batch_t 0.419 (0.427)] [data_t 0.016] [optim_t 0.404] [lr 0.002302] [CE 3.652 (3.723)] [KD 0.000 (0.000)] 2024-10-12 02:29:24,431 - Train: 32.24% [121000/375300] [96.7/300.0] [batch_t 0.430 (0.446)] [data_t 0.016] [optim_t 0.414] [lr 0.002301] [CE 3.856 (3.703)] [KD 0.000 (0.000)] 2024-10-12 02:29:47,026 - Train: 32.25% [121050/375300] [96.8/300.0] [batch_t 0.314 (0.452)] [data_t 0.016] [optim_t 0.298] [lr 0.002301] [CE 3.576 (3.646)] [KD 0.000 (0.000)] 2024-10-12 02:30:09,282 - Train: 32.27% [121100/375300] [96.8/300.0] [batch_t 0.382 (0.445)] [data_t 0.016] [optim_t 0.367] [lr 0.002300] [CE 3.789 (3.651)] [KD 0.000 (0.000)] 2024-10-12 02:30:31,630 - Train: 32.28% [121150/375300] [96.8/300.0] [batch_t 0.422 (0.447)] [data_t 0.016] [optim_t 0.406] [lr 0.002300] [CE 3.784 (3.738)] [KD 0.000 (0.000)] 2024-10-12 02:30:53,290 - Train: 32.29% [121200/375300] [96.9/300.0] [batch_t 0.489 (0.433)] [data_t 0.016] [optim_t 0.473] [lr 0.002299] [CE 3.368 (3.690)] [KD 0.000 (0.000)] 2024-10-12 02:31:14,617 - Train: 32.31% [121250/375300] [96.9/300.0] [batch_t 0.439 (0.426)] [data_t 0.015] [optim_t 0.424] [lr 0.002299] [CE 4.071 (3.707)] [KD 0.000 (0.000)] 2024-10-12 02:31:36,786 - Train: 32.32% [121300/375300] [97.0/300.0] [batch_t 0.424 (0.443)] [data_t 0.016] [optim_t 0.408] [lr 0.002298] [CE 3.825 (3.738)] [KD 0.000 (0.000)] 2024-10-12 02:31:55,943 - ==> Total time: 14:44:59 Eta: 1 day, 6:52:06 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 02:32:03,446 - Train: 32.33% [121350/375300] [97.0/300.0] [batch_t 0.330 (1.906)] [data_t 0.016] [optim_t 0.314] [lr 0.002298] [CE 4.048 (3.885)] [KD 0.000 (0.000)] 2024-10-12 02:32:24,656 - Train: 32.35% [121400/375300] [97.0/300.0] [batch_t 0.394 (0.424)] [data_t 0.094] [optim_t 0.301] [lr 0.002297] [CE 3.843 (3.646)] [KD 0.000 (0.000)] 2024-10-12 02:32:47,061 - Train: 32.36% [121450/375300] [97.1/300.0] [batch_t 0.460 (0.448)] [data_t 0.015] [optim_t 0.445] [lr 0.002296] [CE 3.665 (3.643)] [KD 0.000 (0.000)] 2024-10-12 02:33:10,045 - Train: 32.37% [121500/375300] [97.1/300.0] [batch_t 0.436 (0.460)] [data_t 0.015] [optim_t 0.420] [lr 0.002296] [CE 3.560 (3.718)] [KD 0.000 (0.000)] 2024-10-12 02:33:32,283 - Train: 32.39% [121550/375300] [97.2/300.0] [batch_t 0.349 (0.445)] [data_t 0.015] [optim_t 0.333] [lr 0.002295] [CE 3.487 (3.679)] [KD 0.000 (0.000)] 2024-10-12 02:33:54,025 - Train: 32.40% [121600/375300] [97.2/300.0] [batch_t 0.378 (0.435)] [data_t 0.016] [optim_t 0.362] [lr 0.002295] [CE 3.728 (3.663)] [KD 0.000 (0.000)] 2024-10-12 02:34:16,130 - Train: 32.41% [121650/375300] [97.2/300.0] [batch_t 0.452 (0.442)] [data_t 0.016] [optim_t 0.436] [lr 0.002294] [CE 4.061 (3.729)] [KD 0.000 (0.000)] 2024-10-12 02:34:38,201 - Train: 32.43% [121700/375300] [97.3/300.0] [batch_t 0.527 (0.441)] [data_t 0.015] [optim_t 0.511] [lr 0.002294] [CE 3.685 (3.667)] [KD 0.000 (0.000)] 2024-10-12 02:34:59,891 - Train: 32.44% [121750/375300] [97.3/300.0] [batch_t 0.443 (0.434)] [data_t 0.016] [optim_t 0.427] [lr 0.002293] [CE 3.740 (3.728)] [KD 0.000 (0.000)] 2024-10-12 02:35:22,105 - Train: 32.45% [121800/375300] [97.4/300.0] [batch_t 0.457 (0.444)] [data_t 0.016] [optim_t 0.441] [lr 0.002293] [CE 3.416 (3.680)] [KD 0.000 (0.000)] 2024-10-12 02:35:43,445 - Train: 32.47% [121850/375300] [97.4/300.0] [batch_t 0.423 (0.427)] [data_t 0.016] [optim_t 0.407] [lr 0.002292] [CE 4.061 (3.691)] [KD 0.000 (0.000)] 2024-10-12 02:36:05,062 - Train: 32.48% [121900/375300] [97.4/300.0] [batch_t 0.423 (0.432)] [data_t 0.016] [optim_t 0.407] [lr 0.002292] [CE 3.961 (3.673)] [KD 0.000 (0.000)] 2024-10-12 02:36:26,847 - Train: 32.49% [121950/375300] [97.5/300.0] [batch_t 0.336 (0.436)] [data_t 0.016] [optim_t 0.321] [lr 0.002291] [CE 3.356 (3.746)] [KD 0.000 (0.000)] 2024-10-12 02:36:48,815 - Train: 32.51% [122000/375300] [97.5/300.0] [batch_t 0.493 (0.439)] [data_t 0.015] [optim_t 0.478] [lr 0.002291] [CE 4.218 (3.688)] [KD 0.000 (0.000)] 2024-10-12 02:37:11,132 - Train: 32.52% [122050/375300] [97.6/300.0] [batch_t 0.390 (0.446)] [data_t 0.016] [optim_t 0.374] [lr 0.002290] [CE 3.758 (3.716)] [KD 0.000 (0.000)] 2024-10-12 02:37:33,310 - Train: 32.53% [122100/375300] [97.6/300.0] [batch_t 0.489 (0.443)] [data_t 0.193] [optim_t 0.297] [lr 0.002290] [CE 3.317 (3.717)] [KD 0.000 (0.000)] 2024-10-12 02:37:55,166 - Train: 32.55% [122150/375300] [97.6/300.0] [batch_t 0.472 (0.437)] [data_t 0.175] [optim_t 0.298] [lr 0.002289] [CE 3.717 (3.670)] [KD 0.000 (0.000)] 2024-10-12 02:38:17,520 - Train: 32.56% [122200/375300] [97.7/300.0] [batch_t 0.474 (0.447)] [data_t 0.175] [optim_t 0.300] [lr 0.002289] [CE 3.436 (3.647)] [KD 0.000 (0.000)] 2024-10-12 02:38:40,542 - Train: 32.57% [122250/375300] [97.7/300.0] [batch_t 0.469 (0.460)] [data_t 0.171] [optim_t 0.298] [lr 0.002288] [CE 3.825 (3.673)] [KD 0.000 (0.000)] 2024-10-12 02:39:03,599 - Train: 32.59% [122300/375300] [97.8/300.0] [batch_t 0.396 (0.461)] [data_t 0.100] [optim_t 0.296] [lr 0.002287] [CE 3.440 (3.684)] [KD 0.000 (0.000)] 2024-10-12 02:39:26,641 - Train: 32.60% [122350/375300] [97.8/300.0] [batch_t 0.478 (0.461)] [data_t 0.180] [optim_t 0.298] [lr 0.002287] [CE 3.661 (3.740)] [KD 0.000 (0.000)] 2024-10-12 02:39:49,034 - Train: 32.61% [122400/375300] [97.8/300.0] [batch_t 0.447 (0.448)] [data_t 0.152] [optim_t 0.295] [lr 0.002286] [CE 3.707 (3.752)] [KD 0.000 (0.000)] 2024-10-12 02:40:11,143 - Train: 32.63% [122450/375300] [97.9/300.0] [batch_t 0.386 (0.442)] [data_t 0.086] [optim_t 0.299] [lr 0.002286] [CE 3.320 (3.688)] [KD 0.000 (0.000)] 2024-10-12 02:40:33,381 - Train: 32.64% [122500/375300] [97.9/300.0] [batch_t 0.426 (0.445)] [data_t 0.128] [optim_t 0.298] [lr 0.002285] [CE 3.667 (3.725)] [KD 0.000 (0.000)] 2024-10-12 02:40:54,805 - Train: 32.65% [122550/375300] [98.0/300.0] [batch_t 0.419 (0.428)] [data_t 0.122] [optim_t 0.297] [lr 0.002285] [CE 3.620 (3.671)] [KD 0.000 (0.000)] 2024-10-12 02:41:14,373 - ==> Total time: 14:54:18 Eta: 1 day, 6:43:21 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 02:41:21,437 - Train: 32.67% [122600/375300] [98.0/300.0] [batch_t 1.214 (2.889)] [data_t 0.015] [optim_t 1.199] [lr 0.002284] [CE 3.749 (3.669)] [KD 0.000 (0.000)] 2024-10-12 02:41:41,941 - Train: 32.68% [122650/375300] [98.0/300.0] [batch_t 0.420 (0.410)] [data_t 0.015] [optim_t 0.405] [lr 0.002284] [CE 3.818 (3.703)] [KD 0.000 (0.000)] 2024-10-12 02:42:04,715 - Train: 32.69% [122700/375300] [98.1/300.0] [batch_t 0.524 (0.455)] [data_t 0.016] [optim_t 0.509] [lr 0.002283] [CE 3.614 (3.658)] [KD 0.000 (0.000)] 2024-10-12 02:42:27,350 - Train: 32.71% [122750/375300] [98.1/300.0] [batch_t 0.514 (0.453)] [data_t 0.015] [optim_t 0.499] [lr 0.002283] [CE 3.752 (3.699)] [KD 0.000 (0.000)] 2024-10-12 02:42:50,210 - Train: 32.72% [122800/375300] [98.2/300.0] [batch_t 0.334 (0.457)] [data_t 0.015] [optim_t 0.319] [lr 0.002282] [CE 3.539 (3.676)] [KD 0.000 (0.000)] 2024-10-12 02:43:13,154 - Train: 32.73% [122850/375300] [98.2/300.0] [batch_t 0.516 (0.459)] [data_t 0.015] [optim_t 0.501] [lr 0.002282] [CE 3.690 (3.703)] [KD 0.000 (0.000)] 2024-10-12 02:43:36,117 - Train: 32.75% [122900/375300] [98.2/300.0] [batch_t 0.464 (0.459)] [data_t 0.016] [optim_t 0.448] [lr 0.002281] [CE 3.391 (3.726)] [KD 0.000 (0.000)] 2024-10-12 02:43:58,772 - Train: 32.76% [122950/375300] [98.3/300.0] [batch_t 0.380 (0.453)] [data_t 0.016] [optim_t 0.365] [lr 0.002281] [CE 3.624 (3.717)] [KD 0.000 (0.000)] 2024-10-12 02:44:21,554 - Train: 32.77% [123000/375300] [98.3/300.0] [batch_t 0.420 (0.456)] [data_t 0.016] [optim_t 0.405] [lr 0.002280] [CE 3.494 (3.637)] [KD 0.000 (0.000)] 2024-10-12 02:44:44,186 - Train: 32.79% [123050/375300] [98.4/300.0] [batch_t 0.437 (0.453)] [data_t 0.016] [optim_t 0.422] [lr 0.002279] [CE 3.520 (3.675)] [KD 0.000 (0.000)] 2024-10-12 02:45:06,450 - Train: 32.80% [123100/375300] [98.4/300.0] [batch_t 0.459 (0.445)] [data_t 0.015] [optim_t 0.443] [lr 0.002279] [CE 3.658 (3.675)] [KD 0.000 (0.000)] 2024-10-12 02:45:28,938 - Train: 32.81% [123150/375300] [98.4/300.0] [batch_t 0.471 (0.450)] [data_t 0.015] [optim_t 0.455] [lr 0.002278] [CE 3.586 (3.740)] [KD 0.000 (0.000)] 2024-10-12 02:45:51,299 - Train: 32.83% [123200/375300] [98.5/300.0] [batch_t 0.416 (0.447)] [data_t 0.016] [optim_t 0.401] [lr 0.002278] [CE 3.733 (3.706)] [KD 0.000 (0.000)] 2024-10-12 02:46:12,281 - Train: 32.84% [123250/375300] [98.5/300.0] [batch_t 0.404 (0.420)] [data_t 0.015] [optim_t 0.389] [lr 0.002277] [CE 3.659 (3.699)] [KD 0.000 (0.000)] 2024-10-12 02:46:33,643 - Train: 32.85% [123300/375300] [98.6/300.0] [batch_t 0.505 (0.427)] [data_t 0.016] [optim_t 0.489] [lr 0.002277] [CE 3.641 (3.699)] [KD 0.000 (0.000)] 2024-10-12 02:46:55,641 - Train: 32.87% [123350/375300] [98.6/300.0] [batch_t 0.456 (0.440)] [data_t 0.016] [optim_t 0.440] [lr 0.002276] [CE 3.726 (3.663)] [KD 0.000 (0.000)] 2024-10-12 02:47:18,197 - Train: 32.88% [123400/375300] [98.6/300.0] [batch_t 0.460 (0.451)] [data_t 0.015] [optim_t 0.444] [lr 0.002276] [CE 3.806 (3.670)] [KD 0.000 (0.000)] 2024-10-12 02:47:39,814 - Train: 32.89% [123450/375300] [98.7/300.0] [batch_t 0.453 (0.432)] [data_t 0.016] [optim_t 0.438] [lr 0.002275] [CE 3.737 (3.698)] [KD 0.000 (0.000)] 2024-10-12 02:48:01,778 - Train: 32.91% [123500/375300] [98.7/300.0] [batch_t 0.495 (0.439)] [data_t 0.016] [optim_t 0.480] [lr 0.002275] [CE 3.841 (3.734)] [KD 0.000 (0.000)] 2024-10-12 02:48:23,695 - Train: 32.92% [123550/375300] [98.8/300.0] [batch_t 0.318 (0.438)] [data_t 0.015] [optim_t 0.303] [lr 0.002274] [CE 3.718 (3.662)] [KD 0.000 (0.000)] 2024-10-12 02:48:45,161 - Train: 32.93% [123600/375300] [98.8/300.0] [batch_t 0.425 (0.429)] [data_t 0.015] [optim_t 0.409] [lr 0.002274] [CE 3.856 (3.693)] [KD 0.000 (0.000)] 2024-10-12 02:49:06,785 - Train: 32.95% [123650/375300] [98.8/300.0] [batch_t 0.504 (0.432)] [data_t 0.015] [optim_t 0.489] [lr 0.002273] [CE 3.851 (3.697)] [KD 0.000 (0.000)] 2024-10-12 02:49:28,548 - Train: 32.96% [123700/375300] [98.9/300.0] [batch_t 0.428 (0.435)] [data_t 0.016] [optim_t 0.412] [lr 0.002273] [CE 3.787 (3.692)] [KD 0.000 (0.000)] 2024-10-12 02:49:50,537 - Train: 32.97% [123750/375300] [98.9/300.0] [batch_t 0.448 (0.440)] [data_t 0.016] [optim_t 0.433] [lr 0.002272] [CE 3.464 (3.702)] [KD 0.000 (0.000)] 2024-10-12 02:50:12,445 - Train: 32.99% [123800/375300] [99.0/300.0] [batch_t 0.428 (0.438)] [data_t 0.016] [optim_t 0.413] [lr 0.002271] [CE 3.457 (3.712)] [KD 0.000 (0.000)] 2024-10-12 02:50:32,480 - ==> Total time: 15:03:36 Eta: 1 day, 6:34:35 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 02:50:39,872 - Train: 33.00% [123850/375300] [99.0/300.0] [batch_t 5.819 (5.819)] [data_t 5.508] [optim_t 0.312] [lr 0.002271] [CE 3.661 (3.661)] [KD 0.000 (0.000)] 2024-10-12 02:51:00,003 - Train: 33.01% [123900/375300] [99.0/300.0] [batch_t 0.481 (0.402)] [data_t 0.178] [optim_t 0.303] [lr 0.002270] [CE 3.577 (3.700)] [KD 0.000 (0.000)] 2024-10-12 02:51:22,759 - Train: 33.03% [123950/375300] [99.1/300.0] [batch_t 0.523 (0.455)] [data_t 0.229] [optim_t 0.294] [lr 0.002270] [CE 3.622 (3.669)] [KD 0.000 (0.000)] 2024-10-12 02:51:44,968 - Train: 33.04% [124000/375300] [99.1/300.0] [batch_t 0.522 (0.444)] [data_t 0.224] [optim_t 0.298] [lr 0.002269] [CE 3.801 (3.642)] [KD 0.000 (0.000)] 2024-10-12 02:52:08,015 - Train: 33.05% [124050/375300] [99.2/300.0] [batch_t 0.546 (0.461)] [data_t 0.244] [optim_t 0.303] [lr 0.002269] [CE 3.685 (3.708)] [KD 0.000 (0.000)] 2024-10-12 02:52:31,373 - Train: 33.07% [124100/375300] [99.2/300.0] [batch_t 0.316 (0.467)] [data_t 0.016] [optim_t 0.300] [lr 0.002268] [CE 3.238 (3.618)] [KD 0.000 (0.000)] 2024-10-12 02:52:53,648 - Train: 33.08% [124150/375300] [99.2/300.0] [batch_t 0.520 (0.445)] [data_t 0.224] [optim_t 0.296] [lr 0.002268] [CE 3.947 (3.714)] [KD 0.000 (0.000)] 2024-10-12 02:53:15,732 - Train: 33.09% [124200/375300] [99.3/300.0] [batch_t 0.362 (0.442)] [data_t 0.065] [optim_t 0.297] [lr 0.002267] [CE 3.296 (3.669)] [KD 0.000 (0.000)] 2024-10-12 02:53:38,097 - Train: 33.11% [124250/375300] [99.3/300.0] [batch_t 0.770 (0.447)] [data_t 0.473] [optim_t 0.297] [lr 0.002267] [CE 3.678 (3.735)] [KD 0.000 (0.000)] 2024-10-12 02:53:59,765 - Train: 33.12% [124300/375300] [99.4/300.0] [batch_t 0.506 (0.433)] [data_t 0.210] [optim_t 0.296] [lr 0.002266] [CE 3.800 (3.705)] [KD 0.000 (0.000)] 2024-10-12 02:54:22,101 - Train: 33.13% [124350/375300] [99.4/300.0] [batch_t 0.433 (0.447)] [data_t 0.133] [optim_t 0.300] [lr 0.002266] [CE 3.795 (3.741)] [KD 0.000 (0.000)] 2024-10-12 02:54:44,333 - Train: 33.15% [124400/375300] [99.4/300.0] [batch_t 0.364 (0.444)] [data_t 0.069] [optim_t 0.295] [lr 0.002265] [CE 3.584 (3.686)] [KD 0.000 (0.000)] 2024-10-12 02:55:06,380 - Train: 33.16% [124450/375300] [99.5/300.0] [batch_t 0.463 (0.441)] [data_t 0.161] [optim_t 0.301] [lr 0.002264] [CE 3.521 (3.699)] [KD 0.000 (0.000)] 2024-10-12 02:55:27,822 - Train: 33.17% [124500/375300] [99.5/300.0] [batch_t 0.494 (0.429)] [data_t 0.199] [optim_t 0.294] [lr 0.002264] [CE 3.566 (3.663)] [KD 0.000 (0.000)] 2024-10-12 02:55:49,934 - Train: 33.19% [124550/375300] [99.6/300.0] [batch_t 0.468 (0.442)] [data_t 0.169] [optim_t 0.299] [lr 0.002263] [CE 3.643 (3.669)] [KD 0.000 (0.000)] 2024-10-12 02:56:12,001 - Train: 33.20% [124600/375300] [99.6/300.0] [batch_t 0.474 (0.441)] [data_t 0.182] [optim_t 0.292] [lr 0.002263] [CE 3.675 (3.683)] [KD 0.000 (0.000)] 2024-10-12 02:56:33,753 - Train: 33.21% [124650/375300] [99.6/300.0] [batch_t 0.447 (0.435)] [data_t 0.150] [optim_t 0.298] [lr 0.002262] [CE 3.813 (3.674)] [KD 0.000 (0.000)] 2024-10-12 02:56:54,978 - Train: 33.23% [124700/375300] [99.7/300.0] [batch_t 0.314 (0.424)] [data_t 0.016] [optim_t 0.297] [lr 0.002262] [CE 3.619 (3.692)] [KD 0.000 (0.000)] 2024-10-12 02:57:17,129 - Train: 33.24% [124750/375300] [99.7/300.0] [batch_t 0.479 (0.443)] [data_t 0.176] [optim_t 0.303] [lr 0.002261] [CE 3.840 (3.670)] [KD 0.000 (0.000)] 2024-10-12 02:57:38,644 - Train: 33.25% [124800/375300] [99.8/300.0] [batch_t 0.367 (0.430)] [data_t 0.075] [optim_t 0.293] [lr 0.002261] [CE 3.798 (3.710)] [KD 0.000 (0.000)] 2024-10-12 02:58:00,487 - Train: 33.27% [124850/375300] [99.8/300.0] [batch_t 0.389 (0.437)] [data_t 0.094] [optim_t 0.295] [lr 0.002260] [CE 3.292 (3.652)] [KD 0.000 (0.000)] 2024-10-12 02:58:22,245 - Train: 33.28% [124900/375300] [99.8/300.0] [batch_t 0.379 (0.435)] [data_t 0.080] [optim_t 0.299] [lr 0.002260] [CE 4.022 (3.766)] [KD 0.000 (0.000)] 2024-10-12 02:58:44,607 - Train: 33.29% [124950/375300] [99.9/300.0] [batch_t 0.492 (0.447)] [data_t 0.193] [optim_t 0.299] [lr 0.002259] [CE 3.803 (3.713)] [KD 0.000 (0.000)] 2024-10-12 02:59:06,066 - Train: 33.31% [125000/375300] [99.9/300.0] [batch_t 0.470 (0.429)] [data_t 0.150] [optim_t 0.320] [lr 0.002259] [CE 3.372 (3.632)] [KD 0.000 (0.000)] 2024-10-12 02:59:27,681 - Train: 33.32% [125050/375300] [100.0/300.0] [batch_t 0.445 (0.432)] [data_t 0.016] [optim_t 0.429] [lr 0.002258] [CE 3.767 (3.727)] [KD 0.000 (0.000)] 2024-10-12 02:59:47,763 - Train: 33.33% [125100/375300] [100.0/300.0] [batch_t 0.312 (0.401)] [data_t 0.015] [optim_t 0.297] [lr 0.002258] [CE 3.558 (3.654)] [KD 0.000 (0.000)] 2024-10-12 03:00:10,411 - Test (net): 100.00% [50/50] [batch_t 0.145 (0.447)] [top1_cnt 36169] [top5_cnt 45666] [top_all 50000] 2024-10-12 03:00:10,411 - net: 72.338 (91.332) 2024-10-12 03:00:32,191 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.427)] [top1_cnt 38849] [top5_cnt 47003] [top_all 50000] 2024-10-12 03:00:32,191 - net_E: 77.698 (94.006) 2024-10-12 03:00:32,388 - Max [top1: 72.338 (epoch: 100)] [top1-ema: 77.698 (epoch: 100)] 2024-10-12 03:00:32,388 - ==> Total time: 15:13:36 Eta: 1 day, 6:27:12 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 03:01:00,408 - Train: 33.35% [125150/375300] [100.0/300.0] [batch_t 0.395 (0.424)] [data_t 0.016] [optim_t 0.379] [lr 0.002257] [CE 3.550 (3.674)] [KD 0.000 (0.000)] 2024-10-12 03:01:22,991 - Train: 33.36% [125200/375300] [100.1/300.0] [batch_t 0.480 (0.452)] [data_t 0.016] [optim_t 0.464] [lr 0.002256] [CE 3.601 (3.713)] [KD 0.000 (0.000)] 2024-10-12 03:01:44,925 - Train: 33.37% [125250/375300] [100.1/300.0] [batch_t 0.435 (0.439)] [data_t 0.016] [optim_t 0.419] [lr 0.002256] [CE 3.400 (3.707)] [KD 0.000 (0.000)] 2024-10-12 03:02:07,555 - Train: 33.39% [125300/375300] [100.2/300.0] [batch_t 0.486 (0.452)] [data_t 0.015] [optim_t 0.471] [lr 0.002255] [CE 3.510 (3.694)] [KD 0.000 (0.000)] 2024-10-12 03:02:30,094 - Train: 33.40% [125350/375300] [100.2/300.0] [batch_t 0.435 (0.451)] [data_t 0.016] [optim_t 0.419] [lr 0.002255] [CE 3.675 (3.651)] [KD 0.000 (0.000)] 2024-10-12 03:02:52,214 - Train: 33.41% [125400/375300] [100.2/300.0] [batch_t 0.488 (0.442)] [data_t 0.016] [optim_t 0.472] [lr 0.002254] [CE 3.256 (3.681)] [KD 0.000 (0.000)] 2024-10-12 03:03:13,351 - Train: 33.43% [125450/375300] [100.3/300.0] [batch_t 0.435 (0.423)] [data_t 0.015] [optim_t 0.419] [lr 0.002254] [CE 3.465 (3.700)] [KD 0.000 (0.000)] 2024-10-12 03:03:34,544 - Train: 33.44% [125500/375300] [100.3/300.0] [batch_t 0.477 (0.424)] [data_t 0.016] [optim_t 0.461] [lr 0.002253] [CE 3.787 (3.677)] [KD 0.000 (0.000)] 2024-10-12 03:03:55,894 - Train: 33.45% [125550/375300] [100.4/300.0] [batch_t 0.450 (0.427)] [data_t 0.016] [optim_t 0.434] [lr 0.002253] [CE 3.572 (3.704)] [KD 0.000 (0.000)] 2024-10-12 03:04:17,630 - Train: 33.47% [125600/375300] [100.4/300.0] [batch_t 0.434 (0.435)] [data_t 0.016] [optim_t 0.418] [lr 0.002252] [CE 3.651 (3.655)] [KD 0.000 (0.000)] 2024-10-12 03:04:39,463 - Train: 33.48% [125650/375300] [100.4/300.0] [batch_t 0.358 (0.437)] [data_t 0.016] [optim_t 0.342] [lr 0.002252] [CE 3.647 (3.659)] [KD 0.000 (0.000)] 2024-10-12 03:05:00,500 - Train: 33.49% [125700/375300] [100.5/300.0] [batch_t 0.441 (0.421)] [data_t 0.016] [optim_t 0.425] [lr 0.002251] [CE 3.800 (3.697)] [KD 0.000 (0.000)] 2024-10-12 03:05:22,587 - Train: 33.51% [125750/375300] [100.5/300.0] [batch_t 0.883 (0.442)] [data_t 0.015] [optim_t 0.868] [lr 0.002251] [CE 3.174 (3.682)] [KD 0.000 (0.000)] 2024-10-12 03:05:43,693 - Train: 33.52% [125800/375300] [100.6/300.0] [batch_t 0.503 (0.422)] [data_t 0.016] [optim_t 0.487] [lr 0.002250] [CE 3.730 (3.651)] [KD 0.000 (0.000)] 2024-10-12 03:06:05,125 - Train: 33.53% [125850/375300] [100.6/300.0] [batch_t 0.368 (0.429)] [data_t 0.015] [optim_t 0.353] [lr 0.002249] [CE 3.647 (3.723)] [KD 0.000 (0.000)] 2024-10-12 03:06:26,179 - Train: 33.55% [125900/375300] [100.6/300.0] [batch_t 0.342 (0.421)] [data_t 0.016] [optim_t 0.327] [lr 0.002249] [CE 3.412 (3.710)] [KD 0.000 (0.000)] 2024-10-12 03:06:47,617 - Train: 33.56% [125950/375300] [100.7/300.0] [batch_t 0.329 (0.429)] [data_t 0.016] [optim_t 0.313] [lr 0.002248] [CE 3.648 (3.739)] [KD 0.000 (0.000)] 2024-10-12 03:07:09,566 - Train: 33.57% [126000/375300] [100.7/300.0] [batch_t 0.460 (0.439)] [data_t 0.016] [optim_t 0.445] [lr 0.002248] [CE 3.736 (3.699)] [KD 0.000 (0.000)] 2024-10-12 03:07:31,250 - Train: 33.59% [126050/375300] [100.8/300.0] [batch_t 0.456 (0.434)] [data_t 0.016] [optim_t 0.440] [lr 0.002247] [CE 3.730 (3.660)] [KD 0.000 (0.000)] 2024-10-12 03:07:53,032 - Train: 33.60% [126100/375300] [100.8/300.0] [batch_t 0.511 (0.436)] [data_t 0.016] [optim_t 0.495] [lr 0.002247] [CE 3.769 (3.712)] [KD 0.000 (0.000)] 2024-10-12 03:08:15,324 - Train: 33.61% [126150/375300] [100.8/300.0] [batch_t 0.469 (0.446)] [data_t 0.016] [optim_t 0.454] [lr 0.002246] [CE 4.113 (3.711)] [KD 0.000 (0.000)] 2024-10-12 03:08:36,996 - Train: 33.63% [126200/375300] [100.9/300.0] [batch_t 0.535 (0.433)] [data_t 0.016] [optim_t 0.520] [lr 0.002246] [CE 3.513 (3.660)] [KD 0.000 (0.000)] 2024-10-12 03:08:58,754 - Train: 33.64% [126250/375300] [100.9/300.0] [batch_t 0.438 (0.435)] [data_t 0.016] [optim_t 0.423] [lr 0.002245] [CE 3.773 (3.658)] [KD 0.000 (0.000)] 2024-10-12 03:09:20,712 - Train: 33.65% [126300/375300] [101.0/300.0] [batch_t 0.452 (0.439)] [data_t 0.016] [optim_t 0.436] [lr 0.002245] [CE 3.696 (3.691)] [KD 0.000 (0.000)] 2024-10-12 03:09:42,137 - Train: 33.67% [126350/375300] [101.0/300.0] [batch_t 0.310 (0.428)] [data_t 0.016] [optim_t 0.295] [lr 0.002244] [CE 3.360 (3.686)] [KD 0.000 (0.000)] 2024-10-12 03:09:42,453 - ==> Total time: 15:22:46 Eta: 1 day, 6:18:08 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 03:10:08,246 - Train: 33.68% [126400/375300] [101.0/300.0] [batch_t 0.461 (0.488)] [data_t 0.016] [optim_t 0.445] [lr 0.002243] [CE 3.635 (3.673)] [KD 0.000 (0.000)] 2024-10-12 03:10:31,484 - Train: 33.69% [126450/375300] [101.1/300.0] [batch_t 0.324 (0.465)] [data_t 0.016] [optim_t 0.308] [lr 0.002243] [CE 3.769 (3.658)] [KD 0.000 (0.000)] 2024-10-12 03:10:52,195 - Train: 33.71% [126500/375300] [101.1/300.0] [batch_t 0.490 (0.414)] [data_t 0.016] [optim_t 0.475] [lr 0.002242] [CE 3.635 (3.657)] [KD 0.000 (0.000)] 2024-10-12 03:11:14,424 - Train: 33.72% [126550/375300] [101.2/300.0] [batch_t 0.339 (0.444)] [data_t 0.016] [optim_t 0.324] [lr 0.002242] [CE 3.373 (3.666)] [KD 0.000 (0.000)] 2024-10-12 03:11:35,857 - Train: 33.73% [126600/375300] [101.2/300.0] [batch_t 0.397 (0.429)] [data_t 0.016] [optim_t 0.381] [lr 0.002241] [CE 3.795 (3.680)] [KD 0.000 (0.000)] 2024-10-12 03:11:57,639 - Train: 33.75% [126650/375300] [101.2/300.0] [batch_t 0.412 (0.436)] [data_t 0.015] [optim_t 0.396] [lr 0.002241] [CE 4.025 (3.697)] [KD 0.000 (0.000)] 2024-10-12 03:12:19,714 - Train: 33.76% [126700/375300] [101.3/300.0] [batch_t 0.413 (0.441)] [data_t 0.016] [optim_t 0.398] [lr 0.002240] [CE 3.496 (3.673)] [KD 0.000 (0.000)] 2024-10-12 03:12:41,511 - Train: 33.77% [126750/375300] [101.3/300.0] [batch_t 0.432 (0.436)] [data_t 0.015] [optim_t 0.416] [lr 0.002240] [CE 3.478 (3.701)] [KD 0.000 (0.000)] 2024-10-12 03:13:03,427 - Train: 33.79% [126800/375300] [101.4/300.0] [batch_t 0.422 (0.438)] [data_t 0.016] [optim_t 0.406] [lr 0.002239] [CE 3.798 (3.646)] [KD 0.000 (0.000)] 2024-10-12 03:13:25,748 - Train: 33.80% [126850/375300] [101.4/300.0] [batch_t 0.413 (0.446)] [data_t 0.015] [optim_t 0.398] [lr 0.002239] [CE 3.996 (3.685)] [KD 0.000 (0.000)] 2024-10-12 03:13:48,110 - Train: 33.81% [126900/375300] [101.4/300.0] [batch_t 0.514 (0.447)] [data_t 0.016] [optim_t 0.498] [lr 0.002238] [CE 3.698 (3.689)] [KD 0.000 (0.000)] 2024-10-12 03:14:08,424 - Train: 33.83% [126950/375300] [101.5/300.0] [batch_t 0.408 (0.406)] [data_t 0.015] [optim_t 0.393] [lr 0.002238] [CE 3.385 (3.699)] [KD 0.000 (0.000)] 2024-10-12 03:14:29,236 - Train: 33.84% [127000/375300] [101.5/300.0] [batch_t 0.390 (0.416)] [data_t 0.016] [optim_t 0.374] [lr 0.002237] [CE 3.625 (3.684)] [KD 0.000 (0.000)] 2024-10-12 03:14:50,405 - Train: 33.85% [127050/375300] [101.6/300.0] [batch_t 0.400 (0.423)] [data_t 0.016] [optim_t 0.384] [lr 0.002236] [CE 3.796 (3.715)] [KD 0.000 (0.000)] 2024-10-12 03:15:11,814 - Train: 33.87% [127100/375300] [101.6/300.0] [batch_t 0.423 (0.428)] [data_t 0.016] [optim_t 0.407] [lr 0.002236] [CE 3.810 (3.699)] [KD 0.000 (0.000)] 2024-10-12 03:15:33,785 - Train: 33.88% [127150/375300] [101.6/300.0] [batch_t 0.529 (0.439)] [data_t 0.016] [optim_t 0.514] [lr 0.002235] [CE 3.675 (3.676)] [KD 0.000 (0.000)] 2024-10-12 03:15:55,095 - Train: 33.89% [127200/375300] [101.7/300.0] [batch_t 0.474 (0.426)] [data_t 0.015] [optim_t 0.459] [lr 0.002235] [CE 3.632 (3.668)] [KD 0.000 (0.000)] 2024-10-12 03:16:16,608 - Train: 33.91% [127250/375300] [101.7/300.0] [batch_t 0.569 (0.430)] [data_t 0.016] [optim_t 0.553] [lr 0.002234] [CE 3.502 (3.686)] [KD 0.000 (0.000)] 2024-10-12 03:16:37,885 - Train: 33.92% [127300/375300] [101.8/300.0] [batch_t 0.320 (0.425)] [data_t 0.016] [optim_t 0.304] [lr 0.002234] [CE 3.329 (3.723)] [KD 0.000 (0.000)] 2024-10-12 03:17:00,082 - Train: 33.93% [127350/375300] [101.8/300.0] [batch_t 0.430 (0.444)] [data_t 0.015] [optim_t 0.414] [lr 0.002233] [CE 3.920 (3.711)] [KD 0.000 (0.000)] 2024-10-12 03:17:21,993 - Train: 33.95% [127400/375300] [101.8/300.0] [batch_t 0.964 (0.438)] [data_t 0.016] [optim_t 0.949] [lr 0.002233] [CE 3.823 (3.683)] [KD 0.000 (0.000)] 2024-10-12 03:17:42,932 - Train: 33.96% [127450/375300] [101.9/300.0] [batch_t 0.441 (0.419)] [data_t 0.015] [optim_t 0.425] [lr 0.002232] [CE 3.671 (3.756)] [KD 0.000 (0.000)] 2024-10-12 03:18:04,489 - Train: 33.97% [127500/375300] [101.9/300.0] [batch_t 0.452 (0.431)] [data_t 0.016] [optim_t 0.436] [lr 0.002232] [CE 3.649 (3.638)] [KD 0.000 (0.000)] 2024-10-12 03:18:26,230 - Train: 33.99% [127550/375300] [102.0/300.0] [batch_t 0.479 (0.435)] [data_t 0.016] [optim_t 0.463] [lr 0.002231] [CE 3.642 (3.727)] [KD 0.000 (0.000)] 2024-10-12 03:18:46,414 - Train: 34.00% [127600/375300] [102.0/300.0] [batch_t 0.312 (0.404)] [data_t 0.015] [optim_t 0.297] [lr 0.002230] [CE 3.912 (3.724)] [KD 0.000 (0.000)] 2024-10-12 03:18:47,042 - ==> Total time: 15:31:50 Eta: 1 day, 6:08:53 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 03:19:11,441 - Train: 34.01% [127650/375300] [102.0/300.0] [batch_t 0.484 (0.479)] [data_t 0.016] [optim_t 0.469] [lr 0.002230] [CE 3.415 (3.629)] [KD 0.000 (0.000)] 2024-10-12 03:19:33,381 - Train: 34.03% [127700/375300] [102.1/300.0] [batch_t 0.437 (0.439)] [data_t 0.015] [optim_t 0.421] [lr 0.002229] [CE 3.819 (3.642)] [KD 0.000 (0.000)] 2024-10-12 03:19:54,915 - Train: 34.04% [127750/375300] [102.1/300.0] [batch_t 0.448 (0.431)] [data_t 0.016] [optim_t 0.432] [lr 0.002229] [CE 3.576 (3.644)] [KD 0.000 (0.000)] 2024-10-12 03:20:16,839 - Train: 34.05% [127800/375300] [102.2/300.0] [batch_t 0.423 (0.438)] [data_t 0.016] [optim_t 0.408] [lr 0.002228] [CE 3.866 (3.664)] [KD 0.000 (0.000)] 2024-10-12 03:20:38,907 - Train: 34.07% [127850/375300] [102.2/300.0] [batch_t 0.418 (0.441)] [data_t 0.016] [optim_t 0.402] [lr 0.002228] [CE 4.095 (3.693)] [KD 0.000 (0.000)] 2024-10-12 03:21:00,327 - Train: 34.08% [127900/375300] [102.2/300.0] [batch_t 0.479 (0.428)] [data_t 0.015] [optim_t 0.463] [lr 0.002227] [CE 3.594 (3.680)] [KD 0.000 (0.000)] 2024-10-12 03:21:21,876 - Train: 34.09% [127950/375300] [102.3/300.0] [batch_t 0.426 (0.431)] [data_t 0.016] [optim_t 0.410] [lr 0.002227] [CE 3.791 (3.653)] [KD 0.000 (0.000)] 2024-10-12 03:21:43,632 - Train: 34.11% [128000/375300] [102.3/300.0] [batch_t 0.507 (0.435)] [data_t 0.016] [optim_t 0.491] [lr 0.002226] [CE 3.673 (3.667)] [KD 0.000 (0.000)] 2024-10-12 03:22:05,040 - Train: 34.12% [128050/375300] [102.4/300.0] [batch_t 0.317 (0.428)] [data_t 0.016] [optim_t 0.302] [lr 0.002226] [CE 4.067 (3.701)] [KD 0.000 (0.000)] 2024-10-12 03:22:25,565 - Train: 34.13% [128100/375300] [102.4/300.0] [batch_t 0.425 (0.410)] [data_t 0.015] [optim_t 0.410] [lr 0.002225] [CE 3.817 (3.692)] [KD 0.000 (0.000)] 2024-10-12 03:22:48,332 - Train: 34.15% [128150/375300] [102.4/300.0] [batch_t 0.316 (0.455)] [data_t 0.016] [optim_t 0.300] [lr 0.002224] [CE 3.452 (3.694)] [KD 0.000 (0.000)] 2024-10-12 03:23:10,347 - Train: 34.16% [128200/375300] [102.5/300.0] [batch_t 0.463 (0.440)] [data_t 0.016] [optim_t 0.447] [lr 0.002224] [CE 3.452 (3.690)] [KD 0.000 (0.000)] 2024-10-12 03:23:32,028 - Train: 34.17% [128250/375300] [102.5/300.0] [batch_t 0.403 (0.433)] [data_t 0.016] [optim_t 0.387] [lr 0.002223] [CE 3.569 (3.682)] [KD 0.000 (0.000)] 2024-10-12 03:23:53,948 - Train: 34.19% [128300/375300] [102.6/300.0] [batch_t 0.486 (0.438)] [data_t 0.016] [optim_t 0.470] [lr 0.002223] [CE 3.928 (3.682)] [KD 0.000 (0.000)] 2024-10-12 03:24:15,911 - Train: 34.20% [128350/375300] [102.6/300.0] [batch_t 0.441 (0.439)] [data_t 0.016] [optim_t 0.425] [lr 0.002222] [CE 3.512 (3.670)] [KD 0.000 (0.000)] 2024-10-12 03:24:36,893 - Train: 34.21% [128400/375300] [102.6/300.0] [batch_t 0.425 (0.419)] [data_t 0.016] [optim_t 0.409] [lr 0.002222] [CE 3.780 (3.681)] [KD 0.000 (0.000)] 2024-10-12 03:24:58,759 - Train: 34.23% [128450/375300] [102.7/300.0] [batch_t 0.474 (0.437)] [data_t 0.016] [optim_t 0.459] [lr 0.002221] [CE 3.693 (3.704)] [KD 0.000 (0.000)] 2024-10-12 03:25:20,462 - Train: 34.24% [128500/375300] [102.7/300.0] [batch_t 0.427 (0.434)] [data_t 0.016] [optim_t 0.411] [lr 0.002221] [CE 3.423 (3.690)] [KD 0.000 (0.000)] 2024-10-12 03:25:42,403 - Train: 34.25% [128550/375300] [102.8/300.0] [batch_t 0.455 (0.439)] [data_t 0.015] [optim_t 0.440] [lr 0.002220] [CE 3.538 (3.719)] [KD 0.000 (0.000)] 2024-10-12 03:26:04,086 - Train: 34.27% [128600/375300] [102.8/300.0] [batch_t 0.360 (0.434)] [data_t 0.016] [optim_t 0.344] [lr 0.002220] [CE 3.678 (3.676)] [KD 0.000 (0.000)] 2024-10-12 03:26:25,421 - Train: 34.28% [128650/375300] [102.8/300.0] [batch_t 0.507 (0.427)] [data_t 0.016] [optim_t 0.491] [lr 0.002219] [CE 3.474 (3.727)] [KD 0.000 (0.000)] 2024-10-12 03:26:46,588 - Train: 34.29% [128700/375300] [102.9/300.0] [batch_t 0.502 (0.423)] [data_t 0.016] [optim_t 0.487] [lr 0.002218] [CE 3.920 (3.675)] [KD 0.000 (0.000)] 2024-10-12 03:27:07,604 - Train: 34.31% [128750/375300] [102.9/300.0] [batch_t 0.354 (0.420)] [data_t 0.016] [optim_t 0.338] [lr 0.002218] [CE 3.562 (3.676)] [KD 0.000 (0.000)] 2024-10-12 03:27:30,056 - Train: 34.32% [128800/375300] [103.0/300.0] [batch_t 0.314 (0.449)] [data_t 0.016] [optim_t 0.298] [lr 0.002217] [CE 3.636 (3.650)] [KD 0.000 (0.000)] 2024-10-12 03:27:50,261 - Train: 34.33% [128850/375300] [103.0/300.0] [batch_t 0.307 (0.404)] [data_t 0.016] [optim_t 0.291] [lr 0.002217] [CE 3.622 (3.699)] [KD 0.000 (0.000)] 2024-10-12 03:27:51,194 - ==> Total time: 15:40:55 Eta: 1 day, 5:59:37 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 03:28:16,166 - Train: 34.35% [128900/375300] [103.0/300.0] [batch_t 0.466 (0.499)] [data_t 0.016] [optim_t 0.451] [lr 0.002216] [CE 3.403 (3.629)] [KD 0.000 (0.000)] 2024-10-12 03:28:38,166 - Train: 34.36% [128950/375300] [103.1/300.0] [batch_t 0.452 (0.440)] [data_t 0.015] [optim_t 0.437] [lr 0.002216] [CE 3.796 (3.634)] [KD 0.000 (0.000)] 2024-10-12 03:29:00,347 - Train: 34.37% [129000/375300] [103.1/300.0] [batch_t 0.477 (0.444)] [data_t 0.016] [optim_t 0.461] [lr 0.002215] [CE 3.825 (3.648)] [KD 0.000 (0.000)] 2024-10-12 03:29:21,928 - Train: 34.39% [129050/375300] [103.2/300.0] [batch_t 0.432 (0.432)] [data_t 0.016] [optim_t 0.416] [lr 0.002215] [CE 3.506 (3.660)] [KD 0.000 (0.000)] 2024-10-12 03:29:43,674 - Train: 34.40% [129100/375300] [103.2/300.0] [batch_t 0.384 (0.435)] [data_t 0.016] [optim_t 0.369] [lr 0.002214] [CE 3.631 (3.678)] [KD 0.000 (0.000)] 2024-10-12 03:30:05,996 - Train: 34.41% [129150/375300] [103.2/300.0] [batch_t 0.353 (0.446)] [data_t 0.016] [optim_t 0.338] [lr 0.002213] [CE 3.970 (3.691)] [KD 0.000 (0.000)] 2024-10-12 03:30:28,662 - Train: 34.43% [129200/375300] [103.3/300.0] [batch_t 0.427 (0.453)] [data_t 0.016] [optim_t 0.412] [lr 0.002213] [CE 3.446 (3.663)] [KD 0.000 (0.000)] 2024-10-12 03:30:50,683 - Train: 34.44% [129250/375300] [103.3/300.0] [batch_t 0.378 (0.440)] [data_t 0.015] [optim_t 0.362] [lr 0.002212] [CE 3.540 (3.684)] [KD 0.000 (0.000)] 2024-10-12 03:31:12,570 - Train: 34.45% [129300/375300] [103.4/300.0] [batch_t 0.460 (0.438)] [data_t 0.016] [optim_t 0.444] [lr 0.002212] [CE 3.655 (3.697)] [KD 0.000 (0.000)] 2024-10-12 03:31:34,762 - Train: 34.47% [129350/375300] [103.4/300.0] [batch_t 0.411 (0.444)] [data_t 0.016] [optim_t 0.396] [lr 0.002211] [CE 3.713 (3.658)] [KD 0.000 (0.000)] 2024-10-12 03:31:56,860 - Train: 34.48% [129400/375300] [103.4/300.0] [batch_t 0.452 (0.442)] [data_t 0.015] [optim_t 0.437] [lr 0.002211] [CE 3.788 (3.677)] [KD 0.000 (0.000)] 2024-10-12 03:32:18,582 - Train: 34.49% [129450/375300] [103.5/300.0] [batch_t 0.318 (0.434)] [data_t 0.016] [optim_t 0.303] [lr 0.002210] [CE 3.257 (3.647)] [KD 0.000 (0.000)] 2024-10-12 03:32:40,214 - Train: 34.51% [129500/375300] [103.5/300.0] [batch_t 0.412 (0.433)] [data_t 0.015] [optim_t 0.396] [lr 0.002210] [CE 3.756 (3.702)] [KD 0.000 (0.000)] 2024-10-12 03:33:02,049 - Train: 34.52% [129550/375300] [103.6/300.0] [batch_t 0.402 (0.437)] [data_t 0.015] [optim_t 0.386] [lr 0.002209] [CE 3.716 (3.691)] [KD 0.000 (0.000)] 2024-10-12 03:33:23,447 - Train: 34.53% [129600/375300] [103.6/300.0] [batch_t 0.432 (0.428)] [data_t 0.016] [optim_t 0.416] [lr 0.002209] [CE 3.628 (3.674)] [KD 0.000 (0.000)] 2024-10-12 03:33:45,209 - Train: 34.55% [129650/375300] [103.6/300.0] [batch_t 0.443 (0.435)] [data_t 0.016] [optim_t 0.427] [lr 0.002208] [CE 3.356 (3.673)] [KD 0.000 (0.000)] 2024-10-12 03:34:06,428 - Train: 34.56% [129700/375300] [103.7/300.0] [batch_t 0.497 (0.424)] [data_t 0.016] [optim_t 0.481] [lr 0.002207] [CE 3.663 (3.678)] [KD 0.000 (0.000)] 2024-10-12 03:34:27,476 - Train: 34.57% [129750/375300] [103.7/300.0] [batch_t 0.405 (0.421)] [data_t 0.016] [optim_t 0.389] [lr 0.002207] [CE 3.582 (3.679)] [KD 0.000 (0.000)] 2024-10-12 03:34:48,513 - Train: 34.59% [129800/375300] [103.8/300.0] [batch_t 0.493 (0.421)] [data_t 0.016] [optim_t 0.477] [lr 0.002206] [CE 3.482 (3.673)] [KD 0.000 (0.000)] 2024-10-12 03:35:10,745 - Train: 34.60% [129850/375300] [103.8/300.0] [batch_t 0.410 (0.445)] [data_t 0.016] [optim_t 0.394] [lr 0.002206] [CE 3.689 (3.645)] [KD 0.000 (0.000)] 2024-10-12 03:35:32,989 - Train: 34.61% [129900/375300] [103.8/300.0] [batch_t 0.337 (0.445)] [data_t 0.015] [optim_t 0.322] [lr 0.002205] [CE 3.853 (3.667)] [KD 0.000 (0.000)] 2024-10-12 03:35:54,180 - Train: 34.63% [129950/375300] [103.9/300.0] [batch_t 0.433 (0.424)] [data_t 0.015] [optim_t 0.418] [lr 0.002205] [CE 4.009 (3.681)] [KD 0.000 (0.000)] 2024-10-12 03:36:15,887 - Train: 34.64% [130000/375300] [103.9/300.0] [batch_t 0.465 (0.434)] [data_t 0.015] [optim_t 0.450] [lr 0.002204] [CE 3.960 (3.638)] [KD 0.000 (0.000)] 2024-10-12 03:36:37,684 - Train: 34.65% [130050/375300] [104.0/300.0] [batch_t 0.432 (0.436)] [data_t 0.016] [optim_t 0.417] [lr 0.002204] [CE 3.648 (3.659)] [KD 0.000 (0.000)] 2024-10-12 03:36:58,300 - Train: 34.67% [130100/375300] [104.0/300.0] [batch_t 0.319 (0.412)] [data_t 0.015] [optim_t 0.304] [lr 0.002203] [CE 3.985 (3.674)] [KD 0.000 (0.000)] 2024-10-12 03:36:59,571 - ==> Total time: 15:50:03 Eta: 1 day, 5:50:29 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 03:37:23,620 - Train: 34.68% [130150/375300] [104.0/300.0] [batch_t 0.506 (0.491)] [data_t 0.016] [optim_t 0.490] [lr 0.002202] [CE 3.589 (3.612)] [KD 0.000 (0.000)] 2024-10-12 03:37:46,048 - Train: 34.69% [130200/375300] [104.1/300.0] [batch_t 0.453 (0.448)] [data_t 0.015] [optim_t 0.438] [lr 0.002202] [CE 3.680 (3.637)] [KD 0.000 (0.000)] 2024-10-12 03:38:08,163 - Train: 34.71% [130250/375300] [104.1/300.0] [batch_t 0.460 (0.442)] [data_t 0.016] [optim_t 0.444] [lr 0.002201] [CE 3.870 (3.649)] [KD 0.000 (0.000)] 2024-10-12 03:38:29,849 - Train: 34.72% [130300/375300] [104.2/300.0] [batch_t 0.421 (0.434)] [data_t 0.016] [optim_t 0.405] [lr 0.002201] [CE 3.625 (3.682)] [KD 0.000 (0.000)] 2024-10-12 03:38:51,477 - Train: 34.73% [130350/375300] [104.2/300.0] [batch_t 0.380 (0.432)] [data_t 0.015] [optim_t 0.364] [lr 0.002200] [CE 3.864 (3.619)] [KD 0.000 (0.000)] 2024-10-12 03:39:12,954 - Train: 34.75% [130400/375300] [104.2/300.0] [batch_t 0.382 (0.429)] [data_t 0.016] [optim_t 0.367] [lr 0.002200] [CE 3.605 (3.704)] [KD 0.000 (0.000)] 2024-10-12 03:39:34,471 - Train: 34.76% [130450/375300] [104.3/300.0] [batch_t 0.392 (0.430)] [data_t 0.015] [optim_t 0.377] [lr 0.002199] [CE 3.439 (3.607)] [KD 0.000 (0.000)] 2024-10-12 03:39:56,320 - Train: 34.77% [130500/375300] [104.3/300.0] [batch_t 0.462 (0.437)] [data_t 0.016] [optim_t 0.447] [lr 0.002199] [CE 3.744 (3.665)] [KD 0.000 (0.000)] 2024-10-12 03:40:17,972 - Train: 34.79% [130550/375300] [104.4/300.0] [batch_t 0.399 (0.433)] [data_t 0.015] [optim_t 0.383] [lr 0.002198] [CE 3.617 (3.642)] [KD 0.000 (0.000)] 2024-10-12 03:40:39,909 - Train: 34.80% [130600/375300] [104.4/300.0] [batch_t 0.412 (0.439)] [data_t 0.016] [optim_t 0.396] [lr 0.002198] [CE 4.006 (3.681)] [KD 0.000 (0.000)] 2024-10-12 03:41:01,980 - Train: 34.81% [130650/375300] [104.4/300.0] [batch_t 0.394 (0.441)] [data_t 0.015] [optim_t 0.379] [lr 0.002197] [CE 3.370 (3.637)] [KD 0.000 (0.000)] 2024-10-12 03:41:23,948 - Train: 34.83% [130700/375300] [104.5/300.0] [batch_t 0.457 (0.439)] [data_t 0.016] [optim_t 0.441] [lr 0.002196] [CE 4.043 (3.706)] [KD 0.000 (0.000)] 2024-10-12 03:41:45,981 - Train: 34.84% [130750/375300] [104.5/300.0] [batch_t 0.520 (0.441)] [data_t 0.016] [optim_t 0.504] [lr 0.002196] [CE 3.978 (3.681)] [KD 0.000 (0.000)] 2024-10-12 03:42:07,799 - Train: 34.85% [130800/375300] [104.6/300.0] [batch_t 0.423 (0.436)] [data_t 0.016] [optim_t 0.407] [lr 0.002195] [CE 3.840 (3.667)] [KD 0.000 (0.000)] 2024-10-12 03:42:29,718 - Train: 34.87% [130850/375300] [104.6/300.0] [batch_t 0.368 (0.438)] [data_t 0.016] [optim_t 0.353] [lr 0.002195] [CE 4.015 (3.672)] [KD 0.000 (0.000)] 2024-10-12 03:42:51,750 - Train: 34.88% [130900/375300] [104.6/300.0] [batch_t 0.483 (0.441)] [data_t 0.016] [optim_t 0.467] [lr 0.002194] [CE 3.487 (3.667)] [KD 0.000 (0.000)] 2024-10-12 03:43:13,568 - Train: 34.89% [130950/375300] [104.7/300.0] [batch_t 0.457 (0.436)] [data_t 0.016] [optim_t 0.441] [lr 0.002194] [CE 3.881 (3.682)] [KD 0.000 (0.000)] 2024-10-12 03:43:35,541 - Train: 34.91% [131000/375300] [104.7/300.0] [batch_t 0.456 (0.439)] [data_t 0.016] [optim_t 0.440] [lr 0.002193] [CE 3.865 (3.676)] [KD 0.000 (0.000)] 2024-10-12 03:43:57,534 - Train: 34.92% [131050/375300] [104.8/300.0] [batch_t 0.455 (0.440)] [data_t 0.015] [optim_t 0.440] [lr 0.002193] [CE 3.667 (3.716)] [KD 0.000 (0.000)] 2024-10-12 03:44:19,417 - Train: 34.93% [131100/375300] [104.8/300.0] [batch_t 0.434 (0.438)] [data_t 0.015] [optim_t 0.418] [lr 0.002192] [CE 3.715 (3.613)] [KD 0.000 (0.000)] 2024-10-12 03:44:41,653 - Train: 34.95% [131150/375300] [104.8/300.0] [batch_t 0.426 (0.445)] [data_t 0.015] [optim_t 0.411] [lr 0.002191] [CE 3.598 (3.717)] [KD 0.000 (0.000)] 2024-10-12 03:45:03,989 - Train: 34.96% [131200/375300] [104.9/300.0] [batch_t 0.444 (0.447)] [data_t 0.016] [optim_t 0.428] [lr 0.002191] [CE 3.785 (3.648)] [KD 0.000 (0.000)] 2024-10-12 03:45:26,074 - Train: 34.97% [131250/375300] [104.9/300.0] [batch_t 0.463 (0.442)] [data_t 0.016] [optim_t 0.448] [lr 0.002190] [CE 3.511 (3.686)] [KD 0.000 (0.000)] 2024-10-12 03:45:47,932 - Train: 34.99% [131300/375300] [105.0/300.0] [batch_t 0.356 (0.437)] [data_t 0.015] [optim_t 0.341] [lr 0.002190] [CE 3.995 (3.726)] [KD 0.000 (0.000)] 2024-10-12 03:46:08,665 - Train: 35.00% [131350/375300] [105.0/300.0] [batch_t 0.316 (0.415)] [data_t 0.015] [optim_t 0.301] [lr 0.002189] [CE 3.858 (3.655)] [KD 0.000 (0.000)] 2024-10-12 03:46:32,104 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.433)] [top1_cnt 36095] [top5_cnt 45719] [top_all 50000] 2024-10-12 03:46:32,105 - net: 72.190 (91.438) 2024-10-12 03:46:53,814 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.426)] [top1_cnt 38934] [top5_cnt 47076] [top_all 50000] 2024-10-12 03:46:53,815 - net_E: 77.868 (94.152) 2024-10-12 03:46:53,985 - Max [top1: 72.338 (epoch: 100)] [top1-ema: 77.868 (epoch: 105)] 2024-10-12 03:46:53,986 - ==> Total time: 15:59:57 Eta: 1 day, 5:42:47 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 03:47:19,674 - Train: 35.01% [131400/375300] [105.0/300.0] [batch_t 0.467 (0.462)] [data_t 0.016] [optim_t 0.452] [lr 0.002189] [CE 3.501 (3.647)] [KD 0.000 (0.000)] 2024-10-12 03:47:41,623 - Train: 35.03% [131450/375300] [105.1/300.0] [batch_t 0.452 (0.439)] [data_t 0.016] [optim_t 0.436] [lr 0.002188] [CE 3.805 (3.629)] [KD 0.000 (0.000)] 2024-10-12 03:48:03,810 - Train: 35.04% [131500/375300] [105.1/300.0] [batch_t 0.462 (0.444)] [data_t 0.015] [optim_t 0.447] [lr 0.002188] [CE 3.826 (3.682)] [KD 0.000 (0.000)] 2024-10-12 03:48:25,552 - Train: 35.05% [131550/375300] [105.2/300.0] [batch_t 0.426 (0.435)] [data_t 0.015] [optim_t 0.410] [lr 0.002187] [CE 3.704 (3.672)] [KD 0.000 (0.000)] 2024-10-12 03:48:46,711 - Train: 35.07% [131600/375300] [105.2/300.0] [batch_t 0.468 (0.423)] [data_t 0.016] [optim_t 0.452] [lr 0.002186] [CE 3.651 (3.601)] [KD 0.000 (0.000)] 2024-10-12 03:49:08,056 - Train: 35.08% [131650/375300] [105.2/300.0] [batch_t 0.410 (0.427)] [data_t 0.016] [optim_t 0.394] [lr 0.002186] [CE 3.615 (3.676)] [KD 0.000 (0.000)] 2024-10-12 03:49:30,006 - Train: 35.09% [131700/375300] [105.3/300.0] [batch_t 0.480 (0.439)] [data_t 0.015] [optim_t 0.464] [lr 0.002185] [CE 3.607 (3.663)] [KD 0.000 (0.000)] 2024-10-12 03:49:52,376 - Train: 35.11% [131750/375300] [105.3/300.0] [batch_t 0.358 (0.447)] [data_t 0.016] [optim_t 0.342] [lr 0.002185] [CE 3.231 (3.683)] [KD 0.000 (0.000)] 2024-10-12 03:50:14,575 - Train: 35.12% [131800/375300] [105.4/300.0] [batch_t 0.396 (0.444)] [data_t 0.016] [optim_t 0.380] [lr 0.002184] [CE 3.733 (3.697)] [KD 0.000 (0.000)] 2024-10-12 03:50:36,788 - Train: 35.13% [131850/375300] [105.4/300.0] [batch_t 0.442 (0.444)] [data_t 0.015] [optim_t 0.427] [lr 0.002184] [CE 3.679 (3.639)] [KD 0.000 (0.000)] 2024-10-12 03:50:58,827 - Train: 35.15% [131900/375300] [105.4/300.0] [batch_t 0.393 (0.441)] [data_t 0.016] [optim_t 0.377] [lr 0.002183] [CE 3.642 (3.651)] [KD 0.000 (0.000)] 2024-10-12 03:51:20,850 - Train: 35.16% [131950/375300] [105.5/300.0] [batch_t 0.472 (0.440)] [data_t 0.016] [optim_t 0.456] [lr 0.002183] [CE 3.895 (3.658)] [KD 0.000 (0.000)] 2024-10-12 03:51:42,941 - Train: 35.17% [132000/375300] [105.5/300.0] [batch_t 0.427 (0.442)] [data_t 0.016] [optim_t 0.411] [lr 0.002182] [CE 3.529 (3.679)] [KD 0.000 (0.000)] 2024-10-12 03:52:05,341 - Train: 35.19% [132050/375300] [105.6/300.0] [batch_t 0.402 (0.448)] [data_t 0.016] [optim_t 0.386] [lr 0.002181] [CE 3.869 (3.651)] [KD 0.000 (0.000)] 2024-10-12 03:52:27,515 - Train: 35.20% [132100/375300] [105.6/300.0] [batch_t 0.451 (0.443)] [data_t 0.016] [optim_t 0.436] [lr 0.002181] [CE 3.765 (3.661)] [KD 0.000 (0.000)] 2024-10-12 03:52:49,949 - Train: 35.21% [132150/375300] [105.6/300.0] [batch_t 0.361 (0.448)] [data_t 0.016] [optim_t 0.345] [lr 0.002180] [CE 3.897 (3.643)] [KD 0.000 (0.000)] 2024-10-12 03:53:12,319 - Train: 35.23% [132200/375300] [105.7/300.0] [batch_t 0.441 (0.447)] [data_t 0.016] [optim_t 0.425] [lr 0.002180] [CE 3.135 (3.679)] [KD 0.000 (0.000)] 2024-10-12 03:53:33,873 - Train: 35.24% [132250/375300] [105.7/300.0] [batch_t 0.324 (0.431)] [data_t 0.016] [optim_t 0.308] [lr 0.002179] [CE 3.957 (3.648)] [KD 0.000 (0.000)] 2024-10-12 03:53:54,982 - Train: 35.25% [132300/375300] [105.8/300.0] [batch_t 0.449 (0.422)] [data_t 0.016] [optim_t 0.433] [lr 0.002179] [CE 3.852 (3.675)] [KD 0.000 (0.000)] 2024-10-12 03:54:17,157 - Train: 35.27% [132350/375300] [105.8/300.0] [batch_t 0.479 (0.443)] [data_t 0.016] [optim_t 0.464] [lr 0.002178] [CE 3.779 (3.673)] [KD 0.000 (0.000)] 2024-10-12 03:54:39,360 - Train: 35.28% [132400/375300] [105.8/300.0] [batch_t 0.317 (0.444)] [data_t 0.016] [optim_t 0.301] [lr 0.002178] [CE 3.737 (3.635)] [KD 0.000 (0.000)] 2024-10-12 03:55:01,485 - Train: 35.29% [132450/375300] [105.9/300.0] [batch_t 0.503 (0.442)] [data_t 0.016] [optim_t 0.487] [lr 0.002177] [CE 3.815 (3.706)] [KD 0.000 (0.000)] 2024-10-12 03:55:23,591 - Train: 35.31% [132500/375300] [105.9/300.0] [batch_t 0.319 (0.442)] [data_t 0.016] [optim_t 0.304] [lr 0.002176] [CE 3.616 (3.692)] [KD 0.000 (0.000)] 2024-10-12 03:55:44,488 - Train: 35.32% [132550/375300] [106.0/300.0] [batch_t 0.409 (0.418)] [data_t 0.016] [optim_t 0.393] [lr 0.002176] [CE 3.510 (3.634)] [KD 0.000 (0.000)] 2024-10-12 03:56:05,064 - Train: 35.33% [132600/375300] [106.0/300.0] [batch_t 0.313 (0.411)] [data_t 0.015] [optim_t 0.298] [lr 0.002175] [CE 3.302 (3.714)] [KD 0.000 (0.000)] 2024-10-12 03:56:06,935 - ==> Total time: 16:09:10 Eta: 1 day, 5:33:47 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 03:56:29,951 - Train: 35.35% [132650/375300] [106.0/300.0] [batch_t 0.390 (0.482)] [data_t 0.015] [optim_t 0.374] [lr 0.002175] [CE 3.701 (3.666)] [KD 0.000 (0.000)] 2024-10-12 03:56:51,881 - Train: 35.36% [132700/375300] [106.1/300.0] [batch_t 0.407 (0.438)] [data_t 0.015] [optim_t 0.391] [lr 0.002174] [CE 4.060 (3.663)] [KD 0.000 (0.000)] 2024-10-12 03:57:13,362 - Train: 35.37% [132750/375300] [106.1/300.0] [batch_t 0.317 (0.429)] [data_t 0.015] [optim_t 0.302] [lr 0.002174] [CE 3.519 (3.683)] [KD 0.000 (0.000)] 2024-10-12 03:57:34,700 - Train: 35.39% [132800/375300] [106.2/300.0] [batch_t 0.434 (0.427)] [data_t 0.016] [optim_t 0.418] [lr 0.002173] [CE 3.652 (3.678)] [KD 0.000 (0.000)] 2024-10-12 03:57:56,007 - Train: 35.40% [132850/375300] [106.2/300.0] [batch_t 0.417 (0.426)] [data_t 0.015] [optim_t 0.401] [lr 0.002173] [CE 3.590 (3.658)] [KD 0.000 (0.000)] 2024-10-12 03:58:17,223 - Train: 35.41% [132900/375300] [106.2/300.0] [batch_t 0.417 (0.424)] [data_t 0.015] [optim_t 0.402] [lr 0.002172] [CE 3.946 (3.707)] [KD 0.000 (0.000)] 2024-10-12 03:58:38,520 - Train: 35.42% [132950/375300] [106.3/300.0] [batch_t 0.459 (0.426)] [data_t 0.016] [optim_t 0.444] [lr 0.002171] [CE 3.950 (3.667)] [KD 0.000 (0.000)] 2024-10-12 03:58:59,739 - Train: 35.44% [133000/375300] [106.3/300.0] [batch_t 0.405 (0.424)] [data_t 0.015] [optim_t 0.389] [lr 0.002171] [CE 3.651 (3.680)] [KD 0.000 (0.000)] 2024-10-12 03:59:20,940 - Train: 35.45% [133050/375300] [106.4/300.0] [batch_t 0.455 (0.424)] [data_t 0.016] [optim_t 0.439] [lr 0.002170] [CE 3.795 (3.664)] [KD 0.000 (0.000)] 2024-10-12 03:59:41,906 - Train: 35.46% [133100/375300] [106.4/300.0] [batch_t 0.406 (0.419)] [data_t 0.015] [optim_t 0.390] [lr 0.002170] [CE 3.348 (3.639)] [KD 0.000 (0.000)] 2024-10-12 04:00:03,502 - Train: 35.48% [133150/375300] [106.4/300.0] [batch_t 0.442 (0.432)] [data_t 0.016] [optim_t 0.427] [lr 0.002169] [CE 3.433 (3.696)] [KD 0.000 (0.000)] 2024-10-12 04:00:25,447 - Train: 35.49% [133200/375300] [106.5/300.0] [batch_t 0.370 (0.439)] [data_t 0.016] [optim_t 0.354] [lr 0.002169] [CE 3.890 (3.656)] [KD 0.000 (0.000)] 2024-10-12 04:00:47,471 - Train: 35.50% [133250/375300] [106.5/300.0] [batch_t 0.433 (0.440)] [data_t 0.016] [optim_t 0.417] [lr 0.002168] [CE 3.819 (3.665)] [KD 0.000 (0.000)] 2024-10-12 04:01:09,810 - Train: 35.52% [133300/375300] [106.6/300.0] [batch_t 0.454 (0.447)] [data_t 0.015] [optim_t 0.438] [lr 0.002168] [CE 3.891 (3.690)] [KD 0.000 (0.000)] 2024-10-12 04:01:31,301 - Train: 35.53% [133350/375300] [106.6/300.0] [batch_t 0.378 (0.430)] [data_t 0.016] [optim_t 0.362] [lr 0.002167] [CE 3.647 (3.670)] [KD 0.000 (0.000)] 2024-10-12 04:01:53,034 - Train: 35.54% [133400/375300] [106.6/300.0] [batch_t 0.408 (0.435)] [data_t 0.016] [optim_t 0.392] [lr 0.002166] [CE 3.775 (3.672)] [KD 0.000 (0.000)] 2024-10-12 04:02:15,312 - Train: 35.56% [133450/375300] [106.7/300.0] [batch_t 0.368 (0.445)] [data_t 0.015] [optim_t 0.353] [lr 0.002166] [CE 4.014 (3.704)] [KD 0.000 (0.000)] 2024-10-12 04:02:37,363 - Train: 35.57% [133500/375300] [106.7/300.0] [batch_t 0.452 (0.441)] [data_t 0.016] [optim_t 0.437] [lr 0.002165] [CE 3.295 (3.668)] [KD 0.000 (0.000)] 2024-10-12 04:02:58,084 - Train: 35.58% [133550/375300] [106.8/300.0] [batch_t 0.422 (0.414)] [data_t 0.015] [optim_t 0.407] [lr 0.002165] [CE 3.593 (3.631)] [KD 0.000 (0.000)] 2024-10-12 04:03:19,771 - Train: 35.60% [133600/375300] [106.8/300.0] [batch_t 0.317 (0.434)] [data_t 0.015] [optim_t 0.301] [lr 0.002164] [CE 3.748 (3.681)] [KD 0.000 (0.000)] 2024-10-12 04:03:41,304 - Train: 35.61% [133650/375300] [106.8/300.0] [batch_t 0.427 (0.431)] [data_t 0.016] [optim_t 0.412] [lr 0.002164] [CE 3.754 (3.676)] [KD 0.000 (0.000)] 2024-10-12 04:04:02,831 - Train: 35.62% [133700/375300] [106.9/300.0] [batch_t 0.470 (0.430)] [data_t 0.015] [optim_t 0.454] [lr 0.002163] [CE 3.740 (3.628)] [KD 0.000 (0.000)] 2024-10-12 04:04:25,395 - Train: 35.64% [133750/375300] [106.9/300.0] [batch_t 0.413 (0.451)] [data_t 0.015] [optim_t 0.397] [lr 0.002163] [CE 3.636 (3.649)] [KD 0.000 (0.000)] 2024-10-12 04:04:47,897 - Train: 35.65% [133800/375300] [107.0/300.0] [batch_t 0.446 (0.450)] [data_t 0.015] [optim_t 0.431] [lr 0.002162] [CE 3.702 (3.635)] [KD 0.000 (0.000)] 2024-10-12 04:05:09,379 - Train: 35.66% [133850/375300] [107.0/300.0] [batch_t 0.312 (0.430)] [data_t 0.015] [optim_t 0.297] [lr 0.002161] [CE 4.114 (3.699)] [KD 0.000 (0.000)] 2024-10-12 04:05:11,597 - ==> Total time: 16:18:15 Eta: 1 day, 5:24:31 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 04:05:34,355 - Train: 35.68% [133900/375300] [107.0/300.0] [batch_t 0.322 (0.496)] [data_t 0.016] [optim_t 0.307] [lr 0.002161] [CE 3.803 (3.634)] [KD 0.000 (0.000)] 2024-10-12 04:05:56,835 - Train: 35.69% [133950/375300] [107.1/300.0] [batch_t 0.511 (0.449)] [data_t 0.015] [optim_t 0.495] [lr 0.002160] [CE 3.635 (3.668)] [KD 0.000 (0.000)] 2024-10-12 04:06:18,687 - Train: 35.70% [134000/375300] [107.1/300.0] [batch_t 0.456 (0.437)] [data_t 0.016] [optim_t 0.440] [lr 0.002160] [CE 3.840 (3.668)] [KD 0.000 (0.000)] 2024-10-12 04:06:40,321 - Train: 35.72% [134050/375300] [107.2/300.0] [batch_t 0.315 (0.433)] [data_t 0.016] [optim_t 0.300] [lr 0.002159] [CE 3.846 (3.646)] [KD 0.000 (0.000)] 2024-10-12 04:07:02,594 - Train: 35.73% [134100/375300] [107.2/300.0] [batch_t 0.507 (0.445)] [data_t 0.211] [optim_t 0.296] [lr 0.002159] [CE 3.591 (3.665)] [KD 0.000 (0.000)] 2024-10-12 04:07:24,393 - Train: 35.74% [134150/375300] [107.2/300.0] [batch_t 0.404 (0.436)] [data_t 0.108] [optim_t 0.296] [lr 0.002158] [CE 3.769 (3.650)] [KD 0.000 (0.000)] 2024-10-12 04:07:46,600 - Train: 35.76% [134200/375300] [107.3/300.0] [batch_t 0.393 (0.444)] [data_t 0.094] [optim_t 0.298] [lr 0.002157] [CE 3.470 (3.678)] [KD 0.000 (0.000)] 2024-10-12 04:08:08,439 - Train: 35.77% [134250/375300] [107.3/300.0] [batch_t 0.433 (0.437)] [data_t 0.139] [optim_t 0.294] [lr 0.002157] [CE 3.637 (3.652)] [KD 0.000 (0.000)] 2024-10-12 04:08:30,164 - Train: 35.78% [134300/375300] [107.4/300.0] [batch_t 0.520 (0.434)] [data_t 0.221] [optim_t 0.299] [lr 0.002156] [CE 4.048 (3.666)] [KD 0.000 (0.000)] 2024-10-12 04:08:51,380 - Train: 35.80% [134350/375300] [107.4/300.0] [batch_t 0.473 (0.424)] [data_t 0.175] [optim_t 0.298] [lr 0.002156] [CE 3.775 (3.674)] [KD 0.000 (0.000)] 2024-10-12 04:09:13,554 - Train: 35.81% [134400/375300] [107.4/300.0] [batch_t 0.534 (0.443)] [data_t 0.232] [optim_t 0.302] [lr 0.002155] [CE 3.898 (3.600)] [KD 0.000 (0.000)] 2024-10-12 04:09:35,380 - Train: 35.82% [134450/375300] [107.5/300.0] [batch_t 0.397 (0.436)] [data_t 0.099] [optim_t 0.298] [lr 0.002155] [CE 3.710 (3.649)] [KD 0.000 (0.000)] 2024-10-12 04:09:57,563 - Train: 35.84% [134500/375300] [107.5/300.0] [batch_t 0.490 (0.444)] [data_t 0.192] [optim_t 0.298] [lr 0.002154] [CE 3.426 (3.630)] [KD 0.000 (0.000)] 2024-10-12 04:10:19,660 - Train: 35.85% [134550/375300] [107.6/300.0] [batch_t 0.443 (0.442)] [data_t 0.142] [optim_t 0.301] [lr 0.002154] [CE 3.843 (3.679)] [KD 0.000 (0.000)] 2024-10-12 04:10:41,009 - Train: 35.86% [134600/375300] [107.6/300.0] [batch_t 0.436 (0.427)] [data_t 0.134] [optim_t 0.302] [lr 0.002153] [CE 3.764 (3.625)] [KD 0.000 (0.000)] 2024-10-12 04:11:02,238 - Train: 35.88% [134650/375300] [107.6/300.0] [batch_t 0.481 (0.424)] [data_t 0.179] [optim_t 0.303] [lr 0.002152] [CE 3.887 (3.717)] [KD 0.000 (0.000)] 2024-10-12 04:11:23,659 - Train: 35.89% [134700/375300] [107.7/300.0] [batch_t 0.428 (0.428)] [data_t 0.127] [optim_t 0.301] [lr 0.002152] [CE 3.754 (3.668)] [KD 0.000 (0.000)] 2024-10-12 04:11:45,915 - Train: 35.90% [134750/375300] [107.7/300.0] [batch_t 0.390 (0.445)] [data_t 0.095] [optim_t 0.295] [lr 0.002151] [CE 3.640 (3.720)] [KD 0.000 (0.000)] 2024-10-12 04:12:08,613 - Train: 35.92% [134800/375300] [107.8/300.0] [batch_t 0.473 (0.454)] [data_t 0.177] [optim_t 0.296] [lr 0.002151] [CE 3.765 (3.700)] [KD 0.000 (0.000)] 2024-10-12 04:12:30,753 - Train: 35.93% [134850/375300] [107.8/300.0] [batch_t 0.395 (0.443)] [data_t 0.101] [optim_t 0.294] [lr 0.002150] [CE 3.670 (3.737)] [KD 0.000 (0.000)] 2024-10-12 04:12:52,632 - Train: 35.94% [134900/375300] [107.8/300.0] [batch_t 0.478 (0.437)] [data_t 0.178] [optim_t 0.300] [lr 0.002150] [CE 3.660 (3.637)] [KD 0.000 (0.000)] 2024-10-12 04:13:14,213 - Train: 35.96% [134950/375300] [107.9/300.0] [batch_t 0.392 (0.431)] [data_t 0.096] [optim_t 0.296] [lr 0.002149] [CE 3.570 (3.642)] [KD 0.000 (0.000)] 2024-10-12 04:13:36,058 - Train: 35.97% [135000/375300] [107.9/300.0] [batch_t 0.483 (0.437)] [data_t 0.016] [optim_t 0.467] [lr 0.002149] [CE 3.624 (3.644)] [KD 0.000 (0.000)] 2024-10-12 04:13:57,699 - Train: 35.98% [135050/375300] [108.0/300.0] [batch_t 0.429 (0.433)] [data_t 0.016] [optim_t 0.413] [lr 0.002148] [CE 3.629 (3.633)] [KD 0.000 (0.000)] 2024-10-12 04:14:19,308 - Train: 36.00% [135100/375300] [108.0/300.0] [batch_t 0.310 (0.432)] [data_t 0.015] [optim_t 0.295] [lr 0.002147] [CE 3.337 (3.681)] [KD 0.000 (0.000)] 2024-10-12 04:14:21,802 - ==> Total time: 16:27:25 Eta: 1 day, 5:15:25 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 04:14:44,515 - Train: 36.01% [135150/375300] [108.0/300.0] [batch_t 0.461 (0.499)] [data_t 0.162] [optim_t 0.299] [lr 0.002147] [CE 3.672 (3.627)] [KD 0.000 (0.000)] 2024-10-12 04:15:06,528 - Train: 36.02% [135200/375300] [108.1/300.0] [batch_t 0.402 (0.440)] [data_t 0.015] [optim_t 0.387] [lr 0.002146] [CE 3.689 (3.685)] [KD 0.000 (0.000)] 2024-10-12 04:15:28,599 - Train: 36.04% [135250/375300] [108.1/300.0] [batch_t 0.486 (0.441)] [data_t 0.016] [optim_t 0.470] [lr 0.002146] [CE 3.728 (3.652)] [KD 0.000 (0.000)] 2024-10-12 04:15:50,345 - Train: 36.05% [135300/375300] [108.2/300.0] [batch_t 0.380 (0.435)] [data_t 0.016] [optim_t 0.364] [lr 0.002145] [CE 3.660 (3.620)] [KD 0.000 (0.000)] 2024-10-12 04:16:12,467 - Train: 36.06% [135350/375300] [108.2/300.0] [batch_t 0.517 (0.442)] [data_t 0.016] [optim_t 0.501] [lr 0.002145] [CE 3.153 (3.623)] [KD 0.000 (0.000)] 2024-10-12 04:16:34,502 - Train: 36.08% [135400/375300] [108.2/300.0] [batch_t 0.495 (0.441)] [data_t 0.016] [optim_t 0.480] [lr 0.002144] [CE 3.802 (3.698)] [KD 0.000 (0.000)] 2024-10-12 04:16:56,780 - Train: 36.09% [135450/375300] [108.3/300.0] [batch_t 0.499 (0.445)] [data_t 0.016] [optim_t 0.484] [lr 0.002143] [CE 3.722 (3.637)] [KD 0.000 (0.000)] 2024-10-12 04:17:18,874 - Train: 36.10% [135500/375300] [108.3/300.0] [batch_t 0.374 (0.442)] [data_t 0.015] [optim_t 0.359] [lr 0.002143] [CE 3.758 (3.685)] [KD 0.000 (0.000)] 2024-10-12 04:17:40,984 - Train: 36.12% [135550/375300] [108.4/300.0] [batch_t 0.478 (0.442)] [data_t 0.016] [optim_t 0.462] [lr 0.002142] [CE 3.732 (3.651)] [KD 0.000 (0.000)] 2024-10-12 04:18:03,366 - Train: 36.13% [135600/375300] [108.4/300.0] [batch_t 0.490 (0.448)] [data_t 0.015] [optim_t 0.475] [lr 0.002142] [CE 3.563 (3.710)] [KD 0.000 (0.000)] 2024-10-12 04:18:25,398 - Train: 36.14% [135650/375300] [108.4/300.0] [batch_t 0.428 (0.441)] [data_t 0.016] [optim_t 0.412] [lr 0.002141] [CE 3.282 (3.617)] [KD 0.000 (0.000)] 2024-10-12 04:18:47,497 - Train: 36.16% [135700/375300] [108.5/300.0] [batch_t 0.351 (0.442)] [data_t 0.015] [optim_t 0.335] [lr 0.002141] [CE 3.461 (3.655)] [KD 0.000 (0.000)] 2024-10-12 04:19:10,100 - Train: 36.17% [135750/375300] [108.5/300.0] [batch_t 0.311 (0.452)] [data_t 0.015] [optim_t 0.296] [lr 0.002140] [CE 4.012 (3.654)] [KD 0.000 (0.000)] 2024-10-12 04:19:32,078 - Train: 36.18% [135800/375300] [108.6/300.0] [batch_t 0.542 (0.439)] [data_t 0.015] [optim_t 0.527] [lr 0.002139] [CE 3.275 (3.656)] [KD 0.000 (0.000)] 2024-10-12 04:19:53,973 - Train: 36.20% [135850/375300] [108.6/300.0] [batch_t 0.309 (0.438)] [data_t 0.016] [optim_t 0.293] [lr 0.002139] [CE 3.682 (3.624)] [KD 0.000 (0.000)] 2024-10-12 04:20:15,535 - Train: 36.21% [135900/375300] [108.6/300.0] [batch_t 0.914 (0.431)] [data_t 0.016] [optim_t 0.899] [lr 0.002138] [CE 3.894 (3.664)] [KD 0.000 (0.000)] 2024-10-12 04:20:37,975 - Train: 36.22% [135950/375300] [108.7/300.0] [batch_t 0.401 (0.449)] [data_t 0.015] [optim_t 0.386] [lr 0.002138] [CE 3.698 (3.675)] [KD 0.000 (0.000)] 2024-10-12 04:21:00,153 - Train: 36.24% [136000/375300] [108.7/300.0] [batch_t 0.466 (0.443)] [data_t 0.016] [optim_t 0.450] [lr 0.002137] [CE 3.500 (3.656)] [KD 0.000 (0.000)] 2024-10-12 04:21:21,801 - Train: 36.25% [136050/375300] [108.8/300.0] [batch_t 0.389 (0.433)] [data_t 0.016] [optim_t 0.373] [lr 0.002137] [CE 3.796 (3.675)] [KD 0.000 (0.000)] 2024-10-12 04:21:43,753 - Train: 36.26% [136100/375300] [108.8/300.0] [batch_t 0.479 (0.439)] [data_t 0.016] [optim_t 0.463] [lr 0.002136] [CE 3.744 (3.702)] [KD 0.000 (0.000)] 2024-10-12 04:22:06,122 - Train: 36.28% [136150/375300] [108.8/300.0] [batch_t 0.316 (0.447)] [data_t 0.016] [optim_t 0.300] [lr 0.002136] [CE 3.859 (3.653)] [KD 0.000 (0.000)] 2024-10-12 04:22:27,992 - Train: 36.29% [136200/375300] [108.9/300.0] [batch_t 0.401 (0.437)] [data_t 0.016] [optim_t 0.385] [lr 0.002135] [CE 3.648 (3.700)] [KD 0.000 (0.000)] 2024-10-12 04:22:50,160 - Train: 36.30% [136250/375300] [108.9/300.0] [batch_t 0.773 (0.443)] [data_t 0.480] [optim_t 0.293] [lr 0.002134] [CE 3.615 (3.639)] [KD 0.000 (0.000)] 2024-10-12 04:23:12,558 - Train: 36.32% [136300/375300] [109.0/300.0] [batch_t 0.465 (0.448)] [data_t 0.169] [optim_t 0.296] [lr 0.002134] [CE 3.803 (3.642)] [KD 0.000 (0.000)] 2024-10-12 04:23:34,550 - Train: 36.33% [136350/375300] [109.0/300.0] [batch_t 0.315 (0.440)] [data_t 0.015] [optim_t 0.300] [lr 0.002133] [CE 3.816 (3.726)] [KD 0.000 (0.000)] 2024-10-12 04:23:37,347 - ==> Total time: 16:36:41 Eta: 1 day, 5:06:29 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 04:23:59,777 - Train: 36.34% [136400/375300] [109.0/300.0] [batch_t 0.418 (0.509)] [data_t 0.121] [optim_t 0.297] [lr 0.002133] [CE 3.839 (3.642)] [KD 0.000 (0.000)] 2024-10-12 04:24:21,262 - Train: 36.36% [136450/375300] [109.1/300.0] [batch_t 0.420 (0.430)] [data_t 0.125] [optim_t 0.295] [lr 0.002132] [CE 3.570 (3.656)] [KD 0.000 (0.000)] 2024-10-12 04:24:43,205 - Train: 36.37% [136500/375300] [109.1/300.0] [batch_t 0.365 (0.439)] [data_t 0.071] [optim_t 0.295] [lr 0.002132] [CE 3.307 (3.619)] [KD 0.000 (0.000)] 2024-10-12 04:25:05,257 - Train: 36.38% [136550/375300] [109.2/300.0] [batch_t 0.512 (0.441)] [data_t 0.216] [optim_t 0.296] [lr 0.002131] [CE 3.925 (3.631)] [KD 0.000 (0.000)] 2024-10-12 04:25:27,050 - Train: 36.40% [136600/375300] [109.2/300.0] [batch_t 0.458 (0.436)] [data_t 0.161] [optim_t 0.296] [lr 0.002130] [CE 3.709 (3.649)] [KD 0.000 (0.000)] 2024-10-12 04:25:49,505 - Train: 36.41% [136650/375300] [109.2/300.0] [batch_t 0.466 (0.449)] [data_t 0.169] [optim_t 0.297] [lr 0.002130] [CE 3.626 (3.672)] [KD 0.000 (0.000)] 2024-10-12 04:26:11,230 - Train: 36.42% [136700/375300] [109.3/300.0] [batch_t 0.497 (0.434)] [data_t 0.193] [optim_t 0.304] [lr 0.002129] [CE 3.610 (3.629)] [KD 0.000 (0.000)] 2024-10-12 04:26:32,540 - Train: 36.44% [136750/375300] [109.3/300.0] [batch_t 0.318 (0.426)] [data_t 0.015] [optim_t 0.303] [lr 0.002129] [CE 3.714 (3.649)] [KD 0.000 (0.000)] 2024-10-12 04:26:53,807 - Train: 36.45% [136800/375300] [109.4/300.0] [batch_t 0.415 (0.425)] [data_t 0.119] [optim_t 0.296] [lr 0.002128] [CE 3.456 (3.637)] [KD 0.000 (0.000)] 2024-10-12 04:27:15,518 - Train: 36.46% [136850/375300] [109.4/300.0] [batch_t 0.528 (0.434)] [data_t 0.135] [optim_t 0.392] [lr 0.002128] [CE 3.421 (3.668)] [KD 0.000 (0.000)] 2024-10-12 04:27:36,757 - Train: 36.48% [136900/375300] [109.4/300.0] [batch_t 0.520 (0.425)] [data_t 0.225] [optim_t 0.295] [lr 0.002127] [CE 3.519 (3.603)] [KD 0.000 (0.000)] 2024-10-12 04:27:57,906 - Train: 36.49% [136950/375300] [109.5/300.0] [batch_t 0.396 (0.423)] [data_t 0.100] [optim_t 0.295] [lr 0.002127] [CE 3.739 (3.642)] [KD 0.000 (0.000)] 2024-10-12 04:28:19,230 - Train: 36.50% [137000/375300] [109.5/300.0] [batch_t 0.314 (0.426)] [data_t 0.015] [optim_t 0.299] [lr 0.002126] [CE 3.917 (3.687)] [KD 0.000 (0.000)] 2024-10-12 04:28:40,584 - Train: 36.52% [137050/375300] [109.6/300.0] [batch_t 0.633 (0.427)] [data_t 0.065] [optim_t 0.569] [lr 0.002125] [CE 3.640 (3.653)] [KD 0.000 (0.000)] 2024-10-12 04:29:01,654 - Train: 36.53% [137100/375300] [109.6/300.0] [batch_t 0.431 (0.421)] [data_t 0.136] [optim_t 0.295] [lr 0.002125] [CE 3.933 (3.617)] [KD 0.000 (0.000)] 2024-10-12 04:29:23,066 - Train: 36.54% [137150/375300] [109.6/300.0] [batch_t 0.465 (0.428)] [data_t 0.170] [optim_t 0.295] [lr 0.002124] [CE 3.595 (3.652)] [KD 0.000 (0.000)] 2024-10-12 04:29:44,775 - Train: 36.56% [137200/375300] [109.7/300.0] [batch_t 0.553 (0.434)] [data_t 0.259] [optim_t 0.295] [lr 0.002124] [CE 3.641 (3.671)] [KD 0.000 (0.000)] 2024-10-12 04:30:06,671 - Train: 36.57% [137250/375300] [109.7/300.0] [batch_t 0.407 (0.438)] [data_t 0.112] [optim_t 0.295] [lr 0.002123] [CE 3.773 (3.676)] [KD 0.000 (0.000)] 2024-10-12 04:30:28,509 - Train: 36.58% [137300/375300] [109.8/300.0] [batch_t 0.362 (0.437)] [data_t 0.063] [optim_t 0.298] [lr 0.002123] [CE 3.763 (3.654)] [KD 0.000 (0.000)] 2024-10-12 04:30:49,991 - Train: 36.60% [137350/375300] [109.8/300.0] [batch_t 0.509 (0.430)] [data_t 0.212] [optim_t 0.297] [lr 0.002122] [CE 3.868 (3.668)] [KD 0.000 (0.000)] 2024-10-12 04:31:12,151 - Train: 36.61% [137400/375300] [109.8/300.0] [batch_t 0.489 (0.443)] [data_t 0.194] [optim_t 0.295] [lr 0.002121] [CE 3.784 (3.690)] [KD 0.000 (0.000)] 2024-10-12 04:31:33,683 - Train: 36.62% [137450/375300] [109.9/300.0] [batch_t 0.524 (0.431)] [data_t 0.224] [optim_t 0.300] [lr 0.002121] [CE 3.777 (3.681)] [KD 0.000 (0.000)] 2024-10-12 04:31:55,141 - Train: 36.64% [137500/375300] [109.9/300.0] [batch_t 0.463 (0.429)] [data_t 0.161] [optim_t 0.302] [lr 0.002120] [CE 3.431 (3.670)] [KD 0.000 (0.000)] 2024-10-12 04:32:16,879 - Train: 36.65% [137550/375300] [110.0/300.0] [batch_t 0.369 (0.435)] [data_t 0.069] [optim_t 0.301] [lr 0.002120] [CE 3.440 (3.668)] [KD 0.000 (0.000)] 2024-10-12 04:32:38,682 - Train: 36.66% [137600/375300] [110.0/300.0] [batch_t 0.317 (0.436)] [data_t 0.015] [optim_t 0.302] [lr 0.002119] [CE 3.712 (3.608)] [KD 0.000 (0.000)] 2024-10-12 04:33:04,166 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.442)] [top1_cnt 36285] [top5_cnt 45877] [top_all 50000] 2024-10-12 04:33:04,166 - net: 72.570 (91.754) 2024-10-12 04:33:25,803 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.424)] [top1_cnt 39023] [top5_cnt 47105] [top_all 50000] 2024-10-12 04:33:25,804 - net_E: 78.046 (94.210) 2024-10-12 04:33:25,989 - Max [top1: 72.570 (epoch: 110)] [top1-ema: 78.046 (epoch: 110)] 2024-10-12 04:33:25,989 - ==> Total time: 16:46:29 Eta: 1 day, 4:58:29 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 04:33:50,566 - Train: 36.68% [137650/375300] [110.0/300.0] [batch_t 0.322 (0.447)] [data_t 0.016] [optim_t 0.307] [lr 0.002119] [CE 3.648 (3.641)] [KD 0.000 (0.000)] 2024-10-12 04:34:13,512 - Train: 36.69% [137700/375300] [110.1/300.0] [batch_t 0.502 (0.459)] [data_t 0.016] [optim_t 0.486] [lr 0.002118] [CE 3.649 (3.658)] [KD 0.000 (0.000)] 2024-10-12 04:34:36,718 - Train: 36.70% [137750/375300] [110.1/300.0] [batch_t 0.500 (0.464)] [data_t 0.015] [optim_t 0.485] [lr 0.002117] [CE 3.811 (3.657)] [KD 0.000 (0.000)] 2024-10-12 04:34:59,343 - Train: 36.72% [137800/375300] [110.2/300.0] [batch_t 0.374 (0.452)] [data_t 0.016] [optim_t 0.358] [lr 0.002117] [CE 3.490 (3.658)] [KD 0.000 (0.000)] 2024-10-12 04:35:22,127 - Train: 36.73% [137850/375300] [110.2/300.0] [batch_t 0.432 (0.456)] [data_t 0.016] [optim_t 0.417] [lr 0.002116] [CE 3.743 (3.680)] [KD 0.000 (0.000)] 2024-10-12 04:35:44,709 - Train: 36.74% [137900/375300] [110.2/300.0] [batch_t 0.408 (0.451)] [data_t 0.016] [optim_t 0.392] [lr 0.002116] [CE 3.798 (3.591)] [KD 0.000 (0.000)] 2024-10-12 04:36:07,404 - Train: 36.76% [137950/375300] [110.3/300.0] [batch_t 0.448 (0.454)] [data_t 0.015] [optim_t 0.433] [lr 0.002115] [CE 3.783 (3.685)] [KD 0.000 (0.000)] 2024-10-12 04:36:29,502 - Train: 36.77% [138000/375300] [110.3/300.0] [batch_t 0.429 (0.442)] [data_t 0.016] [optim_t 0.414] [lr 0.002115] [CE 3.763 (3.658)] [KD 0.000 (0.000)] 2024-10-12 04:36:51,531 - Train: 36.78% [138050/375300] [110.4/300.0] [batch_t 0.416 (0.440)] [data_t 0.016] [optim_t 0.400] [lr 0.002114] [CE 3.715 (3.652)] [KD 0.000 (0.000)] 2024-10-12 04:37:13,796 - Train: 36.80% [138100/375300] [110.4/300.0] [batch_t 0.370 (0.445)] [data_t 0.016] [optim_t 0.354] [lr 0.002113] [CE 3.233 (3.653)] [KD 0.000 (0.000)] 2024-10-12 04:37:35,876 - Train: 36.81% [138150/375300] [110.4/300.0] [batch_t 0.528 (0.441)] [data_t 0.016] [optim_t 0.513] [lr 0.002113] [CE 3.687 (3.634)] [KD 0.000 (0.000)] 2024-10-12 04:37:57,841 - Train: 36.82% [138200/375300] [110.5/300.0] [batch_t 0.443 (0.439)] [data_t 0.016] [optim_t 0.428] [lr 0.002112] [CE 3.605 (3.706)] [KD 0.000 (0.000)] 2024-10-12 04:38:19,911 - Train: 36.84% [138250/375300] [110.5/300.0] [batch_t 0.455 (0.441)] [data_t 0.015] [optim_t 0.440] [lr 0.002112] [CE 3.803 (3.715)] [KD 0.000 (0.000)] 2024-10-12 04:38:41,748 - Train: 36.85% [138300/375300] [110.6/300.0] [batch_t 0.392 (0.437)] [data_t 0.015] [optim_t 0.376] [lr 0.002111] [CE 3.345 (3.690)] [KD 0.000 (0.000)] 2024-10-12 04:39:03,772 - Train: 36.86% [138350/375300] [110.6/300.0] [batch_t 0.449 (0.440)] [data_t 0.016] [optim_t 0.433] [lr 0.002111] [CE 3.567 (3.678)] [KD 0.000 (0.000)] 2024-10-12 04:39:26,028 - Train: 36.88% [138400/375300] [110.6/300.0] [batch_t 0.421 (0.445)] [data_t 0.016] [optim_t 0.406] [lr 0.002110] [CE 3.571 (3.696)] [KD 0.000 (0.000)] 2024-10-12 04:39:47,770 - Train: 36.89% [138450/375300] [110.7/300.0] [batch_t 0.439 (0.435)] [data_t 0.016] [optim_t 0.423] [lr 0.002109] [CE 3.701 (3.673)] [KD 0.000 (0.000)] 2024-10-12 04:40:09,561 - Train: 36.90% [138500/375300] [110.7/300.0] [batch_t 0.322 (0.436)] [data_t 0.015] [optim_t 0.307] [lr 0.002109] [CE 3.698 (3.688)] [KD 0.000 (0.000)] 2024-10-12 04:40:31,809 - Train: 36.92% [138550/375300] [110.8/300.0] [batch_t 0.520 (0.445)] [data_t 0.015] [optim_t 0.504] [lr 0.002108] [CE 3.988 (3.635)] [KD 0.000 (0.000)] 2024-10-12 04:40:53,781 - Train: 36.93% [138600/375300] [110.8/300.0] [batch_t 0.387 (0.439)] [data_t 0.015] [optim_t 0.371] [lr 0.002108] [CE 3.682 (3.634)] [KD 0.000 (0.000)] 2024-10-12 04:41:15,977 - Train: 36.94% [138650/375300] [110.8/300.0] [batch_t 0.425 (0.444)] [data_t 0.015] [optim_t 0.410] [lr 0.002107] [CE 3.621 (3.676)] [KD 0.000 (0.000)] 2024-10-12 04:41:38,131 - Train: 36.96% [138700/375300] [110.9/300.0] [batch_t 0.446 (0.443)] [data_t 0.015] [optim_t 0.430] [lr 0.002107] [CE 3.679 (3.652)] [KD 0.000 (0.000)] 2024-10-12 04:42:00,311 - Train: 36.97% [138750/375300] [110.9/300.0] [batch_t 0.417 (0.443)] [data_t 0.015] [optim_t 0.402] [lr 0.002106] [CE 3.603 (3.670)] [KD 0.000 (0.000)] 2024-10-12 04:42:22,252 - Train: 36.98% [138800/375300] [111.0/300.0] [batch_t 0.384 (0.439)] [data_t 0.015] [optim_t 0.369] [lr 0.002105] [CE 3.425 (3.659)] [KD 0.000 (0.000)] 2024-10-12 04:42:43,884 - Train: 37.00% [138850/375300] [111.0/300.0] [batch_t 0.316 (0.433)] [data_t 0.015] [optim_t 0.301] [lr 0.002105] [CE 3.723 (3.648)] [KD 0.000 (0.000)] 2024-10-12 04:42:47,317 - ==> Total time: 16:55:51 Eta: 1 day, 4:49:41 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 04:43:09,060 - Train: 37.01% [138900/375300] [111.0/300.0] [batch_t 0.419 (0.515)] [data_t 0.016] [optim_t 0.403] [lr 0.002104] [CE 3.738 (3.591)] [KD 0.000 (0.000)] 2024-10-12 04:43:31,453 - Train: 37.02% [138950/375300] [111.1/300.0] [batch_t 0.641 (0.448)] [data_t 0.016] [optim_t 0.625] [lr 0.002104] [CE 3.447 (3.606)] [KD 0.000 (0.000)] 2024-10-12 04:43:52,942 - Train: 37.04% [139000/375300] [111.1/300.0] [batch_t 0.452 (0.430)] [data_t 0.016] [optim_t 0.436] [lr 0.002103] [CE 3.636 (3.636)] [KD 0.000 (0.000)] 2024-10-12 04:44:15,061 - Train: 37.05% [139050/375300] [111.2/300.0] [batch_t 0.485 (0.442)] [data_t 0.015] [optim_t 0.469] [lr 0.002103] [CE 3.555 (3.628)] [KD 0.000 (0.000)] 2024-10-12 04:44:36,711 - Train: 37.06% [139100/375300] [111.2/300.0] [batch_t 0.388 (0.433)] [data_t 0.016] [optim_t 0.372] [lr 0.002102] [CE 3.662 (3.670)] [KD 0.000 (0.000)] 2024-10-12 04:44:58,224 - Train: 37.08% [139150/375300] [111.2/300.0] [batch_t 0.476 (0.430)] [data_t 0.015] [optim_t 0.460] [lr 0.002101] [CE 3.666 (3.662)] [KD 0.000 (0.000)] 2024-10-12 04:45:19,439 - Train: 37.09% [139200/375300] [111.3/300.0] [batch_t 0.501 (0.424)] [data_t 0.015] [optim_t 0.485] [lr 0.002101] [CE 3.745 (3.629)] [KD 0.000 (0.000)] 2024-10-12 04:45:40,648 - Train: 37.10% [139250/375300] [111.3/300.0] [batch_t 0.416 (0.424)] [data_t 0.015] [optim_t 0.400] [lr 0.002100] [CE 3.423 (3.649)] [KD 0.000 (0.000)] 2024-10-12 04:46:02,076 - Train: 37.12% [139300/375300] [111.4/300.0] [batch_t 0.410 (0.428)] [data_t 0.015] [optim_t 0.394] [lr 0.002100] [CE 3.627 (3.653)] [KD 0.000 (0.000)] 2024-10-12 04:46:23,695 - Train: 37.13% [139350/375300] [111.4/300.0] [batch_t 0.418 (0.432)] [data_t 0.015] [optim_t 0.403] [lr 0.002099] [CE 3.735 (3.678)] [KD 0.000 (0.000)] 2024-10-12 04:46:44,833 - Train: 37.14% [139400/375300] [111.4/300.0] [batch_t 0.464 (0.423)] [data_t 0.016] [optim_t 0.448] [lr 0.002099] [CE 3.922 (3.640)] [KD 0.000 (0.000)] 2024-10-12 04:47:06,384 - Train: 37.16% [139450/375300] [111.5/300.0] [batch_t 0.498 (0.431)] [data_t 0.015] [optim_t 0.483] [lr 0.002098] [CE 3.601 (3.654)] [KD 0.000 (0.000)] 2024-10-12 04:47:27,794 - Train: 37.17% [139500/375300] [111.5/300.0] [batch_t 0.384 (0.428)] [data_t 0.016] [optim_t 0.368] [lr 0.002097] [CE 3.772 (3.684)] [KD 0.000 (0.000)] 2024-10-12 04:47:49,325 - Train: 37.18% [139550/375300] [111.6/300.0] [batch_t 0.384 (0.430)] [data_t 0.015] [optim_t 0.368] [lr 0.002097] [CE 3.253 (3.638)] [KD 0.000 (0.000)] 2024-10-12 04:48:11,113 - Train: 37.20% [139600/375300] [111.6/300.0] [batch_t 0.477 (0.436)] [data_t 0.016] [optim_t 0.462] [lr 0.002096] [CE 3.626 (3.646)] [KD 0.000 (0.000)] 2024-10-12 04:48:33,033 - Train: 37.21% [139650/375300] [111.6/300.0] [batch_t 0.495 (0.438)] [data_t 0.015] [optim_t 0.480] [lr 0.002096] [CE 3.525 (3.664)] [KD 0.000 (0.000)] 2024-10-12 04:48:54,581 - Train: 37.22% [139700/375300] [111.7/300.0] [batch_t 0.371 (0.431)] [data_t 0.016] [optim_t 0.355] [lr 0.002095] [CE 3.935 (3.646)] [KD 0.000 (0.000)] 2024-10-12 04:49:15,901 - Train: 37.24% [139750/375300] [111.7/300.0] [batch_t 0.412 (0.426)] [data_t 0.016] [optim_t 0.396] [lr 0.002095] [CE 3.813 (3.650)] [KD 0.000 (0.000)] 2024-10-12 04:49:37,419 - Train: 37.25% [139800/375300] [111.8/300.0] [batch_t 0.399 (0.430)] [data_t 0.016] [optim_t 0.383] [lr 0.002094] [CE 3.771 (3.644)] [KD 0.000 (0.000)] 2024-10-12 04:49:58,874 - Train: 37.26% [139850/375300] [111.8/300.0] [batch_t 0.401 (0.429)] [data_t 0.015] [optim_t 0.386] [lr 0.002093] [CE 3.345 (3.629)] [KD 0.000 (0.000)] 2024-10-12 04:50:20,410 - Train: 37.28% [139900/375300] [111.8/300.0] [batch_t 0.447 (0.431)] [data_t 0.016] [optim_t 0.431] [lr 0.002093] [CE 3.802 (3.678)] [KD 0.000 (0.000)] 2024-10-12 04:50:42,063 - Train: 37.29% [139950/375300] [111.9/300.0] [batch_t 0.467 (0.433)] [data_t 0.015] [optim_t 0.452] [lr 0.002092] [CE 3.776 (3.598)] [KD 0.000 (0.000)] 2024-10-12 04:51:03,727 - Train: 37.30% [140000/375300] [111.9/300.0] [batch_t 0.463 (0.433)] [data_t 0.016] [optim_t 0.447] [lr 0.002092] [CE 3.616 (3.651)] [KD 0.000 (0.000)] 2024-10-12 04:51:24,993 - Train: 37.32% [140050/375300] [112.0/300.0] [batch_t 0.431 (0.425)] [data_t 0.016] [optim_t 0.416] [lr 0.002091] [CE 3.488 (3.684)] [KD 0.000 (0.000)] 2024-10-12 04:51:46,584 - Train: 37.33% [140100/375300] [112.0/300.0] [batch_t 0.372 (0.432)] [data_t 0.015] [optim_t 0.356] [lr 0.002091] [CE 3.828 (3.632)] [KD 0.000 (0.000)] 2024-10-12 04:51:50,315 - ==> Total time: 17:04:54 Eta: 1 day, 4:40:22 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 04:52:10,277 - Train: 37.34% [140150/375300] [112.0/300.0] [batch_t 0.319 (0.491)] [data_t 0.015] [optim_t 0.303] [lr 0.002090] [CE 3.565 (3.615)] [KD 0.000 (0.000)] 2024-10-12 04:52:32,144 - Train: 37.36% [140200/375300] [112.1/300.0] [batch_t 0.471 (0.437)] [data_t 0.016] [optim_t 0.456] [lr 0.002089] [CE 3.196 (3.643)] [KD 0.000 (0.000)] 2024-10-12 04:52:53,839 - Train: 37.37% [140250/375300] [112.1/300.0] [batch_t 0.429 (0.434)] [data_t 0.015] [optim_t 0.414] [lr 0.002089] [CE 3.892 (3.648)] [KD 0.000 (0.000)] 2024-10-12 04:53:15,409 - Train: 37.38% [140300/375300] [112.2/300.0] [batch_t 0.433 (0.431)] [data_t 0.015] [optim_t 0.417] [lr 0.002088] [CE 3.479 (3.615)] [KD 0.000 (0.000)] 2024-10-12 04:53:36,405 - Train: 37.40% [140350/375300] [112.2/300.0] [batch_t 0.423 (0.420)] [data_t 0.016] [optim_t 0.407] [lr 0.002088] [CE 3.093 (3.666)] [KD 0.000 (0.000)] 2024-10-12 04:53:57,839 - Train: 37.41% [140400/375300] [112.2/300.0] [batch_t 0.468 (0.429)] [data_t 0.015] [optim_t 0.453] [lr 0.002087] [CE 3.699 (3.629)] [KD 0.000 (0.000)] 2024-10-12 04:54:19,321 - Train: 37.42% [140450/375300] [112.3/300.0] [batch_t 0.449 (0.430)] [data_t 0.016] [optim_t 0.433] [lr 0.002087] [CE 3.465 (3.653)] [KD 0.000 (0.000)] 2024-10-12 04:54:41,649 - Train: 37.44% [140500/375300] [112.3/300.0] [batch_t 0.466 (0.446)] [data_t 0.016] [optim_t 0.451] [lr 0.002086] [CE 3.641 (3.653)] [KD 0.000 (0.000)] 2024-10-12 04:55:03,769 - Train: 37.45% [140550/375300] [112.4/300.0] [batch_t 0.312 (0.442)] [data_t 0.015] [optim_t 0.297] [lr 0.002085] [CE 3.976 (3.642)] [KD 0.000 (0.000)] 2024-10-12 04:55:25,670 - Train: 37.46% [140600/375300] [112.4/300.0] [batch_t 0.366 (0.438)] [data_t 0.016] [optim_t 0.350] [lr 0.002085] [CE 3.834 (3.633)] [KD 0.000 (0.000)] 2024-10-12 04:55:47,720 - Train: 37.48% [140650/375300] [112.4/300.0] [batch_t 0.482 (0.441)] [data_t 0.016] [optim_t 0.467] [lr 0.002084] [CE 3.507 (3.663)] [KD 0.000 (0.000)] 2024-10-12 04:56:09,640 - Train: 37.49% [140700/375300] [112.5/300.0] [batch_t 0.423 (0.438)] [data_t 0.016] [optim_t 0.407] [lr 0.002084] [CE 3.549 (3.658)] [KD 0.000 (0.000)] 2024-10-12 04:56:30,609 - Train: 37.50% [140750/375300] [112.5/300.0] [batch_t 0.449 (0.419)] [data_t 0.016] [optim_t 0.433] [lr 0.002083] [CE 3.523 (3.663)] [KD 0.000 (0.000)] 2024-10-12 04:56:52,370 - Train: 37.52% [140800/375300] [112.5/300.0] [batch_t 0.413 (0.435)] [data_t 0.016] [optim_t 0.398] [lr 0.002083] [CE 3.626 (3.627)] [KD 0.000 (0.000)] 2024-10-12 04:57:14,329 - Train: 37.53% [140850/375300] [112.6/300.0] [batch_t 0.451 (0.439)] [data_t 0.016] [optim_t 0.436] [lr 0.002082] [CE 3.500 (3.648)] [KD 0.000 (0.000)] 2024-10-12 04:57:36,188 - Train: 37.54% [140900/375300] [112.6/300.0] [batch_t 0.407 (0.437)] [data_t 0.016] [optim_t 0.392] [lr 0.002081] [CE 3.445 (3.672)] [KD 0.000 (0.000)] 2024-10-12 04:57:58,498 - Train: 37.56% [140950/375300] [112.7/300.0] [batch_t 0.475 (0.446)] [data_t 0.016] [optim_t 0.459] [lr 0.002081] [CE 3.653 (3.688)] [KD 0.000 (0.000)] 2024-10-12 04:58:20,651 - Train: 37.57% [141000/375300] [112.7/300.0] [batch_t 0.447 (0.443)] [data_t 0.015] [optim_t 0.432] [lr 0.002080] [CE 3.489 (3.672)] [KD 0.000 (0.000)] 2024-10-12 04:58:42,009 - Train: 37.58% [141050/375300] [112.7/300.0] [batch_t 0.423 (0.427)] [data_t 0.016] [optim_t 0.408] [lr 0.002080] [CE 3.736 (3.654)] [KD 0.000 (0.000)] 2024-10-12 04:59:04,351 - Train: 37.60% [141100/375300] [112.8/300.0] [batch_t 0.351 (0.447)] [data_t 0.015] [optim_t 0.336] [lr 0.002079] [CE 3.748 (3.633)] [KD 0.000 (0.000)] 2024-10-12 04:59:25,678 - Train: 37.61% [141150/375300] [112.8/300.0] [batch_t 0.405 (0.426)] [data_t 0.016] [optim_t 0.389] [lr 0.002079] [CE 3.713 (3.609)] [KD 0.000 (0.000)] 2024-10-12 04:59:47,368 - Train: 37.62% [141200/375300] [112.9/300.0] [batch_t 0.376 (0.434)] [data_t 0.016] [optim_t 0.360] [lr 0.002078] [CE 3.762 (3.626)] [KD 0.000 (0.000)] 2024-10-12 05:00:08,965 - Train: 37.64% [141250/375300] [112.9/300.0] [batch_t 0.460 (0.432)] [data_t 0.016] [optim_t 0.445] [lr 0.002077] [CE 3.745 (3.694)] [KD 0.000 (0.000)] 2024-10-12 05:00:31,003 - Train: 37.65% [141300/375300] [112.9/300.0] [batch_t 0.396 (0.441)] [data_t 0.093] [optim_t 0.303] [lr 0.002077] [CE 3.554 (3.592)] [KD 0.000 (0.000)] 2024-10-12 05:00:53,291 - Train: 37.66% [141350/375300] [113.0/300.0] [batch_t 0.404 (0.446)] [data_t 0.110] [optim_t 0.294] [lr 0.002076] [CE 3.493 (3.703)] [KD 0.000 (0.000)] 2024-10-12 05:00:57,479 - ==> Total time: 17:14:01 Eta: 1 day, 4:31:10 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 05:01:18,562 - Train: 37.68% [141400/375300] [113.0/300.0] [batch_t 1.322 (0.530)] [data_t 1.024] [optim_t 0.298] [lr 0.002076] [CE 3.746 (3.632)] [KD 0.000 (0.000)] 2024-10-12 05:01:40,430 - Train: 37.69% [141450/375300] [113.1/300.0] [batch_t 0.413 (0.437)] [data_t 0.120] [optim_t 0.293] [lr 0.002075] [CE 3.922 (3.676)] [KD 0.000 (0.000)] 2024-10-12 05:02:02,485 - Train: 37.70% [141500/375300] [113.1/300.0] [batch_t 0.495 (0.441)] [data_t 0.191] [optim_t 0.303] [lr 0.002075] [CE 3.633 (3.666)] [KD 0.000 (0.000)] 2024-10-12 05:02:24,469 - Train: 37.72% [141550/375300] [113.1/300.0] [batch_t 0.407 (0.440)] [data_t 0.108] [optim_t 0.299] [lr 0.002074] [CE 3.757 (3.624)] [KD 0.000 (0.000)] 2024-10-12 05:02:47,094 - Train: 37.73% [141600/375300] [113.2/300.0] [batch_t 0.520 (0.452)] [data_t 0.016] [optim_t 0.505] [lr 0.002073] [CE 3.506 (3.677)] [KD 0.000 (0.000)] 2024-10-12 05:03:09,864 - Train: 37.74% [141650/375300] [113.2/300.0] [batch_t 0.499 (0.455)] [data_t 0.016] [optim_t 0.484] [lr 0.002073] [CE 3.392 (3.642)] [KD 0.000 (0.000)] 2024-10-12 05:03:31,342 - Train: 37.76% [141700/375300] [113.3/300.0] [batch_t 0.413 (0.429)] [data_t 0.016] [optim_t 0.398] [lr 0.002072] [CE 3.637 (3.600)] [KD 0.000 (0.000)] 2024-10-12 05:03:52,774 - Train: 37.77% [141750/375300] [113.3/300.0] [batch_t 0.398 (0.428)] [data_t 0.016] [optim_t 0.382] [lr 0.002072] [CE 3.481 (3.649)] [KD 0.000 (0.000)] 2024-10-12 05:04:15,131 - Train: 37.78% [141800/375300] [113.3/300.0] [batch_t 0.473 (0.447)] [data_t 0.015] [optim_t 0.457] [lr 0.002071] [CE 3.388 (3.618)] [KD 0.000 (0.000)] 2024-10-12 05:04:37,487 - Train: 37.80% [141850/375300] [113.4/300.0] [batch_t 0.493 (0.447)] [data_t 0.016] [optim_t 0.477] [lr 0.002070] [CE 3.754 (3.627)] [KD 0.000 (0.000)] 2024-10-12 05:04:59,507 - Train: 37.81% [141900/375300] [113.4/300.0] [batch_t 0.454 (0.440)] [data_t 0.015] [optim_t 0.438] [lr 0.002070] [CE 3.407 (3.569)] [KD 0.000 (0.000)] 2024-10-12 05:05:21,705 - Train: 37.82% [141950/375300] [113.5/300.0] [batch_t 0.578 (0.444)] [data_t 0.015] [optim_t 0.563] [lr 0.002069] [CE 3.889 (3.662)] [KD 0.000 (0.000)] 2024-10-12 05:05:43,658 - Train: 37.84% [142000/375300] [113.5/300.0] [batch_t 0.490 (0.439)] [data_t 0.016] [optim_t 0.474] [lr 0.002069] [CE 3.852 (3.640)] [KD 0.000 (0.000)] 2024-10-12 05:06:05,668 - Train: 37.85% [142050/375300] [113.5/300.0] [batch_t 0.411 (0.440)] [data_t 0.016] [optim_t 0.395] [lr 0.002068] [CE 3.739 (3.611)] [KD 0.000 (0.000)] 2024-10-12 05:06:27,648 - Train: 37.86% [142100/375300] [113.6/300.0] [batch_t 0.437 (0.439)] [data_t 0.016] [optim_t 0.422] [lr 0.002068] [CE 3.606 (3.637)] [KD 0.000 (0.000)] 2024-10-12 05:06:49,989 - Train: 37.88% [142150/375300] [113.6/300.0] [batch_t 0.317 (0.447)] [data_t 0.016] [optim_t 0.301] [lr 0.002067] [CE 3.540 (3.665)] [KD 0.000 (0.000)] 2024-10-12 05:07:11,839 - Train: 37.89% [142200/375300] [113.7/300.0] [batch_t 0.482 (0.437)] [data_t 0.016] [optim_t 0.466] [lr 0.002066] [CE 3.734 (3.627)] [KD 0.000 (0.000)] 2024-10-12 05:07:33,442 - Train: 37.90% [142250/375300] [113.7/300.0] [batch_t 0.421 (0.432)] [data_t 0.016] [optim_t 0.405] [lr 0.002066] [CE 3.690 (3.647)] [KD 0.000 (0.000)] 2024-10-12 05:07:55,330 - Train: 37.92% [142300/375300] [113.7/300.0] [batch_t 0.314 (0.438)] [data_t 0.016] [optim_t 0.298] [lr 0.002065] [CE 3.349 (3.582)] [KD 0.000 (0.000)] 2024-10-12 05:08:17,058 - Train: 37.93% [142350/375300] [113.8/300.0] [batch_t 0.385 (0.434)] [data_t 0.016] [optim_t 0.369] [lr 0.002065] [CE 3.580 (3.680)] [KD 0.000 (0.000)] 2024-10-12 05:08:39,019 - Train: 37.94% [142400/375300] [113.8/300.0] [batch_t 0.392 (0.439)] [data_t 0.015] [optim_t 0.377] [lr 0.002064] [CE 3.463 (3.660)] [KD 0.000 (0.000)] 2024-10-12 05:09:01,003 - Train: 37.96% [142450/375300] [113.9/300.0] [batch_t 0.317 (0.440)] [data_t 0.016] [optim_t 0.301] [lr 0.002064] [CE 4.113 (3.691)] [KD 0.000 (0.000)] 2024-10-12 05:09:22,917 - Train: 37.97% [142500/375300] [113.9/300.0] [batch_t 0.422 (0.438)] [data_t 0.016] [optim_t 0.407] [lr 0.002063] [CE 3.499 (3.647)] [KD 0.000 (0.000)] 2024-10-12 05:09:44,217 - Train: 37.98% [142550/375300] [113.9/300.0] [batch_t 0.338 (0.426)] [data_t 0.016] [optim_t 0.322] [lr 0.002062] [CE 3.455 (3.644)] [KD 0.000 (0.000)] 2024-10-12 05:10:06,598 - Train: 38.00% [142600/375300] [114.0/300.0] [batch_t 0.323 (0.447)] [data_t 0.016] [optim_t 0.307] [lr 0.002062] [CE 3.676 (3.640)] [KD 0.000 (0.000)] 2024-10-12 05:10:11,208 - ==> Total time: 17:23:15 Eta: 1 day, 4:22:08 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 05:10:31,332 - Train: 38.01% [142650/375300] [114.0/300.0] [batch_t 0.478 (0.512)] [data_t 0.015] [optim_t 0.463] [lr 0.002061] [CE 3.687 (3.591)] [KD 0.000 (0.000)] 2024-10-12 05:10:53,652 - Train: 38.02% [142700/375300] [114.1/300.0] [batch_t 0.397 (0.446)] [data_t 0.016] [optim_t 0.381] [lr 0.002061] [CE 3.935 (3.607)] [KD 0.000 (0.000)] 2024-10-12 05:11:15,963 - Train: 38.04% [142750/375300] [114.1/300.0] [batch_t 0.394 (0.446)] [data_t 0.016] [optim_t 0.378] [lr 0.002060] [CE 3.435 (3.677)] [KD 0.000 (0.000)] 2024-10-12 05:11:38,245 - Train: 38.05% [142800/375300] [114.1/300.0] [batch_t 0.339 (0.446)] [data_t 0.016] [optim_t 0.324] [lr 0.002060] [CE 3.662 (3.639)] [KD 0.000 (0.000)] 2024-10-12 05:12:00,334 - Train: 38.06% [142850/375300] [114.2/300.0] [batch_t 0.569 (0.442)] [data_t 0.015] [optim_t 0.554] [lr 0.002059] [CE 3.791 (3.647)] [KD 0.000 (0.000)] 2024-10-12 05:12:22,537 - Train: 38.08% [142900/375300] [114.2/300.0] [batch_t 0.386 (0.444)] [data_t 0.016] [optim_t 0.370] [lr 0.002058] [CE 3.663 (3.617)] [KD 0.000 (0.000)] 2024-10-12 05:12:43,972 - Train: 38.09% [142950/375300] [114.3/300.0] [batch_t 0.379 (0.429)] [data_t 0.016] [optim_t 0.363] [lr 0.002058] [CE 3.537 (3.631)] [KD 0.000 (0.000)] 2024-10-12 05:13:06,075 - Train: 38.10% [143000/375300] [114.3/300.0] [batch_t 0.475 (0.442)] [data_t 0.016] [optim_t 0.459] [lr 0.002057] [CE 3.476 (3.620)] [KD 0.000 (0.000)] 2024-10-12 05:13:28,301 - Train: 38.12% [143050/375300] [114.3/300.0] [batch_t 0.429 (0.444)] [data_t 0.016] [optim_t 0.413] [lr 0.002057] [CE 3.335 (3.676)] [KD 0.000 (0.000)] 2024-10-12 05:13:50,832 - Train: 38.13% [143100/375300] [114.4/300.0] [batch_t 0.932 (0.450)] [data_t 0.016] [optim_t 0.916] [lr 0.002056] [CE 3.561 (3.646)] [KD 0.000 (0.000)] 2024-10-12 05:14:12,120 - Train: 38.14% [143150/375300] [114.4/300.0] [batch_t 0.578 (0.426)] [data_t 0.016] [optim_t 0.563] [lr 0.002055] [CE 3.751 (3.680)] [KD 0.000 (0.000)] 2024-10-12 05:14:34,155 - Train: 38.16% [143200/375300] [114.5/300.0] [batch_t 0.459 (0.441)] [data_t 0.016] [optim_t 0.443] [lr 0.002055] [CE 3.651 (3.642)] [KD 0.000 (0.000)] 2024-10-12 05:14:55,784 - Train: 38.17% [143250/375300] [114.5/300.0] [batch_t 0.514 (0.432)] [data_t 0.016] [optim_t 0.498] [lr 0.002054] [CE 3.388 (3.648)] [KD 0.000 (0.000)] 2024-10-12 05:15:17,133 - Train: 38.18% [143300/375300] [114.5/300.0] [batch_t 0.392 (0.427)] [data_t 0.016] [optim_t 0.376] [lr 0.002054] [CE 3.754 (3.639)] [KD 0.000 (0.000)] 2024-10-12 05:15:38,542 - Train: 38.20% [143350/375300] [114.6/300.0] [batch_t 0.317 (0.428)] [data_t 0.016] [optim_t 0.302] [lr 0.002053] [CE 3.424 (3.605)] [KD 0.000 (0.000)] 2024-10-12 05:15:59,392 - Train: 38.21% [143400/375300] [114.6/300.0] [batch_t 0.387 (0.417)] [data_t 0.015] [optim_t 0.372] [lr 0.002053] [CE 3.144 (3.637)] [KD 0.000 (0.000)] 2024-10-12 05:16:21,825 - Train: 38.22% [143450/375300] [114.7/300.0] [batch_t 0.488 (0.449)] [data_t 0.015] [optim_t 0.472] [lr 0.002052] [CE 3.495 (3.622)] [KD 0.000 (0.000)] 2024-10-12 05:16:43,330 - Train: 38.24% [143500/375300] [114.7/300.0] [batch_t 0.417 (0.430)] [data_t 0.016] [optim_t 0.401] [lr 0.002051] [CE 3.280 (3.603)] [KD 0.000 (0.000)] 2024-10-12 05:17:05,208 - Train: 38.25% [143550/375300] [114.7/300.0] [batch_t 0.435 (0.437)] [data_t 0.016] [optim_t 0.419] [lr 0.002051] [CE 3.741 (3.636)] [KD 0.000 (0.000)] 2024-10-12 05:17:27,412 - Train: 38.26% [143600/375300] [114.8/300.0] [batch_t 0.489 (0.444)] [data_t 0.016] [optim_t 0.473] [lr 0.002050] [CE 3.665 (3.596)] [KD 0.000 (0.000)] 2024-10-12 05:17:49,382 - Train: 38.28% [143650/375300] [114.8/300.0] [batch_t 0.314 (0.439)] [data_t 0.016] [optim_t 0.299] [lr 0.002050] [CE 3.607 (3.671)] [KD 0.000 (0.000)] 2024-10-12 05:18:10,306 - Train: 38.29% [143700/375300] [114.9/300.0] [batch_t 0.396 (0.418)] [data_t 0.016] [optim_t 0.380] [lr 0.002049] [CE 3.619 (3.677)] [KD 0.000 (0.000)] 2024-10-12 05:18:32,079 - Train: 38.30% [143750/375300] [114.9/300.0] [batch_t 0.449 (0.435)] [data_t 0.015] [optim_t 0.433] [lr 0.002049] [CE 3.533 (3.636)] [KD 0.000 (0.000)] 2024-10-12 05:18:54,231 - Train: 38.32% [143800/375300] [114.9/300.0] [batch_t 0.487 (0.443)] [data_t 0.016] [optim_t 0.471] [lr 0.002048] [CE 3.684 (3.659)] [KD 0.000 (0.000)] 2024-10-12 05:19:15,877 - Train: 38.33% [143850/375300] [115.0/300.0] [batch_t 0.446 (0.433)] [data_t 0.027] [optim_t 0.419] [lr 0.002047] [CE 3.782 (3.637)] [KD 0.000 (0.000)] 2024-10-12 05:19:43,399 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.448)] [top1_cnt 36468] [top5_cnt 45822] [top_all 50000] 2024-10-12 05:19:43,399 - net: 72.936 (91.644) 2024-10-12 05:20:05,670 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.437)] [top1_cnt 39062] [top5_cnt 47146] [top_all 50000] 2024-10-12 05:20:05,670 - net_E: 78.124 (94.292) 2024-10-12 05:20:05,907 - Max [top1: 72.936 (epoch: 115)] [top1-ema: 78.124 (epoch: 115)] 2024-10-12 05:20:05,907 - ==> Total time: 17:33:09 Eta: 1 day, 4:14:13 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 05:20:29,118 - Train: 38.34% [143900/375300] [115.0/300.0] [batch_t 0.314 (0.457)] [data_t 0.015] [optim_t 0.299] [lr 0.002047] [CE 3.528 (3.610)] [KD 0.000 (0.000)] 2024-10-12 05:20:49,986 - Train: 38.36% [143950/375300] [115.1/300.0] [batch_t 0.320 (0.417)] [data_t 0.015] [optim_t 0.304] [lr 0.002046] [CE 3.711 (3.586)] [KD 0.000 (0.000)] 2024-10-12 05:21:11,084 - Train: 38.37% [144000/375300] [115.1/300.0] [batch_t 0.388 (0.422)] [data_t 0.016] [optim_t 0.372] [lr 0.002046] [CE 3.102 (3.609)] [KD 0.000 (0.000)] 2024-10-12 05:21:32,175 - Train: 38.38% [144050/375300] [115.1/300.0] [batch_t 0.455 (0.422)] [data_t 0.133] [optim_t 0.322] [lr 0.002045] [CE 3.710 (3.618)] [KD 0.000 (0.000)] 2024-10-12 05:21:53,226 - Train: 38.40% [144100/375300] [115.2/300.0] [batch_t 0.380 (0.421)] [data_t 0.084] [optim_t 0.296] [lr 0.002044] [CE 3.996 (3.618)] [KD 0.000 (0.000)] 2024-10-12 05:22:14,343 - Train: 38.41% [144150/375300] [115.2/300.0] [batch_t 0.419 (0.422)] [data_t 0.016] [optim_t 0.403] [lr 0.002044] [CE 3.504 (3.647)] [KD 0.000 (0.000)] 2024-10-12 05:22:36,796 - Train: 38.42% [144200/375300] [115.3/300.0] [batch_t 0.880 (0.449)] [data_t 0.016] [optim_t 0.865] [lr 0.002043] [CE 3.689 (3.617)] [KD 0.000 (0.000)] 2024-10-12 05:22:57,965 - Train: 38.44% [144250/375300] [115.3/300.0] [batch_t 0.451 (0.423)] [data_t 0.015] [optim_t 0.435] [lr 0.002043] [CE 3.694 (3.634)] [KD 0.000 (0.000)] 2024-10-12 05:23:18,507 - Train: 38.45% [144300/375300] [115.3/300.0] [batch_t 0.461 (0.411)] [data_t 0.015] [optim_t 0.445] [lr 0.002042] [CE 3.973 (3.660)] [KD 0.000 (0.000)] 2024-10-12 05:23:39,825 - Train: 38.46% [144350/375300] [115.4/300.0] [batch_t 0.383 (0.426)] [data_t 0.015] [optim_t 0.367] [lr 0.002042] [CE 3.559 (3.669)] [KD 0.000 (0.000)] 2024-10-12 05:24:01,699 - Train: 38.48% [144400/375300] [115.4/300.0] [batch_t 0.468 (0.437)] [data_t 0.015] [optim_t 0.453] [lr 0.002041] [CE 3.467 (3.625)] [KD 0.000 (0.000)] 2024-10-12 05:24:23,856 - Train: 38.49% [144450/375300] [115.5/300.0] [batch_t 0.311 (0.443)] [data_t 0.016] [optim_t 0.295] [lr 0.002040] [CE 3.669 (3.657)] [KD 0.000 (0.000)] 2024-10-12 05:24:45,579 - Train: 38.50% [144500/375300] [115.5/300.0] [batch_t 0.475 (0.434)] [data_t 0.016] [optim_t 0.460] [lr 0.002040] [CE 3.803 (3.598)] [KD 0.000 (0.000)] 2024-10-12 05:25:07,724 - Train: 38.52% [144550/375300] [115.5/300.0] [batch_t 0.438 (0.443)] [data_t 0.015] [optim_t 0.422] [lr 0.002039] [CE 3.525 (3.634)] [KD 0.000 (0.000)] 2024-10-12 05:25:29,525 - Train: 38.53% [144600/375300] [115.6/300.0] [batch_t 0.397 (0.436)] [data_t 0.016] [optim_t 0.380] [lr 0.002039] [CE 3.496 (3.652)] [KD 0.000 (0.000)] 2024-10-12 05:25:51,155 - Train: 38.54% [144650/375300] [115.6/300.0] [batch_t 0.444 (0.432)] [data_t 0.015] [optim_t 0.429] [lr 0.002038] [CE 3.590 (3.672)] [KD 0.000 (0.000)] 2024-10-12 05:26:13,533 - Train: 38.56% [144700/375300] [115.7/300.0] [batch_t 0.480 (0.447)] [data_t 0.015] [optim_t 0.465] [lr 0.002037] [CE 3.546 (3.623)] [KD 0.000 (0.000)] 2024-10-12 05:26:35,727 - Train: 38.57% [144750/375300] [115.7/300.0] [batch_t 0.569 (0.444)] [data_t 0.015] [optim_t 0.553] [lr 0.002037] [CE 3.495 (3.647)] [KD 0.000 (0.000)] 2024-10-12 05:26:58,179 - Train: 38.58% [144800/375300] [115.7/300.0] [batch_t 0.461 (0.449)] [data_t 0.015] [optim_t 0.446] [lr 0.002036] [CE 3.545 (3.641)] [KD 0.000 (0.000)] 2024-10-12 05:27:20,296 - Train: 38.60% [144850/375300] [115.8/300.0] [batch_t 0.442 (0.442)] [data_t 0.015] [optim_t 0.427] [lr 0.002036] [CE 3.439 (3.609)] [KD 0.000 (0.000)] 2024-10-12 05:27:42,787 - Train: 38.61% [144900/375300] [115.8/300.0] [batch_t 0.316 (0.450)] [data_t 0.016] [optim_t 0.300] [lr 0.002035] [CE 3.784 (3.643)] [KD 0.000 (0.000)] 2024-10-12 05:28:04,769 - Train: 38.62% [144950/375300] [115.9/300.0] [batch_t 0.381 (0.440)] [data_t 0.016] [optim_t 0.366] [lr 0.002035] [CE 3.456 (3.657)] [KD 0.000 (0.000)] 2024-10-12 05:28:27,186 - Train: 38.64% [145000/375300] [115.9/300.0] [batch_t 0.471 (0.448)] [data_t 0.016] [optim_t 0.455] [lr 0.002034] [CE 3.414 (3.591)] [KD 0.000 (0.000)] 2024-10-12 05:28:49,612 - Train: 38.65% [145050/375300] [115.9/300.0] [batch_t 0.417 (0.448)] [data_t 0.016] [optim_t 0.402] [lr 0.002033] [CE 3.672 (3.640)] [KD 0.000 (0.000)] 2024-10-12 05:29:11,780 - Train: 38.66% [145100/375300] [116.0/300.0] [batch_t 0.552 (0.443)] [data_t 0.015] [optim_t 0.537] [lr 0.002033] [CE 3.494 (3.636)] [KD 0.000 (0.000)] 2024-10-12 05:29:17,104 - ==> Total time: 17:42:21 Eta: 1 day, 4:05:06 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 05:29:36,474 - Train: 38.68% [145150/375300] [116.0/300.0] [batch_t 0.438 (0.517)] [data_t 0.140] [optim_t 0.298] [lr 0.002032] [CE 3.375 (3.552)] [KD 0.000 (0.000)] 2024-10-12 05:29:58,499 - Train: 38.69% [145200/375300] [116.1/300.0] [batch_t 0.410 (0.440)] [data_t 0.118] [optim_t 0.293] [lr 0.002032] [CE 3.668 (3.601)] [KD 0.000 (0.000)] 2024-10-12 05:30:20,630 - Train: 38.70% [145250/375300] [116.1/300.0] [batch_t 0.442 (0.443)] [data_t 0.150] [optim_t 0.292] [lr 0.002031] [CE 3.343 (3.575)] [KD 0.000 (0.000)] 2024-10-12 05:30:42,920 - Train: 38.72% [145300/375300] [116.1/300.0] [batch_t 0.414 (0.446)] [data_t 0.115] [optim_t 0.299] [lr 0.002030] [CE 3.583 (3.629)] [KD 0.000 (0.000)] 2024-10-12 05:31:04,223 - Train: 38.73% [145350/375300] [116.2/300.0] [batch_t 0.400 (0.426)] [data_t 0.103] [optim_t 0.297] [lr 0.002030] [CE 3.709 (3.646)] [KD 0.000 (0.000)] 2024-10-12 05:31:25,528 - Train: 38.74% [145400/375300] [116.2/300.0] [batch_t 0.362 (0.426)] [data_t 0.069] [optim_t 0.293] [lr 0.002029] [CE 3.615 (3.631)] [KD 0.000 (0.000)] 2024-10-12 05:31:47,436 - Train: 38.76% [145450/375300] [116.3/300.0] [batch_t 0.312 (0.438)] [data_t 0.015] [optim_t 0.297] [lr 0.002029] [CE 3.890 (3.638)] [KD 0.000 (0.000)] 2024-10-12 05:32:07,830 - Train: 38.77% [145500/375300] [116.3/300.0] [batch_t 0.425 (0.408)] [data_t 0.015] [optim_t 0.410] [lr 0.002028] [CE 3.705 (3.612)] [KD 0.000 (0.000)] 2024-10-12 05:32:30,026 - Train: 38.78% [145550/375300] [116.3/300.0] [batch_t 0.377 (0.444)] [data_t 0.016] [optim_t 0.362] [lr 0.002028] [CE 3.520 (3.642)] [KD 0.000 (0.000)] 2024-10-12 05:32:51,828 - Train: 38.80% [145600/375300] [116.4/300.0] [batch_t 0.465 (0.436)] [data_t 0.016] [optim_t 0.449] [lr 0.002027] [CE 3.759 (3.620)] [KD 0.000 (0.000)] 2024-10-12 05:33:13,517 - Train: 38.81% [145650/375300] [116.4/300.0] [batch_t 0.394 (0.434)] [data_t 0.016] [optim_t 0.378] [lr 0.002026] [CE 3.515 (3.619)] [KD 0.000 (0.000)] 2024-10-12 05:33:35,761 - Train: 38.82% [145700/375300] [116.5/300.0] [batch_t 0.362 (0.445)] [data_t 0.015] [optim_t 0.346] [lr 0.002026] [CE 3.840 (3.646)] [KD 0.000 (0.000)] 2024-10-12 05:33:57,510 - Train: 38.84% [145750/375300] [116.5/300.0] [batch_t 0.391 (0.435)] [data_t 0.016] [optim_t 0.375] [lr 0.002025] [CE 3.430 (3.617)] [KD 0.000 (0.000)] 2024-10-12 05:34:19,437 - Train: 38.85% [145800/375300] [116.5/300.0] [batch_t 0.311 (0.438)] [data_t 0.016] [optim_t 0.295] [lr 0.002025] [CE 3.868 (3.625)] [KD 0.000 (0.000)] 2024-10-12 05:34:41,484 - Train: 38.86% [145850/375300] [116.6/300.0] [batch_t 0.439 (0.441)] [data_t 0.016] [optim_t 0.423] [lr 0.002024] [CE 3.797 (3.618)] [KD 0.000 (0.000)] 2024-10-12 05:35:02,942 - Train: 38.88% [145900/375300] [116.6/300.0] [batch_t 0.432 (0.429)] [data_t 0.016] [optim_t 0.416] [lr 0.002023] [CE 3.626 (3.639)] [KD 0.000 (0.000)] 2024-10-12 05:35:24,634 - Train: 38.89% [145950/375300] [116.7/300.0] [batch_t 0.434 (0.434)] [data_t 0.016] [optim_t 0.418] [lr 0.002023] [CE 4.090 (3.619)] [KD 0.000 (0.000)] 2024-10-12 05:35:46,818 - Train: 38.90% [146000/375300] [116.7/300.0] [batch_t 0.389 (0.444)] [data_t 0.016] [optim_t 0.373] [lr 0.002022] [CE 3.637 (3.590)] [KD 0.000 (0.000)] 2024-10-12 05:36:08,362 - Train: 38.92% [146050/375300] [116.7/300.0] [batch_t 0.414 (0.431)] [data_t 0.016] [optim_t 0.399] [lr 0.002022] [CE 3.435 (3.646)] [KD 0.000 (0.000)] 2024-10-12 05:36:29,433 - Train: 38.93% [146100/375300] [116.8/300.0] [batch_t 0.432 (0.421)] [data_t 0.015] [optim_t 0.416] [lr 0.002021] [CE 3.347 (3.664)] [KD 0.000 (0.000)] 2024-10-12 05:36:50,245 - Train: 38.94% [146150/375300] [116.8/300.0] [batch_t 0.474 (0.416)] [data_t 0.015] [optim_t 0.458] [lr 0.002021] [CE 3.505 (3.628)] [KD 0.000 (0.000)] 2024-10-12 05:37:11,581 - Train: 38.96% [146200/375300] [116.9/300.0] [batch_t 0.489 (0.427)] [data_t 0.015] [optim_t 0.473] [lr 0.002020] [CE 3.420 (3.624)] [KD 0.000 (0.000)] 2024-10-12 05:37:34,542 - Train: 38.97% [146250/375300] [116.9/300.0] [batch_t 0.495 (0.459)] [data_t 0.016] [optim_t 0.480] [lr 0.002019] [CE 3.464 (3.694)] [KD 0.000 (0.000)] 2024-10-12 05:37:55,679 - Train: 38.98% [146300/375300] [116.9/300.0] [batch_t 0.377 (0.423)] [data_t 0.016] [optim_t 0.361] [lr 0.002019] [CE 3.850 (3.648)] [KD 0.000 (0.000)] 2024-10-12 05:38:16,133 - Train: 39.00% [146350/375300] [117.0/300.0] [batch_t 0.427 (0.409)] [data_t 0.015] [optim_t 0.412] [lr 0.002018] [CE 3.955 (3.663)] [KD 0.000 (0.000)] 2024-10-12 05:38:21,888 - ==> Total time: 17:51:25 Eta: 1 day, 3:55:49 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 05:38:40,504 - Train: 39.01% [146400/375300] [117.0/300.0] [batch_t 0.595 (0.514)] [data_t 0.016] [optim_t 0.580] [lr 0.002018] [CE 3.500 (3.610)] [KD 0.000 (0.000)] 2024-10-12 05:39:03,825 - Train: 39.02% [146450/375300] [117.1/300.0] [batch_t 0.525 (0.466)] [data_t 0.015] [optim_t 0.509] [lr 0.002017] [CE 3.711 (3.628)] [KD 0.000 (0.000)] 2024-10-12 05:39:26,264 - Train: 39.04% [146500/375300] [117.1/300.0] [batch_t 0.404 (0.449)] [data_t 0.015] [optim_t 0.388] [lr 0.002016] [CE 3.614 (3.636)] [KD 0.000 (0.000)] 2024-10-12 05:39:48,032 - Train: 39.05% [146550/375300] [117.1/300.0] [batch_t 0.322 (0.435)] [data_t 0.016] [optim_t 0.306] [lr 0.002016] [CE 3.502 (3.620)] [KD 0.000 (0.000)] 2024-10-12 05:40:10,171 - Train: 39.06% [146600/375300] [117.2/300.0] [batch_t 0.452 (0.443)] [data_t 0.015] [optim_t 0.437] [lr 0.002015] [CE 3.793 (3.597)] [KD 0.000 (0.000)] 2024-10-12 05:40:32,298 - Train: 39.08% [146650/375300] [117.2/300.0] [batch_t 0.493 (0.442)] [data_t 0.015] [optim_t 0.477] [lr 0.002015] [CE 3.981 (3.667)] [KD 0.000 (0.000)] 2024-10-12 05:40:53,850 - Train: 39.09% [146700/375300] [117.3/300.0] [batch_t 0.469 (0.431)] [data_t 0.016] [optim_t 0.453] [lr 0.002014] [CE 3.281 (3.616)] [KD 0.000 (0.000)] 2024-10-12 05:41:15,257 - Train: 39.10% [146750/375300] [117.3/300.0] [batch_t 0.488 (0.428)] [data_t 0.015] [optim_t 0.472] [lr 0.002014] [CE 3.766 (3.619)] [KD 0.000 (0.000)] 2024-10-12 05:41:36,055 - Train: 39.12% [146800/375300] [117.3/300.0] [batch_t 0.394 (0.416)] [data_t 0.015] [optim_t 0.378] [lr 0.002013] [CE 3.803 (3.617)] [KD 0.000 (0.000)] 2024-10-12 05:41:56,718 - Train: 39.13% [146850/375300] [117.4/300.0] [batch_t 0.311 (0.413)] [data_t 0.016] [optim_t 0.295] [lr 0.002012] [CE 3.539 (3.633)] [KD 0.000 (0.000)] 2024-10-12 05:42:17,764 - Train: 39.14% [146900/375300] [117.4/300.0] [batch_t 0.413 (0.421)] [data_t 0.016] [optim_t 0.397] [lr 0.002012] [CE 3.632 (3.627)] [KD 0.000 (0.000)] 2024-10-12 05:42:38,837 - Train: 39.16% [146950/375300] [117.5/300.0] [batch_t 0.417 (0.421)] [data_t 0.015] [optim_t 0.402] [lr 0.002011] [CE 3.672 (3.649)] [KD 0.000 (0.000)] 2024-10-12 05:43:00,097 - Train: 39.17% [147000/375300] [117.5/300.0] [batch_t 0.408 (0.425)] [data_t 0.015] [optim_t 0.393] [lr 0.002011] [CE 3.663 (3.640)] [KD 0.000 (0.000)] 2024-10-12 05:43:21,110 - Train: 39.18% [147050/375300] [117.5/300.0] [batch_t 0.460 (0.420)] [data_t 0.015] [optim_t 0.445] [lr 0.002010] [CE 3.702 (3.625)] [KD 0.000 (0.000)] 2024-10-12 05:43:42,120 - Train: 39.20% [147100/375300] [117.6/300.0] [batch_t 0.435 (0.420)] [data_t 0.016] [optim_t 0.420] [lr 0.002009] [CE 3.582 (3.600)] [KD 0.000 (0.000)] 2024-10-12 05:44:03,803 - Train: 39.21% [147150/375300] [117.6/300.0] [batch_t 0.445 (0.434)] [data_t 0.015] [optim_t 0.430] [lr 0.002009] [CE 3.734 (3.651)] [KD 0.000 (0.000)] 2024-10-12 05:44:25,671 - Train: 39.22% [147200/375300] [117.7/300.0] [batch_t 0.482 (0.437)] [data_t 0.015] [optim_t 0.466] [lr 0.002008] [CE 3.336 (3.612)] [KD 0.000 (0.000)] 2024-10-12 05:44:48,070 - Train: 39.24% [147250/375300] [117.7/300.0] [batch_t 0.473 (0.448)] [data_t 0.016] [optim_t 0.457] [lr 0.002008] [CE 3.665 (3.640)] [KD 0.000 (0.000)] 2024-10-12 05:45:09,355 - Train: 39.25% [147300/375300] [117.7/300.0] [batch_t 0.382 (0.426)] [data_t 0.016] [optim_t 0.366] [lr 0.002007] [CE 3.743 (3.648)] [KD 0.000 (0.000)] 2024-10-12 05:45:31,278 - Train: 39.26% [147350/375300] [117.8/300.0] [batch_t 0.494 (0.438)] [data_t 0.015] [optim_t 0.478] [lr 0.002007] [CE 3.437 (3.670)] [KD 0.000 (0.000)] 2024-10-12 05:45:53,270 - Train: 39.28% [147400/375300] [117.8/300.0] [batch_t 0.387 (0.440)] [data_t 0.016] [optim_t 0.371] [lr 0.002006] [CE 4.000 (3.631)] [KD 0.000 (0.000)] 2024-10-12 05:46:14,906 - Train: 39.29% [147450/375300] [117.9/300.0] [batch_t 0.316 (0.433)] [data_t 0.016] [optim_t 0.301] [lr 0.002005] [CE 3.911 (3.632)] [KD 0.000 (0.000)] 2024-10-12 05:46:36,978 - Train: 39.30% [147500/375300] [117.9/300.0] [batch_t 0.464 (0.441)] [data_t 0.169] [optim_t 0.295] [lr 0.002005] [CE 3.326 (3.606)] [KD 0.000 (0.000)] 2024-10-12 05:46:59,028 - Train: 39.32% [147550/375300] [117.9/300.0] [batch_t 0.850 (0.441)] [data_t 0.555] [optim_t 0.295] [lr 0.002004] [CE 3.768 (3.638)] [KD 0.000 (0.000)] 2024-10-12 05:47:20,155 - Train: 39.33% [147600/375300] [118.0/300.0] [batch_t 0.431 (0.422)] [data_t 0.015] [optim_t 0.416] [lr 0.002004] [CE 3.333 (3.645)] [KD 0.000 (0.000)] 2024-10-12 05:47:26,571 - ==> Total time: 18:00:30 Eta: 1 day, 3:46:32 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 05:47:45,637 - Train: 39.34% [147650/375300] [118.0/300.0] [batch_t 0.502 (0.552)] [data_t 0.015] [optim_t 0.487] [lr 0.002003] [CE 3.505 (3.595)] [KD 0.000 (0.000)] 2024-10-12 05:48:07,625 - Train: 39.36% [147700/375300] [118.1/300.0] [batch_t 0.490 (0.440)] [data_t 0.015] [optim_t 0.474] [lr 0.002002] [CE 3.389 (3.652)] [KD 0.000 (0.000)] 2024-10-12 05:48:29,921 - Train: 39.37% [147750/375300] [118.1/300.0] [batch_t 0.502 (0.446)] [data_t 0.016] [optim_t 0.487] [lr 0.002002] [CE 3.326 (3.594)] [KD 0.000 (0.000)] 2024-10-12 05:48:52,122 - Train: 39.38% [147800/375300] [118.1/300.0] [batch_t 0.478 (0.444)] [data_t 0.016] [optim_t 0.462] [lr 0.002001] [CE 3.777 (3.626)] [KD 0.000 (0.000)] 2024-10-12 05:49:14,886 - Train: 39.40% [147850/375300] [118.2/300.0] [batch_t 0.468 (0.455)] [data_t 0.015] [optim_t 0.452] [lr 0.002001] [CE 3.727 (3.602)] [KD 0.000 (0.000)] 2024-10-12 05:49:37,534 - Train: 39.41% [147900/375300] [118.2/300.0] [batch_t 0.439 (0.453)] [data_t 0.016] [optim_t 0.423] [lr 0.002000] [CE 3.520 (3.604)] [KD 0.000 (0.000)] 2024-10-12 05:50:00,015 - Train: 39.42% [147950/375300] [118.3/300.0] [batch_t 0.428 (0.449)] [data_t 0.016] [optim_t 0.412] [lr 0.001999] [CE 3.711 (3.597)] [KD 0.000 (0.000)] 2024-10-12 05:50:22,674 - Train: 39.44% [148000/375300] [118.3/300.0] [batch_t 0.874 (0.453)] [data_t 0.016] [optim_t 0.859] [lr 0.001999] [CE 3.697 (3.624)] [KD 0.000 (0.000)] 2024-10-12 05:50:44,306 - Train: 39.45% [148050/375300] [118.3/300.0] [batch_t 0.486 (0.432)] [data_t 0.015] [optim_t 0.471] [lr 0.001998] [CE 3.560 (3.618)] [KD 0.000 (0.000)] 2024-10-12 05:51:06,512 - Train: 39.46% [148100/375300] [118.4/300.0] [batch_t 0.378 (0.444)] [data_t 0.016] [optim_t 0.362] [lr 0.001998] [CE 3.297 (3.670)] [KD 0.000 (0.000)] 2024-10-12 05:51:28,673 - Train: 39.48% [148150/375300] [118.4/300.0] [batch_t 0.462 (0.443)] [data_t 0.016] [optim_t 0.446] [lr 0.001997] [CE 3.527 (3.648)] [KD 0.000 (0.000)] 2024-10-12 05:51:50,621 - Train: 39.49% [148200/375300] [118.5/300.0] [batch_t 0.367 (0.439)] [data_t 0.016] [optim_t 0.352] [lr 0.001997] [CE 3.588 (3.630)] [KD 0.000 (0.000)] 2024-10-12 05:52:12,758 - Train: 39.50% [148250/375300] [118.5/300.0] [batch_t 0.456 (0.443)] [data_t 0.016] [optim_t 0.441] [lr 0.001996] [CE 3.563 (3.603)] [KD 0.000 (0.000)] 2024-10-12 05:52:35,115 - Train: 39.52% [148300/375300] [118.5/300.0] [batch_t 0.412 (0.447)] [data_t 0.016] [optim_t 0.397] [lr 0.001995] [CE 3.376 (3.595)] [KD 0.000 (0.000)] 2024-10-12 05:52:57,243 - Train: 39.53% [148350/375300] [118.6/300.0] [batch_t 0.436 (0.442)] [data_t 0.016] [optim_t 0.420] [lr 0.001995] [CE 3.517 (3.649)] [KD 0.000 (0.000)] 2024-10-12 05:53:19,384 - Train: 39.54% [148400/375300] [118.6/300.0] [batch_t 0.377 (0.443)] [data_t 0.015] [optim_t 0.362] [lr 0.001994] [CE 3.542 (3.620)] [KD 0.000 (0.000)] 2024-10-12 05:53:41,260 - Train: 39.56% [148450/375300] [118.7/300.0] [batch_t 0.423 (0.437)] [data_t 0.016] [optim_t 0.408] [lr 0.001994] [CE 3.404 (3.608)] [KD 0.000 (0.000)] 2024-10-12 05:54:03,311 - Train: 39.57% [148500/375300] [118.7/300.0] [batch_t 0.458 (0.441)] [data_t 0.016] [optim_t 0.442] [lr 0.001993] [CE 3.921 (3.648)] [KD 0.000 (0.000)] 2024-10-12 05:54:24,794 - Train: 39.58% [148550/375300] [118.7/300.0] [batch_t 0.430 (0.430)] [data_t 0.016] [optim_t 0.415] [lr 0.001992] [CE 3.815 (3.642)] [KD 0.000 (0.000)] 2024-10-12 05:54:46,586 - Train: 39.59% [148600/375300] [118.8/300.0] [batch_t 0.485 (0.436)] [data_t 0.016] [optim_t 0.469] [lr 0.001992] [CE 3.792 (3.597)] [KD 0.000 (0.000)] 2024-10-12 05:55:09,112 - Train: 39.61% [148650/375300] [118.8/300.0] [batch_t 0.435 (0.450)] [data_t 0.016] [optim_t 0.419] [lr 0.001991] [CE 3.699 (3.649)] [KD 0.000 (0.000)] 2024-10-12 05:55:29,993 - Train: 39.62% [148700/375300] [118.9/300.0] [batch_t 0.427 (0.417)] [data_t 0.016] [optim_t 0.411] [lr 0.001991] [CE 3.483 (3.600)] [KD 0.000 (0.000)] 2024-10-12 05:55:51,233 - Train: 39.63% [148750/375300] [118.9/300.0] [batch_t 0.402 (0.425)] [data_t 0.016] [optim_t 0.386] [lr 0.001990] [CE 3.880 (3.603)] [KD 0.000 (0.000)] 2024-10-12 05:56:13,355 - Train: 39.65% [148800/375300] [118.9/300.0] [batch_t 0.523 (0.442)] [data_t 0.016] [optim_t 0.507] [lr 0.001989] [CE 3.529 (3.626)] [KD 0.000 (0.000)] 2024-10-12 05:56:35,862 - Train: 39.66% [148850/375300] [119.0/300.0] [batch_t 0.391 (0.450)] [data_t 0.016] [optim_t 0.376] [lr 0.001989] [CE 3.561 (3.679)] [KD 0.000 (0.000)] 2024-10-12 05:56:42,704 - ==> Total time: 18:09:46 Eta: 1 day, 3:37:33 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 05:56:59,912 - Train: 39.67% [148900/375300] [119.0/300.0] [batch_t 0.491 (0.510)] [data_t 0.015] [optim_t 0.476] [lr 0.001988] [CE 3.851 (3.622)] [KD 0.000 (0.000)] 2024-10-12 05:57:22,559 - Train: 39.69% [148950/375300] [119.1/300.0] [batch_t 0.443 (0.453)] [data_t 0.016] [optim_t 0.428] [lr 0.001988] [CE 3.758 (3.602)] [KD 0.000 (0.000)] 2024-10-12 05:57:44,640 - Train: 39.70% [149000/375300] [119.1/300.0] [batch_t 0.477 (0.441)] [data_t 0.016] [optim_t 0.461] [lr 0.001987] [CE 3.537 (3.638)] [KD 0.000 (0.000)] 2024-10-12 05:58:07,148 - Train: 39.71% [149050/375300] [119.1/300.0] [batch_t 0.411 (0.450)] [data_t 0.015] [optim_t 0.395] [lr 0.001987] [CE 3.735 (3.648)] [KD 0.000 (0.000)] 2024-10-12 05:58:28,000 - Train: 39.73% [149100/375300] [119.2/300.0] [batch_t 0.565 (0.417)] [data_t 0.015] [optim_t 0.550] [lr 0.001986] [CE 4.008 (3.592)] [KD 0.000 (0.000)] 2024-10-12 05:58:49,438 - Train: 39.74% [149150/375300] [119.2/300.0] [batch_t 0.488 (0.429)] [data_t 0.016] [optim_t 0.472] [lr 0.001985] [CE 3.666 (3.606)] [KD 0.000 (0.000)] 2024-10-12 05:59:12,201 - Train: 39.75% [149200/375300] [119.3/300.0] [batch_t 0.404 (0.455)] [data_t 0.015] [optim_t 0.388] [lr 0.001985] [CE 3.504 (3.579)] [KD 0.000 (0.000)] 2024-10-12 05:59:34,716 - Train: 39.77% [149250/375300] [119.3/300.0] [batch_t 0.403 (0.450)] [data_t 0.015] [optim_t 0.388] [lr 0.001984] [CE 3.681 (3.641)] [KD 0.000 (0.000)] 2024-10-12 05:59:56,242 - Train: 39.78% [149300/375300] [119.3/300.0] [batch_t 0.466 (0.430)] [data_t 0.015] [optim_t 0.450] [lr 0.001984] [CE 3.329 (3.622)] [KD 0.000 (0.000)] 2024-10-12 06:00:17,610 - Train: 39.79% [149350/375300] [119.4/300.0] [batch_t 0.418 (0.427)] [data_t 0.015] [optim_t 0.402] [lr 0.001983] [CE 3.893 (3.653)] [KD 0.000 (0.000)] 2024-10-12 06:00:40,355 - Train: 39.81% [149400/375300] [119.4/300.0] [batch_t 0.522 (0.455)] [data_t 0.016] [optim_t 0.506] [lr 0.001982] [CE 3.369 (3.601)] [KD 0.000 (0.000)] 2024-10-12 06:01:02,421 - Train: 39.82% [149450/375300] [119.5/300.0] [batch_t 0.452 (0.441)] [data_t 0.016] [optim_t 0.436] [lr 0.001982] [CE 3.477 (3.606)] [KD 0.000 (0.000)] 2024-10-12 06:01:25,321 - Train: 39.83% [149500/375300] [119.5/300.0] [batch_t 0.324 (0.458)] [data_t 0.016] [optim_t 0.309] [lr 0.001981] [CE 3.927 (3.654)] [KD 0.000 (0.000)] 2024-10-12 06:01:47,573 - Train: 39.85% [149550/375300] [119.5/300.0] [batch_t 0.428 (0.445)] [data_t 0.016] [optim_t 0.413] [lr 0.001981] [CE 3.804 (3.653)] [KD 0.000 (0.000)] 2024-10-12 06:02:09,832 - Train: 39.86% [149600/375300] [119.6/300.0] [batch_t 0.428 (0.445)] [data_t 0.016] [optim_t 0.413] [lr 0.001980] [CE 3.805 (3.621)] [KD 0.000 (0.000)] 2024-10-12 06:02:32,196 - Train: 39.87% [149650/375300] [119.6/300.0] [batch_t 0.491 (0.447)] [data_t 0.016] [optim_t 0.475] [lr 0.001979] [CE 3.447 (3.593)] [KD 0.000 (0.000)] 2024-10-12 06:02:53,789 - Train: 39.89% [149700/375300] [119.7/300.0] [batch_t 0.433 (0.432)] [data_t 0.016] [optim_t 0.417] [lr 0.001979] [CE 3.779 (3.653)] [KD 0.000 (0.000)] 2024-10-12 06:03:14,927 - Train: 39.90% [149750/375300] [119.7/300.0] [batch_t 0.410 (0.423)] [data_t 0.015] [optim_t 0.394] [lr 0.001978] [CE 3.591 (3.624)] [KD 0.000 (0.000)] 2024-10-12 06:03:35,976 - Train: 39.91% [149800/375300] [119.7/300.0] [batch_t 0.405 (0.421)] [data_t 0.015] [optim_t 0.390] [lr 0.001978] [CE 3.370 (3.593)] [KD 0.000 (0.000)] 2024-10-12 06:03:57,531 - Train: 39.93% [149850/375300] [119.8/300.0] [batch_t 0.425 (0.431)] [data_t 0.015] [optim_t 0.409] [lr 0.001977] [CE 3.375 (3.648)] [KD 0.000 (0.000)] 2024-10-12 06:04:19,624 - Train: 39.94% [149900/375300] [119.8/300.0] [batch_t 0.463 (0.442)] [data_t 0.016] [optim_t 0.448] [lr 0.001977] [CE 3.319 (3.670)] [KD 0.000 (0.000)] 2024-10-12 06:04:40,856 - Train: 39.95% [149950/375300] [119.9/300.0] [batch_t 0.480 (0.425)] [data_t 0.015] [optim_t 0.465] [lr 0.001976] [CE 3.485 (3.598)] [KD 0.000 (0.000)] 2024-10-12 06:05:03,607 - Train: 39.97% [150000/375300] [119.9/300.0] [batch_t 0.490 (0.455)] [data_t 0.016] [optim_t 0.475] [lr 0.001975] [CE 3.652 (3.653)] [KD 0.000 (0.000)] 2024-10-12 06:05:26,110 - Train: 39.98% [150050/375300] [119.9/300.0] [batch_t 0.473 (0.450)] [data_t 0.015] [optim_t 0.457] [lr 0.001975] [CE 3.859 (3.633)] [KD 0.000 (0.000)] 2024-10-12 06:05:48,424 - Train: 39.99% [150100/375300] [120.0/300.0] [batch_t 0.369 (0.446)] [data_t 0.016] [optim_t 0.353] [lr 0.001974] [CE 3.942 (3.607)] [KD 0.000 (0.000)] 2024-10-12 06:06:18,254 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.444)] [top1_cnt 36355] [top5_cnt 45853] [top_all 50000] 2024-10-12 06:06:18,255 - net: 72.710 (91.706) 2024-10-12 06:06:40,015 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.427)] [top1_cnt 39152] [top5_cnt 47176] [top_all 50000] 2024-10-12 06:06:40,015 - net_E: 78.304 (94.352) 2024-10-12 06:06:40,194 - Max [top1: 72.936 (epoch: 115)] [top1-ema: 78.304 (epoch: 120)] 2024-10-12 06:06:40,194 - ==> Total time: 18:19:44 Eta: 1 day, 3:29:36 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 06:06:58,457 - Train: 40.01% [150150/375300] [120.0/300.0] [batch_t 0.320 (0.450)] [data_t 0.016] [optim_t 0.304] [lr 0.001974] [CE 3.601 (3.554)] [KD 0.000 (0.000)] 2024-10-12 06:07:19,992 - Train: 40.02% [150200/375300] [120.1/300.0] [batch_t 0.316 (0.431)] [data_t 0.016] [optim_t 0.300] [lr 0.001973] [CE 3.383 (3.563)] [KD 0.000 (0.000)] 2024-10-12 06:07:42,894 - Train: 40.03% [150250/375300] [120.1/300.0] [batch_t 0.436 (0.458)] [data_t 0.016] [optim_t 0.421] [lr 0.001972] [CE 3.349 (3.632)] [KD 0.000 (0.000)] 2024-10-12 06:08:04,510 - Train: 40.05% [150300/375300] [120.1/300.0] [batch_t 0.404 (0.432)] [data_t 0.016] [optim_t 0.388] [lr 0.001972] [CE 3.619 (3.605)] [KD 0.000 (0.000)] 2024-10-12 06:08:24,945 - Train: 40.06% [150350/375300] [120.2/300.0] [batch_t 0.366 (0.409)] [data_t 0.015] [optim_t 0.351] [lr 0.001971] [CE 3.591 (3.639)] [KD 0.000 (0.000)] 2024-10-12 06:08:45,827 - Train: 40.07% [150400/375300] [120.2/300.0] [batch_t 0.425 (0.418)] [data_t 0.128] [optim_t 0.297] [lr 0.001971] [CE 3.518 (3.594)] [KD 0.000 (0.000)] 2024-10-12 06:09:07,114 - Train: 40.09% [150450/375300] [120.3/300.0] [batch_t 0.450 (0.426)] [data_t 0.015] [optim_t 0.434] [lr 0.001970] [CE 3.312 (3.601)] [KD 0.000 (0.000)] 2024-10-12 06:09:28,747 - Train: 40.10% [150500/375300] [120.3/300.0] [batch_t 0.420 (0.433)] [data_t 0.016] [optim_t 0.404] [lr 0.001969] [CE 3.436 (3.582)] [KD 0.000 (0.000)] 2024-10-12 06:09:49,920 - Train: 40.11% [150550/375300] [120.3/300.0] [batch_t 0.427 (0.423)] [data_t 0.015] [optim_t 0.412] [lr 0.001969] [CE 3.625 (3.666)] [KD 0.000 (0.000)] 2024-10-12 06:10:11,340 - Train: 40.13% [150600/375300] [120.4/300.0] [batch_t 0.413 (0.428)] [data_t 0.016] [optim_t 0.397] [lr 0.001968] [CE 3.552 (3.630)] [KD 0.000 (0.000)] 2024-10-12 06:10:32,638 - Train: 40.14% [150650/375300] [120.4/300.0] [batch_t 0.315 (0.426)] [data_t 0.015] [optim_t 0.299] [lr 0.001968] [CE 3.511 (3.588)] [KD 0.000 (0.000)] 2024-10-12 06:10:53,179 - Train: 40.15% [150700/375300] [120.5/300.0] [batch_t 0.383 (0.411)] [data_t 0.016] [optim_t 0.367] [lr 0.001967] [CE 3.513 (3.597)] [KD 0.000 (0.000)] 2024-10-12 06:11:14,836 - Train: 40.17% [150750/375300] [120.5/300.0] [batch_t 0.448 (0.433)] [data_t 0.016] [optim_t 0.432] [lr 0.001966] [CE 3.625 (3.612)] [KD 0.000 (0.000)] 2024-10-12 06:11:36,405 - Train: 40.18% [150800/375300] [120.5/300.0] [batch_t 0.555 (0.431)] [data_t 0.015] [optim_t 0.540] [lr 0.001966] [CE 3.927 (3.593)] [KD 0.000 (0.000)] 2024-10-12 06:11:58,692 - Train: 40.19% [150850/375300] [120.6/300.0] [batch_t 0.439 (0.446)] [data_t 0.015] [optim_t 0.423] [lr 0.001965] [CE 3.795 (3.578)] [KD 0.000 (0.000)] 2024-10-12 06:12:21,254 - Train: 40.21% [150900/375300] [120.6/300.0] [batch_t 0.383 (0.451)] [data_t 0.015] [optim_t 0.367] [lr 0.001965] [CE 3.751 (3.616)] [KD 0.000 (0.000)] 2024-10-12 06:12:43,273 - Train: 40.22% [150950/375300] [120.7/300.0] [batch_t 0.466 (0.440)] [data_t 0.015] [optim_t 0.450] [lr 0.001964] [CE 3.475 (3.641)] [KD 0.000 (0.000)] 2024-10-12 06:13:05,867 - Train: 40.23% [151000/375300] [120.7/300.0] [batch_t 0.490 (0.452)] [data_t 0.016] [optim_t 0.475] [lr 0.001963] [CE 3.571 (3.630)] [KD 0.000 (0.000)] 2024-10-12 06:13:27,995 - Train: 40.25% [151050/375300] [120.7/300.0] [batch_t 0.431 (0.442)] [data_t 0.015] [optim_t 0.416] [lr 0.001963] [CE 3.597 (3.597)] [KD 0.000 (0.000)] 2024-10-12 06:13:50,393 - Train: 40.26% [151100/375300] [120.8/300.0] [batch_t 0.432 (0.448)] [data_t 0.016] [optim_t 0.416] [lr 0.001962] [CE 3.704 (3.623)] [KD 0.000 (0.000)] 2024-10-12 06:14:11,780 - Train: 40.27% [151150/375300] [120.8/300.0] [batch_t 0.399 (0.428)] [data_t 0.016] [optim_t 0.383] [lr 0.001962] [CE 3.520 (3.613)] [KD 0.000 (0.000)] 2024-10-12 06:14:33,615 - Train: 40.29% [151200/375300] [120.9/300.0] [batch_t 0.489 (0.437)] [data_t 0.016] [optim_t 0.474] [lr 0.001961] [CE 3.499 (3.621)] [KD 0.000 (0.000)] 2024-10-12 06:14:56,262 - Train: 40.30% [151250/375300] [120.9/300.0] [batch_t 0.506 (0.453)] [data_t 0.016] [optim_t 0.490] [lr 0.001961] [CE 3.866 (3.645)] [KD 0.000 (0.000)] 2024-10-12 06:15:19,166 - Train: 40.31% [151300/375300] [120.9/300.0] [batch_t 0.443 (0.458)] [data_t 0.016] [optim_t 0.427] [lr 0.001960] [CE 3.723 (3.617)] [KD 0.000 (0.000)] 2024-10-12 06:15:42,051 - Train: 40.33% [151350/375300] [121.0/300.0] [batch_t 0.457 (0.458)] [data_t 0.016] [optim_t 0.441] [lr 0.001959] [CE 3.501 (3.637)] [KD 0.000 (0.000)] 2024-10-12 06:15:49,957 - ==> Total time: 18:28:53 Eta: 1 day, 3:20:26 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 06:16:08,078 - Train: 40.34% [151400/375300] [121.0/300.0] [batch_t 0.654 (0.561)] [data_t 0.016] [optim_t 0.639] [lr 0.001959] [CE 3.574 (3.672)] [KD 0.000 (0.000)] 2024-10-12 06:16:32,131 - Train: 40.35% [151450/375300] [121.1/300.0] [batch_t 0.473 (0.481)] [data_t 0.016] [optim_t 0.458] [lr 0.001958] [CE 3.474 (3.614)] [KD 0.000 (0.000)] 2024-10-12 06:16:54,634 - Train: 40.37% [151500/375300] [121.1/300.0] [batch_t 0.313 (0.450)] [data_t 0.016] [optim_t 0.297] [lr 0.001958] [CE 3.498 (3.582)] [KD 0.000 (0.000)] 2024-10-12 06:17:17,071 - Train: 40.38% [151550/375300] [121.1/300.0] [batch_t 0.513 (0.449)] [data_t 0.016] [optim_t 0.497] [lr 0.001957] [CE 3.450 (3.676)] [KD 0.000 (0.000)] 2024-10-12 06:17:39,105 - Train: 40.39% [151600/375300] [121.2/300.0] [batch_t 0.494 (0.441)] [data_t 0.016] [optim_t 0.479] [lr 0.001956] [CE 3.741 (3.614)] [KD 0.000 (0.000)] 2024-10-12 06:18:01,164 - Train: 40.41% [151650/375300] [121.2/300.0] [batch_t 0.437 (0.441)] [data_t 0.015] [optim_t 0.422] [lr 0.001956] [CE 3.277 (3.587)] [KD 0.000 (0.000)] 2024-10-12 06:18:23,553 - Train: 40.42% [151700/375300] [121.3/300.0] [batch_t 0.745 (0.448)] [data_t 0.016] [optim_t 0.730] [lr 0.001955] [CE 3.438 (3.613)] [KD 0.000 (0.000)] 2024-10-12 06:18:45,311 - Train: 40.43% [151750/375300] [121.3/300.0] [batch_t 0.384 (0.435)] [data_t 0.015] [optim_t 0.368] [lr 0.001955] [CE 3.394 (3.640)] [KD 0.000 (0.000)] 2024-10-12 06:19:07,489 - Train: 40.45% [151800/375300] [121.3/300.0] [batch_t 0.324 (0.443)] [data_t 0.015] [optim_t 0.309] [lr 0.001954] [CE 3.484 (3.635)] [KD 0.000 (0.000)] 2024-10-12 06:19:29,940 - Train: 40.46% [151850/375300] [121.4/300.0] [batch_t 0.384 (0.449)] [data_t 0.015] [optim_t 0.369] [lr 0.001953] [CE 3.783 (3.611)] [KD 0.000 (0.000)] 2024-10-12 06:19:51,925 - Train: 40.47% [151900/375300] [121.4/300.0] [batch_t 0.456 (0.440)] [data_t 0.162] [optim_t 0.294] [lr 0.001953] [CE 3.986 (3.595)] [KD 0.000 (0.000)] 2024-10-12 06:20:13,821 - Train: 40.49% [151950/375300] [121.5/300.0] [batch_t 0.423 (0.438)] [data_t 0.128] [optim_t 0.295] [lr 0.001952] [CE 3.413 (3.600)] [KD 0.000 (0.000)] 2024-10-12 06:20:35,777 - Train: 40.50% [152000/375300] [121.5/300.0] [batch_t 0.387 (0.439)] [data_t 0.019] [optim_t 0.368] [lr 0.001952] [CE 3.748 (3.631)] [KD 0.000 (0.000)] 2024-10-12 06:20:57,464 - Train: 40.51% [152050/375300] [121.5/300.0] [batch_t 0.425 (0.434)] [data_t 0.124] [optim_t 0.301] [lr 0.001951] [CE 3.650 (3.609)] [KD 0.000 (0.000)] 2024-10-12 06:21:19,432 - Train: 40.53% [152100/375300] [121.6/300.0] [batch_t 0.515 (0.439)] [data_t 0.122] [optim_t 0.393] [lr 0.001950] [CE 3.291 (3.607)] [KD 0.000 (0.000)] 2024-10-12 06:21:41,426 - Train: 40.54% [152150/375300] [121.6/300.0] [batch_t 0.407 (0.440)] [data_t 0.015] [optim_t 0.392] [lr 0.001950] [CE 3.695 (3.614)] [KD 0.000 (0.000)] 2024-10-12 06:22:03,410 - Train: 40.55% [152200/375300] [121.7/300.0] [batch_t 0.488 (0.440)] [data_t 0.189] [optim_t 0.299] [lr 0.001949] [CE 3.698 (3.617)] [KD 0.000 (0.000)] 2024-10-12 06:22:25,091 - Train: 40.57% [152250/375300] [121.7/300.0] [batch_t 0.312 (0.433)] [data_t 0.015] [optim_t 0.297] [lr 0.001949] [CE 3.605 (3.594)] [KD 0.000 (0.000)] 2024-10-12 06:22:46,505 - Train: 40.58% [152300/375300] [121.7/300.0] [batch_t 0.364 (0.428)] [data_t 0.015] [optim_t 0.349] [lr 0.001948] [CE 3.477 (3.592)] [KD 0.000 (0.000)] 2024-10-12 06:23:08,737 - Train: 40.59% [152350/375300] [121.8/300.0] [batch_t 0.314 (0.445)] [data_t 0.015] [optim_t 0.299] [lr 0.001947] [CE 3.479 (3.655)] [KD 0.000 (0.000)] 2024-10-12 06:23:31,675 - Train: 40.61% [152400/375300] [121.8/300.0] [batch_t 0.489 (0.459)] [data_t 0.016] [optim_t 0.473] [lr 0.001947] [CE 3.446 (3.624)] [KD 0.000 (0.000)] 2024-10-12 06:23:53,752 - Train: 40.62% [152450/375300] [121.9/300.0] [batch_t 0.348 (0.441)] [data_t 0.016] [optim_t 0.332] [lr 0.001946] [CE 3.406 (3.602)] [KD 0.000 (0.000)] 2024-10-12 06:24:16,456 - Train: 40.63% [152500/375300] [121.9/300.0] [batch_t 0.383 (0.454)] [data_t 0.015] [optim_t 0.367] [lr 0.001946] [CE 3.561 (3.583)] [KD 0.000 (0.000)] 2024-10-12 06:24:38,642 - Train: 40.65% [152550/375300] [121.9/300.0] [batch_t 0.531 (0.444)] [data_t 0.015] [optim_t 0.516] [lr 0.001945] [CE 3.707 (3.660)] [KD 0.000 (0.000)] 2024-10-12 06:25:00,734 - Train: 40.66% [152600/375300] [122.0/300.0] [batch_t 0.458 (0.442)] [data_t 0.016] [optim_t 0.442] [lr 0.001944] [CE 3.617 (3.673)] [KD 0.000 (0.000)] 2024-10-12 06:25:09,215 - ==> Total time: 18:38:13 Eta: 1 day, 3:11:29 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 06:25:27,089 - Train: 40.67% [152650/375300] [122.0/300.0] [batch_t 0.532 (0.568)] [data_t 0.236] [optim_t 0.297] [lr 0.001944] [CE 3.498 (3.556)] [KD 0.000 (0.000)] 2024-10-12 06:25:50,059 - Train: 40.69% [152700/375300] [122.1/300.0] [batch_t 0.449 (0.459)] [data_t 0.158] [optim_t 0.291] [lr 0.001943] [CE 3.789 (3.629)] [KD 0.000 (0.000)] 2024-10-12 06:26:13,088 - Train: 40.70% [152750/375300] [122.1/300.0] [batch_t 0.494 (0.460)] [data_t 0.198] [optim_t 0.295] [lr 0.001943] [CE 3.581 (3.610)] [KD 0.000 (0.000)] 2024-10-12 06:26:35,970 - Train: 40.71% [152800/375300] [122.1/300.0] [batch_t 0.502 (0.458)] [data_t 0.015] [optim_t 0.487] [lr 0.001942] [CE 3.474 (3.564)] [KD 0.000 (0.000)] 2024-10-12 06:26:58,073 - Train: 40.73% [152850/375300] [122.2/300.0] [batch_t 0.513 (0.442)] [data_t 0.140] [optim_t 0.374] [lr 0.001942] [CE 3.464 (3.612)] [KD 0.000 (0.000)] 2024-10-12 06:27:20,899 - Train: 40.74% [152900/375300] [122.2/300.0] [batch_t 0.351 (0.456)] [data_t 0.016] [optim_t 0.335] [lr 0.001941] [CE 3.194 (3.598)] [KD 0.000 (0.000)] 2024-10-12 06:27:44,112 - Train: 40.75% [152950/375300] [122.3/300.0] [batch_t 0.550 (0.464)] [data_t 0.015] [optim_t 0.535] [lr 0.001940] [CE 3.467 (3.561)] [KD 0.000 (0.000)] 2024-10-12 06:28:06,446 - Train: 40.77% [153000/375300] [122.3/300.0] [batch_t 0.506 (0.447)] [data_t 0.015] [optim_t 0.491] [lr 0.001940] [CE 3.293 (3.620)] [KD 0.000 (0.000)] 2024-10-12 06:28:29,111 - Train: 40.78% [153050/375300] [122.3/300.0] [batch_t 0.488 (0.453)] [data_t 0.015] [optim_t 0.472] [lr 0.001939] [CE 3.354 (3.664)] [KD 0.000 (0.000)] 2024-10-12 06:28:52,029 - Train: 40.79% [153100/375300] [122.4/300.0] [batch_t 0.447 (0.458)] [data_t 0.015] [optim_t 0.432] [lr 0.001939] [CE 3.597 (3.608)] [KD 0.000 (0.000)] 2024-10-12 06:29:14,403 - Train: 40.81% [153150/375300] [122.4/300.0] [batch_t 0.433 (0.447)] [data_t 0.016] [optim_t 0.418] [lr 0.001938] [CE 3.464 (3.577)] [KD 0.000 (0.000)] 2024-10-12 06:29:36,709 - Train: 40.82% [153200/375300] [122.5/300.0] [batch_t 0.425 (0.446)] [data_t 0.016] [optim_t 0.410] [lr 0.001937] [CE 3.770 (3.622)] [KD 0.000 (0.000)] 2024-10-12 06:29:58,740 - Train: 40.83% [153250/375300] [122.5/300.0] [batch_t 0.474 (0.440)] [data_t 0.016] [optim_t 0.459] [lr 0.001937] [CE 3.730 (3.624)] [KD 0.000 (0.000)] 2024-10-12 06:30:21,348 - Train: 40.85% [153300/375300] [122.5/300.0] [batch_t 0.351 (0.452)] [data_t 0.015] [optim_t 0.335] [lr 0.001936] [CE 3.551 (3.643)] [KD 0.000 (0.000)] 2024-10-12 06:30:43,664 - Train: 40.86% [153350/375300] [122.6/300.0] [batch_t 0.454 (0.446)] [data_t 0.016] [optim_t 0.439] [lr 0.001936] [CE 3.440 (3.582)] [KD 0.000 (0.000)] 2024-10-12 06:31:06,085 - Train: 40.87% [153400/375300] [122.6/300.0] [batch_t 0.419 (0.448)] [data_t 0.016] [optim_t 0.403] [lr 0.001935] [CE 3.389 (3.600)] [KD 0.000 (0.000)] 2024-10-12 06:31:28,136 - Train: 40.89% [153450/375300] [122.7/300.0] [batch_t 0.458 (0.441)] [data_t 0.016] [optim_t 0.442] [lr 0.001934] [CE 3.813 (3.606)] [KD 0.000 (0.000)] 2024-10-12 06:31:50,394 - Train: 40.90% [153500/375300] [122.7/300.0] [batch_t 0.498 (0.445)] [data_t 0.016] [optim_t 0.482] [lr 0.001934] [CE 3.613 (3.597)] [KD 0.000 (0.000)] 2024-10-12 06:32:12,432 - Train: 40.91% [153550/375300] [122.7/300.0] [batch_t 0.537 (0.441)] [data_t 0.016] [optim_t 0.521] [lr 0.001933] [CE 3.787 (3.660)] [KD 0.000 (0.000)] 2024-10-12 06:32:34,471 - Train: 40.93% [153600/375300] [122.8/300.0] [batch_t 0.318 (0.441)] [data_t 0.016] [optim_t 0.302] [lr 0.001933] [CE 3.295 (3.617)] [KD 0.000 (0.000)] 2024-10-12 06:32:57,416 - Train: 40.94% [153650/375300] [122.8/300.0] [batch_t 0.523 (0.459)] [data_t 0.016] [optim_t 0.508] [lr 0.001932] [CE 3.947 (3.581)] [KD 0.000 (0.000)] 2024-10-12 06:33:19,132 - Train: 40.95% [153700/375300] [122.9/300.0] [batch_t 0.473 (0.434)] [data_t 0.016] [optim_t 0.457] [lr 0.001931] [CE 3.501 (3.589)] [KD 0.000 (0.000)] 2024-10-12 06:33:40,952 - Train: 40.97% [153750/375300] [122.9/300.0] [batch_t 0.403 (0.436)] [data_t 0.016] [optim_t 0.388] [lr 0.001931] [CE 3.624 (3.602)] [KD 0.000 (0.000)] 2024-10-12 06:34:02,625 - Train: 40.98% [153800/375300] [122.9/300.0] [batch_t 0.458 (0.433)] [data_t 0.015] [optim_t 0.442] [lr 0.001930] [CE 3.453 (3.684)] [KD 0.000 (0.000)] 2024-10-12 06:34:24,247 - Train: 40.99% [153850/375300] [123.0/300.0] [batch_t 0.432 (0.432)] [data_t 0.016] [optim_t 0.416] [lr 0.001930] [CE 3.660 (3.650)] [KD 0.000 (0.000)] 2024-10-12 06:34:32,726 - ==> Total time: 18:47:36 Eta: 1 day, 3:02:39 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 06:34:48,716 - Train: 41.01% [153900/375300] [123.0/300.0] [batch_t 0.559 (0.531)] [data_t 0.264] [optim_t 0.295] [lr 0.001929] [CE 3.391 (3.553)] [KD 0.000 (0.000)] 2024-10-12 06:35:10,749 - Train: 41.02% [153950/375300] [123.1/300.0] [batch_t 0.429 (0.441)] [data_t 0.136] [optim_t 0.294] [lr 0.001928] [CE 3.440 (3.600)] [KD 0.000 (0.000)] 2024-10-12 06:35:33,271 - Train: 41.03% [154000/375300] [123.1/300.0] [batch_t 0.377 (0.450)] [data_t 0.083] [optim_t 0.294] [lr 0.001928] [CE 3.675 (3.595)] [KD 0.000 (0.000)] 2024-10-12 06:35:55,589 - Train: 41.05% [154050/375300] [123.1/300.0] [batch_t 0.374 (0.446)] [data_t 0.071] [optim_t 0.303] [lr 0.001927] [CE 3.583 (3.584)] [KD 0.000 (0.000)] 2024-10-12 06:36:17,429 - Train: 41.06% [154100/375300] [123.2/300.0] [batch_t 0.409 (0.437)] [data_t 0.112] [optim_t 0.296] [lr 0.001927] [CE 3.233 (3.612)] [KD 0.000 (0.000)] 2024-10-12 06:36:39,938 - Train: 41.07% [154150/375300] [123.2/300.0] [batch_t 0.479 (0.450)] [data_t 0.171] [optim_t 0.308] [lr 0.001926] [CE 3.391 (3.591)] [KD 0.000 (0.000)] 2024-10-12 06:37:01,707 - Train: 41.09% [154200/375300] [123.3/300.0] [batch_t 0.476 (0.435)] [data_t 0.176] [optim_t 0.299] [lr 0.001925] [CE 3.616 (3.601)] [KD 0.000 (0.000)] 2024-10-12 06:37:23,571 - Train: 41.10% [154250/375300] [123.3/300.0] [batch_t 0.482 (0.437)] [data_t 0.189] [optim_t 0.292] [lr 0.001925] [CE 3.681 (3.652)] [KD 0.000 (0.000)] 2024-10-12 06:37:44,835 - Train: 41.11% [154300/375300] [123.3/300.0] [batch_t 0.444 (0.425)] [data_t 0.147] [optim_t 0.297] [lr 0.001924] [CE 3.441 (3.617)] [KD 0.000 (0.000)] 2024-10-12 06:38:07,331 - Train: 41.13% [154350/375300] [123.4/300.0] [batch_t 0.496 (0.450)] [data_t 0.015] [optim_t 0.481] [lr 0.001924] [CE 3.625 (3.599)] [KD 0.000 (0.000)] 2024-10-12 06:38:29,358 - Train: 41.14% [154400/375300] [123.4/300.0] [batch_t 0.316 (0.440)] [data_t 0.015] [optim_t 0.300] [lr 0.001923] [CE 3.539 (3.573)] [KD 0.000 (0.000)] 2024-10-12 06:38:51,608 - Train: 41.15% [154450/375300] [123.5/300.0] [batch_t 0.367 (0.445)] [data_t 0.015] [optim_t 0.352] [lr 0.001922] [CE 3.575 (3.584)] [KD 0.000 (0.000)] 2024-10-12 06:39:13,912 - Train: 41.17% [154500/375300] [123.5/300.0] [batch_t 0.477 (0.446)] [data_t 0.015] [optim_t 0.461] [lr 0.001922] [CE 3.886 (3.623)] [KD 0.000 (0.000)] 2024-10-12 06:39:34,917 - Train: 41.18% [154550/375300] [123.5/300.0] [batch_t 0.390 (0.420)] [data_t 0.016] [optim_t 0.374] [lr 0.001921] [CE 3.828 (3.608)] [KD 0.000 (0.000)] 2024-10-12 06:39:56,202 - Train: 41.19% [154600/375300] [123.6/300.0] [batch_t 0.412 (0.426)] [data_t 0.016] [optim_t 0.396] [lr 0.001921] [CE 3.593 (3.608)] [KD 0.000 (0.000)] 2024-10-12 06:40:18,317 - Train: 41.21% [154650/375300] [123.6/300.0] [batch_t 0.395 (0.442)] [data_t 0.016] [optim_t 0.380] [lr 0.001920] [CE 3.659 (3.608)] [KD 0.000 (0.000)] 2024-10-12 06:40:39,644 - Train: 41.22% [154700/375300] [123.7/300.0] [batch_t 0.370 (0.426)] [data_t 0.015] [optim_t 0.355] [lr 0.001919] [CE 3.879 (3.566)] [KD 0.000 (0.000)] 2024-10-12 06:41:01,793 - Train: 41.23% [154750/375300] [123.7/300.0] [batch_t 0.457 (0.443)] [data_t 0.015] [optim_t 0.442] [lr 0.001919] [CE 3.650 (3.628)] [KD 0.000 (0.000)] 2024-10-12 06:41:23,512 - Train: 41.25% [154800/375300] [123.7/300.0] [batch_t 0.458 (0.434)] [data_t 0.016] [optim_t 0.442] [lr 0.001918] [CE 3.229 (3.574)] [KD 0.000 (0.000)] 2024-10-12 06:41:45,841 - Train: 41.26% [154850/375300] [123.8/300.0] [batch_t 0.386 (0.446)] [data_t 0.016] [optim_t 0.371] [lr 0.001918] [CE 3.666 (3.567)] [KD 0.000 (0.000)] 2024-10-12 06:42:08,073 - Train: 41.27% [154900/375300] [123.8/300.0] [batch_t 0.352 (0.445)] [data_t 0.016] [optim_t 0.336] [lr 0.001917] [CE 3.341 (3.585)] [KD 0.000 (0.000)] 2024-10-12 06:42:28,685 - Train: 41.29% [154950/375300] [123.9/300.0] [batch_t 0.370 (0.412)] [data_t 0.015] [optim_t 0.355] [lr 0.001916] [CE 3.393 (3.603)] [KD 0.000 (0.000)] 2024-10-12 06:42:49,778 - Train: 41.30% [155000/375300] [123.9/300.0] [batch_t 0.411 (0.422)] [data_t 0.015] [optim_t 0.395] [lr 0.001916] [CE 3.565 (3.642)] [KD 0.000 (0.000)] 2024-10-12 06:43:11,552 - Train: 41.31% [155050/375300] [123.9/300.0] [batch_t 1.009 (0.435)] [data_t 0.015] [optim_t 0.994] [lr 0.001915] [CE 3.465 (3.613)] [KD 0.000 (0.000)] 2024-10-12 06:43:32,185 - Train: 41.33% [155100/375300] [124.0/300.0] [batch_t 0.367 (0.413)] [data_t 0.016] [optim_t 0.352] [lr 0.001915] [CE 3.715 (3.600)] [KD 0.000 (0.000)] 2024-10-12 06:43:41,069 - ==> Total time: 18:56:44 Eta: 1 day, 2:53:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 06:43:56,062 - Train: 41.34% [155150/375300] [124.0/300.0] [batch_t 0.315 (0.519)] [data_t 0.016] [optim_t 0.299] [lr 0.001914] [CE 3.464 (3.591)] [KD 0.000 (0.000)] 2024-10-12 06:44:18,055 - Train: 41.35% [155200/375300] [124.1/300.0] [batch_t 0.459 (0.440)] [data_t 0.164] [optim_t 0.295] [lr 0.001913] [CE 3.516 (3.586)] [KD 0.000 (0.000)] 2024-10-12 06:44:39,743 - Train: 41.37% [155250/375300] [124.1/300.0] [batch_t 0.458 (0.434)] [data_t 0.015] [optim_t 0.443] [lr 0.001913] [CE 3.465 (3.563)] [KD 0.000 (0.000)] 2024-10-12 06:45:01,609 - Train: 41.38% [155300/375300] [124.1/300.0] [batch_t 0.449 (0.437)] [data_t 0.016] [optim_t 0.433] [lr 0.001912] [CE 3.877 (3.579)] [KD 0.000 (0.000)] 2024-10-12 06:45:23,151 - Train: 41.39% [155350/375300] [124.2/300.0] [batch_t 0.452 (0.431)] [data_t 0.015] [optim_t 0.437] [lr 0.001912] [CE 3.200 (3.612)] [KD 0.000 (0.000)] 2024-10-12 06:45:44,942 - Train: 41.41% [155400/375300] [124.2/300.0] [batch_t 0.444 (0.436)] [data_t 0.015] [optim_t 0.429] [lr 0.001911] [CE 3.515 (3.611)] [KD 0.000 (0.000)] 2024-10-12 06:46:06,329 - Train: 41.42% [155450/375300] [124.3/300.0] [batch_t 0.459 (0.428)] [data_t 0.016] [optim_t 0.443] [lr 0.001910] [CE 3.588 (3.615)] [KD 0.000 (0.000)] 2024-10-12 06:46:27,906 - Train: 41.43% [155500/375300] [124.3/300.0] [batch_t 0.486 (0.431)] [data_t 0.016] [optim_t 0.470] [lr 0.001910] [CE 3.854 (3.603)] [KD 0.000 (0.000)] 2024-10-12 06:46:49,067 - Train: 41.45% [155550/375300] [124.3/300.0] [batch_t 0.395 (0.423)] [data_t 0.016] [optim_t 0.379] [lr 0.001909] [CE 3.557 (3.603)] [KD 0.000 (0.000)] 2024-10-12 06:47:10,344 - Train: 41.46% [155600/375300] [124.4/300.0] [batch_t 0.439 (0.425)] [data_t 0.016] [optim_t 0.423] [lr 0.001909] [CE 3.860 (3.590)] [KD 0.000 (0.000)] 2024-10-12 06:47:31,954 - Train: 41.47% [155650/375300] [124.4/300.0] [batch_t 0.405 (0.432)] [data_t 0.015] [optim_t 0.390] [lr 0.001908] [CE 3.726 (3.584)] [KD 0.000 (0.000)] 2024-10-12 06:47:54,027 - Train: 41.49% [155700/375300] [124.5/300.0] [batch_t 0.388 (0.441)] [data_t 0.016] [optim_t 0.372] [lr 0.001907] [CE 3.863 (3.605)] [KD 0.000 (0.000)] 2024-10-12 06:48:16,165 - Train: 41.50% [155750/375300] [124.5/300.0] [batch_t 0.520 (0.443)] [data_t 0.015] [optim_t 0.505] [lr 0.001907] [CE 3.621 (3.615)] [KD 0.000 (0.000)] 2024-10-12 06:48:37,892 - Train: 41.51% [155800/375300] [124.5/300.0] [batch_t 0.436 (0.434)] [data_t 0.015] [optim_t 0.421] [lr 0.001906] [CE 3.159 (3.604)] [KD 0.000 (0.000)] 2024-10-12 06:48:59,998 - Train: 41.53% [155850/375300] [124.6/300.0] [batch_t 0.454 (0.442)] [data_t 0.016] [optim_t 0.438] [lr 0.001906] [CE 3.549 (3.612)] [KD 0.000 (0.000)] 2024-10-12 06:49:22,383 - Train: 41.54% [155900/375300] [124.6/300.0] [batch_t 0.418 (0.448)] [data_t 0.016] [optim_t 0.403] [lr 0.001905] [CE 3.510 (3.595)] [KD 0.000 (0.000)] 2024-10-12 06:49:44,366 - Train: 41.55% [155950/375300] [124.7/300.0] [batch_t 0.452 (0.440)] [data_t 0.016] [optim_t 0.436] [lr 0.001904] [CE 3.694 (3.547)] [KD 0.000 (0.000)] 2024-10-12 06:50:06,262 - Train: 41.57% [156000/375300] [124.7/300.0] [batch_t 0.562 (0.438)] [data_t 0.016] [optim_t 0.546] [lr 0.001904] [CE 3.659 (3.602)] [KD 0.000 (0.000)] 2024-10-12 06:50:28,148 - Train: 41.58% [156050/375300] [124.7/300.0] [batch_t 0.503 (0.438)] [data_t 0.016] [optim_t 0.487] [lr 0.001903] [CE 3.503 (3.620)] [KD 0.000 (0.000)] 2024-10-12 06:50:50,073 - Train: 41.59% [156100/375300] [124.8/300.0] [batch_t 0.497 (0.438)] [data_t 0.015] [optim_t 0.481] [lr 0.001903] [CE 3.765 (3.628)] [KD 0.000 (0.000)] 2024-10-12 06:51:12,791 - Train: 41.61% [156150/375300] [124.8/300.0] [batch_t 0.433 (0.454)] [data_t 0.015] [optim_t 0.418] [lr 0.001902] [CE 3.681 (3.651)] [KD 0.000 (0.000)] 2024-10-12 06:51:35,271 - Train: 41.62% [156200/375300] [124.9/300.0] [batch_t 0.536 (0.450)] [data_t 0.015] [optim_t 0.521] [lr 0.001901] [CE 3.285 (3.609)] [KD 0.000 (0.000)] 2024-10-12 06:51:57,073 - Train: 41.63% [156250/375300] [124.9/300.0] [batch_t 0.398 (0.436)] [data_t 0.015] [optim_t 0.383] [lr 0.001901] [CE 3.786 (3.622)] [KD 0.000 (0.000)] 2024-10-12 06:52:18,980 - Train: 41.65% [156300/375300] [124.9/300.0] [batch_t 0.494 (0.438)] [data_t 0.015] [optim_t 0.479] [lr 0.001900] [CE 3.144 (3.576)] [KD 0.000 (0.000)] 2024-10-12 06:52:40,864 - Train: 41.66% [156350/375300] [125.0/300.0] [batch_t 0.434 (0.438)] [data_t 0.015] [optim_t 0.419] [lr 0.001900] [CE 3.766 (3.585)] [KD 0.000 (0.000)] 2024-10-12 06:53:12,423 - Test (net): 100.00% [50/50] [batch_t 0.184 (0.442)] [top1_cnt 36890] [top5_cnt 46137] [top_all 50000] 2024-10-12 06:53:12,424 - net: 73.780 (92.274) 2024-10-12 06:53:35,020 - Test (net_E): 100.00% [50/50] [batch_t 0.133 (0.443)] [top1_cnt 39257] [top5_cnt 47230] [top_all 50000] 2024-10-12 06:53:35,021 - net_E: 78.514 (94.460) 2024-10-12 06:53:35,241 - Max [top1: 73.780 (epoch: 125)] [top1-ema: 78.514 (epoch: 125)] 2024-10-12 06:53:35,241 - ==> Total time: 19:06:39 Eta: 1 day, 2:45:18 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 06:53:53,740 - Train: 41.67% [156400/375300] [125.0/300.0] [batch_t 1.389 (0.470)] [data_t 1.095] [optim_t 0.295] [lr 0.001899] [CE 3.550 (3.582)] [KD 0.000 (0.000)] 2024-10-12 06:54:15,552 - Train: 41.69% [156450/375300] [125.1/300.0] [batch_t 0.503 (0.436)] [data_t 0.206] [optim_t 0.297] [lr 0.001898] [CE 3.340 (3.559)] [KD 0.000 (0.000)] 2024-10-12 06:54:37,213 - Train: 41.70% [156500/375300] [125.1/300.0] [batch_t 0.504 (0.433)] [data_t 0.208] [optim_t 0.295] [lr 0.001898] [CE 3.323 (3.621)] [KD 0.000 (0.000)] 2024-10-12 06:54:59,368 - Train: 41.71% [156550/375300] [125.1/300.0] [batch_t 0.512 (0.443)] [data_t 0.212] [optim_t 0.300] [lr 0.001897] [CE 3.949 (3.636)] [KD 0.000 (0.000)] 2024-10-12 06:55:21,020 - Train: 41.73% [156600/375300] [125.2/300.0] [batch_t 0.436 (0.433)] [data_t 0.142] [optim_t 0.294] [lr 0.001897] [CE 3.098 (3.558)] [KD 0.000 (0.000)] 2024-10-12 06:55:42,752 - Train: 41.74% [156650/375300] [125.2/300.0] [batch_t 0.471 (0.435)] [data_t 0.016] [optim_t 0.455] [lr 0.001896] [CE 3.792 (3.601)] [KD 0.000 (0.000)] 2024-10-12 06:56:04,405 - Train: 41.75% [156700/375300] [125.3/300.0] [batch_t 0.435 (0.433)] [data_t 0.016] [optim_t 0.420] [lr 0.001895] [CE 3.695 (3.597)] [KD 0.000 (0.000)] 2024-10-12 06:56:26,752 - Train: 41.77% [156750/375300] [125.3/300.0] [batch_t 0.557 (0.447)] [data_t 0.015] [optim_t 0.541] [lr 0.001895] [CE 3.444 (3.575)] [KD 0.000 (0.000)] 2024-10-12 06:56:49,090 - Train: 41.78% [156800/375300] [125.3/300.0] [batch_t 0.393 (0.447)] [data_t 0.016] [optim_t 0.378] [lr 0.001894] [CE 3.739 (3.628)] [KD 0.000 (0.000)] 2024-10-12 06:57:10,814 - Train: 41.79% [156850/375300] [125.4/300.0] [batch_t 0.397 (0.434)] [data_t 0.015] [optim_t 0.382] [lr 0.001894] [CE 3.732 (3.613)] [KD 0.000 (0.000)] 2024-10-12 06:57:32,256 - Train: 41.81% [156900/375300] [125.4/300.0] [batch_t 0.413 (0.429)] [data_t 0.015] [optim_t 0.398] [lr 0.001893] [CE 3.182 (3.592)] [KD 0.000 (0.000)] 2024-10-12 06:57:54,192 - Train: 41.82% [156950/375300] [125.5/300.0] [batch_t 0.475 (0.439)] [data_t 0.015] [optim_t 0.460] [lr 0.001892] [CE 3.299 (3.613)] [KD 0.000 (0.000)] 2024-10-12 06:58:16,579 - Train: 41.83% [157000/375300] [125.5/300.0] [batch_t 0.468 (0.448)] [data_t 0.016] [optim_t 0.452] [lr 0.001892] [CE 3.611 (3.574)] [KD 0.000 (0.000)] 2024-10-12 06:58:38,977 - Train: 41.85% [157050/375300] [125.5/300.0] [batch_t 0.522 (0.448)] [data_t 0.016] [optim_t 0.506] [lr 0.001891] [CE 3.423 (3.600)] [KD 0.000 (0.000)] 2024-10-12 06:59:00,799 - Train: 41.86% [157100/375300] [125.6/300.0] [batch_t 0.462 (0.436)] [data_t 0.016] [optim_t 0.446] [lr 0.001891] [CE 4.185 (3.626)] [KD 0.000 (0.000)] 2024-10-12 06:59:22,824 - Train: 41.87% [157150/375300] [125.6/300.0] [batch_t 0.467 (0.440)] [data_t 0.015] [optim_t 0.452] [lr 0.001890] [CE 3.732 (3.588)] [KD 0.000 (0.000)] 2024-10-12 06:59:44,814 - Train: 41.89% [157200/375300] [125.7/300.0] [batch_t 0.375 (0.440)] [data_t 0.016] [optim_t 0.360] [lr 0.001889] [CE 3.721 (3.596)] [KD 0.000 (0.000)] 2024-10-12 07:00:07,369 - Train: 41.90% [157250/375300] [125.7/300.0] [batch_t 0.319 (0.451)] [data_t 0.016] [optim_t 0.304] [lr 0.001889] [CE 3.592 (3.602)] [KD 0.000 (0.000)] 2024-10-12 07:00:29,231 - Train: 41.91% [157300/375300] [125.7/300.0] [batch_t 0.483 (0.437)] [data_t 0.015] [optim_t 0.467] [lr 0.001888] [CE 3.527 (3.679)] [KD 0.000 (0.000)] 2024-10-12 07:00:50,935 - Train: 41.93% [157350/375300] [125.8/300.0] [batch_t 0.383 (0.434)] [data_t 0.016] [optim_t 0.367] [lr 0.001888] [CE 3.232 (3.581)] [KD 0.000 (0.000)] 2024-10-12 07:01:12,487 - Train: 41.94% [157400/375300] [125.8/300.0] [batch_t 0.483 (0.431)] [data_t 0.016] [optim_t 0.467] [lr 0.001887] [CE 3.588 (3.613)] [KD 0.000 (0.000)] 2024-10-12 07:01:34,139 - Train: 41.95% [157450/375300] [125.9/300.0] [batch_t 0.473 (0.433)] [data_t 0.016] [optim_t 0.457] [lr 0.001886] [CE 3.931 (3.589)] [KD 0.000 (0.000)] 2024-10-12 07:01:56,070 - Train: 41.97% [157500/375300] [125.9/300.0] [batch_t 0.417 (0.438)] [data_t 0.016] [optim_t 0.401] [lr 0.001886] [CE 3.658 (3.556)] [KD 0.000 (0.000)] 2024-10-12 07:02:17,946 - Train: 41.98% [157550/375300] [125.9/300.0] [batch_t 0.394 (0.437)] [data_t 0.016] [optim_t 0.378] [lr 0.001885] [CE 3.585 (3.581)] [KD 0.000 (0.000)] 2024-10-12 07:02:40,011 - Train: 41.99% [157600/375300] [126.0/300.0] [batch_t 0.573 (0.441)] [data_t 0.016] [optim_t 0.557] [lr 0.001885] [CE 3.554 (3.636)] [KD 0.000 (0.000)] 2024-10-12 07:02:49,882 - ==> Total time: 19:15:53 Eta: 1 day, 2:36:14 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 07:03:04,564 - Train: 42.01% [157650/375300] [126.0/300.0] [batch_t 0.554 (0.543)] [data_t 0.016] [optim_t 0.539] [lr 0.001884] [CE 3.453 (3.553)] [KD 0.000 (0.000)] 2024-10-12 07:03:26,948 - Train: 42.02% [157700/375300] [126.1/300.0] [batch_t 0.559 (0.448)] [data_t 0.015] [optim_t 0.543] [lr 0.001883] [CE 3.928 (3.627)] [KD 0.000 (0.000)] 2024-10-12 07:03:49,165 - Train: 42.03% [157750/375300] [126.1/300.0] [batch_t 0.381 (0.444)] [data_t 0.016] [optim_t 0.366] [lr 0.001883] [CE 3.585 (3.577)] [KD 0.000 (0.000)] 2024-10-12 07:04:11,812 - Train: 42.05% [157800/375300] [126.1/300.0] [batch_t 0.425 (0.453)] [data_t 0.016] [optim_t 0.410] [lr 0.001882] [CE 3.518 (3.600)] [KD 0.000 (0.000)] 2024-10-12 07:04:33,869 - Train: 42.06% [157850/375300] [126.2/300.0] [batch_t 0.502 (0.441)] [data_t 0.016] [optim_t 0.486] [lr 0.001882] [CE 3.678 (3.602)] [KD 0.000 (0.000)] 2024-10-12 07:04:55,479 - Train: 42.07% [157900/375300] [126.2/300.0] [batch_t 0.450 (0.432)] [data_t 0.016] [optim_t 0.434] [lr 0.001881] [CE 3.815 (3.611)] [KD 0.000 (0.000)] 2024-10-12 07:05:17,386 - Train: 42.09% [157950/375300] [126.3/300.0] [batch_t 0.377 (0.438)] [data_t 0.015] [optim_t 0.361] [lr 0.001880] [CE 3.431 (3.593)] [KD 0.000 (0.000)] 2024-10-12 07:05:39,586 - Train: 42.10% [158000/375300] [126.3/300.0] [batch_t 0.350 (0.444)] [data_t 0.015] [optim_t 0.334] [lr 0.001880] [CE 3.513 (3.635)] [KD 0.000 (0.000)] 2024-10-12 07:06:01,146 - Train: 42.11% [158050/375300] [126.3/300.0] [batch_t 0.398 (0.431)] [data_t 0.016] [optim_t 0.382] [lr 0.001879] [CE 3.983 (3.553)] [KD 0.000 (0.000)] 2024-10-12 07:06:22,979 - Train: 42.13% [158100/375300] [126.4/300.0] [batch_t 0.331 (0.437)] [data_t 0.016] [optim_t 0.315] [lr 0.001879] [CE 3.611 (3.606)] [KD 0.000 (0.000)] 2024-10-12 07:06:45,454 - Train: 42.14% [158150/375300] [126.4/300.0] [batch_t 0.462 (0.449)] [data_t 0.016] [optim_t 0.446] [lr 0.001878] [CE 3.152 (3.581)] [KD 0.000 (0.000)] 2024-10-12 07:07:07,718 - Train: 42.15% [158200/375300] [126.5/300.0] [batch_t 0.491 (0.445)] [data_t 0.015] [optim_t 0.476] [lr 0.001877] [CE 3.547 (3.591)] [KD 0.000 (0.000)] 2024-10-12 07:07:29,533 - Train: 42.17% [158250/375300] [126.5/300.0] [batch_t 0.366 (0.436)] [data_t 0.015] [optim_t 0.351] [lr 0.001877] [CE 3.567 (3.608)] [KD 0.000 (0.000)] 2024-10-12 07:07:51,571 - Train: 42.18% [158300/375300] [126.5/300.0] [batch_t 0.385 (0.441)] [data_t 0.015] [optim_t 0.370] [lr 0.001876] [CE 3.904 (3.589)] [KD 0.000 (0.000)] 2024-10-12 07:08:13,468 - Train: 42.19% [158350/375300] [126.6/300.0] [batch_t 0.544 (0.438)] [data_t 0.016] [optim_t 0.528] [lr 0.001876] [CE 3.868 (3.600)] [KD 0.000 (0.000)] 2024-10-12 07:08:34,932 - Train: 42.21% [158400/375300] [126.6/300.0] [batch_t 0.390 (0.429)] [data_t 0.016] [optim_t 0.374] [lr 0.001875] [CE 3.395 (3.645)] [KD 0.000 (0.000)] 2024-10-12 07:08:56,990 - Train: 42.22% [158450/375300] [126.7/300.0] [batch_t 0.382 (0.441)] [data_t 0.015] [optim_t 0.367] [lr 0.001874] [CE 3.780 (3.576)] [KD 0.000 (0.000)] 2024-10-12 07:09:18,840 - Train: 42.23% [158500/375300] [126.7/300.0] [batch_t 0.368 (0.437)] [data_t 0.017] [optim_t 0.351] [lr 0.001874] [CE 3.457 (3.591)] [KD 0.000 (0.000)] 2024-10-12 07:09:41,030 - Train: 42.25% [158550/375300] [126.7/300.0] [batch_t 0.412 (0.444)] [data_t 0.016] [optim_t 0.396] [lr 0.001873] [CE 3.693 (3.617)] [KD 0.000 (0.000)] 2024-10-12 07:10:02,948 - Train: 42.26% [158600/375300] [126.8/300.0] [batch_t 0.536 (0.438)] [data_t 0.016] [optim_t 0.521] [lr 0.001873] [CE 3.642 (3.610)] [KD 0.000 (0.000)] 2024-10-12 07:10:24,745 - Train: 42.27% [158650/375300] [126.8/300.0] [batch_t 0.315 (0.436)] [data_t 0.016] [optim_t 0.299] [lr 0.001872] [CE 3.260 (3.618)] [KD 0.000 (0.000)] 2024-10-12 07:10:46,427 - Train: 42.29% [158700/375300] [126.9/300.0] [batch_t 0.359 (0.434)] [data_t 0.016] [optim_t 0.343] [lr 0.001871] [CE 3.714 (3.564)] [KD 0.000 (0.000)] 2024-10-12 07:11:08,337 - Train: 42.30% [158750/375300] [126.9/300.0] [batch_t 0.453 (0.438)] [data_t 0.015] [optim_t 0.437] [lr 0.001871] [CE 3.932 (3.603)] [KD 0.000 (0.000)] 2024-10-12 07:11:30,593 - Train: 42.31% [158800/375300] [126.9/300.0] [batch_t 0.500 (0.445)] [data_t 0.015] [optim_t 0.484] [lr 0.001870] [CE 3.883 (3.640)] [KD 0.000 (0.000)] 2024-10-12 07:11:52,752 - Train: 42.33% [158850/375300] [127.0/300.0] [batch_t 0.446 (0.443)] [data_t 0.016] [optim_t 0.431] [lr 0.001870] [CE 3.950 (3.623)] [KD 0.000 (0.000)] 2024-10-12 07:12:03,271 - ==> Total time: 19:25:07 Eta: 1 day, 2:27:07 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 07:12:19,151 - Train: 42.34% [158900/375300] [127.0/300.0] [batch_t 0.327 (0.587)] [data_t 0.016] [optim_t 0.311] [lr 0.001869] [CE 3.613 (3.559)] [KD 0.000 (0.000)] 2024-10-12 07:12:42,343 - Train: 42.35% [158950/375300] [127.1/300.0] [batch_t 0.488 (0.464)] [data_t 0.185] [optim_t 0.303] [lr 0.001868] [CE 3.790 (3.590)] [KD 0.000 (0.000)] 2024-10-12 07:13:05,561 - Train: 42.37% [159000/375300] [127.1/300.0] [batch_t 0.785 (0.464)] [data_t 0.231] [optim_t 0.554] [lr 0.001868] [CE 3.758 (3.584)] [KD 0.000 (0.000)] 2024-10-12 07:13:28,658 - Train: 42.38% [159050/375300] [127.1/300.0] [batch_t 0.325 (0.462)] [data_t 0.016] [optim_t 0.310] [lr 0.001867] [CE 3.385 (3.588)] [KD 0.000 (0.000)] 2024-10-12 07:13:51,344 - Train: 42.39% [159100/375300] [127.2/300.0] [batch_t 0.518 (0.454)] [data_t 0.220] [optim_t 0.298] [lr 0.001867] [CE 3.841 (3.564)] [KD 0.000 (0.000)] 2024-10-12 07:14:14,620 - Train: 42.41% [159150/375300] [127.2/300.0] [batch_t 0.501 (0.465)] [data_t 0.015] [optim_t 0.486] [lr 0.001866] [CE 3.900 (3.597)] [KD 0.000 (0.000)] 2024-10-12 07:14:37,872 - Train: 42.42% [159200/375300] [127.3/300.0] [batch_t 0.385 (0.465)] [data_t 0.015] [optim_t 0.370] [lr 0.001865] [CE 3.754 (3.590)] [KD 0.000 (0.000)] 2024-10-12 07:15:00,723 - Train: 42.43% [159250/375300] [127.3/300.0] [batch_t 0.416 (0.457)] [data_t 0.015] [optim_t 0.400] [lr 0.001865] [CE 3.197 (3.576)] [KD 0.000 (0.000)] 2024-10-12 07:15:23,722 - Train: 42.45% [159300/375300] [127.3/300.0] [batch_t 0.455 (0.460)] [data_t 0.016] [optim_t 0.439] [lr 0.001864] [CE 3.689 (3.589)] [KD 0.000 (0.000)] 2024-10-12 07:15:46,238 - Train: 42.46% [159350/375300] [127.4/300.0] [batch_t 0.416 (0.450)] [data_t 0.016] [optim_t 0.400] [lr 0.001864] [CE 3.737 (3.567)] [KD 0.000 (0.000)] 2024-10-12 07:16:08,963 - Train: 42.47% [159400/375300] [127.4/300.0] [batch_t 0.459 (0.454)] [data_t 0.015] [optim_t 0.443] [lr 0.001863] [CE 3.524 (3.614)] [KD 0.000 (0.000)] 2024-10-12 07:16:31,693 - Train: 42.49% [159450/375300] [127.5/300.0] [batch_t 0.456 (0.454)] [data_t 0.016] [optim_t 0.440] [lr 0.001862] [CE 3.655 (3.602)] [KD 0.000 (0.000)] 2024-10-12 07:16:54,348 - Train: 42.50% [159500/375300] [127.5/300.0] [batch_t 0.408 (0.453)] [data_t 0.016] [optim_t 0.393] [lr 0.001862] [CE 3.529 (3.602)] [KD 0.000 (0.000)] 2024-10-12 07:17:16,254 - Train: 42.51% [159550/375300] [127.5/300.0] [batch_t 0.460 (0.438)] [data_t 0.016] [optim_t 0.444] [lr 0.001861] [CE 3.730 (3.574)] [KD 0.000 (0.000)] 2024-10-12 07:17:38,600 - Train: 42.53% [159600/375300] [127.6/300.0] [batch_t 0.466 (0.447)] [data_t 0.015] [optim_t 0.451] [lr 0.001860] [CE 3.750 (3.607)] [KD 0.000 (0.000)] 2024-10-12 07:18:00,852 - Train: 42.54% [159650/375300] [127.6/300.0] [batch_t 0.512 (0.445)] [data_t 0.016] [optim_t 0.496] [lr 0.001860] [CE 3.674 (3.590)] [KD 0.000 (0.000)] 2024-10-12 07:18:22,294 - Train: 42.55% [159700/375300] [127.7/300.0] [batch_t 0.452 (0.429)] [data_t 0.016] [optim_t 0.437] [lr 0.001859] [CE 3.821 (3.613)] [KD 0.000 (0.000)] 2024-10-12 07:18:43,926 - Train: 42.57% [159750/375300] [127.7/300.0] [batch_t 0.373 (0.432)] [data_t 0.016] [optim_t 0.357] [lr 0.001859] [CE 3.451 (3.591)] [KD 0.000 (0.000)] 2024-10-12 07:19:07,184 - Train: 42.58% [159800/375300] [127.7/300.0] [batch_t 0.406 (0.465)] [data_t 0.016] [optim_t 0.390] [lr 0.001858] [CE 3.678 (3.575)] [KD 0.000 (0.000)] 2024-10-12 07:19:29,391 - Train: 42.59% [159850/375300] [127.8/300.0] [batch_t 0.416 (0.444)] [data_t 0.016] [optim_t 0.400] [lr 0.001857] [CE 3.605 (3.618)] [KD 0.000 (0.000)] 2024-10-12 07:19:51,617 - Train: 42.61% [159900/375300] [127.8/300.0] [batch_t 0.412 (0.444)] [data_t 0.016] [optim_t 0.397] [lr 0.001857] [CE 3.800 (3.603)] [KD 0.000 (0.000)] 2024-10-12 07:20:14,222 - Train: 42.62% [159950/375300] [127.9/300.0] [batch_t 0.448 (0.452)] [data_t 0.016] [optim_t 0.433] [lr 0.001856] [CE 3.502 (3.538)] [KD 0.000 (0.000)] 2024-10-12 07:20:36,260 - Train: 42.63% [160000/375300] [127.9/300.0] [batch_t 0.394 (0.441)] [data_t 0.016] [optim_t 0.378] [lr 0.001856] [CE 3.790 (3.609)] [KD 0.000 (0.000)] 2024-10-12 07:20:58,231 - Train: 42.65% [160050/375300] [127.9/300.0] [batch_t 0.473 (0.439)] [data_t 0.015] [optim_t 0.458] [lr 0.001855] [CE 3.624 (3.558)] [KD 0.000 (0.000)] 2024-10-12 07:21:20,514 - Train: 42.66% [160100/375300] [128.0/300.0] [batch_t 0.585 (0.446)] [data_t 0.015] [optim_t 0.570] [lr 0.001854] [CE 3.655 (3.584)] [KD 0.000 (0.000)] 2024-10-12 07:21:31,655 - ==> Total time: 19:34:35 Eta: 1 day, 2:18:21 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 07:21:45,775 - Train: 42.67% [160150/375300] [128.0/300.0] [batch_t 0.319 (0.576)] [data_t 0.016] [optim_t 0.304] [lr 0.001854] [CE 3.684 (3.553)] [KD 0.000 (0.000)] 2024-10-12 07:22:09,187 - Train: 42.69% [160200/375300] [128.1/300.0] [batch_t 0.484 (0.468)] [data_t 0.190] [optim_t 0.294] [lr 0.001853] [CE 3.429 (3.539)] [KD 0.000 (0.000)] 2024-10-12 07:22:31,708 - Train: 42.70% [160250/375300] [128.1/300.0] [batch_t 0.454 (0.450)] [data_t 0.051] [optim_t 0.403] [lr 0.001853] [CE 3.113 (3.562)] [KD 0.000 (0.000)] 2024-10-12 07:22:53,975 - Train: 42.71% [160300/375300] [128.1/300.0] [batch_t 0.467 (0.445)] [data_t 0.015] [optim_t 0.451] [lr 0.001852] [CE 3.511 (3.598)] [KD 0.000 (0.000)] 2024-10-12 07:23:14,978 - Train: 42.73% [160350/375300] [128.2/300.0] [batch_t 0.426 (0.420)] [data_t 0.015] [optim_t 0.411] [lr 0.001851] [CE 3.667 (3.611)] [KD 0.000 (0.000)] 2024-10-12 07:23:35,493 - Train: 42.74% [160400/375300] [128.2/300.0] [batch_t 0.321 (0.410)] [data_t 0.016] [optim_t 0.306] [lr 0.001851] [CE 3.422 (3.596)] [KD 0.000 (0.000)] 2024-10-12 07:23:57,520 - Train: 42.75% [160450/375300] [128.3/300.0] [batch_t 0.387 (0.440)] [data_t 0.015] [optim_t 0.372] [lr 0.001850] [CE 3.667 (3.583)] [KD 0.000 (0.000)] 2024-10-12 07:24:19,977 - Train: 42.77% [160500/375300] [128.3/300.0] [batch_t 0.452 (0.449)] [data_t 0.015] [optim_t 0.437] [lr 0.001850] [CE 3.790 (3.577)] [KD 0.000 (0.000)] 2024-10-12 07:24:41,313 - Train: 42.78% [160550/375300] [128.3/300.0] [batch_t 0.420 (0.427)] [data_t 0.016] [optim_t 0.404] [lr 0.001849] [CE 3.626 (3.665)] [KD 0.000 (0.000)] 2024-10-12 07:25:02,582 - Train: 42.79% [160600/375300] [128.4/300.0] [batch_t 0.394 (0.425)] [data_t 0.016] [optim_t 0.378] [lr 0.001848] [CE 3.445 (3.543)] [KD 0.000 (0.000)] 2024-10-12 07:25:24,401 - Train: 42.81% [160650/375300] [128.4/300.0] [batch_t 0.319 (0.436)] [data_t 0.015] [optim_t 0.304] [lr 0.001848] [CE 3.717 (3.553)] [KD 0.000 (0.000)] 2024-10-12 07:25:46,082 - Train: 42.82% [160700/375300] [128.5/300.0] [batch_t 0.444 (0.434)] [data_t 0.015] [optim_t 0.429] [lr 0.001847] [CE 3.393 (3.582)] [KD 0.000 (0.000)] 2024-10-12 07:26:07,848 - Train: 42.83% [160750/375300] [128.5/300.0] [batch_t 0.392 (0.435)] [data_t 0.015] [optim_t 0.376] [lr 0.001847] [CE 3.402 (3.603)] [KD 0.000 (0.000)] 2024-10-12 07:26:30,236 - Train: 42.85% [160800/375300] [128.5/300.0] [batch_t 0.462 (0.448)] [data_t 0.016] [optim_t 0.446] [lr 0.001846] [CE 3.156 (3.609)] [KD 0.000 (0.000)] 2024-10-12 07:26:52,170 - Train: 42.86% [160850/375300] [128.6/300.0] [batch_t 0.441 (0.439)] [data_t 0.016] [optim_t 0.425] [lr 0.001845] [CE 3.804 (3.607)] [KD 0.000 (0.000)] 2024-10-12 07:27:14,620 - Train: 42.87% [160900/375300] [128.6/300.0] [batch_t 0.433 (0.449)] [data_t 0.016] [optim_t 0.418] [lr 0.001845] [CE 3.496 (3.548)] [KD 0.000 (0.000)] 2024-10-12 07:27:36,370 - Train: 42.89% [160950/375300] [128.7/300.0] [batch_t 0.434 (0.435)] [data_t 0.016] [optim_t 0.419] [lr 0.001844] [CE 3.532 (3.583)] [KD 0.000 (0.000)] 2024-10-12 07:27:57,311 - Train: 42.90% [161000/375300] [128.7/300.0] [batch_t 0.440 (0.419)] [data_t 0.015] [optim_t 0.425] [lr 0.001844] [CE 3.593 (3.599)] [KD 0.000 (0.000)] 2024-10-12 07:28:19,155 - Train: 42.91% [161050/375300] [128.7/300.0] [batch_t 0.424 (0.437)] [data_t 0.016] [optim_t 0.408] [lr 0.001843] [CE 3.487 (3.601)] [KD 0.000 (0.000)] 2024-10-12 07:28:41,076 - Train: 42.93% [161100/375300] [128.8/300.0] [batch_t 0.460 (0.438)] [data_t 0.015] [optim_t 0.445] [lr 0.001842] [CE 3.530 (3.581)] [KD 0.000 (0.000)] 2024-10-12 07:29:02,856 - Train: 42.94% [161150/375300] [128.8/300.0] [batch_t 0.338 (0.435)] [data_t 0.015] [optim_t 0.323] [lr 0.001842] [CE 3.554 (3.590)] [KD 0.000 (0.000)] 2024-10-12 07:29:24,776 - Train: 42.95% [161200/375300] [128.9/300.0] [batch_t 0.447 (0.438)] [data_t 0.016] [optim_t 0.431] [lr 0.001841] [CE 3.824 (3.609)] [KD 0.000 (0.000)] 2024-10-12 07:29:46,912 - Train: 42.97% [161250/375300] [128.9/300.0] [batch_t 0.461 (0.443)] [data_t 0.015] [optim_t 0.445] [lr 0.001841] [CE 3.862 (3.605)] [KD 0.000 (0.000)] 2024-10-12 07:30:08,698 - Train: 42.98% [161300/375300] [128.9/300.0] [batch_t 0.458 (0.436)] [data_t 0.015] [optim_t 0.442] [lr 0.001840] [CE 3.442 (3.557)] [KD 0.000 (0.000)] 2024-10-12 07:30:30,644 - Train: 42.99% [161350/375300] [129.0/300.0] [batch_t 0.473 (0.439)] [data_t 0.016] [optim_t 0.458] [lr 0.001839] [CE 3.635 (3.583)] [KD 0.000 (0.000)] 2024-10-12 07:30:41,713 - ==> Total time: 19:43:45 Eta: 1 day, 2:09:10 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 07:30:55,418 - Train: 43.01% [161400/375300] [129.0/300.0] [batch_t 0.318 (0.585)] [data_t 0.015] [optim_t 0.302] [lr 0.001839] [CE 3.509 (3.502)] [KD 0.000 (0.000)] 2024-10-12 07:31:16,108 - Train: 43.02% [161450/375300] [129.1/300.0] [batch_t 0.419 (0.414)] [data_t 0.123] [optim_t 0.296] [lr 0.001838] [CE 3.445 (3.580)] [KD 0.000 (0.000)] 2024-10-12 07:31:37,416 - Train: 43.03% [161500/375300] [129.1/300.0] [batch_t 0.410 (0.426)] [data_t 0.015] [optim_t 0.395] [lr 0.001837] [CE 3.259 (3.543)] [KD 0.000 (0.000)] 2024-10-12 07:31:58,553 - Train: 43.05% [161550/375300] [129.1/300.0] [batch_t 0.392 (0.423)] [data_t 0.091] [optim_t 0.300] [lr 0.001837] [CE 3.667 (3.549)] [KD 0.000 (0.000)] 2024-10-12 07:32:20,262 - Train: 43.06% [161600/375300] [129.2/300.0] [batch_t 0.468 (0.434)] [data_t 0.016] [optim_t 0.453] [lr 0.001836] [CE 3.822 (3.595)] [KD 0.000 (0.000)] 2024-10-12 07:32:41,198 - Train: 43.07% [161650/375300] [129.2/300.0] [batch_t 0.435 (0.419)] [data_t 0.015] [optim_t 0.419] [lr 0.001836] [CE 3.523 (3.589)] [KD 0.000 (0.000)] 2024-10-12 07:33:02,623 - Train: 43.09% [161700/375300] [129.3/300.0] [batch_t 0.362 (0.428)] [data_t 0.015] [optim_t 0.346] [lr 0.001835] [CE 3.117 (3.544)] [KD 0.000 (0.000)] 2024-10-12 07:33:24,197 - Train: 43.10% [161750/375300] [129.3/300.0] [batch_t 0.419 (0.431)] [data_t 0.015] [optim_t 0.403] [lr 0.001834] [CE 3.275 (3.627)] [KD 0.000 (0.000)] 2024-10-12 07:33:45,974 - Train: 43.11% [161800/375300] [129.3/300.0] [batch_t 0.367 (0.435)] [data_t 0.016] [optim_t 0.351] [lr 0.001834] [CE 3.807 (3.561)] [KD 0.000 (0.000)] 2024-10-12 07:34:07,308 - Train: 43.13% [161850/375300] [129.4/300.0] [batch_t 0.427 (0.427)] [data_t 0.016] [optim_t 0.411] [lr 0.001833] [CE 3.590 (3.599)] [KD 0.000 (0.000)] 2024-10-12 07:34:28,623 - Train: 43.14% [161900/375300] [129.4/300.0] [batch_t 0.436 (0.426)] [data_t 0.015] [optim_t 0.421] [lr 0.001833] [CE 3.775 (3.643)] [KD 0.000 (0.000)] 2024-10-12 07:34:50,297 - Train: 43.15% [161950/375300] [129.5/300.0] [batch_t 0.489 (0.433)] [data_t 0.015] [optim_t 0.473] [lr 0.001832] [CE 3.827 (3.589)] [KD 0.000 (0.000)] 2024-10-12 07:35:12,109 - Train: 43.17% [162000/375300] [129.5/300.0] [batch_t 0.501 (0.436)] [data_t 0.015] [optim_t 0.485] [lr 0.001831] [CE 3.700 (3.585)] [KD 0.000 (0.000)] 2024-10-12 07:35:33,849 - Train: 43.18% [162050/375300] [129.5/300.0] [batch_t 0.392 (0.435)] [data_t 0.015] [optim_t 0.377] [lr 0.001831] [CE 3.605 (3.584)] [KD 0.000 (0.000)] 2024-10-12 07:35:55,388 - Train: 43.19% [162100/375300] [129.6/300.0] [batch_t 0.458 (0.431)] [data_t 0.015] [optim_t 0.443] [lr 0.001830] [CE 3.794 (3.576)] [KD 0.000 (0.000)] 2024-10-12 07:36:17,182 - Train: 43.21% [162150/375300] [129.6/300.0] [batch_t 0.419 (0.436)] [data_t 0.015] [optim_t 0.403] [lr 0.001830] [CE 3.593 (3.576)] [KD 0.000 (0.000)] 2024-10-12 07:36:38,693 - Train: 43.22% [162200/375300] [129.7/300.0] [batch_t 0.490 (0.430)] [data_t 0.016] [optim_t 0.474] [lr 0.001829] [CE 3.433 (3.607)] [KD 0.000 (0.000)] 2024-10-12 07:37:00,692 - Train: 43.23% [162250/375300] [129.7/300.0] [batch_t 0.414 (0.440)] [data_t 0.016] [optim_t 0.399] [lr 0.001828] [CE 3.747 (3.615)] [KD 0.000 (0.000)] 2024-10-12 07:37:23,134 - Train: 43.25% [162300/375300] [129.7/300.0] [batch_t 0.487 (0.449)] [data_t 0.015] [optim_t 0.471] [lr 0.001828] [CE 3.335 (3.537)] [KD 0.000 (0.000)] 2024-10-12 07:37:44,827 - Train: 43.26% [162350/375300] [129.8/300.0] [batch_t 0.419 (0.434)] [data_t 0.015] [optim_t 0.404] [lr 0.001827] [CE 3.648 (3.573)] [KD 0.000 (0.000)] 2024-10-12 07:38:06,993 - Train: 43.27% [162400/375300] [129.8/300.0] [batch_t 0.484 (0.443)] [data_t 0.016] [optim_t 0.468] [lr 0.001827] [CE 3.643 (3.645)] [KD 0.000 (0.000)] 2024-10-12 07:38:28,772 - Train: 43.29% [162450/375300] [129.9/300.0] [batch_t 0.457 (0.435)] [data_t 0.015] [optim_t 0.442] [lr 0.001826] [CE 3.302 (3.526)] [KD 0.000 (0.000)] 2024-10-12 07:38:49,893 - Train: 43.30% [162500/375300] [129.9/300.0] [batch_t 0.412 (0.422)] [data_t 0.015] [optim_t 0.396] [lr 0.001825] [CE 3.808 (3.574)] [KD 0.000 (0.000)] 2024-10-12 07:39:11,987 - Train: 43.31% [162550/375300] [129.9/300.0] [batch_t 0.472 (0.442)] [data_t 0.016] [optim_t 0.456] [lr 0.001825] [CE 3.461 (3.570)] [KD 0.000 (0.000)] 2024-10-12 07:39:33,388 - Train: 43.33% [162600/375300] [130.0/300.0] [batch_t 0.435 (0.428)] [data_t 0.016] [optim_t 0.420] [lr 0.001824] [CE 3.618 (3.598)] [KD 0.000 (0.000)] 2024-10-12 07:40:06,599 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.428)] [top1_cnt 36910] [top5_cnt 46099] [top_all 50000] 2024-10-12 07:40:06,600 - net: 73.820 (92.198) 2024-10-12 07:40:28,445 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.430)] [top1_cnt 39271] [top5_cnt 47255] [top_all 50000] 2024-10-12 07:40:28,445 - net_E: 78.542 (94.510) 2024-10-12 07:40:28,649 - Max [top1: 73.820 (epoch: 130)] [top1-ema: 78.542 (epoch: 130)] 2024-10-12 07:40:28,650 - ==> Total time: 19:53:32 Eta: 1 day, 2:00:47 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 07:40:44,183 - Train: 43.34% [162650/375300] [130.0/300.0] [batch_t 1.259 (0.462)] [data_t 0.960] [optim_t 0.298] [lr 0.001824] [CE 3.713 (3.506)] [KD 0.000 (0.000)] 2024-10-12 07:41:04,012 - Train: 43.35% [162700/375300] [130.1/300.0] [batch_t 0.380 (0.396)] [data_t 0.082] [optim_t 0.298] [lr 0.001823] [CE 3.754 (3.580)] [KD 0.000 (0.000)] 2024-10-12 07:41:25,474 - Train: 43.37% [162750/375300] [130.1/300.0] [batch_t 0.453 (0.429)] [data_t 0.016] [optim_t 0.438] [lr 0.001822] [CE 3.140 (3.558)] [KD 0.000 (0.000)] 2024-10-12 07:41:47,805 - Train: 43.38% [162800/375300] [130.1/300.0] [batch_t 0.413 (0.447)] [data_t 0.015] [optim_t 0.398] [lr 0.001822] [CE 3.837 (3.571)] [KD 0.000 (0.000)] 2024-10-12 07:42:10,081 - Train: 43.39% [162850/375300] [130.2/300.0] [batch_t 0.411 (0.445)] [data_t 0.015] [optim_t 0.396] [lr 0.001821] [CE 3.491 (3.540)] [KD 0.000 (0.000)] 2024-10-12 07:42:31,862 - Train: 43.41% [162900/375300] [130.2/300.0] [batch_t 0.457 (0.436)] [data_t 0.016] [optim_t 0.442] [lr 0.001820] [CE 3.786 (3.577)] [KD 0.000 (0.000)] 2024-10-12 07:42:53,442 - Train: 43.42% [162950/375300] [130.3/300.0] [batch_t 0.355 (0.431)] [data_t 0.015] [optim_t 0.339] [lr 0.001820] [CE 3.469 (3.551)] [KD 0.000 (0.000)] 2024-10-12 07:43:15,466 - Train: 43.43% [163000/375300] [130.3/300.0] [batch_t 0.425 (0.440)] [data_t 0.015] [optim_t 0.410] [lr 0.001819] [CE 3.814 (3.575)] [KD 0.000 (0.000)] 2024-10-12 07:43:37,917 - Train: 43.45% [163050/375300] [130.3/300.0] [batch_t 0.420 (0.449)] [data_t 0.015] [optim_t 0.404] [lr 0.001819] [CE 3.768 (3.554)] [KD 0.000 (0.000)] 2024-10-12 07:44:00,494 - Train: 43.46% [163100/375300] [130.4/300.0] [batch_t 0.434 (0.451)] [data_t 0.016] [optim_t 0.419] [lr 0.001818] [CE 3.592 (3.557)] [KD 0.000 (0.000)] 2024-10-12 07:44:23,377 - Train: 43.47% [163150/375300] [130.4/300.0] [batch_t 0.378 (0.458)] [data_t 0.016] [optim_t 0.362] [lr 0.001817] [CE 3.485 (3.518)] [KD 0.000 (0.000)] 2024-10-12 07:44:45,345 - Train: 43.49% [163200/375300] [130.5/300.0] [batch_t 0.424 (0.439)] [data_t 0.016] [optim_t 0.408] [lr 0.001817] [CE 3.344 (3.602)] [KD 0.000 (0.000)] 2024-10-12 07:45:07,499 - Train: 43.50% [163250/375300] [130.5/300.0] [batch_t 0.440 (0.443)] [data_t 0.016] [optim_t 0.424] [lr 0.001816] [CE 3.558 (3.579)] [KD 0.000 (0.000)] 2024-10-12 07:45:29,417 - Train: 43.51% [163300/375300] [130.5/300.0] [batch_t 0.431 (0.438)] [data_t 0.015] [optim_t 0.415] [lr 0.001816] [CE 3.842 (3.634)] [KD 0.000 (0.000)] 2024-10-12 07:45:51,829 - Train: 43.53% [163350/375300] [130.6/300.0] [batch_t 0.330 (0.448)] [data_t 0.016] [optim_t 0.314] [lr 0.001815] [CE 3.720 (3.615)] [KD 0.000 (0.000)] 2024-10-12 07:46:14,100 - Train: 43.54% [163400/375300] [130.6/300.0] [batch_t 0.458 (0.445)] [data_t 0.015] [optim_t 0.442] [lr 0.001814] [CE 3.737 (3.566)] [KD 0.000 (0.000)] 2024-10-12 07:46:35,897 - Train: 43.55% [163450/375300] [130.7/300.0] [batch_t 0.439 (0.436)] [data_t 0.016] [optim_t 0.424] [lr 0.001814] [CE 3.236 (3.526)] [KD 0.000 (0.000)] 2024-10-12 07:46:57,567 - Train: 43.57% [163500/375300] [130.7/300.0] [batch_t 0.429 (0.433)] [data_t 0.016] [optim_t 0.413] [lr 0.001813] [CE 3.479 (3.610)] [KD 0.000 (0.000)] 2024-10-12 07:47:19,127 - Train: 43.58% [163550/375300] [130.7/300.0] [batch_t 0.473 (0.431)] [data_t 0.015] [optim_t 0.457] [lr 0.001813] [CE 3.640 (3.585)] [KD 0.000 (0.000)] 2024-10-12 07:47:41,115 - Train: 43.59% [163600/375300] [130.8/300.0] [batch_t 0.437 (0.440)] [data_t 0.015] [optim_t 0.422] [lr 0.001812] [CE 3.765 (3.579)] [KD 0.000 (0.000)] 2024-10-12 07:48:02,903 - Train: 43.61% [163650/375300] [130.8/300.0] [batch_t 0.413 (0.436)] [data_t 0.016] [optim_t 0.398] [lr 0.001811] [CE 3.644 (3.614)] [KD 0.000 (0.000)] 2024-10-12 07:48:24,843 - Train: 43.62% [163700/375300] [130.9/300.0] [batch_t 0.411 (0.439)] [data_t 0.015] [optim_t 0.396] [lr 0.001811] [CE 3.506 (3.574)] [KD 0.000 (0.000)] 2024-10-12 07:48:46,899 - Train: 43.63% [163750/375300] [130.9/300.0] [batch_t 0.467 (0.441)] [data_t 0.016] [optim_t 0.452] [lr 0.001810] [CE 3.492 (3.597)] [KD 0.000 (0.000)] 2024-10-12 07:49:09,313 - Train: 43.65% [163800/375300] [130.9/300.0] [batch_t 0.475 (0.448)] [data_t 0.176] [optim_t 0.299] [lr 0.001810] [CE 3.546 (3.583)] [KD 0.000 (0.000)] 2024-10-12 07:49:31,342 - Train: 43.66% [163850/375300] [131.0/300.0] [batch_t 0.389 (0.440)] [data_t 0.094] [optim_t 0.295] [lr 0.001809] [CE 3.751 (3.558)] [KD 0.000 (0.000)] 2024-10-12 07:49:43,417 - ==> Total time: 20:02:47 Eta: 1 day, 1:51:41 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 07:49:56,277 - Train: 43.67% [163900/375300] [131.0/300.0] [batch_t 0.316 (0.602)] [data_t 0.015] [optim_t 0.301] [lr 0.001808] [CE 3.590 (3.586)] [KD 0.000 (0.000)] 2024-10-12 07:50:18,128 - Train: 43.69% [163950/375300] [131.1/300.0] [batch_t 0.463 (0.437)] [data_t 0.016] [optim_t 0.448] [lr 0.001808] [CE 3.549 (3.552)] [KD 0.000 (0.000)] 2024-10-12 07:50:40,489 - Train: 43.70% [164000/375300] [131.1/300.0] [batch_t 0.431 (0.447)] [data_t 0.016] [optim_t 0.415] [lr 0.001807] [CE 3.784 (3.600)] [KD 0.000 (0.000)] 2024-10-12 07:51:02,247 - Train: 43.71% [164050/375300] [131.1/300.0] [batch_t 0.458 (0.435)] [data_t 0.015] [optim_t 0.443] [lr 0.001806] [CE 3.487 (3.524)] [KD 0.000 (0.000)] 2024-10-12 07:51:24,491 - Train: 43.73% [164100/375300] [131.2/300.0] [batch_t 0.442 (0.445)] [data_t 0.015] [optim_t 0.426] [lr 0.001806] [CE 3.456 (3.610)] [KD 0.000 (0.000)] 2024-10-12 07:51:46,636 - Train: 43.74% [164150/375300] [131.2/300.0] [batch_t 0.443 (0.443)] [data_t 0.016] [optim_t 0.428] [lr 0.001805] [CE 3.412 (3.591)] [KD 0.000 (0.000)] 2024-10-12 07:52:09,442 - Train: 43.75% [164200/375300] [131.3/300.0] [batch_t 0.429 (0.456)] [data_t 0.016] [optim_t 0.414] [lr 0.001805] [CE 3.617 (3.581)] [KD 0.000 (0.000)] 2024-10-12 07:52:31,395 - Train: 43.76% [164250/375300] [131.3/300.0] [batch_t 0.489 (0.439)] [data_t 0.016] [optim_t 0.473] [lr 0.001804] [CE 3.396 (3.542)] [KD 0.000 (0.000)] 2024-10-12 07:52:53,668 - Train: 43.78% [164300/375300] [131.3/300.0] [batch_t 0.440 (0.445)] [data_t 0.016] [optim_t 0.425] [lr 0.001803] [CE 3.556 (3.527)] [KD 0.000 (0.000)] 2024-10-12 07:53:15,754 - Train: 43.79% [164350/375300] [131.4/300.0] [batch_t 0.459 (0.442)] [data_t 0.015] [optim_t 0.444] [lr 0.001803] [CE 3.717 (3.624)] [KD 0.000 (0.000)] 2024-10-12 07:53:37,648 - Train: 43.80% [164400/375300] [131.4/300.0] [batch_t 0.360 (0.438)] [data_t 0.016] [optim_t 0.344] [lr 0.001802] [CE 3.753 (3.572)] [KD 0.000 (0.000)] 2024-10-12 07:54:00,017 - Train: 43.82% [164450/375300] [131.5/300.0] [batch_t 0.409 (0.447)] [data_t 0.015] [optim_t 0.394] [lr 0.001802] [CE 3.898 (3.573)] [KD 0.000 (0.000)] 2024-10-12 07:54:21,878 - Train: 43.83% [164500/375300] [131.5/300.0] [batch_t 0.422 (0.437)] [data_t 0.015] [optim_t 0.407] [lr 0.001801] [CE 3.385 (3.589)] [KD 0.000 (0.000)] 2024-10-12 07:54:43,573 - Train: 43.84% [164550/375300] [131.5/300.0] [batch_t 0.397 (0.434)] [data_t 0.015] [optim_t 0.381] [lr 0.001800] [CE 3.887 (3.612)] [KD 0.000 (0.000)] 2024-10-12 07:55:05,278 - Train: 43.86% [164600/375300] [131.6/300.0] [batch_t 0.430 (0.434)] [data_t 0.016] [optim_t 0.414] [lr 0.001800] [CE 3.406 (3.579)] [KD 0.000 (0.000)] 2024-10-12 07:55:26,444 - Train: 43.87% [164650/375300] [131.6/300.0] [batch_t 0.391 (0.423)] [data_t 0.016] [optim_t 0.376] [lr 0.001799] [CE 3.628 (3.609)] [KD 0.000 (0.000)] 2024-10-12 07:55:48,269 - Train: 43.88% [164700/375300] [131.7/300.0] [batch_t 0.491 (0.436)] [data_t 0.016] [optim_t 0.476] [lr 0.001799] [CE 3.329 (3.538)] [KD 0.000 (0.000)] 2024-10-12 07:56:10,277 - Train: 43.90% [164750/375300] [131.7/300.0] [batch_t 0.439 (0.440)] [data_t 0.016] [optim_t 0.423] [lr 0.001798] [CE 3.414 (3.607)] [KD 0.000 (0.000)] 2024-10-12 07:56:31,980 - Train: 43.91% [164800/375300] [131.7/300.0] [batch_t 0.444 (0.434)] [data_t 0.146] [optim_t 0.298] [lr 0.001797] [CE 3.385 (3.543)] [KD 0.000 (0.000)] 2024-10-12 07:56:54,387 - Train: 43.92% [164850/375300] [131.8/300.0] [batch_t 0.344 (0.448)] [data_t 0.048] [optim_t 0.296] [lr 0.001797] [CE 3.581 (3.575)] [KD 0.000 (0.000)] 2024-10-12 07:57:16,701 - Train: 43.94% [164900/375300] [131.8/300.0] [batch_t 0.426 (0.446)] [data_t 0.129] [optim_t 0.297] [lr 0.001796] [CE 3.634 (3.618)] [KD 0.000 (0.000)] 2024-10-12 07:57:39,156 - Train: 43.95% [164950/375300] [131.9/300.0] [batch_t 0.443 (0.449)] [data_t 0.141] [optim_t 0.301] [lr 0.001795] [CE 3.656 (3.569)] [KD 0.000 (0.000)] 2024-10-12 07:58:01,218 - Train: 43.96% [165000/375300] [131.9/300.0] [batch_t 0.409 (0.441)] [data_t 0.106] [optim_t 0.303] [lr 0.001795] [CE 3.315 (3.565)] [KD 0.000 (0.000)] 2024-10-12 07:58:23,713 - Train: 43.98% [165050/375300] [131.9/300.0] [batch_t 0.461 (0.450)] [data_t 0.160] [optim_t 0.301] [lr 0.001794] [CE 3.801 (3.602)] [KD 0.000 (0.000)] 2024-10-12 07:58:45,163 - Train: 43.99% [165100/375300] [132.0/300.0] [batch_t 0.385 (0.429)] [data_t 0.087] [optim_t 0.298] [lr 0.001794] [CE 3.501 (3.587)] [KD 0.000 (0.000)] 2024-10-12 07:58:57,901 - ==> Total time: 20:12:01 Eta: 1 day, 1:42:35 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 07:59:10,819 - Train: 44.00% [165150/375300] [132.0/300.0] [batch_t 0.317 (0.627)] [data_t 0.016] [optim_t 0.301] [lr 0.001793] [CE 3.448 (3.459)] [KD 0.000 (0.000)] 2024-10-12 07:59:32,617 - Train: 44.02% [165200/375300] [132.1/300.0] [batch_t 0.503 (0.436)] [data_t 0.209] [optim_t 0.294] [lr 0.001792] [CE 3.698 (3.572)] [KD 0.000 (0.000)] 2024-10-12 07:59:55,290 - Train: 44.03% [165250/375300] [132.1/300.0] [batch_t 0.459 (0.453)] [data_t 0.166] [optim_t 0.293] [lr 0.001792] [CE 3.775 (3.573)] [KD 0.000 (0.000)] 2024-10-12 08:00:18,047 - Train: 44.04% [165300/375300] [132.1/300.0] [batch_t 0.457 (0.455)] [data_t 0.163] [optim_t 0.294] [lr 0.001791] [CE 3.381 (3.573)] [KD 0.000 (0.000)] 2024-10-12 08:00:40,552 - Train: 44.06% [165350/375300] [132.2/300.0] [batch_t 0.487 (0.450)] [data_t 0.189] [optim_t 0.298] [lr 0.001791] [CE 3.396 (3.543)] [KD 0.000 (0.000)] 2024-10-12 08:01:02,032 - Train: 44.07% [165400/375300] [132.2/300.0] [batch_t 0.432 (0.429)] [data_t 0.134] [optim_t 0.297] [lr 0.001790] [CE 3.635 (3.590)] [KD 0.000 (0.000)] 2024-10-12 08:01:24,140 - Train: 44.08% [165450/375300] [132.3/300.0] [batch_t 0.489 (0.442)] [data_t 0.195] [optim_t 0.293] [lr 0.001789] [CE 3.380 (3.560)] [KD 0.000 (0.000)] 2024-10-12 08:01:46,198 - Train: 44.10% [165500/375300] [132.3/300.0] [batch_t 0.516 (0.441)] [data_t 0.221] [optim_t 0.295] [lr 0.001789] [CE 3.672 (3.556)] [KD 0.000 (0.000)] 2024-10-12 08:02:08,244 - Train: 44.11% [165550/375300] [132.3/300.0] [batch_t 0.434 (0.441)] [data_t 0.132] [optim_t 0.302] [lr 0.001788] [CE 3.736 (3.563)] [KD 0.000 (0.000)] 2024-10-12 08:02:30,247 - Train: 44.12% [165600/375300] [132.4/300.0] [batch_t 0.436 (0.440)] [data_t 0.142] [optim_t 0.294] [lr 0.001788] [CE 3.727 (3.601)] [KD 0.000 (0.000)] 2024-10-12 08:02:52,085 - Train: 44.14% [165650/375300] [132.4/300.0] [batch_t 0.450 (0.437)] [data_t 0.154] [optim_t 0.296] [lr 0.001787] [CE 3.407 (3.522)] [KD 0.000 (0.000)] 2024-10-12 08:03:13,174 - Train: 44.15% [165700/375300] [132.5/300.0] [batch_t 0.431 (0.422)] [data_t 0.135] [optim_t 0.295] [lr 0.001786] [CE 3.370 (3.568)] [KD 0.000 (0.000)] 2024-10-12 08:03:34,604 - Train: 44.16% [165750/375300] [132.5/300.0] [batch_t 0.463 (0.428)] [data_t 0.168] [optim_t 0.295] [lr 0.001786] [CE 3.685 (3.621)] [KD 0.000 (0.000)] 2024-10-12 08:03:56,381 - Train: 44.18% [165800/375300] [132.5/300.0] [batch_t 0.381 (0.435)] [data_t 0.088] [optim_t 0.293] [lr 0.001785] [CE 3.747 (3.598)] [KD 0.000 (0.000)] 2024-10-12 08:04:17,527 - Train: 44.19% [165850/375300] [132.6/300.0] [batch_t 0.424 (0.423)] [data_t 0.132] [optim_t 0.292] [lr 0.001785] [CE 3.692 (3.568)] [KD 0.000 (0.000)] 2024-10-12 08:04:38,996 - Train: 44.20% [165900/375300] [132.6/300.0] [batch_t 0.420 (0.429)] [data_t 0.016] [optim_t 0.404] [lr 0.001784] [CE 3.324 (3.544)] [KD 0.000 (0.000)] 2024-10-12 08:05:01,005 - Train: 44.22% [165950/375300] [132.7/300.0] [batch_t 0.446 (0.440)] [data_t 0.016] [optim_t 0.430] [lr 0.001783] [CE 3.557 (3.631)] [KD 0.000 (0.000)] 2024-10-12 08:05:22,513 - Train: 44.23% [166000/375300] [132.7/300.0] [batch_t 0.437 (0.430)] [data_t 0.016] [optim_t 0.421] [lr 0.001783] [CE 3.609 (3.583)] [KD 0.000 (0.000)] 2024-10-12 08:05:44,614 - Train: 44.24% [166050/375300] [132.7/300.0] [batch_t 0.392 (0.442)] [data_t 0.016] [optim_t 0.377] [lr 0.001782] [CE 3.482 (3.608)] [KD 0.000 (0.000)] 2024-10-12 08:06:06,535 - Train: 44.26% [166100/375300] [132.8/300.0] [batch_t 0.450 (0.438)] [data_t 0.016] [optim_t 0.434] [lr 0.001781] [CE 3.639 (3.534)] [KD 0.000 (0.000)] 2024-10-12 08:06:28,951 - Train: 44.27% [166150/375300] [132.8/300.0] [batch_t 0.328 (0.448)] [data_t 0.016] [optim_t 0.312] [lr 0.001781] [CE 3.462 (3.572)] [KD 0.000 (0.000)] 2024-10-12 08:06:50,313 - Train: 44.28% [166200/375300] [132.9/300.0] [batch_t 0.433 (0.427)] [data_t 0.016] [optim_t 0.418] [lr 0.001780] [CE 3.474 (3.548)] [KD 0.000 (0.000)] 2024-10-12 08:07:12,510 - Train: 44.30% [166250/375300] [132.9/300.0] [batch_t 0.415 (0.444)] [data_t 0.016] [optim_t 0.400] [lr 0.001780] [CE 3.781 (3.559)] [KD 0.000 (0.000)] 2024-10-12 08:07:34,527 - Train: 44.31% [166300/375300] [132.9/300.0] [batch_t 0.433 (0.440)] [data_t 0.016] [optim_t 0.417] [lr 0.001779] [CE 3.504 (3.581)] [KD 0.000 (0.000)] 2024-10-12 08:07:57,149 - Train: 44.32% [166350/375300] [133.0/300.0] [batch_t 0.817 (0.452)] [data_t 0.016] [optim_t 0.801] [lr 0.001778] [CE 3.739 (3.579)] [KD 0.000 (0.000)] 2024-10-12 08:08:09,422 - ==> Total time: 20:21:13 Eta: 1 day, 1:33:24 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 08:08:22,032 - Train: 44.34% [166400/375300] [133.0/300.0] [batch_t 0.312 (0.654)] [data_t 0.016] [optim_t 0.297] [lr 0.001778] [CE 3.509 (3.556)] [KD 0.000 (0.000)] 2024-10-12 08:08:43,953 - Train: 44.35% [166450/375300] [133.1/300.0] [batch_t 0.470 (0.438)] [data_t 0.097] [optim_t 0.373] [lr 0.001777] [CE 3.194 (3.510)] [KD 0.000 (0.000)] 2024-10-12 08:09:06,570 - Train: 44.36% [166500/375300] [133.1/300.0] [batch_t 0.504 (0.452)] [data_t 0.015] [optim_t 0.489] [lr 0.001777] [CE 3.468 (3.583)] [KD 0.000 (0.000)] 2024-10-12 08:09:28,456 - Train: 44.38% [166550/375300] [133.1/300.0] [batch_t 0.465 (0.438)] [data_t 0.015] [optim_t 0.449] [lr 0.001776] [CE 3.542 (3.598)] [KD 0.000 (0.000)] 2024-10-12 08:09:50,464 - Train: 44.39% [166600/375300] [133.2/300.0] [batch_t 0.393 (0.440)] [data_t 0.015] [optim_t 0.378] [lr 0.001775] [CE 3.233 (3.547)] [KD 0.000 (0.000)] 2024-10-12 08:10:12,051 - Train: 44.40% [166650/375300] [133.2/300.0] [batch_t 0.449 (0.432)] [data_t 0.016] [optim_t 0.434] [lr 0.001775] [CE 3.436 (3.563)] [KD 0.000 (0.000)] 2024-10-12 08:10:32,935 - Train: 44.42% [166700/375300] [133.3/300.0] [batch_t 0.393 (0.418)] [data_t 0.016] [optim_t 0.377] [lr 0.001774] [CE 3.772 (3.563)] [KD 0.000 (0.000)] 2024-10-12 08:10:54,508 - Train: 44.43% [166750/375300] [133.3/300.0] [batch_t 0.434 (0.431)] [data_t 0.016] [optim_t 0.418] [lr 0.001773] [CE 3.880 (3.551)] [KD 0.000 (0.000)] 2024-10-12 08:11:16,660 - Train: 44.44% [166800/375300] [133.3/300.0] [batch_t 0.612 (0.443)] [data_t 0.015] [optim_t 0.597] [lr 0.001773] [CE 3.794 (3.587)] [KD 0.000 (0.000)] 2024-10-12 08:11:38,222 - Train: 44.46% [166850/375300] [133.4/300.0] [batch_t 0.467 (0.431)] [data_t 0.016] [optim_t 0.451] [lr 0.001772] [CE 3.729 (3.547)] [KD 0.000 (0.000)] 2024-10-12 08:11:59,722 - Train: 44.47% [166900/375300] [133.4/300.0] [batch_t 0.419 (0.430)] [data_t 0.015] [optim_t 0.403] [lr 0.001772] [CE 3.480 (3.569)] [KD 0.000 (0.000)] 2024-10-12 08:12:20,828 - Train: 44.48% [166950/375300] [133.5/300.0] [batch_t 0.403 (0.422)] [data_t 0.016] [optim_t 0.387] [lr 0.001771] [CE 3.733 (3.516)] [KD 0.000 (0.000)] 2024-10-12 08:12:42,627 - Train: 44.50% [167000/375300] [133.5/300.0] [batch_t 0.511 (0.436)] [data_t 0.016] [optim_t 0.495] [lr 0.001770] [CE 3.609 (3.615)] [KD 0.000 (0.000)] 2024-10-12 08:13:04,050 - Train: 44.51% [167050/375300] [133.5/300.0] [batch_t 0.427 (0.428)] [data_t 0.015] [optim_t 0.412] [lr 0.001770] [CE 3.795 (3.605)] [KD 0.000 (0.000)] 2024-10-12 08:13:26,062 - Train: 44.52% [167100/375300] [133.6/300.0] [batch_t 0.460 (0.440)] [data_t 0.015] [optim_t 0.444] [lr 0.001769] [CE 3.221 (3.571)] [KD 0.000 (0.000)] 2024-10-12 08:13:47,806 - Train: 44.54% [167150/375300] [133.6/300.0] [batch_t 0.473 (0.435)] [data_t 0.015] [optim_t 0.458] [lr 0.001769] [CE 3.733 (3.578)] [KD 0.000 (0.000)] 2024-10-12 08:14:09,857 - Train: 44.55% [167200/375300] [133.7/300.0] [batch_t 0.487 (0.441)] [data_t 0.016] [optim_t 0.471] [lr 0.001768] [CE 3.693 (3.569)] [KD 0.000 (0.000)] 2024-10-12 08:14:31,522 - Train: 44.56% [167250/375300] [133.7/300.0] [batch_t 0.444 (0.433)] [data_t 0.015] [optim_t 0.429] [lr 0.001767] [CE 3.784 (3.590)] [KD 0.000 (0.000)] 2024-10-12 08:14:53,566 - Train: 44.58% [167300/375300] [133.7/300.0] [batch_t 0.438 (0.441)] [data_t 0.016] [optim_t 0.423] [lr 0.001767] [CE 3.393 (3.559)] [KD 0.000 (0.000)] 2024-10-12 08:15:15,811 - Train: 44.59% [167350/375300] [133.8/300.0] [batch_t 0.456 (0.445)] [data_t 0.016] [optim_t 0.440] [lr 0.001766] [CE 3.504 (3.585)] [KD 0.000 (0.000)] 2024-10-12 08:15:37,250 - Train: 44.60% [167400/375300] [133.8/300.0] [batch_t 0.422 (0.429)] [data_t 0.015] [optim_t 0.406] [lr 0.001766] [CE 3.661 (3.584)] [KD 0.000 (0.000)] 2024-10-12 08:15:59,250 - Train: 44.62% [167450/375300] [133.9/300.0] [batch_t 0.442 (0.440)] [data_t 0.015] [optim_t 0.426] [lr 0.001765] [CE 3.790 (3.605)] [KD 0.000 (0.000)] 2024-10-12 08:16:20,999 - Train: 44.63% [167500/375300] [133.9/300.0] [batch_t 0.411 (0.435)] [data_t 0.016] [optim_t 0.396] [lr 0.001764] [CE 3.560 (3.610)] [KD 0.000 (0.000)] 2024-10-12 08:16:43,031 - Train: 44.64% [167550/375300] [133.9/300.0] [batch_t 0.438 (0.440)] [data_t 0.016] [optim_t 0.423] [lr 0.001764] [CE 3.632 (3.593)] [KD 0.000 (0.000)] 2024-10-12 08:17:05,061 - Train: 44.66% [167600/375300] [134.0/300.0] [batch_t 0.441 (0.440)] [data_t 0.016] [optim_t 0.425] [lr 0.001763] [CE 3.618 (3.588)] [KD 0.000 (0.000)] 2024-10-12 08:17:18,785 - ==> Total time: 20:30:22 Eta: 1 day, 1:24:12 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 08:17:30,022 - Train: 44.67% [167650/375300] [134.0/300.0] [batch_t 0.317 (0.606)] [data_t 0.016] [optim_t 0.302] [lr 0.001762] [CE 3.405 (3.519)] [KD 0.000 (0.000)] 2024-10-12 08:17:51,886 - Train: 44.68% [167700/375300] [134.1/300.0] [batch_t 0.443 (0.437)] [data_t 0.147] [optim_t 0.296] [lr 0.001762] [CE 3.334 (3.494)] [KD 0.000 (0.000)] 2024-10-12 08:18:13,784 - Train: 44.70% [167750/375300] [134.1/300.0] [batch_t 0.580 (0.438)] [data_t 0.087] [optim_t 0.493] [lr 0.001761] [CE 3.547 (3.561)] [KD 0.000 (0.000)] 2024-10-12 08:18:36,041 - Train: 44.71% [167800/375300] [134.1/300.0] [batch_t 0.446 (0.445)] [data_t 0.147] [optim_t 0.298] [lr 0.001761] [CE 3.632 (3.563)] [KD 0.000 (0.000)] 2024-10-12 08:18:58,278 - Train: 44.72% [167850/375300] [134.2/300.0] [batch_t 0.438 (0.445)] [data_t 0.139] [optim_t 0.299] [lr 0.001760] [CE 3.637 (3.535)] [KD 0.000 (0.000)] 2024-10-12 08:19:20,813 - Train: 44.74% [167900/375300] [134.2/300.0] [batch_t 0.419 (0.451)] [data_t 0.125] [optim_t 0.295] [lr 0.001759] [CE 3.537 (3.522)] [KD 0.000 (0.000)] 2024-10-12 08:19:43,018 - Train: 44.75% [167950/375300] [134.3/300.0] [batch_t 0.503 (0.444)] [data_t 0.209] [optim_t 0.294] [lr 0.001759] [CE 3.655 (3.542)] [KD 0.000 (0.000)] 2024-10-12 08:20:04,718 - Train: 44.76% [168000/375300] [134.3/300.0] [batch_t 0.425 (0.434)] [data_t 0.129] [optim_t 0.296] [lr 0.001758] [CE 3.425 (3.583)] [KD 0.000 (0.000)] 2024-10-12 08:20:25,894 - Train: 44.78% [168050/375300] [134.3/300.0] [batch_t 0.419 (0.423)] [data_t 0.123] [optim_t 0.296] [lr 0.001758] [CE 3.460 (3.563)] [KD 0.000 (0.000)] 2024-10-12 08:20:46,992 - Train: 44.79% [168100/375300] [134.4/300.0] [batch_t 0.428 (0.422)] [data_t 0.131] [optim_t 0.297] [lr 0.001757] [CE 3.786 (3.539)] [KD 0.000 (0.000)] 2024-10-12 08:21:08,224 - Train: 44.80% [168150/375300] [134.4/300.0] [batch_t 0.400 (0.425)] [data_t 0.103] [optim_t 0.297] [lr 0.001756] [CE 3.623 (3.598)] [KD 0.000 (0.000)] 2024-10-12 08:21:29,263 - Train: 44.82% [168200/375300] [134.5/300.0] [batch_t 0.421 (0.421)] [data_t 0.125] [optim_t 0.295] [lr 0.001756] [CE 3.707 (3.536)] [KD 0.000 (0.000)] 2024-10-12 08:21:50,371 - Train: 44.83% [168250/375300] [134.5/300.0] [batch_t 0.422 (0.422)] [data_t 0.126] [optim_t 0.297] [lr 0.001755] [CE 3.722 (3.567)] [KD 0.000 (0.000)] 2024-10-12 08:22:12,687 - Train: 44.84% [168300/375300] [134.5/300.0] [batch_t 0.491 (0.446)] [data_t 0.016] [optim_t 0.476] [lr 0.001754] [CE 3.522 (3.592)] [KD 0.000 (0.000)] 2024-10-12 08:22:34,740 - Train: 44.86% [168350/375300] [134.6/300.0] [batch_t 0.321 (0.441)] [data_t 0.016] [optim_t 0.305] [lr 0.001754] [CE 2.918 (3.575)] [KD 0.000 (0.000)] 2024-10-12 08:22:56,606 - Train: 44.87% [168400/375300] [134.6/300.0] [batch_t 0.479 (0.437)] [data_t 0.016] [optim_t 0.463] [lr 0.001753] [CE 3.636 (3.592)] [KD 0.000 (0.000)] 2024-10-12 08:23:17,871 - Train: 44.88% [168450/375300] [134.7/300.0] [batch_t 0.420 (0.425)] [data_t 0.016] [optim_t 0.404] [lr 0.001753] [CE 3.738 (3.559)] [KD 0.000 (0.000)] 2024-10-12 08:23:40,204 - Train: 44.90% [168500/375300] [134.7/300.0] [batch_t 0.451 (0.446)] [data_t 0.016] [optim_t 0.435] [lr 0.001752] [CE 3.458 (3.566)] [KD 0.000 (0.000)] 2024-10-12 08:24:02,201 - Train: 44.91% [168550/375300] [134.7/300.0] [batch_t 0.412 (0.440)] [data_t 0.016] [optim_t 0.397] [lr 0.001751] [CE 3.446 (3.580)] [KD 0.000 (0.000)] 2024-10-12 08:24:24,298 - Train: 44.92% [168600/375300] [134.8/300.0] [batch_t 0.433 (0.442)] [data_t 0.016] [optim_t 0.417] [lr 0.001751] [CE 3.411 (3.560)] [KD 0.000 (0.000)] 2024-10-12 08:24:46,332 - Train: 44.94% [168650/375300] [134.8/300.0] [batch_t 0.400 (0.441)] [data_t 0.016] [optim_t 0.383] [lr 0.001750] [CE 3.342 (3.600)] [KD 0.000 (0.000)] 2024-10-12 08:25:08,395 - Train: 44.95% [168700/375300] [134.9/300.0] [batch_t 0.538 (0.441)] [data_t 0.016] [optim_t 0.523] [lr 0.001750] [CE 3.263 (3.521)] [KD 0.000 (0.000)] 2024-10-12 08:25:29,367 - Train: 44.96% [168750/375300] [134.9/300.0] [batch_t 0.437 (0.419)] [data_t 0.016] [optim_t 0.421] [lr 0.001749] [CE 3.935 (3.557)] [KD 0.000 (0.000)] 2024-10-12 08:25:50,850 - Train: 44.98% [168800/375300] [134.9/300.0] [batch_t 0.431 (0.430)] [data_t 0.015] [optim_t 0.416] [lr 0.001748] [CE 3.716 (3.534)] [KD 0.000 (0.000)] 2024-10-12 08:26:12,447 - Train: 44.99% [168850/375300] [135.0/300.0] [batch_t 0.423 (0.432)] [data_t 0.016] [optim_t 0.408] [lr 0.001748] [CE 3.790 (3.587)] [KD 0.000 (0.000)] 2024-10-12 08:26:47,703 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.431)] [top1_cnt 37024] [top5_cnt 46224] [top_all 50000] 2024-10-12 08:26:47,704 - net: 74.048 (92.448) 2024-10-12 08:27:09,701 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.433)] [top1_cnt 39462] [top5_cnt 47291] [top_all 50000] 2024-10-12 08:27:09,702 - net_E: 78.924 (94.582) 2024-10-12 08:27:09,848 - Max [top1: 74.048 (epoch: 135)] [top1-ema: 78.924 (epoch: 135)] 2024-10-12 08:27:09,848 - ==> Total time: 20:40:13 Eta: 1 day, 1:15:50 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 08:27:23,900 - Train: 45.00% [168900/375300] [135.0/300.0] [batch_t 0.315 (0.421)] [data_t 0.016] [optim_t 0.300] [lr 0.001747] [CE 3.532 (3.545)] [KD 0.000 (0.000)] 2024-10-12 08:27:44,779 - Train: 45.02% [168950/375300] [135.1/300.0] [batch_t 0.319 (0.417)] [data_t 0.016] [optim_t 0.303] [lr 0.001747] [CE 3.841 (3.568)] [KD 0.000 (0.000)] 2024-10-12 08:28:05,368 - Train: 45.03% [169000/375300] [135.1/300.0] [batch_t 0.399 (0.412)] [data_t 0.101] [optim_t 0.298] [lr 0.001746] [CE 3.475 (3.581)] [KD 0.000 (0.000)] 2024-10-12 08:28:27,868 - Train: 45.04% [169050/375300] [135.1/300.0] [batch_t 0.442 (0.450)] [data_t 0.015] [optim_t 0.426] [lr 0.001745] [CE 3.484 (3.564)] [KD 0.000 (0.000)] 2024-10-12 08:28:49,784 - Train: 45.06% [169100/375300] [135.2/300.0] [batch_t 0.413 (0.438)] [data_t 0.016] [optim_t 0.398] [lr 0.001745] [CE 3.486 (3.548)] [KD 0.000 (0.000)] 2024-10-12 08:29:11,316 - Train: 45.07% [169150/375300] [135.2/300.0] [batch_t 0.403 (0.431)] [data_t 0.015] [optim_t 0.388] [lr 0.001744] [CE 3.225 (3.517)] [KD 0.000 (0.000)] 2024-10-12 08:29:33,201 - Train: 45.08% [169200/375300] [135.3/300.0] [batch_t 0.473 (0.438)] [data_t 0.016] [optim_t 0.458] [lr 0.001743] [CE 3.754 (3.550)] [KD 0.000 (0.000)] 2024-10-12 08:29:55,380 - Train: 45.10% [169250/375300] [135.3/300.0] [batch_t 0.449 (0.443)] [data_t 0.016] [optim_t 0.433] [lr 0.001743] [CE 3.711 (3.526)] [KD 0.000 (0.000)] 2024-10-12 08:30:16,168 - Train: 45.11% [169300/375300] [135.3/300.0] [batch_t 0.402 (0.416)] [data_t 0.016] [optim_t 0.386] [lr 0.001742] [CE 3.752 (3.571)] [KD 0.000 (0.000)] 2024-10-12 08:30:37,672 - Train: 45.12% [169350/375300] [135.4/300.0] [batch_t 0.382 (0.430)] [data_t 0.016] [optim_t 0.366] [lr 0.001742] [CE 3.740 (3.564)] [KD 0.000 (0.000)] 2024-10-12 08:30:59,062 - Train: 45.14% [169400/375300] [135.4/300.0] [batch_t 0.428 (0.428)] [data_t 0.015] [optim_t 0.413] [lr 0.001741] [CE 3.548 (3.545)] [KD 0.000 (0.000)] 2024-10-12 08:31:21,192 - Train: 45.15% [169450/375300] [135.5/300.0] [batch_t 0.476 (0.443)] [data_t 0.015] [optim_t 0.460] [lr 0.001740] [CE 3.796 (3.527)] [KD 0.000 (0.000)] 2024-10-12 08:31:43,228 - Train: 45.16% [169500/375300] [135.5/300.0] [batch_t 0.357 (0.441)] [data_t 0.015] [optim_t 0.341] [lr 0.001740] [CE 3.577 (3.580)] [KD 0.000 (0.000)] 2024-10-12 08:32:05,464 - Train: 45.18% [169550/375300] [135.5/300.0] [batch_t 0.427 (0.445)] [data_t 0.015] [optim_t 0.412] [lr 0.001739] [CE 3.283 (3.557)] [KD 0.000 (0.000)] 2024-10-12 08:32:27,813 - Train: 45.19% [169600/375300] [135.6/300.0] [batch_t 0.410 (0.447)] [data_t 0.015] [optim_t 0.394] [lr 0.001739] [CE 3.764 (3.593)] [KD 0.000 (0.000)] 2024-10-12 08:32:50,208 - Train: 45.20% [169650/375300] [135.6/300.0] [batch_t 0.413 (0.448)] [data_t 0.016] [optim_t 0.397] [lr 0.001738] [CE 3.330 (3.527)] [KD 0.000 (0.000)] 2024-10-12 08:33:12,819 - Train: 45.22% [169700/375300] [135.7/300.0] [batch_t 0.450 (0.452)] [data_t 0.015] [optim_t 0.434] [lr 0.001737] [CE 3.571 (3.597)] [KD 0.000 (0.000)] 2024-10-12 08:33:35,463 - Train: 45.23% [169750/375300] [135.7/300.0] [batch_t 0.491 (0.453)] [data_t 0.015] [optim_t 0.476] [lr 0.001737] [CE 4.000 (3.584)] [KD 0.000 (0.000)] 2024-10-12 08:33:57,503 - Train: 45.24% [169800/375300] [135.7/300.0] [batch_t 0.448 (0.441)] [data_t 0.015] [optim_t 0.433] [lr 0.001736] [CE 3.613 (3.563)] [KD 0.000 (0.000)] 2024-10-12 08:34:19,456 - Train: 45.26% [169850/375300] [135.8/300.0] [batch_t 0.459 (0.439)] [data_t 0.016] [optim_t 0.443] [lr 0.001735] [CE 3.630 (3.582)] [KD 0.000 (0.000)] 2024-10-12 08:34:41,104 - Train: 45.27% [169900/375300] [135.8/300.0] [batch_t 0.461 (0.433)] [data_t 0.015] [optim_t 0.445] [lr 0.001735] [CE 3.523 (3.573)] [KD 0.000 (0.000)] 2024-10-12 08:35:03,618 - Train: 45.28% [169950/375300] [135.9/300.0] [batch_t 0.408 (0.450)] [data_t 0.015] [optim_t 0.393] [lr 0.001734] [CE 3.710 (3.586)] [KD 0.000 (0.000)] 2024-10-12 08:35:24,150 - Train: 45.30% [170000/375300] [135.9/300.0] [batch_t 0.387 (0.411)] [data_t 0.015] [optim_t 0.372] [lr 0.001734] [CE 3.365 (3.549)] [KD 0.000 (0.000)] 2024-10-12 08:35:45,553 - Train: 45.31% [170050/375300] [135.9/300.0] [batch_t 0.454 (0.428)] [data_t 0.015] [optim_t 0.438] [lr 0.001733] [CE 3.488 (3.572)] [KD 0.000 (0.000)] 2024-10-12 08:36:07,542 - Train: 45.32% [170100/375300] [136.0/300.0] [batch_t 0.376 (0.440)] [data_t 0.016] [optim_t 0.360] [lr 0.001732] [CE 3.577 (3.594)] [KD 0.000 (0.000)] 2024-10-12 08:36:21,236 - ==> Total time: 20:49:25 Eta: 1 day, 1:06:39 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 08:36:32,482 - Train: 45.34% [170150/375300] [136.0/300.0] [batch_t 0.314 (0.696)] [data_t 0.016] [optim_t 0.299] [lr 0.001732] [CE 3.565 (3.579)] [KD 0.000 (0.000)] 2024-10-12 08:36:54,757 - Train: 45.35% [170200/375300] [136.1/300.0] [batch_t 0.501 (0.445)] [data_t 0.016] [optim_t 0.486] [lr 0.001731] [CE 3.675 (3.567)] [KD 0.000 (0.000)] 2024-10-12 08:37:17,474 - Train: 45.36% [170250/375300] [136.1/300.0] [batch_t 0.469 (0.454)] [data_t 0.016] [optim_t 0.454] [lr 0.001731] [CE 3.163 (3.541)] [KD 0.000 (0.000)] 2024-10-12 08:37:39,932 - Train: 45.38% [170300/375300] [136.1/300.0] [batch_t 0.420 (0.449)] [data_t 0.016] [optim_t 0.405] [lr 0.001730] [CE 3.843 (3.539)] [KD 0.000 (0.000)] 2024-10-12 08:38:01,189 - Train: 45.39% [170350/375300] [136.2/300.0] [batch_t 0.376 (0.425)] [data_t 0.015] [optim_t 0.360] [lr 0.001729] [CE 3.881 (3.562)] [KD 0.000 (0.000)] 2024-10-12 08:38:22,452 - Train: 45.40% [170400/375300] [136.2/300.0] [batch_t 0.420 (0.425)] [data_t 0.016] [optim_t 0.404] [lr 0.001729] [CE 3.306 (3.565)] [KD 0.000 (0.000)] 2024-10-12 08:38:44,497 - Train: 45.42% [170450/375300] [136.3/300.0] [batch_t 0.458 (0.441)] [data_t 0.015] [optim_t 0.443] [lr 0.001728] [CE 3.467 (3.481)] [KD 0.000 (0.000)] 2024-10-12 08:39:07,286 - Train: 45.43% [170500/375300] [136.3/300.0] [batch_t 0.391 (0.456)] [data_t 0.016] [optim_t 0.375] [lr 0.001727] [CE 3.616 (3.542)] [KD 0.000 (0.000)] 2024-10-12 08:39:29,732 - Train: 45.44% [170550/375300] [136.3/300.0] [batch_t 0.471 (0.449)] [data_t 0.015] [optim_t 0.455] [lr 0.001727] [CE 3.127 (3.540)] [KD 0.000 (0.000)] 2024-10-12 08:39:52,011 - Train: 45.46% [170600/375300] [136.4/300.0] [batch_t 0.543 (0.445)] [data_t 0.016] [optim_t 0.528] [lr 0.001726] [CE 3.602 (3.575)] [KD 0.000 (0.000)] 2024-10-12 08:40:13,244 - Train: 45.47% [170650/375300] [136.4/300.0] [batch_t 0.421 (0.425)] [data_t 0.016] [optim_t 0.406] [lr 0.001726] [CE 3.598 (3.542)] [KD 0.000 (0.000)] 2024-10-12 08:40:34,898 - Train: 45.48% [170700/375300] [136.5/300.0] [batch_t 0.851 (0.433)] [data_t 0.016] [optim_t 0.835] [lr 0.001725] [CE 3.675 (3.559)] [KD 0.000 (0.000)] 2024-10-12 08:40:55,709 - Train: 45.50% [170750/375300] [136.5/300.0] [batch_t 0.397 (0.416)] [data_t 0.016] [optim_t 0.382] [lr 0.001724] [CE 3.631 (3.538)] [KD 0.000 (0.000)] 2024-10-12 08:41:17,591 - Train: 45.51% [170800/375300] [136.5/300.0] [batch_t 0.421 (0.438)] [data_t 0.016] [optim_t 0.406] [lr 0.001724] [CE 3.607 (3.584)] [KD 0.000 (0.000)] 2024-10-12 08:41:40,201 - Train: 45.52% [170850/375300] [136.6/300.0] [batch_t 0.449 (0.452)] [data_t 0.016] [optim_t 0.433] [lr 0.001723] [CE 3.302 (3.559)] [KD 0.000 (0.000)] 2024-10-12 08:42:02,566 - Train: 45.54% [170900/375300] [136.6/300.0] [batch_t 0.318 (0.447)] [data_t 0.016] [optim_t 0.302] [lr 0.001723] [CE 3.692 (3.531)] [KD 0.000 (0.000)] 2024-10-12 08:42:24,223 - Train: 45.55% [170950/375300] [136.7/300.0] [batch_t 0.480 (0.433)] [data_t 0.015] [optim_t 0.464] [lr 0.001722] [CE 3.426 (3.577)] [KD 0.000 (0.000)] 2024-10-12 08:42:45,426 - Train: 45.56% [171000/375300] [136.7/300.0] [batch_t 0.481 (0.424)] [data_t 0.015] [optim_t 0.465] [lr 0.001721] [CE 3.604 (3.568)] [KD 0.000 (0.000)] 2024-10-12 08:43:07,085 - Train: 45.58% [171050/375300] [136.7/300.0] [batch_t 0.357 (0.433)] [data_t 0.015] [optim_t 0.341] [lr 0.001721] [CE 3.374 (3.573)] [KD 0.000 (0.000)] 2024-10-12 08:43:28,693 - Train: 45.59% [171100/375300] [136.8/300.0] [batch_t 0.460 (0.432)] [data_t 0.015] [optim_t 0.445] [lr 0.001720] [CE 3.430 (3.565)] [KD 0.000 (0.000)] 2024-10-12 08:43:50,689 - Train: 45.60% [171150/375300] [136.8/300.0] [batch_t 0.315 (0.440)] [data_t 0.016] [optim_t 0.300] [lr 0.001719] [CE 3.371 (3.523)] [KD 0.000 (0.000)] 2024-10-12 08:44:12,165 - Train: 45.62% [171200/375300] [136.9/300.0] [batch_t 0.441 (0.429)] [data_t 0.016] [optim_t 0.426] [lr 0.001719] [CE 3.333 (3.567)] [KD 0.000 (0.000)] 2024-10-12 08:44:33,786 - Train: 45.63% [171250/375300] [136.9/300.0] [batch_t 0.465 (0.432)] [data_t 0.016] [optim_t 0.449] [lr 0.001718] [CE 3.627 (3.542)] [KD 0.000 (0.000)] 2024-10-12 08:44:55,761 - Train: 45.64% [171300/375300] [136.9/300.0] [batch_t 0.490 (0.439)] [data_t 0.016] [optim_t 0.474] [lr 0.001718] [CE 3.443 (3.539)] [KD 0.000 (0.000)] 2024-10-12 08:45:17,856 - Train: 45.66% [171350/375300] [137.0/300.0] [batch_t 0.396 (0.442)] [data_t 0.015] [optim_t 0.381] [lr 0.001717] [CE 3.346 (3.601)] [KD 0.000 (0.000)] 2024-10-12 08:45:32,666 - ==> Total time: 20:58:36 Eta: 1 day, 0:57:28 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 08:45:43,832 - Train: 45.67% [171400/375300] [137.0/300.0] [batch_t 0.318 (0.742)] [data_t 0.015] [optim_t 0.303] [lr 0.001716] [CE 3.408 (3.490)] [KD 0.000 (0.000)] 2024-10-12 08:46:05,489 - Train: 45.68% [171450/375300] [137.1/300.0] [batch_t 0.580 (0.433)] [data_t 0.015] [optim_t 0.564] [lr 0.001716] [CE 3.500 (3.564)] [KD 0.000 (0.000)] 2024-10-12 08:46:27,732 - Train: 45.70% [171500/375300] [137.1/300.0] [batch_t 0.513 (0.445)] [data_t 0.015] [optim_t 0.497] [lr 0.001715] [CE 3.664 (3.547)] [KD 0.000 (0.000)] 2024-10-12 08:46:49,473 - Train: 45.71% [171550/375300] [137.1/300.0] [batch_t 0.465 (0.435)] [data_t 0.016] [optim_t 0.449] [lr 0.001715] [CE 3.612 (3.504)] [KD 0.000 (0.000)] 2024-10-12 08:47:11,695 - Train: 45.72% [171600/375300] [137.2/300.0] [batch_t 0.493 (0.444)] [data_t 0.015] [optim_t 0.477] [lr 0.001714] [CE 3.355 (3.565)] [KD 0.000 (0.000)] 2024-10-12 08:47:34,645 - Train: 45.74% [171650/375300] [137.2/300.0] [batch_t 0.384 (0.459)] [data_t 0.015] [optim_t 0.369] [lr 0.001713] [CE 3.765 (3.508)] [KD 0.000 (0.000)] 2024-10-12 08:47:57,663 - Train: 45.75% [171700/375300] [137.3/300.0] [batch_t 0.468 (0.460)] [data_t 0.015] [optim_t 0.453] [lr 0.001713] [CE 3.532 (3.525)] [KD 0.000 (0.000)] 2024-10-12 08:48:19,706 - Train: 45.76% [171750/375300] [137.3/300.0] [batch_t 0.922 (0.441)] [data_t 0.015] [optim_t 0.906] [lr 0.001712] [CE 3.395 (3.530)] [KD 0.000 (0.000)] 2024-10-12 08:48:41,751 - Train: 45.78% [171800/375300] [137.3/300.0] [batch_t 0.459 (0.441)] [data_t 0.016] [optim_t 0.444] [lr 0.001711] [CE 3.390 (3.559)] [KD 0.000 (0.000)] 2024-10-12 08:49:04,008 - Train: 45.79% [171850/375300] [137.4/300.0] [batch_t 0.479 (0.445)] [data_t 0.016] [optim_t 0.463] [lr 0.001711] [CE 3.518 (3.548)] [KD 0.000 (0.000)] 2024-10-12 08:49:25,882 - Train: 45.80% [171900/375300] [137.4/300.0] [batch_t 0.533 (0.437)] [data_t 0.015] [optim_t 0.517] [lr 0.001710] [CE 3.575 (3.550)] [KD 0.000 (0.000)] 2024-10-12 08:49:47,512 - Train: 45.82% [171950/375300] [137.5/300.0] [batch_t 0.454 (0.432)] [data_t 0.016] [optim_t 0.438] [lr 0.001710] [CE 3.298 (3.545)] [KD 0.000 (0.000)] 2024-10-12 08:50:09,603 - Train: 45.83% [172000/375300] [137.5/300.0] [batch_t 0.436 (0.442)] [data_t 0.016] [optim_t 0.420] [lr 0.001709] [CE 2.989 (3.539)] [KD 0.000 (0.000)] 2024-10-12 08:50:31,633 - Train: 45.84% [172050/375300] [137.5/300.0] [batch_t 0.439 (0.440)] [data_t 0.016] [optim_t 0.423] [lr 0.001708] [CE 3.718 (3.586)] [KD 0.000 (0.000)] 2024-10-12 08:50:53,747 - Train: 45.86% [172100/375300] [137.6/300.0] [batch_t 0.406 (0.442)] [data_t 0.016] [optim_t 0.390] [lr 0.001708] [CE 3.408 (3.580)] [KD 0.000 (0.000)] 2024-10-12 08:51:16,010 - Train: 45.87% [172150/375300] [137.6/300.0] [batch_t 0.463 (0.445)] [data_t 0.016] [optim_t 0.447] [lr 0.001707] [CE 3.423 (3.532)] [KD 0.000 (0.000)] 2024-10-12 08:51:37,813 - Train: 45.88% [172200/375300] [137.6/300.0] [batch_t 0.556 (0.436)] [data_t 0.016] [optim_t 0.540] [lr 0.001707] [CE 3.613 (3.560)] [KD 0.000 (0.000)] 2024-10-12 08:51:59,404 - Train: 45.90% [172250/375300] [137.7/300.0] [batch_t 0.494 (0.432)] [data_t 0.016] [optim_t 0.478] [lr 0.001706] [CE 3.670 (3.549)] [KD 0.000 (0.000)] 2024-10-12 08:52:21,151 - Train: 45.91% [172300/375300] [137.7/300.0] [batch_t 0.406 (0.435)] [data_t 0.016] [optim_t 0.391] [lr 0.001705] [CE 3.437 (3.560)] [KD 0.000 (0.000)] 2024-10-12 08:52:42,579 - Train: 45.92% [172350/375300] [137.8/300.0] [batch_t 0.423 (0.428)] [data_t 0.016] [optim_t 0.408] [lr 0.001705] [CE 3.611 (3.571)] [KD 0.000 (0.000)] 2024-10-12 08:53:04,008 - Train: 45.94% [172400/375300] [137.8/300.0] [batch_t 0.408 (0.428)] [data_t 0.016] [optim_t 0.393] [lr 0.001704] [CE 3.420 (3.553)] [KD 0.000 (0.000)] 2024-10-12 08:53:26,116 - Train: 45.95% [172450/375300] [137.8/300.0] [batch_t 0.526 (0.442)] [data_t 0.016] [optim_t 0.511] [lr 0.001703] [CE 3.646 (3.564)] [KD 0.000 (0.000)] 2024-10-12 08:53:47,990 - Train: 45.96% [172500/375300] [137.9/300.0] [batch_t 0.403 (0.437)] [data_t 0.016] [optim_t 0.388] [lr 0.001703] [CE 3.277 (3.538)] [KD 0.000 (0.000)] 2024-10-12 08:54:09,450 - Train: 45.98% [172550/375300] [137.9/300.0] [batch_t 0.439 (0.429)] [data_t 0.016] [optim_t 0.424] [lr 0.001702] [CE 3.372 (3.592)] [KD 0.000 (0.000)] 2024-10-12 08:54:30,741 - Train: 45.99% [172600/375300] [138.0/300.0] [batch_t 0.394 (0.426)] [data_t 0.016] [optim_t 0.378] [lr 0.001702] [CE 3.450 (3.524)] [KD 0.000 (0.000)] 2024-10-12 08:54:46,230 - ==> Total time: 21:07:50 Eta: 1 day, 0:48:19 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 08:54:56,357 - Train: 46.00% [172650/375300] [138.0/300.0] [batch_t 0.311 (0.682)] [data_t 0.016] [optim_t 0.296] [lr 0.001701] [CE 3.483 (3.473)] [KD 0.000 (0.000)] 2024-10-12 08:55:17,428 - Train: 46.02% [172700/375300] [138.0/300.0] [batch_t 0.459 (0.421)] [data_t 0.016] [optim_t 0.443] [lr 0.001700] [CE 3.602 (3.534)] [KD 0.000 (0.000)] 2024-10-12 08:55:39,148 - Train: 46.03% [172750/375300] [138.1/300.0] [batch_t 0.484 (0.434)] [data_t 0.016] [optim_t 0.468] [lr 0.001700] [CE 3.787 (3.543)] [KD 0.000 (0.000)] 2024-10-12 08:56:00,969 - Train: 46.04% [172800/375300] [138.1/300.0] [batch_t 0.398 (0.436)] [data_t 0.016] [optim_t 0.382] [lr 0.001699] [CE 3.887 (3.525)] [KD 0.000 (0.000)] 2024-10-12 08:56:23,136 - Train: 46.06% [172850/375300] [138.2/300.0] [batch_t 0.470 (0.443)] [data_t 0.016] [optim_t 0.455] [lr 0.001699] [CE 3.779 (3.501)] [KD 0.000 (0.000)] 2024-10-12 08:56:45,093 - Train: 46.07% [172900/375300] [138.2/300.0] [batch_t 0.435 (0.439)] [data_t 0.015] [optim_t 0.420] [lr 0.001698] [CE 3.668 (3.551)] [KD 0.000 (0.000)] 2024-10-12 08:57:07,360 - Train: 46.08% [172950/375300] [138.2/300.0] [batch_t 0.416 (0.445)] [data_t 0.015] [optim_t 0.401] [lr 0.001697] [CE 3.392 (3.572)] [KD 0.000 (0.000)] 2024-10-12 08:57:28,402 - Train: 46.10% [173000/375300] [138.3/300.0] [batch_t 0.444 (0.421)] [data_t 0.016] [optim_t 0.428] [lr 0.001697] [CE 3.501 (3.542)] [KD 0.000 (0.000)] 2024-10-12 08:57:49,985 - Train: 46.11% [173050/375300] [138.3/300.0] [batch_t 0.429 (0.432)] [data_t 0.015] [optim_t 0.414] [lr 0.001696] [CE 3.504 (3.543)] [KD 0.000 (0.000)] 2024-10-12 08:58:11,282 - Train: 46.12% [173100/375300] [138.4/300.0] [batch_t 0.422 (0.426)] [data_t 0.016] [optim_t 0.407] [lr 0.001695] [CE 3.699 (3.539)] [KD 0.000 (0.000)] 2024-10-12 08:58:33,440 - Train: 46.14% [173150/375300] [138.4/300.0] [batch_t 0.894 (0.443)] [data_t 0.015] [optim_t 0.878] [lr 0.001695] [CE 3.421 (3.579)] [KD 0.000 (0.000)] 2024-10-12 08:58:54,008 - Train: 46.15% [173200/375300] [138.4/300.0] [batch_t 0.315 (0.411)] [data_t 0.016] [optim_t 0.300] [lr 0.001694] [CE 3.579 (3.500)] [KD 0.000 (0.000)] 2024-10-12 08:59:16,572 - Train: 46.16% [173250/375300] [138.5/300.0] [batch_t 0.519 (0.451)] [data_t 0.016] [optim_t 0.504] [lr 0.001694] [CE 3.315 (3.569)] [KD 0.000 (0.000)] 2024-10-12 08:59:39,660 - Train: 46.18% [173300/375300] [138.5/300.0] [batch_t 0.463 (0.462)] [data_t 0.016] [optim_t 0.447] [lr 0.001693] [CE 3.276 (3.610)] [KD 0.000 (0.000)] 2024-10-12 09:00:01,278 - Train: 46.19% [173350/375300] [138.6/300.0] [batch_t 0.412 (0.432)] [data_t 0.016] [optim_t 0.396] [lr 0.001692] [CE 3.535 (3.534)] [KD 0.000 (0.000)] 2024-10-12 09:00:23,175 - Train: 46.20% [173400/375300] [138.6/300.0] [batch_t 0.371 (0.438)] [data_t 0.015] [optim_t 0.356] [lr 0.001692] [CE 3.798 (3.593)] [KD 0.000 (0.000)] 2024-10-12 09:00:45,057 - Train: 46.22% [173450/375300] [138.6/300.0] [batch_t 0.472 (0.438)] [data_t 0.015] [optim_t 0.456] [lr 0.001691] [CE 3.304 (3.583)] [KD 0.000 (0.000)] 2024-10-12 09:01:06,663 - Train: 46.23% [173500/375300] [138.7/300.0] [batch_t 0.384 (0.432)] [data_t 0.015] [optim_t 0.368] [lr 0.001690] [CE 3.420 (3.586)] [KD 0.000 (0.000)] 2024-10-12 09:01:28,607 - Train: 46.24% [173550/375300] [138.7/300.0] [batch_t 0.423 (0.439)] [data_t 0.016] [optim_t 0.408] [lr 0.001690] [CE 3.828 (3.517)] [KD 0.000 (0.000)] 2024-10-12 09:01:50,011 - Train: 46.26% [173600/375300] [138.8/300.0] [batch_t 0.479 (0.428)] [data_t 0.015] [optim_t 0.463] [lr 0.001689] [CE 3.503 (3.524)] [KD 0.000 (0.000)] 2024-10-12 09:02:11,362 - Train: 46.27% [173650/375300] [138.8/300.0] [batch_t 0.372 (0.427)] [data_t 0.015] [optim_t 0.356] [lr 0.001689] [CE 3.522 (3.561)] [KD 0.000 (0.000)] 2024-10-12 09:02:32,936 - Train: 46.28% [173700/375300] [138.8/300.0] [batch_t 0.450 (0.431)] [data_t 0.016] [optim_t 0.435] [lr 0.001688] [CE 3.262 (3.563)] [KD 0.000 (0.000)] 2024-10-12 09:02:55,693 - Train: 46.30% [173750/375300] [138.9/300.0] [batch_t 0.418 (0.455)] [data_t 0.015] [optim_t 0.402] [lr 0.001687] [CE 3.460 (3.551)] [KD 0.000 (0.000)] 2024-10-12 09:03:17,329 - Train: 46.31% [173800/375300] [138.9/300.0] [batch_t 0.410 (0.433)] [data_t 0.016] [optim_t 0.394] [lr 0.001687] [CE 3.420 (3.605)] [KD 0.000 (0.000)] 2024-10-12 09:03:38,874 - Train: 46.32% [173850/375300] [139.0/300.0] [batch_t 0.445 (0.431)] [data_t 0.016] [optim_t 0.429] [lr 0.001686] [CE 3.681 (3.559)] [KD 0.000 (0.000)] 2024-10-12 09:03:54,748 - ==> Total time: 21:16:58 Eta: 1 day, 0:39:05 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 09:04:04,941 - Train: 46.34% [173900/375300] [139.0/300.0] [batch_t 0.317 (0.714)] [data_t 0.016] [optim_t 0.301] [lr 0.001686] [CE 3.679 (3.550)] [KD 0.000 (0.000)] 2024-10-12 09:04:25,386 - Train: 46.35% [173950/375300] [139.0/300.0] [batch_t 0.440 (0.409)] [data_t 0.144] [optim_t 0.296] [lr 0.001685] [CE 3.452 (3.513)] [KD 0.000 (0.000)] 2024-10-12 09:04:47,146 - Train: 46.36% [174000/375300] [139.1/300.0] [batch_t 0.466 (0.435)] [data_t 0.163] [optim_t 0.303] [lr 0.001684] [CE 3.571 (3.532)] [KD 0.000 (0.000)] 2024-10-12 09:05:08,295 - Train: 46.38% [174050/375300] [139.1/300.0] [batch_t 0.314 (0.423)] [data_t 0.016] [optim_t 0.299] [lr 0.001684] [CE 3.398 (3.530)] [KD 0.000 (0.000)] 2024-10-12 09:05:30,074 - Train: 46.39% [174100/375300] [139.2/300.0] [batch_t 0.408 (0.435)] [data_t 0.103] [optim_t 0.305] [lr 0.001683] [CE 3.938 (3.545)] [KD 0.000 (0.000)] 2024-10-12 09:05:51,143 - Train: 46.40% [174150/375300] [139.2/300.0] [batch_t 0.311 (0.421)] [data_t 0.016] [optim_t 0.296] [lr 0.001682] [CE 3.502 (3.548)] [KD 0.000 (0.000)] 2024-10-12 09:06:13,351 - Train: 46.42% [174200/375300] [139.2/300.0] [batch_t 0.391 (0.444)] [data_t 0.015] [optim_t 0.376] [lr 0.001682] [CE 3.553 (3.505)] [KD 0.000 (0.000)] 2024-10-12 09:06:35,380 - Train: 46.43% [174250/375300] [139.3/300.0] [batch_t 0.415 (0.440)] [data_t 0.016] [optim_t 0.399] [lr 0.001681] [CE 3.713 (3.524)] [KD 0.000 (0.000)] 2024-10-12 09:06:57,473 - Train: 46.44% [174300/375300] [139.3/300.0] [batch_t 0.442 (0.442)] [data_t 0.016] [optim_t 0.426] [lr 0.001681] [CE 3.540 (3.487)] [KD 0.000 (0.000)] 2024-10-12 09:07:19,423 - Train: 46.46% [174350/375300] [139.4/300.0] [batch_t 0.315 (0.439)] [data_t 0.016] [optim_t 0.299] [lr 0.001680] [CE 3.707 (3.541)] [KD 0.000 (0.000)] 2024-10-12 09:07:40,746 - Train: 46.47% [174400/375300] [139.4/300.0] [batch_t 0.325 (0.426)] [data_t 0.016] [optim_t 0.310] [lr 0.001679] [CE 3.599 (3.578)] [KD 0.000 (0.000)] 2024-10-12 09:08:02,128 - Train: 46.48% [174450/375300] [139.4/300.0] [batch_t 0.378 (0.427)] [data_t 0.016] [optim_t 0.363] [lr 0.001679] [CE 3.470 (3.559)] [KD 0.000 (0.000)] 2024-10-12 09:08:23,558 - Train: 46.50% [174500/375300] [139.5/300.0] [batch_t 0.482 (0.428)] [data_t 0.015] [optim_t 0.466] [lr 0.001678] [CE 3.601 (3.521)] [KD 0.000 (0.000)] 2024-10-12 09:08:44,919 - Train: 46.51% [174550/375300] [139.5/300.0] [batch_t 0.319 (0.427)] [data_t 0.016] [optim_t 0.303] [lr 0.001678] [CE 3.522 (3.546)] [KD 0.000 (0.000)] 2024-10-12 09:09:06,450 - Train: 46.52% [174600/375300] [139.6/300.0] [batch_t 0.515 (0.430)] [data_t 0.015] [optim_t 0.500] [lr 0.001677] [CE 3.382 (3.536)] [KD 0.000 (0.000)] 2024-10-12 09:09:28,210 - Train: 46.54% [174650/375300] [139.6/300.0] [batch_t 0.502 (0.435)] [data_t 0.016] [optim_t 0.487] [lr 0.001676] [CE 3.388 (3.522)] [KD 0.000 (0.000)] 2024-10-12 09:09:50,470 - Train: 46.55% [174700/375300] [139.6/300.0] [batch_t 0.459 (0.445)] [data_t 0.015] [optim_t 0.444] [lr 0.001676] [CE 3.637 (3.556)] [KD 0.000 (0.000)] 2024-10-12 09:10:12,956 - Train: 46.56% [174750/375300] [139.7/300.0] [batch_t 0.481 (0.450)] [data_t 0.016] [optim_t 0.465] [lr 0.001675] [CE 3.490 (3.518)] [KD 0.000 (0.000)] 2024-10-12 09:10:34,408 - Train: 46.58% [174800/375300] [139.7/300.0] [batch_t 0.471 (0.429)] [data_t 0.015] [optim_t 0.455] [lr 0.001674] [CE 3.464 (3.528)] [KD 0.000 (0.000)] 2024-10-12 09:10:56,314 - Train: 46.59% [174850/375300] [139.8/300.0] [batch_t 0.335 (0.438)] [data_t 0.016] [optim_t 0.319] [lr 0.001674] [CE 3.506 (3.539)] [KD 0.000 (0.000)] 2024-10-12 09:11:18,781 - Train: 46.60% [174900/375300] [139.8/300.0] [batch_t 0.443 (0.449)] [data_t 0.015] [optim_t 0.428] [lr 0.001673] [CE 3.957 (3.587)] [KD 0.000 (0.000)] 2024-10-12 09:11:41,363 - Train: 46.62% [174950/375300] [139.8/300.0] [batch_t 0.437 (0.452)] [data_t 0.015] [optim_t 0.421] [lr 0.001673] [CE 3.654 (3.560)] [KD 0.000 (0.000)] 2024-10-12 09:12:03,126 - Train: 46.63% [175000/375300] [139.9/300.0] [batch_t 0.477 (0.435)] [data_t 0.015] [optim_t 0.461] [lr 0.001672] [CE 3.681 (3.598)] [KD 0.000 (0.000)] 2024-10-12 09:12:24,615 - Train: 46.64% [175050/375300] [139.9/300.0] [batch_t 0.314 (0.430)] [data_t 0.015] [optim_t 0.299] [lr 0.001671] [CE 3.799 (3.579)] [KD 0.000 (0.000)] 2024-10-12 09:12:45,104 - Train: 46.66% [175100/375300] [140.0/300.0] [batch_t 0.413 (0.410)] [data_t 0.015] [optim_t 0.397] [lr 0.001671] [CE 3.374 (3.589)] [KD 0.000 (0.000)] 2024-10-12 09:13:22,950 - Test (net): 100.00% [50/50] [batch_t 0.134 (0.439)] [top1_cnt 37164] [top5_cnt 46200] [top_all 50000] 2024-10-12 09:13:22,950 - net: 74.328 (92.400) 2024-10-12 09:13:45,229 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.437)] [top1_cnt 39487] [top5_cnt 47363] [top_all 50000] 2024-10-12 09:13:45,230 - net_E: 78.974 (94.726) 2024-10-12 09:13:45,436 - Max [top1: 74.328 (epoch: 140)] [top1-ema: 78.974 (epoch: 140)] 2024-10-12 09:13:45,436 - ==> Total time: 21:26:49 Eta: 1 day, 0:30:39 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 09:13:56,547 - Train: 46.67% [175150/375300] [140.0/300.0] [batch_t 0.317 (0.565)] [data_t 0.016] [optim_t 0.301] [lr 0.001670] [CE 3.729 (3.514)] [KD 0.000 (0.000)] 2024-10-12 09:14:16,962 - Train: 46.68% [175200/375300] [140.0/300.0] [batch_t 0.404 (0.408)] [data_t 0.101] [optim_t 0.303] [lr 0.001669] [CE 3.457 (3.554)] [KD 0.000 (0.000)] 2024-10-12 09:14:39,226 - Train: 46.70% [175250/375300] [140.1/300.0] [batch_t 0.475 (0.445)] [data_t 0.016] [optim_t 0.459] [lr 0.001669] [CE 3.459 (3.477)] [KD 0.000 (0.000)] 2024-10-12 09:15:01,549 - Train: 46.71% [175300/375300] [140.1/300.0] [batch_t 0.438 (0.446)] [data_t 0.016] [optim_t 0.422] [lr 0.001668] [CE 3.568 (3.545)] [KD 0.000 (0.000)] 2024-10-12 09:15:22,747 - Train: 46.72% [175350/375300] [140.2/300.0] [batch_t 0.441 (0.424)] [data_t 0.135] [optim_t 0.306] [lr 0.001668] [CE 3.727 (3.566)] [KD 0.000 (0.000)] 2024-10-12 09:15:44,031 - Train: 46.74% [175400/375300] [140.2/300.0] [batch_t 0.380 (0.426)] [data_t 0.082] [optim_t 0.298] [lr 0.001667] [CE 3.535 (3.508)] [KD 0.000 (0.000)] 2024-10-12 09:16:06,049 - Train: 46.75% [175450/375300] [140.2/300.0] [batch_t 0.431 (0.440)] [data_t 0.016] [optim_t 0.415] [lr 0.001666] [CE 3.466 (3.496)] [KD 0.000 (0.000)] 2024-10-12 09:16:28,093 - Train: 46.76% [175500/375300] [140.3/300.0] [batch_t 0.444 (0.441)] [data_t 0.016] [optim_t 0.429] [lr 0.001666] [CE 3.777 (3.590)] [KD 0.000 (0.000)] 2024-10-12 09:16:50,039 - Train: 46.78% [175550/375300] [140.3/300.0] [batch_t 0.431 (0.439)] [data_t 0.015] [optim_t 0.416] [lr 0.001665] [CE 3.590 (3.581)] [KD 0.000 (0.000)] 2024-10-12 09:17:11,629 - Train: 46.79% [175600/375300] [140.4/300.0] [batch_t 0.363 (0.432)] [data_t 0.015] [optim_t 0.348] [lr 0.001665] [CE 3.474 (3.544)] [KD 0.000 (0.000)] 2024-10-12 09:17:33,192 - Train: 46.80% [175650/375300] [140.4/300.0] [batch_t 0.426 (0.431)] [data_t 0.016] [optim_t 0.410] [lr 0.001664] [CE 3.532 (3.498)] [KD 0.000 (0.000)] 2024-10-12 09:17:55,182 - Train: 46.82% [175700/375300] [140.4/300.0] [batch_t 0.380 (0.440)] [data_t 0.016] [optim_t 0.365] [lr 0.001663] [CE 3.565 (3.514)] [KD 0.000 (0.000)] 2024-10-12 09:18:16,744 - Train: 46.83% [175750/375300] [140.5/300.0] [batch_t 0.423 (0.431)] [data_t 0.016] [optim_t 0.407] [lr 0.001663] [CE 3.546 (3.528)] [KD 0.000 (0.000)] 2024-10-12 09:18:38,117 - Train: 46.84% [175800/375300] [140.5/300.0] [batch_t 0.419 (0.427)] [data_t 0.016] [optim_t 0.403] [lr 0.001662] [CE 3.533 (3.528)] [KD 0.000 (0.000)] 2024-10-12 09:18:59,775 - Train: 46.86% [175850/375300] [140.6/300.0] [batch_t 0.488 (0.433)] [data_t 0.015] [optim_t 0.472] [lr 0.001661] [CE 3.385 (3.537)] [KD 0.000 (0.000)] 2024-10-12 09:19:21,745 - Train: 46.87% [175900/375300] [140.6/300.0] [batch_t 0.461 (0.439)] [data_t 0.016] [optim_t 0.445] [lr 0.001661] [CE 3.658 (3.567)] [KD 0.000 (0.000)] 2024-10-12 09:19:43,193 - Train: 46.88% [175950/375300] [140.6/300.0] [batch_t 0.368 (0.429)] [data_t 0.016] [optim_t 0.353] [lr 0.001660] [CE 3.556 (3.506)] [KD 0.000 (0.000)] 2024-10-12 09:20:04,398 - Train: 46.90% [176000/375300] [140.7/300.0] [batch_t 0.407 (0.424)] [data_t 0.016] [optim_t 0.392] [lr 0.001660] [CE 3.415 (3.563)] [KD 0.000 (0.000)] 2024-10-12 09:20:26,682 - Train: 46.91% [176050/375300] [140.7/300.0] [batch_t 0.388 (0.446)] [data_t 0.016] [optim_t 0.372] [lr 0.001659] [CE 3.517 (3.575)] [KD 0.000 (0.000)] 2024-10-12 09:20:49,150 - Train: 46.92% [176100/375300] [140.8/300.0] [batch_t 0.372 (0.449)] [data_t 0.015] [optim_t 0.357] [lr 0.001658] [CE 3.808 (3.596)] [KD 0.000 (0.000)] 2024-10-12 09:21:11,471 - Train: 46.94% [176150/375300] [140.8/300.0] [batch_t 0.440 (0.446)] [data_t 0.015] [optim_t 0.424] [lr 0.001658] [CE 3.424 (3.577)] [KD 0.000 (0.000)] 2024-10-12 09:21:33,688 - Train: 46.95% [176200/375300] [140.8/300.0] [batch_t 0.492 (0.444)] [data_t 0.016] [optim_t 0.476] [lr 0.001657] [CE 3.358 (3.556)] [KD 0.000 (0.000)] 2024-10-12 09:21:55,198 - Train: 46.96% [176250/375300] [140.9/300.0] [batch_t 0.432 (0.430)] [data_t 0.016] [optim_t 0.417] [lr 0.001657] [CE 3.541 (3.521)] [KD 0.000 (0.000)] 2024-10-12 09:22:16,833 - Train: 46.98% [176300/375300] [140.9/300.0] [batch_t 0.503 (0.433)] [data_t 0.015] [optim_t 0.487] [lr 0.001656] [CE 3.358 (3.565)] [KD 0.000 (0.000)] 2024-10-12 09:22:38,966 - Train: 46.99% [176350/375300] [141.0/300.0] [batch_t 0.454 (0.443)] [data_t 0.016] [optim_t 0.438] [lr 0.001655] [CE 3.129 (3.575)] [KD 0.000 (0.000)] 2024-10-12 09:22:55,886 - ==> Total time: 21:35:59 Eta: 1 day, 0:21:26 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 09:23:05,377 - Train: 47.00% [176400/375300] [141.0/300.0] [batch_t 0.314 (0.870)] [data_t 0.016] [optim_t 0.298] [lr 0.001655] [CE 3.563 (3.535)] [KD 0.000 (0.000)] 2024-10-12 09:23:25,202 - Train: 47.02% [176450/375300] [141.0/300.0] [batch_t 0.313 (0.396)] [data_t 0.016] [optim_t 0.298] [lr 0.001654] [CE 3.430 (3.504)] [KD 0.000 (0.000)] 2024-10-12 09:23:46,616 - Train: 47.03% [176500/375300] [141.1/300.0] [batch_t 0.439 (0.428)] [data_t 0.016] [optim_t 0.423] [lr 0.001653] [CE 3.153 (3.497)] [KD 0.000 (0.000)] 2024-10-12 09:24:07,923 - Train: 47.04% [176550/375300] [141.1/300.0] [batch_t 0.408 (0.426)] [data_t 0.016] [optim_t 0.392] [lr 0.001653] [CE 3.534 (3.549)] [KD 0.000 (0.000)] 2024-10-12 09:24:28,905 - Train: 47.06% [176600/375300] [141.2/300.0] [batch_t 0.451 (0.420)] [data_t 0.016] [optim_t 0.435] [lr 0.001652] [CE 3.680 (3.528)] [KD 0.000 (0.000)] 2024-10-12 09:24:49,913 - Train: 47.07% [176650/375300] [141.2/300.0] [batch_t 0.397 (0.420)] [data_t 0.015] [optim_t 0.382] [lr 0.001652] [CE 3.701 (3.590)] [KD 0.000 (0.000)] 2024-10-12 09:25:11,343 - Train: 47.08% [176700/375300] [141.2/300.0] [batch_t 0.374 (0.428)] [data_t 0.015] [optim_t 0.359] [lr 0.001651] [CE 3.311 (3.581)] [KD 0.000 (0.000)] 2024-10-12 09:25:33,255 - Train: 47.10% [176750/375300] [141.3/300.0] [batch_t 0.488 (0.438)] [data_t 0.015] [optim_t 0.473] [lr 0.001650] [CE 3.575 (3.506)] [KD 0.000 (0.000)] 2024-10-12 09:25:54,993 - Train: 47.11% [176800/375300] [141.3/300.0] [batch_t 0.415 (0.435)] [data_t 0.016] [optim_t 0.400] [lr 0.001650] [CE 3.569 (3.513)] [KD 0.000 (0.000)] 2024-10-12 09:26:16,668 - Train: 47.12% [176850/375300] [141.4/300.0] [batch_t 0.376 (0.433)] [data_t 0.015] [optim_t 0.360] [lr 0.001649] [CE 3.521 (3.519)] [KD 0.000 (0.000)] 2024-10-12 09:26:37,844 - Train: 47.14% [176900/375300] [141.4/300.0] [batch_t 0.396 (0.423)] [data_t 0.015] [optim_t 0.381] [lr 0.001648] [CE 3.447 (3.506)] [KD 0.000 (0.000)] 2024-10-12 09:26:59,244 - Train: 47.15% [176950/375300] [141.4/300.0] [batch_t 0.464 (0.428)] [data_t 0.015] [optim_t 0.448] [lr 0.001648] [CE 3.565 (3.572)] [KD 0.000 (0.000)] 2024-10-12 09:27:20,170 - Train: 47.16% [177000/375300] [141.5/300.0] [batch_t 0.425 (0.418)] [data_t 0.016] [optim_t 0.410] [lr 0.001647] [CE 3.189 (3.538)] [KD 0.000 (0.000)] 2024-10-12 09:27:41,429 - Train: 47.18% [177050/375300] [141.5/300.0] [batch_t 0.457 (0.425)] [data_t 0.016] [optim_t 0.441] [lr 0.001647] [CE 3.440 (3.588)] [KD 0.000 (0.000)] 2024-10-12 09:28:03,116 - Train: 47.19% [177100/375300] [141.6/300.0] [batch_t 0.456 (0.434)] [data_t 0.016] [optim_t 0.440] [lr 0.001646] [CE 3.691 (3.552)] [KD 0.000 (0.000)] 2024-10-12 09:28:24,540 - Train: 47.20% [177150/375300] [141.6/300.0] [batch_t 0.479 (0.428)] [data_t 0.016] [optim_t 0.463] [lr 0.001645] [CE 3.817 (3.515)] [KD 0.000 (0.000)] 2024-10-12 09:28:46,248 - Train: 47.22% [177200/375300] [141.6/300.0] [batch_t 0.499 (0.434)] [data_t 0.016] [optim_t 0.483] [lr 0.001645] [CE 3.522 (3.535)] [KD 0.000 (0.000)] 2024-10-12 09:29:08,456 - Train: 47.23% [177250/375300] [141.7/300.0] [batch_t 0.463 (0.444)] [data_t 0.015] [optim_t 0.447] [lr 0.001644] [CE 3.807 (3.556)] [KD 0.000 (0.000)] 2024-10-12 09:29:30,384 - Train: 47.24% [177300/375300] [141.7/300.0] [batch_t 0.317 (0.438)] [data_t 0.016] [optim_t 0.302] [lr 0.001644] [CE 3.362 (3.493)] [KD 0.000 (0.000)] 2024-10-12 09:29:51,456 - Train: 47.26% [177350/375300] [141.8/300.0] [batch_t 0.481 (0.421)] [data_t 0.016] [optim_t 0.465] [lr 0.001643] [CE 3.751 (3.516)] [KD 0.000 (0.000)] 2024-10-12 09:30:12,884 - Train: 47.27% [177400/375300] [141.8/300.0] [batch_t 0.521 (0.428)] [data_t 0.016] [optim_t 0.506] [lr 0.001642] [CE 3.743 (3.540)] [KD 0.000 (0.000)] 2024-10-12 09:30:34,988 - Train: 47.28% [177450/375300] [141.8/300.0] [batch_t 0.404 (0.442)] [data_t 0.016] [optim_t 0.388] [lr 0.001642] [CE 3.639 (3.550)] [KD 0.000 (0.000)] 2024-10-12 09:30:56,974 - Train: 47.30% [177500/375300] [141.9/300.0] [batch_t 0.505 (0.440)] [data_t 0.016] [optim_t 0.489] [lr 0.001641] [CE 3.526 (3.532)] [KD 0.000 (0.000)] 2024-10-12 09:31:18,919 - Train: 47.31% [177550/375300] [141.9/300.0] [batch_t 0.555 (0.439)] [data_t 0.016] [optim_t 0.540] [lr 0.001640] [CE 3.497 (3.520)] [KD 0.000 (0.000)] 2024-10-12 09:31:41,210 - Train: 47.32% [177600/375300] [142.0/300.0] [batch_t 0.424 (0.446)] [data_t 0.016] [optim_t 0.408] [lr 0.001640] [CE 3.516 (3.539)] [KD 0.000 (0.000)] 2024-10-12 09:31:58,020 - ==> Total time: 21:45:01 Eta: 1 day, 0:12:04 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 09:32:07,026 - Train: 47.34% [177650/375300] [142.0/300.0] [batch_t 0.320 (0.942)] [data_t 0.015] [optim_t 0.304] [lr 0.001639] [CE 3.405 (3.497)] [KD 0.000 (0.000)] 2024-10-12 09:32:27,811 - Train: 47.35% [177700/375300] [142.0/300.0] [batch_t 0.466 (0.416)] [data_t 0.015] [optim_t 0.450] [lr 0.001639] [CE 3.506 (3.537)] [KD 0.000 (0.000)] 2024-10-12 09:32:50,201 - Train: 47.36% [177750/375300] [142.1/300.0] [batch_t 0.430 (0.448)] [data_t 0.015] [optim_t 0.414] [lr 0.001638] [CE 3.356 (3.494)] [KD 0.000 (0.000)] 2024-10-12 09:33:12,049 - Train: 47.38% [177800/375300] [142.1/300.0] [batch_t 0.315 (0.437)] [data_t 0.016] [optim_t 0.300] [lr 0.001637] [CE 3.039 (3.550)] [KD 0.000 (0.000)] 2024-10-12 09:33:33,669 - Train: 47.39% [177850/375300] [142.2/300.0] [batch_t 0.319 (0.432)] [data_t 0.016] [optim_t 0.304] [lr 0.001637] [CE 3.537 (3.528)] [KD 0.000 (0.000)] 2024-10-12 09:33:55,030 - Train: 47.40% [177900/375300] [142.2/300.0] [batch_t 0.508 (0.427)] [data_t 0.016] [optim_t 0.492] [lr 0.001636] [CE 3.775 (3.572)] [KD 0.000 (0.000)] 2024-10-12 09:34:17,226 - Train: 47.42% [177950/375300] [142.2/300.0] [batch_t 0.445 (0.444)] [data_t 0.015] [optim_t 0.429] [lr 0.001635] [CE 3.829 (3.489)] [KD 0.000 (0.000)] 2024-10-12 09:34:39,617 - Train: 47.43% [178000/375300] [142.3/300.0] [batch_t 0.450 (0.448)] [data_t 0.015] [optim_t 0.434] [lr 0.001635] [CE 3.932 (3.535)] [KD 0.000 (0.000)] 2024-10-12 09:35:01,870 - Train: 47.44% [178050/375300] [142.3/300.0] [batch_t 0.414 (0.445)] [data_t 0.015] [optim_t 0.399] [lr 0.001634] [CE 3.389 (3.543)] [KD 0.000 (0.000)] 2024-10-12 09:35:23,523 - Train: 47.46% [178100/375300] [142.4/300.0] [batch_t 0.409 (0.433)] [data_t 0.016] [optim_t 0.393] [lr 0.001634] [CE 3.651 (3.540)] [KD 0.000 (0.000)] 2024-10-12 09:35:45,215 - Train: 47.47% [178150/375300] [142.4/300.0] [batch_t 0.432 (0.434)] [data_t 0.016] [optim_t 0.417] [lr 0.001633] [CE 3.674 (3.531)] [KD 0.000 (0.000)] 2024-10-12 09:36:07,125 - Train: 47.48% [178200/375300] [142.4/300.0] [batch_t 0.456 (0.438)] [data_t 0.016] [optim_t 0.440] [lr 0.001632] [CE 3.640 (3.505)] [KD 0.000 (0.000)] 2024-10-12 09:36:28,987 - Train: 47.50% [178250/375300] [142.5/300.0] [batch_t 0.404 (0.437)] [data_t 0.016] [optim_t 0.389] [lr 0.001632] [CE 3.582 (3.526)] [KD 0.000 (0.000)] 2024-10-12 09:36:50,693 - Train: 47.51% [178300/375300] [142.5/300.0] [batch_t 0.434 (0.434)] [data_t 0.016] [optim_t 0.418] [lr 0.001631] [CE 3.318 (3.556)] [KD 0.000 (0.000)] 2024-10-12 09:37:11,961 - Train: 47.52% [178350/375300] [142.6/300.0] [batch_t 0.348 (0.425)] [data_t 0.016] [optim_t 0.333] [lr 0.001631] [CE 3.594 (3.511)] [KD 0.000 (0.000)] 2024-10-12 09:37:33,682 - Train: 47.54% [178400/375300] [142.6/300.0] [batch_t 0.494 (0.434)] [data_t 0.015] [optim_t 0.478] [lr 0.001630] [CE 3.642 (3.519)] [KD 0.000 (0.000)] 2024-10-12 09:37:54,950 - Train: 47.55% [178450/375300] [142.6/300.0] [batch_t 0.322 (0.425)] [data_t 0.015] [optim_t 0.307] [lr 0.001629] [CE 3.529 (3.551)] [KD 0.000 (0.000)] 2024-10-12 09:38:16,894 - Train: 47.56% [178500/375300] [142.7/300.0] [batch_t 0.365 (0.439)] [data_t 0.015] [optim_t 0.350] [lr 0.001629] [CE 3.621 (3.575)] [KD 0.000 (0.000)] 2024-10-12 09:38:38,606 - Train: 47.58% [178550/375300] [142.7/300.0] [batch_t 0.454 (0.434)] [data_t 0.015] [optim_t 0.439] [lr 0.001628] [CE 3.527 (3.561)] [KD 0.000 (0.000)] 2024-10-12 09:39:01,047 - Train: 47.59% [178600/375300] [142.8/300.0] [batch_t 0.447 (0.449)] [data_t 0.015] [optim_t 0.431] [lr 0.001627] [CE 3.405 (3.511)] [KD 0.000 (0.000)] 2024-10-12 09:39:21,735 - Train: 47.60% [178650/375300] [142.8/300.0] [batch_t 0.446 (0.414)] [data_t 0.016] [optim_t 0.430] [lr 0.001627] [CE 3.597 (3.539)] [KD 0.000 (0.000)] 2024-10-12 09:39:43,929 - Train: 47.62% [178700/375300] [142.8/300.0] [batch_t 0.459 (0.444)] [data_t 0.016] [optim_t 0.443] [lr 0.001626] [CE 3.505 (3.476)] [KD 0.000 (0.000)] 2024-10-12 09:40:06,286 - Train: 47.63% [178750/375300] [142.9/300.0] [batch_t 0.433 (0.447)] [data_t 0.016] [optim_t 0.417] [lr 0.001626] [CE 3.644 (3.562)] [KD 0.000 (0.000)] 2024-10-12 09:40:28,030 - Train: 47.64% [178800/375300] [142.9/300.0] [batch_t 0.319 (0.435)] [data_t 0.016] [optim_t 0.303] [lr 0.001625] [CE 3.179 (3.580)] [KD 0.000 (0.000)] 2024-10-12 09:40:49,143 - Train: 47.66% [178850/375300] [143.0/300.0] [batch_t 0.398 (0.422)] [data_t 0.015] [optim_t 0.382] [lr 0.001624] [CE 3.200 (3.561)] [KD 0.000 (0.000)] 2024-10-12 09:41:06,123 - ==> Total time: 21:54:10 Eta: 1 day, 0:02:49 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 09:41:15,503 - Train: 47.67% [178900/375300] [143.0/300.0] [batch_t 0.315 (1.121)] [data_t 0.015] [optim_t 0.300] [lr 0.001624] [CE 3.589 (3.585)] [KD 0.000 (0.000)] 2024-10-12 09:41:35,002 - Train: 47.68% [178950/375300] [143.0/300.0] [batch_t 0.462 (0.390)] [data_t 0.015] [optim_t 0.447] [lr 0.001623] [CE 3.362 (3.512)] [KD 0.000 (0.000)] 2024-10-12 09:41:56,460 - Train: 47.70% [179000/375300] [143.1/300.0] [batch_t 0.423 (0.429)] [data_t 0.016] [optim_t 0.407] [lr 0.001622] [CE 3.743 (3.521)] [KD 0.000 (0.000)] 2024-10-12 09:42:18,107 - Train: 47.71% [179050/375300] [143.1/300.0] [batch_t 0.419 (0.433)] [data_t 0.126] [optim_t 0.293] [lr 0.001622] [CE 3.434 (3.530)] [KD 0.000 (0.000)] 2024-10-12 09:42:39,879 - Train: 47.72% [179100/375300] [143.2/300.0] [batch_t 0.434 (0.435)] [data_t 0.140] [optim_t 0.294] [lr 0.001621] [CE 3.645 (3.544)] [KD 0.000 (0.000)] 2024-10-12 09:43:01,391 - Train: 47.74% [179150/375300] [143.2/300.0] [batch_t 0.387 (0.430)] [data_t 0.095] [optim_t 0.292] [lr 0.001621] [CE 3.321 (3.554)] [KD 0.000 (0.000)] 2024-10-12 09:43:22,720 - Train: 47.75% [179200/375300] [143.2/300.0] [batch_t 0.432 (0.426)] [data_t 0.140] [optim_t 0.292] [lr 0.001620] [CE 3.524 (3.496)] [KD 0.000 (0.000)] 2024-10-12 09:43:44,591 - Train: 47.76% [179250/375300] [143.3/300.0] [batch_t 0.412 (0.437)] [data_t 0.015] [optim_t 0.397] [lr 0.001619] [CE 3.644 (3.527)] [KD 0.000 (0.000)] 2024-10-12 09:44:06,301 - Train: 47.78% [179300/375300] [143.3/300.0] [batch_t 0.397 (0.434)] [data_t 0.102] [optim_t 0.295] [lr 0.001619] [CE 3.515 (3.498)] [KD 0.000 (0.000)] 2024-10-12 09:44:28,148 - Train: 47.79% [179350/375300] [143.4/300.0] [batch_t 0.398 (0.437)] [data_t 0.104] [optim_t 0.294] [lr 0.001618] [CE 3.880 (3.552)] [KD 0.000 (0.000)] 2024-10-12 09:44:49,694 - Train: 47.80% [179400/375300] [143.4/300.0] [batch_t 0.427 (0.431)] [data_t 0.128] [optim_t 0.299] [lr 0.001617] [CE 3.562 (3.563)] [KD 0.000 (0.000)] 2024-10-12 09:45:11,737 - Train: 47.82% [179450/375300] [143.4/300.0] [batch_t 0.461 (0.441)] [data_t 0.165] [optim_t 0.296] [lr 0.001617] [CE 3.668 (3.518)] [KD 0.000 (0.000)] 2024-10-12 09:45:34,374 - Train: 47.83% [179500/375300] [143.5/300.0] [batch_t 0.487 (0.453)] [data_t 0.016] [optim_t 0.471] [lr 0.001616] [CE 3.510 (3.517)] [KD 0.000 (0.000)] 2024-10-12 09:45:57,199 - Train: 47.84% [179550/375300] [143.5/300.0] [batch_t 0.353 (0.456)] [data_t 0.016] [optim_t 0.337] [lr 0.001616] [CE 3.466 (3.531)] [KD 0.000 (0.000)] 2024-10-12 09:46:19,179 - Train: 47.86% [179600/375300] [143.6/300.0] [batch_t 0.389 (0.439)] [data_t 0.016] [optim_t 0.373] [lr 0.001615] [CE 3.134 (3.523)] [KD 0.000 (0.000)] 2024-10-12 09:46:40,387 - Train: 47.87% [179650/375300] [143.6/300.0] [batch_t 0.434 (0.424)] [data_t 0.015] [optim_t 0.419] [lr 0.001614] [CE 3.747 (3.536)] [KD 0.000 (0.000)] 2024-10-12 09:47:01,934 - Train: 47.88% [179700/375300] [143.6/300.0] [batch_t 0.429 (0.431)] [data_t 0.016] [optim_t 0.413] [lr 0.001614] [CE 3.547 (3.545)] [KD 0.000 (0.000)] 2024-10-12 09:47:23,036 - Train: 47.90% [179750/375300] [143.7/300.0] [batch_t 0.390 (0.422)] [data_t 0.016] [optim_t 0.374] [lr 0.001613] [CE 3.570 (3.558)] [KD 0.000 (0.000)] 2024-10-12 09:47:45,131 - Train: 47.91% [179800/375300] [143.7/300.0] [batch_t 0.377 (0.442)] [data_t 0.081] [optim_t 0.296] [lr 0.001613] [CE 3.740 (3.502)] [KD 0.000 (0.000)] 2024-10-12 09:48:07,137 - Train: 47.92% [179850/375300] [143.8/300.0] [batch_t 0.417 (0.440)] [data_t 0.122] [optim_t 0.295] [lr 0.001612] [CE 3.636 (3.520)] [KD 0.000 (0.000)] 2024-10-12 09:48:29,995 - Train: 47.93% [179900/375300] [143.8/300.0] [batch_t 0.436 (0.457)] [data_t 0.016] [optim_t 0.421] [lr 0.001611] [CE 3.493 (3.517)] [KD 0.000 (0.000)] 2024-10-12 09:48:52,417 - Train: 47.95% [179950/375300] [143.8/300.0] [batch_t 0.397 (0.448)] [data_t 0.015] [optim_t 0.382] [lr 0.001611] [CE 3.397 (3.528)] [KD 0.000 (0.000)] 2024-10-12 09:49:12,968 - Train: 47.96% [180000/375300] [143.9/300.0] [batch_t 0.406 (0.411)] [data_t 0.015] [optim_t 0.390] [lr 0.001610] [CE 3.820 (3.581)] [KD 0.000 (0.000)] 2024-10-12 09:49:34,342 - Train: 47.97% [180050/375300] [143.9/300.0] [batch_t 0.455 (0.427)] [data_t 0.015] [optim_t 0.440] [lr 0.001609] [CE 3.543 (3.557)] [KD 0.000 (0.000)] 2024-10-12 09:49:56,782 - Train: 47.99% [180100/375300] [144.0/300.0] [batch_t 0.464 (0.449)] [data_t 0.016] [optim_t 0.449] [lr 0.001609] [CE 3.654 (3.546)] [KD 0.000 (0.000)] 2024-10-12 09:50:14,205 - ==> Total time: 22:03:18 Eta: 23:53:34 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 09:50:23,009 - Train: 48.00% [180150/375300] [144.0/300.0] [batch_t 0.312 (1.228)] [data_t 0.015] [optim_t 0.296] [lr 0.001608] [CE 3.623 (3.502)] [KD 0.000 (0.000)] 2024-10-12 09:50:42,767 - Train: 48.01% [180200/375300] [144.0/300.0] [batch_t 0.311 (0.395)] [data_t 0.016] [optim_t 0.296] [lr 0.001608] [CE 3.681 (3.520)] [KD 0.000 (0.000)] 2024-10-12 09:51:05,559 - Train: 48.03% [180250/375300] [144.1/300.0] [batch_t 0.482 (0.456)] [data_t 0.016] [optim_t 0.466] [lr 0.001607] [CE 3.606 (3.547)] [KD 0.000 (0.000)] 2024-10-12 09:51:27,248 - Train: 48.04% [180300/375300] [144.1/300.0] [batch_t 0.414 (0.434)] [data_t 0.016] [optim_t 0.399] [lr 0.001606] [CE 3.567 (3.526)] [KD 0.000 (0.000)] 2024-10-12 09:51:48,437 - Train: 48.05% [180350/375300] [144.2/300.0] [batch_t 0.430 (0.424)] [data_t 0.016] [optim_t 0.414] [lr 0.001606] [CE 3.889 (3.490)] [KD 0.000 (0.000)] 2024-10-12 09:52:10,066 - Train: 48.07% [180400/375300] [144.2/300.0] [batch_t 0.388 (0.432)] [data_t 0.016] [optim_t 0.372] [lr 0.001605] [CE 3.458 (3.528)] [KD 0.000 (0.000)] 2024-10-12 09:52:32,047 - Train: 48.08% [180450/375300] [144.2/300.0] [batch_t 0.595 (0.440)] [data_t 0.016] [optim_t 0.579] [lr 0.001604] [CE 3.697 (3.530)] [KD 0.000 (0.000)] 2024-10-12 09:52:53,614 - Train: 48.09% [180500/375300] [144.3/300.0] [batch_t 0.406 (0.431)] [data_t 0.016] [optim_t 0.390] [lr 0.001604] [CE 3.572 (3.542)] [KD 0.000 (0.000)] 2024-10-12 09:53:15,715 - Train: 48.11% [180550/375300] [144.3/300.0] [batch_t 0.439 (0.442)] [data_t 0.015] [optim_t 0.424] [lr 0.001603] [CE 3.346 (3.506)] [KD 0.000 (0.000)] 2024-10-12 09:53:38,435 - Train: 48.12% [180600/375300] [144.4/300.0] [batch_t 0.425 (0.454)] [data_t 0.016] [optim_t 0.410] [lr 0.001603] [CE 3.475 (3.512)] [KD 0.000 (0.000)] 2024-10-12 09:54:00,713 - Train: 48.13% [180650/375300] [144.4/300.0] [batch_t 0.508 (0.445)] [data_t 0.015] [optim_t 0.493] [lr 0.001602] [CE 3.340 (3.552)] [KD 0.000 (0.000)] 2024-10-12 09:54:22,839 - Train: 48.15% [180700/375300] [144.4/300.0] [batch_t 0.431 (0.442)] [data_t 0.016] [optim_t 0.415] [lr 0.001601] [CE 3.674 (3.524)] [KD 0.000 (0.000)] 2024-10-12 09:54:45,015 - Train: 48.16% [180750/375300] [144.5/300.0] [batch_t 0.475 (0.443)] [data_t 0.015] [optim_t 0.460] [lr 0.001601] [CE 3.882 (3.510)] [KD 0.000 (0.000)] 2024-10-12 09:55:06,875 - Train: 48.17% [180800/375300] [144.5/300.0] [batch_t 0.407 (0.437)] [data_t 0.016] [optim_t 0.390] [lr 0.001600] [CE 3.657 (3.552)] [KD 0.000 (0.000)] 2024-10-12 09:55:29,158 - Train: 48.19% [180850/375300] [144.6/300.0] [batch_t 0.500 (0.446)] [data_t 0.015] [optim_t 0.484] [lr 0.001599] [CE 3.517 (3.534)] [KD 0.000 (0.000)] 2024-10-12 09:55:50,967 - Train: 48.20% [180900/375300] [144.6/300.0] [batch_t 0.444 (0.436)] [data_t 0.016] [optim_t 0.429] [lr 0.001599] [CE 3.667 (3.507)] [KD 0.000 (0.000)] 2024-10-12 09:56:12,941 - Train: 48.21% [180950/375300] [144.6/300.0] [batch_t 0.431 (0.439)] [data_t 0.015] [optim_t 0.415] [lr 0.001598] [CE 3.863 (3.501)] [KD 0.000 (0.000)] 2024-10-12 09:56:35,054 - Train: 48.23% [181000/375300] [144.7/300.0] [batch_t 0.412 (0.442)] [data_t 0.016] [optim_t 0.396] [lr 0.001598] [CE 3.693 (3.506)] [KD 0.000 (0.000)] 2024-10-12 09:56:57,351 - Train: 48.24% [181050/375300] [144.7/300.0] [batch_t 0.365 (0.446)] [data_t 0.016] [optim_t 0.349] [lr 0.001597] [CE 3.670 (3.568)] [KD 0.000 (0.000)] 2024-10-12 09:57:19,251 - Train: 48.25% [181100/375300] [144.8/300.0] [batch_t 0.337 (0.438)] [data_t 0.016] [optim_t 0.322] [lr 0.001596] [CE 3.467 (3.557)] [KD 0.000 (0.000)] 2024-10-12 09:57:40,856 - Train: 48.27% [181150/375300] [144.8/300.0] [batch_t 0.493 (0.432)] [data_t 0.016] [optim_t 0.477] [lr 0.001596] [CE 3.320 (3.534)] [KD 0.000 (0.000)] 2024-10-12 09:58:03,263 - Train: 48.28% [181200/375300] [144.8/300.0] [batch_t 0.503 (0.448)] [data_t 0.015] [optim_t 0.488] [lr 0.001595] [CE 3.552 (3.542)] [KD 0.000 (0.000)] 2024-10-12 09:58:26,143 - Train: 48.29% [181250/375300] [144.9/300.0] [batch_t 0.514 (0.457)] [data_t 0.015] [optim_t 0.499] [lr 0.001595] [CE 3.312 (3.553)] [KD 0.000 (0.000)] 2024-10-12 09:58:48,711 - Train: 48.31% [181300/375300] [144.9/300.0] [batch_t 0.430 (0.451)] [data_t 0.016] [optim_t 0.414] [lr 0.001594] [CE 3.649 (3.543)] [KD 0.000 (0.000)] 2024-10-12 09:59:11,089 - Train: 48.32% [181350/375300] [145.0/300.0] [batch_t 0.412 (0.447)] [data_t 0.015] [optim_t 0.397] [lr 0.001593] [CE 3.471 (3.560)] [KD 0.000 (0.000)] 2024-10-12 09:59:51,931 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.453)] [top1_cnt 37244] [top5_cnt 46318] [top_all 50000] 2024-10-12 09:59:51,932 - net: 74.488 (92.636) 2024-10-12 10:00:14,854 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.449)] [top1_cnt 39541] [top5_cnt 47361] [top_all 50000] 2024-10-12 10:00:14,854 - net_E: 79.082 (94.722) 2024-10-12 10:00:15,098 - Max [top1: 74.488 (epoch: 145)] [top1-ema: 79.082 (epoch: 145)] 2024-10-12 10:00:15,099 - ==> Total time: 22:13:19 Eta: 23:45:16 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 10:00:25,153 - Train: 48.33% [181400/375300] [145.0/300.0] [batch_t 0.313 (0.787)] [data_t 0.015] [optim_t 0.297] [lr 0.001593] [CE 3.202 (3.448)] [KD 0.000 (0.000)] 2024-10-12 10:00:44,467 - Train: 48.35% [181450/375300] [145.0/300.0] [batch_t 0.405 (0.386)] [data_t 0.015] [optim_t 0.389] [lr 0.001592] [CE 3.577 (3.540)] [KD 0.000 (0.000)] 2024-10-12 10:01:06,663 - Train: 48.36% [181500/375300] [145.1/300.0] [batch_t 0.409 (0.444)] [data_t 0.015] [optim_t 0.393] [lr 0.001591] [CE 3.678 (3.507)] [KD 0.000 (0.000)] 2024-10-12 10:01:28,957 - Train: 48.37% [181550/375300] [145.1/300.0] [batch_t 0.439 (0.446)] [data_t 0.016] [optim_t 0.423] [lr 0.001591] [CE 3.505 (3.561)] [KD 0.000 (0.000)] 2024-10-12 10:01:50,846 - Train: 48.39% [181600/375300] [145.2/300.0] [batch_t 0.403 (0.438)] [data_t 0.016] [optim_t 0.387] [lr 0.001590] [CE 3.501 (3.515)] [KD 0.000 (0.000)] 2024-10-12 10:02:12,598 - Train: 48.40% [181650/375300] [145.2/300.0] [batch_t 0.307 (0.435)] [data_t 0.016] [optim_t 0.292] [lr 0.001590] [CE 3.420 (3.555)] [KD 0.000 (0.000)] 2024-10-12 10:02:33,672 - Train: 48.41% [181700/375300] [145.2/300.0] [batch_t 0.417 (0.421)] [data_t 0.015] [optim_t 0.402] [lr 0.001589] [CE 3.425 (3.531)] [KD 0.000 (0.000)] 2024-10-12 10:02:54,973 - Train: 48.43% [181750/375300] [145.3/300.0] [batch_t 0.462 (0.426)] [data_t 0.016] [optim_t 0.446] [lr 0.001588] [CE 3.620 (3.500)] [KD 0.000 (0.000)] 2024-10-12 10:03:16,296 - Train: 48.44% [181800/375300] [145.3/300.0] [batch_t 0.424 (0.426)] [data_t 0.015] [optim_t 0.409] [lr 0.001588] [CE 3.782 (3.505)] [KD 0.000 (0.000)] 2024-10-12 10:03:38,146 - Train: 48.45% [181850/375300] [145.4/300.0] [batch_t 0.364 (0.437)] [data_t 0.016] [optim_t 0.349] [lr 0.001587] [CE 3.783 (3.548)] [KD 0.000 (0.000)] 2024-10-12 10:03:59,535 - Train: 48.47% [181900/375300] [145.4/300.0] [batch_t 0.476 (0.428)] [data_t 0.016] [optim_t 0.461] [lr 0.001586] [CE 3.521 (3.514)] [KD 0.000 (0.000)] 2024-10-12 10:04:20,966 - Train: 48.48% [181950/375300] [145.4/300.0] [batch_t 0.406 (0.428)] [data_t 0.016] [optim_t 0.391] [lr 0.001586] [CE 3.650 (3.545)] [KD 0.000 (0.000)] 2024-10-12 10:04:42,338 - Train: 48.49% [182000/375300] [145.5/300.0] [batch_t 0.405 (0.427)] [data_t 0.015] [optim_t 0.389] [lr 0.001585] [CE 3.128 (3.511)] [KD 0.000 (0.000)] 2024-10-12 10:05:03,551 - Train: 48.51% [182050/375300] [145.5/300.0] [batch_t 0.389 (0.424)] [data_t 0.015] [optim_t 0.374] [lr 0.001585] [CE 3.193 (3.547)] [KD 0.000 (0.000)] 2024-10-12 10:05:24,568 - Train: 48.52% [182100/375300] [145.6/300.0] [batch_t 0.413 (0.420)] [data_t 0.016] [optim_t 0.397] [lr 0.001584] [CE 3.585 (3.536)] [KD 0.000 (0.000)] 2024-10-12 10:05:45,887 - Train: 48.53% [182150/375300] [145.6/300.0] [batch_t 0.314 (0.426)] [data_t 0.015] [optim_t 0.299] [lr 0.001583] [CE 3.239 (3.519)] [KD 0.000 (0.000)] 2024-10-12 10:06:07,588 - Train: 48.55% [182200/375300] [145.6/300.0] [batch_t 0.408 (0.434)] [data_t 0.015] [optim_t 0.393] [lr 0.001583] [CE 3.725 (3.505)] [KD 0.000 (0.000)] 2024-10-12 10:06:28,930 - Train: 48.56% [182250/375300] [145.7/300.0] [batch_t 0.458 (0.427)] [data_t 0.015] [optim_t 0.443] [lr 0.001582] [CE 4.028 (3.526)] [KD 0.000 (0.000)] 2024-10-12 10:06:50,889 - Train: 48.57% [182300/375300] [145.7/300.0] [batch_t 0.387 (0.439)] [data_t 0.092] [optim_t 0.296] [lr 0.001581] [CE 3.506 (3.554)] [KD 0.000 (0.000)] 2024-10-12 10:07:12,620 - Train: 48.59% [182350/375300] [145.8/300.0] [batch_t 0.404 (0.435)] [data_t 0.111] [optim_t 0.294] [lr 0.001581] [CE 3.618 (3.526)] [KD 0.000 (0.000)] 2024-10-12 10:07:34,691 - Train: 48.60% [182400/375300] [145.8/300.0] [batch_t 0.456 (0.441)] [data_t 0.161] [optim_t 0.295] [lr 0.001580] [CE 3.845 (3.542)] [KD 0.000 (0.000)] 2024-10-12 10:07:56,561 - Train: 48.61% [182450/375300] [145.8/300.0] [batch_t 0.442 (0.437)] [data_t 0.148] [optim_t 0.294] [lr 0.001580] [CE 3.475 (3.488)] [KD 0.000 (0.000)] 2024-10-12 10:08:18,515 - Train: 48.63% [182500/375300] [145.9/300.0] [batch_t 0.396 (0.439)] [data_t 0.100] [optim_t 0.296] [lr 0.001579] [CE 3.275 (3.574)] [KD 0.000 (0.000)] 2024-10-12 10:08:40,416 - Train: 48.64% [182550/375300] [145.9/300.0] [batch_t 0.393 (0.438)] [data_t 0.096] [optim_t 0.296] [lr 0.001578] [CE 3.524 (3.540)] [KD 0.000 (0.000)] 2024-10-12 10:09:01,768 - Train: 48.65% [182600/375300] [146.0/300.0] [batch_t 0.402 (0.427)] [data_t 0.015] [optim_t 0.387] [lr 0.001578] [CE 3.579 (3.496)] [KD 0.000 (0.000)] 2024-10-12 10:09:19,923 - ==> Total time: 22:22:23 Eta: 23:35:57 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 10:09:27,661 - Train: 48.67% [182650/375300] [146.0/300.0] [batch_t 0.308 (1.566)] [data_t 0.015] [optim_t 0.292] [lr 0.001577] [CE 3.446 (3.536)] [KD 0.000 (0.000)] 2024-10-12 10:09:47,324 - Train: 48.68% [182700/375300] [146.0/300.0] [batch_t 0.423 (0.393)] [data_t 0.015] [optim_t 0.407] [lr 0.001577] [CE 3.813 (3.467)] [KD 0.000 (0.000)] 2024-10-12 10:10:08,533 - Train: 48.69% [182750/375300] [146.1/300.0] [batch_t 0.349 (0.424)] [data_t 0.015] [optim_t 0.334] [lr 0.001576] [CE 3.648 (3.528)] [KD 0.000 (0.000)] 2024-10-12 10:10:30,332 - Train: 48.71% [182800/375300] [146.1/300.0] [batch_t 0.416 (0.436)] [data_t 0.015] [optim_t 0.400] [lr 0.001575] [CE 3.513 (3.495)] [KD 0.000 (0.000)] 2024-10-12 10:10:51,999 - Train: 48.72% [182850/375300] [146.2/300.0] [batch_t 0.379 (0.433)] [data_t 0.016] [optim_t 0.364] [lr 0.001575] [CE 3.475 (3.485)] [KD 0.000 (0.000)] 2024-10-12 10:11:13,600 - Train: 48.73% [182900/375300] [146.2/300.0] [batch_t 0.436 (0.432)] [data_t 0.016] [optim_t 0.421] [lr 0.001574] [CE 3.370 (3.505)] [KD 0.000 (0.000)] 2024-10-12 10:11:35,400 - Train: 48.75% [182950/375300] [146.2/300.0] [batch_t 0.311 (0.436)] [data_t 0.016] [optim_t 0.296] [lr 0.001573] [CE 3.512 (3.516)] [KD 0.000 (0.000)] 2024-10-12 10:11:57,554 - Train: 48.76% [183000/375300] [146.3/300.0] [batch_t 0.408 (0.443)] [data_t 0.015] [optim_t 0.393] [lr 0.001573] [CE 3.467 (3.524)] [KD 0.000 (0.000)] 2024-10-12 10:12:19,298 - Train: 48.77% [183050/375300] [146.3/300.0] [batch_t 0.441 (0.435)] [data_t 0.015] [optim_t 0.425] [lr 0.001572] [CE 3.390 (3.532)] [KD 0.000 (0.000)] 2024-10-12 10:12:41,013 - Train: 48.79% [183100/375300] [146.4/300.0] [batch_t 0.382 (0.434)] [data_t 0.015] [optim_t 0.367] [lr 0.001572] [CE 3.563 (3.531)] [KD 0.000 (0.000)] 2024-10-12 10:13:02,530 - Train: 48.80% [183150/375300] [146.4/300.0] [batch_t 0.418 (0.430)] [data_t 0.015] [optim_t 0.402] [lr 0.001571] [CE 3.773 (3.513)] [KD 0.000 (0.000)] 2024-10-12 10:13:24,355 - Train: 48.81% [183200/375300] [146.4/300.0] [batch_t 0.388 (0.436)] [data_t 0.015] [optim_t 0.373] [lr 0.001570] [CE 3.174 (3.545)] [KD 0.000 (0.000)] 2024-10-12 10:13:46,178 - Train: 48.83% [183250/375300] [146.5/300.0] [batch_t 0.484 (0.436)] [data_t 0.016] [optim_t 0.468] [lr 0.001570] [CE 3.505 (3.539)] [KD 0.000 (0.000)] 2024-10-12 10:14:07,789 - Train: 48.84% [183300/375300] [146.5/300.0] [batch_t 0.310 (0.432)] [data_t 0.016] [optim_t 0.295] [lr 0.001569] [CE 3.681 (3.559)] [KD 0.000 (0.000)] 2024-10-12 10:14:29,814 - Train: 48.85% [183350/375300] [146.6/300.0] [batch_t 0.354 (0.440)] [data_t 0.016] [optim_t 0.338] [lr 0.001568] [CE 3.764 (3.544)] [KD 0.000 (0.000)] 2024-10-12 10:14:51,491 - Train: 48.87% [183400/375300] [146.6/300.0] [batch_t 0.315 (0.433)] [data_t 0.015] [optim_t 0.299] [lr 0.001568] [CE 3.738 (3.526)] [KD 0.000 (0.000)] 2024-10-12 10:15:13,744 - Train: 48.88% [183450/375300] [146.6/300.0] [batch_t 0.512 (0.445)] [data_t 0.015] [optim_t 0.496] [lr 0.001567] [CE 3.534 (3.498)] [KD 0.000 (0.000)] 2024-10-12 10:15:35,640 - Train: 48.89% [183500/375300] [146.7/300.0] [batch_t 0.355 (0.438)] [data_t 0.016] [optim_t 0.339] [lr 0.001567] [CE 3.478 (3.546)] [KD 0.000 (0.000)] 2024-10-12 10:15:57,518 - Train: 48.91% [183550/375300] [146.7/300.0] [batch_t 0.387 (0.437)] [data_t 0.015] [optim_t 0.372] [lr 0.001566] [CE 3.487 (3.500)] [KD 0.000 (0.000)] 2024-10-12 10:16:19,485 - Train: 48.92% [183600/375300] [146.8/300.0] [batch_t 0.321 (0.439)] [data_t 0.015] [optim_t 0.306] [lr 0.001565] [CE 3.460 (3.502)] [KD 0.000 (0.000)] 2024-10-12 10:16:40,913 - Train: 48.93% [183650/375300] [146.8/300.0] [batch_t 0.490 (0.428)] [data_t 0.015] [optim_t 0.475] [lr 0.001565] [CE 3.333 (3.529)] [KD 0.000 (0.000)] 2024-10-12 10:17:02,886 - Train: 48.95% [183700/375300] [146.8/300.0] [batch_t 0.417 (0.439)] [data_t 0.016] [optim_t 0.402] [lr 0.001564] [CE 3.538 (3.595)] [KD 0.000 (0.000)] 2024-10-12 10:17:25,312 - Train: 48.96% [183750/375300] [146.9/300.0] [batch_t 0.535 (0.448)] [data_t 0.016] [optim_t 0.519] [lr 0.001563] [CE 3.678 (3.500)] [KD 0.000 (0.000)] 2024-10-12 10:17:47,407 - Train: 48.97% [183800/375300] [146.9/300.0] [batch_t 0.477 (0.442)] [data_t 0.015] [optim_t 0.462] [lr 0.001563] [CE 3.425 (3.498)] [KD 0.000 (0.000)] 2024-10-12 10:18:09,222 - Train: 48.99% [183850/375300] [147.0/300.0] [batch_t 0.385 (0.436)] [data_t 0.015] [optim_t 0.370] [lr 0.001562] [CE 3.531 (3.495)] [KD 0.000 (0.000)] 2024-10-12 10:18:28,406 - ==> Total time: 22:31:32 Eta: 23:26:42 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 10:18:34,938 - Train: 49.00% [183900/375300] [147.0/300.0] [batch_t 0.308 (1.716)] [data_t 0.016] [optim_t 0.292] [lr 0.001562] [CE 3.087 (3.428)] [KD 0.000 (0.000)] 2024-10-12 10:18:56,136 - Train: 49.01% [183950/375300] [147.0/300.0] [batch_t 0.542 (0.424)] [data_t 0.248] [optim_t 0.294] [lr 0.001561] [CE 3.674 (3.474)] [KD 0.000 (0.000)] 2024-10-12 10:19:18,368 - Train: 49.03% [184000/375300] [147.1/300.0] [batch_t 0.311 (0.445)] [data_t 0.016] [optim_t 0.296] [lr 0.001560] [CE 3.643 (3.503)] [KD 0.000 (0.000)] 2024-10-12 10:19:40,760 - Train: 49.04% [184050/375300] [147.1/300.0] [batch_t 0.413 (0.448)] [data_t 0.015] [optim_t 0.398] [lr 0.001560] [CE 3.552 (3.516)] [KD 0.000 (0.000)] 2024-10-12 10:20:03,103 - Train: 49.05% [184100/375300] [147.2/300.0] [batch_t 0.495 (0.447)] [data_t 0.016] [optim_t 0.480] [lr 0.001559] [CE 3.618 (3.532)] [KD 0.000 (0.000)] 2024-10-12 10:20:25,107 - Train: 49.07% [184150/375300] [147.2/300.0] [batch_t 0.510 (0.440)] [data_t 0.015] [optim_t 0.494] [lr 0.001559] [CE 3.583 (3.523)] [KD 0.000 (0.000)] 2024-10-12 10:20:46,373 - Train: 49.08% [184200/375300] [147.2/300.0] [batch_t 0.418 (0.425)] [data_t 0.015] [optim_t 0.403] [lr 0.001558] [CE 3.751 (3.478)] [KD 0.000 (0.000)] 2024-10-12 10:21:08,503 - Train: 49.09% [184250/375300] [147.3/300.0] [batch_t 0.311 (0.442)] [data_t 0.016] [optim_t 0.296] [lr 0.001557] [CE 3.522 (3.513)] [KD 0.000 (0.000)] 2024-10-12 10:21:30,484 - Train: 49.11% [184300/375300] [147.3/300.0] [batch_t 0.363 (0.440)] [data_t 0.066] [optim_t 0.297] [lr 0.001557] [CE 3.180 (3.498)] [KD 0.000 (0.000)] 2024-10-12 10:21:52,154 - Train: 49.12% [184350/375300] [147.4/300.0] [batch_t 0.315 (0.433)] [data_t 0.015] [optim_t 0.300] [lr 0.001556] [CE 3.688 (3.516)] [KD 0.000 (0.000)] 2024-10-12 10:22:14,693 - Train: 49.13% [184400/375300] [147.4/300.0] [batch_t 0.493 (0.451)] [data_t 0.016] [optim_t 0.477] [lr 0.001555] [CE 3.716 (3.511)] [KD 0.000 (0.000)] 2024-10-12 10:22:36,912 - Train: 49.15% [184450/375300] [147.4/300.0] [batch_t 0.481 (0.444)] [data_t 0.015] [optim_t 0.465] [lr 0.001555] [CE 3.630 (3.505)] [KD 0.000 (0.000)] 2024-10-12 10:22:58,356 - Train: 49.16% [184500/375300] [147.5/300.0] [batch_t 0.478 (0.429)] [data_t 0.016] [optim_t 0.462] [lr 0.001554] [CE 3.771 (3.548)] [KD 0.000 (0.000)] 2024-10-12 10:23:19,738 - Train: 49.17% [184550/375300] [147.5/300.0] [batch_t 0.464 (0.428)] [data_t 0.016] [optim_t 0.448] [lr 0.001554] [CE 3.179 (3.501)] [KD 0.000 (0.000)] 2024-10-12 10:23:41,930 - Train: 49.19% [184600/375300] [147.6/300.0] [batch_t 0.466 (0.444)] [data_t 0.133] [optim_t 0.333] [lr 0.001553] [CE 3.648 (3.498)] [KD 0.000 (0.000)] 2024-10-12 10:24:04,334 - Train: 49.20% [184650/375300] [147.6/300.0] [batch_t 0.412 (0.448)] [data_t 0.118] [optim_t 0.293] [lr 0.001552] [CE 3.554 (3.499)] [KD 0.000 (0.000)] 2024-10-12 10:24:26,720 - Train: 49.21% [184700/375300] [147.6/300.0] [batch_t 0.476 (0.448)] [data_t 0.175] [optim_t 0.301] [lr 0.001552] [CE 3.489 (3.544)] [KD 0.000 (0.000)] 2024-10-12 10:24:48,906 - Train: 49.23% [184750/375300] [147.7/300.0] [batch_t 0.409 (0.444)] [data_t 0.112] [optim_t 0.297] [lr 0.001551] [CE 3.243 (3.571)] [KD 0.000 (0.000)] 2024-10-12 10:25:10,864 - Train: 49.24% [184800/375300] [147.7/300.0] [batch_t 0.315 (0.439)] [data_t 0.016] [optim_t 0.300] [lr 0.001550] [CE 3.364 (3.498)] [KD 0.000 (0.000)] 2024-10-12 10:25:31,801 - Train: 49.25% [184850/375300] [147.8/300.0] [batch_t 0.404 (0.419)] [data_t 0.114] [optim_t 0.289] [lr 0.001550] [CE 3.690 (3.507)] [KD 0.000 (0.000)] 2024-10-12 10:25:53,547 - Train: 49.27% [184900/375300] [147.8/300.0] [batch_t 0.471 (0.435)] [data_t 0.015] [optim_t 0.455] [lr 0.001549] [CE 3.372 (3.541)] [KD 0.000 (0.000)] 2024-10-12 10:26:15,615 - Train: 49.28% [184950/375300] [147.8/300.0] [batch_t 0.533 (0.441)] [data_t 0.240] [optim_t 0.293] [lr 0.001549] [CE 3.473 (3.496)] [KD 0.000 (0.000)] 2024-10-12 10:26:38,240 - Train: 49.29% [185000/375300] [147.9/300.0] [batch_t 0.443 (0.452)] [data_t 0.148] [optim_t 0.294] [lr 0.001548] [CE 3.628 (3.563)] [KD 0.000 (0.000)] 2024-10-12 10:27:00,750 - Train: 49.31% [185050/375300] [147.9/300.0] [batch_t 0.435 (0.450)] [data_t 0.141] [optim_t 0.293] [lr 0.001547] [CE 3.386 (3.506)] [KD 0.000 (0.000)] 2024-10-12 10:27:22,695 - Train: 49.32% [185100/375300] [148.0/300.0] [batch_t 0.456 (0.439)] [data_t 0.161] [optim_t 0.295] [lr 0.001547] [CE 3.651 (3.531)] [KD 0.000 (0.000)] 2024-10-12 10:27:42,462 - ==> Total time: 22:40:46 Eta: 23:17:33 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 10:27:50,096 - Train: 49.33% [185150/375300] [148.0/300.0] [batch_t 0.317 (3.155)] [data_t 0.015] [optim_t 0.302] [lr 0.001546] [CE 3.699 (3.574)] [KD 0.000 (0.000)] 2024-10-12 10:28:10,060 - Train: 49.35% [185200/375300] [148.0/300.0] [batch_t 0.873 (0.399)] [data_t 0.015] [optim_t 0.858] [lr 0.001545] [CE 3.307 (3.494)] [KD 0.000 (0.000)] 2024-10-12 10:28:32,565 - Train: 49.36% [185250/375300] [148.1/300.0] [batch_t 0.311 (0.450)] [data_t 0.015] [optim_t 0.296] [lr 0.001545] [CE 3.530 (3.505)] [KD 0.000 (0.000)] 2024-10-12 10:28:54,824 - Train: 49.37% [185300/375300] [148.1/300.0] [batch_t 0.440 (0.445)] [data_t 0.015] [optim_t 0.424] [lr 0.001544] [CE 3.459 (3.546)] [KD 0.000 (0.000)] 2024-10-12 10:29:16,954 - Train: 49.39% [185350/375300] [148.2/300.0] [batch_t 0.515 (0.442)] [data_t 0.016] [optim_t 0.500] [lr 0.001544] [CE 3.577 (3.492)] [KD 0.000 (0.000)] 2024-10-12 10:29:39,014 - Train: 49.40% [185400/375300] [148.2/300.0] [batch_t 0.445 (0.441)] [data_t 0.015] [optim_t 0.430] [lr 0.001543] [CE 3.623 (3.476)] [KD 0.000 (0.000)] 2024-10-12 10:30:00,626 - Train: 49.41% [185450/375300] [148.2/300.0] [batch_t 0.377 (0.432)] [data_t 0.015] [optim_t 0.361] [lr 0.001542] [CE 3.628 (3.538)] [KD 0.000 (0.000)] 2024-10-12 10:30:22,226 - Train: 49.43% [185500/375300] [148.3/300.0] [batch_t 0.397 (0.432)] [data_t 0.016] [optim_t 0.381] [lr 0.001542] [CE 4.025 (3.490)] [KD 0.000 (0.000)] 2024-10-12 10:30:44,476 - Train: 49.44% [185550/375300] [148.3/300.0] [batch_t 0.584 (0.445)] [data_t 0.016] [optim_t 0.569] [lr 0.001541] [CE 3.457 (3.487)] [KD 0.000 (0.000)] 2024-10-12 10:31:05,931 - Train: 49.45% [185600/375300] [148.4/300.0] [batch_t 0.388 (0.429)] [data_t 0.015] [optim_t 0.372] [lr 0.001540] [CE 3.353 (3.455)] [KD 0.000 (0.000)] 2024-10-12 10:31:27,600 - Train: 49.47% [185650/375300] [148.4/300.0] [batch_t 0.343 (0.433)] [data_t 0.015] [optim_t 0.328] [lr 0.001540] [CE 3.828 (3.509)] [KD 0.000 (0.000)] 2024-10-12 10:31:49,465 - Train: 49.48% [185700/375300] [148.4/300.0] [batch_t 0.393 (0.437)] [data_t 0.096] [optim_t 0.297] [lr 0.001539] [CE 3.216 (3.528)] [KD 0.000 (0.000)] 2024-10-12 10:32:11,919 - Train: 49.49% [185750/375300] [148.5/300.0] [batch_t 0.421 (0.449)] [data_t 0.126] [optim_t 0.295] [lr 0.001539] [CE 3.516 (3.533)] [KD 0.000 (0.000)] 2024-10-12 10:32:34,311 - Train: 49.51% [185800/375300] [148.5/300.0] [batch_t 0.496 (0.448)] [data_t 0.199] [optim_t 0.297] [lr 0.001538] [CE 3.302 (3.509)] [KD 0.000 (0.000)] 2024-10-12 10:32:56,611 - Train: 49.52% [185850/375300] [148.6/300.0] [batch_t 0.468 (0.446)] [data_t 0.168] [optim_t 0.300] [lr 0.001537] [CE 3.693 (3.517)] [KD 0.000 (0.000)] 2024-10-12 10:33:19,237 - Train: 49.53% [185900/375300] [148.6/300.0] [batch_t 0.880 (0.452)] [data_t 0.581] [optim_t 0.299] [lr 0.001537] [CE 3.380 (3.542)] [KD 0.000 (0.000)] 2024-10-12 10:33:39,879 - Train: 49.55% [185950/375300] [148.6/300.0] [batch_t 0.318 (0.413)] [data_t 0.015] [optim_t 0.302] [lr 0.001536] [CE 3.491 (3.508)] [KD 0.000 (0.000)] 2024-10-12 10:34:00,520 - Train: 49.56% [186000/375300] [148.7/300.0] [batch_t 0.461 (0.413)] [data_t 0.016] [optim_t 0.446] [lr 0.001536] [CE 3.427 (3.524)] [KD 0.000 (0.000)] 2024-10-12 10:34:22,714 - Train: 49.57% [186050/375300] [148.7/300.0] [batch_t 0.357 (0.444)] [data_t 0.015] [optim_t 0.341] [lr 0.001535] [CE 3.398 (3.527)] [KD 0.000 (0.000)] 2024-10-12 10:34:45,298 - Train: 49.59% [186100/375300] [148.8/300.0] [batch_t 0.419 (0.452)] [data_t 0.122] [optim_t 0.297] [lr 0.001534] [CE 3.558 (3.496)] [KD 0.000 (0.000)] 2024-10-12 10:35:07,825 - Train: 49.60% [186150/375300] [148.8/300.0] [batch_t 0.432 (0.450)] [data_t 0.137] [optim_t 0.295] [lr 0.001534] [CE 3.839 (3.515)] [KD 0.000 (0.000)] 2024-10-12 10:35:30,088 - Train: 49.61% [186200/375300] [148.8/300.0] [batch_t 0.437 (0.445)] [data_t 0.137] [optim_t 0.300] [lr 0.001533] [CE 3.095 (3.498)] [KD 0.000 (0.000)] 2024-10-12 10:35:51,882 - Train: 49.63% [186250/375300] [148.9/300.0] [batch_t 0.496 (0.436)] [data_t 0.200] [optim_t 0.296] [lr 0.001532] [CE 3.586 (3.520)] [KD 0.000 (0.000)] 2024-10-12 10:36:13,178 - Train: 49.64% [186300/375300] [148.9/300.0] [batch_t 0.444 (0.426)] [data_t 0.015] [optim_t 0.429] [lr 0.001532] [CE 3.110 (3.521)] [KD 0.000 (0.000)] 2024-10-12 10:36:35,071 - Train: 49.65% [186350/375300] [149.0/300.0] [batch_t 0.409 (0.438)] [data_t 0.015] [optim_t 0.394] [lr 0.001531] [CE 3.531 (3.529)] [KD 0.000 (0.000)] 2024-10-12 10:36:55,258 - ==> Total time: 22:49:59 Eta: 23:08:22 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 10:37:02,762 - Train: 49.67% [186400/375300] [149.0/300.0] [batch_t 5.773 (5.773)] [data_t 4.163] [optim_t 1.610] [lr 0.001531] [CE 3.504 (3.504)] [KD 0.000 (0.000)] 2024-10-12 10:37:22,672 - Train: 49.68% [186450/375300] [149.0/300.0] [batch_t 0.318 (0.398)] [data_t 0.015] [optim_t 0.303] [lr 0.001530] [CE 3.436 (3.521)] [KD 0.000 (0.000)] 2024-10-12 10:37:45,622 - Train: 49.69% [186500/375300] [149.1/300.0] [batch_t 0.432 (0.459)] [data_t 0.015] [optim_t 0.417] [lr 0.001529] [CE 3.553 (3.517)] [KD 0.000 (0.000)] 2024-10-12 10:38:07,377 - Train: 49.71% [186550/375300] [149.1/300.0] [batch_t 0.427 (0.435)] [data_t 0.016] [optim_t 0.412] [lr 0.001529] [CE 3.431 (3.482)] [KD 0.000 (0.000)] 2024-10-12 10:38:29,811 - Train: 49.72% [186600/375300] [149.2/300.0] [batch_t 0.530 (0.449)] [data_t 0.015] [optim_t 0.515] [lr 0.001528] [CE 3.799 (3.514)] [KD 0.000 (0.000)] 2024-10-12 10:38:51,829 - Train: 49.73% [186650/375300] [149.2/300.0] [batch_t 0.512 (0.440)] [data_t 0.015] [optim_t 0.496] [lr 0.001527] [CE 3.336 (3.511)] [KD 0.000 (0.000)] 2024-10-12 10:39:13,683 - Train: 49.75% [186700/375300] [149.2/300.0] [batch_t 0.393 (0.437)] [data_t 0.098] [optim_t 0.295] [lr 0.001527] [CE 3.707 (3.486)] [KD 0.000 (0.000)] 2024-10-12 10:39:36,263 - Train: 49.76% [186750/375300] [149.3/300.0] [batch_t 0.490 (0.451)] [data_t 0.193] [optim_t 0.297] [lr 0.001526] [CE 3.443 (3.474)] [KD 0.000 (0.000)] 2024-10-12 10:39:58,423 - Train: 49.77% [186800/375300] [149.3/300.0] [batch_t 0.492 (0.443)] [data_t 0.196] [optim_t 0.296] [lr 0.001526] [CE 3.052 (3.466)] [KD 0.000 (0.000)] 2024-10-12 10:40:20,012 - Train: 49.79% [186850/375300] [149.4/300.0] [batch_t 0.381 (0.432)] [data_t 0.084] [optim_t 0.297] [lr 0.001525] [CE 3.507 (3.537)] [KD 0.000 (0.000)] 2024-10-12 10:40:41,449 - Train: 49.80% [186900/375300] [149.4/300.0] [batch_t 0.437 (0.429)] [data_t 0.016] [optim_t 0.422] [lr 0.001524] [CE 3.683 (3.559)] [KD 0.000 (0.000)] 2024-10-12 10:41:04,302 - Train: 49.81% [186950/375300] [149.4/300.0] [batch_t 0.472 (0.457)] [data_t 0.015] [optim_t 0.456] [lr 0.001524] [CE 3.399 (3.493)] [KD 0.000 (0.000)] 2024-10-12 10:41:26,526 - Train: 49.83% [187000/375300] [149.5/300.0] [batch_t 0.388 (0.444)] [data_t 0.016] [optim_t 0.373] [lr 0.001523] [CE 3.566 (3.560)] [KD 0.000 (0.000)] 2024-10-12 10:41:48,888 - Train: 49.84% [187050/375300] [149.5/300.0] [batch_t 0.476 (0.447)] [data_t 0.185] [optim_t 0.291] [lr 0.001522] [CE 3.749 (3.514)] [KD 0.000 (0.000)] 2024-10-12 10:42:10,501 - Train: 49.85% [187100/375300] [149.6/300.0] [batch_t 0.496 (0.432)] [data_t 0.184] [optim_t 0.312] [lr 0.001522] [CE 3.450 (3.519)] [KD 0.000 (0.000)] 2024-10-12 10:42:32,735 - Train: 49.87% [187150/375300] [149.6/300.0] [batch_t 0.397 (0.445)] [data_t 0.015] [optim_t 0.381] [lr 0.001521] [CE 3.386 (3.501)] [KD 0.000 (0.000)] 2024-10-12 10:42:54,425 - Train: 49.88% [187200/375300] [149.6/300.0] [batch_t 0.413 (0.434)] [data_t 0.015] [optim_t 0.397] [lr 0.001521] [CE 3.628 (3.508)] [KD 0.000 (0.000)] 2024-10-12 10:43:16,121 - Train: 49.89% [187250/375300] [149.7/300.0] [batch_t 0.313 (0.434)] [data_t 0.016] [optim_t 0.298] [lr 0.001520] [CE 3.520 (3.514)] [KD 0.000 (0.000)] 2024-10-12 10:43:38,262 - Train: 49.91% [187300/375300] [149.7/300.0] [batch_t 0.456 (0.443)] [data_t 0.015] [optim_t 0.440] [lr 0.001519] [CE 3.574 (3.533)] [KD 0.000 (0.000)] 2024-10-12 10:44:00,061 - Train: 49.92% [187350/375300] [149.8/300.0] [batch_t 0.444 (0.436)] [data_t 0.016] [optim_t 0.428] [lr 0.001519] [CE 3.131 (3.501)] [KD 0.000 (0.000)] 2024-10-12 10:44:21,602 - Train: 49.93% [187400/375300] [149.8/300.0] [batch_t 0.472 (0.431)] [data_t 0.015] [optim_t 0.457] [lr 0.001518] [CE 3.222 (3.480)] [KD 0.000 (0.000)] 2024-10-12 10:44:43,151 - Train: 49.95% [187450/375300] [149.8/300.0] [batch_t 0.371 (0.431)] [data_t 0.015] [optim_t 0.356] [lr 0.001517] [CE 3.225 (3.483)] [KD 0.000 (0.000)] 2024-10-12 10:45:04,714 - Train: 49.96% [187500/375300] [149.9/300.0] [batch_t 0.449 (0.431)] [data_t 0.016] [optim_t 0.433] [lr 0.001517] [CE 3.107 (3.497)] [KD 0.000 (0.000)] 2024-10-12 10:45:26,587 - Train: 49.97% [187550/375300] [149.9/300.0] [batch_t 0.363 (0.437)] [data_t 0.015] [optim_t 0.348] [lr 0.001516] [CE 3.267 (3.559)] [KD 0.000 (0.000)] 2024-10-12 10:45:48,445 - Train: 49.99% [187600/375300] [150.0/300.0] [batch_t 0.509 (0.437)] [data_t 0.015] [optim_t 0.494] [lr 0.001516] [CE 3.631 (3.523)] [KD 0.000 (0.000)] 2024-10-12 10:46:08,769 - Train: 50.00% [187650/375300] [150.0/300.0] [batch_t 0.315 (0.406)] [data_t 0.015] [optim_t 0.300] [lr 0.001515] [CE 3.434 (3.511)] [KD 0.000 (0.000)] 2024-10-12 10:46:30,642 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.433)] [top1_cnt 37619] [top5_cnt 46447] [top_all 50000] 2024-10-12 10:46:30,643 - net: 75.238 (92.894) 2024-10-12 10:46:52,420 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.428)] [top1_cnt 39581] [top5_cnt 47449] [top_all 50000] 2024-10-12 10:46:52,420 - net_E: 79.162 (94.898) 2024-10-12 10:46:52,630 - Max [top1: 75.238 (epoch: 150)] [top1-ema: 79.162 (epoch: 150)] 2024-10-12 10:46:52,631 - ==> Total time: 22:59:56 Eta: 22:59:56 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 10:47:20,430 - Train: 50.01% [187700/375300] [150.0/300.0] [batch_t 0.320 (0.418)] [data_t 0.016] [optim_t 0.305] [lr 0.001514] [CE 3.762 (3.479)] [KD 0.000 (0.000)] 2024-10-12 10:47:42,237 - Train: 50.03% [187750/375300] [150.1/300.0] [batch_t 0.426 (0.436)] [data_t 0.016] [optim_t 0.411] [lr 0.001514] [CE 3.543 (3.528)] [KD 0.000 (0.000)] 2024-10-12 10:48:04,341 - Train: 50.04% [187800/375300] [150.1/300.0] [batch_t 0.447 (0.442)] [data_t 0.016] [optim_t 0.431] [lr 0.001513] [CE 3.579 (3.498)] [KD 0.000 (0.000)] 2024-10-12 10:48:25,972 - Train: 50.05% [187850/375300] [150.2/300.0] [batch_t 0.440 (0.432)] [data_t 0.016] [optim_t 0.424] [lr 0.001513] [CE 3.481 (3.542)] [KD 0.000 (0.000)] 2024-10-12 10:48:47,525 - Train: 50.07% [187900/375300] [150.2/300.0] [batch_t 0.435 (0.431)] [data_t 0.015] [optim_t 0.420] [lr 0.001512] [CE 3.638 (3.475)] [KD 0.000 (0.000)] 2024-10-12 10:49:09,148 - Train: 50.08% [187950/375300] [150.2/300.0] [batch_t 0.488 (0.432)] [data_t 0.015] [optim_t 0.472] [lr 0.001511] [CE 3.874 (3.486)] [KD 0.000 (0.000)] 2024-10-12 10:49:30,315 - Train: 50.09% [188000/375300] [150.3/300.0] [batch_t 0.405 (0.423)] [data_t 0.015] [optim_t 0.389] [lr 0.001511] [CE 3.593 (3.503)] [KD 0.000 (0.000)] 2024-10-12 10:49:51,504 - Train: 50.11% [188050/375300] [150.3/300.0] [batch_t 0.423 (0.424)] [data_t 0.015] [optim_t 0.407] [lr 0.001510] [CE 3.376 (3.529)] [KD 0.000 (0.000)] 2024-10-12 10:50:12,079 - Train: 50.12% [188100/375300] [150.4/300.0] [batch_t 0.412 (0.411)] [data_t 0.016] [optim_t 0.396] [lr 0.001509] [CE 3.517 (3.536)] [KD 0.000 (0.000)] 2024-10-12 10:50:32,728 - Train: 50.13% [188150/375300] [150.4/300.0] [batch_t 0.411 (0.413)] [data_t 0.016] [optim_t 0.395] [lr 0.001509] [CE 3.167 (3.512)] [KD 0.000 (0.000)] 2024-10-12 10:50:53,429 - Train: 50.15% [188200/375300] [150.4/300.0] [batch_t 0.310 (0.414)] [data_t 0.015] [optim_t 0.294] [lr 0.001508] [CE 3.358 (3.515)] [KD 0.000 (0.000)] 2024-10-12 10:51:14,712 - Train: 50.16% [188250/375300] [150.5/300.0] [batch_t 0.431 (0.426)] [data_t 0.015] [optim_t 0.416] [lr 0.001508] [CE 3.497 (3.544)] [KD 0.000 (0.000)] 2024-10-12 10:51:36,159 - Train: 50.17% [188300/375300] [150.5/300.0] [batch_t 0.348 (0.429)] [data_t 0.015] [optim_t 0.333] [lr 0.001507] [CE 3.553 (3.493)] [KD 0.000 (0.000)] 2024-10-12 10:51:58,411 - Train: 50.19% [188350/375300] [150.6/300.0] [batch_t 0.470 (0.445)] [data_t 0.015] [optim_t 0.455] [lr 0.001506] [CE 3.475 (3.513)] [KD 0.000 (0.000)] 2024-10-12 10:52:19,690 - Train: 50.20% [188400/375300] [150.6/300.0] [batch_t 0.373 (0.425)] [data_t 0.015] [optim_t 0.358] [lr 0.001506] [CE 3.613 (3.479)] [KD 0.000 (0.000)] 2024-10-12 10:52:41,313 - Train: 50.21% [188450/375300] [150.6/300.0] [batch_t 0.468 (0.432)] [data_t 0.016] [optim_t 0.453] [lr 0.001505] [CE 3.822 (3.488)] [KD 0.000 (0.000)] 2024-10-12 10:53:02,648 - Train: 50.23% [188500/375300] [150.7/300.0] [batch_t 0.485 (0.427)] [data_t 0.015] [optim_t 0.470] [lr 0.001504] [CE 3.256 (3.531)] [KD 0.000 (0.000)] 2024-10-12 10:53:24,422 - Train: 50.24% [188550/375300] [150.7/300.0] [batch_t 0.393 (0.435)] [data_t 0.015] [optim_t 0.378] [lr 0.001504] [CE 3.307 (3.557)] [KD 0.000 (0.000)] 2024-10-12 10:53:46,596 - Train: 50.25% [188600/375300] [150.8/300.0] [batch_t 0.414 (0.443)] [data_t 0.015] [optim_t 0.399] [lr 0.001503] [CE 3.194 (3.510)] [KD 0.000 (0.000)] 2024-10-12 10:54:08,102 - Train: 50.27% [188650/375300] [150.8/300.0] [batch_t 0.420 (0.430)] [data_t 0.015] [optim_t 0.404] [lr 0.001503] [CE 3.666 (3.561)] [KD 0.000 (0.000)] 2024-10-12 10:54:29,709 - Train: 50.28% [188700/375300] [150.8/300.0] [batch_t 0.365 (0.432)] [data_t 0.016] [optim_t 0.350] [lr 0.001502] [CE 3.499 (3.486)] [KD 0.000 (0.000)] 2024-10-12 10:54:51,219 - Train: 50.29% [188750/375300] [150.9/300.0] [batch_t 0.502 (0.430)] [data_t 0.015] [optim_t 0.487] [lr 0.001501] [CE 3.523 (3.494)] [KD 0.000 (0.000)] 2024-10-12 10:55:12,736 - Train: 50.31% [188800/375300] [150.9/300.0] [batch_t 0.435 (0.430)] [data_t 0.015] [optim_t 0.420] [lr 0.001501] [CE 3.487 (3.505)] [KD 0.000 (0.000)] 2024-10-12 10:55:34,497 - Train: 50.32% [188850/375300] [151.0/300.0] [batch_t 0.529 (0.435)] [data_t 0.016] [optim_t 0.514] [lr 0.001500] [CE 3.368 (3.523)] [KD 0.000 (0.000)] 2024-10-12 10:55:55,602 - Train: 50.33% [188900/375300] [151.0/300.0] [batch_t 0.305 (0.422)] [data_t 0.015] [optim_t 0.290] [lr 0.001499] [CE 3.285 (3.510)] [KD 0.000 (0.000)] 2024-10-12 10:55:55,912 - ==> Total time: 23:08:59 Eta: 22:50:36 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 10:56:22,505 - Train: 50.35% [188950/375300] [151.0/300.0] [batch_t 0.485 (0.512)] [data_t 0.015] [optim_t 0.469] [lr 0.001499] [CE 3.439 (3.495)] [KD 0.000 (0.000)] 2024-10-12 10:56:44,925 - Train: 50.36% [189000/375300] [151.1/300.0] [batch_t 0.435 (0.448)] [data_t 0.015] [optim_t 0.420] [lr 0.001498] [CE 3.056 (3.454)] [KD 0.000 (0.000)] 2024-10-12 10:57:07,301 - Train: 50.37% [189050/375300] [151.1/300.0] [batch_t 0.448 (0.447)] [data_t 0.016] [optim_t 0.432] [lr 0.001498] [CE 3.736 (3.485)] [KD 0.000 (0.000)] 2024-10-12 10:57:29,087 - Train: 50.39% [189100/375300] [151.2/300.0] [batch_t 0.489 (0.436)] [data_t 0.016] [optim_t 0.474] [lr 0.001497] [CE 3.555 (3.467)] [KD 0.000 (0.000)] 2024-10-12 10:57:50,031 - Train: 50.40% [189150/375300] [151.2/300.0] [batch_t 0.489 (0.419)] [data_t 0.016] [optim_t 0.474] [lr 0.001496] [CE 3.489 (3.495)] [KD 0.000 (0.000)] 2024-10-12 10:58:10,988 - Train: 50.41% [189200/375300] [151.2/300.0] [batch_t 0.383 (0.419)] [data_t 0.087] [optim_t 0.296] [lr 0.001496] [CE 3.324 (3.455)] [KD 0.000 (0.000)] 2024-10-12 10:58:32,424 - Train: 50.43% [189250/375300] [151.3/300.0] [batch_t 0.445 (0.429)] [data_t 0.016] [optim_t 0.430] [lr 0.001495] [CE 3.730 (3.508)] [KD 0.000 (0.000)] 2024-10-12 10:58:54,516 - Train: 50.44% [189300/375300] [151.3/300.0] [batch_t 0.334 (0.442)] [data_t 0.015] [optim_t 0.319] [lr 0.001495] [CE 3.405 (3.485)] [KD 0.000 (0.000)] 2024-10-12 10:59:16,577 - Train: 50.45% [189350/375300] [151.4/300.0] [batch_t 0.466 (0.441)] [data_t 0.015] [optim_t 0.451] [lr 0.001494] [CE 3.348 (3.521)] [KD 0.000 (0.000)] 2024-10-12 10:59:38,661 - Train: 50.47% [189400/375300] [151.4/300.0] [batch_t 0.432 (0.442)] [data_t 0.016] [optim_t 0.416] [lr 0.001493] [CE 3.816 (3.489)] [KD 0.000 (0.000)] 2024-10-12 11:00:00,649 - Train: 50.48% [189450/375300] [151.4/300.0] [batch_t 0.394 (0.440)] [data_t 0.016] [optim_t 0.378] [lr 0.001493] [CE 3.389 (3.482)] [KD 0.000 (0.000)] 2024-10-12 11:00:22,520 - Train: 50.49% [189500/375300] [151.5/300.0] [batch_t 0.434 (0.437)] [data_t 0.015] [optim_t 0.419] [lr 0.001492] [CE 3.392 (3.487)] [KD 0.000 (0.000)] 2024-10-12 11:00:43,690 - Train: 50.51% [189550/375300] [151.5/300.0] [batch_t 0.364 (0.423)] [data_t 0.015] [optim_t 0.348] [lr 0.001491] [CE 3.383 (3.472)] [KD 0.000 (0.000)] 2024-10-12 11:01:05,007 - Train: 50.52% [189600/375300] [151.6/300.0] [batch_t 0.382 (0.426)] [data_t 0.015] [optim_t 0.367] [lr 0.001491] [CE 3.336 (3.521)] [KD 0.000 (0.000)] 2024-10-12 11:01:25,949 - Train: 50.53% [189650/375300] [151.6/300.0] [batch_t 0.390 (0.419)] [data_t 0.015] [optim_t 0.375] [lr 0.001490] [CE 3.480 (3.501)] [KD 0.000 (0.000)] 2024-10-12 11:01:47,710 - Train: 50.55% [189700/375300] [151.6/300.0] [batch_t 0.521 (0.435)] [data_t 0.015] [optim_t 0.506] [lr 0.001490] [CE 3.221 (3.527)] [KD 0.000 (0.000)] 2024-10-12 11:02:09,361 - Train: 50.56% [189750/375300] [151.7/300.0] [batch_t 0.364 (0.433)] [data_t 0.015] [optim_t 0.348] [lr 0.001489] [CE 3.342 (3.473)] [KD 0.000 (0.000)] 2024-10-12 11:02:30,994 - Train: 50.57% [189800/375300] [151.7/300.0] [batch_t 0.534 (0.433)] [data_t 0.016] [optim_t 0.518] [lr 0.001488] [CE 3.547 (3.517)] [KD 0.000 (0.000)] 2024-10-12 11:02:52,457 - Train: 50.59% [189850/375300] [151.8/300.0] [batch_t 0.480 (0.429)] [data_t 0.015] [optim_t 0.465] [lr 0.001488] [CE 3.387 (3.487)] [KD 0.000 (0.000)] 2024-10-12 11:03:13,972 - Train: 50.60% [189900/375300] [151.8/300.0] [batch_t 0.411 (0.430)] [data_t 0.016] [optim_t 0.395] [lr 0.001487] [CE 3.511 (3.475)] [KD 0.000 (0.000)] 2024-10-12 11:03:35,472 - Train: 50.61% [189950/375300] [151.8/300.0] [batch_t 0.316 (0.430)] [data_t 0.016] [optim_t 0.300] [lr 0.001486] [CE 3.591 (3.531)] [KD 0.000 (0.000)] 2024-10-12 11:03:57,266 - Train: 50.63% [190000/375300] [151.9/300.0] [batch_t 0.468 (0.436)] [data_t 0.016] [optim_t 0.453] [lr 0.001486] [CE 3.619 (3.506)] [KD 0.000 (0.000)] 2024-10-12 11:04:19,210 - Train: 50.64% [190050/375300] [151.9/300.0] [batch_t 0.454 (0.439)] [data_t 0.015] [optim_t 0.438] [lr 0.001485] [CE 3.498 (3.503)] [KD 0.000 (0.000)] 2024-10-12 11:04:40,455 - Train: 50.65% [190100/375300] [152.0/300.0] [batch_t 0.467 (0.425)] [data_t 0.016] [optim_t 0.452] [lr 0.001485] [CE 3.505 (3.553)] [KD 0.000 (0.000)] 2024-10-12 11:05:01,552 - Train: 50.67% [190150/375300] [152.0/300.0] [batch_t 0.313 (0.422)] [data_t 0.015] [optim_t 0.298] [lr 0.001484] [CE 3.472 (3.505)] [KD 0.000 (0.000)] 2024-10-12 11:05:02,180 - ==> Total time: 23:18:06 Eta: 22:41:18 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 11:05:29,017 - Train: 50.68% [190200/375300] [152.0/300.0] [batch_t 0.316 (0.461)] [data_t 0.016] [optim_t 0.301] [lr 0.001483] [CE 3.556 (3.493)] [KD 0.000 (0.000)] 2024-10-12 11:05:50,750 - Train: 50.69% [190250/375300] [152.1/300.0] [batch_t 0.454 (0.435)] [data_t 0.016] [optim_t 0.438] [lr 0.001483] [CE 3.544 (3.455)] [KD 0.000 (0.000)] 2024-10-12 11:06:13,788 - Train: 50.71% [190300/375300] [152.1/300.0] [batch_t 0.464 (0.461)] [data_t 0.167] [optim_t 0.297] [lr 0.001482] [CE 3.259 (3.505)] [KD 0.000 (0.000)] 2024-10-12 11:06:36,175 - Train: 50.72% [190350/375300] [152.2/300.0] [batch_t 0.399 (0.448)] [data_t 0.100] [optim_t 0.299] [lr 0.001481] [CE 3.479 (3.520)] [KD 0.000 (0.000)] 2024-10-12 11:06:57,716 - Train: 50.73% [190400/375300] [152.2/300.0] [batch_t 0.539 (0.431)] [data_t 0.243] [optim_t 0.295] [lr 0.001481] [CE 3.241 (3.459)] [KD 0.000 (0.000)] 2024-10-12 11:07:19,606 - Train: 50.75% [190450/375300] [152.2/300.0] [batch_t 0.491 (0.438)] [data_t 0.121] [optim_t 0.370] [lr 0.001480] [CE 3.534 (3.521)] [KD 0.000 (0.000)] 2024-10-12 11:07:42,659 - Train: 50.76% [190500/375300] [152.3/300.0] [batch_t 0.399 (0.461)] [data_t 0.016] [optim_t 0.383] [lr 0.001480] [CE 3.800 (3.476)] [KD 0.000 (0.000)] 2024-10-12 11:08:04,931 - Train: 50.77% [190550/375300] [152.3/300.0] [batch_t 0.513 (0.445)] [data_t 0.015] [optim_t 0.497] [lr 0.001479] [CE 3.599 (3.493)] [KD 0.000 (0.000)] 2024-10-12 11:08:26,982 - Train: 50.79% [190600/375300] [152.4/300.0] [batch_t 0.393 (0.441)] [data_t 0.016] [optim_t 0.378] [lr 0.001478] [CE 3.306 (3.486)] [KD 0.000 (0.000)] 2024-10-12 11:08:49,491 - Train: 50.80% [190650/375300] [152.4/300.0] [batch_t 0.344 (0.450)] [data_t 0.016] [optim_t 0.328] [lr 0.001478] [CE 3.629 (3.495)] [KD 0.000 (0.000)] 2024-10-12 11:09:11,812 - Train: 50.81% [190700/375300] [152.4/300.0] [batch_t 0.463 (0.446)] [data_t 0.015] [optim_t 0.448] [lr 0.001477] [CE 3.485 (3.415)] [KD 0.000 (0.000)] 2024-10-12 11:09:34,992 - Train: 50.83% [190750/375300] [152.5/300.0] [batch_t 0.319 (0.463)] [data_t 0.016] [optim_t 0.303] [lr 0.001476] [CE 3.239 (3.491)] [KD 0.000 (0.000)] 2024-10-12 11:09:56,845 - Train: 50.84% [190800/375300] [152.5/300.0] [batch_t 0.380 (0.437)] [data_t 0.016] [optim_t 0.364] [lr 0.001476] [CE 3.538 (3.518)] [KD 0.000 (0.000)] 2024-10-12 11:10:19,126 - Train: 50.85% [190850/375300] [152.6/300.0] [batch_t 0.443 (0.446)] [data_t 0.016] [optim_t 0.428] [lr 0.001475] [CE 3.448 (3.523)] [KD 0.000 (0.000)] 2024-10-12 11:10:41,343 - Train: 50.87% [190900/375300] [152.6/300.0] [batch_t 0.392 (0.444)] [data_t 0.015] [optim_t 0.376] [lr 0.001475] [CE 3.469 (3.536)] [KD 0.000 (0.000)] 2024-10-12 11:11:03,774 - Train: 50.88% [190950/375300] [152.6/300.0] [batch_t 0.592 (0.449)] [data_t 0.016] [optim_t 0.577] [lr 0.001474] [CE 2.861 (3.507)] [KD 0.000 (0.000)] 2024-10-12 11:11:25,901 - Train: 50.89% [191000/375300] [152.7/300.0] [batch_t 0.370 (0.442)] [data_t 0.016] [optim_t 0.354] [lr 0.001473] [CE 3.782 (3.500)] [KD 0.000 (0.000)] 2024-10-12 11:11:48,071 - Train: 50.91% [191050/375300] [152.7/300.0] [batch_t 0.446 (0.443)] [data_t 0.015] [optim_t 0.430] [lr 0.001473] [CE 3.847 (3.519)] [KD 0.000 (0.000)] 2024-10-12 11:12:10,281 - Train: 50.92% [191100/375300] [152.8/300.0] [batch_t 0.395 (0.444)] [data_t 0.016] [optim_t 0.380] [lr 0.001472] [CE 3.415 (3.482)] [KD 0.000 (0.000)] 2024-10-12 11:12:32,239 - Train: 50.93% [191150/375300] [152.8/300.0] [batch_t 0.535 (0.439)] [data_t 0.015] [optim_t 0.520] [lr 0.001472] [CE 3.675 (3.504)] [KD 0.000 (0.000)] 2024-10-12 11:12:54,469 - Train: 50.95% [191200/375300] [152.8/300.0] [batch_t 0.415 (0.444)] [data_t 0.015] [optim_t 0.399] [lr 0.001471] [CE 3.387 (3.443)] [KD 0.000 (0.000)] 2024-10-12 11:13:16,952 - Train: 50.96% [191250/375300] [152.9/300.0] [batch_t 0.313 (0.450)] [data_t 0.015] [optim_t 0.298] [lr 0.001470] [CE 3.649 (3.493)] [KD 0.000 (0.000)] 2024-10-12 11:13:38,526 - Train: 50.97% [191300/375300] [152.9/300.0] [batch_t 0.320 (0.431)] [data_t 0.016] [optim_t 0.304] [lr 0.001470] [CE 3.743 (3.513)] [KD 0.000 (0.000)] 2024-10-12 11:14:01,111 - Train: 50.99% [191350/375300] [153.0/300.0] [batch_t 0.377 (0.452)] [data_t 0.016] [optim_t 0.362] [lr 0.001469] [CE 3.655 (3.510)] [KD 0.000 (0.000)] 2024-10-12 11:14:22,531 - Train: 51.00% [191400/375300] [153.0/300.0] [batch_t 0.310 (0.428)] [data_t 0.015] [optim_t 0.295] [lr 0.001468] [CE 3.717 (3.471)] [KD 0.000 (0.000)] 2024-10-12 11:14:23,466 - ==> Total time: 23:27:27 Eta: 22:32:15 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 11:14:48,287 - Train: 51.01% [191450/375300] [153.0/300.0] [batch_t 0.593 (0.498)] [data_t 0.016] [optim_t 0.578] [lr 0.001468] [CE 3.535 (3.472)] [KD 0.000 (0.000)] 2024-10-12 11:15:11,324 - Train: 51.03% [191500/375300] [153.1/300.0] [batch_t 0.523 (0.461)] [data_t 0.016] [optim_t 0.507] [lr 0.001467] [CE 3.510 (3.460)] [KD 0.000 (0.000)] 2024-10-12 11:15:32,718 - Train: 51.04% [191550/375300] [153.1/300.0] [batch_t 0.417 (0.428)] [data_t 0.016] [optim_t 0.402] [lr 0.001467] [CE 3.534 (3.478)] [KD 0.000 (0.000)] 2024-10-12 11:15:53,950 - Train: 51.05% [191600/375300] [153.2/300.0] [batch_t 0.311 (0.425)] [data_t 0.015] [optim_t 0.295] [lr 0.001466] [CE 3.356 (3.490)] [KD 0.000 (0.000)] 2024-10-12 11:16:15,158 - Train: 51.07% [191650/375300] [153.2/300.0] [batch_t 0.484 (0.424)] [data_t 0.015] [optim_t 0.469] [lr 0.001465] [CE 3.245 (3.443)] [KD 0.000 (0.000)] 2024-10-12 11:16:36,571 - Train: 51.08% [191700/375300] [153.2/300.0] [batch_t 0.413 (0.428)] [data_t 0.015] [optim_t 0.398] [lr 0.001465] [CE 3.154 (3.483)] [KD 0.000 (0.000)] 2024-10-12 11:16:57,946 - Train: 51.09% [191750/375300] [153.3/300.0] [batch_t 0.473 (0.427)] [data_t 0.015] [optim_t 0.457] [lr 0.001464] [CE 3.534 (3.518)] [KD 0.000 (0.000)] 2024-10-12 11:17:18,972 - Train: 51.11% [191800/375300] [153.3/300.0] [batch_t 0.366 (0.420)] [data_t 0.015] [optim_t 0.351] [lr 0.001463] [CE 3.393 (3.487)] [KD 0.000 (0.000)] 2024-10-12 11:17:40,411 - Train: 51.12% [191850/375300] [153.4/300.0] [batch_t 0.443 (0.429)] [data_t 0.015] [optim_t 0.427] [lr 0.001463] [CE 3.442 (3.448)] [KD 0.000 (0.000)] 2024-10-12 11:18:01,676 - Train: 51.13% [191900/375300] [153.4/300.0] [batch_t 0.450 (0.425)] [data_t 0.016] [optim_t 0.434] [lr 0.001462] [CE 3.724 (3.517)] [KD 0.000 (0.000)] 2024-10-12 11:18:22,831 - Train: 51.15% [191950/375300] [153.4/300.0] [batch_t 0.417 (0.423)] [data_t 0.016] [optim_t 0.401] [lr 0.001462] [CE 3.639 (3.487)] [KD 0.000 (0.000)] 2024-10-12 11:18:44,347 - Train: 51.16% [192000/375300] [153.5/300.0] [batch_t 0.874 (0.430)] [data_t 0.015] [optim_t 0.859] [lr 0.001461] [CE 3.337 (3.501)] [KD 0.000 (0.000)] 2024-10-12 11:19:05,060 - Train: 51.17% [192050/375300] [153.5/300.0] [batch_t 0.468 (0.414)] [data_t 0.015] [optim_t 0.453] [lr 0.001460] [CE 3.360 (3.516)] [KD 0.000 (0.000)] 2024-10-12 11:19:26,474 - Train: 51.19% [192100/375300] [153.6/300.0] [batch_t 0.423 (0.428)] [data_t 0.016] [optim_t 0.408] [lr 0.001460] [CE 3.379 (3.514)] [KD 0.000 (0.000)] 2024-10-12 11:19:47,597 - Train: 51.20% [192150/375300] [153.6/300.0] [batch_t 0.442 (0.422)] [data_t 0.016] [optim_t 0.427] [lr 0.001459] [CE 3.657 (3.532)] [KD 0.000 (0.000)] 2024-10-12 11:20:09,462 - Train: 51.21% [192200/375300] [153.6/300.0] [batch_t 0.819 (0.437)] [data_t 0.016] [optim_t 0.803] [lr 0.001458] [CE 3.243 (3.479)] [KD 0.000 (0.000)] 2024-10-12 11:20:29,842 - Train: 51.23% [192250/375300] [153.7/300.0] [batch_t 0.504 (0.407)] [data_t 0.015] [optim_t 0.489] [lr 0.001458] [CE 3.566 (3.503)] [KD 0.000 (0.000)] 2024-10-12 11:20:50,821 - Train: 51.24% [192300/375300] [153.7/300.0] [batch_t 0.317 (0.419)] [data_t 0.015] [optim_t 0.301] [lr 0.001457] [CE 3.675 (3.519)] [KD 0.000 (0.000)] 2024-10-12 11:21:12,503 - Train: 51.25% [192350/375300] [153.8/300.0] [batch_t 0.458 (0.434)] [data_t 0.015] [optim_t 0.442] [lr 0.001457] [CE 3.205 (3.479)] [KD 0.000 (0.000)] 2024-10-12 11:21:34,558 - Train: 51.27% [192400/375300] [153.8/300.0] [batch_t 0.443 (0.441)] [data_t 0.015] [optim_t 0.427] [lr 0.001456] [CE 3.328 (3.510)] [KD 0.000 (0.000)] 2024-10-12 11:21:55,862 - Train: 51.28% [192450/375300] [153.8/300.0] [batch_t 0.364 (0.426)] [data_t 0.016] [optim_t 0.349] [lr 0.001455] [CE 3.673 (3.512)] [KD 0.000 (0.000)] 2024-10-12 11:22:16,928 - Train: 51.29% [192500/375300] [153.9/300.0] [batch_t 0.416 (0.421)] [data_t 0.016] [optim_t 0.401] [lr 0.001455] [CE 3.599 (3.534)] [KD 0.000 (0.000)] 2024-10-12 11:22:38,798 - Train: 51.31% [192550/375300] [153.9/300.0] [batch_t 0.485 (0.437)] [data_t 0.016] [optim_t 0.469] [lr 0.001454] [CE 3.561 (3.509)] [KD 0.000 (0.000)] 2024-10-12 11:23:00,240 - Train: 51.32% [192600/375300] [154.0/300.0] [batch_t 0.438 (0.429)] [data_t 0.015] [optim_t 0.422] [lr 0.001453] [CE 3.549 (3.541)] [KD 0.000 (0.000)] 2024-10-12 11:23:21,017 - Train: 51.33% [192650/375300] [154.0/300.0] [batch_t 0.311 (0.415)] [data_t 0.015] [optim_t 0.295] [lr 0.001453] [CE 3.464 (3.476)] [KD 0.000 (0.000)] 2024-10-12 11:23:22,269 - ==> Total time: 23:36:26 Eta: 22:22:51 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 11:23:46,598 - Train: 51.35% [192700/375300] [154.0/300.0] [batch_t 0.565 (0.498)] [data_t 0.016] [optim_t 0.550] [lr 0.001452] [CE 3.278 (3.451)] [KD 0.000 (0.000)] 2024-10-12 11:24:09,370 - Train: 51.36% [192750/375300] [154.1/300.0] [batch_t 0.486 (0.455)] [data_t 0.016] [optim_t 0.470] [lr 0.001452] [CE 3.404 (3.432)] [KD 0.000 (0.000)] 2024-10-12 11:24:31,635 - Train: 51.37% [192800/375300] [154.1/300.0] [batch_t 0.477 (0.445)] [data_t 0.015] [optim_t 0.462] [lr 0.001451] [CE 3.433 (3.450)] [KD 0.000 (0.000)] 2024-10-12 11:24:54,072 - Train: 51.39% [192850/375300] [154.2/300.0] [batch_t 0.431 (0.449)] [data_t 0.015] [optim_t 0.416] [lr 0.001450] [CE 3.255 (3.537)] [KD 0.000 (0.000)] 2024-10-12 11:25:16,284 - Train: 51.40% [192900/375300] [154.2/300.0] [batch_t 0.421 (0.444)] [data_t 0.015] [optim_t 0.405] [lr 0.001450] [CE 3.355 (3.481)] [KD 0.000 (0.000)] 2024-10-12 11:25:38,611 - Train: 51.41% [192950/375300] [154.2/300.0] [batch_t 0.345 (0.446)] [data_t 0.016] [optim_t 0.330] [lr 0.001449] [CE 3.408 (3.454)] [KD 0.000 (0.000)] 2024-10-12 11:26:00,952 - Train: 51.43% [193000/375300] [154.3/300.0] [batch_t 0.479 (0.447)] [data_t 0.015] [optim_t 0.464] [lr 0.001449] [CE 3.429 (3.474)] [KD 0.000 (0.000)] 2024-10-12 11:26:22,997 - Train: 51.44% [193050/375300] [154.3/300.0] [batch_t 0.316 (0.441)] [data_t 0.016] [optim_t 0.300] [lr 0.001448] [CE 3.377 (3.501)] [KD 0.000 (0.000)] 2024-10-12 11:26:45,463 - Train: 51.45% [193100/375300] [154.4/300.0] [batch_t 0.426 (0.449)] [data_t 0.015] [optim_t 0.411] [lr 0.001447] [CE 3.220 (3.424)] [KD 0.000 (0.000)] 2024-10-12 11:27:06,207 - Train: 51.47% [193150/375300] [154.4/300.0] [batch_t 0.395 (0.415)] [data_t 0.016] [optim_t 0.379] [lr 0.001447] [CE 3.628 (3.522)] [KD 0.000 (0.000)] 2024-10-12 11:27:27,302 - Train: 51.48% [193200/375300] [154.4/300.0] [batch_t 0.382 (0.422)] [data_t 0.016] [optim_t 0.366] [lr 0.001446] [CE 3.705 (3.481)] [KD 0.000 (0.000)] 2024-10-12 11:27:48,540 - Train: 51.49% [193250/375300] [154.5/300.0] [batch_t 0.421 (0.425)] [data_t 0.016] [optim_t 0.406] [lr 0.001445] [CE 3.412 (3.492)] [KD 0.000 (0.000)] 2024-10-12 11:28:09,777 - Train: 51.51% [193300/375300] [154.5/300.0] [batch_t 0.311 (0.425)] [data_t 0.015] [optim_t 0.296] [lr 0.001445] [CE 3.378 (3.505)] [KD 0.000 (0.000)] 2024-10-12 11:28:30,848 - Train: 51.52% [193350/375300] [154.6/300.0] [batch_t 0.462 (0.421)] [data_t 0.015] [optim_t 0.447] [lr 0.001444] [CE 3.542 (3.460)] [KD 0.000 (0.000)] 2024-10-12 11:28:52,845 - Train: 51.53% [193400/375300] [154.6/300.0] [batch_t 0.550 (0.440)] [data_t 0.015] [optim_t 0.535] [lr 0.001444] [CE 3.362 (3.459)] [KD 0.000 (0.000)] 2024-10-12 11:29:14,434 - Train: 51.55% [193450/375300] [154.6/300.0] [batch_t 0.425 (0.432)] [data_t 0.015] [optim_t 0.410] [lr 0.001443] [CE 3.865 (3.486)] [KD 0.000 (0.000)] 2024-10-12 11:29:35,616 - Train: 51.56% [193500/375300] [154.7/300.0] [batch_t 0.495 (0.424)] [data_t 0.016] [optim_t 0.480] [lr 0.001442] [CE 3.366 (3.488)] [KD 0.000 (0.000)] 2024-10-12 11:29:57,203 - Train: 51.57% [193550/375300] [154.7/300.0] [batch_t 0.471 (0.432)] [data_t 0.016] [optim_t 0.455] [lr 0.001442] [CE 3.478 (3.454)] [KD 0.000 (0.000)] 2024-10-12 11:30:18,514 - Train: 51.59% [193600/375300] [154.8/300.0] [batch_t 0.314 (0.426)] [data_t 0.016] [optim_t 0.299] [lr 0.001441] [CE 3.456 (3.527)] [KD 0.000 (0.000)] 2024-10-12 11:30:40,136 - Train: 51.60% [193650/375300] [154.8/300.0] [batch_t 0.420 (0.432)] [data_t 0.016] [optim_t 0.405] [lr 0.001440] [CE 3.273 (3.460)] [KD 0.000 (0.000)] 2024-10-12 11:31:01,341 - Train: 51.61% [193700/375300] [154.8/300.0] [batch_t 0.396 (0.424)] [data_t 0.016] [optim_t 0.380] [lr 0.001440] [CE 3.438 (3.526)] [KD 0.000 (0.000)] 2024-10-12 11:31:22,703 - Train: 51.63% [193750/375300] [154.9/300.0] [batch_t 0.439 (0.427)] [data_t 0.016] [optim_t 0.423] [lr 0.001439] [CE 3.489 (3.504)] [KD 0.000 (0.000)] 2024-10-12 11:31:44,212 - Train: 51.64% [193800/375300] [154.9/300.0] [batch_t 0.467 (0.430)] [data_t 0.015] [optim_t 0.451] [lr 0.001439] [CE 3.583 (3.540)] [KD 0.000 (0.000)] 2024-10-12 11:32:05,722 - Train: 51.65% [193850/375300] [155.0/300.0] [batch_t 0.386 (0.430)] [data_t 0.015] [optim_t 0.370] [lr 0.001438] [CE 3.713 (3.498)] [KD 0.000 (0.000)] 2024-10-12 11:32:26,403 - Train: 51.67% [193900/375300] [155.0/300.0] [batch_t 0.318 (0.413)] [data_t 0.015] [optim_t 0.303] [lr 0.001437] [CE 3.638 (3.503)] [KD 0.000 (0.000)] 2024-10-12 11:32:50,500 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.446)] [top1_cnt 37491] [top5_cnt 46473] [top_all 50000] 2024-10-12 11:32:50,501 - net: 74.982 (92.946) 2024-10-12 11:33:12,274 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.428)] [top1_cnt 39647] [top5_cnt 47455] [top_all 50000] 2024-10-12 11:33:12,275 - net_E: 79.294 (94.910) 2024-10-12 11:33:12,417 - Max [top1: 75.238 (epoch: 150)] [top1-ema: 79.294 (epoch: 155)] 2024-10-12 11:33:12,417 - ==> Total time: 23:46:16 Eta: 22:14:15 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 11:33:38,219 - Train: 51.68% [193950/375300] [155.0/300.0] [batch_t 0.516 (0.472)] [data_t 0.222] [optim_t 0.294] [lr 0.001437] [CE 3.321 (3.494)] [KD 0.000 (0.000)] 2024-10-12 11:33:59,447 - Train: 51.69% [194000/375300] [155.1/300.0] [batch_t 0.433 (0.424)] [data_t 0.015] [optim_t 0.417] [lr 0.001436] [CE 3.372 (3.436)] [KD 0.000 (0.000)] 2024-10-12 11:34:21,033 - Train: 51.71% [194050/375300] [155.1/300.0] [batch_t 0.404 (0.432)] [data_t 0.016] [optim_t 0.389] [lr 0.001435] [CE 3.047 (3.468)] [KD 0.000 (0.000)] 2024-10-12 11:34:43,383 - Train: 51.72% [194100/375300] [155.2/300.0] [batch_t 0.447 (0.447)] [data_t 0.015] [optim_t 0.431] [lr 0.001435] [CE 3.673 (3.483)] [KD 0.000 (0.000)] 2024-10-12 11:35:05,646 - Train: 51.73% [194150/375300] [155.2/300.0] [batch_t 0.421 (0.445)] [data_t 0.016] [optim_t 0.406] [lr 0.001434] [CE 3.455 (3.489)] [KD 0.000 (0.000)] 2024-10-12 11:35:27,539 - Train: 51.75% [194200/375300] [155.2/300.0] [batch_t 0.314 (0.438)] [data_t 0.015] [optim_t 0.298] [lr 0.001434] [CE 3.442 (3.452)] [KD 0.000 (0.000)] 2024-10-12 11:35:49,917 - Train: 51.76% [194250/375300] [155.3/300.0] [batch_t 0.430 (0.447)] [data_t 0.016] [optim_t 0.414] [lr 0.001433] [CE 3.351 (3.459)] [KD 0.000 (0.000)] 2024-10-12 11:36:11,561 - Train: 51.77% [194300/375300] [155.3/300.0] [batch_t 0.436 (0.433)] [data_t 0.016] [optim_t 0.420] [lr 0.001432] [CE 3.748 (3.430)] [KD 0.000 (0.000)] 2024-10-12 11:36:32,552 - Train: 51.79% [194350/375300] [155.4/300.0] [batch_t 0.511 (0.420)] [data_t 0.015] [optim_t 0.496] [lr 0.001432] [CE 3.424 (3.444)] [KD 0.000 (0.000)] 2024-10-12 11:36:54,082 - Train: 51.80% [194400/375300] [155.4/300.0] [batch_t 0.445 (0.430)] [data_t 0.016] [optim_t 0.429] [lr 0.001431] [CE 3.442 (3.475)] [KD 0.000 (0.000)] 2024-10-12 11:37:16,020 - Train: 51.81% [194450/375300] [155.4/300.0] [batch_t 0.472 (0.439)] [data_t 0.015] [optim_t 0.457] [lr 0.001431] [CE 3.450 (3.467)] [KD 0.000 (0.000)] 2024-10-12 11:37:37,602 - Train: 51.83% [194500/375300] [155.5/300.0] [batch_t 0.316 (0.432)] [data_t 0.015] [optim_t 0.301] [lr 0.001430] [CE 3.559 (3.493)] [KD 0.000 (0.000)] 2024-10-12 11:37:59,553 - Train: 51.84% [194550/375300] [155.5/300.0] [batch_t 0.414 (0.439)] [data_t 0.015] [optim_t 0.398] [lr 0.001429] [CE 3.663 (3.504)] [KD 0.000 (0.000)] 2024-10-12 11:38:21,995 - Train: 51.85% [194600/375300] [155.6/300.0] [batch_t 0.434 (0.449)] [data_t 0.016] [optim_t 0.418] [lr 0.001429] [CE 3.406 (3.506)] [KD 0.000 (0.000)] 2024-10-12 11:38:44,133 - Train: 51.87% [194650/375300] [155.6/300.0] [batch_t 0.885 (0.443)] [data_t 0.016] [optim_t 0.870] [lr 0.001428] [CE 3.430 (3.529)] [KD 0.000 (0.000)] 2024-10-12 11:39:05,160 - Train: 51.88% [194700/375300] [155.6/300.0] [batch_t 0.495 (0.420)] [data_t 0.016] [optim_t 0.479] [lr 0.001427] [CE 3.765 (3.475)] [KD 0.000 (0.000)] 2024-10-12 11:39:27,105 - Train: 51.89% [194750/375300] [155.7/300.0] [batch_t 0.434 (0.439)] [data_t 0.016] [optim_t 0.418] [lr 0.001427] [CE 3.612 (3.475)] [KD 0.000 (0.000)] 2024-10-12 11:39:48,659 - Train: 51.91% [194800/375300] [155.7/300.0] [batch_t 0.464 (0.431)] [data_t 0.015] [optim_t 0.449] [lr 0.001426] [CE 3.514 (3.467)] [KD 0.000 (0.000)] 2024-10-12 11:40:10,263 - Train: 51.92% [194850/375300] [155.8/300.0] [batch_t 0.314 (0.432)] [data_t 0.016] [optim_t 0.298] [lr 0.001426] [CE 3.360 (3.540)] [KD 0.000 (0.000)] 2024-10-12 11:40:31,743 - Train: 51.93% [194900/375300] [155.8/300.0] [batch_t 0.419 (0.429)] [data_t 0.015] [optim_t 0.404] [lr 0.001425] [CE 3.304 (3.462)] [KD 0.000 (0.000)] 2024-10-12 11:40:53,061 - Train: 51.95% [194950/375300] [155.8/300.0] [batch_t 0.443 (0.426)] [data_t 0.015] [optim_t 0.428] [lr 0.001424] [CE 3.367 (3.485)] [KD 0.000 (0.000)] 2024-10-12 11:41:14,494 - Train: 51.96% [195000/375300] [155.9/300.0] [batch_t 0.492 (0.429)] [data_t 0.016] [optim_t 0.477] [lr 0.001424] [CE 3.569 (3.500)] [KD 0.000 (0.000)] 2024-10-12 11:41:36,649 - Train: 51.97% [195050/375300] [155.9/300.0] [batch_t 0.434 (0.443)] [data_t 0.016] [optim_t 0.419] [lr 0.001423] [CE 3.483 (3.475)] [KD 0.000 (0.000)] 2024-10-12 11:41:57,823 - Train: 51.99% [195100/375300] [156.0/300.0] [batch_t 0.400 (0.423)] [data_t 0.015] [optim_t 0.384] [lr 0.001422] [CE 3.477 (3.482)] [KD 0.000 (0.000)] 2024-10-12 11:42:18,756 - Train: 52.00% [195150/375300] [156.0/300.0] [batch_t 0.307 (0.419)] [data_t 0.015] [optim_t 0.292] [lr 0.001422] [CE 3.082 (3.488)] [KD 0.000 (0.000)] 2024-10-12 11:42:20,636 - ==> Total time: 23:55:24 Eta: 22:04:59 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 11:42:44,710 - Train: 52.01% [195200/375300] [156.0/300.0] [batch_t 0.388 (0.507)] [data_t 0.094] [optim_t 0.294] [lr 0.001421] [CE 3.520 (3.426)] [KD 0.000 (0.000)] 2024-10-12 11:43:06,393 - Train: 52.03% [195250/375300] [156.1/300.0] [batch_t 0.418 (0.434)] [data_t 0.125] [optim_t 0.293] [lr 0.001421] [CE 3.289 (3.527)] [KD 0.000 (0.000)] 2024-10-12 11:43:27,924 - Train: 52.04% [195300/375300] [156.1/300.0] [batch_t 0.412 (0.431)] [data_t 0.015] [optim_t 0.396] [lr 0.001420] [CE 3.713 (3.448)] [KD 0.000 (0.000)] 2024-10-12 11:43:49,807 - Train: 52.05% [195350/375300] [156.2/300.0] [batch_t 0.513 (0.438)] [data_t 0.218] [optim_t 0.294] [lr 0.001419] [CE 3.450 (3.482)] [KD 0.000 (0.000)] 2024-10-12 11:44:11,083 - Train: 52.07% [195400/375300] [156.2/300.0] [batch_t 0.401 (0.425)] [data_t 0.101] [optim_t 0.299] [lr 0.001419] [CE 3.480 (3.474)] [KD 0.000 (0.000)] 2024-10-12 11:44:31,588 - Train: 52.08% [195450/375300] [156.2/300.0] [batch_t 0.471 (0.410)] [data_t 0.171] [optim_t 0.299] [lr 0.001418] [CE 3.418 (3.441)] [KD 0.000 (0.000)] 2024-10-12 11:44:54,022 - Train: 52.09% [195500/375300] [156.3/300.0] [batch_t 0.502 (0.449)] [data_t 0.016] [optim_t 0.486] [lr 0.001418] [CE 3.724 (3.452)] [KD 0.000 (0.000)] 2024-10-12 11:45:16,093 - Train: 52.10% [195550/375300] [156.3/300.0] [batch_t 0.382 (0.441)] [data_t 0.015] [optim_t 0.366] [lr 0.001417] [CE 3.904 (3.496)] [KD 0.000 (0.000)] 2024-10-12 11:45:37,517 - Train: 52.12% [195600/375300] [156.4/300.0] [batch_t 0.501 (0.428)] [data_t 0.015] [optim_t 0.485] [lr 0.001416] [CE 3.561 (3.455)] [KD 0.000 (0.000)] 2024-10-12 11:45:58,262 - Train: 52.13% [195650/375300] [156.4/300.0] [batch_t 0.344 (0.415)] [data_t 0.015] [optim_t 0.329] [lr 0.001416] [CE 3.591 (3.446)] [KD 0.000 (0.000)] 2024-10-12 11:46:19,833 - Train: 52.14% [195700/375300] [156.4/300.0] [batch_t 0.519 (0.431)] [data_t 0.015] [optim_t 0.503] [lr 0.001415] [CE 3.340 (3.483)] [KD 0.000 (0.000)] 2024-10-12 11:46:41,402 - Train: 52.16% [195750/375300] [156.5/300.0] [batch_t 0.318 (0.431)] [data_t 0.016] [optim_t 0.302] [lr 0.001414] [CE 3.506 (3.509)] [KD 0.000 (0.000)] 2024-10-12 11:47:02,791 - Train: 52.17% [195800/375300] [156.5/300.0] [batch_t 0.464 (0.428)] [data_t 0.015] [optim_t 0.448] [lr 0.001414] [CE 3.497 (3.441)] [KD 0.000 (0.000)] 2024-10-12 11:47:24,908 - Train: 52.18% [195850/375300] [156.6/300.0] [batch_t 0.419 (0.442)] [data_t 0.015] [optim_t 0.404] [lr 0.001413] [CE 3.129 (3.456)] [KD 0.000 (0.000)] 2024-10-12 11:47:47,135 - Train: 52.20% [195900/375300] [156.6/300.0] [batch_t 0.433 (0.444)] [data_t 0.015] [optim_t 0.417] [lr 0.001413] [CE 3.266 (3.483)] [KD 0.000 (0.000)] 2024-10-12 11:48:08,461 - Train: 52.21% [195950/375300] [156.6/300.0] [batch_t 0.428 (0.426)] [data_t 0.015] [optim_t 0.413] [lr 0.001412] [CE 3.464 (3.481)] [KD 0.000 (0.000)] 2024-10-12 11:48:30,567 - Train: 52.22% [196000/375300] [156.7/300.0] [batch_t 0.469 (0.442)] [data_t 0.015] [optim_t 0.453] [lr 0.001411] [CE 3.483 (3.464)] [KD 0.000 (0.000)] 2024-10-12 11:48:53,275 - Train: 52.24% [196050/375300] [156.7/300.0] [batch_t 0.312 (0.454)] [data_t 0.015] [optim_t 0.297] [lr 0.001411] [CE 3.346 (3.480)] [KD 0.000 (0.000)] 2024-10-12 11:49:14,673 - Train: 52.25% [196100/375300] [156.8/300.0] [batch_t 0.384 (0.428)] [data_t 0.016] [optim_t 0.368] [lr 0.001410] [CE 3.288 (3.502)] [KD 0.000 (0.000)] 2024-10-12 11:49:35,496 - Train: 52.26% [196150/375300] [156.8/300.0] [batch_t 0.400 (0.416)] [data_t 0.015] [optim_t 0.385] [lr 0.001409] [CE 3.296 (3.482)] [KD 0.000 (0.000)] 2024-10-12 11:49:56,916 - Train: 52.28% [196200/375300] [156.8/300.0] [batch_t 0.485 (0.428)] [data_t 0.015] [optim_t 0.470] [lr 0.001409] [CE 3.589 (3.486)] [KD 0.000 (0.000)] 2024-10-12 11:50:18,500 - Train: 52.29% [196250/375300] [156.9/300.0] [batch_t 0.313 (0.432)] [data_t 0.015] [optim_t 0.298] [lr 0.001408] [CE 3.708 (3.499)] [KD 0.000 (0.000)] 2024-10-12 11:50:39,354 - Train: 52.30% [196300/375300] [156.9/300.0] [batch_t 0.475 (0.417)] [data_t 0.015] [optim_t 0.460] [lr 0.001408] [CE 3.671 (3.496)] [KD 0.000 (0.000)] 2024-10-12 11:51:01,172 - Train: 52.32% [196350/375300] [157.0/300.0] [batch_t 0.373 (0.436)] [data_t 0.015] [optim_t 0.358] [lr 0.001407] [CE 3.111 (3.462)] [KD 0.000 (0.000)] 2024-10-12 11:51:22,540 - Train: 52.33% [196400/375300] [157.0/300.0] [batch_t 0.307 (0.427)] [data_t 0.015] [optim_t 0.292] [lr 0.001406] [CE 3.762 (3.476)] [KD 0.000 (0.000)] 2024-10-12 11:51:24,758 - ==> Total time: 1 day, 0:04:28 Eta: 21:55:40 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 11:51:47,792 - Train: 52.34% [196450/375300] [157.0/300.0] [batch_t 0.541 (0.505)] [data_t 0.015] [optim_t 0.525] [lr 0.001406] [CE 3.106 (3.411)] [KD 0.000 (0.000)] 2024-10-12 11:52:09,438 - Train: 52.36% [196500/375300] [157.1/300.0] [batch_t 0.406 (0.433)] [data_t 0.015] [optim_t 0.390] [lr 0.001405] [CE 3.525 (3.441)] [KD 0.000 (0.000)] 2024-10-12 11:52:31,458 - Train: 52.37% [196550/375300] [157.1/300.0] [batch_t 0.498 (0.440)] [data_t 0.015] [optim_t 0.483] [lr 0.001404] [CE 3.307 (3.461)] [KD 0.000 (0.000)] 2024-10-12 11:52:53,350 - Train: 52.38% [196600/375300] [157.2/300.0] [batch_t 0.311 (0.438)] [data_t 0.015] [optim_t 0.295] [lr 0.001404] [CE 3.439 (3.452)] [KD 0.000 (0.000)] 2024-10-12 11:53:16,478 - Train: 52.40% [196650/375300] [157.2/300.0] [batch_t 0.445 (0.462)] [data_t 0.015] [optim_t 0.429] [lr 0.001403] [CE 3.196 (3.457)] [KD 0.000 (0.000)] 2024-10-12 11:53:39,144 - Train: 52.41% [196700/375300] [157.2/300.0] [batch_t 0.415 (0.453)] [data_t 0.015] [optim_t 0.400] [lr 0.001403] [CE 3.571 (3.480)] [KD 0.000 (0.000)] 2024-10-12 11:54:01,413 - Train: 52.42% [196750/375300] [157.3/300.0] [batch_t 0.418 (0.445)] [data_t 0.015] [optim_t 0.403] [lr 0.001402] [CE 3.685 (3.463)] [KD 0.000 (0.000)] 2024-10-12 11:54:23,335 - Train: 52.44% [196800/375300] [157.3/300.0] [batch_t 0.503 (0.438)] [data_t 0.015] [optim_t 0.488] [lr 0.001401] [CE 3.378 (3.471)] [KD 0.000 (0.000)] 2024-10-12 11:54:44,509 - Train: 52.45% [196850/375300] [157.4/300.0] [batch_t 0.445 (0.423)] [data_t 0.015] [optim_t 0.429] [lr 0.001401] [CE 3.636 (3.498)] [KD 0.000 (0.000)] 2024-10-12 11:55:07,271 - Train: 52.46% [196900/375300] [157.4/300.0] [batch_t 0.429 (0.455)] [data_t 0.015] [optim_t 0.414] [lr 0.001400] [CE 3.662 (3.475)] [KD 0.000 (0.000)] 2024-10-12 11:55:29,358 - Train: 52.48% [196950/375300] [157.4/300.0] [batch_t 0.338 (0.442)] [data_t 0.015] [optim_t 0.323] [lr 0.001400] [CE 3.464 (3.473)] [KD 0.000 (0.000)] 2024-10-12 11:55:51,432 - Train: 52.49% [197000/375300] [157.5/300.0] [batch_t 0.335 (0.441)] [data_t 0.015] [optim_t 0.320] [lr 0.001399] [CE 3.586 (3.414)] [KD 0.000 (0.000)] 2024-10-12 11:56:14,062 - Train: 52.50% [197050/375300] [157.5/300.0] [batch_t 0.518 (0.452)] [data_t 0.015] [optim_t 0.503] [lr 0.001398] [CE 3.561 (3.431)] [KD 0.000 (0.000)] 2024-10-12 11:56:36,753 - Train: 52.52% [197100/375300] [157.6/300.0] [batch_t 0.502 (0.454)] [data_t 0.015] [optim_t 0.486] [lr 0.001398] [CE 3.009 (3.413)] [KD 0.000 (0.000)] 2024-10-12 11:56:57,589 - Train: 52.53% [197150/375300] [157.6/300.0] [batch_t 0.413 (0.417)] [data_t 0.015] [optim_t 0.398] [lr 0.001397] [CE 3.404 (3.477)] [KD 0.000 (0.000)] 2024-10-12 11:57:18,714 - Train: 52.54% [197200/375300] [157.6/300.0] [batch_t 0.412 (0.422)] [data_t 0.015] [optim_t 0.397] [lr 0.001396] [CE 3.648 (3.482)] [KD 0.000 (0.000)] 2024-10-12 11:57:40,739 - Train: 52.56% [197250/375300] [157.7/300.0] [batch_t 0.362 (0.440)] [data_t 0.015] [optim_t 0.347] [lr 0.001396] [CE 3.210 (3.448)] [KD 0.000 (0.000)] 2024-10-12 11:58:02,572 - Train: 52.57% [197300/375300] [157.7/300.0] [batch_t 0.387 (0.437)] [data_t 0.015] [optim_t 0.372] [lr 0.001395] [CE 3.307 (3.432)] [KD 0.000 (0.000)] 2024-10-12 11:58:25,191 - Train: 52.58% [197350/375300] [157.8/300.0] [batch_t 0.404 (0.452)] [data_t 0.015] [optim_t 0.389] [lr 0.001395] [CE 3.580 (3.448)] [KD 0.000 (0.000)] 2024-10-12 11:58:46,572 - Train: 52.60% [197400/375300] [157.8/300.0] [batch_t 0.394 (0.428)] [data_t 0.016] [optim_t 0.378] [lr 0.001394] [CE 3.599 (3.484)] [KD 0.000 (0.000)] 2024-10-12 11:59:09,076 - Train: 52.61% [197450/375300] [157.8/300.0] [batch_t 0.373 (0.450)] [data_t 0.077] [optim_t 0.296] [lr 0.001393] [CE 3.800 (3.515)] [KD 0.000 (0.000)] 2024-10-12 11:59:31,005 - Train: 52.62% [197500/375300] [157.9/300.0] [batch_t 0.452 (0.438)] [data_t 0.151] [optim_t 0.301] [lr 0.001393] [CE 3.603 (3.479)] [KD 0.000 (0.000)] 2024-10-12 11:59:52,987 - Train: 52.64% [197550/375300] [157.9/300.0] [batch_t 0.444 (0.439)] [data_t 0.152] [optim_t 0.293] [lr 0.001392] [CE 3.566 (3.471)] [KD 0.000 (0.000)] 2024-10-12 12:00:15,273 - Train: 52.65% [197600/375300] [158.0/300.0] [batch_t 0.472 (0.446)] [data_t 0.179] [optim_t 0.293] [lr 0.001391] [CE 3.583 (3.481)] [KD 0.000 (0.000)] 2024-10-12 12:00:36,607 - Train: 52.66% [197650/375300] [158.0/300.0] [batch_t 0.310 (0.427)] [data_t 0.015] [optim_t 0.295] [lr 0.001391] [CE 3.418 (3.444)] [KD 0.000 (0.000)] 2024-10-12 12:00:39,089 - ==> Total time: 1 day, 0:13:43 Eta: 21:46:30 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 12:01:02,304 - Train: 52.68% [197700/375300] [158.0/300.0] [batch_t 0.309 (0.516)] [data_t 0.016] [optim_t 0.294] [lr 0.001390] [CE 3.921 (3.457)] [KD 0.000 (0.000)] 2024-10-12 12:01:24,300 - Train: 52.69% [197750/375300] [158.1/300.0] [batch_t 0.455 (0.440)] [data_t 0.015] [optim_t 0.439] [lr 0.001390] [CE 3.425 (3.497)] [KD 0.000 (0.000)] 2024-10-12 12:01:46,303 - Train: 52.70% [197800/375300] [158.1/300.0] [batch_t 0.458 (0.440)] [data_t 0.016] [optim_t 0.442] [lr 0.001389] [CE 3.520 (3.433)] [KD 0.000 (0.000)] 2024-10-12 12:02:07,801 - Train: 52.72% [197850/375300] [158.2/300.0] [batch_t 0.316 (0.430)] [data_t 0.015] [optim_t 0.301] [lr 0.001388] [CE 3.664 (3.448)] [KD 0.000 (0.000)] 2024-10-12 12:02:29,593 - Train: 52.73% [197900/375300] [158.2/300.0] [batch_t 0.460 (0.436)] [data_t 0.015] [optim_t 0.444] [lr 0.001388] [CE 3.622 (3.422)] [KD 0.000 (0.000)] 2024-10-12 12:02:51,253 - Train: 52.74% [197950/375300] [158.2/300.0] [batch_t 0.309 (0.433)] [data_t 0.015] [optim_t 0.293] [lr 0.001387] [CE 3.723 (3.463)] [KD 0.000 (0.000)] 2024-10-12 12:03:12,587 - Train: 52.76% [198000/375300] [158.3/300.0] [batch_t 0.428 (0.427)] [data_t 0.015] [optim_t 0.413] [lr 0.001387] [CE 3.549 (3.439)] [KD 0.000 (0.000)] 2024-10-12 12:03:33,938 - Train: 52.77% [198050/375300] [158.3/300.0] [batch_t 0.437 (0.427)] [data_t 0.016] [optim_t 0.421] [lr 0.001386] [CE 3.181 (3.483)] [KD 0.000 (0.000)] 2024-10-12 12:03:54,724 - Train: 52.78% [198100/375300] [158.4/300.0] [batch_t 0.319 (0.416)] [data_t 0.016] [optim_t 0.304] [lr 0.001385] [CE 3.714 (3.505)] [KD 0.000 (0.000)] 2024-10-12 12:04:16,708 - Train: 52.80% [198150/375300] [158.4/300.0] [batch_t 0.439 (0.440)] [data_t 0.016] [optim_t 0.423] [lr 0.001385] [CE 3.351 (3.473)] [KD 0.000 (0.000)] 2024-10-12 12:04:38,556 - Train: 52.81% [198200/375300] [158.4/300.0] [batch_t 0.433 (0.437)] [data_t 0.016] [optim_t 0.417] [lr 0.001384] [CE 3.559 (3.427)] [KD 0.000 (0.000)] 2024-10-12 12:05:00,340 - Train: 52.82% [198250/375300] [158.5/300.0] [batch_t 0.441 (0.436)] [data_t 0.015] [optim_t 0.426] [lr 0.001383] [CE 3.598 (3.432)] [KD 0.000 (0.000)] 2024-10-12 12:05:22,208 - Train: 52.84% [198300/375300] [158.5/300.0] [batch_t 0.506 (0.437)] [data_t 0.015] [optim_t 0.491] [lr 0.001383] [CE 3.506 (3.494)] [KD 0.000 (0.000)] 2024-10-12 12:05:43,817 - Train: 52.85% [198350/375300] [158.6/300.0] [batch_t 0.366 (0.432)] [data_t 0.015] [optim_t 0.350] [lr 0.001382] [CE 3.397 (3.458)] [KD 0.000 (0.000)] 2024-10-12 12:06:05,458 - Train: 52.86% [198400/375300] [158.6/300.0] [batch_t 0.442 (0.433)] [data_t 0.015] [optim_t 0.426] [lr 0.001382] [CE 3.328 (3.430)] [KD 0.000 (0.000)] 2024-10-12 12:06:27,227 - Train: 52.88% [198450/375300] [158.6/300.0] [batch_t 0.479 (0.435)] [data_t 0.015] [optim_t 0.464] [lr 0.001381] [CE 3.403 (3.489)] [KD 0.000 (0.000)] 2024-10-12 12:06:49,249 - Train: 52.89% [198500/375300] [158.7/300.0] [batch_t 0.463 (0.440)] [data_t 0.015] [optim_t 0.448] [lr 0.001380] [CE 3.278 (3.479)] [KD 0.000 (0.000)] 2024-10-12 12:07:11,406 - Train: 52.90% [198550/375300] [158.7/300.0] [batch_t 0.359 (0.443)] [data_t 0.015] [optim_t 0.343] [lr 0.001380] [CE 3.362 (3.430)] [KD 0.000 (0.000)] 2024-10-12 12:07:33,273 - Train: 52.92% [198600/375300] [158.8/300.0] [batch_t 0.413 (0.437)] [data_t 0.016] [optim_t 0.397] [lr 0.001379] [CE 3.523 (3.485)] [KD 0.000 (0.000)] 2024-10-12 12:07:55,185 - Train: 52.93% [198650/375300] [158.8/300.0] [batch_t 0.483 (0.438)] [data_t 0.016] [optim_t 0.467] [lr 0.001378] [CE 3.419 (3.491)] [KD 0.000 (0.000)] 2024-10-12 12:08:16,903 - Train: 52.94% [198700/375300] [158.8/300.0] [batch_t 0.319 (0.434)] [data_t 0.015] [optim_t 0.303] [lr 0.001378] [CE 3.555 (3.497)] [KD 0.000 (0.000)] 2024-10-12 12:08:38,862 - Train: 52.96% [198750/375300] [158.9/300.0] [batch_t 0.428 (0.439)] [data_t 0.016] [optim_t 0.412] [lr 0.001377] [CE 3.002 (3.461)] [KD 0.000 (0.000)] 2024-10-12 12:09:01,027 - Train: 52.97% [198800/375300] [158.9/300.0] [batch_t 0.428 (0.443)] [data_t 0.015] [optim_t 0.413] [lr 0.001377] [CE 3.690 (3.528)] [KD 0.000 (0.000)] 2024-10-12 12:09:23,386 - Train: 52.98% [198850/375300] [159.0/300.0] [batch_t 0.457 (0.447)] [data_t 0.015] [optim_t 0.441] [lr 0.001376] [CE 3.351 (3.457)] [KD 0.000 (0.000)] 2024-10-12 12:09:44,542 - Train: 53.00% [198900/375300] [159.0/300.0] [batch_t 0.313 (0.423)] [data_t 0.015] [optim_t 0.298] [lr 0.001375] [CE 3.184 (3.457)] [KD 0.000 (0.000)] 2024-10-12 12:09:47,355 - ==> Total time: 1 day, 0:22:51 Eta: 21:37:14 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 12:10:10,068 - Train: 53.01% [198950/375300] [159.0/300.0] [batch_t 0.723 (0.514)] [data_t 0.016] [optim_t 0.707] [lr 0.001375] [CE 3.660 (3.406)] [KD 0.000 (0.000)] 2024-10-12 12:10:32,256 - Train: 53.02% [199000/375300] [159.1/300.0] [batch_t 0.444 (0.444)] [data_t 0.015] [optim_t 0.428] [lr 0.001374] [CE 3.452 (3.439)] [KD 0.000 (0.000)] 2024-10-12 12:10:53,992 - Train: 53.04% [199050/375300] [159.1/300.0] [batch_t 0.326 (0.435)] [data_t 0.016] [optim_t 0.311] [lr 0.001374] [CE 3.402 (3.455)] [KD 0.000 (0.000)] 2024-10-12 12:11:15,746 - Train: 53.05% [199100/375300] [159.2/300.0] [batch_t 0.427 (0.435)] [data_t 0.016] [optim_t 0.411] [lr 0.001373] [CE 3.571 (3.466)] [KD 0.000 (0.000)] 2024-10-12 12:11:38,362 - Train: 53.06% [199150/375300] [159.2/300.0] [batch_t 0.442 (0.452)] [data_t 0.015] [optim_t 0.427] [lr 0.001372] [CE 3.315 (3.460)] [KD 0.000 (0.000)] 2024-10-12 12:12:00,444 - Train: 53.08% [199200/375300] [159.2/300.0] [batch_t 0.410 (0.442)] [data_t 0.015] [optim_t 0.395] [lr 0.001372] [CE 3.461 (3.457)] [KD 0.000 (0.000)] 2024-10-12 12:12:22,537 - Train: 53.09% [199250/375300] [159.3/300.0] [batch_t 0.453 (0.442)] [data_t 0.015] [optim_t 0.438] [lr 0.001371] [CE 3.119 (3.442)] [KD 0.000 (0.000)] 2024-10-12 12:12:44,131 - Train: 53.10% [199300/375300] [159.3/300.0] [batch_t 0.414 (0.432)] [data_t 0.016] [optim_t 0.399] [lr 0.001370] [CE 3.157 (3.453)] [KD 0.000 (0.000)] 2024-10-12 12:13:06,457 - Train: 53.12% [199350/375300] [159.4/300.0] [batch_t 0.464 (0.446)] [data_t 0.016] [optim_t 0.449] [lr 0.001370] [CE 3.846 (3.448)] [KD 0.000 (0.000)] 2024-10-12 12:13:28,931 - Train: 53.13% [199400/375300] [159.4/300.0] [batch_t 0.435 (0.449)] [data_t 0.015] [optim_t 0.420] [lr 0.001369] [CE 3.372 (3.467)] [KD 0.000 (0.000)] 2024-10-12 12:13:51,317 - Train: 53.14% [199450/375300] [159.4/300.0] [batch_t 0.424 (0.448)] [data_t 0.016] [optim_t 0.408] [lr 0.001369] [CE 3.720 (3.477)] [KD 0.000 (0.000)] 2024-10-12 12:14:13,763 - Train: 53.16% [199500/375300] [159.5/300.0] [batch_t 0.414 (0.449)] [data_t 0.016] [optim_t 0.398] [lr 0.001368] [CE 3.508 (3.454)] [KD 0.000 (0.000)] 2024-10-12 12:14:35,832 - Train: 53.17% [199550/375300] [159.5/300.0] [batch_t 0.415 (0.441)] [data_t 0.015] [optim_t 0.400] [lr 0.001367] [CE 3.312 (3.479)] [KD 0.000 (0.000)] 2024-10-12 12:14:58,749 - Train: 53.18% [199600/375300] [159.6/300.0] [batch_t 0.445 (0.458)] [data_t 0.015] [optim_t 0.429] [lr 0.001367] [CE 3.241 (3.426)] [KD 0.000 (0.000)] 2024-10-12 12:15:21,232 - Train: 53.20% [199650/375300] [159.6/300.0] [batch_t 0.521 (0.450)] [data_t 0.016] [optim_t 0.505] [lr 0.001366] [CE 3.347 (3.495)] [KD 0.000 (0.000)] 2024-10-12 12:15:43,834 - Train: 53.21% [199700/375300] [159.6/300.0] [batch_t 0.315 (0.452)] [data_t 0.016] [optim_t 0.299] [lr 0.001365] [CE 3.644 (3.463)] [KD 0.000 (0.000)] 2024-10-12 12:16:06,630 - Train: 53.22% [199750/375300] [159.7/300.0] [batch_t 0.428 (0.456)] [data_t 0.015] [optim_t 0.412] [lr 0.001365] [CE 3.419 (3.496)] [KD 0.000 (0.000)] 2024-10-12 12:16:28,964 - Train: 53.24% [199800/375300] [159.7/300.0] [batch_t 0.473 (0.447)] [data_t 0.016] [optim_t 0.458] [lr 0.001364] [CE 3.329 (3.472)] [KD 0.000 (0.000)] 2024-10-12 12:16:51,201 - Train: 53.25% [199850/375300] [159.8/300.0] [batch_t 0.446 (0.445)] [data_t 0.016] [optim_t 0.431] [lr 0.001364] [CE 3.320 (3.465)] [KD 0.000 (0.000)] 2024-10-12 12:17:14,092 - Train: 53.26% [199900/375300] [159.8/300.0] [batch_t 0.352 (0.458)] [data_t 0.015] [optim_t 0.336] [lr 0.001363] [CE 3.495 (3.459)] [KD 0.000 (0.000)] 2024-10-12 12:17:36,404 - Train: 53.28% [199950/375300] [159.8/300.0] [batch_t 0.404 (0.446)] [data_t 0.015] [optim_t 0.388] [lr 0.001362] [CE 3.695 (3.429)] [KD 0.000 (0.000)] 2024-10-12 12:17:58,415 - Train: 53.29% [200000/375300] [159.9/300.0] [batch_t 0.455 (0.440)] [data_t 0.015] [optim_t 0.440] [lr 0.001362] [CE 3.400 (3.433)] [KD 0.000 (0.000)] 2024-10-12 12:18:20,632 - Train: 53.30% [200050/375300] [159.9/300.0] [batch_t 0.485 (0.444)] [data_t 0.015] [optim_t 0.470] [lr 0.001361] [CE 3.457 (3.497)] [KD 0.000 (0.000)] 2024-10-12 12:18:41,911 - Train: 53.32% [200100/375300] [160.0/300.0] [batch_t 0.402 (0.425)] [data_t 0.016] [optim_t 0.386] [lr 0.001361] [CE 3.431 (3.434)] [KD 0.000 (0.000)] 2024-10-12 12:19:03,179 - Train: 53.33% [200150/375300] [160.0/300.0] [batch_t 0.319 (0.425)] [data_t 0.015] [optim_t 0.304] [lr 0.001360] [CE 3.449 (3.420)] [KD 0.000 (0.000)] 2024-10-12 12:19:27,970 - Test (net): 100.00% [50/50] [batch_t 0.148 (0.429)] [top1_cnt 37800] [top5_cnt 46533] [top_all 50000] 2024-10-12 12:19:27,970 - net: 75.600 (93.066) 2024-10-12 12:19:50,361 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.441)] [top1_cnt 39744] [top5_cnt 47504] [top_all 50000] 2024-10-12 12:19:50,361 - net_E: 79.488 (95.008) 2024-10-12 12:19:50,511 - Max [top1: 75.600 (epoch: 160)] [top1-ema: 79.488 (epoch: 160)] 2024-10-12 12:19:50,511 - ==> Total time: 1 day, 0:32:54 Eta: 21:28:47 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 12:20:14,635 - Train: 53.34% [200200/375300] [160.0/300.0] [batch_t 0.320 (0.433)] [data_t 0.016] [optim_t 0.305] [lr 0.001359] [CE 3.716 (3.464)] [KD 0.000 (0.000)] 2024-10-12 12:20:35,856 - Train: 53.36% [200250/375300] [160.1/300.0] [batch_t 0.403 (0.424)] [data_t 0.015] [optim_t 0.388] [lr 0.001359] [CE 3.595 (3.455)] [KD 0.000 (0.000)] 2024-10-12 12:20:58,750 - Train: 53.37% [200300/375300] [160.1/300.0] [batch_t 0.415 (0.458)] [data_t 0.016] [optim_t 0.399] [lr 0.001358] [CE 3.697 (3.436)] [KD 0.000 (0.000)] 2024-10-12 12:21:20,794 - Train: 53.38% [200350/375300] [160.2/300.0] [batch_t 0.445 (0.441)] [data_t 0.016] [optim_t 0.429] [lr 0.001357] [CE 3.308 (3.430)] [KD 0.000 (0.000)] 2024-10-12 12:21:43,092 - Train: 53.40% [200400/375300] [160.2/300.0] [batch_t 0.462 (0.446)] [data_t 0.015] [optim_t 0.447] [lr 0.001357] [CE 3.150 (3.475)] [KD 0.000 (0.000)] 2024-10-12 12:22:05,125 - Train: 53.41% [200450/375300] [160.2/300.0] [batch_t 0.360 (0.441)] [data_t 0.016] [optim_t 0.345] [lr 0.001356] [CE 3.360 (3.421)] [KD 0.000 (0.000)] 2024-10-12 12:22:25,849 - Train: 53.42% [200500/375300] [160.3/300.0] [batch_t 0.393 (0.414)] [data_t 0.015] [optim_t 0.378] [lr 0.001356] [CE 3.443 (3.467)] [KD 0.000 (0.000)] 2024-10-12 12:22:47,471 - Train: 53.44% [200550/375300] [160.3/300.0] [batch_t 0.450 (0.432)] [data_t 0.152] [optim_t 0.298] [lr 0.001355] [CE 3.196 (3.489)] [KD 0.000 (0.000)] 2024-10-12 12:23:09,873 - Train: 53.45% [200600/375300] [160.4/300.0] [batch_t 0.468 (0.448)] [data_t 0.172] [optim_t 0.296] [lr 0.001354] [CE 3.553 (3.488)] [KD 0.000 (0.000)] 2024-10-12 12:23:31,695 - Train: 53.46% [200650/375300] [160.4/300.0] [batch_t 0.443 (0.436)] [data_t 0.148] [optim_t 0.295] [lr 0.001354] [CE 3.459 (3.498)] [KD 0.000 (0.000)] 2024-10-12 12:23:54,264 - Train: 53.48% [200700/375300] [160.4/300.0] [batch_t 0.408 (0.451)] [data_t 0.113] [optim_t 0.295] [lr 0.001353] [CE 3.457 (3.453)] [KD 0.000 (0.000)] 2024-10-12 12:24:15,709 - Train: 53.49% [200750/375300] [160.5/300.0] [batch_t 0.489 (0.429)] [data_t 0.015] [optim_t 0.473] [lr 0.001352] [CE 3.467 (3.475)] [KD 0.000 (0.000)] 2024-10-12 12:24:38,084 - Train: 53.50% [200800/375300] [160.5/300.0] [batch_t 0.408 (0.447)] [data_t 0.016] [optim_t 0.393] [lr 0.001352] [CE 3.343 (3.466)] [KD 0.000 (0.000)] 2024-10-12 12:24:59,165 - Train: 53.52% [200850/375300] [160.6/300.0] [batch_t 0.377 (0.422)] [data_t 0.015] [optim_t 0.362] [lr 0.001351] [CE 3.278 (3.425)] [KD 0.000 (0.000)] 2024-10-12 12:25:22,271 - Train: 53.53% [200900/375300] [160.6/300.0] [batch_t 0.452 (0.462)] [data_t 0.016] [optim_t 0.436] [lr 0.001351] [CE 3.603 (3.489)] [KD 0.000 (0.000)] 2024-10-12 12:25:43,575 - Train: 53.54% [200950/375300] [160.6/300.0] [batch_t 0.427 (0.426)] [data_t 0.015] [optim_t 0.411] [lr 0.001350] [CE 3.620 (3.415)] [KD 0.000 (0.000)] 2024-10-12 12:26:05,106 - Train: 53.56% [201000/375300] [160.7/300.0] [batch_t 0.513 (0.430)] [data_t 0.016] [optim_t 0.497] [lr 0.001349] [CE 3.547 (3.474)] [KD 0.000 (0.000)] 2024-10-12 12:26:27,021 - Train: 53.57% [201050/375300] [160.7/300.0] [batch_t 0.444 (0.438)] [data_t 0.015] [optim_t 0.429] [lr 0.001349] [CE 3.518 (3.478)] [KD 0.000 (0.000)] 2024-10-12 12:26:49,010 - Train: 53.58% [201100/375300] [160.8/300.0] [batch_t 0.404 (0.440)] [data_t 0.016] [optim_t 0.389] [lr 0.001348] [CE 3.482 (3.466)] [KD 0.000 (0.000)] 2024-10-12 12:27:10,242 - Train: 53.60% [201150/375300] [160.8/300.0] [batch_t 0.460 (0.425)] [data_t 0.015] [optim_t 0.444] [lr 0.001348] [CE 3.710 (3.467)] [KD 0.000 (0.000)] 2024-10-12 12:27:32,784 - Train: 53.61% [201200/375300] [160.8/300.0] [batch_t 0.451 (0.451)] [data_t 0.016] [optim_t 0.435] [lr 0.001347] [CE 3.538 (3.398)] [KD 0.000 (0.000)] 2024-10-12 12:27:54,187 - Train: 53.62% [201250/375300] [160.9/300.0] [batch_t 0.407 (0.428)] [data_t 0.015] [optim_t 0.392] [lr 0.001346] [CE 3.626 (3.495)] [KD 0.000 (0.000)] 2024-10-12 12:28:16,114 - Train: 53.64% [201300/375300] [160.9/300.0] [batch_t 0.375 (0.438)] [data_t 0.015] [optim_t 0.360] [lr 0.001346] [CE 3.552 (3.442)] [KD 0.000 (0.000)] 2024-10-12 12:28:38,392 - Train: 53.65% [201350/375300] [161.0/300.0] [batch_t 0.513 (0.445)] [data_t 0.015] [optim_t 0.498] [lr 0.001345] [CE 3.642 (3.490)] [KD 0.000 (0.000)] 2024-10-12 12:28:59,809 - Train: 53.66% [201400/375300] [161.0/300.0] [batch_t 0.352 (0.428)] [data_t 0.015] [optim_t 0.337] [lr 0.001344] [CE 3.366 (3.434)] [KD 0.000 (0.000)] 2024-10-12 12:29:03,393 - ==> Total time: 1 day, 0:42:07 Eta: 21:19:35 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 12:29:25,547 - Train: 53.68% [201450/375300] [161.0/300.0] [batch_t 0.318 (0.456)] [data_t 0.015] [optim_t 0.303] [lr 0.001344] [CE 3.678 (3.472)] [KD 0.000 (0.000)] 2024-10-12 12:29:48,118 - Train: 53.69% [201500/375300] [161.1/300.0] [batch_t 0.499 (0.451)] [data_t 0.015] [optim_t 0.484] [lr 0.001343] [CE 3.678 (3.438)] [KD 0.000 (0.000)] 2024-10-12 12:30:10,754 - Train: 53.70% [201550/375300] [161.1/300.0] [batch_t 0.442 (0.453)] [data_t 0.015] [optim_t 0.426] [lr 0.001343] [CE 3.497 (3.413)] [KD 0.000 (0.000)] 2024-10-12 12:30:32,968 - Train: 53.72% [201600/375300] [161.2/300.0] [batch_t 0.454 (0.444)] [data_t 0.015] [optim_t 0.439] [lr 0.001342] [CE 3.372 (3.446)] [KD 0.000 (0.000)] 2024-10-12 12:30:54,371 - Train: 53.73% [201650/375300] [161.2/300.0] [batch_t 0.415 (0.428)] [data_t 0.016] [optim_t 0.400] [lr 0.001341] [CE 3.376 (3.466)] [KD 0.000 (0.000)] 2024-10-12 12:31:15,855 - Train: 53.74% [201700/375300] [161.2/300.0] [batch_t 0.396 (0.430)] [data_t 0.015] [optim_t 0.381] [lr 0.001341] [CE 3.655 (3.494)] [KD 0.000 (0.000)] 2024-10-12 12:31:36,617 - Train: 53.76% [201750/375300] [161.3/300.0] [batch_t 0.443 (0.415)] [data_t 0.015] [optim_t 0.428] [lr 0.001340] [CE 3.326 (3.406)] [KD 0.000 (0.000)] 2024-10-12 12:31:58,247 - Train: 53.77% [201800/375300] [161.3/300.0] [batch_t 0.466 (0.432)] [data_t 0.015] [optim_t 0.451] [lr 0.001340] [CE 3.257 (3.430)] [KD 0.000 (0.000)] 2024-10-12 12:32:20,298 - Train: 53.78% [201850/375300] [161.4/300.0] [batch_t 0.427 (0.441)] [data_t 0.016] [optim_t 0.411] [lr 0.001339] [CE 3.631 (3.461)] [KD 0.000 (0.000)] 2024-10-12 12:32:41,951 - Train: 53.80% [201900/375300] [161.4/300.0] [batch_t 0.439 (0.433)] [data_t 0.015] [optim_t 0.423] [lr 0.001338] [CE 3.243 (3.430)] [KD 0.000 (0.000)] 2024-10-12 12:33:03,972 - Train: 53.81% [201950/375300] [161.4/300.0] [batch_t 0.427 (0.440)] [data_t 0.015] [optim_t 0.412] [lr 0.001338] [CE 3.542 (3.468)] [KD 0.000 (0.000)] 2024-10-12 12:33:25,185 - Train: 53.82% [202000/375300] [161.5/300.0] [batch_t 0.317 (0.424)] [data_t 0.016] [optim_t 0.302] [lr 0.001337] [CE 3.415 (3.449)] [KD 0.000 (0.000)] 2024-10-12 12:33:47,458 - Train: 53.84% [202050/375300] [161.5/300.0] [batch_t 0.315 (0.445)] [data_t 0.015] [optim_t 0.300] [lr 0.001336] [CE 3.481 (3.431)] [KD 0.000 (0.000)] 2024-10-12 12:34:08,721 - Train: 53.85% [202100/375300] [161.6/300.0] [batch_t 0.448 (0.425)] [data_t 0.015] [optim_t 0.433] [lr 0.001336] [CE 3.559 (3.469)] [KD 0.000 (0.000)] 2024-10-12 12:34:29,977 - Train: 53.86% [202150/375300] [161.6/300.0] [batch_t 0.389 (0.425)] [data_t 0.015] [optim_t 0.374] [lr 0.001335] [CE 3.304 (3.437)] [KD 0.000 (0.000)] 2024-10-12 12:34:51,732 - Train: 53.88% [202200/375300] [161.6/300.0] [batch_t 0.417 (0.435)] [data_t 0.016] [optim_t 0.402] [lr 0.001335] [CE 3.697 (3.509)] [KD 0.000 (0.000)] 2024-10-12 12:35:13,596 - Train: 53.89% [202250/375300] [161.7/300.0] [batch_t 0.430 (0.437)] [data_t 0.015] [optim_t 0.414] [lr 0.001334] [CE 3.498 (3.500)] [KD 0.000 (0.000)] 2024-10-12 12:35:35,194 - Train: 53.90% [202300/375300] [161.7/300.0] [batch_t 0.461 (0.432)] [data_t 0.016] [optim_t 0.446] [lr 0.001333] [CE 3.421 (3.449)] [KD 0.000 (0.000)] 2024-10-12 12:35:57,189 - Train: 53.92% [202350/375300] [161.8/300.0] [batch_t 0.410 (0.440)] [data_t 0.015] [optim_t 0.395] [lr 0.001333] [CE 3.689 (3.472)] [KD 0.000 (0.000)] 2024-10-12 12:36:19,135 - Train: 53.93% [202400/375300] [161.8/300.0] [batch_t 0.375 (0.439)] [data_t 0.015] [optim_t 0.359] [lr 0.001332] [CE 3.641 (3.459)] [KD 0.000 (0.000)] 2024-10-12 12:36:41,759 - Train: 53.94% [202450/375300] [161.8/300.0] [batch_t 0.881 (0.452)] [data_t 0.016] [optim_t 0.865] [lr 0.001332] [CE 3.578 (3.479)] [KD 0.000 (0.000)] 2024-10-12 12:37:02,421 - Train: 53.96% [202500/375300] [161.9/300.0] [batch_t 0.412 (0.413)] [data_t 0.016] [optim_t 0.396] [lr 0.001331] [CE 3.287 (3.473)] [KD 0.000 (0.000)] 2024-10-12 12:37:24,669 - Train: 53.97% [202550/375300] [161.9/300.0] [batch_t 0.448 (0.445)] [data_t 0.015] [optim_t 0.432] [lr 0.001330] [CE 3.293 (3.485)] [KD 0.000 (0.000)] 2024-10-12 12:37:46,592 - Train: 53.98% [202600/375300] [162.0/300.0] [batch_t 0.426 (0.438)] [data_t 0.015] [optim_t 0.410] [lr 0.001330] [CE 3.337 (3.448)] [KD 0.000 (0.000)] 2024-10-12 12:38:08,595 - Train: 54.00% [202650/375300] [162.0/300.0] [batch_t 0.409 (0.440)] [data_t 0.015] [optim_t 0.394] [lr 0.001329] [CE 3.532 (3.425)] [KD 0.000 (0.000)] 2024-10-12 12:38:12,330 - ==> Total time: 1 day, 0:51:16 Eta: 21:10:20 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 12:38:34,043 - Train: 54.01% [202700/375300] [162.0/300.0] [batch_t 1.065 (0.538)] [data_t 0.773] [optim_t 0.292] [lr 0.001328] [CE 3.559 (3.499)] [KD 0.000 (0.000)] 2024-10-12 12:38:55,694 - Train: 54.02% [202750/375300] [162.1/300.0] [batch_t 0.389 (0.433)] [data_t 0.015] [optim_t 0.374] [lr 0.001328] [CE 2.950 (3.386)] [KD 0.000 (0.000)] 2024-10-12 12:39:17,593 - Train: 54.04% [202800/375300] [162.1/300.0] [batch_t 0.423 (0.438)] [data_t 0.016] [optim_t 0.407] [lr 0.001327] [CE 3.141 (3.416)] [KD 0.000 (0.000)] 2024-10-12 12:39:39,811 - Train: 54.05% [202850/375300] [162.2/300.0] [batch_t 0.473 (0.444)] [data_t 0.015] [optim_t 0.457] [lr 0.001327] [CE 3.472 (3.428)] [KD 0.000 (0.000)] 2024-10-12 12:40:01,461 - Train: 54.06% [202900/375300] [162.2/300.0] [batch_t 0.398 (0.433)] [data_t 0.015] [optim_t 0.383] [lr 0.001326] [CE 3.673 (3.455)] [KD 0.000 (0.000)] 2024-10-12 12:40:23,095 - Train: 54.08% [202950/375300] [162.2/300.0] [batch_t 0.523 (0.433)] [data_t 0.015] [optim_t 0.508] [lr 0.001325] [CE 3.491 (3.458)] [KD 0.000 (0.000)] 2024-10-12 12:40:45,087 - Train: 54.09% [203000/375300] [162.3/300.0] [batch_t 0.470 (0.440)] [data_t 0.016] [optim_t 0.454] [lr 0.001325] [CE 3.203 (3.427)] [KD 0.000 (0.000)] 2024-10-12 12:41:06,304 - Train: 54.10% [203050/375300] [162.3/300.0] [batch_t 0.374 (0.424)] [data_t 0.016] [optim_t 0.359] [lr 0.001324] [CE 3.506 (3.446)] [KD 0.000 (0.000)] 2024-10-12 12:41:27,344 - Train: 54.12% [203100/375300] [162.4/300.0] [batch_t 0.481 (0.421)] [data_t 0.015] [optim_t 0.466] [lr 0.001323] [CE 3.718 (3.481)] [KD 0.000 (0.000)] 2024-10-12 12:41:48,284 - Train: 54.13% [203150/375300] [162.4/300.0] [batch_t 0.432 (0.419)] [data_t 0.016] [optim_t 0.416] [lr 0.001323] [CE 3.265 (3.455)] [KD 0.000 (0.000)] 2024-10-12 12:42:09,633 - Train: 54.14% [203200/375300] [162.4/300.0] [batch_t 0.415 (0.427)] [data_t 0.015] [optim_t 0.400] [lr 0.001322] [CE 3.253 (3.493)] [KD 0.000 (0.000)] 2024-10-12 12:42:30,569 - Train: 54.16% [203250/375300] [162.5/300.0] [batch_t 0.443 (0.419)] [data_t 0.015] [optim_t 0.428] [lr 0.001322] [CE 3.804 (3.483)] [KD 0.000 (0.000)] 2024-10-12 12:42:52,073 - Train: 54.17% [203300/375300] [162.5/300.0] [batch_t 0.372 (0.430)] [data_t 0.015] [optim_t 0.357] [lr 0.001321] [CE 3.600 (3.465)] [KD 0.000 (0.000)] 2024-10-12 12:43:13,702 - Train: 54.18% [203350/375300] [162.5/300.0] [batch_t 0.502 (0.432)] [data_t 0.016] [optim_t 0.486] [lr 0.001320] [CE 3.366 (3.433)] [KD 0.000 (0.000)] 2024-10-12 12:43:35,179 - Train: 54.20% [203400/375300] [162.6/300.0] [batch_t 0.332 (0.429)] [data_t 0.015] [optim_t 0.317] [lr 0.001320] [CE 3.568 (3.434)] [KD 0.000 (0.000)] 2024-10-12 12:43:56,912 - Train: 54.21% [203450/375300] [162.6/300.0] [batch_t 0.471 (0.435)] [data_t 0.015] [optim_t 0.455] [lr 0.001319] [CE 3.463 (3.483)] [KD 0.000 (0.000)] 2024-10-12 12:44:18,461 - Train: 54.22% [203500/375300] [162.7/300.0] [batch_t 0.457 (0.431)] [data_t 0.015] [optim_t 0.441] [lr 0.001319] [CE 3.234 (3.444)] [KD 0.000 (0.000)] 2024-10-12 12:44:40,081 - Train: 54.24% [203550/375300] [162.7/300.0] [batch_t 0.407 (0.432)] [data_t 0.015] [optim_t 0.391] [lr 0.001318] [CE 3.628 (3.470)] [KD 0.000 (0.000)] 2024-10-12 12:45:01,887 - Train: 54.25% [203600/375300] [162.7/300.0] [batch_t 0.398 (0.436)] [data_t 0.016] [optim_t 0.382] [lr 0.001317] [CE 3.293 (3.489)] [KD 0.000 (0.000)] 2024-10-12 12:45:24,052 - Train: 54.26% [203650/375300] [162.8/300.0] [batch_t 0.921 (0.443)] [data_t 0.629] [optim_t 0.292] [lr 0.001317] [CE 3.789 (3.471)] [KD 0.000 (0.000)] 2024-10-12 12:45:45,438 - Train: 54.28% [203700/375300] [162.8/300.0] [batch_t 0.462 (0.428)] [data_t 0.166] [optim_t 0.296] [lr 0.001316] [CE 3.670 (3.459)] [KD 0.000 (0.000)] 2024-10-12 12:46:06,999 - Train: 54.29% [203750/375300] [162.9/300.0] [batch_t 0.457 (0.431)] [data_t 0.160] [optim_t 0.296] [lr 0.001315] [CE 3.372 (3.507)] [KD 0.000 (0.000)] 2024-10-12 12:46:28,853 - Train: 54.30% [203800/375300] [162.9/300.0] [batch_t 0.412 (0.437)] [data_t 0.117] [optim_t 0.294] [lr 0.001315] [CE 3.781 (3.452)] [KD 0.000 (0.000)] 2024-10-12 12:46:50,962 - Train: 54.32% [203850/375300] [162.9/300.0] [batch_t 0.505 (0.442)] [data_t 0.206] [optim_t 0.299] [lr 0.001314] [CE 3.697 (3.526)] [KD 0.000 (0.000)] 2024-10-12 12:47:12,916 - Train: 54.33% [203900/375300] [163.0/300.0] [batch_t 0.346 (0.439)] [data_t 0.049] [optim_t 0.297] [lr 0.001314] [CE 3.545 (3.461)] [KD 0.000 (0.000)] 2024-10-12 12:47:17,138 - ==> Total time: 1 day, 1:00:21 Eta: 21:01:01 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 12:47:39,176 - Train: 54.34% [203950/375300] [163.0/300.0] [batch_t 0.492 (0.546)] [data_t 0.015] [optim_t 0.476] [lr 0.001313] [CE 3.730 (3.483)] [KD 0.000 (0.000)] 2024-10-12 12:48:02,187 - Train: 54.36% [204000/375300] [163.1/300.0] [batch_t 0.445 (0.460)] [data_t 0.015] [optim_t 0.429] [lr 0.001312] [CE 3.588 (3.440)] [KD 0.000 (0.000)] 2024-10-12 12:48:24,962 - Train: 54.37% [204050/375300] [163.1/300.0] [batch_t 0.500 (0.455)] [data_t 0.016] [optim_t 0.484] [lr 0.001312] [CE 3.539 (3.434)] [KD 0.000 (0.000)] 2024-10-12 12:48:47,750 - Train: 54.38% [204100/375300] [163.1/300.0] [batch_t 0.391 (0.456)] [data_t 0.015] [optim_t 0.376] [lr 0.001311] [CE 3.535 (3.422)] [KD 0.000 (0.000)] 2024-10-12 12:49:10,495 - Train: 54.40% [204150/375300] [163.2/300.0] [batch_t 0.476 (0.455)] [data_t 0.015] [optim_t 0.460] [lr 0.001311] [CE 3.368 (3.428)] [KD 0.000 (0.000)] 2024-10-12 12:49:33,006 - Train: 54.41% [204200/375300] [163.2/300.0] [batch_t 0.471 (0.450)] [data_t 0.016] [optim_t 0.456] [lr 0.001310] [CE 3.374 (3.453)] [KD 0.000 (0.000)] 2024-10-12 12:49:55,895 - Train: 54.42% [204250/375300] [163.3/300.0] [batch_t 0.389 (0.458)] [data_t 0.015] [optim_t 0.374] [lr 0.001309] [CE 3.156 (3.463)] [KD 0.000 (0.000)] 2024-10-12 12:50:19,096 - Train: 54.44% [204300/375300] [163.3/300.0] [batch_t 0.419 (0.464)] [data_t 0.015] [optim_t 0.404] [lr 0.001309] [CE 3.590 (3.436)] [KD 0.000 (0.000)] 2024-10-12 12:50:41,239 - Train: 54.45% [204350/375300] [163.3/300.0] [batch_t 0.467 (0.443)] [data_t 0.015] [optim_t 0.452] [lr 0.001308] [CE 3.273 (3.452)] [KD 0.000 (0.000)] 2024-10-12 12:51:03,412 - Train: 54.46% [204400/375300] [163.4/300.0] [batch_t 0.461 (0.443)] [data_t 0.015] [optim_t 0.445] [lr 0.001307] [CE 3.759 (3.459)] [KD 0.000 (0.000)] 2024-10-12 12:51:25,739 - Train: 54.48% [204450/375300] [163.4/300.0] [batch_t 0.466 (0.446)] [data_t 0.016] [optim_t 0.450] [lr 0.001307] [CE 3.328 (3.456)] [KD 0.000 (0.000)] 2024-10-12 12:51:48,026 - Train: 54.49% [204500/375300] [163.5/300.0] [batch_t 0.500 (0.446)] [data_t 0.015] [optim_t 0.484] [lr 0.001306] [CE 3.417 (3.473)] [KD 0.000 (0.000)] 2024-10-12 12:52:09,754 - Train: 54.50% [204550/375300] [163.5/300.0] [batch_t 0.464 (0.434)] [data_t 0.016] [optim_t 0.449] [lr 0.001306] [CE 3.432 (3.466)] [KD 0.000 (0.000)] 2024-10-12 12:52:31,650 - Train: 54.52% [204600/375300] [163.5/300.0] [batch_t 0.443 (0.438)] [data_t 0.015] [optim_t 0.427] [lr 0.001305] [CE 3.368 (3.417)] [KD 0.000 (0.000)] 2024-10-12 12:52:53,747 - Train: 54.53% [204650/375300] [163.6/300.0] [batch_t 0.425 (0.442)] [data_t 0.016] [optim_t 0.409] [lr 0.001304] [CE 3.501 (3.466)] [KD 0.000 (0.000)] 2024-10-12 12:53:15,985 - Train: 54.54% [204700/375300] [163.6/300.0] [batch_t 0.415 (0.445)] [data_t 0.015] [optim_t 0.399] [lr 0.001304] [CE 3.623 (3.452)] [KD 0.000 (0.000)] 2024-10-12 12:53:38,400 - Train: 54.56% [204750/375300] [163.7/300.0] [batch_t 0.421 (0.448)] [data_t 0.016] [optim_t 0.406] [lr 0.001303] [CE 3.255 (3.448)] [KD 0.000 (0.000)] 2024-10-12 12:54:00,591 - Train: 54.57% [204800/375300] [163.7/300.0] [batch_t 0.438 (0.444)] [data_t 0.015] [optim_t 0.423] [lr 0.001303] [CE 3.546 (3.471)] [KD 0.000 (0.000)] 2024-10-12 12:54:23,067 - Train: 54.58% [204850/375300] [163.7/300.0] [batch_t 0.416 (0.449)] [data_t 0.016] [optim_t 0.400] [lr 0.001302] [CE 3.320 (3.490)] [KD 0.000 (0.000)] 2024-10-12 12:54:45,605 - Train: 54.60% [204900/375300] [163.8/300.0] [batch_t 0.599 (0.451)] [data_t 0.016] [optim_t 0.583] [lr 0.001301] [CE 3.798 (3.459)] [KD 0.000 (0.000)] 2024-10-12 12:55:07,494 - Train: 54.61% [204950/375300] [163.8/300.0] [batch_t 0.459 (0.438)] [data_t 0.016] [optim_t 0.443] [lr 0.001301] [CE 3.526 (3.426)] [KD 0.000 (0.000)] 2024-10-12 12:55:29,595 - Train: 54.62% [205000/375300] [163.9/300.0] [batch_t 0.496 (0.442)] [data_t 0.016] [optim_t 0.480] [lr 0.001300] [CE 3.397 (3.473)] [KD 0.000 (0.000)] 2024-10-12 12:55:50,917 - Train: 54.64% [205050/375300] [163.9/300.0] [batch_t 0.433 (0.426)] [data_t 0.016] [optim_t 0.417] [lr 0.001299] [CE 3.366 (3.464)] [KD 0.000 (0.000)] 2024-10-12 12:56:12,623 - Train: 54.65% [205100/375300] [163.9/300.0] [batch_t 0.518 (0.434)] [data_t 0.015] [optim_t 0.502] [lr 0.001299] [CE 3.481 (3.463)] [KD 0.000 (0.000)] 2024-10-12 12:56:34,142 - Train: 54.66% [205150/375300] [164.0/300.0] [batch_t 0.367 (0.430)] [data_t 0.015] [optim_t 0.352] [lr 0.001298] [CE 3.386 (3.447)] [KD 0.000 (0.000)] 2024-10-12 12:56:38,799 - ==> Total time: 1 day, 1:09:42 Eta: 20:51:57 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 12:56:58,977 - Train: 54.68% [205200/375300] [164.0/300.0] [batch_t 0.490 (0.505)] [data_t 0.058] [optim_t 0.432] [lr 0.001298] [CE 3.201 (3.361)] [KD 0.000 (0.000)] 2024-10-12 12:57:20,931 - Train: 54.69% [205250/375300] [164.1/300.0] [batch_t 0.449 (0.439)] [data_t 0.156] [optim_t 0.294] [lr 0.001297] [CE 3.361 (3.422)] [KD 0.000 (0.000)] 2024-10-12 12:57:41,839 - Train: 54.70% [205300/375300] [164.1/300.0] [batch_t 0.411 (0.418)] [data_t 0.113] [optim_t 0.298] [lr 0.001296] [CE 3.408 (3.479)] [KD 0.000 (0.000)] 2024-10-12 12:58:02,873 - Train: 54.72% [205350/375300] [164.1/300.0] [batch_t 0.444 (0.421)] [data_t 0.148] [optim_t 0.296] [lr 0.001296] [CE 3.269 (3.405)] [KD 0.000 (0.000)] 2024-10-12 12:58:24,875 - Train: 54.73% [205400/375300] [164.2/300.0] [batch_t 0.307 (0.440)] [data_t 0.015] [optim_t 0.291] [lr 0.001295] [CE 3.357 (3.479)] [KD 0.000 (0.000)] 2024-10-12 12:58:47,088 - Train: 54.74% [205450/375300] [164.2/300.0] [batch_t 0.430 (0.444)] [data_t 0.015] [optim_t 0.415] [lr 0.001295] [CE 3.646 (3.437)] [KD 0.000 (0.000)] 2024-10-12 12:59:09,380 - Train: 54.76% [205500/375300] [164.3/300.0] [batch_t 0.397 (0.446)] [data_t 0.015] [optim_t 0.382] [lr 0.001294] [CE 3.453 (3.453)] [KD 0.000 (0.000)] 2024-10-12 12:59:32,514 - Train: 54.77% [205550/375300] [164.3/300.0] [batch_t 0.460 (0.463)] [data_t 0.163] [optim_t 0.297] [lr 0.001293] [CE 3.432 (3.446)] [KD 0.000 (0.000)] 2024-10-12 12:59:54,717 - Train: 54.78% [205600/375300] [164.3/300.0] [batch_t 0.391 (0.444)] [data_t 0.093] [optim_t 0.298] [lr 0.001293] [CE 3.298 (3.412)] [KD 0.000 (0.000)] 2024-10-12 13:00:16,417 - Train: 54.80% [205650/375300] [164.4/300.0] [batch_t 0.465 (0.434)] [data_t 0.016] [optim_t 0.449] [lr 0.001292] [CE 3.571 (3.394)] [KD 0.000 (0.000)] 2024-10-12 13:00:38,248 - Train: 54.81% [205700/375300] [164.4/300.0] [batch_t 0.489 (0.437)] [data_t 0.015] [optim_t 0.473] [lr 0.001291] [CE 3.554 (3.440)] [KD 0.000 (0.000)] 2024-10-12 13:01:00,176 - Train: 54.82% [205750/375300] [164.5/300.0] [batch_t 0.360 (0.438)] [data_t 0.016] [optim_t 0.344] [lr 0.001291] [CE 3.437 (3.423)] [KD 0.000 (0.000)] 2024-10-12 13:01:22,500 - Train: 54.84% [205800/375300] [164.5/300.0] [batch_t 0.514 (0.446)] [data_t 0.016] [optim_t 0.498] [lr 0.001290] [CE 3.190 (3.435)] [KD 0.000 (0.000)] 2024-10-12 13:01:44,655 - Train: 54.85% [205850/375300] [164.5/300.0] [batch_t 0.418 (0.443)] [data_t 0.015] [optim_t 0.402] [lr 0.001290] [CE 3.559 (3.453)] [KD 0.000 (0.000)] 2024-10-12 13:02:06,896 - Train: 54.86% [205900/375300] [164.6/300.0] [batch_t 0.484 (0.445)] [data_t 0.016] [optim_t 0.468] [lr 0.001289] [CE 3.369 (3.399)] [KD 0.000 (0.000)] 2024-10-12 13:02:29,393 - Train: 54.88% [205950/375300] [164.6/300.0] [batch_t 0.449 (0.450)] [data_t 0.015] [optim_t 0.434] [lr 0.001288] [CE 3.476 (3.434)] [KD 0.000 (0.000)] 2024-10-12 13:02:51,536 - Train: 54.89% [206000/375300] [164.7/300.0] [batch_t 0.430 (0.443)] [data_t 0.015] [optim_t 0.414] [lr 0.001288] [CE 3.662 (3.446)] [KD 0.000 (0.000)] 2024-10-12 13:03:14,301 - Train: 54.90% [206050/375300] [164.7/300.0] [batch_t 0.509 (0.455)] [data_t 0.015] [optim_t 0.493] [lr 0.001287] [CE 3.618 (3.421)] [KD 0.000 (0.000)] 2024-10-12 13:03:36,842 - Train: 54.92% [206100/375300] [164.7/300.0] [batch_t 0.408 (0.451)] [data_t 0.015] [optim_t 0.393] [lr 0.001287] [CE 3.650 (3.454)] [KD 0.000 (0.000)] 2024-10-12 13:03:59,932 - Train: 54.93% [206150/375300] [164.8/300.0] [batch_t 0.532 (0.462)] [data_t 0.015] [optim_t 0.517] [lr 0.001286] [CE 3.498 (3.452)] [KD 0.000 (0.000)] 2024-10-12 13:04:22,471 - Train: 54.94% [206200/375300] [164.8/300.0] [batch_t 0.461 (0.451)] [data_t 0.015] [optim_t 0.445] [lr 0.001285] [CE 3.489 (3.395)] [KD 0.000 (0.000)] 2024-10-12 13:04:44,894 - Train: 54.96% [206250/375300] [164.9/300.0] [batch_t 0.413 (0.448)] [data_t 0.016] [optim_t 0.397] [lr 0.001285] [CE 3.491 (3.446)] [KD 0.000 (0.000)] 2024-10-12 13:05:06,633 - Train: 54.97% [206300/375300] [164.9/300.0] [batch_t 0.498 (0.435)] [data_t 0.016] [optim_t 0.483] [lr 0.001284] [CE 3.317 (3.419)] [KD 0.000 (0.000)] 2024-10-12 13:05:28,684 - Train: 54.98% [206350/375300] [164.9/300.0] [batch_t 0.461 (0.441)] [data_t 0.015] [optim_t 0.446] [lr 0.001284] [CE 3.593 (3.416)] [KD 0.000 (0.000)] 2024-10-12 13:05:50,308 - Train: 55.00% [206400/375300] [165.0/300.0] [batch_t 0.395 (0.432)] [data_t 0.026] [optim_t 0.369] [lr 0.001283] [CE 3.565 (3.451)] [KD 0.000 (0.000)] 2024-10-12 13:06:17,313 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.438)] [top1_cnt 37868] [top5_cnt 46704] [top_all 50000] 2024-10-12 13:06:17,313 - net: 75.736 (93.408) 2024-10-12 13:06:39,248 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.431)] [top1_cnt 39877] [top5_cnt 47499] [top_all 50000] 2024-10-12 13:06:39,248 - net_E: 79.754 (94.998) 2024-10-12 13:06:39,396 - Max [top1: 75.736 (epoch: 165)] [top1-ema: 79.754 (epoch: 165)] 2024-10-12 13:06:39,397 - ==> Total time: 1 day, 1:19:43 Eta: 20:43:24 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 13:07:02,270 - Train: 55.01% [206450/375300] [165.0/300.0] [batch_t 0.317 (0.414)] [data_t 0.015] [optim_t 0.302] [lr 0.001282] [CE 3.703 (3.385)] [KD 0.000 (0.000)] 2024-10-12 13:07:23,361 - Train: 55.02% [206500/375300] [165.1/300.0] [batch_t 0.315 (0.422)] [data_t 0.015] [optim_t 0.300] [lr 0.001282] [CE 3.360 (3.392)] [KD 0.000 (0.000)] 2024-10-12 13:07:45,245 - Train: 55.04% [206550/375300] [165.1/300.0] [batch_t 0.494 (0.438)] [data_t 0.016] [optim_t 0.479] [lr 0.001281] [CE 3.434 (3.387)] [KD 0.000 (0.000)] 2024-10-12 13:08:07,096 - Train: 55.05% [206600/375300] [165.1/300.0] [batch_t 0.484 (0.437)] [data_t 0.016] [optim_t 0.468] [lr 0.001280] [CE 3.643 (3.444)] [KD 0.000 (0.000)] 2024-10-12 13:08:29,287 - Train: 55.06% [206650/375300] [165.2/300.0] [batch_t 0.419 (0.444)] [data_t 0.016] [optim_t 0.404] [lr 0.001280] [CE 3.512 (3.421)] [KD 0.000 (0.000)] 2024-10-12 13:08:51,155 - Train: 55.08% [206700/375300] [165.2/300.0] [batch_t 0.378 (0.437)] [data_t 0.080] [optim_t 0.298] [lr 0.001279] [CE 3.267 (3.389)] [KD 0.000 (0.000)] 2024-10-12 13:09:12,858 - Train: 55.09% [206750/375300] [165.3/300.0] [batch_t 0.403 (0.434)] [data_t 0.016] [optim_t 0.387] [lr 0.001279] [CE 3.574 (3.411)] [KD 0.000 (0.000)] 2024-10-12 13:09:34,825 - Train: 55.10% [206800/375300] [165.3/300.0] [batch_t 0.316 (0.439)] [data_t 0.016] [optim_t 0.301] [lr 0.001278] [CE 2.993 (3.417)] [KD 0.000 (0.000)] 2024-10-12 13:09:56,629 - Train: 55.12% [206850/375300] [165.3/300.0] [batch_t 0.314 (0.436)] [data_t 0.016] [optim_t 0.298] [lr 0.001277] [CE 3.361 (3.421)] [KD 0.000 (0.000)] 2024-10-12 13:10:18,607 - Train: 55.13% [206900/375300] [165.4/300.0] [batch_t 0.436 (0.439)] [data_t 0.015] [optim_t 0.420] [lr 0.001277] [CE 3.574 (3.412)] [KD 0.000 (0.000)] 2024-10-12 13:10:40,575 - Train: 55.14% [206950/375300] [165.4/300.0] [batch_t 0.506 (0.439)] [data_t 0.015] [optim_t 0.490] [lr 0.001276] [CE 3.670 (3.466)] [KD 0.000 (0.000)] 2024-10-12 13:11:02,490 - Train: 55.16% [207000/375300] [165.5/300.0] [batch_t 0.396 (0.438)] [data_t 0.016] [optim_t 0.380] [lr 0.001276] [CE 3.168 (3.365)] [KD 0.000 (0.000)] 2024-10-12 13:11:24,427 - Train: 55.17% [207050/375300] [165.5/300.0] [batch_t 0.386 (0.439)] [data_t 0.015] [optim_t 0.371] [lr 0.001275] [CE 3.532 (3.420)] [KD 0.000 (0.000)] 2024-10-12 13:11:46,417 - Train: 55.18% [207100/375300] [165.5/300.0] [batch_t 0.489 (0.440)] [data_t 0.016] [optim_t 0.473] [lr 0.001274] [CE 3.397 (3.450)] [KD 0.000 (0.000)] 2024-10-12 13:12:08,641 - Train: 55.20% [207150/375300] [165.6/300.0] [batch_t 0.457 (0.444)] [data_t 0.015] [optim_t 0.441] [lr 0.001274] [CE 3.153 (3.423)] [KD 0.000 (0.000)] 2024-10-12 13:12:30,778 - Train: 55.21% [207200/375300] [165.6/300.0] [batch_t 0.398 (0.443)] [data_t 0.104] [optim_t 0.295] [lr 0.001273] [CE 3.175 (3.451)] [KD 0.000 (0.000)] 2024-10-12 13:12:52,381 - Train: 55.22% [207250/375300] [165.7/300.0] [batch_t 0.454 (0.432)] [data_t 0.015] [optim_t 0.438] [lr 0.001272] [CE 3.371 (3.454)] [KD 0.000 (0.000)] 2024-10-12 13:13:15,088 - Train: 55.24% [207300/375300] [165.7/300.0] [batch_t 0.848 (0.454)] [data_t 0.016] [optim_t 0.832] [lr 0.001272] [CE 3.473 (3.441)] [KD 0.000 (0.000)] 2024-10-12 13:13:36,568 - Train: 55.25% [207350/375300] [165.7/300.0] [batch_t 0.416 (0.429)] [data_t 0.016] [optim_t 0.401] [lr 0.001271] [CE 3.274 (3.437)] [KD 0.000 (0.000)] 2024-10-12 13:13:58,188 - Train: 55.26% [207400/375300] [165.8/300.0] [batch_t 0.431 (0.432)] [data_t 0.016] [optim_t 0.416] [lr 0.001271] [CE 3.590 (3.417)] [KD 0.000 (0.000)] 2024-10-12 13:14:20,139 - Train: 55.28% [207450/375300] [165.8/300.0] [batch_t 0.449 (0.439)] [data_t 0.015] [optim_t 0.433] [lr 0.001270] [CE 3.421 (3.443)] [KD 0.000 (0.000)] 2024-10-12 13:14:42,347 - Train: 55.29% [207500/375300] [165.9/300.0] [batch_t 0.391 (0.444)] [data_t 0.016] [optim_t 0.376] [lr 0.001269] [CE 3.453 (3.452)] [KD 0.000 (0.000)] 2024-10-12 13:15:05,441 - Train: 55.30% [207550/375300] [165.9/300.0] [batch_t 0.457 (0.462)] [data_t 0.016] [optim_t 0.441] [lr 0.001269] [CE 3.394 (3.418)] [KD 0.000 (0.000)] 2024-10-12 13:15:27,926 - Train: 55.32% [207600/375300] [165.9/300.0] [batch_t 0.441 (0.450)] [data_t 0.015] [optim_t 0.425] [lr 0.001268] [CE 3.661 (3.458)] [KD 0.000 (0.000)] 2024-10-12 13:15:50,129 - Train: 55.33% [207650/375300] [166.0/300.0] [batch_t 0.388 (0.444)] [data_t 0.016] [optim_t 0.372] [lr 0.001268] [CE 3.245 (3.444)] [KD 0.000 (0.000)] 2024-10-12 13:15:55,445 - ==> Total time: 1 day, 1:28:59 Eta: 20:34:14 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 13:16:14,646 - Train: 55.34% [207700/375300] [166.0/300.0] [batch_t 0.322 (0.509)] [data_t 0.017] [optim_t 0.305] [lr 0.001267] [CE 3.379 (3.447)] [KD 0.000 (0.000)] 2024-10-12 13:16:36,425 - Train: 55.36% [207750/375300] [166.1/300.0] [batch_t 0.590 (0.435)] [data_t 0.016] [optim_t 0.575] [lr 0.001266] [CE 3.494 (3.476)] [KD 0.000 (0.000)] 2024-10-12 13:16:58,515 - Train: 55.37% [207800/375300] [166.1/300.0] [batch_t 0.415 (0.442)] [data_t 0.016] [optim_t 0.399] [lr 0.001266] [CE 3.531 (3.448)] [KD 0.000 (0.000)] 2024-10-12 13:17:20,825 - Train: 55.38% [207850/375300] [166.1/300.0] [batch_t 0.476 (0.446)] [data_t 0.016] [optim_t 0.461] [lr 0.001265] [CE 3.362 (3.382)] [KD 0.000 (0.000)] 2024-10-12 13:17:42,645 - Train: 55.40% [207900/375300] [166.2/300.0] [batch_t 0.422 (0.436)] [data_t 0.016] [optim_t 0.406] [lr 0.001264] [CE 3.373 (3.440)] [KD 0.000 (0.000)] 2024-10-12 13:18:03,921 - Train: 55.41% [207950/375300] [166.2/300.0] [batch_t 0.454 (0.425)] [data_t 0.016] [optim_t 0.438] [lr 0.001264] [CE 3.447 (3.446)] [KD 0.000 (0.000)] 2024-10-12 13:18:25,980 - Train: 55.42% [208000/375300] [166.3/300.0] [batch_t 0.347 (0.441)] [data_t 0.016] [optim_t 0.332] [lr 0.001263] [CE 3.388 (3.437)] [KD 0.000 (0.000)] 2024-10-12 13:18:47,808 - Train: 55.44% [208050/375300] [166.3/300.0] [batch_t 0.468 (0.436)] [data_t 0.016] [optim_t 0.453] [lr 0.001263] [CE 3.487 (3.426)] [KD 0.000 (0.000)] 2024-10-12 13:19:09,658 - Train: 55.45% [208100/375300] [166.3/300.0] [batch_t 0.443 (0.437)] [data_t 0.015] [optim_t 0.427] [lr 0.001262] [CE 3.374 (3.394)] [KD 0.000 (0.000)] 2024-10-12 13:19:31,170 - Train: 55.46% [208150/375300] [166.4/300.0] [batch_t 0.379 (0.430)] [data_t 0.015] [optim_t 0.364] [lr 0.001261] [CE 3.481 (3.428)] [KD 0.000 (0.000)] 2024-10-12 13:19:53,225 - Train: 55.48% [208200/375300] [166.4/300.0] [batch_t 0.445 (0.441)] [data_t 0.015] [optim_t 0.430] [lr 0.001261] [CE 3.261 (3.448)] [KD 0.000 (0.000)] 2024-10-12 13:20:14,906 - Train: 55.49% [208250/375300] [166.5/300.0] [batch_t 0.452 (0.434)] [data_t 0.016] [optim_t 0.437] [lr 0.001260] [CE 3.505 (3.454)] [KD 0.000 (0.000)] 2024-10-12 13:20:36,596 - Train: 55.50% [208300/375300] [166.5/300.0] [batch_t 0.518 (0.434)] [data_t 0.016] [optim_t 0.503] [lr 0.001260] [CE 3.623 (3.476)] [KD 0.000 (0.000)] 2024-10-12 13:20:59,032 - Train: 55.52% [208350/375300] [166.5/300.0] [batch_t 0.456 (0.449)] [data_t 0.015] [optim_t 0.441] [lr 0.001259] [CE 3.188 (3.388)] [KD 0.000 (0.000)] 2024-10-12 13:21:20,986 - Train: 55.53% [208400/375300] [166.6/300.0] [batch_t 0.387 (0.439)] [data_t 0.015] [optim_t 0.372] [lr 0.001258] [CE 3.274 (3.432)] [KD 0.000 (0.000)] 2024-10-12 13:21:42,608 - Train: 55.54% [208450/375300] [166.6/300.0] [batch_t 0.432 (0.432)] [data_t 0.016] [optim_t 0.416] [lr 0.001258] [CE 3.309 (3.463)] [KD 0.000 (0.000)] 2024-10-12 13:22:03,782 - Train: 55.56% [208500/375300] [166.7/300.0] [batch_t 0.457 (0.423)] [data_t 0.015] [optim_t 0.441] [lr 0.001257] [CE 3.338 (3.483)] [KD 0.000 (0.000)] 2024-10-12 13:22:25,127 - Train: 55.57% [208550/375300] [166.7/300.0] [batch_t 0.441 (0.427)] [data_t 0.016] [optim_t 0.425] [lr 0.001257] [CE 3.547 (3.428)] [KD 0.000 (0.000)] 2024-10-12 13:22:46,915 - Train: 55.58% [208600/375300] [166.7/300.0] [batch_t 0.464 (0.436)] [data_t 0.016] [optim_t 0.449] [lr 0.001256] [CE 3.722 (3.457)] [KD 0.000 (0.000)] 2024-10-12 13:23:08,685 - Train: 55.60% [208650/375300] [166.8/300.0] [batch_t 0.404 (0.435)] [data_t 0.016] [optim_t 0.389] [lr 0.001255] [CE 3.384 (3.473)] [KD 0.000 (0.000)] 2024-10-12 13:23:30,431 - Train: 55.61% [208700/375300] [166.8/300.0] [batch_t 0.433 (0.435)] [data_t 0.015] [optim_t 0.418] [lr 0.001255] [CE 3.548 (3.433)] [KD 0.000 (0.000)] 2024-10-12 13:23:52,225 - Train: 55.62% [208750/375300] [166.9/300.0] [batch_t 0.452 (0.436)] [data_t 0.015] [optim_t 0.436] [lr 0.001254] [CE 3.413 (3.431)] [KD 0.000 (0.000)] 2024-10-12 13:24:14,165 - Train: 55.64% [208800/375300] [166.9/300.0] [batch_t 0.389 (0.439)] [data_t 0.093] [optim_t 0.296] [lr 0.001253] [CE 3.260 (3.428)] [KD 0.000 (0.000)] 2024-10-12 13:24:35,403 - Train: 55.65% [208850/375300] [166.9/300.0] [batch_t 0.450 (0.425)] [data_t 0.155] [optim_t 0.296] [lr 0.001253] [CE 3.629 (3.472)] [KD 0.000 (0.000)] 2024-10-12 13:24:57,620 - Train: 55.66% [208900/375300] [167.0/300.0] [batch_t 0.420 (0.444)] [data_t 0.126] [optim_t 0.294] [lr 0.001252] [CE 3.337 (3.455)] [KD 0.000 (0.000)] 2024-10-12 13:25:03,259 - ==> Total time: 1 day, 1:38:07 Eta: 20:24:58 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 13:25:23,044 - Train: 55.68% [208950/375300] [167.0/300.0] [batch_t 1.004 (0.484)] [data_t 0.712] [optim_t 0.292] [lr 0.001252] [CE 3.271 (3.418)] [KD 0.000 (0.000)] 2024-10-12 13:25:44,263 - Train: 55.69% [209000/375300] [167.1/300.0] [batch_t 0.488 (0.424)] [data_t 0.015] [optim_t 0.473] [lr 0.001251] [CE 3.402 (3.412)] [KD 0.000 (0.000)] 2024-10-12 13:26:06,450 - Train: 55.70% [209050/375300] [167.1/300.0] [batch_t 0.446 (0.444)] [data_t 0.016] [optim_t 0.431] [lr 0.001250] [CE 3.258 (3.413)] [KD 0.000 (0.000)] 2024-10-12 13:26:28,235 - Train: 55.72% [209100/375300] [167.1/300.0] [batch_t 0.415 (0.436)] [data_t 0.015] [optim_t 0.400] [lr 0.001250] [CE 3.229 (3.455)] [KD 0.000 (0.000)] 2024-10-12 13:26:50,119 - Train: 55.73% [209150/375300] [167.2/300.0] [batch_t 0.422 (0.438)] [data_t 0.015] [optim_t 0.407] [lr 0.001249] [CE 3.666 (3.457)] [KD 0.000 (0.000)] 2024-10-12 13:27:11,916 - Train: 55.74% [209200/375300] [167.2/300.0] [batch_t 0.445 (0.436)] [data_t 0.015] [optim_t 0.429] [lr 0.001249] [CE 3.238 (3.441)] [KD 0.000 (0.000)] 2024-10-12 13:27:33,740 - Train: 55.76% [209250/375300] [167.3/300.0] [batch_t 0.471 (0.436)] [data_t 0.015] [optim_t 0.455] [lr 0.001248] [CE 3.509 (3.402)] [KD 0.000 (0.000)] 2024-10-12 13:27:55,666 - Train: 55.77% [209300/375300] [167.3/300.0] [batch_t 0.448 (0.438)] [data_t 0.015] [optim_t 0.432] [lr 0.001247] [CE 3.293 (3.443)] [KD 0.000 (0.000)] 2024-10-12 13:28:17,503 - Train: 55.78% [209350/375300] [167.3/300.0] [batch_t 0.462 (0.437)] [data_t 0.015] [optim_t 0.447] [lr 0.001247] [CE 3.016 (3.459)] [KD 0.000 (0.000)] 2024-10-12 13:28:38,835 - Train: 55.80% [209400/375300] [167.4/300.0] [batch_t 0.445 (0.427)] [data_t 0.015] [optim_t 0.430] [lr 0.001246] [CE 3.276 (3.452)] [KD 0.000 (0.000)] 2024-10-12 13:29:00,333 - Train: 55.81% [209450/375300] [167.4/300.0] [batch_t 0.487 (0.430)] [data_t 0.015] [optim_t 0.472] [lr 0.001246] [CE 3.368 (3.434)] [KD 0.000 (0.000)] 2024-10-12 13:29:22,062 - Train: 55.82% [209500/375300] [167.5/300.0] [batch_t 0.417 (0.434)] [data_t 0.016] [optim_t 0.402] [lr 0.001245] [CE 3.257 (3.458)] [KD 0.000 (0.000)] 2024-10-12 13:29:43,583 - Train: 55.84% [209550/375300] [167.5/300.0] [batch_t 0.414 (0.430)] [data_t 0.015] [optim_t 0.399] [lr 0.001244] [CE 3.240 (3.385)] [KD 0.000 (0.000)] 2024-10-12 13:30:05,074 - Train: 55.85% [209600/375300] [167.5/300.0] [batch_t 0.471 (0.430)] [data_t 0.015] [optim_t 0.455] [lr 0.001244] [CE 3.733 (3.470)] [KD 0.000 (0.000)] 2024-10-12 13:30:26,542 - Train: 55.86% [209650/375300] [167.6/300.0] [batch_t 0.501 (0.429)] [data_t 0.016] [optim_t 0.486] [lr 0.001243] [CE 3.468 (3.470)] [KD 0.000 (0.000)] 2024-10-12 13:30:48,150 - Train: 55.88% [209700/375300] [167.6/300.0] [batch_t 0.478 (0.432)] [data_t 0.016] [optim_t 0.462] [lr 0.001242] [CE 3.520 (3.456)] [KD 0.000 (0.000)] 2024-10-12 13:31:09,785 - Train: 55.89% [209750/375300] [167.7/300.0] [batch_t 0.433 (0.433)] [data_t 0.016] [optim_t 0.417] [lr 0.001242] [CE 3.096 (3.408)] [KD 0.000 (0.000)] 2024-10-12 13:31:31,401 - Train: 55.90% [209800/375300] [167.7/300.0] [batch_t 0.526 (0.432)] [data_t 0.016] [optim_t 0.510] [lr 0.001241] [CE 3.305 (3.431)] [KD 0.000 (0.000)] 2024-10-12 13:31:53,149 - Train: 55.92% [209850/375300] [167.7/300.0] [batch_t 0.437 (0.435)] [data_t 0.016] [optim_t 0.421] [lr 0.001241] [CE 3.616 (3.411)] [KD 0.000 (0.000)] 2024-10-12 13:32:15,628 - Train: 55.93% [209900/375300] [167.8/300.0] [batch_t 0.490 (0.449)] [data_t 0.016] [optim_t 0.474] [lr 0.001240] [CE 3.088 (3.439)] [KD 0.000 (0.000)] 2024-10-12 13:32:37,463 - Train: 55.94% [209950/375300] [167.8/300.0] [batch_t 0.494 (0.437)] [data_t 0.015] [optim_t 0.479] [lr 0.001239] [CE 3.469 (3.392)] [KD 0.000 (0.000)] 2024-10-12 13:32:58,634 - Train: 55.96% [210000/375300] [167.9/300.0] [batch_t 0.386 (0.423)] [data_t 0.015] [optim_t 0.371] [lr 0.001239] [CE 3.233 (3.462)] [KD 0.000 (0.000)] 2024-10-12 13:33:20,241 - Train: 55.97% [210050/375300] [167.9/300.0] [batch_t 0.409 (0.432)] [data_t 0.016] [optim_t 0.394] [lr 0.001238] [CE 3.351 (3.461)] [KD 0.000 (0.000)] 2024-10-12 13:33:42,255 - Train: 55.98% [210100/375300] [167.9/300.0] [batch_t 0.423 (0.440)] [data_t 0.016] [optim_t 0.408] [lr 0.001238] [CE 3.564 (3.442)] [KD 0.000 (0.000)] 2024-10-12 13:34:03,704 - Train: 56.00% [210150/375300] [168.0/300.0] [batch_t 0.429 (0.429)] [data_t 0.016] [optim_t 0.413] [lr 0.001237] [CE 3.467 (3.479)] [KD 0.000 (0.000)] 2024-10-12 13:34:10,029 - ==> Total time: 1 day, 1:47:13 Eta: 20:15:40 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 13:34:28,919 - Train: 56.01% [210200/375300] [168.0/300.0] [batch_t 0.634 (0.546)] [data_t 0.015] [optim_t 0.618] [lr 0.001236] [CE 3.574 (3.454)] [KD 0.000 (0.000)] 2024-10-12 13:34:50,653 - Train: 56.02% [210250/375300] [168.1/300.0] [batch_t 0.437 (0.435)] [data_t 0.016] [optim_t 0.422] [lr 0.001236] [CE 3.755 (3.410)] [KD 0.000 (0.000)] 2024-10-12 13:35:11,972 - Train: 56.04% [210300/375300] [168.1/300.0] [batch_t 0.423 (0.426)] [data_t 0.016] [optim_t 0.407] [lr 0.001235] [CE 3.341 (3.413)] [KD 0.000 (0.000)] 2024-10-12 13:35:33,512 - Train: 56.05% [210350/375300] [168.1/300.0] [batch_t 0.461 (0.431)] [data_t 0.016] [optim_t 0.445] [lr 0.001235] [CE 3.251 (3.438)] [KD 0.000 (0.000)] 2024-10-12 13:35:55,514 - Train: 56.06% [210400/375300] [168.2/300.0] [batch_t 0.395 (0.440)] [data_t 0.016] [optim_t 0.379] [lr 0.001234] [CE 3.221 (3.380)] [KD 0.000 (0.000)] 2024-10-12 13:36:17,765 - Train: 56.08% [210450/375300] [168.2/300.0] [batch_t 0.312 (0.445)] [data_t 0.016] [optim_t 0.296] [lr 0.001233] [CE 3.238 (3.398)] [KD 0.000 (0.000)] 2024-10-12 13:36:40,513 - Train: 56.09% [210500/375300] [168.3/300.0] [batch_t 0.421 (0.455)] [data_t 0.016] [optim_t 0.406] [lr 0.001233] [CE 3.246 (3.432)] [KD 0.000 (0.000)] 2024-10-12 13:37:02,792 - Train: 56.10% [210550/375300] [168.3/300.0] [batch_t 0.515 (0.445)] [data_t 0.016] [optim_t 0.499] [lr 0.001232] [CE 3.737 (3.411)] [KD 0.000 (0.000)] 2024-10-12 13:37:23,672 - Train: 56.12% [210600/375300] [168.3/300.0] [batch_t 0.416 (0.417)] [data_t 0.015] [optim_t 0.401] [lr 0.001231] [CE 3.030 (3.440)] [KD 0.000 (0.000)] 2024-10-12 13:37:44,777 - Train: 56.13% [210650/375300] [168.4/300.0] [batch_t 0.381 (0.422)] [data_t 0.015] [optim_t 0.366] [lr 0.001231] [CE 3.348 (3.439)] [KD 0.000 (0.000)] 2024-10-12 13:38:05,578 - Train: 56.14% [210700/375300] [168.4/300.0] [batch_t 0.459 (0.416)] [data_t 0.015] [optim_t 0.443] [lr 0.001230] [CE 3.496 (3.401)] [KD 0.000 (0.000)] 2024-10-12 13:38:26,550 - Train: 56.16% [210750/375300] [168.5/300.0] [batch_t 0.428 (0.419)] [data_t 0.016] [optim_t 0.413] [lr 0.001230] [CE 3.715 (3.427)] [KD 0.000 (0.000)] 2024-10-12 13:38:48,127 - Train: 56.17% [210800/375300] [168.5/300.0] [batch_t 0.393 (0.431)] [data_t 0.015] [optim_t 0.378] [lr 0.001229] [CE 3.580 (3.404)] [KD 0.000 (0.000)] 2024-10-12 13:39:09,180 - Train: 56.18% [210850/375300] [168.5/300.0] [batch_t 0.312 (0.421)] [data_t 0.015] [optim_t 0.296] [lr 0.001228] [CE 3.318 (3.459)] [KD 0.000 (0.000)] 2024-10-12 13:39:30,488 - Train: 56.20% [210900/375300] [168.6/300.0] [batch_t 0.316 (0.426)] [data_t 0.016] [optim_t 0.300] [lr 0.001228] [CE 3.400 (3.438)] [KD 0.000 (0.000)] 2024-10-12 13:39:52,192 - Train: 56.21% [210950/375300] [168.6/300.0] [batch_t 0.409 (0.434)] [data_t 0.015] [optim_t 0.394] [lr 0.001227] [CE 3.507 (3.434)] [KD 0.000 (0.000)] 2024-10-12 13:40:14,707 - Train: 56.22% [211000/375300] [168.7/300.0] [batch_t 0.352 (0.450)] [data_t 0.015] [optim_t 0.337] [lr 0.001227] [CE 3.370 (3.412)] [KD 0.000 (0.000)] 2024-10-12 13:40:37,486 - Train: 56.24% [211050/375300] [168.7/300.0] [batch_t 0.325 (0.455)] [data_t 0.016] [optim_t 0.309] [lr 0.001226] [CE 3.385 (3.455)] [KD 0.000 (0.000)] 2024-10-12 13:40:59,257 - Train: 56.25% [211100/375300] [168.7/300.0] [batch_t 0.486 (0.435)] [data_t 0.016] [optim_t 0.471] [lr 0.001225] [CE 3.507 (3.442)] [KD 0.000 (0.000)] 2024-10-12 13:41:21,388 - Train: 56.26% [211150/375300] [168.8/300.0] [batch_t 0.462 (0.442)] [data_t 0.015] [optim_t 0.447] [lr 0.001225] [CE 3.006 (3.400)] [KD 0.000 (0.000)] 2024-10-12 13:41:43,694 - Train: 56.27% [211200/375300] [168.8/300.0] [batch_t 0.421 (0.446)] [data_t 0.015] [optim_t 0.406] [lr 0.001224] [CE 3.560 (3.452)] [KD 0.000 (0.000)] 2024-10-12 13:42:05,260 - Train: 56.29% [211250/375300] [168.9/300.0] [batch_t 0.431 (0.431)] [data_t 0.015] [optim_t 0.416] [lr 0.001224] [CE 3.270 (3.448)] [KD 0.000 (0.000)] 2024-10-12 13:42:26,207 - Train: 56.30% [211300/375300] [168.9/300.0] [batch_t 0.395 (0.419)] [data_t 0.015] [optim_t 0.379] [lr 0.001223] [CE 3.565 (3.453)] [KD 0.000 (0.000)] 2024-10-12 13:42:47,752 - Train: 56.31% [211350/375300] [168.9/300.0] [batch_t 0.432 (0.431)] [data_t 0.015] [optim_t 0.416] [lr 0.001222] [CE 3.466 (3.478)] [KD 0.000 (0.000)] 2024-10-12 13:43:09,015 - Train: 56.33% [211400/375300] [169.0/300.0] [batch_t 0.319 (0.425)] [data_t 0.015] [optim_t 0.304] [lr 0.001222] [CE 3.435 (3.417)] [KD 0.000 (0.000)] 2024-10-12 13:43:15,144 - ==> Total time: 1 day, 1:56:19 Eta: 20:06:22 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 13:43:33,225 - Train: 56.34% [211450/375300] [169.0/300.0] [batch_t 0.316 (0.541)] [data_t 0.016] [optim_t 0.301] [lr 0.001221] [CE 3.237 (3.348)] [KD 0.000 (0.000)] 2024-10-12 13:43:55,931 - Train: 56.35% [211500/375300] [169.1/300.0] [batch_t 0.481 (0.454)] [data_t 0.015] [optim_t 0.465] [lr 0.001221] [CE 3.383 (3.391)] [KD 0.000 (0.000)] 2024-10-12 13:44:17,720 - Train: 56.37% [211550/375300] [169.1/300.0] [batch_t 0.484 (0.436)] [data_t 0.015] [optim_t 0.469] [lr 0.001220] [CE 3.443 (3.415)] [KD 0.000 (0.000)] 2024-10-12 13:44:39,200 - Train: 56.38% [211600/375300] [169.1/300.0] [batch_t 0.525 (0.429)] [data_t 0.015] [optim_t 0.509] [lr 0.001219] [CE 3.652 (3.447)] [KD 0.000 (0.000)] 2024-10-12 13:45:01,150 - Train: 56.39% [211650/375300] [169.2/300.0] [batch_t 0.384 (0.439)] [data_t 0.015] [optim_t 0.369] [lr 0.001219] [CE 3.485 (3.448)] [KD 0.000 (0.000)] 2024-10-12 13:45:23,141 - Train: 56.41% [211700/375300] [169.2/300.0] [batch_t 0.377 (0.440)] [data_t 0.015] [optim_t 0.361] [lr 0.001218] [CE 3.487 (3.420)] [KD 0.000 (0.000)] 2024-10-12 13:45:45,549 - Train: 56.42% [211750/375300] [169.3/300.0] [batch_t 0.560 (0.448)] [data_t 0.015] [optim_t 0.545] [lr 0.001217] [CE 3.583 (3.394)] [KD 0.000 (0.000)] 2024-10-12 13:46:07,146 - Train: 56.43% [211800/375300] [169.3/300.0] [batch_t 0.396 (0.432)] [data_t 0.016] [optim_t 0.381] [lr 0.001217] [CE 3.379 (3.436)] [KD 0.000 (0.000)] 2024-10-12 13:46:27,943 - Train: 56.45% [211850/375300] [169.3/300.0] [batch_t 0.539 (0.416)] [data_t 0.016] [optim_t 0.524] [lr 0.001216] [CE 3.443 (3.418)] [KD 0.000 (0.000)] 2024-10-12 13:46:48,748 - Train: 56.46% [211900/375300] [169.4/300.0] [batch_t 0.433 (0.416)] [data_t 0.016] [optim_t 0.417] [lr 0.001216] [CE 3.165 (3.440)] [KD 0.000 (0.000)] 2024-10-12 13:47:10,210 - Train: 56.47% [211950/375300] [169.4/300.0] [batch_t 0.440 (0.429)] [data_t 0.016] [optim_t 0.424] [lr 0.001215] [CE 3.593 (3.462)] [KD 0.000 (0.000)] 2024-10-12 13:47:31,672 - Train: 56.49% [212000/375300] [169.5/300.0] [batch_t 0.312 (0.429)] [data_t 0.016] [optim_t 0.296] [lr 0.001214] [CE 3.597 (3.440)] [KD 0.000 (0.000)] 2024-10-12 13:47:52,306 - Train: 56.50% [212050/375300] [169.5/300.0] [batch_t 0.473 (0.413)] [data_t 0.016] [optim_t 0.457] [lr 0.001214] [CE 3.544 (3.423)] [KD 0.000 (0.000)] 2024-10-12 13:48:12,927 - Train: 56.51% [212100/375300] [169.5/300.0] [batch_t 0.377 (0.412)] [data_t 0.015] [optim_t 0.362] [lr 0.001213] [CE 3.146 (3.438)] [KD 0.000 (0.000)] 2024-10-12 13:48:35,226 - Train: 56.53% [212150/375300] [169.6/300.0] [batch_t 0.421 (0.446)] [data_t 0.015] [optim_t 0.406] [lr 0.001213] [CE 3.002 (3.428)] [KD 0.000 (0.000)] 2024-10-12 13:48:56,861 - Train: 56.54% [212200/375300] [169.6/300.0] [batch_t 0.413 (0.433)] [data_t 0.015] [optim_t 0.398] [lr 0.001212] [CE 3.401 (3.425)] [KD 0.000 (0.000)] 2024-10-12 13:49:18,829 - Train: 56.55% [212250/375300] [169.7/300.0] [batch_t 0.447 (0.439)] [data_t 0.015] [optim_t 0.432] [lr 0.001211] [CE 3.584 (3.443)] [KD 0.000 (0.000)] 2024-10-12 13:49:40,519 - Train: 56.57% [212300/375300] [169.7/300.0] [batch_t 0.416 (0.434)] [data_t 0.015] [optim_t 0.400] [lr 0.001211] [CE 3.263 (3.427)] [KD 0.000 (0.000)] 2024-10-12 13:50:01,727 - Train: 56.58% [212350/375300] [169.7/300.0] [batch_t 0.499 (0.424)] [data_t 0.015] [optim_t 0.484] [lr 0.001210] [CE 3.168 (3.438)] [KD 0.000 (0.000)] 2024-10-12 13:50:23,046 - Train: 56.59% [212400/375300] [169.8/300.0] [batch_t 0.367 (0.426)] [data_t 0.015] [optim_t 0.352] [lr 0.001210] [CE 3.019 (3.395)] [KD 0.000 (0.000)] 2024-10-12 13:50:44,617 - Train: 56.61% [212450/375300] [169.8/300.0] [batch_t 0.455 (0.431)] [data_t 0.015] [optim_t 0.439] [lr 0.001209] [CE 3.619 (3.413)] [KD 0.000 (0.000)] 2024-10-12 13:51:07,012 - Train: 56.62% [212500/375300] [169.9/300.0] [batch_t 0.447 (0.448)] [data_t 0.015] [optim_t 0.432] [lr 0.001208] [CE 3.331 (3.428)] [KD 0.000 (0.000)] 2024-10-12 13:51:28,970 - Train: 56.63% [212550/375300] [169.9/300.0] [batch_t 0.501 (0.439)] [data_t 0.016] [optim_t 0.485] [lr 0.001208] [CE 3.218 (3.437)] [KD 0.000 (0.000)] 2024-10-12 13:51:50,774 - Train: 56.65% [212600/375300] [169.9/300.0] [batch_t 0.440 (0.436)] [data_t 0.015] [optim_t 0.424] [lr 0.001207] [CE 3.284 (3.425)] [KD 0.000 (0.000)] 2024-10-12 13:52:12,069 - Train: 56.66% [212650/375300] [170.0/300.0] [batch_t 0.509 (0.426)] [data_t 0.015] [optim_t 0.494] [lr 0.001207] [CE 3.544 (3.455)] [KD 0.000 (0.000)] 2024-10-12 13:52:41,309 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.436)] [top1_cnt 38020] [top5_cnt 46771] [top_all 50000] 2024-10-12 13:52:41,310 - net: 76.040 (93.542) 2024-10-12 13:53:03,590 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.439)] [top1_cnt 39915] [top5_cnt 47565] [top_all 50000] 2024-10-12 13:53:03,590 - net_E: 79.830 (95.130) 2024-10-12 13:53:03,734 - Max [top1: 76.040 (epoch: 170)] [top1-ema: 79.830 (epoch: 170)] 2024-10-12 13:53:03,734 - ==> Total time: 1 day, 2:06:07 Eta: 19:57:37 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 13:53:25,912 - Train: 56.67% [212700/375300] [170.0/300.0] [batch_t 0.316 (0.447)] [data_t 0.016] [optim_t 0.300] [lr 0.001206] [CE 3.401 (3.443)] [KD 0.000 (0.000)] 2024-10-12 13:53:47,532 - Train: 56.69% [212750/375300] [170.1/300.0] [batch_t 0.456 (0.432)] [data_t 0.015] [optim_t 0.441] [lr 0.001205] [CE 3.418 (3.443)] [KD 0.000 (0.000)] 2024-10-12 13:54:09,812 - Train: 56.70% [212800/375300] [170.1/300.0] [batch_t 0.313 (0.445)] [data_t 0.016] [optim_t 0.297] [lr 0.001205] [CE 3.029 (3.390)] [KD 0.000 (0.000)] 2024-10-12 13:54:31,844 - Train: 56.71% [212850/375300] [170.1/300.0] [batch_t 0.398 (0.441)] [data_t 0.016] [optim_t 0.382] [lr 0.001204] [CE 3.129 (3.445)] [KD 0.000 (0.000)] 2024-10-12 13:54:53,769 - Train: 56.73% [212900/375300] [170.2/300.0] [batch_t 0.494 (0.438)] [data_t 0.016] [optim_t 0.479] [lr 0.001203] [CE 3.709 (3.406)] [KD 0.000 (0.000)] 2024-10-12 13:55:15,729 - Train: 56.74% [212950/375300] [170.2/300.0] [batch_t 0.470 (0.439)] [data_t 0.015] [optim_t 0.455] [lr 0.001203] [CE 3.241 (3.397)] [KD 0.000 (0.000)] 2024-10-12 13:55:38,272 - Train: 56.75% [213000/375300] [170.3/300.0] [batch_t 0.517 (0.451)] [data_t 0.015] [optim_t 0.502] [lr 0.001202] [CE 3.657 (3.392)] [KD 0.000 (0.000)] 2024-10-12 13:56:01,013 - Train: 56.77% [213050/375300] [170.3/300.0] [batch_t 0.456 (0.455)] [data_t 0.016] [optim_t 0.440] [lr 0.001202] [CE 3.316 (3.434)] [KD 0.000 (0.000)] 2024-10-12 13:56:21,890 - Train: 56.78% [213100/375300] [170.3/300.0] [batch_t 0.456 (0.417)] [data_t 0.015] [optim_t 0.441] [lr 0.001201] [CE 3.454 (3.370)] [KD 0.000 (0.000)] 2024-10-12 13:56:42,922 - Train: 56.79% [213150/375300] [170.4/300.0] [batch_t 0.400 (0.421)] [data_t 0.015] [optim_t 0.385] [lr 0.001200] [CE 3.644 (3.450)] [KD 0.000 (0.000)] 2024-10-12 13:57:04,812 - Train: 56.81% [213200/375300] [170.4/300.0] [batch_t 0.396 (0.438)] [data_t 0.098] [optim_t 0.298] [lr 0.001200] [CE 3.468 (3.455)] [KD 0.000 (0.000)] 2024-10-12 13:57:26,099 - Train: 56.82% [213250/375300] [170.5/300.0] [batch_t 0.440 (0.426)] [data_t 0.144] [optim_t 0.295] [lr 0.001199] [CE 3.179 (3.439)] [KD 0.000 (0.000)] 2024-10-12 13:57:46,144 - Train: 56.83% [213300/375300] [170.5/300.0] [batch_t 0.430 (0.401)] [data_t 0.130] [optim_t 0.300] [lr 0.001199] [CE 3.222 (3.469)] [KD 0.000 (0.000)] 2024-10-12 13:58:08,290 - Train: 56.85% [213350/375300] [170.5/300.0] [batch_t 0.397 (0.443)] [data_t 0.101] [optim_t 0.295] [lr 0.001198] [CE 3.330 (3.444)] [KD 0.000 (0.000)] 2024-10-12 13:58:29,876 - Train: 56.86% [213400/375300] [170.6/300.0] [batch_t 0.443 (0.432)] [data_t 0.143] [optim_t 0.299] [lr 0.001197] [CE 3.406 (3.392)] [KD 0.000 (0.000)] 2024-10-12 13:58:51,802 - Train: 56.87% [213450/375300] [170.6/300.0] [batch_t 0.380 (0.438)] [data_t 0.083] [optim_t 0.297] [lr 0.001197] [CE 3.629 (3.432)] [KD 0.000 (0.000)] 2024-10-12 13:59:13,476 - Train: 56.89% [213500/375300] [170.7/300.0] [batch_t 0.502 (0.433)] [data_t 0.205] [optim_t 0.297] [lr 0.001196] [CE 3.555 (3.401)] [KD 0.000 (0.000)] 2024-10-12 13:59:35,679 - Train: 56.90% [213550/375300] [170.7/300.0] [batch_t 0.449 (0.444)] [data_t 0.155] [optim_t 0.294] [lr 0.001196] [CE 3.702 (3.379)] [KD 0.000 (0.000)] 2024-10-12 13:59:58,142 - Train: 56.91% [213600/375300] [170.7/300.0] [batch_t 0.521 (0.449)] [data_t 0.015] [optim_t 0.505] [lr 0.001195] [CE 3.390 (3.373)] [KD 0.000 (0.000)] 2024-10-12 14:00:20,692 - Train: 56.93% [213650/375300] [170.8/300.0] [batch_t 0.466 (0.451)] [data_t 0.015] [optim_t 0.450] [lr 0.001194] [CE 2.992 (3.404)] [KD 0.000 (0.000)] 2024-10-12 14:00:43,133 - Train: 56.94% [213700/375300] [170.8/300.0] [batch_t 0.438 (0.449)] [data_t 0.015] [optim_t 0.423] [lr 0.001194] [CE 3.504 (3.416)] [KD 0.000 (0.000)] 2024-10-12 14:01:04,435 - Train: 56.95% [213750/375300] [170.9/300.0] [batch_t 0.396 (0.426)] [data_t 0.015] [optim_t 0.381] [lr 0.001193] [CE 3.701 (3.468)] [KD 0.000 (0.000)] 2024-10-12 14:01:25,859 - Train: 56.97% [213800/375300] [170.9/300.0] [batch_t 0.419 (0.428)] [data_t 0.015] [optim_t 0.404] [lr 0.001193] [CE 3.354 (3.441)] [KD 0.000 (0.000)] 2024-10-12 14:01:46,491 - Train: 56.98% [213850/375300] [170.9/300.0] [batch_t 0.406 (0.413)] [data_t 0.015] [optim_t 0.391] [lr 0.001192] [CE 3.349 (3.433)] [KD 0.000 (0.000)] 2024-10-12 14:02:09,142 - Train: 56.99% [213900/375300] [171.0/300.0] [batch_t 0.372 (0.453)] [data_t 0.016] [optim_t 0.356] [lr 0.001191] [CE 3.504 (3.426)] [KD 0.000 (0.000)] 2024-10-12 14:02:16,963 - ==> Total time: 1 day, 2:15:20 Eta: 19:48:25 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 14:02:34,372 - Train: 57.01% [213950/375300] [171.0/300.0] [batch_t 0.527 (0.551)] [data_t 0.231] [optim_t 0.296] [lr 0.001191] [CE 3.550 (3.415)] [KD 0.000 (0.000)] 2024-10-12 14:02:56,971 - Train: 57.02% [214000/375300] [171.1/300.0] [batch_t 0.490 (0.452)] [data_t 0.190] [optim_t 0.300] [lr 0.001190] [CE 3.537 (3.344)] [KD 0.000 (0.000)] 2024-10-12 14:03:19,497 - Train: 57.03% [214050/375300] [171.1/300.0] [batch_t 0.424 (0.450)] [data_t 0.126] [optim_t 0.298] [lr 0.001190] [CE 3.448 (3.387)] [KD 0.000 (0.000)] 2024-10-12 14:03:42,085 - Train: 57.05% [214100/375300] [171.1/300.0] [batch_t 0.461 (0.452)] [data_t 0.163] [optim_t 0.298] [lr 0.001189] [CE 3.535 (3.436)] [KD 0.000 (0.000)] 2024-10-12 14:04:04,628 - Train: 57.06% [214150/375300] [171.2/300.0] [batch_t 0.450 (0.451)] [data_t 0.156] [optim_t 0.293] [lr 0.001188] [CE 3.457 (3.424)] [KD 0.000 (0.000)] 2024-10-12 14:04:27,867 - Train: 57.07% [214200/375300] [171.2/300.0] [batch_t 0.347 (0.465)] [data_t 0.049] [optim_t 0.298] [lr 0.001188] [CE 3.494 (3.432)] [KD 0.000 (0.000)] 2024-10-12 14:04:50,422 - Train: 57.09% [214250/375300] [171.3/300.0] [batch_t 0.430 (0.451)] [data_t 0.136] [optim_t 0.294] [lr 0.001187] [CE 3.242 (3.376)] [KD 0.000 (0.000)] 2024-10-12 14:05:11,602 - Train: 57.10% [214300/375300] [171.3/300.0] [batch_t 0.399 (0.423)] [data_t 0.101] [optim_t 0.298] [lr 0.001186] [CE 3.247 (3.423)] [KD 0.000 (0.000)] 2024-10-12 14:05:33,576 - Train: 57.11% [214350/375300] [171.3/300.0] [batch_t 0.444 (0.439)] [data_t 0.016] [optim_t 0.429] [lr 0.001186] [CE 3.518 (3.426)] [KD 0.000 (0.000)] 2024-10-12 14:05:55,931 - Train: 57.13% [214400/375300] [171.4/300.0] [batch_t 0.432 (0.447)] [data_t 0.016] [optim_t 0.416] [lr 0.001185] [CE 3.341 (3.402)] [KD 0.000 (0.000)] 2024-10-12 14:06:17,741 - Train: 57.14% [214450/375300] [171.4/300.0] [batch_t 0.353 (0.436)] [data_t 0.016] [optim_t 0.338] [lr 0.001185] [CE 3.580 (3.396)] [KD 0.000 (0.000)] 2024-10-12 14:06:39,505 - Train: 57.15% [214500/375300] [171.5/300.0] [batch_t 0.450 (0.435)] [data_t 0.015] [optim_t 0.435] [lr 0.001184] [CE 3.293 (3.425)] [KD 0.000 (0.000)] 2024-10-12 14:07:01,062 - Train: 57.17% [214550/375300] [171.5/300.0] [batch_t 0.425 (0.431)] [data_t 0.016] [optim_t 0.410] [lr 0.001183] [CE 3.312 (3.432)] [KD 0.000 (0.000)] 2024-10-12 14:07:22,065 - Train: 57.18% [214600/375300] [171.5/300.0] [batch_t 0.393 (0.420)] [data_t 0.016] [optim_t 0.377] [lr 0.001183] [CE 3.039 (3.449)] [KD 0.000 (0.000)] 2024-10-12 14:07:43,598 - Train: 57.19% [214650/375300] [171.6/300.0] [batch_t 0.546 (0.431)] [data_t 0.245] [optim_t 0.301] [lr 0.001182] [CE 3.313 (3.415)] [KD 0.000 (0.000)] 2024-10-12 14:08:05,518 - Train: 57.21% [214700/375300] [171.6/300.0] [batch_t 0.317 (0.438)] [data_t 0.016] [optim_t 0.301] [lr 0.001182] [CE 3.232 (3.450)] [KD 0.000 (0.000)] 2024-10-12 14:08:27,188 - Train: 57.22% [214750/375300] [171.7/300.0] [batch_t 0.405 (0.433)] [data_t 0.016] [optim_t 0.389] [lr 0.001181] [CE 3.030 (3.429)] [KD 0.000 (0.000)] 2024-10-12 14:08:49,610 - Train: 57.23% [214800/375300] [171.7/300.0] [batch_t 0.418 (0.448)] [data_t 0.016] [optim_t 0.402] [lr 0.001180] [CE 3.106 (3.408)] [KD 0.000 (0.000)] 2024-10-12 14:09:11,798 - Train: 57.25% [214850/375300] [171.7/300.0] [batch_t 0.441 (0.444)] [data_t 0.015] [optim_t 0.425] [lr 0.001180] [CE 3.124 (3.367)] [KD 0.000 (0.000)] 2024-10-12 14:09:33,606 - Train: 57.26% [214900/375300] [171.8/300.0] [batch_t 0.459 (0.436)] [data_t 0.015] [optim_t 0.444] [lr 0.001179] [CE 3.427 (3.397)] [KD 0.000 (0.000)] 2024-10-12 14:09:55,926 - Train: 57.27% [214950/375300] [171.8/300.0] [batch_t 0.533 (0.446)] [data_t 0.016] [optim_t 0.517] [lr 0.001179] [CE 3.361 (3.433)] [KD 0.000 (0.000)] 2024-10-12 14:10:18,414 - Train: 57.29% [215000/375300] [171.9/300.0] [batch_t 0.437 (0.450)] [data_t 0.016] [optim_t 0.421] [lr 0.001178] [CE 3.235 (3.422)] [KD 0.000 (0.000)] 2024-10-12 14:10:40,811 - Train: 57.30% [215050/375300] [171.9/300.0] [batch_t 0.462 (0.448)] [data_t 0.016] [optim_t 0.447] [lr 0.001177] [CE 3.292 (3.377)] [KD 0.000 (0.000)] 2024-10-12 14:11:03,495 - Train: 57.31% [215100/375300] [171.9/300.0] [batch_t 0.667 (0.454)] [data_t 0.149] [optim_t 0.518] [lr 0.001177] [CE 3.172 (3.422)] [KD 0.000 (0.000)] 2024-10-12 14:11:24,858 - Train: 57.33% [215150/375300] [172.0/300.0] [batch_t 0.472 (0.427)] [data_t 0.079] [optim_t 0.394] [lr 0.001176] [CE 3.778 (3.427)] [KD 0.000 (0.000)] 2024-10-12 14:11:33,252 - ==> Total time: 1 day, 2:24:37 Eta: 19:39:15 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 14:11:49,692 - Train: 57.34% [215200/375300] [172.0/300.0] [batch_t 0.519 (0.528)] [data_t 0.224] [optim_t 0.296] [lr 0.001176] [CE 3.130 (3.415)] [KD 0.000 (0.000)] 2024-10-12 14:12:11,741 - Train: 57.35% [215250/375300] [172.1/300.0] [batch_t 0.491 (0.441)] [data_t 0.197] [optim_t 0.294] [lr 0.001175] [CE 3.593 (3.405)] [KD 0.000 (0.000)] 2024-10-12 14:12:34,196 - Train: 57.37% [215300/375300] [172.1/300.0] [batch_t 0.438 (0.449)] [data_t 0.094] [optim_t 0.344] [lr 0.001174] [CE 2.899 (3.376)] [KD 0.000 (0.000)] 2024-10-12 14:12:55,924 - Train: 57.38% [215350/375300] [172.1/300.0] [batch_t 0.416 (0.434)] [data_t 0.016] [optim_t 0.401] [lr 0.001174] [CE 3.623 (3.405)] [KD 0.000 (0.000)] 2024-10-12 14:13:17,628 - Train: 57.39% [215400/375300] [172.2/300.0] [batch_t 0.462 (0.434)] [data_t 0.163] [optim_t 0.298] [lr 0.001173] [CE 3.360 (3.387)] [KD 0.000 (0.000)] 2024-10-12 14:13:39,310 - Train: 57.41% [215450/375300] [172.2/300.0] [batch_t 0.392 (0.434)] [data_t 0.090] [optim_t 0.302] [lr 0.001173] [CE 3.276 (3.439)] [KD 0.000 (0.000)] 2024-10-12 14:14:01,275 - Train: 57.42% [215500/375300] [172.3/300.0] [batch_t 0.446 (0.439)] [data_t 0.149] [optim_t 0.297] [lr 0.001172] [CE 3.415 (3.399)] [KD 0.000 (0.000)] 2024-10-12 14:14:23,777 - Train: 57.43% [215550/375300] [172.3/300.0] [batch_t 0.467 (0.450)] [data_t 0.170] [optim_t 0.297] [lr 0.001171] [CE 3.218 (3.421)] [KD 0.000 (0.000)] 2024-10-12 14:14:46,055 - Train: 57.45% [215600/375300] [172.3/300.0] [batch_t 0.510 (0.445)] [data_t 0.216] [optim_t 0.295] [lr 0.001171] [CE 3.661 (3.398)] [KD 0.000 (0.000)] 2024-10-12 14:15:08,268 - Train: 57.46% [215650/375300] [172.4/300.0] [batch_t 0.464 (0.444)] [data_t 0.169] [optim_t 0.296] [lr 0.001170] [CE 3.362 (3.344)] [KD 0.000 (0.000)] 2024-10-12 14:15:30,455 - Train: 57.47% [215700/375300] [172.4/300.0] [batch_t 0.446 (0.444)] [data_t 0.153] [optim_t 0.293] [lr 0.001170] [CE 3.463 (3.434)] [KD 0.000 (0.000)] 2024-10-12 14:15:53,024 - Train: 57.49% [215750/375300] [172.5/300.0] [batch_t 0.393 (0.451)] [data_t 0.098] [optim_t 0.295] [lr 0.001169] [CE 3.048 (3.382)] [KD 0.000 (0.000)] 2024-10-12 14:16:14,916 - Train: 57.50% [215800/375300] [172.5/300.0] [batch_t 0.452 (0.438)] [data_t 0.157] [optim_t 0.295] [lr 0.001168] [CE 3.588 (3.397)] [KD 0.000 (0.000)] 2024-10-12 14:16:36,781 - Train: 57.51% [215850/375300] [172.5/300.0] [batch_t 0.506 (0.437)] [data_t 0.207] [optim_t 0.298] [lr 0.001168] [CE 3.512 (3.444)] [KD 0.000 (0.000)] 2024-10-12 14:16:59,079 - Train: 57.53% [215900/375300] [172.6/300.0] [batch_t 0.469 (0.446)] [data_t 0.173] [optim_t 0.295] [lr 0.001167] [CE 3.322 (3.390)] [KD 0.000 (0.000)] 2024-10-12 14:17:21,778 - Train: 57.54% [215950/375300] [172.6/300.0] [batch_t 0.418 (0.454)] [data_t 0.122] [optim_t 0.296] [lr 0.001167] [CE 3.696 (3.361)] [KD 0.000 (0.000)] 2024-10-12 14:17:43,998 - Train: 57.55% [216000/375300] [172.7/300.0] [batch_t 0.413 (0.444)] [data_t 0.119] [optim_t 0.294] [lr 0.001166] [CE 3.430 (3.426)] [KD 0.000 (0.000)] 2024-10-12 14:18:06,564 - Train: 57.57% [216050/375300] [172.7/300.0] [batch_t 0.488 (0.451)] [data_t 0.195] [optim_t 0.293] [lr 0.001165] [CE 3.191 (3.392)] [KD 0.000 (0.000)] 2024-10-12 14:18:29,010 - Train: 57.58% [216100/375300] [172.7/300.0] [batch_t 0.473 (0.449)] [data_t 0.177] [optim_t 0.296] [lr 0.001165] [CE 3.318 (3.376)] [KD 0.000 (0.000)] 2024-10-12 14:18:51,248 - Train: 57.59% [216150/375300] [172.8/300.0] [batch_t 0.452 (0.445)] [data_t 0.152] [optim_t 0.300] [lr 0.001164] [CE 3.151 (3.413)] [KD 0.000 (0.000)] 2024-10-12 14:19:13,238 - Train: 57.61% [216200/375300] [172.8/300.0] [batch_t 0.479 (0.440)] [data_t 0.178] [optim_t 0.301] [lr 0.001163] [CE 3.207 (3.451)] [KD 0.000 (0.000)] 2024-10-12 14:19:35,194 - Train: 57.62% [216250/375300] [172.9/300.0] [batch_t 0.459 (0.439)] [data_t 0.162] [optim_t 0.296] [lr 0.001163] [CE 3.301 (3.376)] [KD 0.000 (0.000)] 2024-10-12 14:19:57,380 - Train: 57.63% [216300/375300] [172.9/300.0] [batch_t 0.482 (0.444)] [data_t 0.177] [optim_t 0.305] [lr 0.001162] [CE 3.546 (3.456)] [KD 0.000 (0.000)] 2024-10-12 14:20:18,874 - Train: 57.65% [216350/375300] [172.9/300.0] [batch_t 0.432 (0.430)] [data_t 0.137] [optim_t 0.295] [lr 0.001162] [CE 3.543 (3.447)] [KD 0.000 (0.000)] 2024-10-12 14:20:40,452 - Train: 57.66% [216400/375300] [173.0/300.0] [batch_t 0.484 (0.431)] [data_t 0.188] [optim_t 0.296] [lr 0.001161] [CE 3.208 (3.401)] [KD 0.000 (0.000)] 2024-10-12 14:20:48,958 - ==> Total time: 1 day, 2:33:52 Eta: 19:30:04 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 14:21:05,123 - Train: 57.67% [216450/375300] [173.0/300.0] [batch_t 0.460 (0.546)] [data_t 0.015] [optim_t 0.445] [lr 0.001160] [CE 3.547 (3.377)] [KD 0.000 (0.000)] 2024-10-12 14:21:27,267 - Train: 57.69% [216500/375300] [173.1/300.0] [batch_t 0.466 (0.443)] [data_t 0.016] [optim_t 0.451] [lr 0.001160] [CE 3.485 (3.395)] [KD 0.000 (0.000)] 2024-10-12 14:21:49,853 - Train: 57.70% [216550/375300] [173.1/300.0] [batch_t 0.431 (0.452)] [data_t 0.015] [optim_t 0.416] [lr 0.001159] [CE 3.262 (3.370)] [KD 0.000 (0.000)] 2024-10-12 14:22:11,041 - Train: 57.71% [216600/375300] [173.1/300.0] [batch_t 0.404 (0.424)] [data_t 0.016] [optim_t 0.389] [lr 0.001159] [CE 3.086 (3.402)] [KD 0.000 (0.000)] 2024-10-12 14:22:33,133 - Train: 57.73% [216650/375300] [173.2/300.0] [batch_t 0.510 (0.442)] [data_t 0.016] [optim_t 0.494] [lr 0.001158] [CE 3.591 (3.398)] [KD 0.000 (0.000)] 2024-10-12 14:22:55,337 - Train: 57.74% [216700/375300] [173.2/300.0] [batch_t 0.442 (0.444)] [data_t 0.015] [optim_t 0.427] [lr 0.001157] [CE 3.632 (3.342)] [KD 0.000 (0.000)] 2024-10-12 14:23:17,309 - Train: 57.75% [216750/375300] [173.3/300.0] [batch_t 0.430 (0.439)] [data_t 0.015] [optim_t 0.415] [lr 0.001157] [CE 3.599 (3.412)] [KD 0.000 (0.000)] 2024-10-12 14:23:38,766 - Train: 57.77% [216800/375300] [173.3/300.0] [batch_t 0.415 (0.429)] [data_t 0.015] [optim_t 0.399] [lr 0.001156] [CE 3.395 (3.388)] [KD 0.000 (0.000)] 2024-10-12 14:24:00,644 - Train: 57.78% [216850/375300] [173.3/300.0] [batch_t 0.512 (0.437)] [data_t 0.016] [optim_t 0.496] [lr 0.001156] [CE 3.825 (3.396)] [KD 0.000 (0.000)] 2024-10-12 14:24:21,860 - Train: 57.79% [216900/375300] [173.4/300.0] [batch_t 0.454 (0.424)] [data_t 0.015] [optim_t 0.438] [lr 0.001155] [CE 2.966 (3.398)] [KD 0.000 (0.000)] 2024-10-12 14:24:43,759 - Train: 57.81% [216950/375300] [173.4/300.0] [batch_t 0.480 (0.438)] [data_t 0.016] [optim_t 0.464] [lr 0.001154] [CE 3.345 (3.396)] [KD 0.000 (0.000)] 2024-10-12 14:25:05,495 - Train: 57.82% [217000/375300] [173.5/300.0] [batch_t 0.482 (0.435)] [data_t 0.016] [optim_t 0.466] [lr 0.001154] [CE 3.348 (3.400)] [KD 0.000 (0.000)] 2024-10-12 14:25:27,477 - Train: 57.83% [217050/375300] [173.5/300.0] [batch_t 0.470 (0.440)] [data_t 0.016] [optim_t 0.454] [lr 0.001153] [CE 3.285 (3.372)] [KD 0.000 (0.000)] 2024-10-12 14:25:49,456 - Train: 57.85% [217100/375300] [173.5/300.0] [batch_t 0.513 (0.439)] [data_t 0.016] [optim_t 0.497] [lr 0.001153] [CE 3.323 (3.411)] [KD 0.000 (0.000)] 2024-10-12 14:26:11,505 - Train: 57.86% [217150/375300] [173.6/300.0] [batch_t 0.423 (0.441)] [data_t 0.016] [optim_t 0.408] [lr 0.001152] [CE 3.292 (3.357)] [KD 0.000 (0.000)] 2024-10-12 14:26:33,330 - Train: 57.87% [217200/375300] [173.6/300.0] [batch_t 0.424 (0.436)] [data_t 0.015] [optim_t 0.409] [lr 0.001151] [CE 3.588 (3.340)] [KD 0.000 (0.000)] 2024-10-12 14:26:55,088 - Train: 57.89% [217250/375300] [173.7/300.0] [batch_t 0.470 (0.435)] [data_t 0.016] [optim_t 0.454] [lr 0.001151] [CE 3.295 (3.400)] [KD 0.000 (0.000)] 2024-10-12 14:27:17,104 - Train: 57.90% [217300/375300] [173.7/300.0] [batch_t 0.406 (0.440)] [data_t 0.015] [optim_t 0.390] [lr 0.001150] [CE 3.915 (3.406)] [KD 0.000 (0.000)] 2024-10-12 14:27:39,434 - Train: 57.91% [217350/375300] [173.7/300.0] [batch_t 0.466 (0.446)] [data_t 0.015] [optim_t 0.451] [lr 0.001150] [CE 3.490 (3.440)] [KD 0.000 (0.000)] 2024-10-12 14:28:01,396 - Train: 57.93% [217400/375300] [173.8/300.0] [batch_t 0.466 (0.439)] [data_t 0.016] [optim_t 0.450] [lr 0.001149] [CE 3.280 (3.403)] [KD 0.000 (0.000)] 2024-10-12 14:28:23,557 - Train: 57.94% [217450/375300] [173.8/300.0] [batch_t 0.473 (0.443)] [data_t 0.015] [optim_t 0.457] [lr 0.001148] [CE 3.392 (3.398)] [KD 0.000 (0.000)] 2024-10-12 14:28:45,915 - Train: 57.95% [217500/375300] [173.9/300.0] [batch_t 0.449 (0.447)] [data_t 0.015] [optim_t 0.434] [lr 0.001148] [CE 3.324 (3.412)] [KD 0.000 (0.000)] 2024-10-12 14:29:07,811 - Train: 57.97% [217550/375300] [173.9/300.0] [batch_t 0.420 (0.438)] [data_t 0.016] [optim_t 0.404] [lr 0.001147] [CE 3.041 (3.417)] [KD 0.000 (0.000)] 2024-10-12 14:29:29,861 - Train: 57.98% [217600/375300] [173.9/300.0] [batch_t 0.398 (0.441)] [data_t 0.016] [optim_t 0.382] [lr 0.001147] [CE 3.352 (3.410)] [KD 0.000 (0.000)] 2024-10-12 14:29:51,441 - Train: 57.99% [217650/375300] [174.0/300.0] [batch_t 0.443 (0.431)] [data_t 0.016] [optim_t 0.427] [lr 0.001146] [CE 3.292 (3.419)] [KD 0.000 (0.000)] 2024-10-12 14:30:00,308 - ==> Total time: 1 day, 2:43:04 Eta: 19:20:50 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 14:30:15,645 - Train: 58.01% [217700/375300] [174.0/300.0] [batch_t 0.517 (0.525)] [data_t 0.016] [optim_t 0.501] [lr 0.001145] [CE 3.658 (3.452)] [KD 0.000 (0.000)] 2024-10-12 14:30:38,478 - Train: 58.02% [217750/375300] [174.1/300.0] [batch_t 0.312 (0.456)] [data_t 0.015] [optim_t 0.296] [lr 0.001145] [CE 3.213 (3.358)] [KD 0.000 (0.000)] 2024-10-12 14:30:59,659 - Train: 58.03% [217800/375300] [174.1/300.0] [batch_t 0.472 (0.423)] [data_t 0.173] [optim_t 0.299] [lr 0.001144] [CE 3.662 (3.398)] [KD 0.000 (0.000)] 2024-10-12 14:31:21,896 - Train: 58.05% [217850/375300] [174.1/300.0] [batch_t 0.429 (0.445)] [data_t 0.015] [optim_t 0.414] [lr 0.001144] [CE 3.313 (3.399)] [KD 0.000 (0.000)] 2024-10-12 14:31:44,044 - Train: 58.06% [217900/375300] [174.2/300.0] [batch_t 0.309 (0.443)] [data_t 0.016] [optim_t 0.293] [lr 0.001143] [CE 3.681 (3.360)] [KD 0.000 (0.000)] 2024-10-12 14:32:05,799 - Train: 58.07% [217950/375300] [174.2/300.0] [batch_t 0.431 (0.435)] [data_t 0.015] [optim_t 0.416] [lr 0.001142] [CE 3.425 (3.419)] [KD 0.000 (0.000)] 2024-10-12 14:32:28,131 - Train: 58.09% [218000/375300] [174.3/300.0] [batch_t 0.507 (0.447)] [data_t 0.015] [optim_t 0.492] [lr 0.001142] [CE 3.192 (3.336)] [KD 0.000 (0.000)] 2024-10-12 14:32:49,638 - Train: 58.10% [218050/375300] [174.3/300.0] [batch_t 0.438 (0.430)] [data_t 0.016] [optim_t 0.423] [lr 0.001141] [CE 3.588 (3.372)] [KD 0.000 (0.000)] 2024-10-12 14:33:11,257 - Train: 58.11% [218100/375300] [174.3/300.0] [batch_t 0.442 (0.432)] [data_t 0.015] [optim_t 0.426] [lr 0.001141] [CE 3.514 (3.395)] [KD 0.000 (0.000)] 2024-10-12 14:33:33,560 - Train: 58.13% [218150/375300] [174.4/300.0] [batch_t 0.358 (0.446)] [data_t 0.016] [optim_t 0.342] [lr 0.001140] [CE 3.532 (3.359)] [KD 0.000 (0.000)] 2024-10-12 14:33:55,557 - Train: 58.14% [218200/375300] [174.4/300.0] [batch_t 0.476 (0.440)] [data_t 0.015] [optim_t 0.461] [lr 0.001139] [CE 3.591 (3.411)] [KD 0.000 (0.000)] 2024-10-12 14:34:18,030 - Train: 58.15% [218250/375300] [174.5/300.0] [batch_t 0.746 (0.449)] [data_t 0.016] [optim_t 0.730] [lr 0.001139] [CE 3.311 (3.373)] [KD 0.000 (0.000)] 2024-10-12 14:34:40,369 - Train: 58.17% [218300/375300] [174.5/300.0] [batch_t 0.494 (0.447)] [data_t 0.016] [optim_t 0.478] [lr 0.001138] [CE 3.940 (3.421)] [KD 0.000 (0.000)] 2024-10-12 14:35:02,843 - Train: 58.18% [218350/375300] [174.5/300.0] [batch_t 0.523 (0.449)] [data_t 0.015] [optim_t 0.507] [lr 0.001138] [CE 3.144 (3.350)] [KD 0.000 (0.000)] 2024-10-12 14:35:25,069 - Train: 58.19% [218400/375300] [174.6/300.0] [batch_t 0.479 (0.444)] [data_t 0.016] [optim_t 0.463] [lr 0.001137] [CE 3.425 (3.400)] [KD 0.000 (0.000)] 2024-10-12 14:35:47,933 - Train: 58.21% [218450/375300] [174.6/300.0] [batch_t 0.460 (0.457)] [data_t 0.015] [optim_t 0.444] [lr 0.001136] [CE 2.967 (3.413)] [KD 0.000 (0.000)] 2024-10-12 14:36:10,421 - Train: 58.22% [218500/375300] [174.7/300.0] [batch_t 0.434 (0.450)] [data_t 0.016] [optim_t 0.419] [lr 0.001136] [CE 3.738 (3.445)] [KD 0.000 (0.000)] 2024-10-12 14:36:32,674 - Train: 58.23% [218550/375300] [174.7/300.0] [batch_t 0.468 (0.445)] [data_t 0.016] [optim_t 0.452] [lr 0.001135] [CE 3.754 (3.395)] [KD 0.000 (0.000)] 2024-10-12 14:36:54,677 - Train: 58.25% [218600/375300] [174.7/300.0] [batch_t 0.437 (0.440)] [data_t 0.015] [optim_t 0.422] [lr 0.001135] [CE 3.315 (3.407)] [KD 0.000 (0.000)] 2024-10-12 14:37:16,246 - Train: 58.26% [218650/375300] [174.8/300.0] [batch_t 0.499 (0.431)] [data_t 0.016] [optim_t 0.483] [lr 0.001134] [CE 3.628 (3.413)] [KD 0.000 (0.000)] 2024-10-12 14:37:38,566 - Train: 58.27% [218700/375300] [174.8/300.0] [batch_t 0.500 (0.446)] [data_t 0.015] [optim_t 0.484] [lr 0.001133] [CE 3.587 (3.387)] [KD 0.000 (0.000)] 2024-10-12 14:38:00,733 - Train: 58.29% [218750/375300] [174.9/300.0] [batch_t 0.415 (0.443)] [data_t 0.016] [optim_t 0.399] [lr 0.001133] [CE 2.958 (3.387)] [KD 0.000 (0.000)] 2024-10-12 14:38:22,465 - Train: 58.30% [218800/375300] [174.9/300.0] [batch_t 0.453 (0.435)] [data_t 0.015] [optim_t 0.437] [lr 0.001132] [CE 3.292 (3.381)] [KD 0.000 (0.000)] 2024-10-12 14:38:44,161 - Train: 58.31% [218850/375300] [174.9/300.0] [batch_t 0.393 (0.434)] [data_t 0.016] [optim_t 0.377] [lr 0.001132] [CE 3.716 (3.420)] [KD 0.000 (0.000)] 2024-10-12 14:39:05,405 - Train: 58.33% [218900/375300] [175.0/300.0] [batch_t 0.442 (0.425)] [data_t 0.016] [optim_t 0.426] [lr 0.001131] [CE 3.296 (3.393)] [KD 0.000 (0.000)] 2024-10-12 14:39:37,087 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.441)] [top1_cnt 38046] [top5_cnt 46750] [top_all 50000] 2024-10-12 14:39:37,087 - net: 76.092 (93.500) 2024-10-12 14:39:59,492 - Test (net_E): 100.00% [50/50] [batch_t 0.133 (0.439)] [top1_cnt 39961] [top5_cnt 47634] [top_all 50000] 2024-10-12 14:39:59,492 - net_E: 79.922 (95.268) 2024-10-12 14:39:59,691 - Max [top1: 76.092 (epoch: 175)] [top1-ema: 79.922 (epoch: 175)] 2024-10-12 14:39:59,691 - ==> Total time: 1 day, 2:53:03 Eta: 19:12:11 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 14:40:18,739 - Train: 58.34% [218950/375300] [175.0/300.0] [batch_t 1.404 (0.450)] [data_t 1.110] [optim_t 0.294] [lr 0.001130] [CE 3.568 (3.381)] [KD 0.000 (0.000)] 2024-10-12 14:40:40,091 - Train: 58.35% [219000/375300] [175.1/300.0] [batch_t 0.428 (0.427)] [data_t 0.134] [optim_t 0.294] [lr 0.001130] [CE 3.208 (3.349)] [KD 0.000 (0.000)] 2024-10-12 14:41:01,778 - Train: 58.37% [219050/375300] [175.1/300.0] [batch_t 0.355 (0.434)] [data_t 0.016] [optim_t 0.340] [lr 0.001129] [CE 3.401 (3.379)] [KD 0.000 (0.000)] 2024-10-12 14:41:23,784 - Train: 58.38% [219100/375300] [175.1/300.0] [batch_t 0.511 (0.440)] [data_t 0.015] [optim_t 0.495] [lr 0.001129] [CE 3.594 (3.366)] [KD 0.000 (0.000)] 2024-10-12 14:41:45,330 - Train: 58.39% [219150/375300] [175.2/300.0] [batch_t 0.424 (0.431)] [data_t 0.015] [optim_t 0.408] [lr 0.001128] [CE 3.523 (3.355)] [KD 0.000 (0.000)] 2024-10-12 14:42:07,173 - Train: 58.41% [219200/375300] [175.2/300.0] [batch_t 0.422 (0.437)] [data_t 0.015] [optim_t 0.406] [lr 0.001127] [CE 3.179 (3.405)] [KD 0.000 (0.000)] 2024-10-12 14:42:29,610 - Train: 58.42% [219250/375300] [175.3/300.0] [batch_t 0.470 (0.449)] [data_t 0.015] [optim_t 0.455] [lr 0.001127] [CE 3.261 (3.386)] [KD 0.000 (0.000)] 2024-10-12 14:42:52,121 - Train: 58.43% [219300/375300] [175.3/300.0] [batch_t 0.525 (0.450)] [data_t 0.016] [optim_t 0.509] [lr 0.001126] [CE 3.154 (3.362)] [KD 0.000 (0.000)] 2024-10-12 14:43:14,205 - Train: 58.45% [219350/375300] [175.3/300.0] [batch_t 0.473 (0.442)] [data_t 0.015] [optim_t 0.458] [lr 0.001126] [CE 3.354 (3.400)] [KD 0.000 (0.000)] 2024-10-12 14:43:36,511 - Train: 58.46% [219400/375300] [175.4/300.0] [batch_t 0.473 (0.446)] [data_t 0.015] [optim_t 0.457] [lr 0.001125] [CE 3.286 (3.356)] [KD 0.000 (0.000)] 2024-10-12 14:43:58,705 - Train: 58.47% [219450/375300] [175.4/300.0] [batch_t 0.437 (0.444)] [data_t 0.016] [optim_t 0.421] [lr 0.001124] [CE 3.611 (3.389)] [KD 0.000 (0.000)] 2024-10-12 14:44:21,612 - Train: 58.49% [219500/375300] [175.5/300.0] [batch_t 0.455 (0.458)] [data_t 0.016] [optim_t 0.440] [lr 0.001124] [CE 3.280 (3.414)] [KD 0.000 (0.000)] 2024-10-12 14:44:44,389 - Train: 58.50% [219550/375300] [175.5/300.0] [batch_t 0.318 (0.455)] [data_t 0.015] [optim_t 0.303] [lr 0.001123] [CE 3.523 (3.382)] [KD 0.000 (0.000)] 2024-10-12 14:45:06,677 - Train: 58.51% [219600/375300] [175.5/300.0] [batch_t 0.474 (0.446)] [data_t 0.015] [optim_t 0.458] [lr 0.001123] [CE 3.694 (3.410)] [KD 0.000 (0.000)] 2024-10-12 14:45:28,895 - Train: 58.53% [219650/375300] [175.6/300.0] [batch_t 0.471 (0.444)] [data_t 0.015] [optim_t 0.456] [lr 0.001122] [CE 3.616 (3.435)] [KD 0.000 (0.000)] 2024-10-12 14:45:51,157 - Train: 58.54% [219700/375300] [175.6/300.0] [batch_t 0.424 (0.445)] [data_t 0.016] [optim_t 0.408] [lr 0.001121] [CE 3.501 (3.382)] [KD 0.000 (0.000)] 2024-10-12 14:46:13,810 - Train: 58.55% [219750/375300] [175.7/300.0] [batch_t 0.391 (0.453)] [data_t 0.016] [optim_t 0.375] [lr 0.001121] [CE 3.393 (3.394)] [KD 0.000 (0.000)] 2024-10-12 14:46:36,291 - Train: 58.57% [219800/375300] [175.7/300.0] [batch_t 0.443 (0.450)] [data_t 0.015] [optim_t 0.427] [lr 0.001120] [CE 3.193 (3.418)] [KD 0.000 (0.000)] 2024-10-12 14:46:58,286 - Train: 58.58% [219850/375300] [175.7/300.0] [batch_t 0.451 (0.440)] [data_t 0.016] [optim_t 0.435] [lr 0.001120] [CE 3.405 (3.421)] [KD 0.000 (0.000)] 2024-10-12 14:47:19,406 - Train: 58.59% [219900/375300] [175.8/300.0] [batch_t 0.404 (0.422)] [data_t 0.015] [optim_t 0.388] [lr 0.001119] [CE 3.290 (3.387)] [KD 0.000 (0.000)] 2024-10-12 14:47:41,221 - Train: 58.61% [219950/375300] [175.8/300.0] [batch_t 0.458 (0.436)] [data_t 0.015] [optim_t 0.443] [lr 0.001118] [CE 3.391 (3.423)] [KD 0.000 (0.000)] 2024-10-12 14:48:03,348 - Train: 58.62% [220000/375300] [175.9/300.0] [batch_t 0.415 (0.442)] [data_t 0.015] [optim_t 0.399] [lr 0.001118] [CE 3.614 (3.411)] [KD 0.000 (0.000)] 2024-10-12 14:48:24,975 - Train: 58.63% [220050/375300] [175.9/300.0] [batch_t 0.339 (0.432)] [data_t 0.015] [optim_t 0.324] [lr 0.001117] [CE 3.396 (3.364)] [KD 0.000 (0.000)] 2024-10-12 14:48:46,789 - Train: 58.65% [220100/375300] [175.9/300.0] [batch_t 0.408 (0.436)] [data_t 0.015] [optim_t 0.393] [lr 0.001117] [CE 3.568 (3.394)] [KD 0.000 (0.000)] 2024-10-12 14:49:09,921 - Train: 58.66% [220150/375300] [176.0/300.0] [batch_t 0.525 (0.463)] [data_t 0.015] [optim_t 0.509] [lr 0.001116] [CE 3.718 (3.432)] [KD 0.000 (0.000)] 2024-10-12 14:49:19,889 - ==> Total time: 1 day, 3:02:23 Eta: 19:03:03 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 14:49:34,948 - Train: 58.67% [220200/375300] [176.0/300.0] [batch_t 0.314 (0.551)] [data_t 0.016] [optim_t 0.298] [lr 0.001115] [CE 3.573 (3.410)] [KD 0.000 (0.000)] 2024-10-12 14:49:57,242 - Train: 58.69% [220250/375300] [176.1/300.0] [batch_t 0.347 (0.446)] [data_t 0.015] [optim_t 0.331] [lr 0.001115] [CE 3.275 (3.358)] [KD 0.000 (0.000)] 2024-10-12 14:50:19,411 - Train: 58.70% [220300/375300] [176.1/300.0] [batch_t 0.463 (0.443)] [data_t 0.015] [optim_t 0.447] [lr 0.001114] [CE 3.371 (3.378)] [KD 0.000 (0.000)] 2024-10-12 14:50:41,565 - Train: 58.71% [220350/375300] [176.1/300.0] [batch_t 0.360 (0.443)] [data_t 0.015] [optim_t 0.344] [lr 0.001114] [CE 3.560 (3.381)] [KD 0.000 (0.000)] 2024-10-12 14:51:03,775 - Train: 58.73% [220400/375300] [176.2/300.0] [batch_t 0.371 (0.444)] [data_t 0.016] [optim_t 0.356] [lr 0.001113] [CE 3.323 (3.393)] [KD 0.000 (0.000)] 2024-10-12 14:51:25,986 - Train: 58.74% [220450/375300] [176.2/300.0] [batch_t 0.436 (0.444)] [data_t 0.016] [optim_t 0.420] [lr 0.001112] [CE 3.483 (3.384)] [KD 0.000 (0.000)] 2024-10-12 14:51:48,618 - Train: 58.75% [220500/375300] [176.3/300.0] [batch_t 0.431 (0.453)] [data_t 0.016] [optim_t 0.415] [lr 0.001112] [CE 3.130 (3.425)] [KD 0.000 (0.000)] 2024-10-12 14:52:11,138 - Train: 58.77% [220550/375300] [176.3/300.0] [batch_t 0.430 (0.450)] [data_t 0.016] [optim_t 0.415] [lr 0.001111] [CE 3.283 (3.400)] [KD 0.000 (0.000)] 2024-10-12 14:52:33,309 - Train: 58.78% [220600/375300] [176.3/300.0] [batch_t 0.444 (0.443)] [data_t 0.016] [optim_t 0.428] [lr 0.001111] [CE 3.565 (3.389)] [KD 0.000 (0.000)] 2024-10-12 14:52:55,640 - Train: 58.79% [220650/375300] [176.4/300.0] [batch_t 0.516 (0.446)] [data_t 0.015] [optim_t 0.501] [lr 0.001110] [CE 3.629 (3.440)] [KD 0.000 (0.000)] 2024-10-12 14:53:17,832 - Train: 58.81% [220700/375300] [176.4/300.0] [batch_t 0.433 (0.444)] [data_t 0.015] [optim_t 0.417] [lr 0.001109] [CE 3.079 (3.373)] [KD 0.000 (0.000)] 2024-10-12 14:53:39,950 - Train: 58.82% [220750/375300] [176.5/300.0] [batch_t 0.425 (0.442)] [data_t 0.015] [optim_t 0.410] [lr 0.001109] [CE 3.263 (3.386)] [KD 0.000 (0.000)] 2024-10-12 14:54:02,164 - Train: 58.83% [220800/375300] [176.5/300.0] [batch_t 0.417 (0.444)] [data_t 0.016] [optim_t 0.401] [lr 0.001108] [CE 3.240 (3.390)] [KD 0.000 (0.000)] 2024-10-12 14:54:23,929 - Train: 58.85% [220850/375300] [176.5/300.0] [batch_t 0.392 (0.435)] [data_t 0.016] [optim_t 0.376] [lr 0.001108] [CE 3.337 (3.388)] [KD 0.000 (0.000)] 2024-10-12 14:54:45,708 - Train: 58.86% [220900/375300] [176.6/300.0] [batch_t 0.417 (0.435)] [data_t 0.016] [optim_t 0.402] [lr 0.001107] [CE 3.214 (3.410)] [KD 0.000 (0.000)] 2024-10-12 14:55:07,730 - Train: 58.87% [220950/375300] [176.6/300.0] [batch_t 0.445 (0.440)] [data_t 0.015] [optim_t 0.430] [lr 0.001106] [CE 3.062 (3.369)] [KD 0.000 (0.000)] 2024-10-12 14:55:30,029 - Train: 58.89% [221000/375300] [176.7/300.0] [batch_t 0.412 (0.446)] [data_t 0.015] [optim_t 0.396] [lr 0.001106] [CE 2.862 (3.429)] [KD 0.000 (0.000)] 2024-10-12 14:55:51,947 - Train: 58.90% [221050/375300] [176.7/300.0] [batch_t 0.491 (0.438)] [data_t 0.015] [optim_t 0.476] [lr 0.001105] [CE 3.386 (3.397)] [KD 0.000 (0.000)] 2024-10-12 14:56:13,804 - Train: 58.91% [221100/375300] [176.7/300.0] [batch_t 0.437 (0.437)] [data_t 0.015] [optim_t 0.422] [lr 0.001105] [CE 3.321 (3.376)] [KD 0.000 (0.000)] 2024-10-12 14:56:35,592 - Train: 58.93% [221150/375300] [176.8/300.0] [batch_t 0.412 (0.436)] [data_t 0.016] [optim_t 0.397] [lr 0.001104] [CE 3.265 (3.362)] [KD 0.000 (0.000)] 2024-10-12 14:56:57,467 - Train: 58.94% [221200/375300] [176.8/300.0] [batch_t 0.482 (0.437)] [data_t 0.016] [optim_t 0.466] [lr 0.001103] [CE 3.478 (3.387)] [KD 0.000 (0.000)] 2024-10-12 14:57:19,713 - Train: 58.95% [221250/375300] [176.9/300.0] [batch_t 0.441 (0.445)] [data_t 0.016] [optim_t 0.425] [lr 0.001103] [CE 3.359 (3.346)] [KD 0.000 (0.000)] 2024-10-12 14:57:41,957 - Train: 58.97% [221300/375300] [176.9/300.0] [batch_t 0.427 (0.445)] [data_t 0.015] [optim_t 0.411] [lr 0.001102] [CE 3.590 (3.389)] [KD 0.000 (0.000)] 2024-10-12 14:58:03,924 - Train: 58.98% [221350/375300] [176.9/300.0] [batch_t 0.420 (0.439)] [data_t 0.016] [optim_t 0.404] [lr 0.001102] [CE 3.549 (3.400)] [KD 0.000 (0.000)] 2024-10-12 14:58:25,476 - Train: 58.99% [221400/375300] [177.0/300.0] [batch_t 0.389 (0.431)] [data_t 0.015] [optim_t 0.374] [lr 0.001101] [CE 3.366 (3.416)] [KD 0.000 (0.000)] 2024-10-12 14:58:35,879 - ==> Total time: 1 day, 3:11:39 Eta: 18:53:52 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 14:58:51,071 - Train: 59.01% [221450/375300] [177.0/300.0] [batch_t 0.318 (0.583)] [data_t 0.016] [optim_t 0.303] [lr 0.001100] [CE 3.442 (3.348)] [KD 0.000 (0.000)] 2024-10-12 14:59:12,472 - Train: 59.02% [221500/375300] [177.1/300.0] [batch_t 0.414 (0.428)] [data_t 0.015] [optim_t 0.398] [lr 0.001100] [CE 3.588 (3.367)] [KD 0.000 (0.000)] 2024-10-12 14:59:34,563 - Train: 59.03% [221550/375300] [177.1/300.0] [batch_t 0.392 (0.442)] [data_t 0.016] [optim_t 0.377] [lr 0.001099] [CE 3.254 (3.311)] [KD 0.000 (0.000)] 2024-10-12 14:59:56,549 - Train: 59.05% [221600/375300] [177.1/300.0] [batch_t 0.487 (0.440)] [data_t 0.016] [optim_t 0.471] [lr 0.001099] [CE 3.362 (3.402)] [KD 0.000 (0.000)] 2024-10-12 15:00:18,295 - Train: 59.06% [221650/375300] [177.2/300.0] [batch_t 0.406 (0.435)] [data_t 0.016] [optim_t 0.390] [lr 0.001098] [CE 3.600 (3.408)] [KD 0.000 (0.000)] 2024-10-12 15:00:39,516 - Train: 59.07% [221700/375300] [177.2/300.0] [batch_t 0.431 (0.424)] [data_t 0.016] [optim_t 0.415] [lr 0.001097] [CE 3.395 (3.368)] [KD 0.000 (0.000)] 2024-10-12 15:01:01,016 - Train: 59.09% [221750/375300] [177.3/300.0] [batch_t 0.455 (0.430)] [data_t 0.016] [optim_t 0.440] [lr 0.001097] [CE 3.364 (3.340)] [KD 0.000 (0.000)] 2024-10-12 15:01:22,722 - Train: 59.10% [221800/375300] [177.3/300.0] [batch_t 0.522 (0.434)] [data_t 0.016] [optim_t 0.507] [lr 0.001096] [CE 3.362 (3.409)] [KD 0.000 (0.000)] 2024-10-12 15:01:44,292 - Train: 59.11% [221850/375300] [177.3/300.0] [batch_t 0.459 (0.431)] [data_t 0.015] [optim_t 0.444] [lr 0.001096] [CE 3.278 (3.381)] [KD 0.000 (0.000)] 2024-10-12 15:02:05,698 - Train: 59.13% [221900/375300] [177.4/300.0] [batch_t 0.412 (0.428)] [data_t 0.015] [optim_t 0.396] [lr 0.001095] [CE 3.241 (3.406)] [KD 0.000 (0.000)] 2024-10-12 15:02:27,057 - Train: 59.14% [221950/375300] [177.4/300.0] [batch_t 0.399 (0.427)] [data_t 0.015] [optim_t 0.384] [lr 0.001094] [CE 3.443 (3.372)] [KD 0.000 (0.000)] 2024-10-12 15:02:48,594 - Train: 59.15% [222000/375300] [177.5/300.0] [batch_t 0.492 (0.431)] [data_t 0.016] [optim_t 0.476] [lr 0.001094] [CE 3.472 (3.389)] [KD 0.000 (0.000)] 2024-10-12 15:03:10,382 - Train: 59.17% [222050/375300] [177.5/300.0] [batch_t 0.398 (0.436)] [data_t 0.016] [optim_t 0.383] [lr 0.001093] [CE 3.227 (3.391)] [KD 0.000 (0.000)] 2024-10-12 15:03:31,906 - Train: 59.18% [222100/375300] [177.5/300.0] [batch_t 0.426 (0.430)] [data_t 0.016] [optim_t 0.410] [lr 0.001093] [CE 3.552 (3.377)] [KD 0.000 (0.000)] 2024-10-12 15:03:53,231 - Train: 59.19% [222150/375300] [177.6/300.0] [batch_t 0.414 (0.426)] [data_t 0.016] [optim_t 0.399] [lr 0.001092] [CE 3.441 (3.400)] [KD 0.000 (0.000)] 2024-10-12 15:04:14,890 - Train: 59.21% [222200/375300] [177.6/300.0] [batch_t 0.432 (0.433)] [data_t 0.015] [optim_t 0.416] [lr 0.001091] [CE 3.307 (3.397)] [KD 0.000 (0.000)] 2024-10-12 15:04:36,478 - Train: 59.22% [222250/375300] [177.7/300.0] [batch_t 0.393 (0.432)] [data_t 0.016] [optim_t 0.377] [lr 0.001091] [CE 3.093 (3.411)] [KD 0.000 (0.000)] 2024-10-12 15:04:57,919 - Train: 59.23% [222300/375300] [177.7/300.0] [batch_t 0.461 (0.429)] [data_t 0.016] [optim_t 0.445] [lr 0.001090] [CE 3.526 (3.389)] [KD 0.000 (0.000)] 2024-10-12 15:05:19,280 - Train: 59.25% [222350/375300] [177.7/300.0] [batch_t 0.472 (0.427)] [data_t 0.016] [optim_t 0.456] [lr 0.001090] [CE 2.911 (3.360)] [KD 0.000 (0.000)] 2024-10-12 15:05:41,808 - Train: 59.26% [222400/375300] [177.8/300.0] [batch_t 0.497 (0.450)] [data_t 0.015] [optim_t 0.482] [lr 0.001089] [CE 3.415 (3.408)] [KD 0.000 (0.000)] 2024-10-12 15:06:02,610 - Train: 59.27% [222450/375300] [177.8/300.0] [batch_t 0.362 (0.416)] [data_t 0.016] [optim_t 0.347] [lr 0.001089] [CE 2.961 (3.392)] [KD 0.000 (0.000)] 2024-10-12 15:06:23,644 - Train: 59.29% [222500/375300] [177.9/300.0] [batch_t 0.473 (0.421)] [data_t 0.016] [optim_t 0.457] [lr 0.001088] [CE 3.389 (3.404)] [KD 0.000 (0.000)] 2024-10-12 15:06:44,756 - Train: 59.30% [222550/375300] [177.9/300.0] [batch_t 0.374 (0.422)] [data_t 0.015] [optim_t 0.358] [lr 0.001087] [CE 3.170 (3.378)] [KD 0.000 (0.000)] 2024-10-12 15:07:05,764 - Train: 59.31% [222600/375300] [177.9/300.0] [batch_t 0.311 (0.420)] [data_t 0.016] [optim_t 0.296] [lr 0.001087] [CE 3.361 (3.377)] [KD 0.000 (0.000)] 2024-10-12 15:07:27,033 - Train: 59.33% [222650/375300] [178.0/300.0] [batch_t 0.426 (0.425)] [data_t 0.016] [optim_t 0.410] [lr 0.001086] [CE 3.406 (3.387)] [KD 0.000 (0.000)] 2024-10-12 15:07:37,645 - ==> Total time: 1 day, 3:20:41 Eta: 18:44:31 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 15:07:51,690 - Train: 59.34% [222700/375300] [178.0/300.0] [batch_t 0.319 (0.574)] [data_t 0.016] [optim_t 0.303] [lr 0.001086] [CE 3.049 (3.381)] [KD 0.000 (0.000)] 2024-10-12 15:08:13,051 - Train: 59.35% [222750/375300] [178.1/300.0] [batch_t 0.402 (0.427)] [data_t 0.015] [optim_t 0.386] [lr 0.001085] [CE 3.502 (3.376)] [KD 0.000 (0.000)] 2024-10-12 15:08:34,591 - Train: 59.37% [222800/375300] [178.1/300.0] [batch_t 0.455 (0.431)] [data_t 0.016] [optim_t 0.439] [lr 0.001084] [CE 3.380 (3.372)] [KD 0.000 (0.000)] 2024-10-12 15:08:56,447 - Train: 59.38% [222850/375300] [178.1/300.0] [batch_t 0.544 (0.437)] [data_t 0.016] [optim_t 0.528] [lr 0.001084] [CE 3.337 (3.351)] [KD 0.000 (0.000)] 2024-10-12 15:09:18,129 - Train: 59.39% [222900/375300] [178.2/300.0] [batch_t 0.381 (0.434)] [data_t 0.016] [optim_t 0.365] [lr 0.001083] [CE 2.843 (3.350)] [KD 0.000 (0.000)] 2024-10-12 15:09:40,485 - Train: 59.41% [222950/375300] [178.2/300.0] [batch_t 0.416 (0.447)] [data_t 0.016] [optim_t 0.400] [lr 0.001083] [CE 3.266 (3.338)] [KD 0.000 (0.000)] 2024-10-12 15:10:02,801 - Train: 59.42% [223000/375300] [178.3/300.0] [batch_t 0.463 (0.446)] [data_t 0.015] [optim_t 0.447] [lr 0.001082] [CE 3.336 (3.343)] [KD 0.000 (0.000)] 2024-10-12 15:10:24,996 - Train: 59.43% [223050/375300] [178.3/300.0] [batch_t 0.429 (0.444)] [data_t 0.015] [optim_t 0.414] [lr 0.001081] [CE 3.209 (3.345)] [KD 0.000 (0.000)] 2024-10-12 15:10:47,048 - Train: 59.45% [223100/375300] [178.3/300.0] [batch_t 0.410 (0.441)] [data_t 0.016] [optim_t 0.394] [lr 0.001081] [CE 3.454 (3.367)] [KD 0.000 (0.000)] 2024-10-12 15:11:09,509 - Train: 59.46% [223150/375300] [178.4/300.0] [batch_t 0.507 (0.449)] [data_t 0.015] [optim_t 0.492] [lr 0.001080] [CE 3.769 (3.409)] [KD 0.000 (0.000)] 2024-10-12 15:11:31,606 - Train: 59.47% [223200/375300] [178.4/300.0] [batch_t 0.310 (0.442)] [data_t 0.016] [optim_t 0.294] [lr 0.001080] [CE 3.541 (3.375)] [KD 0.000 (0.000)] 2024-10-12 15:11:53,659 - Train: 59.49% [223250/375300] [178.5/300.0] [batch_t 0.438 (0.441)] [data_t 0.016] [optim_t 0.422] [lr 0.001079] [CE 3.409 (3.403)] [KD 0.000 (0.000)] 2024-10-12 15:12:15,691 - Train: 59.50% [223300/375300] [178.5/300.0] [batch_t 0.418 (0.441)] [data_t 0.016] [optim_t 0.402] [lr 0.001078] [CE 3.234 (3.402)] [KD 0.000 (0.000)] 2024-10-12 15:12:37,052 - Train: 59.51% [223350/375300] [178.5/300.0] [batch_t 0.418 (0.427)] [data_t 0.015] [optim_t 0.402] [lr 0.001078] [CE 3.084 (3.374)] [KD 0.000 (0.000)] 2024-10-12 15:12:58,285 - Train: 59.53% [223400/375300] [178.6/300.0] [batch_t 0.384 (0.425)] [data_t 0.015] [optim_t 0.368] [lr 0.001077] [CE 3.403 (3.305)] [KD 0.000 (0.000)] 2024-10-12 15:13:19,356 - Train: 59.54% [223450/375300] [178.6/300.0] [batch_t 0.501 (0.421)] [data_t 0.016] [optim_t 0.485] [lr 0.001077] [CE 3.331 (3.363)] [KD 0.000 (0.000)] 2024-10-12 15:13:40,827 - Train: 59.55% [223500/375300] [178.7/300.0] [batch_t 0.424 (0.429)] [data_t 0.015] [optim_t 0.408] [lr 0.001076] [CE 3.466 (3.392)] [KD 0.000 (0.000)] 2024-10-12 15:14:03,079 - Train: 59.57% [223550/375300] [178.7/300.0] [batch_t 0.439 (0.445)] [data_t 0.015] [optim_t 0.424] [lr 0.001075] [CE 3.442 (3.397)] [KD 0.000 (0.000)] 2024-10-12 15:14:25,249 - Train: 59.58% [223600/375300] [178.7/300.0] [batch_t 0.443 (0.443)] [data_t 0.016] [optim_t 0.427] [lr 0.001075] [CE 3.508 (3.371)] [KD 0.000 (0.000)] 2024-10-12 15:14:47,706 - Train: 59.59% [223650/375300] [178.8/300.0] [batch_t 0.464 (0.449)] [data_t 0.015] [optim_t 0.448] [lr 0.001074] [CE 2.937 (3.349)] [KD 0.000 (0.000)] 2024-10-12 15:15:09,665 - Train: 59.61% [223700/375300] [178.8/300.0] [batch_t 0.452 (0.439)] [data_t 0.016] [optim_t 0.437] [lr 0.001074] [CE 3.516 (3.380)] [KD 0.000 (0.000)] 2024-10-12 15:15:31,336 - Train: 59.62% [223750/375300] [178.9/300.0] [batch_t 0.380 (0.433)] [data_t 0.015] [optim_t 0.365] [lr 0.001073] [CE 3.482 (3.356)] [KD 0.000 (0.000)] 2024-10-12 15:15:53,138 - Train: 59.63% [223800/375300] [178.9/300.0] [batch_t 0.467 (0.436)] [data_t 0.015] [optim_t 0.451] [lr 0.001072] [CE 3.093 (3.349)] [KD 0.000 (0.000)] 2024-10-12 15:16:15,142 - Train: 59.65% [223850/375300] [178.9/300.0] [batch_t 0.490 (0.440)] [data_t 0.016] [optim_t 0.474] [lr 0.001072] [CE 3.265 (3.357)] [KD 0.000 (0.000)] 2024-10-12 15:16:36,588 - Train: 59.66% [223900/375300] [179.0/300.0] [batch_t 0.437 (0.429)] [data_t 0.016] [optim_t 0.421] [lr 0.001071] [CE 3.265 (3.381)] [KD 0.000 (0.000)] 2024-10-12 15:16:48,064 - ==> Total time: 1 day, 3:29:51 Eta: 18:35:16 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 15:17:01,751 - Train: 59.67% [223950/375300] [179.0/300.0] [batch_t 0.325 (0.577)] [data_t 0.016] [optim_t 0.309] [lr 0.001071] [CE 3.712 (3.375)] [KD 0.000 (0.000)] 2024-10-12 15:17:23,564 - Train: 59.69% [224000/375300] [179.1/300.0] [batch_t 0.506 (0.436)] [data_t 0.016] [optim_t 0.491] [lr 0.001070] [CE 3.347 (3.388)] [KD 0.000 (0.000)] 2024-10-12 15:17:45,884 - Train: 59.70% [224050/375300] [179.1/300.0] [batch_t 0.479 (0.446)] [data_t 0.015] [optim_t 0.463] [lr 0.001070] [CE 3.189 (3.319)] [KD 0.000 (0.000)] 2024-10-12 15:18:07,902 - Train: 59.71% [224100/375300] [179.1/300.0] [batch_t 0.418 (0.440)] [data_t 0.015] [optim_t 0.403] [lr 0.001069] [CE 3.539 (3.403)] [KD 0.000 (0.000)] 2024-10-12 15:18:30,567 - Train: 59.73% [224150/375300] [179.2/300.0] [batch_t 0.482 (0.453)] [data_t 0.016] [optim_t 0.467] [lr 0.001068] [CE 3.506 (3.379)] [KD 0.000 (0.000)] 2024-10-12 15:18:52,983 - Train: 59.74% [224200/375300] [179.2/300.0] [batch_t 0.548 (0.448)] [data_t 0.016] [optim_t 0.532] [lr 0.001068] [CE 3.199 (3.394)] [KD 0.000 (0.000)] 2024-10-12 15:19:15,408 - Train: 59.75% [224250/375300] [179.3/300.0] [batch_t 0.490 (0.448)] [data_t 0.015] [optim_t 0.475] [lr 0.001067] [CE 3.042 (3.355)] [KD 0.000 (0.000)] 2024-10-12 15:19:36,945 - Train: 59.77% [224300/375300] [179.3/300.0] [batch_t 0.371 (0.431)] [data_t 0.015] [optim_t 0.355] [lr 0.001067] [CE 3.398 (3.356)] [KD 0.000 (0.000)] 2024-10-12 15:19:59,104 - Train: 59.78% [224350/375300] [179.3/300.0] [batch_t 0.330 (0.443)] [data_t 0.015] [optim_t 0.315] [lr 0.001066] [CE 3.387 (3.392)] [KD 0.000 (0.000)] 2024-10-12 15:20:21,458 - Train: 59.79% [224400/375300] [179.4/300.0] [batch_t 0.473 (0.447)] [data_t 0.016] [optim_t 0.458] [lr 0.001065] [CE 3.454 (3.336)] [KD 0.000 (0.000)] 2024-10-12 15:20:43,776 - Train: 59.81% [224450/375300] [179.4/300.0] [batch_t 0.521 (0.446)] [data_t 0.015] [optim_t 0.505] [lr 0.001065] [CE 3.267 (3.375)] [KD 0.000 (0.000)] 2024-10-12 15:21:05,974 - Train: 59.82% [224500/375300] [179.5/300.0] [batch_t 0.459 (0.444)] [data_t 0.016] [optim_t 0.444] [lr 0.001064] [CE 3.127 (3.335)] [KD 0.000 (0.000)] 2024-10-12 15:21:28,106 - Train: 59.83% [224550/375300] [179.5/300.0] [batch_t 0.388 (0.443)] [data_t 0.015] [optim_t 0.373] [lr 0.001064] [CE 3.203 (3.357)] [KD 0.000 (0.000)] 2024-10-12 15:21:50,038 - Train: 59.85% [224600/375300] [179.5/300.0] [batch_t 0.452 (0.439)] [data_t 0.015] [optim_t 0.437] [lr 0.001063] [CE 3.374 (3.350)] [KD 0.000 (0.000)] 2024-10-12 15:22:11,898 - Train: 59.86% [224650/375300] [179.6/300.0] [batch_t 0.465 (0.437)] [data_t 0.015] [optim_t 0.450] [lr 0.001062] [CE 3.170 (3.397)] [KD 0.000 (0.000)] 2024-10-12 15:22:33,873 - Train: 59.87% [224700/375300] [179.6/300.0] [batch_t 0.467 (0.439)] [data_t 0.016] [optim_t 0.451] [lr 0.001062] [CE 3.121 (3.363)] [KD 0.000 (0.000)] 2024-10-12 15:22:56,101 - Train: 59.89% [224750/375300] [179.7/300.0] [batch_t 0.452 (0.444)] [data_t 0.016] [optim_t 0.436] [lr 0.001061] [CE 3.336 (3.366)] [KD 0.000 (0.000)] 2024-10-12 15:23:18,337 - Train: 59.90% [224800/375300] [179.7/300.0] [batch_t 0.484 (0.445)] [data_t 0.016] [optim_t 0.468] [lr 0.001061] [CE 3.234 (3.388)] [KD 0.000 (0.000)] 2024-10-12 15:23:40,742 - Train: 59.91% [224850/375300] [179.7/300.0] [batch_t 0.488 (0.448)] [data_t 0.016] [optim_t 0.472] [lr 0.001060] [CE 3.445 (3.367)] [KD 0.000 (0.000)] 2024-10-12 15:24:03,201 - Train: 59.93% [224900/375300] [179.8/300.0] [batch_t 0.488 (0.449)] [data_t 0.015] [optim_t 0.472] [lr 0.001059] [CE 3.365 (3.378)] [KD 0.000 (0.000)] 2024-10-12 15:24:24,899 - Train: 59.94% [224950/375300] [179.8/300.0] [batch_t 0.329 (0.434)] [data_t 0.016] [optim_t 0.313] [lr 0.001059] [CE 3.587 (3.354)] [KD 0.000 (0.000)] 2024-10-12 15:24:46,919 - Train: 59.95% [225000/375300] [179.9/300.0] [batch_t 0.337 (0.440)] [data_t 0.016] [optim_t 0.321] [lr 0.001058] [CE 3.459 (3.370)] [KD 0.000 (0.000)] 2024-10-12 15:25:09,052 - Train: 59.97% [225050/375300] [179.9/300.0] [batch_t 0.408 (0.443)] [data_t 0.016] [optim_t 0.392] [lr 0.001058] [CE 3.192 (3.355)] [KD 0.000 (0.000)] 2024-10-12 15:25:31,364 - Train: 59.98% [225100/375300] [179.9/300.0] [batch_t 0.401 (0.446)] [data_t 0.015] [optim_t 0.385] [lr 0.001057] [CE 3.400 (3.372)] [KD 0.000 (0.000)] 2024-10-12 15:25:53,344 - Train: 59.99% [225150/375300] [180.0/300.0] [batch_t 0.359 (0.439)] [data_t 0.015] [optim_t 0.344] [lr 0.001056] [CE 3.237 (3.418)] [KD 0.000 (0.000)] 2024-10-12 15:26:28,506 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.464)] [top1_cnt 38273] [top5_cnt 46854] [top_all 50000] 2024-10-12 15:26:28,507 - net: 76.546 (93.708) 2024-10-12 15:26:51,345 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.444)] [top1_cnt 40024] [top5_cnt 47649] [top_all 50000] 2024-10-12 15:26:51,346 - net_E: 80.048 (95.298) 2024-10-12 15:26:51,523 - Max [top1: 76.546 (epoch: 180)] [top1-ema: 80.048 (epoch: 180)] 2024-10-12 15:26:51,524 - ==> Total time: 1 day, 3:39:55 Eta: 18:26:36 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 15:27:07,000 - Train: 60.01% [225200/375300] [180.0/300.0] [batch_t 0.316 (0.418)] [data_t 0.015] [optim_t 0.300] [lr 0.001056] [CE 3.198 (3.268)] [KD 0.000 (0.000)] 2024-10-12 15:27:29,475 - Train: 60.02% [225250/375300] [180.1/300.0] [batch_t 0.383 (0.449)] [data_t 0.016] [optim_t 0.367] [lr 0.001055] [CE 3.285 (3.339)] [KD 0.000 (0.000)] 2024-10-12 15:27:52,481 - Train: 60.03% [225300/375300] [180.1/300.0] [batch_t 0.445 (0.460)] [data_t 0.016] [optim_t 0.429] [lr 0.001055] [CE 3.020 (3.332)] [KD 0.000 (0.000)] 2024-10-12 15:28:15,541 - Train: 60.05% [225350/375300] [180.1/300.0] [batch_t 0.314 (0.461)] [data_t 0.016] [optim_t 0.299] [lr 0.001054] [CE 3.595 (3.344)] [KD 0.000 (0.000)] 2024-10-12 15:28:38,478 - Train: 60.06% [225400/375300] [180.2/300.0] [batch_t 0.459 (0.459)] [data_t 0.016] [optim_t 0.443] [lr 0.001054] [CE 3.749 (3.374)] [KD 0.000 (0.000)] 2024-10-12 15:29:00,714 - Train: 60.07% [225450/375300] [180.2/300.0] [batch_t 0.385 (0.445)] [data_t 0.016] [optim_t 0.369] [lr 0.001053] [CE 3.297 (3.325)] [KD 0.000 (0.000)] 2024-10-12 15:29:23,532 - Train: 60.09% [225500/375300] [180.3/300.0] [batch_t 0.489 (0.456)] [data_t 0.016] [optim_t 0.474] [lr 0.001052] [CE 2.961 (3.336)] [KD 0.000 (0.000)] 2024-10-12 15:29:45,639 - Train: 60.10% [225550/375300] [180.3/300.0] [batch_t 0.421 (0.442)] [data_t 0.016] [optim_t 0.405] [lr 0.001052] [CE 3.301 (3.398)] [KD 0.000 (0.000)] 2024-10-12 15:30:07,882 - Train: 60.11% [225600/375300] [180.3/300.0] [batch_t 0.311 (0.445)] [data_t 0.016] [optim_t 0.295] [lr 0.001051] [CE 3.080 (3.366)] [KD 0.000 (0.000)] 2024-10-12 15:30:29,890 - Train: 60.13% [225650/375300] [180.4/300.0] [batch_t 0.426 (0.440)] [data_t 0.016] [optim_t 0.411] [lr 0.001051] [CE 3.550 (3.339)] [KD 0.000 (0.000)] 2024-10-12 15:30:52,609 - Train: 60.14% [225700/375300] [180.4/300.0] [batch_t 0.821 (0.454)] [data_t 0.015] [optim_t 0.805] [lr 0.001050] [CE 3.236 (3.372)] [KD 0.000 (0.000)] 2024-10-12 15:31:14,390 - Train: 60.15% [225750/375300] [180.5/300.0] [batch_t 0.546 (0.436)] [data_t 0.016] [optim_t 0.530] [lr 0.001049] [CE 2.949 (3.343)] [KD 0.000 (0.000)] 2024-10-12 15:31:37,728 - Train: 60.17% [225800/375300] [180.5/300.0] [batch_t 0.372 (0.467)] [data_t 0.015] [optim_t 0.357] [lr 0.001049] [CE 3.285 (3.385)] [KD 0.000 (0.000)] 2024-10-12 15:31:59,953 - Train: 60.18% [225850/375300] [180.5/300.0] [batch_t 0.416 (0.444)] [data_t 0.015] [optim_t 0.401] [lr 0.001048] [CE 3.451 (3.331)] [KD 0.000 (0.000)] 2024-10-12 15:32:21,970 - Train: 60.19% [225900/375300] [180.6/300.0] [batch_t 0.406 (0.440)] [data_t 0.015] [optim_t 0.391] [lr 0.001048] [CE 3.234 (3.377)] [KD 0.000 (0.000)] 2024-10-12 15:32:44,022 - Train: 60.21% [225950/375300] [180.6/300.0] [batch_t 0.424 (0.441)] [data_t 0.016] [optim_t 0.408] [lr 0.001047] [CE 3.411 (3.378)] [KD 0.000 (0.000)] 2024-10-12 15:33:06,285 - Train: 60.22% [226000/375300] [180.7/300.0] [batch_t 0.423 (0.445)] [data_t 0.016] [optim_t 0.407] [lr 0.001046] [CE 3.460 (3.379)] [KD 0.000 (0.000)] 2024-10-12 15:33:28,596 - Train: 60.23% [226050/375300] [180.7/300.0] [batch_t 0.416 (0.446)] [data_t 0.016] [optim_t 0.400] [lr 0.001046] [CE 3.068 (3.361)] [KD 0.000 (0.000)] 2024-10-12 15:33:51,123 - Train: 60.25% [226100/375300] [180.7/300.0] [batch_t 0.446 (0.450)] [data_t 0.016] [optim_t 0.430] [lr 0.001045] [CE 3.474 (3.435)] [KD 0.000 (0.000)] 2024-10-12 15:34:13,727 - Train: 60.26% [226150/375300] [180.8/300.0] [batch_t 0.364 (0.452)] [data_t 0.016] [optim_t 0.349] [lr 0.001045] [CE 3.136 (3.386)] [KD 0.000 (0.000)] 2024-10-12 15:34:36,290 - Train: 60.27% [226200/375300] [180.8/300.0] [batch_t 0.517 (0.451)] [data_t 0.016] [optim_t 0.501] [lr 0.001044] [CE 3.328 (3.351)] [KD 0.000 (0.000)] 2024-10-12 15:34:59,404 - Train: 60.29% [226250/375300] [180.9/300.0] [batch_t 0.410 (0.462)] [data_t 0.015] [optim_t 0.394] [lr 0.001043] [CE 3.098 (3.375)] [KD 0.000 (0.000)] 2024-10-12 15:35:22,294 - Train: 60.30% [226300/375300] [180.9/300.0] [batch_t 0.445 (0.458)] [data_t 0.015] [optim_t 0.429] [lr 0.001043] [CE 3.257 (3.358)] [KD 0.000 (0.000)] 2024-10-12 15:35:45,398 - Train: 60.31% [226350/375300] [180.9/300.0] [batch_t 0.448 (0.462)] [data_t 0.015] [optim_t 0.433] [lr 0.001042] [CE 3.353 (3.354)] [KD 0.000 (0.000)] 2024-10-12 15:36:08,650 - Train: 60.33% [226400/375300] [181.0/300.0] [batch_t 0.534 (0.465)] [data_t 0.016] [optim_t 0.518] [lr 0.001042] [CE 3.612 (3.376)] [KD 0.000 (0.000)] 2024-10-12 15:36:20,761 - ==> Total time: 1 day, 3:49:24 Eta: 18:17:34 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 15:36:34,152 - Train: 60.34% [226450/375300] [181.0/300.0] [batch_t 0.317 (0.621)] [data_t 0.015] [optim_t 0.301] [lr 0.001041] [CE 3.060 (3.308)] [KD 0.000 (0.000)] 2024-10-12 15:36:56,051 - Train: 60.35% [226500/375300] [181.1/300.0] [batch_t 0.455 (0.438)] [data_t 0.161] [optim_t 0.293] [lr 0.001041] [CE 2.957 (3.399)] [KD 0.000 (0.000)] 2024-10-12 15:37:18,148 - Train: 60.37% [226550/375300] [181.1/300.0] [batch_t 0.434 (0.442)] [data_t 0.137] [optim_t 0.297] [lr 0.001040] [CE 3.047 (3.351)] [KD 0.000 (0.000)] 2024-10-12 15:37:39,823 - Train: 60.38% [226600/375300] [181.1/300.0] [batch_t 0.443 (0.433)] [data_t 0.151] [optim_t 0.291] [lr 0.001039] [CE 3.200 (3.379)] [KD 0.000 (0.000)] 2024-10-12 15:38:02,360 - Train: 60.39% [226650/375300] [181.2/300.0] [batch_t 0.464 (0.451)] [data_t 0.016] [optim_t 0.448] [lr 0.001039] [CE 3.322 (3.399)] [KD 0.000 (0.000)] 2024-10-12 15:38:25,014 - Train: 60.41% [226700/375300] [181.2/300.0] [batch_t 0.934 (0.453)] [data_t 0.016] [optim_t 0.919] [lr 0.001038] [CE 3.591 (3.383)] [KD 0.000 (0.000)] 2024-10-12 15:38:47,032 - Train: 60.42% [226750/375300] [181.3/300.0] [batch_t 0.545 (0.440)] [data_t 0.016] [optim_t 0.529] [lr 0.001038] [CE 3.482 (3.414)] [KD 0.000 (0.000)] 2024-10-12 15:39:09,150 - Train: 60.43% [226800/375300] [181.3/300.0] [batch_t 0.425 (0.442)] [data_t 0.015] [optim_t 0.410] [lr 0.001037] [CE 3.324 (3.368)] [KD 0.000 (0.000)] 2024-10-12 15:39:31,223 - Train: 60.44% [226850/375300] [181.3/300.0] [batch_t 0.468 (0.441)] [data_t 0.016] [optim_t 0.453] [lr 0.001036] [CE 3.398 (3.346)] [KD 0.000 (0.000)] 2024-10-12 15:39:53,902 - Train: 60.46% [226900/375300] [181.4/300.0] [batch_t 0.833 (0.453)] [data_t 0.015] [optim_t 0.818] [lr 0.001036] [CE 3.352 (3.388)] [KD 0.000 (0.000)] 2024-10-12 15:40:15,963 - Train: 60.47% [226950/375300] [181.4/300.0] [batch_t 0.430 (0.441)] [data_t 0.015] [optim_t 0.414] [lr 0.001035] [CE 3.455 (3.389)] [KD 0.000 (0.000)] 2024-10-12 15:40:38,342 - Train: 60.48% [227000/375300] [181.5/300.0] [batch_t 0.438 (0.447)] [data_t 0.016] [optim_t 0.423] [lr 0.001035] [CE 3.132 (3.365)] [KD 0.000 (0.000)] 2024-10-12 15:41:00,795 - Train: 60.50% [227050/375300] [181.5/300.0] [batch_t 0.377 (0.449)] [data_t 0.016] [optim_t 0.361] [lr 0.001034] [CE 3.511 (3.330)] [KD 0.000 (0.000)] 2024-10-12 15:41:23,142 - Train: 60.51% [227100/375300] [181.5/300.0] [batch_t 0.393 (0.447)] [data_t 0.016] [optim_t 0.378] [lr 0.001033] [CE 3.231 (3.358)] [KD 0.000 (0.000)] 2024-10-12 15:41:45,449 - Train: 60.52% [227150/375300] [181.6/300.0] [batch_t 0.445 (0.446)] [data_t 0.016] [optim_t 0.429] [lr 0.001033] [CE 3.219 (3.349)] [KD 0.000 (0.000)] 2024-10-12 15:42:07,907 - Train: 60.54% [227200/375300] [181.6/300.0] [batch_t 0.494 (0.449)] [data_t 0.015] [optim_t 0.479] [lr 0.001032] [CE 3.007 (3.332)] [KD 0.000 (0.000)] 2024-10-12 15:42:30,145 - Train: 60.55% [227250/375300] [181.7/300.0] [batch_t 0.454 (0.445)] [data_t 0.015] [optim_t 0.439] [lr 0.001032] [CE 2.861 (3.410)] [KD 0.000 (0.000)] 2024-10-12 15:42:52,144 - Train: 60.56% [227300/375300] [181.7/300.0] [batch_t 0.397 (0.440)] [data_t 0.015] [optim_t 0.382] [lr 0.001031] [CE 3.235 (3.356)] [KD 0.000 (0.000)] 2024-10-12 15:43:14,224 - Train: 60.58% [227350/375300] [181.7/300.0] [batch_t 0.434 (0.441)] [data_t 0.015] [optim_t 0.419] [lr 0.001031] [CE 3.675 (3.400)] [KD 0.000 (0.000)] 2024-10-12 15:43:35,026 - Train: 60.59% [227400/375300] [181.8/300.0] [batch_t 0.319 (0.416)] [data_t 0.015] [optim_t 0.303] [lr 0.001030] [CE 2.937 (3.396)] [KD 0.000 (0.000)] 2024-10-12 15:43:56,711 - Train: 60.60% [227450/375300] [181.8/300.0] [batch_t 0.315 (0.434)] [data_t 0.015] [optim_t 0.299] [lr 0.001029] [CE 3.100 (3.398)] [KD 0.000 (0.000)] 2024-10-12 15:44:19,016 - Train: 60.62% [227500/375300] [181.9/300.0] [batch_t 0.475 (0.446)] [data_t 0.016] [optim_t 0.459] [lr 0.001029] [CE 3.613 (3.417)] [KD 0.000 (0.000)] 2024-10-12 15:44:41,181 - Train: 60.63% [227550/375300] [181.9/300.0] [batch_t 0.455 (0.443)] [data_t 0.015] [optim_t 0.439] [lr 0.001028] [CE 3.252 (3.353)] [KD 0.000 (0.000)] 2024-10-12 15:45:02,884 - Train: 60.64% [227600/375300] [181.9/300.0] [batch_t 0.385 (0.434)] [data_t 0.015] [optim_t 0.370] [lr 0.001028] [CE 3.389 (3.380)] [KD 0.000 (0.000)] 2024-10-12 15:45:24,771 - Train: 60.66% [227650/375300] [182.0/300.0] [batch_t 0.404 (0.438)] [data_t 0.016] [optim_t 0.389] [lr 0.001027] [CE 3.219 (3.375)] [KD 0.000 (0.000)] 2024-10-12 15:45:37,356 - ==> Total time: 1 day, 3:58:41 Eta: 18:08:22 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 15:45:49,573 - Train: 60.67% [227700/375300] [182.0/300.0] [batch_t 0.315 (0.586)] [data_t 0.016] [optim_t 0.299] [lr 0.001026] [CE 3.190 (3.377)] [KD 0.000 (0.000)] 2024-10-12 15:46:10,676 - Train: 60.68% [227750/375300] [182.1/300.0] [batch_t 0.441 (0.422)] [data_t 0.016] [optim_t 0.425] [lr 0.001026] [CE 3.438 (3.355)] [KD 0.000 (0.000)] 2024-10-12 15:46:31,772 - Train: 60.70% [227800/375300] [182.1/300.0] [batch_t 0.428 (0.422)] [data_t 0.016] [optim_t 0.412] [lr 0.001025] [CE 3.423 (3.346)] [KD 0.000 (0.000)] 2024-10-12 15:46:52,887 - Train: 60.71% [227850/375300] [182.1/300.0] [batch_t 0.420 (0.422)] [data_t 0.016] [optim_t 0.405] [lr 0.001025] [CE 3.437 (3.353)] [KD 0.000 (0.000)] 2024-10-12 15:47:15,192 - Train: 60.72% [227900/375300] [182.2/300.0] [batch_t 0.447 (0.446)] [data_t 0.151] [optim_t 0.296] [lr 0.001024] [CE 3.466 (3.381)] [KD 0.000 (0.000)] 2024-10-12 15:47:37,490 - Train: 60.74% [227950/375300] [182.2/300.0] [batch_t 0.442 (0.446)] [data_t 0.143] [optim_t 0.299] [lr 0.001023] [CE 3.512 (3.349)] [KD 0.000 (0.000)] 2024-10-12 15:47:58,847 - Train: 60.75% [228000/375300] [182.3/300.0] [batch_t 0.475 (0.427)] [data_t 0.180] [optim_t 0.295] [lr 0.001023] [CE 3.513 (3.399)] [KD 0.000 (0.000)] 2024-10-12 15:48:21,034 - Train: 60.76% [228050/375300] [182.3/300.0] [batch_t 0.495 (0.444)] [data_t 0.199] [optim_t 0.296] [lr 0.001022] [CE 3.347 (3.377)] [KD 0.000 (0.000)] 2024-10-12 15:48:42,554 - Train: 60.78% [228100/375300] [182.3/300.0] [batch_t 0.407 (0.430)] [data_t 0.015] [optim_t 0.391] [lr 0.001022] [CE 3.271 (3.348)] [KD 0.000 (0.000)] 2024-10-12 15:49:04,239 - Train: 60.79% [228150/375300] [182.4/300.0] [batch_t 0.322 (0.434)] [data_t 0.016] [optim_t 0.306] [lr 0.001021] [CE 3.571 (3.414)] [KD 0.000 (0.000)] 2024-10-12 15:49:25,347 - Train: 60.80% [228200/375300] [182.4/300.0] [batch_t 0.455 (0.422)] [data_t 0.015] [optim_t 0.440] [lr 0.001021] [CE 3.337 (3.324)] [KD 0.000 (0.000)] 2024-10-12 15:49:46,861 - Train: 60.82% [228250/375300] [182.5/300.0] [batch_t 0.411 (0.430)] [data_t 0.016] [optim_t 0.395] [lr 0.001020] [CE 3.309 (3.362)] [KD 0.000 (0.000)] 2024-10-12 15:50:08,377 - Train: 60.83% [228300/375300] [182.5/300.0] [batch_t 0.505 (0.430)] [data_t 0.208] [optim_t 0.297] [lr 0.001019] [CE 3.581 (3.346)] [KD 0.000 (0.000)] 2024-10-12 15:50:29,882 - Train: 60.84% [228350/375300] [182.5/300.0] [batch_t 0.500 (0.430)] [data_t 0.203] [optim_t 0.297] [lr 0.001019] [CE 3.661 (3.356)] [KD 0.000 (0.000)] 2024-10-12 15:50:51,447 - Train: 60.86% [228400/375300] [182.6/300.0] [batch_t 0.422 (0.431)] [data_t 0.127] [optim_t 0.295] [lr 0.001018] [CE 3.246 (3.343)] [KD 0.000 (0.000)] 2024-10-12 15:51:13,276 - Train: 60.87% [228450/375300] [182.6/300.0] [batch_t 0.474 (0.436)] [data_t 0.180] [optim_t 0.294] [lr 0.001018] [CE 3.364 (3.353)] [KD 0.000 (0.000)] 2024-10-12 15:51:34,992 - Train: 60.88% [228500/375300] [182.7/300.0] [batch_t 0.481 (0.434)] [data_t 0.185] [optim_t 0.296] [lr 0.001017] [CE 3.334 (3.371)] [KD 0.000 (0.000)] 2024-10-12 15:51:57,074 - Train: 60.90% [228550/375300] [182.7/300.0] [batch_t 0.484 (0.442)] [data_t 0.191] [optim_t 0.293] [lr 0.001016] [CE 3.192 (3.392)] [KD 0.000 (0.000)] 2024-10-12 15:52:19,077 - Train: 60.91% [228600/375300] [182.7/300.0] [batch_t 0.468 (0.440)] [data_t 0.015] [optim_t 0.452] [lr 0.001016] [CE 3.274 (3.333)] [KD 0.000 (0.000)] 2024-10-12 15:52:41,894 - Train: 60.92% [228650/375300] [182.8/300.0] [batch_t 0.532 (0.456)] [data_t 0.015] [optim_t 0.516] [lr 0.001015] [CE 3.563 (3.329)] [KD 0.000 (0.000)] 2024-10-12 15:53:03,898 - Train: 60.94% [228700/375300] [182.8/300.0] [batch_t 0.415 (0.440)] [data_t 0.015] [optim_t 0.399] [lr 0.001015] [CE 3.515 (3.400)] [KD 0.000 (0.000)] 2024-10-12 15:53:25,885 - Train: 60.95% [228750/375300] [182.9/300.0] [batch_t 0.419 (0.440)] [data_t 0.016] [optim_t 0.404] [lr 0.001014] [CE 3.187 (3.340)] [KD 0.000 (0.000)] 2024-10-12 15:53:48,665 - Train: 60.96% [228800/375300] [182.9/300.0] [batch_t 0.451 (0.455)] [data_t 0.016] [optim_t 0.435] [lr 0.001014] [CE 3.543 (3.349)] [KD 0.000 (0.000)] 2024-10-12 15:54:10,797 - Train: 60.98% [228850/375300] [182.9/300.0] [batch_t 0.419 (0.442)] [data_t 0.016] [optim_t 0.403] [lr 0.001013] [CE 3.102 (3.343)] [KD 0.000 (0.000)] 2024-10-12 15:54:32,896 - Train: 60.99% [228900/375300] [183.0/300.0] [batch_t 0.478 (0.442)] [data_t 0.016] [optim_t 0.463] [lr 0.001012] [CE 3.571 (3.375)] [KD 0.000 (0.000)] 2024-10-12 15:54:46,396 - ==> Total time: 1 day, 4:07:50 Eta: 17:59:06 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 15:54:59,726 - Train: 61.00% [228950/375300] [183.0/300.0] [batch_t 0.316 (0.691)] [data_t 0.016] [optim_t 0.300] [lr 0.001012] [CE 3.316 (3.251)] [KD 0.000 (0.000)] 2024-10-12 15:55:20,631 - Train: 61.02% [229000/375300] [183.1/300.0] [batch_t 0.472 (0.418)] [data_t 0.177] [optim_t 0.295] [lr 0.001011] [CE 3.388 (3.320)] [KD 0.000 (0.000)] 2024-10-12 15:55:42,639 - Train: 61.03% [229050/375300] [183.1/300.0] [batch_t 0.482 (0.440)] [data_t 0.184] [optim_t 0.298] [lr 0.001011] [CE 3.292 (3.365)] [KD 0.000 (0.000)] 2024-10-12 15:56:05,225 - Train: 61.04% [229100/375300] [183.1/300.0] [batch_t 0.500 (0.452)] [data_t 0.201] [optim_t 0.300] [lr 0.001010] [CE 3.106 (3.348)] [KD 0.000 (0.000)] 2024-10-12 15:56:26,857 - Train: 61.06% [229150/375300] [183.2/300.0] [batch_t 0.321 (0.432)] [data_t 0.019] [optim_t 0.303] [lr 0.001009] [CE 3.342 (3.344)] [KD 0.000 (0.000)] 2024-10-12 15:56:48,931 - Train: 61.07% [229200/375300] [183.2/300.0] [batch_t 0.420 (0.441)] [data_t 0.126] [optim_t 0.294] [lr 0.001009] [CE 3.476 (3.345)] [KD 0.000 (0.000)] 2024-10-12 15:57:10,024 - Train: 61.08% [229250/375300] [183.3/300.0] [batch_t 0.419 (0.422)] [data_t 0.119] [optim_t 0.300] [lr 0.001008] [CE 3.505 (3.308)] [KD 0.000 (0.000)] 2024-10-12 15:57:31,627 - Train: 61.10% [229300/375300] [183.3/300.0] [batch_t 0.317 (0.432)] [data_t 0.016] [optim_t 0.302] [lr 0.001008] [CE 3.241 (3.370)] [KD 0.000 (0.000)] 2024-10-12 15:57:53,058 - Train: 61.11% [229350/375300] [183.3/300.0] [batch_t 0.494 (0.428)] [data_t 0.196] [optim_t 0.298] [lr 0.001007] [CE 3.128 (3.310)] [KD 0.000 (0.000)] 2024-10-12 15:58:15,261 - Train: 61.12% [229400/375300] [183.4/300.0] [batch_t 0.451 (0.444)] [data_t 0.015] [optim_t 0.435] [lr 0.001007] [CE 3.098 (3.334)] [KD 0.000 (0.000)] 2024-10-12 15:58:37,220 - Train: 61.14% [229450/375300] [183.4/300.0] [batch_t 0.426 (0.439)] [data_t 0.016] [optim_t 0.411] [lr 0.001006] [CE 3.643 (3.311)] [KD 0.000 (0.000)] 2024-10-12 15:59:00,387 - Train: 61.15% [229500/375300] [183.5/300.0] [batch_t 0.378 (0.463)] [data_t 0.016] [optim_t 0.362] [lr 0.001005] [CE 3.333 (3.325)] [KD 0.000 (0.000)] 2024-10-12 15:59:23,042 - Train: 61.16% [229550/375300] [183.5/300.0] [batch_t 0.474 (0.453)] [data_t 0.016] [optim_t 0.458] [lr 0.001005] [CE 3.105 (3.408)] [KD 0.000 (0.000)] 2024-10-12 15:59:44,960 - Train: 61.18% [229600/375300] [183.5/300.0] [batch_t 0.437 (0.438)] [data_t 0.016] [optim_t 0.421] [lr 0.001004] [CE 3.111 (3.335)] [KD 0.000 (0.000)] 2024-10-12 16:00:06,481 - Train: 61.19% [229650/375300] [183.6/300.0] [batch_t 0.425 (0.430)] [data_t 0.016] [optim_t 0.409] [lr 0.001004] [CE 3.755 (3.395)] [KD 0.000 (0.000)] 2024-10-12 16:00:27,964 - Train: 61.20% [229700/375300] [183.6/300.0] [batch_t 0.458 (0.430)] [data_t 0.016] [optim_t 0.442] [lr 0.001003] [CE 3.087 (3.388)] [KD 0.000 (0.000)] 2024-10-12 16:00:49,416 - Train: 61.22% [229750/375300] [183.7/300.0] [batch_t 0.361 (0.429)] [data_t 0.016] [optim_t 0.345] [lr 0.001002] [CE 3.196 (3.342)] [KD 0.000 (0.000)] 2024-10-12 16:01:11,812 - Train: 61.23% [229800/375300] [183.7/300.0] [batch_t 0.444 (0.448)] [data_t 0.016] [optim_t 0.429] [lr 0.001002] [CE 3.364 (3.364)] [KD 0.000 (0.000)] 2024-10-12 16:01:34,483 - Train: 61.24% [229850/375300] [183.7/300.0] [batch_t 0.353 (0.453)] [data_t 0.016] [optim_t 0.338] [lr 0.001001] [CE 3.286 (3.337)] [KD 0.000 (0.000)] 2024-10-12 16:01:56,921 - Train: 61.26% [229900/375300] [183.8/300.0] [batch_t 0.446 (0.449)] [data_t 0.016] [optim_t 0.430] [lr 0.001001] [CE 3.212 (3.330)] [KD 0.000 (0.000)] 2024-10-12 16:02:19,226 - Train: 61.27% [229950/375300] [183.8/300.0] [batch_t 0.393 (0.446)] [data_t 0.016] [optim_t 0.378] [lr 0.001000] [CE 3.142 (3.367)] [KD 0.000 (0.000)] 2024-10-12 16:02:40,825 - Train: 61.28% [230000/375300] [183.9/300.0] [batch_t 0.424 (0.432)] [data_t 0.016] [optim_t 0.409] [lr 0.001000] [CE 3.449 (3.372)] [KD 0.000 (0.000)] 2024-10-12 16:03:02,543 - Train: 61.30% [230050/375300] [183.9/300.0] [batch_t 0.505 (0.434)] [data_t 0.016] [optim_t 0.489] [lr 0.000999] [CE 3.442 (3.338)] [KD 0.000 (0.000)] 2024-10-12 16:03:24,621 - Train: 61.31% [230100/375300] [183.9/300.0] [batch_t 0.455 (0.441)] [data_t 0.015] [optim_t 0.439] [lr 0.000998] [CE 3.385 (3.341)] [KD 0.000 (0.000)] 2024-10-12 16:03:46,366 - Train: 61.32% [230150/375300] [184.0/300.0] [batch_t 0.439 (0.435)] [data_t 0.016] [optim_t 0.423] [lr 0.000998] [CE 3.324 (3.344)] [KD 0.000 (0.000)] 2024-10-12 16:03:59,625 - ==> Total time: 1 day, 4:17:03 Eta: 17:49:53 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 16:04:11,845 - Train: 61.34% [230200/375300] [184.0/300.0] [batch_t 0.324 (0.659)] [data_t 0.015] [optim_t 0.309] [lr 0.000997] [CE 3.153 (3.293)] [KD 0.000 (0.000)] 2024-10-12 16:04:32,999 - Train: 61.35% [230250/375300] [184.1/300.0] [batch_t 0.479 (0.423)] [data_t 0.016] [optim_t 0.463] [lr 0.000997] [CE 3.525 (3.325)] [KD 0.000 (0.000)] 2024-10-12 16:04:55,393 - Train: 61.36% [230300/375300] [184.1/300.0] [batch_t 0.506 (0.448)] [data_t 0.015] [optim_t 0.491] [lr 0.000996] [CE 3.584 (3.320)] [KD 0.000 (0.000)] 2024-10-12 16:05:17,286 - Train: 61.38% [230350/375300] [184.1/300.0] [batch_t 0.392 (0.438)] [data_t 0.015] [optim_t 0.376] [lr 0.000995] [CE 3.424 (3.309)] [KD 0.000 (0.000)] 2024-10-12 16:05:39,629 - Train: 61.39% [230400/375300] [184.2/300.0] [batch_t 0.459 (0.447)] [data_t 0.017] [optim_t 0.443] [lr 0.000995] [CE 3.404 (3.355)] [KD 0.000 (0.000)] 2024-10-12 16:06:02,062 - Train: 61.40% [230450/375300] [184.2/300.0] [batch_t 0.394 (0.449)] [data_t 0.016] [optim_t 0.378] [lr 0.000994] [CE 3.289 (3.341)] [KD 0.000 (0.000)] 2024-10-12 16:06:23,483 - Train: 61.42% [230500/375300] [184.3/300.0] [batch_t 0.434 (0.428)] [data_t 0.015] [optim_t 0.419] [lr 0.000994] [CE 3.590 (3.357)] [KD 0.000 (0.000)] 2024-10-12 16:06:45,872 - Train: 61.43% [230550/375300] [184.3/300.0] [batch_t 0.474 (0.448)] [data_t 0.015] [optim_t 0.459] [lr 0.000993] [CE 3.513 (3.302)] [KD 0.000 (0.000)] 2024-10-12 16:07:08,143 - Train: 61.44% [230600/375300] [184.3/300.0] [batch_t 0.418 (0.445)] [data_t 0.015] [optim_t 0.403] [lr 0.000993] [CE 3.336 (3.301)] [KD 0.000 (0.000)] 2024-10-12 16:07:29,982 - Train: 61.46% [230650/375300] [184.4/300.0] [batch_t 0.538 (0.437)] [data_t 0.015] [optim_t 0.522] [lr 0.000992] [CE 3.443 (3.314)] [KD 0.000 (0.000)] 2024-10-12 16:07:51,665 - Train: 61.47% [230700/375300] [184.4/300.0] [batch_t 0.321 (0.434)] [data_t 0.016] [optim_t 0.306] [lr 0.000991] [CE 3.345 (3.356)] [KD 0.000 (0.000)] 2024-10-12 16:08:13,849 - Train: 61.48% [230750/375300] [184.5/300.0] [batch_t 0.435 (0.444)] [data_t 0.015] [optim_t 0.419] [lr 0.000991] [CE 3.326 (3.336)] [KD 0.000 (0.000)] 2024-10-12 16:08:35,646 - Train: 61.50% [230800/375300] [184.5/300.0] [batch_t 0.434 (0.436)] [data_t 0.015] [optim_t 0.418] [lr 0.000990] [CE 3.545 (3.377)] [KD 0.000 (0.000)] 2024-10-12 16:08:57,768 - Train: 61.51% [230850/375300] [184.5/300.0] [batch_t 0.498 (0.442)] [data_t 0.015] [optim_t 0.483] [lr 0.000990] [CE 3.240 (3.337)] [KD 0.000 (0.000)] 2024-10-12 16:09:20,031 - Train: 61.52% [230900/375300] [184.6/300.0] [batch_t 0.538 (0.445)] [data_t 0.015] [optim_t 0.523] [lr 0.000989] [CE 3.328 (3.365)] [KD 0.000 (0.000)] 2024-10-12 16:09:42,015 - Train: 61.54% [230950/375300] [184.6/300.0] [batch_t 0.451 (0.440)] [data_t 0.015] [optim_t 0.436] [lr 0.000988] [CE 3.235 (3.367)] [KD 0.000 (0.000)] 2024-10-12 16:10:02,989 - Train: 61.55% [231000/375300] [184.7/300.0] [batch_t 0.471 (0.419)] [data_t 0.016] [optim_t 0.455] [lr 0.000988] [CE 3.342 (3.345)] [KD 0.000 (0.000)] 2024-10-12 16:10:25,245 - Train: 61.56% [231050/375300] [184.7/300.0] [batch_t 0.421 (0.445)] [data_t 0.016] [optim_t 0.405] [lr 0.000987] [CE 3.632 (3.352)] [KD 0.000 (0.000)] 2024-10-12 16:10:47,748 - Train: 61.58% [231100/375300] [184.7/300.0] [batch_t 0.435 (0.450)] [data_t 0.016] [optim_t 0.419] [lr 0.000987] [CE 3.352 (3.336)] [KD 0.000 (0.000)] 2024-10-12 16:11:09,883 - Train: 61.59% [231150/375300] [184.8/300.0] [batch_t 0.503 (0.443)] [data_t 0.016] [optim_t 0.488] [lr 0.000986] [CE 3.316 (3.332)] [KD 0.000 (0.000)] 2024-10-12 16:11:31,951 - Train: 61.60% [231200/375300] [184.8/300.0] [batch_t 0.476 (0.441)] [data_t 0.015] [optim_t 0.461] [lr 0.000986] [CE 3.439 (3.372)] [KD 0.000 (0.000)] 2024-10-12 16:11:53,738 - Train: 61.62% [231250/375300] [184.9/300.0] [batch_t 0.501 (0.436)] [data_t 0.016] [optim_t 0.486] [lr 0.000985] [CE 3.167 (3.344)] [KD 0.000 (0.000)] 2024-10-12 16:12:14,915 - Train: 61.63% [231300/375300] [184.9/300.0] [batch_t 0.444 (0.423)] [data_t 0.016] [optim_t 0.428] [lr 0.000984] [CE 3.340 (3.378)] [KD 0.000 (0.000)] 2024-10-12 16:12:37,080 - Train: 61.64% [231350/375300] [184.9/300.0] [batch_t 0.474 (0.443)] [data_t 0.016] [optim_t 0.458] [lr 0.000984] [CE 3.482 (3.360)] [KD 0.000 (0.000)] 2024-10-12 16:12:58,667 - Train: 61.66% [231400/375300] [185.0/300.0] [batch_t 0.447 (0.432)] [data_t 0.016] [optim_t 0.431] [lr 0.000983] [CE 3.185 (3.297)] [KD 0.000 (0.000)] 2024-10-12 16:13:34,578 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.441)] [top1_cnt 38506] [top5_cnt 46938] [top_all 50000] 2024-10-12 16:13:34,579 - net: 77.012 (93.876) 2024-10-12 16:13:56,381 - Test (net_E): 100.00% [50/50] [batch_t 0.131 (0.427)] [top1_cnt 40143] [top5_cnt 47708] [top_all 50000] 2024-10-12 16:13:56,381 - net_E: 80.286 (95.416) 2024-10-12 16:13:56,580 - Max [top1: 77.012 (epoch: 185)] [top1-ema: 80.286 (epoch: 185)] 2024-10-12 16:13:56,580 - ==> Total time: 1 day, 4:27:00 Eta: 17:41:06 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 16:14:13,057 - Train: 61.67% [231450/375300] [185.0/300.0] [batch_t 0.316 (0.458)] [data_t 0.016] [optim_t 0.301] [lr 0.000983] [CE 3.206 (3.274)] [KD 0.000 (0.000)] 2024-10-12 16:14:34,493 - Train: 61.68% [231500/375300] [185.1/300.0] [batch_t 0.316 (0.429)] [data_t 0.016] [optim_t 0.300] [lr 0.000982] [CE 3.198 (3.330)] [KD 0.000 (0.000)] 2024-10-12 16:14:57,456 - Train: 61.70% [231550/375300] [185.1/300.0] [batch_t 0.390 (0.459)] [data_t 0.016] [optim_t 0.374] [lr 0.000982] [CE 3.171 (3.317)] [KD 0.000 (0.000)] 2024-10-12 16:15:19,919 - Train: 61.71% [231600/375300] [185.1/300.0] [batch_t 0.461 (0.449)] [data_t 0.016] [optim_t 0.445] [lr 0.000981] [CE 3.353 (3.360)] [KD 0.000 (0.000)] 2024-10-12 16:15:42,118 - Train: 61.72% [231650/375300] [185.2/300.0] [batch_t 0.431 (0.444)] [data_t 0.015] [optim_t 0.416] [lr 0.000980] [CE 3.007 (3.352)] [KD 0.000 (0.000)] 2024-10-12 16:16:04,737 - Train: 61.74% [231700/375300] [185.2/300.0] [batch_t 0.496 (0.452)] [data_t 0.016] [optim_t 0.480] [lr 0.000980] [CE 3.597 (3.393)] [KD 0.000 (0.000)] 2024-10-12 16:16:26,580 - Train: 61.75% [231750/375300] [185.3/300.0] [batch_t 0.324 (0.437)] [data_t 0.016] [optim_t 0.308] [lr 0.000979] [CE 3.143 (3.320)] [KD 0.000 (0.000)] 2024-10-12 16:16:47,536 - Train: 61.76% [231800/375300] [185.3/300.0] [batch_t 0.417 (0.419)] [data_t 0.016] [optim_t 0.401] [lr 0.000979] [CE 3.280 (3.326)] [KD 0.000 (0.000)] 2024-10-12 16:17:09,050 - Train: 61.78% [231850/375300] [185.3/300.0] [batch_t 0.382 (0.430)] [data_t 0.016] [optim_t 0.366] [lr 0.000978] [CE 3.423 (3.363)] [KD 0.000 (0.000)] 2024-10-12 16:17:30,368 - Train: 61.79% [231900/375300] [185.4/300.0] [batch_t 0.389 (0.426)] [data_t 0.016] [optim_t 0.373] [lr 0.000977] [CE 3.362 (3.349)] [KD 0.000 (0.000)] 2024-10-12 16:17:51,820 - Train: 61.80% [231950/375300] [185.4/300.0] [batch_t 0.381 (0.429)] [data_t 0.016] [optim_t 0.365] [lr 0.000977] [CE 3.564 (3.319)] [KD 0.000 (0.000)] 2024-10-12 16:18:13,330 - Train: 61.82% [232000/375300] [185.5/300.0] [batch_t 0.842 (0.430)] [data_t 0.016] [optim_t 0.827] [lr 0.000976] [CE 3.490 (3.363)] [KD 0.000 (0.000)] 2024-10-12 16:18:34,205 - Train: 61.83% [232050/375300] [185.5/300.0] [batch_t 0.413 (0.417)] [data_t 0.016] [optim_t 0.398] [lr 0.000976] [CE 3.604 (3.386)] [KD 0.000 (0.000)] 2024-10-12 16:18:55,835 - Train: 61.84% [232100/375300] [185.5/300.0] [batch_t 0.493 (0.432)] [data_t 0.016] [optim_t 0.477] [lr 0.000975] [CE 3.685 (3.330)] [KD 0.000 (0.000)] 2024-10-12 16:19:17,246 - Train: 61.86% [232150/375300] [185.6/300.0] [batch_t 0.375 (0.428)] [data_t 0.016] [optim_t 0.360] [lr 0.000975] [CE 3.426 (3.346)] [KD 0.000 (0.000)] 2024-10-12 16:19:38,754 - Train: 61.87% [232200/375300] [185.6/300.0] [batch_t 0.373 (0.430)] [data_t 0.016] [optim_t 0.357] [lr 0.000974] [CE 3.114 (3.350)] [KD 0.000 (0.000)] 2024-10-12 16:20:00,587 - Train: 61.88% [232250/375300] [185.7/300.0] [batch_t 0.536 (0.436)] [data_t 0.016] [optim_t 0.520] [lr 0.000973] [CE 3.056 (3.319)] [KD 0.000 (0.000)] 2024-10-12 16:20:22,294 - Train: 61.90% [232300/375300] [185.7/300.0] [batch_t 0.461 (0.434)] [data_t 0.016] [optim_t 0.446] [lr 0.000973] [CE 3.279 (3.327)] [KD 0.000 (0.000)] 2024-10-12 16:20:43,992 - Train: 61.91% [232350/375300] [185.7/300.0] [batch_t 0.374 (0.434)] [data_t 0.015] [optim_t 0.359] [lr 0.000972] [CE 3.338 (3.333)] [KD 0.000 (0.000)] 2024-10-12 16:21:05,772 - Train: 61.92% [232400/375300] [185.8/300.0] [batch_t 0.576 (0.436)] [data_t 0.016] [optim_t 0.561] [lr 0.000972] [CE 3.488 (3.360)] [KD 0.000 (0.000)] 2024-10-12 16:21:27,759 - Train: 61.94% [232450/375300] [185.8/300.0] [batch_t 0.326 (0.440)] [data_t 0.016] [optim_t 0.310] [lr 0.000971] [CE 3.350 (3.364)] [KD 0.000 (0.000)] 2024-10-12 16:21:49,737 - Train: 61.95% [232500/375300] [185.9/300.0] [batch_t 0.456 (0.439)] [data_t 0.016] [optim_t 0.441] [lr 0.000970] [CE 3.675 (3.373)] [KD 0.000 (0.000)] 2024-10-12 16:22:11,643 - Train: 61.96% [232550/375300] [185.9/300.0] [batch_t 0.493 (0.438)] [data_t 0.015] [optim_t 0.477] [lr 0.000970] [CE 3.015 (3.351)] [KD 0.000 (0.000)] 2024-10-12 16:22:33,618 - Train: 61.98% [232600/375300] [185.9/300.0] [batch_t 0.319 (0.439)] [data_t 0.015] [optim_t 0.304] [lr 0.000969] [CE 3.275 (3.310)] [KD 0.000 (0.000)] 2024-10-12 16:22:55,775 - Train: 61.99% [232650/375300] [186.0/300.0] [batch_t 0.471 (0.443)] [data_t 0.015] [optim_t 0.456] [lr 0.000969] [CE 3.199 (3.373)] [KD 0.000 (0.000)] 2024-10-12 16:23:09,826 - ==> Total time: 1 day, 4:36:13 Eta: 17:31:52 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 16:23:21,774 - Train: 62.00% [232700/375300] [186.0/300.0] [batch_t 0.315 (0.725)] [data_t 0.015] [optim_t 0.300] [lr 0.000968] [CE 3.503 (3.378)] [KD 0.000 (0.000)] 2024-10-12 16:23:42,896 - Train: 62.02% [232750/375300] [186.1/300.0] [batch_t 0.316 (0.422)] [data_t 0.015] [optim_t 0.300] [lr 0.000968] [CE 3.459 (3.290)] [KD 0.000 (0.000)] 2024-10-12 16:24:05,072 - Train: 62.03% [232800/375300] [186.1/300.0] [batch_t 0.427 (0.443)] [data_t 0.016] [optim_t 0.412] [lr 0.000967] [CE 3.448 (3.314)] [KD 0.000 (0.000)] 2024-10-12 16:24:27,037 - Train: 62.04% [232850/375300] [186.1/300.0] [batch_t 0.491 (0.439)] [data_t 0.016] [optim_t 0.476] [lr 0.000966] [CE 3.162 (3.328)] [KD 0.000 (0.000)] 2024-10-12 16:24:49,309 - Train: 62.06% [232900/375300] [186.2/300.0] [batch_t 0.508 (0.445)] [data_t 0.016] [optim_t 0.492] [lr 0.000966] [CE 3.572 (3.390)] [KD 0.000 (0.000)] 2024-10-12 16:25:11,316 - Train: 62.07% [232950/375300] [186.2/300.0] [batch_t 0.376 (0.440)] [data_t 0.015] [optim_t 0.360] [lr 0.000965] [CE 3.229 (3.328)] [KD 0.000 (0.000)] 2024-10-12 16:25:33,594 - Train: 62.08% [233000/375300] [186.3/300.0] [batch_t 0.405 (0.445)] [data_t 0.015] [optim_t 0.390] [lr 0.000965] [CE 3.164 (3.322)] [KD 0.000 (0.000)] 2024-10-12 16:25:55,776 - Train: 62.10% [233050/375300] [186.3/300.0] [batch_t 0.420 (0.444)] [data_t 0.016] [optim_t 0.404] [lr 0.000964] [CE 3.396 (3.325)] [KD 0.000 (0.000)] 2024-10-12 16:26:18,146 - Train: 62.11% [233100/375300] [186.3/300.0] [batch_t 0.468 (0.447)] [data_t 0.016] [optim_t 0.452] [lr 0.000964] [CE 3.312 (3.323)] [KD 0.000 (0.000)] 2024-10-12 16:26:40,463 - Train: 62.12% [233150/375300] [186.4/300.0] [batch_t 0.337 (0.446)] [data_t 0.015] [optim_t 0.322] [lr 0.000963] [CE 3.505 (3.341)] [KD 0.000 (0.000)] 2024-10-12 16:27:03,556 - Train: 62.14% [233200/375300] [186.4/300.0] [batch_t 0.552 (0.462)] [data_t 0.246] [optim_t 0.305] [lr 0.000962] [CE 3.388 (3.316)] [KD 0.000 (0.000)] 2024-10-12 16:27:26,142 - Train: 62.15% [233250/375300] [186.5/300.0] [batch_t 0.497 (0.452)] [data_t 0.202] [optim_t 0.294] [lr 0.000962] [CE 3.514 (3.319)] [KD 0.000 (0.000)] 2024-10-12 16:27:48,736 - Train: 62.16% [233300/375300] [186.5/300.0] [batch_t 0.495 (0.452)] [data_t 0.199] [optim_t 0.297] [lr 0.000961] [CE 3.196 (3.319)] [KD 0.000 (0.000)] 2024-10-12 16:28:10,455 - Train: 62.18% [233350/375300] [186.5/300.0] [batch_t 0.463 (0.434)] [data_t 0.166] [optim_t 0.297] [lr 0.000961] [CE 3.259 (3.311)] [KD 0.000 (0.000)] 2024-10-12 16:28:32,475 - Train: 62.19% [233400/375300] [186.6/300.0] [batch_t 0.458 (0.440)] [data_t 0.162] [optim_t 0.296] [lr 0.000960] [CE 3.332 (3.379)] [KD 0.000 (0.000)] 2024-10-12 16:28:54,813 - Train: 62.20% [233450/375300] [186.6/300.0] [batch_t 0.314 (0.447)] [data_t 0.016] [optim_t 0.299] [lr 0.000960] [CE 3.672 (3.407)] [KD 0.000 (0.000)] 2024-10-12 16:29:17,488 - Train: 62.22% [233500/375300] [186.7/300.0] [batch_t 0.425 (0.453)] [data_t 0.015] [optim_t 0.410] [lr 0.000959] [CE 3.161 (3.326)] [KD 0.000 (0.000)] 2024-10-12 16:29:40,375 - Train: 62.23% [233550/375300] [186.7/300.0] [batch_t 0.373 (0.458)] [data_t 0.015] [optim_t 0.358] [lr 0.000958] [CE 3.287 (3.364)] [KD 0.000 (0.000)] 2024-10-12 16:30:02,741 - Train: 62.24% [233600/375300] [186.7/300.0] [batch_t 0.484 (0.447)] [data_t 0.016] [optim_t 0.468] [lr 0.000958] [CE 3.060 (3.360)] [KD 0.000 (0.000)] 2024-10-12 16:30:24,706 - Train: 62.26% [233650/375300] [186.8/300.0] [batch_t 0.499 (0.439)] [data_t 0.016] [optim_t 0.484] [lr 0.000957] [CE 3.052 (3.335)] [KD 0.000 (0.000)] 2024-10-12 16:30:46,679 - Train: 62.27% [233700/375300] [186.8/300.0] [batch_t 0.390 (0.439)] [data_t 0.016] [optim_t 0.374] [lr 0.000957] [CE 3.406 (3.353)] [KD 0.000 (0.000)] 2024-10-12 16:31:09,206 - Train: 62.28% [233750/375300] [186.9/300.0] [batch_t 0.467 (0.450)] [data_t 0.016] [optim_t 0.451] [lr 0.000956] [CE 3.170 (3.335)] [KD 0.000 (0.000)] 2024-10-12 16:31:31,122 - Train: 62.30% [233800/375300] [186.9/300.0] [batch_t 0.440 (0.438)] [data_t 0.015] [optim_t 0.425] [lr 0.000955] [CE 3.129 (3.350)] [KD 0.000 (0.000)] 2024-10-12 16:31:53,396 - Train: 62.31% [233850/375300] [186.9/300.0] [batch_t 0.457 (0.445)] [data_t 0.016] [optim_t 0.442] [lr 0.000955] [CE 3.095 (3.363)] [KD 0.000 (0.000)] 2024-10-12 16:32:16,019 - Train: 62.32% [233900/375300] [187.0/300.0] [batch_t 0.440 (0.452)] [data_t 0.016] [optim_t 0.425] [lr 0.000954] [CE 3.239 (3.373)] [KD 0.000 (0.000)] 2024-10-12 16:32:31,295 - ==> Total time: 1 day, 4:45:35 Eta: 17:22:44 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 16:32:41,884 - Train: 62.34% [233950/375300] [187.0/300.0] [batch_t 0.319 (0.665)] [data_t 0.016] [optim_t 0.303] [lr 0.000954] [CE 3.211 (3.322)] [KD 0.000 (0.000)] 2024-10-12 16:33:02,880 - Train: 62.35% [234000/375300] [187.1/300.0] [batch_t 0.393 (0.420)] [data_t 0.096] [optim_t 0.297] [lr 0.000953] [CE 3.230 (3.337)] [KD 0.000 (0.000)] 2024-10-12 16:33:24,716 - Train: 62.36% [234050/375300] [187.1/300.0] [batch_t 0.511 (0.437)] [data_t 0.215] [optim_t 0.295] [lr 0.000953] [CE 3.220 (3.342)] [KD 0.000 (0.000)] 2024-10-12 16:33:46,600 - Train: 62.38% [234100/375300] [187.1/300.0] [batch_t 0.411 (0.438)] [data_t 0.074] [optim_t 0.336] [lr 0.000952] [CE 3.316 (3.290)] [KD 0.000 (0.000)] 2024-10-12 16:34:08,286 - Train: 62.39% [234150/375300] [187.2/300.0] [batch_t 0.417 (0.434)] [data_t 0.015] [optim_t 0.401] [lr 0.000951] [CE 3.056 (3.324)] [KD 0.000 (0.000)] 2024-10-12 16:34:29,750 - Train: 62.40% [234200/375300] [187.2/300.0] [batch_t 0.482 (0.429)] [data_t 0.096] [optim_t 0.385] [lr 0.000951] [CE 3.471 (3.337)] [KD 0.000 (0.000)] 2024-10-12 16:34:51,572 - Train: 62.42% [234250/375300] [187.3/300.0] [batch_t 0.524 (0.436)] [data_t 0.224] [optim_t 0.301] [lr 0.000950] [CE 3.358 (3.329)] [KD 0.000 (0.000)] 2024-10-12 16:35:13,261 - Train: 62.43% [234300/375300] [187.3/300.0] [batch_t 0.456 (0.434)] [data_t 0.162] [optim_t 0.294] [lr 0.000950] [CE 3.355 (3.319)] [KD 0.000 (0.000)] 2024-10-12 16:35:34,996 - Train: 62.44% [234350/375300] [187.3/300.0] [batch_t 0.400 (0.435)] [data_t 0.104] [optim_t 0.296] [lr 0.000949] [CE 3.155 (3.340)] [KD 0.000 (0.000)] 2024-10-12 16:35:56,739 - Train: 62.46% [234400/375300] [187.4/300.0] [batch_t 0.479 (0.435)] [data_t 0.180] [optim_t 0.299] [lr 0.000949] [CE 3.405 (3.343)] [KD 0.000 (0.000)] 2024-10-12 16:36:18,425 - Train: 62.47% [234450/375300] [187.4/300.0] [batch_t 0.507 (0.434)] [data_t 0.206] [optim_t 0.300] [lr 0.000948] [CE 3.113 (3.320)] [KD 0.000 (0.000)] 2024-10-12 16:36:39,457 - Train: 62.48% [234500/375300] [187.5/300.0] [batch_t 0.399 (0.420)] [data_t 0.097] [optim_t 0.302] [lr 0.000947] [CE 3.354 (3.362)] [KD 0.000 (0.000)] 2024-10-12 16:37:01,257 - Train: 62.50% [234550/375300] [187.5/300.0] [batch_t 0.412 (0.436)] [data_t 0.118] [optim_t 0.294] [lr 0.000947] [CE 3.409 (3.419)] [KD 0.000 (0.000)] 2024-10-12 16:37:23,376 - Train: 62.51% [234600/375300] [187.5/300.0] [batch_t 0.466 (0.442)] [data_t 0.169] [optim_t 0.296] [lr 0.000946] [CE 3.428 (3.308)] [KD 0.000 (0.000)] 2024-10-12 16:37:45,108 - Train: 62.52% [234650/375300] [187.6/300.0] [batch_t 0.497 (0.435)] [data_t 0.199] [optim_t 0.298] [lr 0.000946] [CE 3.330 (3.353)] [KD 0.000 (0.000)] 2024-10-12 16:38:06,823 - Train: 62.54% [234700/375300] [187.6/300.0] [batch_t 0.433 (0.434)] [data_t 0.137] [optim_t 0.296] [lr 0.000945] [CE 3.062 (3.299)] [KD 0.000 (0.000)] 2024-10-12 16:38:29,070 - Train: 62.55% [234750/375300] [187.6/300.0] [batch_t 0.403 (0.445)] [data_t 0.111] [optim_t 0.292] [lr 0.000945] [CE 2.867 (3.333)] [KD 0.000 (0.000)] 2024-10-12 16:38:50,941 - Train: 62.56% [234800/375300] [187.7/300.0] [batch_t 0.447 (0.437)] [data_t 0.152] [optim_t 0.295] [lr 0.000944] [CE 3.455 (3.365)] [KD 0.000 (0.000)] 2024-10-12 16:39:13,160 - Train: 62.58% [234850/375300] [187.7/300.0] [batch_t 0.491 (0.444)] [data_t 0.198] [optim_t 0.294] [lr 0.000943] [CE 3.314 (3.329)] [KD 0.000 (0.000)] 2024-10-12 16:39:35,553 - Train: 62.59% [234900/375300] [187.8/300.0] [batch_t 0.465 (0.448)] [data_t 0.170] [optim_t 0.295] [lr 0.000943] [CE 3.282 (3.302)] [KD 0.000 (0.000)] 2024-10-12 16:39:57,579 - Train: 62.60% [234950/375300] [187.8/300.0] [batch_t 0.392 (0.440)] [data_t 0.099] [optim_t 0.293] [lr 0.000942] [CE 3.734 (3.372)] [KD 0.000 (0.000)] 2024-10-12 16:40:19,288 - Train: 62.62% [235000/375300] [187.8/300.0] [batch_t 0.460 (0.434)] [data_t 0.165] [optim_t 0.295] [lr 0.000942] [CE 3.491 (3.317)] [KD 0.000 (0.000)] 2024-10-12 16:40:41,537 - Train: 62.63% [235050/375300] [187.9/300.0] [batch_t 0.496 (0.445)] [data_t 0.203] [optim_t 0.293] [lr 0.000941] [CE 3.217 (3.383)] [KD 0.000 (0.000)] 2024-10-12 16:41:03,036 - Train: 62.64% [235100/375300] [187.9/300.0] [batch_t 0.457 (0.430)] [data_t 0.161] [optim_t 0.296] [lr 0.000941] [CE 3.356 (3.369)] [KD 0.000 (0.000)] 2024-10-12 16:41:24,641 - Train: 62.66% [235150/375300] [188.0/300.0] [batch_t 0.610 (0.432)] [data_t 0.161] [optim_t 0.449] [lr 0.000940] [CE 2.994 (3.325)] [KD 0.000 (0.000)] 2024-10-12 16:41:39,257 - ==> Total time: 1 day, 4:54:43 Eta: 17:13:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 16:41:49,752 - Train: 62.67% [235200/375300] [188.0/300.0] [batch_t 0.318 (0.752)] [data_t 0.016] [optim_t 0.303] [lr 0.000939] [CE 3.529 (3.296)] [KD 0.000 (0.000)] 2024-10-12 16:42:10,256 - Train: 62.68% [235250/375300] [188.0/300.0] [batch_t 0.408 (0.410)] [data_t 0.015] [optim_t 0.392] [lr 0.000939] [CE 2.997 (3.247)] [KD 0.000 (0.000)] 2024-10-12 16:42:31,780 - Train: 62.70% [235300/375300] [188.1/300.0] [batch_t 0.425 (0.430)] [data_t 0.015] [optim_t 0.409] [lr 0.000938] [CE 3.309 (3.317)] [KD 0.000 (0.000)] 2024-10-12 16:42:53,488 - Train: 62.71% [235350/375300] [188.1/300.0] [batch_t 0.402 (0.434)] [data_t 0.016] [optim_t 0.386] [lr 0.000938] [CE 3.197 (3.306)] [KD 0.000 (0.000)] 2024-10-12 16:43:15,401 - Train: 62.72% [235400/375300] [188.2/300.0] [batch_t 0.414 (0.438)] [data_t 0.016] [optim_t 0.398] [lr 0.000937] [CE 3.202 (3.338)] [KD 0.000 (0.000)] 2024-10-12 16:43:37,296 - Train: 62.74% [235450/375300] [188.2/300.0] [batch_t 0.449 (0.438)] [data_t 0.015] [optim_t 0.434] [lr 0.000937] [CE 3.474 (3.311)] [KD 0.000 (0.000)] 2024-10-12 16:43:59,279 - Train: 62.75% [235500/375300] [188.2/300.0] [batch_t 0.450 (0.440)] [data_t 0.015] [optim_t 0.434] [lr 0.000936] [CE 3.485 (3.282)] [KD 0.000 (0.000)] 2024-10-12 16:44:21,516 - Train: 62.76% [235550/375300] [188.3/300.0] [batch_t 0.463 (0.445)] [data_t 0.016] [optim_t 0.448] [lr 0.000935] [CE 3.580 (3.357)] [KD 0.000 (0.000)] 2024-10-12 16:44:43,720 - Train: 62.78% [235600/375300] [188.3/300.0] [batch_t 0.413 (0.444)] [data_t 0.016] [optim_t 0.398] [lr 0.000935] [CE 3.220 (3.332)] [KD 0.000 (0.000)] 2024-10-12 16:45:06,106 - Train: 62.79% [235650/375300] [188.4/300.0] [batch_t 0.445 (0.448)] [data_t 0.016] [optim_t 0.429] [lr 0.000934] [CE 3.379 (3.338)] [KD 0.000 (0.000)] 2024-10-12 16:45:29,322 - Train: 62.80% [235700/375300] [188.4/300.0] [batch_t 0.317 (0.464)] [data_t 0.016] [optim_t 0.301] [lr 0.000934] [CE 3.100 (3.342)] [KD 0.000 (0.000)] 2024-10-12 16:45:51,086 - Train: 62.82% [235750/375300] [188.4/300.0] [batch_t 0.385 (0.435)] [data_t 0.016] [optim_t 0.369] [lr 0.000933] [CE 3.443 (3.339)] [KD 0.000 (0.000)] 2024-10-12 16:46:12,532 - Train: 62.83% [235800/375300] [188.5/300.0] [batch_t 0.445 (0.429)] [data_t 0.016] [optim_t 0.429] [lr 0.000933] [CE 3.466 (3.326)] [KD 0.000 (0.000)] 2024-10-12 16:46:34,913 - Train: 62.84% [235850/375300] [188.5/300.0] [batch_t 0.482 (0.448)] [data_t 0.015] [optim_t 0.467] [lr 0.000932] [CE 3.213 (3.331)] [KD 0.000 (0.000)] 2024-10-12 16:46:56,846 - Train: 62.86% [235900/375300] [188.6/300.0] [batch_t 0.513 (0.439)] [data_t 0.016] [optim_t 0.497] [lr 0.000931] [CE 3.575 (3.360)] [KD 0.000 (0.000)] 2024-10-12 16:47:18,661 - Train: 62.87% [235950/375300] [188.6/300.0] [batch_t 0.323 (0.436)] [data_t 0.015] [optim_t 0.307] [lr 0.000931] [CE 3.278 (3.325)] [KD 0.000 (0.000)] 2024-10-12 16:47:40,055 - Train: 62.88% [236000/375300] [188.6/300.0] [batch_t 0.404 (0.428)] [data_t 0.016] [optim_t 0.389] [lr 0.000930] [CE 3.145 (3.347)] [KD 0.000 (0.000)] 2024-10-12 16:48:01,694 - Train: 62.90% [236050/375300] [188.7/300.0] [batch_t 0.439 (0.433)] [data_t 0.016] [optim_t 0.424] [lr 0.000930] [CE 3.577 (3.367)] [KD 0.000 (0.000)] 2024-10-12 16:48:23,316 - Train: 62.91% [236100/375300] [188.7/300.0] [batch_t 0.383 (0.432)] [data_t 0.016] [optim_t 0.368] [lr 0.000929] [CE 3.611 (3.281)] [KD 0.000 (0.000)] 2024-10-12 16:48:44,976 - Train: 62.92% [236150/375300] [188.8/300.0] [batch_t 0.329 (0.433)] [data_t 0.015] [optim_t 0.314] [lr 0.000929] [CE 3.509 (3.284)] [KD 0.000 (0.000)] 2024-10-12 16:49:06,858 - Train: 62.94% [236200/375300] [188.8/300.0] [batch_t 0.404 (0.438)] [data_t 0.016] [optim_t 0.388] [lr 0.000928] [CE 3.195 (3.396)] [KD 0.000 (0.000)] 2024-10-12 16:49:28,533 - Train: 62.95% [236250/375300] [188.8/300.0] [batch_t 0.372 (0.433)] [data_t 0.016] [optim_t 0.356] [lr 0.000927] [CE 3.361 (3.347)] [KD 0.000 (0.000)] 2024-10-12 16:49:50,335 - Train: 62.96% [236300/375300] [188.9/300.0] [batch_t 0.461 (0.436)] [data_t 0.016] [optim_t 0.446] [lr 0.000927] [CE 3.324 (3.374)] [KD 0.000 (0.000)] 2024-10-12 16:50:12,194 - Train: 62.98% [236350/375300] [188.9/300.0] [batch_t 0.423 (0.437)] [data_t 0.016] [optim_t 0.407] [lr 0.000926] [CE 3.369 (3.363)] [KD 0.000 (0.000)] 2024-10-12 16:50:33,805 - Train: 62.99% [236400/375300] [189.0/300.0] [batch_t 0.462 (0.432)] [data_t 0.016] [optim_t 0.446] [lr 0.000926] [CE 3.390 (3.351)] [KD 0.000 (0.000)] 2024-10-12 16:50:49,257 - ==> Total time: 1 day, 5:03:53 Eta: 17:04:11 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 16:50:59,223 - Train: 63.00% [236450/375300] [189.0/300.0] [batch_t 0.329 (0.776)] [data_t 0.015] [optim_t 0.314] [lr 0.000925] [CE 3.217 (3.327)] [KD 0.000 (0.000)] 2024-10-12 16:51:20,488 - Train: 63.02% [236500/375300] [189.0/300.0] [batch_t 0.481 (0.425)] [data_t 0.016] [optim_t 0.466] [lr 0.000925] [CE 3.380 (3.266)] [KD 0.000 (0.000)] 2024-10-12 16:51:42,616 - Train: 63.03% [236550/375300] [189.1/300.0] [batch_t 0.491 (0.442)] [data_t 0.016] [optim_t 0.475] [lr 0.000924] [CE 3.108 (3.330)] [KD 0.000 (0.000)] 2024-10-12 16:52:05,148 - Train: 63.04% [236600/375300] [189.1/300.0] [batch_t 0.497 (0.451)] [data_t 0.016] [optim_t 0.482] [lr 0.000923] [CE 3.301 (3.311)] [KD 0.000 (0.000)] 2024-10-12 16:52:27,666 - Train: 63.06% [236650/375300] [189.2/300.0] [batch_t 0.399 (0.450)] [data_t 0.016] [optim_t 0.383] [lr 0.000923] [CE 3.436 (3.332)] [KD 0.000 (0.000)] 2024-10-12 16:52:50,708 - Train: 63.07% [236700/375300] [189.2/300.0] [batch_t 0.427 (0.461)] [data_t 0.015] [optim_t 0.412] [lr 0.000922] [CE 2.997 (3.276)] [KD 0.000 (0.000)] 2024-10-12 16:53:13,845 - Train: 63.08% [236750/375300] [189.2/300.0] [batch_t 0.456 (0.463)] [data_t 0.015] [optim_t 0.441] [lr 0.000922] [CE 3.257 (3.299)] [KD 0.000 (0.000)] 2024-10-12 16:53:36,264 - Train: 63.10% [236800/375300] [189.3/300.0] [batch_t 0.497 (0.448)] [data_t 0.016] [optim_t 0.481] [lr 0.000921] [CE 3.104 (3.317)] [KD 0.000 (0.000)] 2024-10-12 16:53:58,272 - Train: 63.11% [236850/375300] [189.3/300.0] [batch_t 0.398 (0.440)] [data_t 0.016] [optim_t 0.383] [lr 0.000921] [CE 2.938 (3.307)] [KD 0.000 (0.000)] 2024-10-12 16:54:19,627 - Train: 63.12% [236900/375300] [189.4/300.0] [batch_t 0.400 (0.427)] [data_t 0.015] [optim_t 0.385] [lr 0.000920] [CE 3.139 (3.307)] [KD 0.000 (0.000)] 2024-10-12 16:54:40,714 - Train: 63.14% [236950/375300] [189.4/300.0] [batch_t 0.416 (0.422)] [data_t 0.015] [optim_t 0.401] [lr 0.000919] [CE 3.329 (3.307)] [KD 0.000 (0.000)] 2024-10-12 16:55:02,241 - Train: 63.15% [237000/375300] [189.4/300.0] [batch_t 0.466 (0.430)] [data_t 0.015] [optim_t 0.451] [lr 0.000919] [CE 3.203 (3.349)] [KD 0.000 (0.000)] 2024-10-12 16:55:23,506 - Train: 63.16% [237050/375300] [189.5/300.0] [batch_t 0.400 (0.425)] [data_t 0.015] [optim_t 0.384] [lr 0.000918] [CE 3.131 (3.360)] [KD 0.000 (0.000)] 2024-10-12 16:55:44,575 - Train: 63.18% [237100/375300] [189.5/300.0] [batch_t 0.311 (0.421)] [data_t 0.015] [optim_t 0.295] [lr 0.000918] [CE 3.352 (3.306)] [KD 0.000 (0.000)] 2024-10-12 16:56:05,803 - Train: 63.19% [237150/375300] [189.6/300.0] [batch_t 0.466 (0.424)] [data_t 0.015] [optim_t 0.450] [lr 0.000917] [CE 3.238 (3.315)] [KD 0.000 (0.000)] 2024-10-12 16:56:27,263 - Train: 63.20% [237200/375300] [189.6/300.0] [batch_t 0.547 (0.429)] [data_t 0.016] [optim_t 0.532] [lr 0.000917] [CE 3.512 (3.371)] [KD 0.000 (0.000)] 2024-10-12 16:56:48,817 - Train: 63.22% [237250/375300] [189.6/300.0] [batch_t 0.421 (0.431)] [data_t 0.016] [optim_t 0.406] [lr 0.000916] [CE 3.329 (3.392)] [KD 0.000 (0.000)] 2024-10-12 16:57:11,067 - Train: 63.23% [237300/375300] [189.7/300.0] [batch_t 0.465 (0.445)] [data_t 0.016] [optim_t 0.449] [lr 0.000915] [CE 3.309 (3.338)] [KD 0.000 (0.000)] 2024-10-12 16:57:32,730 - Train: 63.24% [237350/375300] [189.7/300.0] [batch_t 0.423 (0.433)] [data_t 0.015] [optim_t 0.407] [lr 0.000915] [CE 3.297 (3.303)] [KD 0.000 (0.000)] 2024-10-12 16:57:54,626 - Train: 63.26% [237400/375300] [189.8/300.0] [batch_t 0.491 (0.438)] [data_t 0.015] [optim_t 0.476] [lr 0.000914] [CE 3.565 (3.364)] [KD 0.000 (0.000)] 2024-10-12 16:58:16,725 - Train: 63.27% [237450/375300] [189.8/300.0] [batch_t 0.537 (0.442)] [data_t 0.016] [optim_t 0.521] [lr 0.000914] [CE 3.495 (3.339)] [KD 0.000 (0.000)] 2024-10-12 16:58:39,048 - Train: 63.28% [237500/375300] [189.8/300.0] [batch_t 0.487 (0.446)] [data_t 0.016] [optim_t 0.472] [lr 0.000913] [CE 3.515 (3.307)] [KD 0.000 (0.000)] 2024-10-12 16:59:00,692 - Train: 63.30% [237550/375300] [189.9/300.0] [batch_t 0.424 (0.433)] [data_t 0.016] [optim_t 0.409] [lr 0.000913] [CE 3.270 (3.320)] [KD 0.000 (0.000)] 2024-10-12 16:59:22,625 - Train: 63.31% [237600/375300] [189.9/300.0] [batch_t 0.417 (0.439)] [data_t 0.016] [optim_t 0.401] [lr 0.000912] [CE 2.936 (3.336)] [KD 0.000 (0.000)] 2024-10-12 16:59:44,662 - Train: 63.32% [237650/375300] [190.0/300.0] [batch_t 0.468 (0.441)] [data_t 0.015] [optim_t 0.453] [lr 0.000911] [CE 3.420 (3.308)] [KD 0.000 (0.000)] 2024-10-12 17:00:22,918 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.437)] [top1_cnt 38559] [top5_cnt 47034] [top_all 50000] 2024-10-12 17:00:22,919 - net: 77.118 (94.068) 2024-10-12 17:00:45,351 - Test (net_E): 100.00% [50/50] [batch_t 0.135 (0.440)] [top1_cnt 40182] [top5_cnt 47733] [top_all 50000] 2024-10-12 17:00:45,351 - net_E: 80.364 (95.466) 2024-10-12 17:00:45,533 - Max [top1: 77.118 (epoch: 190)] [top1-ema: 80.364 (epoch: 190)] 2024-10-12 17:00:45,534 - ==> Total time: 1 day, 5:13:49 Eta: 16:55:22 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 17:00:57,547 - Train: 63.34% [237700/375300] [190.0/300.0] [batch_t 0.319 (0.597)] [data_t 0.016] [optim_t 0.303] [lr 0.000911] [CE 3.341 (3.327)] [KD 0.000 (0.000)] 2024-10-12 17:01:17,683 - Train: 63.35% [237750/375300] [190.0/300.0] [batch_t 0.461 (0.403)] [data_t 0.015] [optim_t 0.446] [lr 0.000910] [CE 3.434 (3.331)] [KD 0.000 (0.000)] 2024-10-12 17:01:39,402 - Train: 63.36% [237800/375300] [190.1/300.0] [batch_t 0.431 (0.434)] [data_t 0.016] [optim_t 0.416] [lr 0.000910] [CE 3.461 (3.291)] [KD 0.000 (0.000)] 2024-10-12 17:02:01,585 - Train: 63.38% [237850/375300] [190.1/300.0] [batch_t 0.510 (0.444)] [data_t 0.015] [optim_t 0.495] [lr 0.000909] [CE 3.286 (3.324)] [KD 0.000 (0.000)] 2024-10-12 17:02:23,573 - Train: 63.39% [237900/375300] [190.2/300.0] [batch_t 0.488 (0.440)] [data_t 0.015] [optim_t 0.472] [lr 0.000909] [CE 3.090 (3.321)] [KD 0.000 (0.000)] 2024-10-12 17:02:45,547 - Train: 63.40% [237950/375300] [190.2/300.0] [batch_t 0.312 (0.439)] [data_t 0.016] [optim_t 0.296] [lr 0.000908] [CE 3.446 (3.346)] [KD 0.000 (0.000)] 2024-10-12 17:03:07,121 - Train: 63.42% [238000/375300] [190.2/300.0] [batch_t 0.435 (0.431)] [data_t 0.016] [optim_t 0.419] [lr 0.000907] [CE 3.405 (3.335)] [KD 0.000 (0.000)] 2024-10-12 17:03:29,215 - Train: 63.43% [238050/375300] [190.3/300.0] [batch_t 0.492 (0.442)] [data_t 0.016] [optim_t 0.477] [lr 0.000907] [CE 3.390 (3.318)] [KD 0.000 (0.000)] 2024-10-12 17:03:50,417 - Train: 63.44% [238100/375300] [190.3/300.0] [batch_t 0.383 (0.424)] [data_t 0.016] [optim_t 0.368] [lr 0.000906] [CE 3.632 (3.329)] [KD 0.000 (0.000)] 2024-10-12 17:04:12,654 - Train: 63.46% [238150/375300] [190.4/300.0] [batch_t 0.444 (0.445)] [data_t 0.016] [optim_t 0.428] [lr 0.000906] [CE 2.752 (3.275)] [KD 0.000 (0.000)] 2024-10-12 17:04:33,736 - Train: 63.47% [238200/375300] [190.4/300.0] [batch_t 0.439 (0.421)] [data_t 0.016] [optim_t 0.424] [lr 0.000905] [CE 3.429 (3.321)] [KD 0.000 (0.000)] 2024-10-12 17:04:55,088 - Train: 63.48% [238250/375300] [190.4/300.0] [batch_t 0.432 (0.427)] [data_t 0.016] [optim_t 0.416] [lr 0.000905] [CE 3.198 (3.305)] [KD 0.000 (0.000)] 2024-10-12 17:05:16,196 - Train: 63.50% [238300/375300] [190.5/300.0] [batch_t 0.407 (0.422)] [data_t 0.016] [optim_t 0.391] [lr 0.000904] [CE 3.259 (3.304)] [KD 0.000 (0.000)] 2024-10-12 17:05:37,189 - Train: 63.51% [238350/375300] [190.5/300.0] [batch_t 0.456 (0.420)] [data_t 0.015] [optim_t 0.440] [lr 0.000904] [CE 3.369 (3.331)] [KD 0.000 (0.000)] 2024-10-12 17:05:57,978 - Train: 63.52% [238400/375300] [190.6/300.0] [batch_t 0.444 (0.416)] [data_t 0.016] [optim_t 0.428] [lr 0.000903] [CE 3.547 (3.290)] [KD 0.000 (0.000)] 2024-10-12 17:06:19,696 - Train: 63.54% [238450/375300] [190.6/300.0] [batch_t 0.415 (0.434)] [data_t 0.016] [optim_t 0.399] [lr 0.000902] [CE 3.486 (3.291)] [KD 0.000 (0.000)] 2024-10-12 17:06:41,316 - Train: 63.55% [238500/375300] [190.6/300.0] [batch_t 0.429 (0.432)] [data_t 0.016] [optim_t 0.413] [lr 0.000902] [CE 3.388 (3.352)] [KD 0.000 (0.000)] 2024-10-12 17:07:03,170 - Train: 63.56% [238550/375300] [190.7/300.0] [batch_t 0.509 (0.437)] [data_t 0.015] [optim_t 0.493] [lr 0.000901] [CE 3.502 (3.323)] [KD 0.000 (0.000)] 2024-10-12 17:07:24,619 - Train: 63.58% [238600/375300] [190.7/300.0] [batch_t 0.376 (0.429)] [data_t 0.016] [optim_t 0.361] [lr 0.000901] [CE 3.254 (3.283)] [KD 0.000 (0.000)] 2024-10-12 17:07:46,198 - Train: 63.59% [238650/375300] [190.8/300.0] [batch_t 0.496 (0.431)] [data_t 0.015] [optim_t 0.481] [lr 0.000900] [CE 3.175 (3.325)] [KD 0.000 (0.000)] 2024-10-12 17:08:08,261 - Train: 63.60% [238700/375300] [190.8/300.0] [batch_t 0.310 (0.441)] [data_t 0.015] [optim_t 0.295] [lr 0.000900] [CE 3.314 (3.307)] [KD 0.000 (0.000)] 2024-10-12 17:08:30,417 - Train: 63.62% [238750/375300] [190.8/300.0] [batch_t 0.419 (0.443)] [data_t 0.015] [optim_t 0.404] [lr 0.000899] [CE 3.626 (3.339)] [KD 0.000 (0.000)] 2024-10-12 17:08:52,330 - Train: 63.63% [238800/375300] [190.9/300.0] [batch_t 0.441 (0.438)] [data_t 0.015] [optim_t 0.426] [lr 0.000898] [CE 3.135 (3.320)] [KD 0.000 (0.000)] 2024-10-12 17:09:13,422 - Train: 63.64% [238850/375300] [190.9/300.0] [batch_t 0.437 (0.422)] [data_t 0.016] [optim_t 0.422] [lr 0.000898] [CE 3.124 (3.325)] [KD 0.000 (0.000)] 2024-10-12 17:09:36,518 - Train: 63.66% [238900/375300] [191.0/300.0] [batch_t 0.453 (0.462)] [data_t 0.159] [optim_t 0.293] [lr 0.000897] [CE 3.645 (3.324)] [KD 0.000 (0.000)] 2024-10-12 17:09:52,420 - ==> Total time: 1 day, 5:22:56 Eta: 16:46:04 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 17:10:02,673 - Train: 63.67% [238950/375300] [191.0/300.0] [batch_t 0.332 (0.988)] [data_t 0.016] [optim_t 0.316] [lr 0.000897] [CE 3.147 (3.255)] [KD 0.000 (0.000)] 2024-10-12 17:10:23,245 - Train: 63.68% [239000/375300] [191.0/300.0] [batch_t 0.406 (0.411)] [data_t 0.016] [optim_t 0.391] [lr 0.000896] [CE 3.381 (3.308)] [KD 0.000 (0.000)] 2024-10-12 17:10:45,685 - Train: 63.70% [239050/375300] [191.1/300.0] [batch_t 0.394 (0.449)] [data_t 0.015] [optim_t 0.378] [lr 0.000896] [CE 3.371 (3.285)] [KD 0.000 (0.000)] 2024-10-12 17:11:07,962 - Train: 63.71% [239100/375300] [191.1/300.0] [batch_t 0.463 (0.445)] [data_t 0.015] [optim_t 0.447] [lr 0.000895] [CE 3.312 (3.287)] [KD 0.000 (0.000)] 2024-10-12 17:11:30,291 - Train: 63.72% [239150/375300] [191.2/300.0] [batch_t 0.371 (0.446)] [data_t 0.015] [optim_t 0.355] [lr 0.000894] [CE 3.302 (3.305)] [KD 0.000 (0.000)] 2024-10-12 17:11:52,836 - Train: 63.74% [239200/375300] [191.2/300.0] [batch_t 0.541 (0.451)] [data_t 0.016] [optim_t 0.526] [lr 0.000894] [CE 3.164 (3.276)] [KD 0.000 (0.000)] 2024-10-12 17:12:14,863 - Train: 63.75% [239250/375300] [191.2/300.0] [batch_t 0.429 (0.440)] [data_t 0.016] [optim_t 0.414] [lr 0.000893] [CE 3.431 (3.311)] [KD 0.000 (0.000)] 2024-10-12 17:12:37,087 - Train: 63.76% [239300/375300] [191.3/300.0] [batch_t 0.429 (0.444)] [data_t 0.016] [optim_t 0.413] [lr 0.000893] [CE 3.326 (3.308)] [KD 0.000 (0.000)] 2024-10-12 17:12:58,903 - Train: 63.78% [239350/375300] [191.3/300.0] [batch_t 0.439 (0.436)] [data_t 0.084] [optim_t 0.355] [lr 0.000892] [CE 3.364 (3.361)] [KD 0.000 (0.000)] 2024-10-12 17:13:21,209 - Train: 63.79% [239400/375300] [191.4/300.0] [batch_t 0.371 (0.446)] [data_t 0.073] [optim_t 0.297] [lr 0.000892] [CE 3.212 (3.310)] [KD 0.000 (0.000)] 2024-10-12 17:13:42,912 - Train: 63.80% [239450/375300] [191.4/300.0] [batch_t 0.414 (0.434)] [data_t 0.052] [optim_t 0.362] [lr 0.000891] [CE 3.705 (3.327)] [KD 0.000 (0.000)] 2024-10-12 17:14:05,497 - Train: 63.82% [239500/375300] [191.4/300.0] [batch_t 0.488 (0.452)] [data_t 0.015] [optim_t 0.473] [lr 0.000891] [CE 3.252 (3.323)] [KD 0.000 (0.000)] 2024-10-12 17:14:27,418 - Train: 63.83% [239550/375300] [191.5/300.0] [batch_t 0.440 (0.438)] [data_t 0.016] [optim_t 0.424] [lr 0.000890] [CE 3.370 (3.340)] [KD 0.000 (0.000)] 2024-10-12 17:14:50,084 - Train: 63.84% [239600/375300] [191.5/300.0] [batch_t 0.321 (0.453)] [data_t 0.016] [optim_t 0.306] [lr 0.000889] [CE 3.001 (3.331)] [KD 0.000 (0.000)] 2024-10-12 17:15:11,839 - Train: 63.86% [239650/375300] [191.6/300.0] [batch_t 0.421 (0.435)] [data_t 0.016] [optim_t 0.405] [lr 0.000889] [CE 2.964 (3.299)] [KD 0.000 (0.000)] 2024-10-12 17:15:33,986 - Train: 63.87% [239700/375300] [191.6/300.0] [batch_t 0.395 (0.443)] [data_t 0.099] [optim_t 0.295] [lr 0.000888] [CE 3.483 (3.314)] [KD 0.000 (0.000)] 2024-10-12 17:15:56,539 - Train: 63.88% [239750/375300] [191.6/300.0] [batch_t 0.453 (0.451)] [data_t 0.155] [optim_t 0.298] [lr 0.000888] [CE 2.990 (3.300)] [KD 0.000 (0.000)] 2024-10-12 17:16:18,892 - Train: 63.90% [239800/375300] [191.7/300.0] [batch_t 0.312 (0.447)] [data_t 0.016] [optim_t 0.297] [lr 0.000887] [CE 3.241 (3.300)] [KD 0.000 (0.000)] 2024-10-12 17:16:41,200 - Train: 63.91% [239850/375300] [191.7/300.0] [batch_t 0.386 (0.446)] [data_t 0.082] [optim_t 0.304] [lr 0.000887] [CE 3.605 (3.354)] [KD 0.000 (0.000)] 2024-10-12 17:17:03,760 - Train: 63.92% [239900/375300] [191.8/300.0] [batch_t 0.437 (0.451)] [data_t 0.140] [optim_t 0.297] [lr 0.000886] [CE 3.397 (3.334)] [KD 0.000 (0.000)] 2024-10-12 17:17:26,205 - Train: 63.94% [239950/375300] [191.8/300.0] [batch_t 0.434 (0.449)] [data_t 0.142] [optim_t 0.293] [lr 0.000885] [CE 3.089 (3.337)] [KD 0.000 (0.000)] 2024-10-12 17:17:48,970 - Train: 63.95% [240000/375300] [191.8/300.0] [batch_t 0.464 (0.455)] [data_t 0.171] [optim_t 0.293] [lr 0.000885] [CE 3.445 (3.296)] [KD 0.000 (0.000)] 2024-10-12 17:18:11,504 - Train: 63.96% [240050/375300] [191.9/300.0] [batch_t 0.383 (0.451)] [data_t 0.092] [optim_t 0.291] [lr 0.000884] [CE 3.122 (3.321)] [KD 0.000 (0.000)] 2024-10-12 17:18:34,118 - Train: 63.98% [240100/375300] [191.9/300.0] [batch_t 0.319 (0.452)] [data_t 0.025] [optim_t 0.294] [lr 0.000884] [CE 3.316 (3.339)] [KD 0.000 (0.000)] 2024-10-12 17:18:56,301 - Train: 63.99% [240150/375300] [192.0/300.0] [batch_t 0.316 (0.444)] [data_t 0.016] [optim_t 0.300] [lr 0.000883] [CE 3.174 (3.299)] [KD 0.000 (0.000)] 2024-10-12 17:19:13,786 - ==> Total time: 1 day, 5:32:17 Eta: 16:36:54 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 17:19:23,075 - Train: 64.00% [240200/375300] [192.0/300.0] [batch_t 0.314 (0.991)] [data_t 0.016] [optim_t 0.299] [lr 0.000883] [CE 3.652 (3.199)] [KD 0.000 (0.000)] 2024-10-12 17:19:44,077 - Train: 64.02% [240250/375300] [192.0/300.0] [batch_t 0.465 (0.420)] [data_t 0.023] [optim_t 0.442] [lr 0.000882] [CE 2.905 (3.317)] [KD 0.000 (0.000)] 2024-10-12 17:20:07,061 - Train: 64.03% [240300/375300] [192.1/300.0] [batch_t 0.455 (0.460)] [data_t 0.157] [optim_t 0.298] [lr 0.000882] [CE 3.014 (3.320)] [KD 0.000 (0.000)] 2024-10-12 17:20:28,322 - Train: 64.04% [240350/375300] [192.1/300.0] [batch_t 0.321 (0.425)] [data_t 0.025] [optim_t 0.296] [lr 0.000881] [CE 3.275 (3.298)] [KD 0.000 (0.000)] 2024-10-12 17:20:50,301 - Train: 64.06% [240400/375300] [192.2/300.0] [batch_t 0.443 (0.439)] [data_t 0.016] [optim_t 0.427] [lr 0.000880] [CE 3.341 (3.322)] [KD 0.000 (0.000)] 2024-10-12 17:21:12,594 - Train: 64.07% [240450/375300] [192.2/300.0] [batch_t 0.401 (0.446)] [data_t 0.015] [optim_t 0.386] [lr 0.000880] [CE 3.197 (3.284)] [KD 0.000 (0.000)] 2024-10-12 17:21:34,099 - Train: 64.08% [240500/375300] [192.2/300.0] [batch_t 0.452 (0.430)] [data_t 0.015] [optim_t 0.436] [lr 0.000879] [CE 3.294 (3.327)] [KD 0.000 (0.000)] 2024-10-12 17:21:55,818 - Train: 64.10% [240550/375300] [192.3/300.0] [batch_t 0.492 (0.434)] [data_t 0.016] [optim_t 0.476] [lr 0.000879] [CE 3.162 (3.323)] [KD 0.000 (0.000)] 2024-10-12 17:22:18,087 - Train: 64.11% [240600/375300] [192.3/300.0] [batch_t 0.495 (0.445)] [data_t 0.195] [optim_t 0.300] [lr 0.000878] [CE 3.351 (3.233)] [KD 0.000 (0.000)] 2024-10-12 17:22:39,750 - Train: 64.12% [240650/375300] [192.4/300.0] [batch_t 0.449 (0.433)] [data_t 0.016] [optim_t 0.433] [lr 0.000878] [CE 3.284 (3.318)] [KD 0.000 (0.000)] 2024-10-12 17:23:01,747 - Train: 64.14% [240700/375300] [192.4/300.0] [batch_t 0.499 (0.440)] [data_t 0.015] [optim_t 0.483] [lr 0.000877] [CE 3.507 (3.271)] [KD 0.000 (0.000)] 2024-10-12 17:23:23,838 - Train: 64.15% [240750/375300] [192.4/300.0] [batch_t 0.420 (0.442)] [data_t 0.016] [optim_t 0.405] [lr 0.000876] [CE 3.412 (3.329)] [KD 0.000 (0.000)] 2024-10-12 17:23:46,063 - Train: 64.16% [240800/375300] [192.5/300.0] [batch_t 0.469 (0.444)] [data_t 0.016] [optim_t 0.453] [lr 0.000876] [CE 3.382 (3.260)] [KD 0.000 (0.000)] 2024-10-12 17:24:08,201 - Train: 64.18% [240850/375300] [192.5/300.0] [batch_t 0.470 (0.443)] [data_t 0.015] [optim_t 0.455] [lr 0.000875] [CE 3.177 (3.302)] [KD 0.000 (0.000)] 2024-10-12 17:24:30,248 - Train: 64.19% [240900/375300] [192.6/300.0] [batch_t 0.426 (0.441)] [data_t 0.015] [optim_t 0.410] [lr 0.000875] [CE 3.252 (3.292)] [KD 0.000 (0.000)] 2024-10-12 17:24:51,688 - Train: 64.20% [240950/375300] [192.6/300.0] [batch_t 0.316 (0.429)] [data_t 0.015] [optim_t 0.301] [lr 0.000874] [CE 3.052 (3.316)] [KD 0.000 (0.000)] 2024-10-12 17:25:13,170 - Train: 64.22% [241000/375300] [192.6/300.0] [batch_t 0.445 (0.430)] [data_t 0.015] [optim_t 0.430] [lr 0.000874] [CE 3.255 (3.322)] [KD 0.000 (0.000)] 2024-10-12 17:25:34,637 - Train: 64.23% [241050/375300] [192.7/300.0] [batch_t 0.496 (0.429)] [data_t 0.016] [optim_t 0.480] [lr 0.000873] [CE 3.283 (3.304)] [KD 0.000 (0.000)] 2024-10-12 17:25:57,117 - Train: 64.24% [241100/375300] [192.7/300.0] [batch_t 0.321 (0.449)] [data_t 0.015] [optim_t 0.305] [lr 0.000873] [CE 3.644 (3.286)] [KD 0.000 (0.000)] 2024-10-12 17:26:18,744 - Train: 64.26% [241150/375300] [192.8/300.0] [batch_t 0.444 (0.432)] [data_t 0.015] [optim_t 0.429] [lr 0.000872] [CE 3.379 (3.354)] [KD 0.000 (0.000)] 2024-10-12 17:26:40,394 - Train: 64.27% [241200/375300] [192.8/300.0] [batch_t 0.441 (0.433)] [data_t 0.015] [optim_t 0.426] [lr 0.000871] [CE 3.144 (3.351)] [KD 0.000 (0.000)] 2024-10-12 17:27:01,426 - Train: 64.28% [241250/375300] [192.8/300.0] [batch_t 0.381 (0.421)] [data_t 0.016] [optim_t 0.365] [lr 0.000871] [CE 3.615 (3.360)] [KD 0.000 (0.000)] 2024-10-12 17:27:23,353 - Train: 64.30% [241300/375300] [192.9/300.0] [batch_t 0.317 (0.438)] [data_t 0.016] [optim_t 0.301] [lr 0.000870] [CE 3.641 (3.313)] [KD 0.000 (0.000)] 2024-10-12 17:27:45,416 - Train: 64.31% [241350/375300] [192.9/300.0] [batch_t 0.370 (0.441)] [data_t 0.015] [optim_t 0.354] [lr 0.000870] [CE 3.020 (3.276)] [KD 0.000 (0.000)] 2024-10-12 17:28:06,842 - Train: 64.32% [241400/375300] [193.0/300.0] [batch_t 0.457 (0.428)] [data_t 0.015] [optim_t 0.442] [lr 0.000869] [CE 3.072 (3.270)] [KD 0.000 (0.000)] 2024-10-12 17:28:24,570 - ==> Total time: 1 day, 5:41:28 Eta: 16:27:39 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 17:28:34,176 - Train: 64.34% [241450/375300] [193.0/300.0] [batch_t 0.321 (1.165)] [data_t 0.016] [optim_t 0.306] [lr 0.000869] [CE 3.462 (3.213)] [KD 0.000 (0.000)] 2024-10-12 17:28:53,904 - Train: 64.35% [241500/375300] [193.0/300.0] [batch_t 0.396 (0.394)] [data_t 0.016] [optim_t 0.381] [lr 0.000868] [CE 3.404 (3.313)] [KD 0.000 (0.000)] 2024-10-12 17:29:16,304 - Train: 64.36% [241550/375300] [193.1/300.0] [batch_t 0.567 (0.448)] [data_t 0.016] [optim_t 0.552] [lr 0.000867] [CE 3.072 (3.300)] [KD 0.000 (0.000)] 2024-10-12 17:29:38,337 - Train: 64.38% [241600/375300] [193.1/300.0] [batch_t 0.432 (0.441)] [data_t 0.016] [optim_t 0.416] [lr 0.000867] [CE 3.193 (3.298)] [KD 0.000 (0.000)] 2024-10-12 17:30:00,153 - Train: 64.39% [241650/375300] [193.2/300.0] [batch_t 0.448 (0.436)] [data_t 0.016] [optim_t 0.432] [lr 0.000866] [CE 3.103 (3.273)] [KD 0.000 (0.000)] 2024-10-12 17:30:21,900 - Train: 64.40% [241700/375300] [193.2/300.0] [batch_t 0.496 (0.435)] [data_t 0.015] [optim_t 0.481] [lr 0.000866] [CE 3.174 (3.308)] [KD 0.000 (0.000)] 2024-10-12 17:30:44,403 - Train: 64.42% [241750/375300] [193.2/300.0] [batch_t 0.317 (0.450)] [data_t 0.015] [optim_t 0.301] [lr 0.000865] [CE 3.153 (3.306)] [KD 0.000 (0.000)] 2024-10-12 17:31:06,752 - Train: 64.43% [241800/375300] [193.3/300.0] [batch_t 0.448 (0.447)] [data_t 0.015] [optim_t 0.433] [lr 0.000865] [CE 3.602 (3.333)] [KD 0.000 (0.000)] 2024-10-12 17:31:28,215 - Train: 64.44% [241850/375300] [193.3/300.0] [batch_t 0.333 (0.429)] [data_t 0.015] [optim_t 0.317] [lr 0.000864] [CE 2.979 (3.301)] [KD 0.000 (0.000)] 2024-10-12 17:31:49,274 - Train: 64.46% [241900/375300] [193.4/300.0] [batch_t 0.484 (0.421)] [data_t 0.016] [optim_t 0.468] [lr 0.000864] [CE 3.260 (3.365)] [KD 0.000 (0.000)] 2024-10-12 17:32:10,647 - Train: 64.47% [241950/375300] [193.4/300.0] [batch_t 0.446 (0.427)] [data_t 0.015] [optim_t 0.431] [lr 0.000863] [CE 3.200 (3.279)] [KD 0.000 (0.000)] 2024-10-12 17:32:32,592 - Train: 64.48% [242000/375300] [193.4/300.0] [batch_t 0.402 (0.439)] [data_t 0.016] [optim_t 0.386] [lr 0.000862] [CE 3.507 (3.288)] [KD 0.000 (0.000)] 2024-10-12 17:32:54,645 - Train: 64.50% [242050/375300] [193.5/300.0] [batch_t 0.457 (0.441)] [data_t 0.015] [optim_t 0.442] [lr 0.000862] [CE 3.340 (3.285)] [KD 0.000 (0.000)] 2024-10-12 17:33:16,935 - Train: 64.51% [242100/375300] [193.5/300.0] [batch_t 0.405 (0.446)] [data_t 0.015] [optim_t 0.390] [lr 0.000861] [CE 3.613 (3.282)] [KD 0.000 (0.000)] 2024-10-12 17:33:38,916 - Train: 64.52% [242150/375300] [193.6/300.0] [batch_t 0.351 (0.440)] [data_t 0.015] [optim_t 0.335] [lr 0.000861] [CE 3.346 (3.262)] [KD 0.000 (0.000)] 2024-10-12 17:34:00,856 - Train: 64.54% [242200/375300] [193.6/300.0] [batch_t 0.398 (0.439)] [data_t 0.015] [optim_t 0.382] [lr 0.000860] [CE 3.419 (3.269)] [KD 0.000 (0.000)] 2024-10-12 17:34:23,490 - Train: 64.55% [242250/375300] [193.6/300.0] [batch_t 0.477 (0.453)] [data_t 0.016] [optim_t 0.462] [lr 0.000860] [CE 3.400 (3.279)] [KD 0.000 (0.000)] 2024-10-12 17:34:45,367 - Train: 64.56% [242300/375300] [193.7/300.0] [batch_t 0.351 (0.437)] [data_t 0.015] [optim_t 0.335] [lr 0.000859] [CE 3.558 (3.309)] [KD 0.000 (0.000)] 2024-10-12 17:35:07,471 - Train: 64.58% [242350/375300] [193.7/300.0] [batch_t 0.488 (0.442)] [data_t 0.016] [optim_t 0.472] [lr 0.000859] [CE 3.143 (3.308)] [KD 0.000 (0.000)] 2024-10-12 17:35:29,319 - Train: 64.59% [242400/375300] [193.8/300.0] [batch_t 0.458 (0.437)] [data_t 0.155] [optim_t 0.303] [lr 0.000858] [CE 3.502 (3.310)] [KD 0.000 (0.000)] 2024-10-12 17:35:51,667 - Train: 64.60% [242450/375300] [193.8/300.0] [batch_t 0.441 (0.447)] [data_t 0.142] [optim_t 0.298] [lr 0.000857] [CE 3.196 (3.319)] [KD 0.000 (0.000)] 2024-10-12 17:36:13,270 - Train: 64.61% [242500/375300] [193.8/300.0] [batch_t 0.406 (0.432)] [data_t 0.103] [optim_t 0.303] [lr 0.000857] [CE 3.136 (3.329)] [KD 0.000 (0.000)] 2024-10-12 17:36:34,688 - Train: 64.63% [242550/375300] [193.9/300.0] [batch_t 0.458 (0.428)] [data_t 0.161] [optim_t 0.297] [lr 0.000856] [CE 3.054 (3.325)] [KD 0.000 (0.000)] 2024-10-12 17:36:57,005 - Train: 64.64% [242600/375300] [193.9/300.0] [batch_t 0.391 (0.446)] [data_t 0.016] [optim_t 0.376] [lr 0.000856] [CE 3.386 (3.290)] [KD 0.000 (0.000)] 2024-10-12 17:37:19,443 - Train: 64.65% [242650/375300] [194.0/300.0] [batch_t 0.441 (0.449)] [data_t 0.016] [optim_t 0.426] [lr 0.000855] [CE 3.158 (3.306)] [KD 0.000 (0.000)] 2024-10-12 17:37:37,123 - ==> Total time: 1 day, 5:50:41 Eta: 16:18:24 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 17:37:45,468 - Train: 64.67% [242700/375300] [194.0/300.0] [batch_t 0.313 (1.143)] [data_t 0.015] [optim_t 0.297] [lr 0.000855] [CE 3.513 (3.389)] [KD 0.000 (0.000)] 2024-10-12 17:38:06,206 - Train: 64.68% [242750/375300] [194.0/300.0] [batch_t 0.375 (0.415)] [data_t 0.079] [optim_t 0.296] [lr 0.000854] [CE 3.255 (3.270)] [KD 0.000 (0.000)] 2024-10-12 17:38:28,209 - Train: 64.69% [242800/375300] [194.1/300.0] [batch_t 0.432 (0.440)] [data_t 0.140] [optim_t 0.293] [lr 0.000854] [CE 3.307 (3.302)] [KD 0.000 (0.000)] 2024-10-12 17:38:49,968 - Train: 64.71% [242850/375300] [194.1/300.0] [batch_t 0.448 (0.435)] [data_t 0.016] [optim_t 0.433] [lr 0.000853] [CE 3.108 (3.278)] [KD 0.000 (0.000)] 2024-10-12 17:39:11,696 - Train: 64.72% [242900/375300] [194.2/300.0] [batch_t 0.422 (0.434)] [data_t 0.016] [optim_t 0.406] [lr 0.000852] [CE 3.001 (3.281)] [KD 0.000 (0.000)] 2024-10-12 17:39:32,354 - Train: 64.73% [242950/375300] [194.2/300.0] [batch_t 0.419 (0.413)] [data_t 0.016] [optim_t 0.403] [lr 0.000852] [CE 3.015 (3.318)] [KD 0.000 (0.000)] 2024-10-12 17:39:53,625 - Train: 64.75% [243000/375300] [194.2/300.0] [batch_t 0.418 (0.425)] [data_t 0.123] [optim_t 0.295] [lr 0.000851] [CE 3.249 (3.285)] [KD 0.000 (0.000)] 2024-10-12 17:40:15,309 - Train: 64.76% [243050/375300] [194.3/300.0] [batch_t 0.411 (0.434)] [data_t 0.016] [optim_t 0.395] [lr 0.000851] [CE 3.560 (3.292)] [KD 0.000 (0.000)] 2024-10-12 17:40:36,615 - Train: 64.77% [243100/375300] [194.3/300.0] [batch_t 0.430 (0.426)] [data_t 0.016] [optim_t 0.414] [lr 0.000850] [CE 3.205 (3.312)] [KD 0.000 (0.000)] 2024-10-12 17:40:57,799 - Train: 64.79% [243150/375300] [194.4/300.0] [batch_t 0.403 (0.424)] [data_t 0.016] [optim_t 0.388] [lr 0.000850] [CE 3.378 (3.297)] [KD 0.000 (0.000)] 2024-10-12 17:41:19,789 - Train: 64.80% [243200/375300] [194.4/300.0] [batch_t 0.523 (0.440)] [data_t 0.016] [optim_t 0.507] [lr 0.000849] [CE 2.975 (3.323)] [KD 0.000 (0.000)] 2024-10-12 17:41:40,881 - Train: 64.81% [243250/375300] [194.4/300.0] [batch_t 0.446 (0.422)] [data_t 0.016] [optim_t 0.430] [lr 0.000849] [CE 2.800 (3.302)] [KD 0.000 (0.000)] 2024-10-12 17:42:02,684 - Train: 64.83% [243300/375300] [194.5/300.0] [batch_t 0.368 (0.436)] [data_t 0.072] [optim_t 0.296] [lr 0.000848] [CE 3.454 (3.281)] [KD 0.000 (0.000)] 2024-10-12 17:42:23,573 - Train: 64.84% [243350/375300] [194.5/300.0] [batch_t 0.505 (0.418)] [data_t 0.015] [optim_t 0.489] [lr 0.000847] [CE 3.222 (3.322)] [KD 0.000 (0.000)] 2024-10-12 17:42:45,407 - Train: 64.85% [243400/375300] [194.6/300.0] [batch_t 0.482 (0.437)] [data_t 0.015] [optim_t 0.467] [lr 0.000847] [CE 3.413 (3.293)] [KD 0.000 (0.000)] 2024-10-12 17:43:08,097 - Train: 64.87% [243450/375300] [194.6/300.0] [batch_t 0.447 (0.454)] [data_t 0.015] [optim_t 0.431] [lr 0.000846] [CE 2.993 (3.274)] [KD 0.000 (0.000)] 2024-10-12 17:43:29,524 - Train: 64.88% [243500/375300] [194.6/300.0] [batch_t 0.460 (0.428)] [data_t 0.015] [optim_t 0.445] [lr 0.000846] [CE 3.030 (3.312)] [KD 0.000 (0.000)] 2024-10-12 17:43:51,002 - Train: 64.89% [243550/375300] [194.7/300.0] [batch_t 0.467 (0.429)] [data_t 0.015] [optim_t 0.452] [lr 0.000845] [CE 3.376 (3.280)] [KD 0.000 (0.000)] 2024-10-12 17:44:12,284 - Train: 64.91% [243600/375300] [194.7/300.0] [batch_t 0.431 (0.426)] [data_t 0.015] [optim_t 0.416] [lr 0.000845] [CE 3.252 (3.355)] [KD 0.000 (0.000)] 2024-10-12 17:44:33,830 - Train: 64.92% [243650/375300] [194.8/300.0] [batch_t 0.443 (0.431)] [data_t 0.016] [optim_t 0.427] [lr 0.000844] [CE 3.239 (3.256)] [KD 0.000 (0.000)] 2024-10-12 17:44:55,510 - Train: 64.93% [243700/375300] [194.8/300.0] [batch_t 0.417 (0.433)] [data_t 0.015] [optim_t 0.402] [lr 0.000844] [CE 3.504 (3.301)] [KD 0.000 (0.000)] 2024-10-12 17:45:17,156 - Train: 64.95% [243750/375300] [194.8/300.0] [batch_t 0.436 (0.433)] [data_t 0.015] [optim_t 0.421] [lr 0.000843] [CE 3.048 (3.285)] [KD 0.000 (0.000)] 2024-10-12 17:45:38,332 - Train: 64.96% [243800/375300] [194.9/300.0] [batch_t 0.473 (0.423)] [data_t 0.016] [optim_t 0.458] [lr 0.000842] [CE 3.329 (3.344)] [KD 0.000 (0.000)] 2024-10-12 17:45:59,723 - Train: 64.97% [243850/375300] [194.9/300.0] [batch_t 0.384 (0.428)] [data_t 0.016] [optim_t 0.368] [lr 0.000842] [CE 3.378 (3.307)] [KD 0.000 (0.000)] 2024-10-12 17:46:21,035 - Train: 64.99% [243900/375300] [195.0/300.0] [batch_t 0.575 (0.426)] [data_t 0.015] [optim_t 0.560] [lr 0.000841] [CE 3.345 (3.312)] [KD 0.000 (0.000)] 2024-10-12 17:47:00,839 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.434)] [top1_cnt 38701] [top5_cnt 47047] [top_all 50000] 2024-10-12 17:47:00,839 - net: 77.402 (94.094) 2024-10-12 17:47:23,059 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.435)] [top1_cnt 40284] [top5_cnt 47729] [top_all 50000] 2024-10-12 17:47:23,059 - net_E: 80.568 (95.458) 2024-10-12 17:47:23,250 - Max [top1: 77.402 (epoch: 195)] [top1-ema: 80.568 (epoch: 195)] 2024-10-12 17:47:23,250 - ==> Total time: 1 day, 6:00:27 Eta: 16:09:28 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 17:47:34,551 - Train: 65.00% [243950/375300] [195.0/300.0] [batch_t 0.319 (0.610)] [data_t 0.016] [optim_t 0.303] [lr 0.000841] [CE 3.419 (3.370)] [KD 0.000 (0.000)] 2024-10-12 17:47:54,560 - Train: 65.01% [244000/375300] [195.0/300.0] [batch_t 0.463 (0.400)] [data_t 0.171] [optim_t 0.293] [lr 0.000840] [CE 3.322 (3.277)] [KD 0.000 (0.000)] 2024-10-12 17:48:16,292 - Train: 65.03% [244050/375300] [195.1/300.0] [batch_t 0.316 (0.435)] [data_t 0.016] [optim_t 0.301] [lr 0.000840] [CE 3.493 (3.292)] [KD 0.000 (0.000)] 2024-10-12 17:48:37,993 - Train: 65.04% [244100/375300] [195.1/300.0] [batch_t 0.445 (0.434)] [data_t 0.016] [optim_t 0.430] [lr 0.000839] [CE 2.762 (3.277)] [KD 0.000 (0.000)] 2024-10-12 17:48:59,892 - Train: 65.05% [244150/375300] [195.2/300.0] [batch_t 0.499 (0.438)] [data_t 0.015] [optim_t 0.484] [lr 0.000839] [CE 3.420 (3.285)] [KD 0.000 (0.000)] 2024-10-12 17:49:21,783 - Train: 65.07% [244200/375300] [195.2/300.0] [batch_t 0.379 (0.438)] [data_t 0.016] [optim_t 0.363] [lr 0.000838] [CE 3.153 (3.273)] [KD 0.000 (0.000)] 2024-10-12 17:49:43,717 - Train: 65.08% [244250/375300] [195.2/300.0] [batch_t 0.487 (0.439)] [data_t 0.016] [optim_t 0.471] [lr 0.000837] [CE 3.504 (3.286)] [KD 0.000 (0.000)] 2024-10-12 17:50:05,800 - Train: 65.09% [244300/375300] [195.3/300.0] [batch_t 0.512 (0.442)] [data_t 0.016] [optim_t 0.496] [lr 0.000837] [CE 3.400 (3.316)] [KD 0.000 (0.000)] 2024-10-12 17:50:27,350 - Train: 65.11% [244350/375300] [195.3/300.0] [batch_t 0.424 (0.431)] [data_t 0.016] [optim_t 0.409] [lr 0.000836] [CE 3.372 (3.260)] [KD 0.000 (0.000)] 2024-10-12 17:50:49,861 - Train: 65.12% [244400/375300] [195.4/300.0] [batch_t 0.445 (0.450)] [data_t 0.015] [optim_t 0.429] [lr 0.000836] [CE 3.274 (3.296)] [KD 0.000 (0.000)] 2024-10-12 17:51:12,356 - Train: 65.13% [244450/375300] [195.4/300.0] [batch_t 0.497 (0.450)] [data_t 0.015] [optim_t 0.482] [lr 0.000835] [CE 3.265 (3.282)] [KD 0.000 (0.000)] 2024-10-12 17:51:34,367 - Train: 65.15% [244500/375300] [195.4/300.0] [batch_t 0.390 (0.440)] [data_t 0.015] [optim_t 0.374] [lr 0.000835] [CE 3.298 (3.325)] [KD 0.000 (0.000)] 2024-10-12 17:51:57,087 - Train: 65.16% [244550/375300] [195.5/300.0] [batch_t 0.321 (0.454)] [data_t 0.015] [optim_t 0.306] [lr 0.000834] [CE 3.023 (3.269)] [KD 0.000 (0.000)] 2024-10-12 17:52:18,445 - Train: 65.17% [244600/375300] [195.5/300.0] [batch_t 0.437 (0.427)] [data_t 0.016] [optim_t 0.422] [lr 0.000834] [CE 3.416 (3.272)] [KD 0.000 (0.000)] 2024-10-12 17:52:39,294 - Train: 65.19% [244650/375300] [195.6/300.0] [batch_t 0.441 (0.417)] [data_t 0.016] [optim_t 0.426] [lr 0.000833] [CE 3.330 (3.312)] [KD 0.000 (0.000)] 2024-10-12 17:53:00,929 - Train: 65.20% [244700/375300] [195.6/300.0] [batch_t 0.406 (0.433)] [data_t 0.016] [optim_t 0.390] [lr 0.000832] [CE 3.045 (3.287)] [KD 0.000 (0.000)] 2024-10-12 17:53:22,854 - Train: 65.21% [244750/375300] [195.6/300.0] [batch_t 0.424 (0.438)] [data_t 0.016] [optim_t 0.408] [lr 0.000832] [CE 3.183 (3.339)] [KD 0.000 (0.000)] 2024-10-12 17:53:45,293 - Train: 65.23% [244800/375300] [195.7/300.0] [batch_t 0.452 (0.449)] [data_t 0.016] [optim_t 0.436] [lr 0.000831] [CE 2.880 (3.303)] [KD 0.000 (0.000)] 2024-10-12 17:54:07,864 - Train: 65.24% [244850/375300] [195.7/300.0] [batch_t 0.892 (0.451)] [data_t 0.016] [optim_t 0.876] [lr 0.000831] [CE 3.075 (3.283)] [KD 0.000 (0.000)] 2024-10-12 17:54:29,772 - Train: 65.25% [244900/375300] [195.8/300.0] [batch_t 0.321 (0.438)] [data_t 0.016] [optim_t 0.305] [lr 0.000830] [CE 3.081 (3.306)] [KD 0.000 (0.000)] 2024-10-12 17:54:51,004 - Train: 65.27% [244950/375300] [195.8/300.0] [batch_t 0.420 (0.425)] [data_t 0.016] [optim_t 0.404] [lr 0.000830] [CE 2.991 (3.306)] [KD 0.000 (0.000)] 2024-10-12 17:55:11,914 - Train: 65.28% [245000/375300] [195.8/300.0] [batch_t 0.495 (0.418)] [data_t 0.015] [optim_t 0.480] [lr 0.000829] [CE 3.395 (3.307)] [KD 0.000 (0.000)] 2024-10-12 17:55:33,453 - Train: 65.29% [245050/375300] [195.9/300.0] [batch_t 0.407 (0.431)] [data_t 0.015] [optim_t 0.392] [lr 0.000829] [CE 3.400 (3.262)] [KD 0.000 (0.000)] 2024-10-12 17:55:54,949 - Train: 65.31% [245100/375300] [195.9/300.0] [batch_t 0.377 (0.430)] [data_t 0.015] [optim_t 0.361] [lr 0.000828] [CE 3.281 (3.265)] [KD 0.000 (0.000)] 2024-10-12 17:56:16,815 - Train: 65.32% [245150/375300] [196.0/300.0] [batch_t 0.448 (0.437)] [data_t 0.015] [optim_t 0.433] [lr 0.000828] [CE 3.344 (3.304)] [KD 0.000 (0.000)] 2024-10-12 17:56:35,618 - ==> Total time: 1 day, 6:09:39 Eta: 16:00:13 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 17:56:43,741 - Train: 65.33% [245200/375300] [196.0/300.0] [batch_t 0.319 (1.552)] [data_t 0.016] [optim_t 0.303] [lr 0.000827] [CE 3.249 (3.188)] [KD 0.000 (0.000)] 2024-10-12 17:57:03,086 - Train: 65.35% [245250/375300] [196.0/300.0] [batch_t 0.532 (0.387)] [data_t 0.016] [optim_t 0.516] [lr 0.000826] [CE 3.546 (3.275)] [KD 0.000 (0.000)] 2024-10-12 17:57:26,045 - Train: 65.36% [245300/375300] [196.1/300.0] [batch_t 0.426 (0.459)] [data_t 0.015] [optim_t 0.410] [lr 0.000826] [CE 3.289 (3.275)] [KD 0.000 (0.000)] 2024-10-12 17:57:48,963 - Train: 65.37% [245350/375300] [196.1/300.0] [batch_t 0.428 (0.458)] [data_t 0.015] [optim_t 0.412] [lr 0.000825] [CE 3.247 (3.273)] [KD 0.000 (0.000)] 2024-10-12 17:58:11,247 - Train: 65.39% [245400/375300] [196.2/300.0] [batch_t 0.379 (0.446)] [data_t 0.016] [optim_t 0.363] [lr 0.000825] [CE 3.308 (3.256)] [KD 0.000 (0.000)] 2024-10-12 17:58:33,800 - Train: 65.40% [245450/375300] [196.2/300.0] [batch_t 0.492 (0.451)] [data_t 0.015] [optim_t 0.477] [lr 0.000824] [CE 3.240 (3.300)] [KD 0.000 (0.000)] 2024-10-12 17:58:56,161 - Train: 65.41% [245500/375300] [196.2/300.0] [batch_t 0.318 (0.447)] [data_t 0.016] [optim_t 0.301] [lr 0.000824] [CE 3.388 (3.270)] [KD 0.000 (0.000)] 2024-10-12 17:59:18,720 - Train: 65.43% [245550/375300] [196.3/300.0] [batch_t 0.456 (0.451)] [data_t 0.016] [optim_t 0.440] [lr 0.000823] [CE 3.409 (3.269)] [KD 0.000 (0.000)] 2024-10-12 17:59:40,993 - Train: 65.44% [245600/375300] [196.3/300.0] [batch_t 0.528 (0.445)] [data_t 0.015] [optim_t 0.512] [lr 0.000823] [CE 3.487 (3.317)] [KD 0.000 (0.000)] 2024-10-12 18:00:02,914 - Train: 65.45% [245650/375300] [196.4/300.0] [batch_t 0.442 (0.438)] [data_t 0.016] [optim_t 0.426] [lr 0.000822] [CE 3.269 (3.286)] [KD 0.000 (0.000)] 2024-10-12 18:00:24,990 - Train: 65.47% [245700/375300] [196.4/300.0] [batch_t 0.499 (0.441)] [data_t 0.016] [optim_t 0.483] [lr 0.000821] [CE 3.161 (3.271)] [KD 0.000 (0.000)] 2024-10-12 18:00:47,170 - Train: 65.48% [245750/375300] [196.4/300.0] [batch_t 0.528 (0.443)] [data_t 0.015] [optim_t 0.513] [lr 0.000821] [CE 3.466 (3.287)] [KD 0.000 (0.000)] 2024-10-12 18:01:09,983 - Train: 65.49% [245800/375300] [196.5/300.0] [batch_t 0.973 (0.456)] [data_t 0.016] [optim_t 0.957] [lr 0.000820] [CE 3.499 (3.324)] [KD 0.000 (0.000)] 2024-10-12 18:01:31,730 - Train: 65.51% [245850/375300] [196.5/300.0] [batch_t 0.551 (0.435)] [data_t 0.016] [optim_t 0.535] [lr 0.000820] [CE 3.131 (3.282)] [KD 0.000 (0.000)] 2024-10-12 18:01:54,270 - Train: 65.52% [245900/375300] [196.6/300.0] [batch_t 0.327 (0.451)] [data_t 0.016] [optim_t 0.312] [lr 0.000819] [CE 3.217 (3.255)] [KD 0.000 (0.000)] 2024-10-12 18:02:16,148 - Train: 65.53% [245950/375300] [196.6/300.0] [batch_t 0.426 (0.437)] [data_t 0.015] [optim_t 0.410] [lr 0.000819] [CE 3.147 (3.289)] [KD 0.000 (0.000)] 2024-10-12 18:02:38,379 - Train: 65.55% [246000/375300] [196.6/300.0] [batch_t 0.459 (0.445)] [data_t 0.015] [optim_t 0.444] [lr 0.000818] [CE 3.434 (3.254)] [KD 0.000 (0.000)] 2024-10-12 18:03:00,699 - Train: 65.56% [246050/375300] [196.7/300.0] [batch_t 0.416 (0.446)] [data_t 0.015] [optim_t 0.400] [lr 0.000818] [CE 3.430 (3.256)] [KD 0.000 (0.000)] 2024-10-12 18:03:22,727 - Train: 65.57% [246100/375300] [196.7/300.0] [batch_t 0.408 (0.440)] [data_t 0.015] [optim_t 0.392] [lr 0.000817] [CE 3.173 (3.304)] [KD 0.000 (0.000)] 2024-10-12 18:03:44,517 - Train: 65.59% [246150/375300] [196.8/300.0] [batch_t 0.394 (0.436)] [data_t 0.016] [optim_t 0.378] [lr 0.000817] [CE 3.231 (3.287)] [KD 0.000 (0.000)] 2024-10-12 18:04:06,515 - Train: 65.60% [246200/375300] [196.8/300.0] [batch_t 0.441 (0.440)] [data_t 0.015] [optim_t 0.426] [lr 0.000816] [CE 3.261 (3.297)] [KD 0.000 (0.000)] 2024-10-12 18:04:29,085 - Train: 65.61% [246250/375300] [196.8/300.0] [batch_t 0.439 (0.451)] [data_t 0.016] [optim_t 0.423] [lr 0.000815] [CE 3.500 (3.311)] [KD 0.000 (0.000)] 2024-10-12 18:04:51,844 - Train: 65.63% [246300/375300] [196.9/300.0] [batch_t 0.477 (0.455)] [data_t 0.016] [optim_t 0.462] [lr 0.000815] [CE 3.270 (3.269)] [KD 0.000 (0.000)] 2024-10-12 18:05:14,098 - Train: 65.64% [246350/375300] [196.9/300.0] [batch_t 0.466 (0.445)] [data_t 0.016] [optim_t 0.450] [lr 0.000814] [CE 3.203 (3.306)] [KD 0.000 (0.000)] 2024-10-12 18:05:35,699 - Train: 65.65% [246400/375300] [197.0/300.0] [batch_t 0.488 (0.432)] [data_t 0.016] [optim_t 0.473] [lr 0.000814] [CE 3.327 (3.297)] [KD 0.000 (0.000)] 2024-10-12 18:05:54,154 - ==> Total time: 1 day, 6:18:58 Eta: 15:51:02 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 18:06:02,256 - Train: 65.67% [246450/375300] [197.0/300.0] [batch_t 0.313 (1.988)] [data_t 0.016] [optim_t 0.297] [lr 0.000813] [CE 3.194 (3.035)] [KD 0.000 (0.000)] 2024-10-12 18:06:23,390 - Train: 65.68% [246500/375300] [197.0/300.0] [batch_t 0.411 (0.423)] [data_t 0.016] [optim_t 0.395] [lr 0.000813] [CE 3.355 (3.238)] [KD 0.000 (0.000)] 2024-10-12 18:06:46,878 - Train: 65.69% [246550/375300] [197.1/300.0] [batch_t 0.316 (0.470)] [data_t 0.016] [optim_t 0.301] [lr 0.000812] [CE 3.416 (3.286)] [KD 0.000 (0.000)] 2024-10-12 18:07:10,013 - Train: 65.71% [246600/375300] [197.1/300.0] [batch_t 0.399 (0.463)] [data_t 0.015] [optim_t 0.384] [lr 0.000812] [CE 3.174 (3.286)] [KD 0.000 (0.000)] 2024-10-12 18:07:33,579 - Train: 65.72% [246650/375300] [197.2/300.0] [batch_t 0.763 (0.471)] [data_t 0.016] [optim_t 0.747] [lr 0.000811] [CE 3.217 (3.259)] [KD 0.000 (0.000)] 2024-10-12 18:07:56,726 - Train: 65.73% [246700/375300] [197.2/300.0] [batch_t 0.451 (0.463)] [data_t 0.016] [optim_t 0.435] [lr 0.000811] [CE 2.879 (3.268)] [KD 0.000 (0.000)] 2024-10-12 18:08:19,708 - Train: 65.75% [246750/375300] [197.2/300.0] [batch_t 0.501 (0.460)] [data_t 0.016] [optim_t 0.485] [lr 0.000810] [CE 3.242 (3.289)] [KD 0.000 (0.000)] 2024-10-12 18:08:42,083 - Train: 65.76% [246800/375300] [197.3/300.0] [batch_t 0.497 (0.447)] [data_t 0.016] [optim_t 0.481] [lr 0.000809] [CE 3.179 (3.299)] [KD 0.000 (0.000)] 2024-10-12 18:09:04,378 - Train: 65.77% [246850/375300] [197.3/300.0] [batch_t 0.457 (0.446)] [data_t 0.015] [optim_t 0.442] [lr 0.000809] [CE 3.063 (3.256)] [KD 0.000 (0.000)] 2024-10-12 18:09:26,846 - Train: 65.79% [246900/375300] [197.4/300.0] [batch_t 0.427 (0.449)] [data_t 0.016] [optim_t 0.411] [lr 0.000808] [CE 3.615 (3.281)] [KD 0.000 (0.000)] 2024-10-12 18:09:49,619 - Train: 65.80% [246950/375300] [197.4/300.0] [batch_t 0.482 (0.455)] [data_t 0.016] [optim_t 0.467] [lr 0.000808] [CE 3.363 (3.266)] [KD 0.000 (0.000)] 2024-10-12 18:10:11,716 - Train: 65.81% [247000/375300] [197.4/300.0] [batch_t 0.513 (0.442)] [data_t 0.016] [optim_t 0.497] [lr 0.000807] [CE 3.250 (3.279)] [KD 0.000 (0.000)] 2024-10-12 18:10:33,237 - Train: 65.83% [247050/375300] [197.5/300.0] [batch_t 0.429 (0.430)] [data_t 0.016] [optim_t 0.413] [lr 0.000807] [CE 3.304 (3.341)] [KD 0.000 (0.000)] 2024-10-12 18:10:54,853 - Train: 65.84% [247100/375300] [197.5/300.0] [batch_t 0.483 (0.432)] [data_t 0.015] [optim_t 0.468] [lr 0.000806] [CE 3.353 (3.255)] [KD 0.000 (0.000)] 2024-10-12 18:11:16,422 - Train: 65.85% [247150/375300] [197.6/300.0] [batch_t 0.446 (0.431)] [data_t 0.015] [optim_t 0.430] [lr 0.000806] [CE 3.461 (3.253)] [KD 0.000 (0.000)] 2024-10-12 18:11:38,247 - Train: 65.87% [247200/375300] [197.6/300.0] [batch_t 0.587 (0.436)] [data_t 0.015] [optim_t 0.571] [lr 0.000805] [CE 3.310 (3.258)] [KD 0.000 (0.000)] 2024-10-12 18:12:00,154 - Train: 65.88% [247250/375300] [197.6/300.0] [batch_t 0.507 (0.438)] [data_t 0.016] [optim_t 0.491] [lr 0.000804] [CE 3.199 (3.303)] [KD 0.000 (0.000)] 2024-10-12 18:12:22,270 - Train: 65.89% [247300/375300] [197.7/300.0] [batch_t 0.487 (0.442)] [data_t 0.016] [optim_t 0.471] [lr 0.000804] [CE 3.346 (3.273)] [KD 0.000 (0.000)] 2024-10-12 18:12:44,169 - Train: 65.91% [247350/375300] [197.7/300.0] [batch_t 0.317 (0.438)] [data_t 0.015] [optim_t 0.301] [lr 0.000803] [CE 3.118 (3.325)] [KD 0.000 (0.000)] 2024-10-12 18:13:06,502 - Train: 65.92% [247400/375300] [197.8/300.0] [batch_t 0.467 (0.447)] [data_t 0.015] [optim_t 0.452] [lr 0.000803] [CE 3.457 (3.305)] [KD 0.000 (0.000)] 2024-10-12 18:13:28,719 - Train: 65.93% [247450/375300] [197.8/300.0] [batch_t 0.400 (0.444)] [data_t 0.015] [optim_t 0.385] [lr 0.000802] [CE 3.379 (3.282)] [KD 0.000 (0.000)] 2024-10-12 18:13:50,937 - Train: 65.95% [247500/375300] [197.8/300.0] [batch_t 0.450 (0.444)] [data_t 0.016] [optim_t 0.434] [lr 0.000802] [CE 3.135 (3.246)] [KD 0.000 (0.000)] 2024-10-12 18:14:12,744 - Train: 65.96% [247550/375300] [197.9/300.0] [batch_t 0.325 (0.436)] [data_t 0.015] [optim_t 0.310] [lr 0.000801] [CE 3.449 (3.307)] [KD 0.000 (0.000)] 2024-10-12 18:14:34,784 - Train: 65.97% [247600/375300] [197.9/300.0] [batch_t 0.436 (0.441)] [data_t 0.016] [optim_t 0.421] [lr 0.000801] [CE 3.255 (3.311)] [KD 0.000 (0.000)] 2024-10-12 18:14:56,664 - Train: 65.99% [247650/375300] [198.0/300.0] [batch_t 0.448 (0.437)] [data_t 0.016] [optim_t 0.432] [lr 0.000800] [CE 3.120 (3.239)] [KD 0.000 (0.000)] 2024-10-12 18:15:16,479 - ==> Total time: 1 day, 6:28:20 Eta: 15:41:52 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 18:15:24,465 - Train: 66.00% [247700/375300] [198.0/300.0] [batch_t 0.505 (3.311)] [data_t 0.015] [optim_t 0.490] [lr 0.000800] [CE 3.334 (3.316)] [KD 0.000 (0.000)] 2024-10-12 18:15:44,509 - Train: 66.01% [247750/375300] [198.0/300.0] [batch_t 0.517 (0.401)] [data_t 0.015] [optim_t 0.502] [lr 0.000799] [CE 3.327 (3.287)] [KD 0.000 (0.000)] 2024-10-12 18:16:07,129 - Train: 66.03% [247800/375300] [198.1/300.0] [batch_t 0.439 (0.452)] [data_t 0.015] [optim_t 0.424] [lr 0.000798] [CE 3.000 (3.253)] [KD 0.000 (0.000)] 2024-10-12 18:16:29,550 - Train: 66.04% [247850/375300] [198.1/300.0] [batch_t 0.487 (0.448)] [data_t 0.016] [optim_t 0.472] [lr 0.000798] [CE 3.343 (3.284)] [KD 0.000 (0.000)] 2024-10-12 18:16:51,733 - Train: 66.05% [247900/375300] [198.2/300.0] [batch_t 0.530 (0.444)] [data_t 0.015] [optim_t 0.515] [lr 0.000797] [CE 3.079 (3.307)] [KD 0.000 (0.000)] 2024-10-12 18:17:14,765 - Train: 66.07% [247950/375300] [198.2/300.0] [batch_t 0.433 (0.461)] [data_t 0.016] [optim_t 0.417] [lr 0.000797] [CE 3.446 (3.306)] [KD 0.000 (0.000)] 2024-10-12 18:17:37,435 - Train: 66.08% [248000/375300] [198.2/300.0] [batch_t 0.476 (0.453)] [data_t 0.015] [optim_t 0.460] [lr 0.000796] [CE 3.367 (3.253)] [KD 0.000 (0.000)] 2024-10-12 18:17:59,644 - Train: 66.09% [248050/375300] [198.3/300.0] [batch_t 0.438 (0.444)] [data_t 0.016] [optim_t 0.423] [lr 0.000796] [CE 3.482 (3.286)] [KD 0.000 (0.000)] 2024-10-12 18:18:22,420 - Train: 66.11% [248100/375300] [198.3/300.0] [batch_t 0.498 (0.455)] [data_t 0.016] [optim_t 0.482] [lr 0.000795] [CE 3.283 (3.283)] [KD 0.000 (0.000)] 2024-10-12 18:18:44,943 - Train: 66.12% [248150/375300] [198.4/300.0] [batch_t 0.447 (0.450)] [data_t 0.016] [optim_t 0.431] [lr 0.000795] [CE 3.114 (3.250)] [KD 0.000 (0.000)] 2024-10-12 18:19:07,218 - Train: 66.13% [248200/375300] [198.4/300.0] [batch_t 0.480 (0.445)] [data_t 0.015] [optim_t 0.465] [lr 0.000794] [CE 3.395 (3.254)] [KD 0.000 (0.000)] 2024-10-12 18:19:29,667 - Train: 66.15% [248250/375300] [198.4/300.0] [batch_t 0.490 (0.449)] [data_t 0.016] [optim_t 0.475] [lr 0.000794] [CE 3.395 (3.284)] [KD 0.000 (0.000)] 2024-10-12 18:19:52,218 - Train: 66.16% [248300/375300] [198.5/300.0] [batch_t 0.393 (0.451)] [data_t 0.016] [optim_t 0.378] [lr 0.000793] [CE 3.478 (3.293)] [KD 0.000 (0.000)] 2024-10-12 18:20:14,497 - Train: 66.17% [248350/375300] [198.5/300.0] [batch_t 0.479 (0.445)] [data_t 0.015] [optim_t 0.463] [lr 0.000793] [CE 3.227 (3.295)] [KD 0.000 (0.000)] 2024-10-12 18:20:36,642 - Train: 66.19% [248400/375300] [198.6/300.0] [batch_t 0.518 (0.443)] [data_t 0.015] [optim_t 0.503] [lr 0.000792] [CE 3.172 (3.260)] [KD 0.000 (0.000)] 2024-10-12 18:20:58,985 - Train: 66.20% [248450/375300] [198.6/300.0] [batch_t 0.454 (0.447)] [data_t 0.016] [optim_t 0.438] [lr 0.000791] [CE 3.387 (3.289)] [KD 0.000 (0.000)] 2024-10-12 18:21:21,571 - Train: 66.21% [248500/375300] [198.6/300.0] [batch_t 0.452 (0.452)] [data_t 0.015] [optim_t 0.437] [lr 0.000791] [CE 3.243 (3.265)] [KD 0.000 (0.000)] 2024-10-12 18:21:44,146 - Train: 66.23% [248550/375300] [198.7/300.0] [batch_t 0.451 (0.451)] [data_t 0.015] [optim_t 0.436] [lr 0.000790] [CE 3.275 (3.271)] [KD 0.000 (0.000)] 2024-10-12 18:22:06,384 - Train: 66.24% [248600/375300] [198.7/300.0] [batch_t 0.519 (0.445)] [data_t 0.016] [optim_t 0.503] [lr 0.000790] [CE 3.334 (3.249)] [KD 0.000 (0.000)] 2024-10-12 18:22:29,036 - Train: 66.25% [248650/375300] [198.8/300.0] [batch_t 0.435 (0.453)] [data_t 0.016] [optim_t 0.419] [lr 0.000789] [CE 3.175 (3.297)] [KD 0.000 (0.000)] 2024-10-12 18:22:52,388 - Train: 66.27% [248700/375300] [198.8/300.0] [batch_t 0.504 (0.467)] [data_t 0.016] [optim_t 0.489] [lr 0.000789] [CE 3.245 (3.298)] [KD 0.000 (0.000)] 2024-10-12 18:23:14,818 - Train: 66.28% [248750/375300] [198.8/300.0] [batch_t 0.374 (0.448)] [data_t 0.016] [optim_t 0.359] [lr 0.000788] [CE 3.331 (3.258)] [KD 0.000 (0.000)] 2024-10-12 18:23:37,017 - Train: 66.29% [248800/375300] [198.9/300.0] [batch_t 0.505 (0.444)] [data_t 0.015] [optim_t 0.490] [lr 0.000788] [CE 3.298 (3.275)] [KD 0.000 (0.000)] 2024-10-12 18:23:58,861 - Train: 66.31% [248850/375300] [198.9/300.0] [batch_t 0.487 (0.437)] [data_t 0.016] [optim_t 0.472] [lr 0.000787] [CE 3.342 (3.283)] [KD 0.000 (0.000)] 2024-10-12 18:24:20,734 - Train: 66.32% [248900/375300] [199.0/300.0] [batch_t 0.469 (0.437)] [data_t 0.016] [optim_t 0.453] [lr 0.000787] [CE 3.185 (3.302)] [KD 0.000 (0.000)] 2024-10-12 18:24:40,646 - ==> Total time: 1 day, 6:37:44 Eta: 15:32:43 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 18:24:48,151 - Train: 66.33% [248950/375300] [199.0/300.0] [batch_t 6.139 (6.139)] [data_t 3.177] [optim_t 2.962] [lr 0.000786] [CE 3.227 (3.227)] [KD 0.000 (0.000)] 2024-10-12 18:25:08,677 - Train: 66.35% [249000/375300] [199.0/300.0] [batch_t 0.315 (0.410)] [data_t 0.016] [optim_t 0.299] [lr 0.000785] [CE 3.393 (3.253)] [KD 0.000 (0.000)] 2024-10-12 18:25:31,983 - Train: 66.36% [249050/375300] [199.1/300.0] [batch_t 0.492 (0.466)] [data_t 0.016] [optim_t 0.476] [lr 0.000785] [CE 3.179 (3.273)] [KD 0.000 (0.000)] 2024-10-12 18:25:55,044 - Train: 66.37% [249100/375300] [199.1/300.0] [batch_t 0.442 (0.461)] [data_t 0.015] [optim_t 0.426] [lr 0.000784] [CE 3.526 (3.250)] [KD 0.000 (0.000)] 2024-10-12 18:26:17,397 - Train: 66.39% [249150/375300] [199.2/300.0] [batch_t 0.435 (0.447)] [data_t 0.016] [optim_t 0.419] [lr 0.000784] [CE 3.348 (3.214)] [KD 0.000 (0.000)] 2024-10-12 18:26:39,678 - Train: 66.40% [249200/375300] [199.2/300.0] [batch_t 0.419 (0.446)] [data_t 0.015] [optim_t 0.403] [lr 0.000783] [CE 3.552 (3.301)] [KD 0.000 (0.000)] 2024-10-12 18:27:01,852 - Train: 66.41% [249250/375300] [199.2/300.0] [batch_t 0.423 (0.443)] [data_t 0.015] [optim_t 0.408] [lr 0.000783] [CE 3.165 (3.287)] [KD 0.000 (0.000)] 2024-10-12 18:27:24,331 - Train: 66.43% [249300/375300] [199.3/300.0] [batch_t 0.465 (0.449)] [data_t 0.016] [optim_t 0.449] [lr 0.000782] [CE 3.220 (3.285)] [KD 0.000 (0.000)] 2024-10-12 18:27:46,721 - Train: 66.44% [249350/375300] [199.3/300.0] [batch_t 0.500 (0.448)] [data_t 0.015] [optim_t 0.484] [lr 0.000782] [CE 3.147 (3.267)] [KD 0.000 (0.000)] 2024-10-12 18:28:08,481 - Train: 66.45% [249400/375300] [199.4/300.0] [batch_t 0.490 (0.435)] [data_t 0.016] [optim_t 0.474] [lr 0.000781] [CE 3.049 (3.287)] [KD 0.000 (0.000)] 2024-10-12 18:28:30,680 - Train: 66.47% [249450/375300] [199.4/300.0] [batch_t 0.493 (0.444)] [data_t 0.015] [optim_t 0.477] [lr 0.000781] [CE 3.118 (3.286)] [KD 0.000 (0.000)] 2024-10-12 18:28:53,013 - Train: 66.48% [249500/375300] [199.4/300.0] [batch_t 0.411 (0.447)] [data_t 0.016] [optim_t 0.395] [lr 0.000780] [CE 3.040 (3.304)] [KD 0.000 (0.000)] 2024-10-12 18:29:15,361 - Train: 66.49% [249550/375300] [199.5/300.0] [batch_t 0.515 (0.447)] [data_t 0.016] [optim_t 0.500] [lr 0.000780] [CE 3.486 (3.291)] [KD 0.000 (0.000)] 2024-10-12 18:29:37,787 - Train: 66.51% [249600/375300] [199.5/300.0] [batch_t 0.445 (0.448)] [data_t 0.016] [optim_t 0.429] [lr 0.000779] [CE 3.293 (3.276)] [KD 0.000 (0.000)] 2024-10-12 18:29:59,699 - Train: 66.52% [249650/375300] [199.6/300.0] [batch_t 0.451 (0.438)] [data_t 0.016] [optim_t 0.435] [lr 0.000778] [CE 3.298 (3.249)] [KD 0.000 (0.000)] 2024-10-12 18:30:21,339 - Train: 66.53% [249700/375300] [199.6/300.0] [batch_t 0.320 (0.433)] [data_t 0.015] [optim_t 0.304] [lr 0.000778] [CE 3.289 (3.285)] [KD 0.000 (0.000)] 2024-10-12 18:30:42,447 - Train: 66.55% [249750/375300] [199.6/300.0] [batch_t 0.321 (0.422)] [data_t 0.016] [optim_t 0.306] [lr 0.000777] [CE 3.274 (3.271)] [KD 0.000 (0.000)] 2024-10-12 18:31:04,436 - Train: 66.56% [249800/375300] [199.7/300.0] [batch_t 0.363 (0.440)] [data_t 0.016] [optim_t 0.347] [lr 0.000777] [CE 3.213 (3.264)] [KD 0.000 (0.000)] 2024-10-12 18:31:26,357 - Train: 66.57% [249850/375300] [199.7/300.0] [batch_t 0.397 (0.438)] [data_t 0.016] [optim_t 0.381] [lr 0.000776] [CE 3.428 (3.313)] [KD 0.000 (0.000)] 2024-10-12 18:31:48,551 - Train: 66.59% [249900/375300] [199.8/300.0] [batch_t 0.459 (0.444)] [data_t 0.015] [optim_t 0.444] [lr 0.000776] [CE 3.477 (3.315)] [KD 0.000 (0.000)] 2024-10-12 18:32:11,023 - Train: 66.60% [249950/375300] [199.8/300.0] [batch_t 0.494 (0.449)] [data_t 0.016] [optim_t 0.478] [lr 0.000775] [CE 3.404 (3.263)] [KD 0.000 (0.000)] 2024-10-12 18:32:33,199 - Train: 66.61% [250000/375300] [199.8/300.0] [batch_t 0.547 (0.443)] [data_t 0.016] [optim_t 0.531] [lr 0.000775] [CE 3.287 (3.263)] [KD 0.000 (0.000)] 2024-10-12 18:32:55,130 - Train: 66.63% [250050/375300] [199.9/300.0] [batch_t 0.357 (0.439)] [data_t 0.016] [optim_t 0.341] [lr 0.000774] [CE 3.131 (3.319)] [KD 0.000 (0.000)] 2024-10-12 18:33:17,464 - Train: 66.64% [250100/375300] [199.9/300.0] [batch_t 0.458 (0.447)] [data_t 0.015] [optim_t 0.442] [lr 0.000774] [CE 3.358 (3.270)] [KD 0.000 (0.000)] 2024-10-12 18:33:39,895 - Train: 66.65% [250150/375300] [200.0/300.0] [batch_t 0.451 (0.449)] [data_t 0.016] [optim_t 0.436] [lr 0.000773] [CE 3.201 (3.285)] [KD 0.000 (0.000)] 2024-10-12 18:34:00,739 - Train: 66.67% [250200/375300] [200.0/300.0] [batch_t 0.309 (0.417)] [data_t 0.015] [optim_t 0.294] [lr 0.000773] [CE 3.162 (3.288)] [KD 0.000 (0.000)] 2024-10-12 18:34:23,289 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.446)] [top1_cnt 38825] [top5_cnt 47130] [top_all 50000] 2024-10-12 18:34:23,290 - net: 77.650 (94.260) 2024-10-12 18:34:45,995 - Test (net_E): 100.00% [50/50] [batch_t 0.131 (0.446)] [top1_cnt 40372] [top5_cnt 47799] [top_all 50000] 2024-10-12 18:34:45,995 - net_E: 80.744 (95.598) 2024-10-12 18:34:46,164 - Max [top1: 77.650 (epoch: 200)] [top1-ema: 80.744 (epoch: 200)] 2024-10-12 18:34:46,164 - ==> Total time: 1 day, 6:47:50 Eta: 15:23:55 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 18:35:15,621 - Train: 66.68% [250250/375300] [200.0/300.0] [batch_t 0.322 (0.452)] [data_t 0.016] [optim_t 0.306] [lr 0.000772] [CE 3.317 (3.261)] [KD 0.000 (0.000)] 2024-10-12 18:35:37,471 - Train: 66.69% [250300/375300] [200.1/300.0] [batch_t 0.389 (0.437)] [data_t 0.089] [optim_t 0.300] [lr 0.000771] [CE 3.366 (3.286)] [KD 0.000 (0.000)] 2024-10-12 18:35:59,726 - Train: 66.71% [250350/375300] [200.1/300.0] [batch_t 0.447 (0.445)] [data_t 0.016] [optim_t 0.431] [lr 0.000771] [CE 3.281 (3.278)] [KD 0.000 (0.000)] 2024-10-12 18:36:22,605 - Train: 66.72% [250400/375300] [200.2/300.0] [batch_t 0.310 (0.457)] [data_t 0.016] [optim_t 0.294] [lr 0.000770] [CE 3.496 (3.260)] [KD 0.000 (0.000)] 2024-10-12 18:36:44,303 - Train: 66.73% [250450/375300] [200.2/300.0] [batch_t 0.453 (0.434)] [data_t 0.016] [optim_t 0.438] [lr 0.000770] [CE 3.127 (3.296)] [KD 0.000 (0.000)] 2024-10-12 18:37:05,974 - Train: 66.75% [250500/375300] [200.2/300.0] [batch_t 0.489 (0.433)] [data_t 0.016] [optim_t 0.473] [lr 0.000769] [CE 3.124 (3.252)] [KD 0.000 (0.000)] 2024-10-12 18:37:28,365 - Train: 66.76% [250550/375300] [200.3/300.0] [batch_t 0.388 (0.448)] [data_t 0.015] [optim_t 0.372] [lr 0.000769] [CE 3.334 (3.249)] [KD 0.000 (0.000)] 2024-10-12 18:37:50,078 - Train: 66.77% [250600/375300] [200.3/300.0] [batch_t 0.442 (0.434)] [data_t 0.016] [optim_t 0.426] [lr 0.000768] [CE 2.972 (3.277)] [KD 0.000 (0.000)] 2024-10-12 18:38:11,701 - Train: 66.79% [250650/375300] [200.4/300.0] [batch_t 0.419 (0.432)] [data_t 0.016] [optim_t 0.403] [lr 0.000768] [CE 3.294 (3.254)] [KD 0.000 (0.000)] 2024-10-12 18:38:33,437 - Train: 66.80% [250700/375300] [200.4/300.0] [batch_t 0.422 (0.435)] [data_t 0.015] [optim_t 0.406] [lr 0.000767] [CE 3.153 (3.288)] [KD 0.000 (0.000)] 2024-10-12 18:38:55,828 - Train: 66.81% [250750/375300] [200.4/300.0] [batch_t 0.455 (0.448)] [data_t 0.158] [optim_t 0.297] [lr 0.000767] [CE 3.347 (3.256)] [KD 0.000 (0.000)] 2024-10-12 18:39:17,179 - Train: 66.83% [250800/375300] [200.5/300.0] [batch_t 0.412 (0.427)] [data_t 0.113] [optim_t 0.300] [lr 0.000766] [CE 3.016 (3.280)] [KD 0.000 (0.000)] 2024-10-12 18:39:38,802 - Train: 66.84% [250850/375300] [200.5/300.0] [batch_t 0.370 (0.432)] [data_t 0.070] [optim_t 0.299] [lr 0.000766] [CE 3.499 (3.280)] [KD 0.000 (0.000)] 2024-10-12 18:40:00,628 - Train: 66.85% [250900/375300] [200.6/300.0] [batch_t 0.419 (0.436)] [data_t 0.016] [optim_t 0.404] [lr 0.000765] [CE 3.435 (3.313)] [KD 0.000 (0.000)] 2024-10-12 18:40:22,622 - Train: 66.87% [250950/375300] [200.6/300.0] [batch_t 0.401 (0.440)] [data_t 0.106] [optim_t 0.295] [lr 0.000764] [CE 3.451 (3.236)] [KD 0.000 (0.000)] 2024-10-12 18:40:43,910 - Train: 66.88% [251000/375300] [200.6/300.0] [batch_t 0.466 (0.426)] [data_t 0.169] [optim_t 0.297] [lr 0.000764] [CE 3.551 (3.240)] [KD 0.000 (0.000)] 2024-10-12 18:41:06,210 - Train: 66.89% [251050/375300] [200.7/300.0] [batch_t 0.318 (0.446)] [data_t 0.015] [optim_t 0.302] [lr 0.000763] [CE 3.378 (3.288)] [KD 0.000 (0.000)] 2024-10-12 18:41:27,226 - Train: 66.91% [251100/375300] [200.7/300.0] [batch_t 0.408 (0.420)] [data_t 0.105] [optim_t 0.303] [lr 0.000763] [CE 2.676 (3.284)] [KD 0.000 (0.000)] 2024-10-12 18:41:48,740 - Train: 66.92% [251150/375300] [200.8/300.0] [batch_t 0.408 (0.430)] [data_t 0.016] [optim_t 0.393] [lr 0.000762] [CE 3.042 (3.270)] [KD 0.000 (0.000)] 2024-10-12 18:42:10,350 - Train: 66.93% [251200/375300] [200.8/300.0] [batch_t 0.446 (0.432)] [data_t 0.016] [optim_t 0.430] [lr 0.000762] [CE 3.368 (3.262)] [KD 0.000 (0.000)] 2024-10-12 18:42:31,729 - Train: 66.95% [251250/375300] [200.8/300.0] [batch_t 0.383 (0.427)] [data_t 0.016] [optim_t 0.367] [lr 0.000761] [CE 3.521 (3.248)] [KD 0.000 (0.000)] 2024-10-12 18:42:53,697 - Train: 66.96% [251300/375300] [200.9/300.0] [batch_t 0.460 (0.439)] [data_t 0.016] [optim_t 0.444] [lr 0.000761] [CE 3.446 (3.296)] [KD 0.000 (0.000)] 2024-10-12 18:43:15,536 - Train: 66.97% [251350/375300] [200.9/300.0] [batch_t 0.531 (0.437)] [data_t 0.016] [optim_t 0.516] [lr 0.000760] [CE 3.413 (3.243)] [KD 0.000 (0.000)] 2024-10-12 18:43:37,868 - Train: 66.99% [251400/375300] [201.0/300.0] [batch_t 0.382 (0.447)] [data_t 0.015] [optim_t 0.367] [lr 0.000760] [CE 3.488 (3.277)] [KD 0.000 (0.000)] 2024-10-12 18:43:58,322 - Train: 67.00% [251450/375300] [201.0/300.0] [batch_t 0.311 (0.409)] [data_t 0.015] [optim_t 0.295] [lr 0.000759] [CE 3.308 (3.268)] [KD 0.000 (0.000)] 2024-10-12 18:44:20,046 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.423)] [top1_cnt 38999] [top5_cnt 47147] [top_all 50000] 2024-10-12 18:44:20,047 - net: 77.998 (94.294) 2024-10-12 18:44:42,059 - Test (net_E): 100.00% [50/50] [batch_t 0.131 (0.432)] [top1_cnt 40352] [top5_cnt 47811] [top_all 50000] 2024-10-12 18:44:42,060 - net_E: 80.704 (95.622) 2024-10-12 18:44:42,244 - Max [top1: 77.998 (epoch: 201)] [top1-ema: 80.744 (epoch: 200)] 2024-10-12 18:44:42,244 - ==> Total time: 1 day, 6:57:46 Eta: 15:15:01 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 18:45:08,747 - Train: 67.01% [251500/375300] [201.0/300.0] [batch_t 0.434 (0.441)] [data_t 0.137] [optim_t 0.297] [lr 0.000759] [CE 2.935 (3.241)] [KD 0.000 (0.000)] 2024-10-12 18:45:30,517 - Train: 67.03% [251550/375300] [201.1/300.0] [batch_t 0.418 (0.435)] [data_t 0.016] [optim_t 0.403] [lr 0.000758] [CE 3.214 (3.302)] [KD 0.000 (0.000)] 2024-10-12 18:45:52,020 - Train: 67.04% [251600/375300] [201.1/300.0] [batch_t 0.426 (0.430)] [data_t 0.016] [optim_t 0.410] [lr 0.000757] [CE 3.559 (3.248)] [KD 0.000 (0.000)] 2024-10-12 18:46:13,623 - Train: 67.05% [251650/375300] [201.2/300.0] [batch_t 0.518 (0.432)] [data_t 0.015] [optim_t 0.503] [lr 0.000757] [CE 3.070 (3.201)] [KD 0.000 (0.000)] 2024-10-12 18:46:35,323 - Train: 67.07% [251700/375300] [201.2/300.0] [batch_t 0.386 (0.434)] [data_t 0.015] [optim_t 0.371] [lr 0.000756] [CE 3.334 (3.283)] [KD 0.000 (0.000)] 2024-10-12 18:46:57,538 - Train: 67.08% [251750/375300] [201.2/300.0] [batch_t 0.415 (0.444)] [data_t 0.016] [optim_t 0.399] [lr 0.000756] [CE 3.282 (3.214)] [KD 0.000 (0.000)] 2024-10-12 18:47:20,283 - Train: 67.09% [251800/375300] [201.3/300.0] [batch_t 0.314 (0.455)] [data_t 0.016] [optim_t 0.298] [lr 0.000755] [CE 3.125 (3.296)] [KD 0.000 (0.000)] 2024-10-12 18:47:42,175 - Train: 67.11% [251850/375300] [201.3/300.0] [batch_t 0.352 (0.438)] [data_t 0.016] [optim_t 0.337] [lr 0.000755] [CE 3.073 (3.301)] [KD 0.000 (0.000)] 2024-10-12 18:48:03,057 - Train: 67.12% [251900/375300] [201.4/300.0] [batch_t 0.319 (0.417)] [data_t 0.016] [optim_t 0.303] [lr 0.000754] [CE 3.371 (3.274)] [KD 0.000 (0.000)] 2024-10-12 18:48:24,518 - Train: 67.13% [251950/375300] [201.4/300.0] [batch_t 0.398 (0.429)] [data_t 0.015] [optim_t 0.383] [lr 0.000754] [CE 3.428 (3.242)] [KD 0.000 (0.000)] 2024-10-12 18:48:46,293 - Train: 67.15% [252000/375300] [201.4/300.0] [batch_t 0.461 (0.435)] [data_t 0.016] [optim_t 0.445] [lr 0.000753] [CE 3.399 (3.234)] [KD 0.000 (0.000)] 2024-10-12 18:49:08,115 - Train: 67.16% [252050/375300] [201.5/300.0] [batch_t 0.542 (0.436)] [data_t 0.016] [optim_t 0.527] [lr 0.000753] [CE 3.301 (3.293)] [KD 0.000 (0.000)] 2024-10-12 18:49:29,749 - Train: 67.17% [252100/375300] [201.5/300.0] [batch_t 0.404 (0.433)] [data_t 0.016] [optim_t 0.388] [lr 0.000752] [CE 3.432 (3.268)] [KD 0.000 (0.000)] 2024-10-12 18:49:52,322 - Train: 67.19% [252150/375300] [201.6/300.0] [batch_t 0.516 (0.451)] [data_t 0.016] [optim_t 0.500] [lr 0.000752] [CE 3.132 (3.267)] [KD 0.000 (0.000)] 2024-10-12 18:50:13,841 - Train: 67.20% [252200/375300] [201.6/300.0] [batch_t 0.476 (0.430)] [data_t 0.015] [optim_t 0.460] [lr 0.000751] [CE 3.413 (3.265)] [KD 0.000 (0.000)] 2024-10-12 18:50:34,853 - Train: 67.21% [252250/375300] [201.6/300.0] [batch_t 0.474 (0.420)] [data_t 0.015] [optim_t 0.459] [lr 0.000751] [CE 3.076 (3.282)] [KD 0.000 (0.000)] 2024-10-12 18:50:56,381 - Train: 67.23% [252300/375300] [201.7/300.0] [batch_t 0.428 (0.430)] [data_t 0.015] [optim_t 0.413] [lr 0.000750] [CE 3.333 (3.264)] [KD 0.000 (0.000)] 2024-10-12 18:51:18,205 - Train: 67.24% [252350/375300] [201.7/300.0] [batch_t 0.500 (0.436)] [data_t 0.016] [optim_t 0.485] [lr 0.000749] [CE 3.268 (3.272)] [KD 0.000 (0.000)] 2024-10-12 18:51:39,863 - Train: 67.25% [252400/375300] [201.8/300.0] [batch_t 0.462 (0.433)] [data_t 0.016] [optim_t 0.447] [lr 0.000749] [CE 3.443 (3.254)] [KD 0.000 (0.000)] 2024-10-12 18:52:01,937 - Train: 67.27% [252450/375300] [201.8/300.0] [batch_t 0.381 (0.441)] [data_t 0.016] [optim_t 0.365] [lr 0.000748] [CE 3.414 (3.276)] [KD 0.000 (0.000)] 2024-10-12 18:52:23,778 - Train: 67.28% [252500/375300] [201.8/300.0] [batch_t 0.482 (0.437)] [data_t 0.015] [optim_t 0.466] [lr 0.000748] [CE 3.137 (3.275)] [KD 0.000 (0.000)] 2024-10-12 18:52:45,806 - Train: 67.29% [252550/375300] [201.9/300.0] [batch_t 0.437 (0.440)] [data_t 0.016] [optim_t 0.421] [lr 0.000747] [CE 3.519 (3.270)] [KD 0.000 (0.000)] 2024-10-12 18:53:07,829 - Train: 67.31% [252600/375300] [201.9/300.0] [batch_t 0.461 (0.440)] [data_t 0.015] [optim_t 0.446] [lr 0.000747] [CE 3.168 (3.247)] [KD 0.000 (0.000)] 2024-10-12 18:53:29,863 - Train: 67.32% [252650/375300] [202.0/300.0] [batch_t 0.368 (0.441)] [data_t 0.016] [optim_t 0.352] [lr 0.000746] [CE 3.167 (3.226)] [KD 0.000 (0.000)] 2024-10-12 18:53:50,682 - Train: 67.33% [252700/375300] [202.0/300.0] [batch_t 0.308 (0.416)] [data_t 0.015] [optim_t 0.293] [lr 0.000746] [CE 3.144 (3.275)] [KD 0.000 (0.000)] 2024-10-12 18:54:13,064 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.429)] [top1_cnt 39017] [top5_cnt 47183] [top_all 50000] 2024-10-12 18:54:13,064 - net: 78.034 (94.366) 2024-10-12 18:54:35,566 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.441)] [top1_cnt 40395] [top5_cnt 47788] [top_all 50000] 2024-10-12 18:54:35,566 - net_E: 80.790 (95.576) 2024-10-12 18:54:35,731 - Max [top1: 78.034 (epoch: 202)] [top1-ema: 80.790 (epoch: 202)] 2024-10-12 18:54:35,731 - ==> Total time: 1 day, 7:07:39 Eta: 15:06:05 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 18:55:01,553 - Train: 67.35% [252750/375300] [202.0/300.0] [batch_t 0.323 (0.425)] [data_t 0.016] [optim_t 0.307] [lr 0.000745] [CE 3.599 (3.243)] [KD 0.000 (0.000)] 2024-10-12 18:55:23,334 - Train: 67.36% [252800/375300] [202.1/300.0] [batch_t 0.448 (0.435)] [data_t 0.016] [optim_t 0.432] [lr 0.000745] [CE 3.540 (3.270)] [KD 0.000 (0.000)] 2024-10-12 18:55:44,687 - Train: 67.37% [252850/375300] [202.1/300.0] [batch_t 0.433 (0.427)] [data_t 0.016] [optim_t 0.417] [lr 0.000744] [CE 3.301 (3.183)] [KD 0.000 (0.000)] 2024-10-12 18:56:06,937 - Train: 67.39% [252900/375300] [202.2/300.0] [batch_t 0.451 (0.445)] [data_t 0.016] [optim_t 0.435] [lr 0.000744] [CE 3.090 (3.242)] [KD 0.000 (0.000)] 2024-10-12 18:56:29,138 - Train: 67.40% [252950/375300] [202.2/300.0] [batch_t 0.389 (0.444)] [data_t 0.016] [optim_t 0.374] [lr 0.000743] [CE 3.500 (3.227)] [KD 0.000 (0.000)] 2024-10-12 18:56:51,436 - Train: 67.41% [253000/375300] [202.2/300.0] [batch_t 0.461 (0.446)] [data_t 0.015] [optim_t 0.445] [lr 0.000743] [CE 3.138 (3.273)] [KD 0.000 (0.000)] 2024-10-12 18:57:13,510 - Train: 67.43% [253050/375300] [202.3/300.0] [batch_t 0.399 (0.441)] [data_t 0.016] [optim_t 0.383] [lr 0.000742] [CE 3.336 (3.250)] [KD 0.000 (0.000)] 2024-10-12 18:57:35,461 - Train: 67.44% [253100/375300] [202.3/300.0] [batch_t 0.382 (0.439)] [data_t 0.016] [optim_t 0.366] [lr 0.000742] [CE 2.854 (3.247)] [KD 0.000 (0.000)] 2024-10-12 18:57:57,140 - Train: 67.45% [253150/375300] [202.4/300.0] [batch_t 0.474 (0.433)] [data_t 0.016] [optim_t 0.458] [lr 0.000741] [CE 3.189 (3.261)] [KD 0.000 (0.000)] 2024-10-12 18:58:18,478 - Train: 67.47% [253200/375300] [202.4/300.0] [batch_t 0.364 (0.427)] [data_t 0.015] [optim_t 0.349] [lr 0.000740] [CE 3.257 (3.229)] [KD 0.000 (0.000)] 2024-10-12 18:58:39,683 - Train: 67.48% [253250/375300] [202.4/300.0] [batch_t 0.413 (0.424)] [data_t 0.015] [optim_t 0.397] [lr 0.000740] [CE 3.092 (3.284)] [KD 0.000 (0.000)] 2024-10-12 18:59:01,530 - Train: 67.49% [253300/375300] [202.5/300.0] [batch_t 0.319 (0.437)] [data_t 0.016] [optim_t 0.304] [lr 0.000739] [CE 3.295 (3.284)] [KD 0.000 (0.000)] 2024-10-12 18:59:24,153 - Train: 67.51% [253350/375300] [202.5/300.0] [batch_t 0.380 (0.452)] [data_t 0.016] [optim_t 0.365] [lr 0.000739] [CE 3.321 (3.256)] [KD 0.000 (0.000)] 2024-10-12 18:59:46,887 - Train: 67.52% [253400/375300] [202.6/300.0] [batch_t 0.522 (0.455)] [data_t 0.016] [optim_t 0.507] [lr 0.000738] [CE 3.256 (3.263)] [KD 0.000 (0.000)] 2024-10-12 19:00:09,947 - Train: 67.53% [253450/375300] [202.6/300.0] [batch_t 0.514 (0.461)] [data_t 0.015] [optim_t 0.499] [lr 0.000738] [CE 3.671 (3.237)] [KD 0.000 (0.000)] 2024-10-12 19:00:32,806 - Train: 67.55% [253500/375300] [202.6/300.0] [batch_t 0.392 (0.457)] [data_t 0.016] [optim_t 0.377] [lr 0.000737] [CE 3.517 (3.289)] [KD 0.000 (0.000)] 2024-10-12 19:00:54,831 - Train: 67.56% [253550/375300] [202.7/300.0] [batch_t 0.441 (0.440)] [data_t 0.015] [optim_t 0.425] [lr 0.000737] [CE 3.222 (3.270)] [KD 0.000 (0.000)] 2024-10-12 19:01:16,550 - Train: 67.57% [253600/375300] [202.7/300.0] [batch_t 0.316 (0.434)] [data_t 0.015] [optim_t 0.300] [lr 0.000736] [CE 3.398 (3.211)] [KD 0.000 (0.000)] 2024-10-12 19:01:37,201 - Train: 67.59% [253650/375300] [202.8/300.0] [batch_t 0.403 (0.413)] [data_t 0.016] [optim_t 0.387] [lr 0.000736] [CE 3.179 (3.208)] [KD 0.000 (0.000)] 2024-10-12 19:01:59,582 - Train: 67.60% [253700/375300] [202.8/300.0] [batch_t 0.421 (0.447)] [data_t 0.016] [optim_t 0.405] [lr 0.000735] [CE 3.225 (3.259)] [KD 0.000 (0.000)] 2024-10-12 19:02:20,807 - Train: 67.61% [253750/375300] [202.8/300.0] [batch_t 0.319 (0.424)] [data_t 0.016] [optim_t 0.302] [lr 0.000735] [CE 3.584 (3.283)] [KD 0.000 (0.000)] 2024-10-12 19:02:42,233 - Train: 67.63% [253800/375300] [202.9/300.0] [batch_t 0.550 (0.428)] [data_t 0.016] [optim_t 0.534] [lr 0.000734] [CE 3.247 (3.254)] [KD 0.000 (0.000)] 2024-10-12 19:03:04,138 - Train: 67.64% [253850/375300] [202.9/300.0] [batch_t 0.532 (0.438)] [data_t 0.016] [optim_t 0.516] [lr 0.000734] [CE 3.090 (3.267)] [KD 0.000 (0.000)] 2024-10-12 19:03:25,407 - Train: 67.65% [253900/375300] [203.0/300.0] [batch_t 0.424 (0.425)] [data_t 0.016] [optim_t 0.408] [lr 0.000733] [CE 3.330 (3.213)] [KD 0.000 (0.000)] 2024-10-12 19:03:46,038 - Train: 67.67% [253950/375300] [203.0/300.0] [batch_t 0.315 (0.412)] [data_t 0.015] [optim_t 0.299] [lr 0.000733] [CE 3.435 (3.234)] [KD 0.000 (0.000)] 2024-10-12 19:04:09,218 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.440)] [top1_cnt 38956] [top5_cnt 47154] [top_all 50000] 2024-10-12 19:04:09,218 - net: 77.912 (94.308) 2024-10-12 19:04:31,451 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.438)] [top1_cnt 40435] [top5_cnt 47823] [top_all 50000] 2024-10-12 19:04:31,451 - net_E: 80.870 (95.646) 2024-10-12 19:04:31,700 - Max [top1: 78.034 (epoch: 202)] [top1-ema: 80.870 (epoch: 203)] 2024-10-12 19:04:31,701 - ==> Total time: 1 day, 7:17:35 Eta: 14:57:10 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 19:04:57,687 - Train: 67.68% [254000/375300] [203.0/300.0] [batch_t 0.424 (0.445)] [data_t 0.016] [optim_t 0.408] [lr 0.000732] [CE 3.359 (3.256)] [KD 0.000 (0.000)] 2024-10-12 19:05:20,591 - Train: 67.69% [254050/375300] [203.1/300.0] [batch_t 0.461 (0.458)] [data_t 0.016] [optim_t 0.445] [lr 0.000731] [CE 2.923 (3.255)] [KD 0.000 (0.000)] 2024-10-12 19:05:42,884 - Train: 67.71% [254100/375300] [203.1/300.0] [batch_t 0.437 (0.446)] [data_t 0.015] [optim_t 0.421] [lr 0.000731] [CE 3.103 (3.222)] [KD 0.000 (0.000)] 2024-10-12 19:06:05,479 - Train: 67.72% [254150/375300] [203.2/300.0] [batch_t 0.495 (0.452)] [data_t 0.016] [optim_t 0.480] [lr 0.000730] [CE 3.460 (3.255)] [KD 0.000 (0.000)] 2024-10-12 19:06:27,597 - Train: 67.73% [254200/375300] [203.2/300.0] [batch_t 0.456 (0.442)] [data_t 0.015] [optim_t 0.440] [lr 0.000730] [CE 3.279 (3.240)] [KD 0.000 (0.000)] 2024-10-12 19:06:49,561 - Train: 67.75% [254250/375300] [203.2/300.0] [batch_t 0.433 (0.439)] [data_t 0.015] [optim_t 0.417] [lr 0.000729] [CE 3.436 (3.234)] [KD 0.000 (0.000)] 2024-10-12 19:07:11,550 - Train: 67.76% [254300/375300] [203.3/300.0] [batch_t 0.466 (0.440)] [data_t 0.015] [optim_t 0.450] [lr 0.000729] [CE 3.502 (3.237)] [KD 0.000 (0.000)] 2024-10-12 19:07:33,949 - Train: 67.77% [254350/375300] [203.3/300.0] [batch_t 0.496 (0.448)] [data_t 0.016] [optim_t 0.481] [lr 0.000728] [CE 2.953 (3.275)] [KD 0.000 (0.000)] 2024-10-12 19:07:56,294 - Train: 67.79% [254400/375300] [203.4/300.0] [batch_t 0.522 (0.447)] [data_t 0.016] [optim_t 0.506] [lr 0.000728] [CE 2.989 (3.266)] [KD 0.000 (0.000)] 2024-10-12 19:08:18,454 - Train: 67.80% [254450/375300] [203.4/300.0] [batch_t 0.456 (0.443)] [data_t 0.016] [optim_t 0.440] [lr 0.000727] [CE 3.287 (3.235)] [KD 0.000 (0.000)] 2024-10-12 19:08:40,869 - Train: 67.81% [254500/375300] [203.4/300.0] [batch_t 0.451 (0.448)] [data_t 0.016] [optim_t 0.435] [lr 0.000727] [CE 3.510 (3.311)] [KD 0.000 (0.000)] 2024-10-12 19:09:04,324 - Train: 67.83% [254550/375300] [203.5/300.0] [batch_t 0.412 (0.469)] [data_t 0.016] [optim_t 0.396] [lr 0.000726] [CE 3.491 (3.275)] [KD 0.000 (0.000)] 2024-10-12 19:09:27,717 - Train: 67.84% [254600/375300] [203.5/300.0] [batch_t 0.895 (0.468)] [data_t 0.016] [optim_t 0.879] [lr 0.000726] [CE 2.995 (3.254)] [KD 0.000 (0.000)] 2024-10-12 19:09:49,954 - Train: 67.85% [254650/375300] [203.6/300.0] [batch_t 0.512 (0.445)] [data_t 0.015] [optim_t 0.496] [lr 0.000725] [CE 3.063 (3.280)] [KD 0.000 (0.000)] 2024-10-12 19:10:12,293 - Train: 67.87% [254700/375300] [203.6/300.0] [batch_t 0.483 (0.447)] [data_t 0.015] [optim_t 0.468] [lr 0.000725] [CE 3.127 (3.255)] [KD 0.000 (0.000)] 2024-10-12 19:10:34,464 - Train: 67.88% [254750/375300] [203.6/300.0] [batch_t 0.506 (0.443)] [data_t 0.015] [optim_t 0.490] [lr 0.000724] [CE 3.391 (3.205)] [KD 0.000 (0.000)] 2024-10-12 19:10:56,581 - Train: 67.89% [254800/375300] [203.7/300.0] [batch_t 0.489 (0.442)] [data_t 0.015] [optim_t 0.474] [lr 0.000724] [CE 3.576 (3.246)] [KD 0.000 (0.000)] 2024-10-12 19:11:19,010 - Train: 67.91% [254850/375300] [203.7/300.0] [batch_t 0.510 (0.448)] [data_t 0.015] [optim_t 0.495] [lr 0.000723] [CE 3.493 (3.262)] [KD 0.000 (0.000)] 2024-10-12 19:11:41,184 - Train: 67.92% [254900/375300] [203.8/300.0] [batch_t 0.482 (0.443)] [data_t 0.015] [optim_t 0.466] [lr 0.000723] [CE 3.210 (3.307)] [KD 0.000 (0.000)] 2024-10-12 19:12:03,895 - Train: 67.93% [254950/375300] [203.8/300.0] [batch_t 0.319 (0.454)] [data_t 0.015] [optim_t 0.304] [lr 0.000722] [CE 3.388 (3.233)] [KD 0.000 (0.000)] 2024-10-12 19:12:25,929 - Train: 67.95% [255000/375300] [203.8/300.0] [batch_t 0.317 (0.441)] [data_t 0.015] [optim_t 0.302] [lr 0.000721] [CE 3.457 (3.282)] [KD 0.000 (0.000)] 2024-10-12 19:12:46,670 - Train: 67.96% [255050/375300] [203.9/300.0] [batch_t 0.524 (0.415)] [data_t 0.016] [optim_t 0.508] [lr 0.000721] [CE 3.027 (3.279)] [KD 0.000 (0.000)] 2024-10-12 19:13:08,369 - Train: 67.97% [255100/375300] [203.9/300.0] [batch_t 0.446 (0.434)] [data_t 0.015] [optim_t 0.430] [lr 0.000720] [CE 3.492 (3.292)] [KD 0.000 (0.000)] 2024-10-12 19:13:30,505 - Train: 67.99% [255150/375300] [204.0/300.0] [batch_t 0.485 (0.443)] [data_t 0.015] [optim_t 0.470] [lr 0.000720] [CE 3.296 (3.320)] [KD 0.000 (0.000)] 2024-10-12 19:13:51,398 - Train: 68.00% [255200/375300] [204.0/300.0] [batch_t 0.311 (0.418)] [data_t 0.015] [optim_t 0.296] [lr 0.000719] [CE 2.923 (3.278)] [KD 0.000 (0.000)] 2024-10-12 19:14:14,365 - Test (net): 100.00% [50/50] [batch_t 0.134 (0.429)] [top1_cnt 39003] [top5_cnt 47229] [top_all 50000] 2024-10-12 19:14:14,366 - net: 78.006 (94.458) 2024-10-12 19:14:36,374 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.431)] [top1_cnt 40448] [top5_cnt 47820] [top_all 50000] 2024-10-12 19:14:36,375 - net_E: 80.896 (95.640) 2024-10-12 19:14:36,585 - Max [top1: 78.034 (epoch: 202)] [top1-ema: 80.896 (epoch: 204)] 2024-10-12 19:14:36,585 - ==> Total time: 1 day, 7:27:40 Eta: 14:48:19 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 19:15:01,802 - Train: 68.01% [255250/375300] [204.0/300.0] [batch_t 0.518 (0.441)] [data_t 0.222] [optim_t 0.296] [lr 0.000719] [CE 3.287 (3.215)] [KD 0.000 (0.000)] 2024-10-12 19:15:23,348 - Train: 68.03% [255300/375300] [204.1/300.0] [batch_t 0.408 (0.431)] [data_t 0.110] [optim_t 0.298] [lr 0.000718] [CE 3.200 (3.214)] [KD 0.000 (0.000)] 2024-10-12 19:15:44,979 - Train: 68.04% [255350/375300] [204.1/300.0] [batch_t 0.402 (0.432)] [data_t 0.106] [optim_t 0.296] [lr 0.000718] [CE 3.310 (3.252)] [KD 0.000 (0.000)] 2024-10-12 19:16:06,398 - Train: 68.05% [255400/375300] [204.2/300.0] [batch_t 0.440 (0.428)] [data_t 0.141] [optim_t 0.299] [lr 0.000717] [CE 3.441 (3.216)] [KD 0.000 (0.000)] 2024-10-12 19:16:28,055 - Train: 68.07% [255450/375300] [204.2/300.0] [batch_t 0.402 (0.433)] [data_t 0.108] [optim_t 0.294] [lr 0.000717] [CE 3.176 (3.252)] [KD 0.000 (0.000)] 2024-10-12 19:16:49,763 - Train: 68.08% [255500/375300] [204.2/300.0] [batch_t 0.369 (0.434)] [data_t 0.075] [optim_t 0.294] [lr 0.000716] [CE 3.167 (3.272)] [KD 0.000 (0.000)] 2024-10-12 19:17:11,498 - Train: 68.09% [255550/375300] [204.3/300.0] [batch_t 0.396 (0.435)] [data_t 0.095] [optim_t 0.301] [lr 0.000716] [CE 3.217 (3.247)] [KD 0.000 (0.000)] 2024-10-12 19:17:32,982 - Train: 68.11% [255600/375300] [204.3/300.0] [batch_t 0.476 (0.430)] [data_t 0.177] [optim_t 0.300] [lr 0.000715] [CE 3.387 (3.267)] [KD 0.000 (0.000)] 2024-10-12 19:17:54,645 - Train: 68.12% [255650/375300] [204.4/300.0] [batch_t 0.436 (0.433)] [data_t 0.139] [optim_t 0.297] [lr 0.000715] [CE 3.389 (3.270)] [KD 0.000 (0.000)] 2024-10-12 19:18:15,907 - Train: 68.13% [255700/375300] [204.4/300.0] [batch_t 0.501 (0.425)] [data_t 0.202] [optim_t 0.298] [lr 0.000714] [CE 3.378 (3.262)] [KD 0.000 (0.000)] 2024-10-12 19:18:37,284 - Train: 68.15% [255750/375300] [204.4/300.0] [batch_t 0.406 (0.427)] [data_t 0.103] [optim_t 0.303] [lr 0.000714] [CE 3.022 (3.234)] [KD 0.000 (0.000)] 2024-10-12 19:18:58,909 - Train: 68.16% [255800/375300] [204.5/300.0] [batch_t 0.412 (0.432)] [data_t 0.016] [optim_t 0.396] [lr 0.000713] [CE 3.323 (3.241)] [KD 0.000 (0.000)] 2024-10-12 19:19:20,849 - Train: 68.17% [255850/375300] [204.5/300.0] [batch_t 0.416 (0.439)] [data_t 0.016] [optim_t 0.400] [lr 0.000713] [CE 3.224 (3.247)] [KD 0.000 (0.000)] 2024-10-12 19:19:43,022 - Train: 68.19% [255900/375300] [204.6/300.0] [batch_t 0.319 (0.443)] [data_t 0.016] [optim_t 0.304] [lr 0.000712] [CE 3.619 (3.273)] [KD 0.000 (0.000)] 2024-10-12 19:20:04,647 - Train: 68.20% [255950/375300] [204.6/300.0] [batch_t 0.485 (0.432)] [data_t 0.016] [optim_t 0.469] [lr 0.000711] [CE 3.295 (3.242)] [KD 0.000 (0.000)] 2024-10-12 19:20:26,855 - Train: 68.21% [256000/375300] [204.6/300.0] [batch_t 0.437 (0.444)] [data_t 0.016] [optim_t 0.422] [lr 0.000711] [CE 3.312 (3.225)] [KD 0.000 (0.000)] 2024-10-12 19:20:48,307 - Train: 68.23% [256050/375300] [204.7/300.0] [batch_t 0.499 (0.429)] [data_t 0.016] [optim_t 0.483] [lr 0.000710] [CE 3.416 (3.221)] [KD 0.000 (0.000)] 2024-10-12 19:21:10,010 - Train: 68.24% [256100/375300] [204.7/300.0] [batch_t 0.452 (0.434)] [data_t 0.016] [optim_t 0.437] [lr 0.000710] [CE 3.199 (3.266)] [KD 0.000 (0.000)] 2024-10-12 19:21:32,041 - Train: 68.25% [256150/375300] [204.8/300.0] [batch_t 0.494 (0.440)] [data_t 0.016] [optim_t 0.478] [lr 0.000709] [CE 2.962 (3.201)] [KD 0.000 (0.000)] 2024-10-12 19:21:53,861 - Train: 68.27% [256200/375300] [204.8/300.0] [batch_t 0.375 (0.436)] [data_t 0.017] [optim_t 0.358] [lr 0.000709] [CE 3.101 (3.241)] [KD 0.000 (0.000)] 2024-10-12 19:22:14,868 - Train: 68.28% [256250/375300] [204.8/300.0] [batch_t 0.802 (0.420)] [data_t 0.016] [optim_t 0.787] [lr 0.000708] [CE 3.263 (3.293)] [KD 0.000 (0.000)] 2024-10-12 19:22:36,589 - Train: 68.29% [256300/375300] [204.9/300.0] [batch_t 0.354 (0.434)] [data_t 0.052] [optim_t 0.302] [lr 0.000708] [CE 3.362 (3.265)] [KD 0.000 (0.000)] 2024-10-12 19:22:58,421 - Train: 68.31% [256350/375300] [204.9/300.0] [batch_t 0.489 (0.436)] [data_t 0.187] [optim_t 0.302] [lr 0.000707] [CE 3.384 (3.238)] [KD 0.000 (0.000)] 2024-10-12 19:23:20,509 - Train: 68.32% [256400/375300] [205.0/300.0] [batch_t 0.499 (0.442)] [data_t 0.197] [optim_t 0.302] [lr 0.000707] [CE 3.019 (3.248)] [KD 0.000 (0.000)] 2024-10-12 19:23:41,080 - Train: 68.33% [256450/375300] [205.0/300.0] [batch_t 0.318 (0.411)] [data_t 0.015] [optim_t 0.302] [lr 0.000706] [CE 3.344 (3.192)] [KD 0.000 (0.000)] 2024-10-12 19:24:04,685 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.434)] [top1_cnt 39178] [top5_cnt 47210] [top_all 50000] 2024-10-12 19:24:04,686 - net: 78.356 (94.420) 2024-10-12 19:24:26,736 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.434)] [top1_cnt 40478] [top5_cnt 47851] [top_all 50000] 2024-10-12 19:24:26,737 - net_E: 80.956 (95.702) 2024-10-12 19:24:26,909 - Max [top1: 78.356 (epoch: 205)] [top1-ema: 80.956 (epoch: 205)] 2024-10-12 19:24:26,910 - ==> Total time: 1 day, 7:37:30 Eta: 14:39:20 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 19:24:53,566 - Train: 68.35% [256500/375300] [205.0/300.0] [batch_t 0.319 (0.416)] [data_t 0.016] [optim_t 0.304] [lr 0.000706] [CE 3.276 (3.212)] [KD 0.000 (0.000)] 2024-10-12 19:25:15,882 - Train: 68.36% [256550/375300] [205.1/300.0] [batch_t 0.443 (0.446)] [data_t 0.016] [optim_t 0.427] [lr 0.000705] [CE 3.363 (3.223)] [KD 0.000 (0.000)] 2024-10-12 19:25:38,403 - Train: 68.37% [256600/375300] [205.1/300.0] [batch_t 0.541 (0.450)] [data_t 0.016] [optim_t 0.525] [lr 0.000705] [CE 3.365 (3.237)] [KD 0.000 (0.000)] 2024-10-12 19:25:59,465 - Train: 68.39% [256650/375300] [205.2/300.0] [batch_t 0.410 (0.421)] [data_t 0.016] [optim_t 0.394] [lr 0.000704] [CE 3.348 (3.240)] [KD 0.000 (0.000)] 2024-10-12 19:26:20,673 - Train: 68.40% [256700/375300] [205.2/300.0] [batch_t 0.445 (0.424)] [data_t 0.015] [optim_t 0.429] [lr 0.000704] [CE 3.179 (3.225)] [KD 0.000 (0.000)] 2024-10-12 19:26:42,276 - Train: 68.41% [256750/375300] [205.2/300.0] [batch_t 0.420 (0.432)] [data_t 0.015] [optim_t 0.405] [lr 0.000703] [CE 3.443 (3.256)] [KD 0.000 (0.000)] 2024-10-12 19:27:04,527 - Train: 68.43% [256800/375300] [205.3/300.0] [batch_t 0.399 (0.445)] [data_t 0.015] [optim_t 0.383] [lr 0.000703] [CE 3.523 (3.252)] [KD 0.000 (0.000)] 2024-10-12 19:27:26,535 - Train: 68.44% [256850/375300] [205.3/300.0] [batch_t 0.420 (0.440)] [data_t 0.015] [optim_t 0.405] [lr 0.000702] [CE 3.330 (3.250)] [KD 0.000 (0.000)] 2024-10-12 19:27:48,333 - Train: 68.45% [256900/375300] [205.4/300.0] [batch_t 0.409 (0.436)] [data_t 0.115] [optim_t 0.294] [lr 0.000702] [CE 3.459 (3.212)] [KD 0.000 (0.000)] 2024-10-12 19:28:10,323 - Train: 68.47% [256950/375300] [205.4/300.0] [batch_t 0.467 (0.440)] [data_t 0.168] [optim_t 0.298] [lr 0.000701] [CE 3.357 (3.236)] [KD 0.000 (0.000)] 2024-10-12 19:28:32,062 - Train: 68.48% [257000/375300] [205.4/300.0] [batch_t 0.417 (0.435)] [data_t 0.121] [optim_t 0.296] [lr 0.000701] [CE 3.211 (3.203)] [KD 0.000 (0.000)] 2024-10-12 19:28:53,525 - Train: 68.49% [257050/375300] [205.5/300.0] [batch_t 0.445 (0.429)] [data_t 0.150] [optim_t 0.295] [lr 0.000700] [CE 3.396 (3.242)] [KD 0.000 (0.000)] 2024-10-12 19:29:14,934 - Train: 68.51% [257100/375300] [205.5/300.0] [batch_t 0.395 (0.428)] [data_t 0.098] [optim_t 0.297] [lr 0.000700] [CE 3.144 (3.240)] [KD 0.000 (0.000)] 2024-10-12 19:29:36,386 - Train: 68.52% [257150/375300] [205.6/300.0] [batch_t 0.447 (0.429)] [data_t 0.154] [optim_t 0.294] [lr 0.000699] [CE 3.522 (3.243)] [KD 0.000 (0.000)] 2024-10-12 19:29:58,940 - Train: 68.53% [257200/375300] [205.6/300.0] [batch_t 0.897 (0.451)] [data_t 0.603] [optim_t 0.294] [lr 0.000698] [CE 3.253 (3.264)] [KD 0.000 (0.000)] 2024-10-12 19:30:19,776 - Train: 68.55% [257250/375300] [205.6/300.0] [batch_t 0.485 (0.417)] [data_t 0.190] [optim_t 0.296] [lr 0.000698] [CE 3.239 (3.256)] [KD 0.000 (0.000)] 2024-10-12 19:30:41,636 - Train: 68.56% [257300/375300] [205.7/300.0] [batch_t 0.405 (0.437)] [data_t 0.106] [optim_t 0.299] [lr 0.000697] [CE 3.368 (3.232)] [KD 0.000 (0.000)] 2024-10-12 19:31:03,138 - Train: 68.57% [257350/375300] [205.7/300.0] [batch_t 0.339 (0.430)] [data_t 0.043] [optim_t 0.296] [lr 0.000697] [CE 3.146 (3.278)] [KD 0.000 (0.000)] 2024-10-12 19:31:25,191 - Train: 68.59% [257400/375300] [205.8/300.0] [batch_t 0.445 (0.441)] [data_t 0.150] [optim_t 0.295] [lr 0.000696] [CE 3.361 (3.259)] [KD 0.000 (0.000)] 2024-10-12 19:31:45,855 - Train: 68.60% [257450/375300] [205.8/300.0] [batch_t 0.419 (0.413)] [data_t 0.127] [optim_t 0.293] [lr 0.000696] [CE 3.115 (3.217)] [KD 0.000 (0.000)] 2024-10-12 19:32:06,682 - Train: 68.61% [257500/375300] [205.8/300.0] [batch_t 0.321 (0.416)] [data_t 0.016] [optim_t 0.306] [lr 0.000695] [CE 3.204 (3.267)] [KD 0.000 (0.000)] 2024-10-12 19:32:27,129 - Train: 68.63% [257550/375300] [205.9/300.0] [batch_t 0.395 (0.409)] [data_t 0.015] [optim_t 0.379] [lr 0.000695] [CE 3.473 (3.226)] [KD 0.000 (0.000)] 2024-10-12 19:32:48,294 - Train: 68.64% [257600/375300] [205.9/300.0] [batch_t 0.405 (0.423)] [data_t 0.016] [optim_t 0.390] [lr 0.000694] [CE 3.226 (3.255)] [KD 0.000 (0.000)] 2024-10-12 19:33:09,505 - Train: 68.65% [257650/375300] [206.0/300.0] [batch_t 0.380 (0.424)] [data_t 0.016] [optim_t 0.364] [lr 0.000694] [CE 3.361 (3.236)] [KD 0.000 (0.000)] 2024-10-12 19:33:30,001 - Train: 68.67% [257700/375300] [206.0/300.0] [batch_t 0.313 (0.410)] [data_t 0.015] [optim_t 0.298] [lr 0.000693] [CE 3.391 (3.240)] [KD 0.000 (0.000)] 2024-10-12 19:33:53,275 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.424)] [top1_cnt 39065] [top5_cnt 47227] [top_all 50000] 2024-10-12 19:33:53,276 - net: 78.130 (94.454) 2024-10-12 19:34:15,150 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.431)] [top1_cnt 40484] [top5_cnt 47869] [top_all 50000] 2024-10-12 19:34:15,150 - net_E: 80.968 (95.738) 2024-10-12 19:34:15,298 - Max [top1: 78.356 (epoch: 205)] [top1-ema: 80.968 (epoch: 206)] 2024-10-12 19:34:15,299 - ==> Total time: 1 day, 7:47:19 Eta: 14:30:19 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 19:34:39,411 - Train: 68.68% [257750/375300] [206.0/300.0] [batch_t 0.678 (0.449)] [data_t 0.015] [optim_t 0.662] [lr 0.000693] [CE 3.608 (3.180)] [KD 0.000 (0.000)] 2024-10-12 19:35:01,066 - Train: 68.69% [257800/375300] [206.1/300.0] [batch_t 0.482 (0.433)] [data_t 0.015] [optim_t 0.467] [lr 0.000692] [CE 3.261 (3.206)] [KD 0.000 (0.000)] 2024-10-12 19:35:22,301 - Train: 68.71% [257850/375300] [206.1/300.0] [batch_t 0.369 (0.425)] [data_t 0.015] [optim_t 0.354] [lr 0.000692] [CE 3.388 (3.249)] [KD 0.000 (0.000)] 2024-10-12 19:35:43,049 - Train: 68.72% [257900/375300] [206.2/300.0] [batch_t 0.387 (0.415)] [data_t 0.015] [optim_t 0.372] [lr 0.000691] [CE 3.291 (3.242)] [KD 0.000 (0.000)] 2024-10-12 19:36:04,153 - Train: 68.73% [257950/375300] [206.2/300.0] [batch_t 0.394 (0.422)] [data_t 0.015] [optim_t 0.378] [lr 0.000691] [CE 3.037 (3.219)] [KD 0.000 (0.000)] 2024-10-12 19:36:25,610 - Train: 68.75% [258000/375300] [206.2/300.0] [batch_t 0.320 (0.429)] [data_t 0.016] [optim_t 0.304] [lr 0.000690] [CE 3.173 (3.232)] [KD 0.000 (0.000)] 2024-10-12 19:36:47,292 - Train: 68.76% [258050/375300] [206.3/300.0] [batch_t 0.416 (0.434)] [data_t 0.015] [optim_t 0.400] [lr 0.000690] [CE 2.915 (3.219)] [KD 0.000 (0.000)] 2024-10-12 19:37:09,383 - Train: 68.77% [258100/375300] [206.3/300.0] [batch_t 0.474 (0.442)] [data_t 0.016] [optim_t 0.459] [lr 0.000689] [CE 3.422 (3.199)] [KD 0.000 (0.000)] 2024-10-12 19:37:30,677 - Train: 68.78% [258150/375300] [206.4/300.0] [batch_t 0.449 (0.426)] [data_t 0.016] [optim_t 0.434] [lr 0.000689] [CE 3.335 (3.211)] [KD 0.000 (0.000)] 2024-10-12 19:37:52,130 - Train: 68.80% [258200/375300] [206.4/300.0] [batch_t 0.503 (0.429)] [data_t 0.016] [optim_t 0.488] [lr 0.000688] [CE 3.216 (3.201)] [KD 0.000 (0.000)] 2024-10-12 19:38:14,126 - Train: 68.81% [258250/375300] [206.4/300.0] [batch_t 0.466 (0.440)] [data_t 0.016] [optim_t 0.451] [lr 0.000688] [CE 3.101 (3.218)] [KD 0.000 (0.000)] 2024-10-12 19:38:36,155 - Train: 68.82% [258300/375300] [206.5/300.0] [batch_t 0.333 (0.440)] [data_t 0.016] [optim_t 0.317] [lr 0.000687] [CE 2.989 (3.230)] [KD 0.000 (0.000)] 2024-10-12 19:38:57,155 - Train: 68.84% [258350/375300] [206.5/300.0] [batch_t 0.418 (0.420)] [data_t 0.016] [optim_t 0.402] [lr 0.000687] [CE 3.379 (3.255)] [KD 0.000 (0.000)] 2024-10-12 19:39:19,159 - Train: 68.85% [258400/375300] [206.6/300.0] [batch_t 0.480 (0.440)] [data_t 0.015] [optim_t 0.465] [lr 0.000686] [CE 2.990 (3.243)] [KD 0.000 (0.000)] 2024-10-12 19:39:41,477 - Train: 68.86% [258450/375300] [206.6/300.0] [batch_t 0.417 (0.446)] [data_t 0.015] [optim_t 0.402] [lr 0.000686] [CE 3.289 (3.206)] [KD 0.000 (0.000)] 2024-10-12 19:40:03,650 - Train: 68.88% [258500/375300] [206.6/300.0] [batch_t 0.394 (0.443)] [data_t 0.015] [optim_t 0.378] [lr 0.000685] [CE 3.347 (3.231)] [KD 0.000 (0.000)] 2024-10-12 19:40:25,871 - Train: 68.89% [258550/375300] [206.7/300.0] [batch_t 0.353 (0.444)] [data_t 0.016] [optim_t 0.337] [lr 0.000685] [CE 3.399 (3.304)] [KD 0.000 (0.000)] 2024-10-12 19:40:47,413 - Train: 68.90% [258600/375300] [206.7/300.0] [batch_t 0.433 (0.431)] [data_t 0.016] [optim_t 0.418] [lr 0.000684] [CE 3.270 (3.183)] [KD 0.000 (0.000)] 2024-10-12 19:41:09,342 - Train: 68.92% [258650/375300] [206.8/300.0] [batch_t 0.455 (0.438)] [data_t 0.016] [optim_t 0.440] [lr 0.000683] [CE 2.999 (3.241)] [KD 0.000 (0.000)] 2024-10-12 19:41:30,683 - Train: 68.93% [258700/375300] [206.8/300.0] [batch_t 0.404 (0.427)] [data_t 0.016] [optim_t 0.389] [lr 0.000683] [CE 3.157 (3.247)] [KD 0.000 (0.000)] 2024-10-12 19:41:51,924 - Train: 68.94% [258750/375300] [206.8/300.0] [batch_t 0.381 (0.425)] [data_t 0.016] [optim_t 0.365] [lr 0.000682] [CE 3.113 (3.218)] [KD 0.000 (0.000)] 2024-10-12 19:42:13,661 - Train: 68.96% [258800/375300] [206.9/300.0] [batch_t 0.452 (0.435)] [data_t 0.016] [optim_t 0.437] [lr 0.000682] [CE 3.361 (3.265)] [KD 0.000 (0.000)] 2024-10-12 19:42:35,923 - Train: 68.97% [258850/375300] [206.9/300.0] [batch_t 0.444 (0.445)] [data_t 0.015] [optim_t 0.429] [lr 0.000681] [CE 3.208 (3.196)] [KD 0.000 (0.000)] 2024-10-12 19:42:58,196 - Train: 68.98% [258900/375300] [207.0/300.0] [batch_t 0.422 (0.445)] [data_t 0.128] [optim_t 0.294] [lr 0.000681] [CE 3.019 (3.226)] [KD 0.000 (0.000)] 2024-10-12 19:43:19,759 - Train: 69.00% [258950/375300] [207.0/300.0] [batch_t 0.313 (0.431)] [data_t 0.015] [optim_t 0.297] [lr 0.000680] [CE 3.318 (3.231)] [KD 0.000 (0.000)] 2024-10-12 19:43:44,227 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.441)] [top1_cnt 38987] [top5_cnt 47162] [top_all 50000] 2024-10-12 19:43:44,228 - net: 77.974 (94.324) 2024-10-12 19:44:06,210 - Test (net_E): 100.00% [50/50] [batch_t 0.134 (0.432)] [top1_cnt 40453] [top5_cnt 47858] [top_all 50000] 2024-10-12 19:44:06,211 - net_E: 80.906 (95.716) 2024-10-12 19:44:06,367 - Max [top1: 78.356 (epoch: 205)] [top1-ema: 80.968 (epoch: 206)] 2024-10-12 19:44:06,367 - ==> Total time: 1 day, 7:57:10 Eta: 14:21:20 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 19:44:29,583 - Train: 69.01% [259000/375300] [207.0/300.0] [batch_t 0.316 (0.503)] [data_t 0.016] [optim_t 0.300] [lr 0.000680] [CE 3.296 (3.237)] [KD 0.000 (0.000)] 2024-10-12 19:44:51,184 - Train: 69.02% [259050/375300] [207.1/300.0] [batch_t 0.557 (0.432)] [data_t 0.016] [optim_t 0.542] [lr 0.000679] [CE 3.220 (3.206)] [KD 0.000 (0.000)] 2024-10-12 19:45:13,668 - Train: 69.04% [259100/375300] [207.1/300.0] [batch_t 0.312 (0.450)] [data_t 0.015] [optim_t 0.296] [lr 0.000679] [CE 3.227 (3.219)] [KD 0.000 (0.000)] 2024-10-12 19:45:36,016 - Train: 69.05% [259150/375300] [207.2/300.0] [batch_t 0.419 (0.447)] [data_t 0.015] [optim_t 0.404] [lr 0.000678] [CE 3.340 (3.195)] [KD 0.000 (0.000)] 2024-10-12 19:45:58,485 - Train: 69.06% [259200/375300] [207.2/300.0] [batch_t 0.467 (0.449)] [data_t 0.015] [optim_t 0.452] [lr 0.000678] [CE 3.203 (3.186)] [KD 0.000 (0.000)] 2024-10-12 19:46:20,545 - Train: 69.08% [259250/375300] [207.2/300.0] [batch_t 0.444 (0.441)] [data_t 0.016] [optim_t 0.428] [lr 0.000677] [CE 2.829 (3.230)] [KD 0.000 (0.000)] 2024-10-12 19:46:42,764 - Train: 69.09% [259300/375300] [207.3/300.0] [batch_t 0.443 (0.444)] [data_t 0.016] [optim_t 0.427] [lr 0.000677] [CE 3.303 (3.245)] [KD 0.000 (0.000)] 2024-10-12 19:47:04,736 - Train: 69.10% [259350/375300] [207.3/300.0] [batch_t 0.380 (0.439)] [data_t 0.016] [optim_t 0.364] [lr 0.000676] [CE 3.381 (3.246)] [KD 0.000 (0.000)] 2024-10-12 19:47:26,820 - Train: 69.12% [259400/375300] [207.4/300.0] [batch_t 0.434 (0.442)] [data_t 0.015] [optim_t 0.419] [lr 0.000676] [CE 3.471 (3.232)] [KD 0.000 (0.000)] 2024-10-12 19:47:48,642 - Train: 69.13% [259450/375300] [207.4/300.0] [batch_t 0.462 (0.436)] [data_t 0.015] [optim_t 0.447] [lr 0.000675] [CE 2.863 (3.195)] [KD 0.000 (0.000)] 2024-10-12 19:48:10,895 - Train: 69.14% [259500/375300] [207.4/300.0] [batch_t 0.450 (0.445)] [data_t 0.015] [optim_t 0.435] [lr 0.000675] [CE 3.512 (3.212)] [KD 0.000 (0.000)] 2024-10-12 19:48:32,404 - Train: 69.16% [259550/375300] [207.5/300.0] [batch_t 0.407 (0.430)] [data_t 0.015] [optim_t 0.392] [lr 0.000674] [CE 2.874 (3.231)] [KD 0.000 (0.000)] 2024-10-12 19:48:53,954 - Train: 69.17% [259600/375300] [207.5/300.0] [batch_t 0.400 (0.431)] [data_t 0.016] [optim_t 0.384] [lr 0.000674] [CE 2.917 (3.217)] [KD 0.000 (0.000)] 2024-10-12 19:49:15,748 - Train: 69.18% [259650/375300] [207.6/300.0] [batch_t 0.448 (0.436)] [data_t 0.016] [optim_t 0.433] [lr 0.000673] [CE 3.015 (3.239)] [KD 0.000 (0.000)] 2024-10-12 19:49:37,455 - Train: 69.20% [259700/375300] [207.6/300.0] [batch_t 0.373 (0.434)] [data_t 0.016] [optim_t 0.357] [lr 0.000673] [CE 3.173 (3.184)] [KD 0.000 (0.000)] 2024-10-12 19:49:58,730 - Train: 69.21% [259750/375300] [207.6/300.0] [batch_t 0.482 (0.425)] [data_t 0.015] [optim_t 0.467] [lr 0.000672] [CE 3.377 (3.228)] [KD 0.000 (0.000)] 2024-10-12 19:50:19,996 - Train: 69.22% [259800/375300] [207.7/300.0] [batch_t 0.435 (0.425)] [data_t 0.015] [optim_t 0.419] [lr 0.000672] [CE 3.012 (3.218)] [KD 0.000 (0.000)] 2024-10-12 19:50:41,316 - Train: 69.24% [259850/375300] [207.7/300.0] [batch_t 0.410 (0.426)] [data_t 0.015] [optim_t 0.395] [lr 0.000671] [CE 3.262 (3.221)] [KD 0.000 (0.000)] 2024-10-12 19:51:02,060 - Train: 69.25% [259900/375300] [207.8/300.0] [batch_t 0.436 (0.415)] [data_t 0.015] [optim_t 0.421] [lr 0.000671] [CE 3.314 (3.258)] [KD 0.000 (0.000)] 2024-10-12 19:51:24,118 - Train: 69.26% [259950/375300] [207.8/300.0] [batch_t 0.460 (0.441)] [data_t 0.015] [optim_t 0.444] [lr 0.000670] [CE 3.249 (3.240)] [KD 0.000 (0.000)] 2024-10-12 19:51:44,979 - Train: 69.28% [260000/375300] [207.8/300.0] [batch_t 0.319 (0.417)] [data_t 0.015] [optim_t 0.304] [lr 0.000670] [CE 3.466 (3.239)] [KD 0.000 (0.000)] 2024-10-12 19:52:05,770 - Train: 69.29% [260050/375300] [207.9/300.0] [batch_t 0.414 (0.416)] [data_t 0.015] [optim_t 0.398] [lr 0.000669] [CE 3.284 (3.272)] [KD 0.000 (0.000)] 2024-10-12 19:52:27,108 - Train: 69.30% [260100/375300] [207.9/300.0] [batch_t 0.507 (0.427)] [data_t 0.016] [optim_t 0.491] [lr 0.000669] [CE 3.147 (3.223)] [KD 0.000 (0.000)] 2024-10-12 19:52:49,042 - Train: 69.32% [260150/375300] [208.0/300.0] [batch_t 0.452 (0.439)] [data_t 0.015] [optim_t 0.436] [lr 0.000668] [CE 3.240 (3.240)] [KD 0.000 (0.000)] 2024-10-12 19:53:10,986 - Train: 69.33% [260200/375300] [208.0/300.0] [batch_t 0.315 (0.439)] [data_t 0.015] [optim_t 0.300] [lr 0.000668] [CE 3.246 (3.235)] [KD 0.000 (0.000)] 2024-10-12 19:53:34,963 - Test (net): 100.00% [50/50] [batch_t 0.134 (0.426)] [top1_cnt 39205] [top5_cnt 47221] [top_all 50000] 2024-10-12 19:53:34,963 - net: 78.410 (94.442) 2024-10-12 19:53:56,929 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.432)] [top1_cnt 40510] [top5_cnt 47883] [top_all 50000] 2024-10-12 19:53:56,930 - net_E: 81.020 (95.766) 2024-10-12 19:53:57,078 - Max [top1: 78.410 (epoch: 208)] [top1-ema: 81.020 (epoch: 208)] 2024-10-12 19:53:57,078 - ==> Total time: 1 day, 8:07:01 Eta: 14:12:20 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 19:54:25,974 - Train: 69.34% [260250/375300] [208.0/300.0] [batch_t 0.543 (0.433)] [data_t 0.246] [optim_t 0.298] [lr 0.000667] [CE 3.004 (3.213)] [KD 0.000 (0.000)] 2024-10-12 19:54:48,959 - Train: 69.36% [260300/375300] [208.1/300.0] [batch_t 0.962 (0.460)] [data_t 0.016] [optim_t 0.946] [lr 0.000667] [CE 3.155 (3.224)] [KD 0.000 (0.000)] 2024-10-12 19:55:10,808 - Train: 69.37% [260350/375300] [208.1/300.0] [batch_t 0.445 (0.437)] [data_t 0.015] [optim_t 0.429] [lr 0.000666] [CE 3.288 (3.257)] [KD 0.000 (0.000)] 2024-10-12 19:55:33,332 - Train: 69.38% [260400/375300] [208.2/300.0] [batch_t 0.473 (0.450)] [data_t 0.015] [optim_t 0.457] [lr 0.000666] [CE 3.302 (3.248)] [KD 0.000 (0.000)] 2024-10-12 19:55:56,074 - Train: 69.40% [260450/375300] [208.2/300.0] [batch_t 0.507 (0.455)] [data_t 0.016] [optim_t 0.492] [lr 0.000665] [CE 3.298 (3.250)] [KD 0.000 (0.000)] 2024-10-12 19:56:18,804 - Train: 69.41% [260500/375300] [208.2/300.0] [batch_t 0.502 (0.454)] [data_t 0.016] [optim_t 0.487] [lr 0.000665] [CE 3.111 (3.270)] [KD 0.000 (0.000)] 2024-10-12 19:56:41,167 - Train: 69.42% [260550/375300] [208.3/300.0] [batch_t 0.388 (0.447)] [data_t 0.015] [optim_t 0.372] [lr 0.000664] [CE 3.287 (3.244)] [KD 0.000 (0.000)] 2024-10-12 19:57:03,634 - Train: 69.44% [260600/375300] [208.3/300.0] [batch_t 0.500 (0.449)] [data_t 0.016] [optim_t 0.485] [lr 0.000664] [CE 3.128 (3.203)] [KD 0.000 (0.000)] 2024-10-12 19:57:26,230 - Train: 69.45% [260650/375300] [208.4/300.0] [batch_t 0.521 (0.452)] [data_t 0.016] [optim_t 0.505] [lr 0.000663] [CE 2.908 (3.217)] [KD 0.000 (0.000)] 2024-10-12 19:57:48,955 - Train: 69.46% [260700/375300] [208.4/300.0] [batch_t 0.461 (0.454)] [data_t 0.015] [optim_t 0.445] [lr 0.000662] [CE 2.869 (3.172)] [KD 0.000 (0.000)] 2024-10-12 19:58:11,483 - Train: 69.48% [260750/375300] [208.4/300.0] [batch_t 0.447 (0.450)] [data_t 0.015] [optim_t 0.432] [lr 0.000662] [CE 3.107 (3.246)] [KD 0.000 (0.000)] 2024-10-12 19:58:34,295 - Train: 69.49% [260800/375300] [208.5/300.0] [batch_t 0.427 (0.456)] [data_t 0.015] [optim_t 0.412] [lr 0.000661] [CE 3.265 (3.225)] [KD 0.000 (0.000)] 2024-10-12 19:58:57,152 - Train: 69.50% [260850/375300] [208.5/300.0] [batch_t 0.496 (0.457)] [data_t 0.015] [optim_t 0.481] [lr 0.000661] [CE 3.362 (3.230)] [KD 0.000 (0.000)] 2024-10-12 19:59:19,938 - Train: 69.52% [260900/375300] [208.6/300.0] [batch_t 0.437 (0.456)] [data_t 0.016] [optim_t 0.421] [lr 0.000660] [CE 3.269 (3.211)] [KD 0.000 (0.000)] 2024-10-12 19:59:42,369 - Train: 69.53% [260950/375300] [208.6/300.0] [batch_t 0.432 (0.448)] [data_t 0.015] [optim_t 0.417] [lr 0.000660] [CE 3.415 (3.192)] [KD 0.000 (0.000)] 2024-10-12 20:00:04,769 - Train: 69.54% [261000/375300] [208.6/300.0] [batch_t 0.486 (0.448)] [data_t 0.015] [optim_t 0.471] [lr 0.000659] [CE 3.130 (3.211)] [KD 0.000 (0.000)] 2024-10-12 20:00:27,981 - Train: 69.56% [261050/375300] [208.7/300.0] [batch_t 0.423 (0.464)] [data_t 0.016] [optim_t 0.407] [lr 0.000659] [CE 3.428 (3.239)] [KD 0.000 (0.000)] 2024-10-12 20:00:51,005 - Train: 69.57% [261100/375300] [208.7/300.0] [batch_t 0.456 (0.460)] [data_t 0.015] [optim_t 0.441] [lr 0.000658] [CE 3.303 (3.188)] [KD 0.000 (0.000)] 2024-10-12 20:01:13,283 - Train: 69.58% [261150/375300] [208.8/300.0] [batch_t 0.434 (0.445)] [data_t 0.015] [optim_t 0.418] [lr 0.000658] [CE 3.133 (3.242)] [KD 0.000 (0.000)] 2024-10-12 20:01:35,253 - Train: 69.60% [261200/375300] [208.8/300.0] [batch_t 0.447 (0.439)] [data_t 0.015] [optim_t 0.432] [lr 0.000657] [CE 3.368 (3.203)] [KD 0.000 (0.000)] 2024-10-12 20:01:56,118 - Train: 69.61% [261250/375300] [208.8/300.0] [batch_t 0.421 (0.417)] [data_t 0.016] [optim_t 0.406] [lr 0.000657] [CE 3.408 (3.196)] [KD 0.000 (0.000)] 2024-10-12 20:02:17,513 - Train: 69.62% [261300/375300] [208.9/300.0] [batch_t 0.317 (0.428)] [data_t 0.015] [optim_t 0.301] [lr 0.000656] [CE 3.220 (3.266)] [KD 0.000 (0.000)] 2024-10-12 20:02:39,767 - Train: 69.64% [261350/375300] [208.9/300.0] [batch_t 0.439 (0.445)] [data_t 0.137] [optim_t 0.301] [lr 0.000656] [CE 3.070 (3.183)] [KD 0.000 (0.000)] 2024-10-12 20:03:02,860 - Train: 69.65% [261400/375300] [209.0/300.0] [batch_t 0.523 (0.462)] [data_t 0.227] [optim_t 0.296] [lr 0.000655] [CE 3.360 (3.210)] [KD 0.000 (0.000)] 2024-10-12 20:03:25,166 - Train: 69.66% [261450/375300] [209.0/300.0] [batch_t 0.315 (0.446)] [data_t 0.015] [optim_t 0.300] [lr 0.000655] [CE 3.716 (3.237)] [KD 0.000 (0.000)] 2024-10-12 20:03:49,669 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.430)] [top1_cnt 39282] [top5_cnt 47279] [top_all 50000] 2024-10-12 20:03:49,670 - net: 78.564 (94.558) 2024-10-12 20:04:11,458 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.430)] [top1_cnt 40534] [top5_cnt 47893] [top_all 50000] 2024-10-12 20:04:11,459 - net_E: 81.068 (95.786) 2024-10-12 20:04:11,637 - Max [top1: 78.564 (epoch: 209)] [top1-ema: 81.068 (epoch: 209)] 2024-10-12 20:04:11,638 - ==> Total time: 1 day, 8:17:15 Eta: 14:03:29 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 20:04:36,267 - Train: 69.68% [261500/375300] [209.0/300.0] [batch_t 0.500 (0.421)] [data_t 0.016] [optim_t 0.484] [lr 0.000654] [CE 3.118 (3.236)] [KD 0.000 (0.000)] 2024-10-12 20:04:58,921 - Train: 69.69% [261550/375300] [209.1/300.0] [batch_t 0.427 (0.453)] [data_t 0.016] [optim_t 0.411] [lr 0.000654] [CE 3.076 (3.230)] [KD 0.000 (0.000)] 2024-10-12 20:05:20,896 - Train: 69.70% [261600/375300] [209.1/300.0] [batch_t 0.316 (0.439)] [data_t 0.016] [optim_t 0.300] [lr 0.000653] [CE 3.061 (3.199)] [KD 0.000 (0.000)] 2024-10-12 20:05:42,116 - Train: 69.72% [261650/375300] [209.2/300.0] [batch_t 0.473 (0.424)] [data_t 0.016] [optim_t 0.457] [lr 0.000653] [CE 3.318 (3.233)] [KD 0.000 (0.000)] 2024-10-12 20:06:04,533 - Train: 69.73% [261700/375300] [209.2/300.0] [batch_t 0.477 (0.448)] [data_t 0.016] [optim_t 0.461] [lr 0.000652] [CE 2.824 (3.207)] [KD 0.000 (0.000)] 2024-10-12 20:06:26,933 - Train: 69.74% [261750/375300] [209.2/300.0] [batch_t 0.465 (0.448)] [data_t 0.015] [optim_t 0.449] [lr 0.000652] [CE 3.293 (3.194)] [KD 0.000 (0.000)] 2024-10-12 20:06:49,160 - Train: 69.76% [261800/375300] [209.3/300.0] [batch_t 0.454 (0.444)] [data_t 0.016] [optim_t 0.439] [lr 0.000651] [CE 3.258 (3.214)] [KD 0.000 (0.000)] 2024-10-12 20:07:11,427 - Train: 69.77% [261850/375300] [209.3/300.0] [batch_t 0.432 (0.445)] [data_t 0.016] [optim_t 0.416] [lr 0.000651] [CE 3.112 (3.235)] [KD 0.000 (0.000)] 2024-10-12 20:07:33,594 - Train: 69.78% [261900/375300] [209.4/300.0] [batch_t 0.413 (0.443)] [data_t 0.016] [optim_t 0.397] [lr 0.000650] [CE 3.035 (3.201)] [KD 0.000 (0.000)] 2024-10-12 20:07:55,337 - Train: 69.80% [261950/375300] [209.4/300.0] [batch_t 0.313 (0.435)] [data_t 0.015] [optim_t 0.298] [lr 0.000650] [CE 3.330 (3.219)] [KD 0.000 (0.000)] 2024-10-12 20:08:17,288 - Train: 69.81% [262000/375300] [209.4/300.0] [batch_t 0.515 (0.439)] [data_t 0.015] [optim_t 0.500] [lr 0.000649] [CE 3.069 (3.204)] [KD 0.000 (0.000)] 2024-10-12 20:08:38,670 - Train: 69.82% [262050/375300] [209.5/300.0] [batch_t 0.403 (0.428)] [data_t 0.015] [optim_t 0.387] [lr 0.000649] [CE 3.485 (3.262)] [KD 0.000 (0.000)] 2024-10-12 20:08:59,248 - Train: 69.84% [262100/375300] [209.5/300.0] [batch_t 0.449 (0.411)] [data_t 0.016] [optim_t 0.434] [lr 0.000648] [CE 3.299 (3.223)] [KD 0.000 (0.000)] 2024-10-12 20:09:21,719 - Train: 69.85% [262150/375300] [209.6/300.0] [batch_t 0.451 (0.449)] [data_t 0.016] [optim_t 0.435] [lr 0.000648] [CE 3.394 (3.251)] [KD 0.000 (0.000)] 2024-10-12 20:09:44,396 - Train: 69.86% [262200/375300] [209.6/300.0] [batch_t 0.407 (0.453)] [data_t 0.016] [optim_t 0.392] [lr 0.000647] [CE 3.095 (3.227)] [KD 0.000 (0.000)] 2024-10-12 20:10:06,596 - Train: 69.88% [262250/375300] [209.6/300.0] [batch_t 0.414 (0.444)] [data_t 0.015] [optim_t 0.399] [lr 0.000647] [CE 3.150 (3.210)] [KD 0.000 (0.000)] 2024-10-12 20:10:27,524 - Train: 69.89% [262300/375300] [209.7/300.0] [batch_t 0.439 (0.418)] [data_t 0.016] [optim_t 0.424] [lr 0.000646] [CE 3.253 (3.263)] [KD 0.000 (0.000)] 2024-10-12 20:10:49,212 - Train: 69.90% [262350/375300] [209.7/300.0] [batch_t 0.431 (0.434)] [data_t 0.015] [optim_t 0.416] [lr 0.000646] [CE 3.360 (3.281)] [KD 0.000 (0.000)] 2024-10-12 20:11:10,425 - Train: 69.92% [262400/375300] [209.8/300.0] [batch_t 0.404 (0.424)] [data_t 0.015] [optim_t 0.388] [lr 0.000645] [CE 3.111 (3.214)] [KD 0.000 (0.000)] 2024-10-12 20:11:31,581 - Train: 69.93% [262450/375300] [209.8/300.0] [batch_t 0.446 (0.423)] [data_t 0.015] [optim_t 0.430] [lr 0.000645] [CE 3.370 (3.253)] [KD 0.000 (0.000)] 2024-10-12 20:11:53,260 - Train: 69.94% [262500/375300] [209.8/300.0] [batch_t 0.379 (0.433)] [data_t 0.016] [optim_t 0.364] [lr 0.000644] [CE 2.982 (3.234)] [KD 0.000 (0.000)] 2024-10-12 20:12:15,499 - Train: 69.96% [262550/375300] [209.9/300.0] [batch_t 0.429 (0.445)] [data_t 0.015] [optim_t 0.413] [lr 0.000644] [CE 3.041 (3.247)] [KD 0.000 (0.000)] 2024-10-12 20:12:37,531 - Train: 69.97% [262600/375300] [209.9/300.0] [batch_t 0.349 (0.441)] [data_t 0.016] [optim_t 0.334] [lr 0.000643] [CE 3.181 (3.168)] [KD 0.000 (0.000)] 2024-10-12 20:12:58,227 - Train: 69.98% [262650/375300] [210.0/300.0] [batch_t 0.384 (0.414)] [data_t 0.016] [optim_t 0.368] [lr 0.000643] [CE 3.321 (3.243)] [KD 0.000 (0.000)] 2024-10-12 20:13:18,803 - Train: 70.00% [262700/375300] [210.0/300.0] [batch_t 0.314 (0.411)] [data_t 0.015] [optim_t 0.299] [lr 0.000642] [CE 3.020 (3.261)] [KD 0.000 (0.000)] 2024-10-12 20:13:43,800 - Test (net): 100.00% [50/50] [batch_t 0.171 (0.431)] [top1_cnt 39241] [top5_cnt 47318] [top_all 50000] 2024-10-12 20:13:43,800 - net: 78.482 (94.636) 2024-10-12 20:14:06,378 - Test (net_E): 100.00% [50/50] [batch_t 0.149 (0.445)] [top1_cnt 40564] [top5_cnt 47878] [top_all 50000] 2024-10-12 20:14:06,378 - net_E: 81.128 (95.756) 2024-10-12 20:14:06,535 - Max [top1: 78.564 (epoch: 209)] [top1-ema: 81.128 (epoch: 210)] 2024-10-12 20:14:06,535 - ==> Total time: 1 day, 8:27:10 Eta: 13:54:30 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 20:14:29,392 - Train: 70.01% [262750/375300] [210.0/300.0] [batch_t 0.313 (0.445)] [data_t 0.015] [optim_t 0.298] [lr 0.000642] [CE 3.333 (3.173)] [KD 0.000 (0.000)] 2024-10-12 20:14:52,011 - Train: 70.02% [262800/375300] [210.1/300.0] [batch_t 0.477 (0.452)] [data_t 0.015] [optim_t 0.462] [lr 0.000641] [CE 3.389 (3.177)] [KD 0.000 (0.000)] 2024-10-12 20:15:15,072 - Train: 70.04% [262850/375300] [210.1/300.0] [batch_t 0.471 (0.461)] [data_t 0.015] [optim_t 0.455] [lr 0.000641] [CE 3.093 (3.212)] [KD 0.000 (0.000)] 2024-10-12 20:15:37,602 - Train: 70.05% [262900/375300] [210.2/300.0] [batch_t 0.427 (0.451)] [data_t 0.015] [optim_t 0.412] [lr 0.000640] [CE 2.988 (3.175)] [KD 0.000 (0.000)] 2024-10-12 20:15:59,948 - Train: 70.06% [262950/375300] [210.2/300.0] [batch_t 0.496 (0.447)] [data_t 0.015] [optim_t 0.480] [lr 0.000640] [CE 3.441 (3.230)] [KD 0.000 (0.000)] 2024-10-12 20:16:21,194 - Train: 70.08% [263000/375300] [210.2/300.0] [batch_t 0.469 (0.425)] [data_t 0.016] [optim_t 0.454] [lr 0.000639] [CE 3.139 (3.247)] [KD 0.000 (0.000)] 2024-10-12 20:16:43,592 - Train: 70.09% [263050/375300] [210.3/300.0] [batch_t 0.391 (0.448)] [data_t 0.016] [optim_t 0.376] [lr 0.000639] [CE 3.099 (3.217)] [KD 0.000 (0.000)] 2024-10-12 20:17:05,757 - Train: 70.10% [263100/375300] [210.3/300.0] [batch_t 0.378 (0.443)] [data_t 0.016] [optim_t 0.362] [lr 0.000638] [CE 3.373 (3.202)] [KD 0.000 (0.000)] 2024-10-12 20:17:27,978 - Train: 70.12% [263150/375300] [210.4/300.0] [batch_t 0.414 (0.444)] [data_t 0.016] [optim_t 0.398] [lr 0.000638] [CE 3.303 (3.201)] [KD 0.000 (0.000)] 2024-10-12 20:17:49,980 - Train: 70.13% [263200/375300] [210.4/300.0] [batch_t 0.427 (0.440)] [data_t 0.016] [optim_t 0.411] [lr 0.000637] [CE 3.444 (3.248)] [KD 0.000 (0.000)] 2024-10-12 20:18:11,152 - Train: 70.14% [263250/375300] [210.4/300.0] [batch_t 0.459 (0.423)] [data_t 0.016] [optim_t 0.443] [lr 0.000637] [CE 2.666 (3.146)] [KD 0.000 (0.000)] 2024-10-12 20:18:32,746 - Train: 70.16% [263300/375300] [210.5/300.0] [batch_t 0.317 (0.432)] [data_t 0.016] [optim_t 0.302] [lr 0.000636] [CE 3.294 (3.228)] [KD 0.000 (0.000)] 2024-10-12 20:18:54,364 - Train: 70.17% [263350/375300] [210.5/300.0] [batch_t 0.349 (0.432)] [data_t 0.015] [optim_t 0.334] [lr 0.000636] [CE 3.201 (3.160)] [KD 0.000 (0.000)] 2024-10-12 20:19:16,798 - Train: 70.18% [263400/375300] [210.6/300.0] [batch_t 0.916 (0.449)] [data_t 0.015] [optim_t 0.901] [lr 0.000635] [CE 3.178 (3.206)] [KD 0.000 (0.000)] 2024-10-12 20:19:38,294 - Train: 70.20% [263450/375300] [210.6/300.0] [batch_t 0.319 (0.430)] [data_t 0.016] [optim_t 0.303] [lr 0.000635] [CE 3.131 (3.215)] [KD 0.000 (0.000)] 2024-10-12 20:20:00,098 - Train: 70.21% [263500/375300] [210.6/300.0] [batch_t 0.489 (0.436)] [data_t 0.015] [optim_t 0.474] [lr 0.000634] [CE 3.197 (3.193)] [KD 0.000 (0.000)] 2024-10-12 20:20:21,768 - Train: 70.22% [263550/375300] [210.7/300.0] [batch_t 0.413 (0.433)] [data_t 0.015] [optim_t 0.398] [lr 0.000634] [CE 3.065 (3.220)] [KD 0.000 (0.000)] 2024-10-12 20:20:43,360 - Train: 70.24% [263600/375300] [210.7/300.0] [batch_t 0.517 (0.432)] [data_t 0.015] [optim_t 0.502] [lr 0.000633] [CE 3.045 (3.213)] [KD 0.000 (0.000)] 2024-10-12 20:21:05,126 - Train: 70.25% [263650/375300] [210.8/300.0] [batch_t 0.446 (0.435)] [data_t 0.016] [optim_t 0.430] [lr 0.000633] [CE 3.200 (3.214)] [KD 0.000 (0.000)] 2024-10-12 20:21:27,383 - Train: 70.26% [263700/375300] [210.8/300.0] [batch_t 0.442 (0.445)] [data_t 0.016] [optim_t 0.427] [lr 0.000632] [CE 3.030 (3.188)] [KD 0.000 (0.000)] 2024-10-12 20:21:49,533 - Train: 70.28% [263750/375300] [210.8/300.0] [batch_t 0.361 (0.443)] [data_t 0.015] [optim_t 0.346] [lr 0.000632] [CE 3.148 (3.195)] [KD 0.000 (0.000)] 2024-10-12 20:22:11,655 - Train: 70.29% [263800/375300] [210.9/300.0] [batch_t 0.431 (0.442)] [data_t 0.015] [optim_t 0.416] [lr 0.000631] [CE 3.477 (3.199)] [KD 0.000 (0.000)] 2024-10-12 20:22:33,381 - Train: 70.30% [263850/375300] [210.9/300.0] [batch_t 0.317 (0.434)] [data_t 0.015] [optim_t 0.302] [lr 0.000631] [CE 3.123 (3.224)] [KD 0.000 (0.000)] 2024-10-12 20:22:55,171 - Train: 70.32% [263900/375300] [211.0/300.0] [batch_t 0.442 (0.436)] [data_t 0.016] [optim_t 0.427] [lr 0.000630] [CE 3.232 (3.212)] [KD 0.000 (0.000)] 2024-10-12 20:23:17,078 - Train: 70.33% [263950/375300] [211.0/300.0] [batch_t 0.313 (0.438)] [data_t 0.015] [optim_t 0.298] [lr 0.000630] [CE 3.191 (3.218)] [KD 0.000 (0.000)] 2024-10-12 20:23:43,205 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.447)] [top1_cnt 39303] [top5_cnt 47277] [top_all 50000] 2024-10-12 20:23:43,206 - net: 78.606 (94.554) 2024-10-12 20:24:05,515 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.438)] [top1_cnt 40585] [top5_cnt 47907] [top_all 50000] 2024-10-12 20:24:05,515 - net_E: 81.170 (95.814) 2024-10-12 20:24:05,655 - Max [top1: 78.606 (epoch: 211)] [top1-ema: 81.170 (epoch: 211)] 2024-10-12 20:24:05,656 - ==> Total time: 1 day, 8:37:09 Eta: 13:45:31 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 20:24:30,226 - Train: 70.34% [264000/375300] [211.0/300.0] [batch_t 0.517 (0.445)] [data_t 0.222] [optim_t 0.295] [lr 0.000629] [CE 3.271 (3.135)] [KD 0.000 (0.000)] 2024-10-12 20:24:51,417 - Train: 70.36% [264050/375300] [211.1/300.0] [batch_t 0.461 (0.424)] [data_t 0.167] [optim_t 0.295] [lr 0.000629] [CE 3.482 (3.186)] [KD 0.000 (0.000)] 2024-10-12 20:25:13,191 - Train: 70.37% [264100/375300] [211.1/300.0] [batch_t 0.462 (0.435)] [data_t 0.167] [optim_t 0.296] [lr 0.000628] [CE 3.120 (3.236)] [KD 0.000 (0.000)] 2024-10-12 20:25:35,590 - Train: 70.38% [264150/375300] [211.2/300.0] [batch_t 0.405 (0.448)] [data_t 0.015] [optim_t 0.390] [lr 0.000628] [CE 3.424 (3.246)] [KD 0.000 (0.000)] 2024-10-12 20:25:57,761 - Train: 70.40% [264200/375300] [211.2/300.0] [batch_t 0.418 (0.443)] [data_t 0.016] [optim_t 0.402] [lr 0.000627] [CE 3.186 (3.182)] [KD 0.000 (0.000)] 2024-10-12 20:26:19,608 - Train: 70.41% [264250/375300] [211.2/300.0] [batch_t 0.314 (0.437)] [data_t 0.015] [optim_t 0.298] [lr 0.000627] [CE 3.077 (3.202)] [KD 0.000 (0.000)] 2024-10-12 20:26:41,189 - Train: 70.42% [264300/375300] [211.3/300.0] [batch_t 0.371 (0.431)] [data_t 0.015] [optim_t 0.356] [lr 0.000626] [CE 3.072 (3.194)] [KD 0.000 (0.000)] 2024-10-12 20:27:03,055 - Train: 70.44% [264350/375300] [211.3/300.0] [batch_t 0.346 (0.437)] [data_t 0.016] [optim_t 0.331] [lr 0.000626] [CE 3.373 (3.200)] [KD 0.000 (0.000)] 2024-10-12 20:27:24,330 - Train: 70.45% [264400/375300] [211.4/300.0] [batch_t 0.411 (0.425)] [data_t 0.016] [optim_t 0.395] [lr 0.000625] [CE 3.173 (3.153)] [KD 0.000 (0.000)] 2024-10-12 20:27:45,948 - Train: 70.46% [264450/375300] [211.4/300.0] [batch_t 0.420 (0.432)] [data_t 0.016] [optim_t 0.405] [lr 0.000625] [CE 3.248 (3.204)] [KD 0.000 (0.000)] 2024-10-12 20:28:08,038 - Train: 70.48% [264500/375300] [211.4/300.0] [batch_t 0.460 (0.442)] [data_t 0.015] [optim_t 0.444] [lr 0.000624] [CE 3.187 (3.191)] [KD 0.000 (0.000)] 2024-10-12 20:28:30,140 - Train: 70.49% [264550/375300] [211.5/300.0] [batch_t 0.424 (0.442)] [data_t 0.015] [optim_t 0.409] [lr 0.000624] [CE 3.289 (3.196)] [KD 0.000 (0.000)] 2024-10-12 20:28:51,635 - Train: 70.50% [264600/375300] [211.5/300.0] [batch_t 0.476 (0.430)] [data_t 0.015] [optim_t 0.461] [lr 0.000623] [CE 3.151 (3.174)] [KD 0.000 (0.000)] 2024-10-12 20:29:13,708 - Train: 70.52% [264650/375300] [211.6/300.0] [batch_t 0.524 (0.441)] [data_t 0.016] [optim_t 0.509] [lr 0.000623] [CE 3.240 (3.200)] [KD 0.000 (0.000)] 2024-10-12 20:29:35,543 - Train: 70.53% [264700/375300] [211.6/300.0] [batch_t 0.432 (0.437)] [data_t 0.015] [optim_t 0.417] [lr 0.000622] [CE 3.244 (3.202)] [KD 0.000 (0.000)] 2024-10-12 20:29:56,923 - Train: 70.54% [264750/375300] [211.6/300.0] [batch_t 0.452 (0.427)] [data_t 0.016] [optim_t 0.437] [lr 0.000622] [CE 3.355 (3.201)] [KD 0.000 (0.000)] 2024-10-12 20:30:18,392 - Train: 70.56% [264800/375300] [211.7/300.0] [batch_t 0.426 (0.429)] [data_t 0.126] [optim_t 0.300] [lr 0.000621] [CE 3.279 (3.209)] [KD 0.000 (0.000)] 2024-10-12 20:30:40,073 - Train: 70.57% [264850/375300] [211.7/300.0] [batch_t 0.420 (0.433)] [data_t 0.016] [optim_t 0.404] [lr 0.000621] [CE 3.295 (3.201)] [KD 0.000 (0.000)] 2024-10-12 20:31:01,784 - Train: 70.58% [264900/375300] [211.8/300.0] [batch_t 0.416 (0.434)] [data_t 0.016] [optim_t 0.400] [lr 0.000620] [CE 3.169 (3.214)] [KD 0.000 (0.000)] 2024-10-12 20:31:22,855 - Train: 70.60% [264950/375300] [211.8/300.0] [batch_t 0.327 (0.421)] [data_t 0.016] [optim_t 0.312] [lr 0.000620] [CE 3.241 (3.219)] [KD 0.000 (0.000)] 2024-10-12 20:31:44,021 - Train: 70.61% [265000/375300] [211.8/300.0] [batch_t 0.322 (0.423)] [data_t 0.015] [optim_t 0.306] [lr 0.000619] [CE 3.209 (3.245)] [KD 0.000 (0.000)] 2024-10-12 20:32:05,009 - Train: 70.62% [265050/375300] [211.9/300.0] [batch_t 0.403 (0.420)] [data_t 0.016] [optim_t 0.387] [lr 0.000619] [CE 3.308 (3.214)] [KD 0.000 (0.000)] 2024-10-12 20:32:26,315 - Train: 70.64% [265100/375300] [211.9/300.0] [batch_t 0.388 (0.426)] [data_t 0.015] [optim_t 0.373] [lr 0.000618] [CE 3.225 (3.263)] [KD 0.000 (0.000)] 2024-10-12 20:32:47,936 - Train: 70.65% [265150/375300] [212.0/300.0] [batch_t 0.377 (0.432)] [data_t 0.016] [optim_t 0.361] [lr 0.000618] [CE 3.171 (3.229)] [KD 0.000 (0.000)] 2024-10-12 20:33:09,357 - Train: 70.66% [265200/375300] [212.0/300.0] [batch_t 0.430 (0.428)] [data_t 0.015] [optim_t 0.415] [lr 0.000617] [CE 3.042 (3.207)] [KD 0.000 (0.000)] 2024-10-12 20:33:35,229 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.437)] [top1_cnt 39243] [top5_cnt 47350] [top_all 50000] 2024-10-12 20:33:35,230 - net: 78.486 (94.700) 2024-10-12 20:33:57,161 - Test (net_E): 100.00% [50/50] [batch_t 0.172 (0.430)] [top1_cnt 40607] [top5_cnt 47897] [top_all 50000] 2024-10-12 20:33:57,161 - net_E: 81.214 (95.794) 2024-10-12 20:33:57,355 - Max [top1: 78.606 (epoch: 211)] [top1-ema: 81.214 (epoch: 212)] 2024-10-12 20:33:57,355 - ==> Total time: 1 day, 8:47:01 Eta: 13:36:29 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 20:34:19,584 - Train: 70.68% [265250/375300] [212.0/300.0] [batch_t 0.309 (0.449)] [data_t 0.015] [optim_t 0.294] [lr 0.000617] [CE 3.371 (3.177)] [KD 0.000 (0.000)] 2024-10-12 20:34:42,261 - Train: 70.69% [265300/375300] [212.1/300.0] [batch_t 0.458 (0.453)] [data_t 0.016] [optim_t 0.442] [lr 0.000616] [CE 2.981 (3.171)] [KD 0.000 (0.000)] 2024-10-12 20:35:04,972 - Train: 70.70% [265350/375300] [212.1/300.0] [batch_t 0.545 (0.454)] [data_t 0.016] [optim_t 0.530] [lr 0.000616] [CE 2.868 (3.186)] [KD 0.000 (0.000)] 2024-10-12 20:35:27,478 - Train: 70.72% [265400/375300] [212.2/300.0] [batch_t 0.509 (0.450)] [data_t 0.015] [optim_t 0.493] [lr 0.000615] [CE 3.220 (3.176)] [KD 0.000 (0.000)] 2024-10-12 20:35:49,794 - Train: 70.73% [265450/375300] [212.2/300.0] [batch_t 0.414 (0.446)] [data_t 0.016] [optim_t 0.398] [lr 0.000615] [CE 3.073 (3.205)] [KD 0.000 (0.000)] 2024-10-12 20:36:11,835 - Train: 70.74% [265500/375300] [212.2/300.0] [batch_t 0.464 (0.441)] [data_t 0.015] [optim_t 0.448] [lr 0.000614] [CE 3.055 (3.185)] [KD 0.000 (0.000)] 2024-10-12 20:36:32,353 - Train: 70.76% [265550/375300] [212.3/300.0] [batch_t 0.417 (0.410)] [data_t 0.016] [optim_t 0.402] [lr 0.000614] [CE 3.409 (3.226)] [KD 0.000 (0.000)] 2024-10-12 20:36:54,082 - Train: 70.77% [265600/375300] [212.3/300.0] [batch_t 0.438 (0.434)] [data_t 0.016] [optim_t 0.423] [lr 0.000613] [CE 3.381 (3.201)] [KD 0.000 (0.000)] 2024-10-12 20:37:15,952 - Train: 70.78% [265650/375300] [212.4/300.0] [batch_t 0.456 (0.437)] [data_t 0.015] [optim_t 0.440] [lr 0.000613] [CE 3.370 (3.189)] [KD 0.000 (0.000)] 2024-10-12 20:37:36,984 - Train: 70.80% [265700/375300] [212.4/300.0] [batch_t 0.443 (0.421)] [data_t 0.016] [optim_t 0.427] [lr 0.000612] [CE 3.218 (3.214)] [KD 0.000 (0.000)] 2024-10-12 20:37:59,069 - Train: 70.81% [265750/375300] [212.4/300.0] [batch_t 0.447 (0.442)] [data_t 0.016] [optim_t 0.432] [lr 0.000612] [CE 3.070 (3.201)] [KD 0.000 (0.000)] 2024-10-12 20:38:20,778 - Train: 70.82% [265800/375300] [212.5/300.0] [batch_t 0.320 (0.434)] [data_t 0.015] [optim_t 0.304] [lr 0.000611] [CE 3.281 (3.185)] [KD 0.000 (0.000)] 2024-10-12 20:38:41,858 - Train: 70.84% [265850/375300] [212.5/300.0] [batch_t 0.478 (0.421)] [data_t 0.016] [optim_t 0.463] [lr 0.000611] [CE 2.952 (3.201)] [KD 0.000 (0.000)] 2024-10-12 20:39:03,382 - Train: 70.85% [265900/375300] [212.5/300.0] [batch_t 0.408 (0.430)] [data_t 0.016] [optim_t 0.392] [lr 0.000610] [CE 3.367 (3.249)] [KD 0.000 (0.000)] 2024-10-12 20:39:25,442 - Train: 70.86% [265950/375300] [212.6/300.0] [batch_t 0.371 (0.441)] [data_t 0.015] [optim_t 0.356] [lr 0.000610] [CE 3.093 (3.223)] [KD 0.000 (0.000)] 2024-10-12 20:39:46,640 - Train: 70.88% [266000/375300] [212.6/300.0] [batch_t 0.457 (0.424)] [data_t 0.016] [optim_t 0.441] [lr 0.000609] [CE 3.319 (3.165)] [KD 0.000 (0.000)] 2024-10-12 20:40:08,260 - Train: 70.89% [266050/375300] [212.7/300.0] [batch_t 0.454 (0.432)] [data_t 0.016] [optim_t 0.438] [lr 0.000609] [CE 3.070 (3.175)] [KD 0.000 (0.000)] 2024-10-12 20:40:30,254 - Train: 70.90% [266100/375300] [212.7/300.0] [batch_t 0.494 (0.440)] [data_t 0.015] [optim_t 0.478] [lr 0.000608] [CE 3.187 (3.199)] [KD 0.000 (0.000)] 2024-10-12 20:40:51,609 - Train: 70.92% [266150/375300] [212.7/300.0] [batch_t 0.420 (0.427)] [data_t 0.015] [optim_t 0.404] [lr 0.000608] [CE 3.098 (3.222)] [KD 0.000 (0.000)] 2024-10-12 20:41:13,515 - Train: 70.93% [266200/375300] [212.8/300.0] [batch_t 0.312 (0.438)] [data_t 0.016] [optim_t 0.297] [lr 0.000607] [CE 2.898 (3.155)] [KD 0.000 (0.000)] 2024-10-12 20:41:34,752 - Train: 70.94% [266250/375300] [212.8/300.0] [batch_t 0.454 (0.425)] [data_t 0.016] [optim_t 0.439] [lr 0.000607] [CE 3.293 (3.236)] [KD 0.000 (0.000)] 2024-10-12 20:41:57,626 - Train: 70.96% [266300/375300] [212.9/300.0] [batch_t 0.355 (0.457)] [data_t 0.015] [optim_t 0.340] [lr 0.000606] [CE 3.177 (3.187)] [KD 0.000 (0.000)] 2024-10-12 20:42:19,476 - Train: 70.97% [266350/375300] [212.9/300.0] [batch_t 0.437 (0.437)] [data_t 0.015] [optim_t 0.422] [lr 0.000606] [CE 3.091 (3.188)] [KD 0.000 (0.000)] 2024-10-12 20:42:40,954 - Train: 70.98% [266400/375300] [212.9/300.0] [batch_t 0.394 (0.429)] [data_t 0.016] [optim_t 0.378] [lr 0.000605] [CE 3.483 (3.180)] [KD 0.000 (0.000)] 2024-10-12 20:43:02,587 - Train: 71.00% [266450/375300] [213.0/300.0] [batch_t 0.319 (0.433)] [data_t 0.015] [optim_t 0.304] [lr 0.000605] [CE 2.944 (3.156)] [KD 0.000 (0.000)] 2024-10-12 20:43:28,229 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.424)] [top1_cnt 39382] [top5_cnt 47405] [top_all 50000] 2024-10-12 20:43:28,230 - net: 78.764 (94.810) 2024-10-12 20:43:49,792 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.423)] [top1_cnt 40633] [top5_cnt 47912] [top_all 50000] 2024-10-12 20:43:49,793 - net_E: 81.266 (95.824) 2024-10-12 20:43:50,056 - Max [top1: 78.764 (epoch: 213)] [top1-ema: 81.266 (epoch: 213)] 2024-10-12 20:43:50,057 - ==> Total time: 1 day, 8:56:53 Eta: 13:27:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 20:44:12,591 - Train: 71.01% [266500/375300] [213.0/300.0] [batch_t 0.320 (0.424)] [data_t 0.016] [optim_t 0.304] [lr 0.000604] [CE 3.247 (3.161)] [KD 0.000 (0.000)] 2024-10-12 20:44:34,697 - Train: 71.02% [266550/375300] [213.1/300.0] [batch_t 0.440 (0.442)] [data_t 0.016] [optim_t 0.424] [lr 0.000604] [CE 3.053 (3.244)] [KD 0.000 (0.000)] 2024-10-12 20:44:57,193 - Train: 71.04% [266600/375300] [213.1/300.0] [batch_t 0.461 (0.450)] [data_t 0.016] [optim_t 0.445] [lr 0.000603] [CE 3.556 (3.183)] [KD 0.000 (0.000)] 2024-10-12 20:45:18,856 - Train: 71.05% [266650/375300] [213.1/300.0] [batch_t 0.471 (0.433)] [data_t 0.016] [optim_t 0.455] [lr 0.000603] [CE 3.268 (3.198)] [KD 0.000 (0.000)] 2024-10-12 20:45:40,474 - Train: 71.06% [266700/375300] [213.2/300.0] [batch_t 0.395 (0.432)] [data_t 0.016] [optim_t 0.379] [lr 0.000603] [CE 3.338 (3.169)] [KD 0.000 (0.000)] 2024-10-12 20:46:02,236 - Train: 71.08% [266750/375300] [213.2/300.0] [batch_t 0.319 (0.435)] [data_t 0.016] [optim_t 0.304] [lr 0.000602] [CE 2.924 (3.215)] [KD 0.000 (0.000)] 2024-10-12 20:46:23,199 - Train: 71.09% [266800/375300] [213.3/300.0] [batch_t 0.386 (0.419)] [data_t 0.016] [optim_t 0.370] [lr 0.000602] [CE 2.986 (3.171)] [KD 0.000 (0.000)] 2024-10-12 20:46:44,439 - Train: 71.10% [266850/375300] [213.3/300.0] [batch_t 0.346 (0.425)] [data_t 0.016] [optim_t 0.330] [lr 0.000601] [CE 3.388 (3.159)] [KD 0.000 (0.000)] 2024-10-12 20:47:06,346 - Train: 71.12% [266900/375300] [213.3/300.0] [batch_t 0.447 (0.438)] [data_t 0.015] [optim_t 0.432] [lr 0.000601] [CE 3.005 (3.175)] [KD 0.000 (0.000)] 2024-10-12 20:47:28,102 - Train: 71.13% [266950/375300] [213.4/300.0] [batch_t 0.526 (0.435)] [data_t 0.015] [optim_t 0.511] [lr 0.000600] [CE 3.023 (3.202)] [KD 0.000 (0.000)] 2024-10-12 20:47:50,721 - Train: 71.14% [267000/375300] [213.4/300.0] [batch_t 0.425 (0.452)] [data_t 0.015] [optim_t 0.410] [lr 0.000600] [CE 3.375 (3.250)] [KD 0.000 (0.000)] 2024-10-12 20:48:12,533 - Train: 71.16% [267050/375300] [213.5/300.0] [batch_t 0.503 (0.436)] [data_t 0.016] [optim_t 0.487] [lr 0.000599] [CE 3.107 (3.187)] [KD 0.000 (0.000)] 2024-10-12 20:48:34,332 - Train: 71.17% [267100/375300] [213.5/300.0] [batch_t 0.461 (0.436)] [data_t 0.015] [optim_t 0.445] [lr 0.000599] [CE 3.342 (3.167)] [KD 0.000 (0.000)] 2024-10-12 20:48:56,456 - Train: 71.18% [267150/375300] [213.5/300.0] [batch_t 0.421 (0.442)] [data_t 0.016] [optim_t 0.406] [lr 0.000598] [CE 2.869 (3.170)] [KD 0.000 (0.000)] 2024-10-12 20:49:18,961 - Train: 71.20% [267200/375300] [213.6/300.0] [batch_t 0.452 (0.450)] [data_t 0.016] [optim_t 0.437] [lr 0.000598] [CE 3.320 (3.229)] [KD 0.000 (0.000)] 2024-10-12 20:49:41,635 - Train: 71.21% [267250/375300] [213.6/300.0] [batch_t 0.401 (0.453)] [data_t 0.016] [optim_t 0.385] [lr 0.000597] [CE 3.320 (3.221)] [KD 0.000 (0.000)] 2024-10-12 20:50:04,052 - Train: 71.22% [267300/375300] [213.7/300.0] [batch_t 0.396 (0.448)] [data_t 0.015] [optim_t 0.381] [lr 0.000597] [CE 3.419 (3.230)] [KD 0.000 (0.000)] 2024-10-12 20:50:26,649 - Train: 71.24% [267350/375300] [213.7/300.0] [batch_t 0.378 (0.452)] [data_t 0.016] [optim_t 0.363] [lr 0.000596] [CE 3.227 (3.228)] [KD 0.000 (0.000)] 2024-10-12 20:50:48,163 - Train: 71.25% [267400/375300] [213.7/300.0] [batch_t 0.388 (0.430)] [data_t 0.016] [optim_t 0.373] [lr 0.000596] [CE 2.917 (3.167)] [KD 0.000 (0.000)] 2024-10-12 20:51:09,380 - Train: 71.26% [267450/375300] [213.8/300.0] [batch_t 0.418 (0.424)] [data_t 0.016] [optim_t 0.403] [lr 0.000595] [CE 3.250 (3.164)] [KD 0.000 (0.000)] 2024-10-12 20:51:31,069 - Train: 71.28% [267500/375300] [213.8/300.0] [batch_t 0.495 (0.434)] [data_t 0.016] [optim_t 0.480] [lr 0.000595] [CE 3.415 (3.211)] [KD 0.000 (0.000)] 2024-10-12 20:51:52,565 - Train: 71.29% [267550/375300] [213.9/300.0] [batch_t 0.426 (0.430)] [data_t 0.016] [optim_t 0.411] [lr 0.000594] [CE 3.126 (3.160)] [KD 0.000 (0.000)] 2024-10-12 20:52:14,633 - Train: 71.30% [267600/375300] [213.9/300.0] [batch_t 0.312 (0.441)] [data_t 0.016] [optim_t 0.297] [lr 0.000594] [CE 3.228 (3.193)] [KD 0.000 (0.000)] 2024-10-12 20:52:36,808 - Train: 71.32% [267650/375300] [213.9/300.0] [batch_t 0.466 (0.443)] [data_t 0.171] [optim_t 0.295] [lr 0.000593] [CE 3.248 (3.163)] [KD 0.000 (0.000)] 2024-10-12 20:52:58,783 - Train: 71.33% [267700/375300] [214.0/300.0] [batch_t 0.381 (0.439)] [data_t 0.085] [optim_t 0.296] [lr 0.000593] [CE 3.079 (3.216)] [KD 0.000 (0.000)] 2024-10-12 20:53:25,346 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.430)] [top1_cnt 39436] [top5_cnt 47339] [top_all 50000] 2024-10-12 20:53:25,347 - net: 78.872 (94.678) 2024-10-12 20:53:47,287 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.430)] [top1_cnt 40667] [top5_cnt 47911] [top_all 50000] 2024-10-12 20:53:47,288 - net_E: 81.334 (95.822) 2024-10-12 20:53:47,489 - Max [top1: 78.872 (epoch: 214)] [top1-ema: 81.334 (epoch: 214)] 2024-10-12 20:53:47,489 - ==> Total time: 1 day, 9:06:51 Eta: 13:18:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 20:54:09,913 - Train: 71.34% [267750/375300] [214.0/300.0] [batch_t 0.314 (0.427)] [data_t 0.016] [optim_t 0.298] [lr 0.000592] [CE 2.884 (3.128)] [KD 0.000 (0.000)] 2024-10-12 20:54:31,364 - Train: 71.36% [267800/375300] [214.1/300.0] [batch_t 0.435 (0.429)] [data_t 0.015] [optim_t 0.420] [lr 0.000592] [CE 3.074 (3.166)] [KD 0.000 (0.000)] 2024-10-12 20:54:53,360 - Train: 71.37% [267850/375300] [214.1/300.0] [batch_t 0.390 (0.440)] [data_t 0.015] [optim_t 0.374] [lr 0.000591] [CE 3.426 (3.189)] [KD 0.000 (0.000)] 2024-10-12 20:55:15,758 - Train: 71.38% [267900/375300] [214.1/300.0] [batch_t 0.315 (0.448)] [data_t 0.016] [optim_t 0.299] [lr 0.000591] [CE 3.034 (3.154)] [KD 0.000 (0.000)] 2024-10-12 20:55:38,574 - Train: 71.40% [267950/375300] [214.2/300.0] [batch_t 0.474 (0.456)] [data_t 0.015] [optim_t 0.459] [lr 0.000590] [CE 3.116 (3.196)] [KD 0.000 (0.000)] 2024-10-12 20:56:00,747 - Train: 71.41% [268000/375300] [214.2/300.0] [batch_t 0.315 (0.443)] [data_t 0.016] [optim_t 0.299] [lr 0.000590] [CE 3.339 (3.137)] [KD 0.000 (0.000)] 2024-10-12 20:56:23,033 - Train: 71.42% [268050/375300] [214.3/300.0] [batch_t 0.435 (0.446)] [data_t 0.016] [optim_t 0.419] [lr 0.000589] [CE 3.407 (3.133)] [KD 0.000 (0.000)] 2024-10-12 20:56:45,122 - Train: 71.44% [268100/375300] [214.3/300.0] [batch_t 0.423 (0.442)] [data_t 0.016] [optim_t 0.408] [lr 0.000589] [CE 2.846 (3.205)] [KD 0.000 (0.000)] 2024-10-12 20:57:07,104 - Train: 71.45% [268150/375300] [214.3/300.0] [batch_t 0.485 (0.440)] [data_t 0.015] [optim_t 0.470] [lr 0.000588] [CE 3.050 (3.194)] [KD 0.000 (0.000)] 2024-10-12 20:57:28,642 - Train: 71.46% [268200/375300] [214.4/300.0] [batch_t 0.478 (0.431)] [data_t 0.016] [optim_t 0.462] [lr 0.000588] [CE 3.261 (3.166)] [KD 0.000 (0.000)] 2024-10-12 20:57:50,700 - Train: 71.48% [268250/375300] [214.4/300.0] [batch_t 0.447 (0.441)] [data_t 0.016] [optim_t 0.431] [lr 0.000587] [CE 3.160 (3.166)] [KD 0.000 (0.000)] 2024-10-12 20:58:12,753 - Train: 71.49% [268300/375300] [214.5/300.0] [batch_t 0.464 (0.441)] [data_t 0.016] [optim_t 0.449] [lr 0.000587] [CE 3.314 (3.199)] [KD 0.000 (0.000)] 2024-10-12 20:58:34,803 - Train: 71.50% [268350/375300] [214.5/300.0] [batch_t 0.312 (0.441)] [data_t 0.016] [optim_t 0.297] [lr 0.000586] [CE 3.024 (3.200)] [KD 0.000 (0.000)] 2024-10-12 20:58:56,927 - Train: 71.52% [268400/375300] [214.5/300.0] [batch_t 0.405 (0.442)] [data_t 0.016] [optim_t 0.389] [lr 0.000586] [CE 3.093 (3.182)] [KD 0.000 (0.000)] 2024-10-12 20:59:18,988 - Train: 71.53% [268450/375300] [214.6/300.0] [batch_t 0.469 (0.441)] [data_t 0.016] [optim_t 0.454] [lr 0.000585] [CE 3.271 (3.181)] [KD 0.000 (0.000)] 2024-10-12 20:59:40,691 - Train: 71.54% [268500/375300] [214.6/300.0] [batch_t 0.416 (0.434)] [data_t 0.016] [optim_t 0.400] [lr 0.000585] [CE 3.299 (3.189)] [KD 0.000 (0.000)] 2024-10-12 21:00:02,339 - Train: 71.56% [268550/375300] [214.7/300.0] [batch_t 0.460 (0.433)] [data_t 0.015] [optim_t 0.445] [lr 0.000584] [CE 3.100 (3.214)] [KD 0.000 (0.000)] 2024-10-12 21:00:24,132 - Train: 71.57% [268600/375300] [214.7/300.0] [batch_t 0.443 (0.436)] [data_t 0.016] [optim_t 0.428] [lr 0.000584] [CE 3.315 (3.183)] [KD 0.000 (0.000)] 2024-10-12 21:00:46,077 - Train: 71.58% [268650/375300] [214.7/300.0] [batch_t 0.436 (0.439)] [data_t 0.015] [optim_t 0.420] [lr 0.000584] [CE 3.353 (3.193)] [KD 0.000 (0.000)] 2024-10-12 21:01:07,473 - Train: 71.60% [268700/375300] [214.8/300.0] [batch_t 0.415 (0.428)] [data_t 0.015] [optim_t 0.399] [lr 0.000583] [CE 3.125 (3.144)] [KD 0.000 (0.000)] 2024-10-12 21:01:29,298 - Train: 71.61% [268750/375300] [214.8/300.0] [batch_t 0.379 (0.436)] [data_t 0.016] [optim_t 0.364] [lr 0.000583] [CE 3.177 (3.150)] [KD 0.000 (0.000)] 2024-10-12 21:01:51,521 - Train: 71.62% [268800/375300] [214.9/300.0] [batch_t 0.419 (0.444)] [data_t 0.016] [optim_t 0.404] [lr 0.000582] [CE 3.397 (3.203)] [KD 0.000 (0.000)] 2024-10-12 21:02:12,922 - Train: 71.64% [268850/375300] [214.9/300.0] [batch_t 0.385 (0.428)] [data_t 0.015] [optim_t 0.369] [lr 0.000582] [CE 3.515 (3.169)] [KD 0.000 (0.000)] 2024-10-12 21:02:34,715 - Train: 71.65% [268900/375300] [214.9/300.0] [batch_t 0.417 (0.436)] [data_t 0.016] [optim_t 0.401] [lr 0.000581] [CE 3.024 (3.163)] [KD 0.000 (0.000)] 2024-10-12 21:02:56,633 - Train: 71.66% [268950/375300] [215.0/300.0] [batch_t 0.470 (0.438)] [data_t 0.039] [optim_t 0.431] [lr 0.000581] [CE 3.160 (3.245)] [KD 0.000 (0.000)] 2024-10-12 21:03:25,353 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.469)] [top1_cnt 39383] [top5_cnt 47408] [top_all 50000] 2024-10-12 21:03:25,354 - net: 78.766 (94.816) 2024-10-12 21:03:47,068 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.426)] [top1_cnt 40697] [top5_cnt 47931] [top_all 50000] 2024-10-12 21:03:47,069 - net_E: 81.394 (95.862) 2024-10-12 21:03:47,252 - Max [top1: 78.872 (epoch: 214)] [top1-ema: 81.394 (epoch: 215)] 2024-10-12 21:03:47,252 - ==> Total time: 1 day, 9:16:51 Eta: 13:09:27 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 21:04:07,692 - Train: 71.68% [269000/375300] [215.0/300.0] [batch_t 0.505 (0.415)] [data_t 0.032] [optim_t 0.472] [lr 0.000580] [CE 3.195 (3.160)] [KD 0.000 (0.000)] 2024-10-12 21:04:29,503 - Train: 71.69% [269050/375300] [215.1/300.0] [batch_t 0.391 (0.436)] [data_t 0.016] [optim_t 0.375] [lr 0.000580] [CE 3.275 (3.152)] [KD 0.000 (0.000)] 2024-10-12 21:04:51,632 - Train: 71.70% [269100/375300] [215.1/300.0] [batch_t 0.410 (0.442)] [data_t 0.016] [optim_t 0.394] [lr 0.000579] [CE 3.390 (3.177)] [KD 0.000 (0.000)] 2024-10-12 21:05:13,351 - Train: 71.72% [269150/375300] [215.1/300.0] [batch_t 0.311 (0.434)] [data_t 0.015] [optim_t 0.296] [lr 0.000579] [CE 2.934 (3.225)] [KD 0.000 (0.000)] 2024-10-12 21:05:35,928 - Train: 71.73% [269200/375300] [215.2/300.0] [batch_t 0.473 (0.451)] [data_t 0.016] [optim_t 0.458] [lr 0.000578] [CE 3.109 (3.165)] [KD 0.000 (0.000)] 2024-10-12 21:05:56,623 - Train: 71.74% [269250/375300] [215.2/300.0] [batch_t 0.375 (0.414)] [data_t 0.015] [optim_t 0.360] [lr 0.000578] [CE 3.295 (3.199)] [KD 0.000 (0.000)] 2024-10-12 21:06:17,719 - Train: 71.76% [269300/375300] [215.3/300.0] [batch_t 0.461 (0.422)] [data_t 0.016] [optim_t 0.445] [lr 0.000577] [CE 3.033 (3.154)] [KD 0.000 (0.000)] 2024-10-12 21:06:39,303 - Train: 71.77% [269350/375300] [215.3/300.0] [batch_t 0.405 (0.432)] [data_t 0.016] [optim_t 0.390] [lr 0.000577] [CE 2.982 (3.168)] [KD 0.000 (0.000)] 2024-10-12 21:07:01,299 - Train: 71.78% [269400/375300] [215.3/300.0] [batch_t 0.441 (0.440)] [data_t 0.016] [optim_t 0.426] [lr 0.000576] [CE 3.643 (3.159)] [KD 0.000 (0.000)] 2024-10-12 21:07:23,011 - Train: 71.80% [269450/375300] [215.4/300.0] [batch_t 0.417 (0.434)] [data_t 0.016] [optim_t 0.401] [lr 0.000576] [CE 2.919 (3.216)] [KD 0.000 (0.000)] 2024-10-12 21:07:44,558 - Train: 71.81% [269500/375300] [215.4/300.0] [batch_t 0.411 (0.431)] [data_t 0.016] [optim_t 0.395] [lr 0.000575] [CE 3.121 (3.192)] [KD 0.000 (0.000)] 2024-10-12 21:08:06,082 - Train: 71.82% [269550/375300] [215.5/300.0] [batch_t 0.368 (0.430)] [data_t 0.016] [optim_t 0.352] [lr 0.000575] [CE 3.223 (3.164)] [KD 0.000 (0.000)] 2024-10-12 21:08:27,587 - Train: 71.84% [269600/375300] [215.5/300.0] [batch_t 0.352 (0.430)] [data_t 0.015] [optim_t 0.337] [lr 0.000574] [CE 3.202 (3.137)] [KD 0.000 (0.000)] 2024-10-12 21:08:49,363 - Train: 71.85% [269650/375300] [215.5/300.0] [batch_t 0.487 (0.435)] [data_t 0.016] [optim_t 0.472] [lr 0.000574] [CE 3.234 (3.209)] [KD 0.000 (0.000)] 2024-10-12 21:09:11,949 - Train: 71.86% [269700/375300] [215.6/300.0] [batch_t 0.514 (0.452)] [data_t 0.016] [optim_t 0.498] [lr 0.000573] [CE 3.162 (3.133)] [KD 0.000 (0.000)] 2024-10-12 21:09:34,442 - Train: 71.88% [269750/375300] [215.6/300.0] [batch_t 0.506 (0.450)] [data_t 0.016] [optim_t 0.490] [lr 0.000573] [CE 3.368 (3.217)] [KD 0.000 (0.000)] 2024-10-12 21:09:56,469 - Train: 71.89% [269800/375300] [215.7/300.0] [batch_t 0.451 (0.440)] [data_t 0.016] [optim_t 0.435] [lr 0.000572] [CE 3.133 (3.207)] [KD 0.000 (0.000)] 2024-10-12 21:10:18,617 - Train: 71.90% [269850/375300] [215.7/300.0] [batch_t 0.402 (0.443)] [data_t 0.016] [optim_t 0.386] [lr 0.000572] [CE 3.485 (3.209)] [KD 0.000 (0.000)] 2024-10-12 21:10:40,697 - Train: 71.92% [269900/375300] [215.7/300.0] [batch_t 0.475 (0.442)] [data_t 0.016] [optim_t 0.459] [lr 0.000571] [CE 3.159 (3.182)] [KD 0.000 (0.000)] 2024-10-12 21:11:01,461 - Train: 71.93% [269950/375300] [215.8/300.0] [batch_t 0.318 (0.415)] [data_t 0.016] [optim_t 0.302] [lr 0.000571] [CE 3.172 (3.190)] [KD 0.000 (0.000)] 2024-10-12 21:11:22,847 - Train: 71.94% [270000/375300] [215.8/300.0] [batch_t 0.445 (0.428)] [data_t 0.016] [optim_t 0.430] [lr 0.000571] [CE 3.304 (3.198)] [KD 0.000 (0.000)] 2024-10-12 21:11:44,675 - Train: 71.96% [270050/375300] [215.9/300.0] [batch_t 0.471 (0.436)] [data_t 0.016] [optim_t 0.455] [lr 0.000570] [CE 3.108 (3.166)] [KD 0.000 (0.000)] 2024-10-12 21:12:06,577 - Train: 71.97% [270100/375300] [215.9/300.0] [batch_t 0.470 (0.438)] [data_t 0.016] [optim_t 0.454] [lr 0.000570] [CE 3.248 (3.118)] [KD 0.000 (0.000)] 2024-10-12 21:12:28,687 - Train: 71.98% [270150/375300] [215.9/300.0] [batch_t 0.326 (0.442)] [data_t 0.016] [optim_t 0.311] [lr 0.000569] [CE 3.564 (3.151)] [KD 0.000 (0.000)] 2024-10-12 21:12:50,578 - Train: 72.00% [270200/375300] [216.0/300.0] [batch_t 0.482 (0.438)] [data_t 0.016] [optim_t 0.466] [lr 0.000569] [CE 3.084 (3.160)] [KD 0.000 (0.000)] 2024-10-12 21:13:18,314 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.437)] [top1_cnt 39098] [top5_cnt 47293] [top_all 50000] 2024-10-12 21:13:18,314 - net: 78.196 (94.586) 2024-10-12 21:13:40,181 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.428)] [top1_cnt 40699] [top5_cnt 47932] [top_all 50000] 2024-10-12 21:13:40,181 - net_E: 81.398 (95.864) 2024-10-12 21:13:40,404 - Max [top1: 78.872 (epoch: 214)] [top1-ema: 81.398 (epoch: 216)] 2024-10-12 21:13:40,404 - ==> Total time: 1 day, 9:26:44 Eta: 13:00:23 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 21:14:01,875 - Train: 72.01% [270250/375300] [216.0/300.0] [batch_t 0.315 (0.496)] [data_t 0.016] [optim_t 0.299] [lr 0.000568] [CE 3.296 (3.183)] [KD 0.000 (0.000)] 2024-10-12 21:14:25,431 - Train: 72.02% [270300/375300] [216.1/300.0] [batch_t 0.553 (0.471)] [data_t 0.251] [optim_t 0.301] [lr 0.000568] [CE 3.565 (3.174)] [KD 0.000 (0.000)] 2024-10-12 21:14:48,437 - Train: 72.04% [270350/375300] [216.1/300.0] [batch_t 0.548 (0.460)] [data_t 0.253] [optim_t 0.294] [lr 0.000567] [CE 3.499 (3.183)] [KD 0.000 (0.000)] 2024-10-12 21:15:11,157 - Train: 72.05% [270400/375300] [216.1/300.0] [batch_t 0.347 (0.454)] [data_t 0.050] [optim_t 0.297] [lr 0.000567] [CE 2.972 (3.149)] [KD 0.000 (0.000)] 2024-10-12 21:15:33,990 - Train: 72.06% [270450/375300] [216.2/300.0] [batch_t 0.476 (0.457)] [data_t 0.175] [optim_t 0.302] [lr 0.000566] [CE 3.190 (3.184)] [KD 0.000 (0.000)] 2024-10-12 21:15:57,456 - Train: 72.08% [270500/375300] [216.2/300.0] [batch_t 1.087 (0.469)] [data_t 0.784] [optim_t 0.304] [lr 0.000566] [CE 2.805 (3.196)] [KD 0.000 (0.000)] 2024-10-12 21:16:19,813 - Train: 72.09% [270550/375300] [216.3/300.0] [batch_t 0.535 (0.447)] [data_t 0.235] [optim_t 0.300] [lr 0.000565] [CE 3.267 (3.214)] [KD 0.000 (0.000)] 2024-10-12 21:16:41,942 - Train: 72.10% [270600/375300] [216.3/300.0] [batch_t 0.417 (0.442)] [data_t 0.116] [optim_t 0.301] [lr 0.000565] [CE 3.156 (3.171)] [KD 0.000 (0.000)] 2024-10-12 21:17:04,016 - Train: 72.12% [270650/375300] [216.3/300.0] [batch_t 0.330 (0.441)] [data_t 0.031] [optim_t 0.298] [lr 0.000564] [CE 2.980 (3.224)] [KD 0.000 (0.000)] 2024-10-12 21:17:26,313 - Train: 72.13% [270700/375300] [216.4/300.0] [batch_t 0.420 (0.446)] [data_t 0.121] [optim_t 0.299] [lr 0.000564] [CE 3.199 (3.167)] [KD 0.000 (0.000)] 2024-10-12 21:17:48,516 - Train: 72.14% [270750/375300] [216.4/300.0] [batch_t 0.544 (0.444)] [data_t 0.240] [optim_t 0.304] [lr 0.000563] [CE 3.276 (3.180)] [KD 0.000 (0.000)] 2024-10-12 21:18:09,717 - Train: 72.16% [270800/375300] [216.5/300.0] [batch_t 0.423 (0.424)] [data_t 0.124] [optim_t 0.300] [lr 0.000563] [CE 2.878 (3.139)] [KD 0.000 (0.000)] 2024-10-12 21:18:30,744 - Train: 72.17% [270850/375300] [216.5/300.0] [batch_t 0.430 (0.420)] [data_t 0.131] [optim_t 0.299] [lr 0.000562] [CE 3.235 (3.186)] [KD 0.000 (0.000)] 2024-10-12 21:18:53,080 - Train: 72.18% [270900/375300] [216.5/300.0] [batch_t 0.423 (0.447)] [data_t 0.016] [optim_t 0.407] [lr 0.000562] [CE 3.222 (3.208)] [KD 0.000 (0.000)] 2024-10-12 21:19:15,489 - Train: 72.20% [270950/375300] [216.6/300.0] [batch_t 0.318 (0.448)] [data_t 0.016] [optim_t 0.302] [lr 0.000561] [CE 3.269 (3.184)] [KD 0.000 (0.000)] 2024-10-12 21:19:38,390 - Train: 72.21% [271000/375300] [216.6/300.0] [batch_t 0.395 (0.458)] [data_t 0.016] [optim_t 0.379] [lr 0.000561] [CE 2.889 (3.171)] [KD 0.000 (0.000)] 2024-10-12 21:20:00,935 - Train: 72.22% [271050/375300] [216.7/300.0] [batch_t 0.363 (0.451)] [data_t 0.016] [optim_t 0.347] [lr 0.000560] [CE 3.044 (3.181)] [KD 0.000 (0.000)] 2024-10-12 21:20:23,885 - Train: 72.24% [271100/375300] [216.7/300.0] [batch_t 0.520 (0.459)] [data_t 0.016] [optim_t 0.505] [lr 0.000560] [CE 3.259 (3.157)] [KD 0.000 (0.000)] 2024-10-12 21:20:46,071 - Train: 72.25% [271150/375300] [216.7/300.0] [batch_t 0.485 (0.444)] [data_t 0.016] [optim_t 0.469] [lr 0.000560] [CE 2.966 (3.211)] [KD 0.000 (0.000)] 2024-10-12 21:21:08,132 - Train: 72.26% [271200/375300] [216.8/300.0] [batch_t 0.433 (0.441)] [data_t 0.015] [optim_t 0.417] [lr 0.000559] [CE 3.392 (3.205)] [KD 0.000 (0.000)] 2024-10-12 21:21:30,223 - Train: 72.28% [271250/375300] [216.8/300.0] [batch_t 0.466 (0.442)] [data_t 0.016] [optim_t 0.450] [lr 0.000559] [CE 3.225 (3.213)] [KD 0.000 (0.000)] 2024-10-12 21:21:52,788 - Train: 72.29% [271300/375300] [216.9/300.0] [batch_t 0.423 (0.451)] [data_t 0.015] [optim_t 0.408] [lr 0.000558] [CE 3.260 (3.187)] [KD 0.000 (0.000)] 2024-10-12 21:22:15,255 - Train: 72.30% [271350/375300] [216.9/300.0] [batch_t 0.450 (0.449)] [data_t 0.015] [optim_t 0.435] [lr 0.000558] [CE 3.108 (3.169)] [KD 0.000 (0.000)] 2024-10-12 21:22:37,381 - Train: 72.32% [271400/375300] [216.9/300.0] [batch_t 0.454 (0.442)] [data_t 0.016] [optim_t 0.438] [lr 0.000557] [CE 3.183 (3.182)] [KD 0.000 (0.000)] 2024-10-12 21:22:59,574 - Train: 72.33% [271450/375300] [217.0/300.0] [batch_t 0.384 (0.444)] [data_t 0.016] [optim_t 0.369] [lr 0.000557] [CE 3.143 (3.184)] [KD 0.000 (0.000)] 2024-10-12 21:23:28,406 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.453)] [top1_cnt 39368] [top5_cnt 47381] [top_all 50000] 2024-10-12 21:23:28,407 - net: 78.736 (94.762) 2024-10-12 21:23:50,165 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.428)] [top1_cnt 40695] [top5_cnt 47915] [top_all 50000] 2024-10-12 21:23:50,165 - net_E: 81.390 (95.830) 2024-10-12 21:23:50,354 - Max [top1: 78.872 (epoch: 214)] [top1-ema: 81.398 (epoch: 216)] 2024-10-12 21:23:50,354 - ==> Total time: 1 day, 9:36:54 Eta: 12:51:26 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 21:24:09,419 - Train: 72.34% [271500/375300] [217.0/300.0] [batch_t 0.489 (0.533)] [data_t 0.016] [optim_t 0.473] [lr 0.000556] [CE 3.173 (3.209)] [KD 0.000 (0.000)] 2024-10-12 21:24:30,903 - Train: 72.36% [271550/375300] [217.1/300.0] [batch_t 0.415 (0.430)] [data_t 0.016] [optim_t 0.399] [lr 0.000556] [CE 3.283 (3.177)] [KD 0.000 (0.000)] 2024-10-12 21:24:52,277 - Train: 72.37% [271600/375300] [217.1/300.0] [batch_t 0.438 (0.427)] [data_t 0.016] [optim_t 0.423] [lr 0.000555] [CE 3.202 (3.186)] [KD 0.000 (0.000)] 2024-10-12 21:25:13,713 - Train: 72.38% [271650/375300] [217.1/300.0] [batch_t 0.409 (0.429)] [data_t 0.016] [optim_t 0.393] [lr 0.000555] [CE 3.196 (3.168)] [KD 0.000 (0.000)] 2024-10-12 21:25:35,412 - Train: 72.40% [271700/375300] [217.2/300.0] [batch_t 0.459 (0.434)] [data_t 0.015] [optim_t 0.443] [lr 0.000554] [CE 3.091 (3.150)] [KD 0.000 (0.000)] 2024-10-12 21:25:58,260 - Train: 72.41% [271750/375300] [217.2/300.0] [batch_t 0.414 (0.457)] [data_t 0.016] [optim_t 0.398] [lr 0.000554] [CE 3.325 (3.166)] [KD 0.000 (0.000)] 2024-10-12 21:26:19,981 - Train: 72.42% [271800/375300] [217.3/300.0] [batch_t 0.442 (0.434)] [data_t 0.137] [optim_t 0.304] [lr 0.000553] [CE 3.078 (3.184)] [KD 0.000 (0.000)] 2024-10-12 21:26:41,300 - Train: 72.44% [271850/375300] [217.3/300.0] [batch_t 0.401 (0.426)] [data_t 0.099] [optim_t 0.303] [lr 0.000553] [CE 3.274 (3.148)] [KD 0.000 (0.000)] 2024-10-12 21:27:03,049 - Train: 72.45% [271900/375300] [217.3/300.0] [batch_t 0.469 (0.435)] [data_t 0.016] [optim_t 0.454] [lr 0.000552] [CE 3.347 (3.161)] [KD 0.000 (0.000)] 2024-10-12 21:27:25,143 - Train: 72.46% [271950/375300] [217.4/300.0] [batch_t 0.400 (0.442)] [data_t 0.016] [optim_t 0.384] [lr 0.000552] [CE 3.198 (3.185)] [KD 0.000 (0.000)] 2024-10-12 21:27:47,527 - Train: 72.48% [272000/375300] [217.4/300.0] [batch_t 0.386 (0.448)] [data_t 0.016] [optim_t 0.371] [lr 0.000551] [CE 3.177 (3.165)] [KD 0.000 (0.000)] 2024-10-12 21:28:09,648 - Train: 72.49% [272050/375300] [217.5/300.0] [batch_t 0.429 (0.442)] [data_t 0.015] [optim_t 0.414] [lr 0.000551] [CE 3.267 (3.176)] [KD 0.000 (0.000)] 2024-10-12 21:28:32,167 - Train: 72.50% [272100/375300] [217.5/300.0] [batch_t 0.425 (0.450)] [data_t 0.016] [optim_t 0.410] [lr 0.000551] [CE 3.080 (3.147)] [KD 0.000 (0.000)] 2024-10-12 21:28:54,239 - Train: 72.52% [272150/375300] [217.5/300.0] [batch_t 0.342 (0.441)] [data_t 0.016] [optim_t 0.326] [lr 0.000550] [CE 2.929 (3.163)] [KD 0.000 (0.000)] 2024-10-12 21:29:14,880 - Train: 72.53% [272200/375300] [217.6/300.0] [batch_t 0.353 (0.413)] [data_t 0.016] [optim_t 0.337] [lr 0.000550] [CE 3.340 (3.223)] [KD 0.000 (0.000)] 2024-10-12 21:29:35,894 - Train: 72.54% [272250/375300] [217.6/300.0] [batch_t 0.466 (0.420)] [data_t 0.016] [optim_t 0.450] [lr 0.000549] [CE 3.071 (3.178)] [KD 0.000 (0.000)] 2024-10-12 21:29:58,051 - Train: 72.56% [272300/375300] [217.7/300.0] [batch_t 0.409 (0.443)] [data_t 0.016] [optim_t 0.393] [lr 0.000549] [CE 3.002 (3.174)] [KD 0.000 (0.000)] 2024-10-12 21:30:19,595 - Train: 72.57% [272350/375300] [217.7/300.0] [batch_t 0.466 (0.431)] [data_t 0.016] [optim_t 0.450] [lr 0.000548] [CE 3.133 (3.151)] [KD 0.000 (0.000)] 2024-10-12 21:30:41,030 - Train: 72.58% [272400/375300] [217.7/300.0] [batch_t 0.440 (0.429)] [data_t 0.016] [optim_t 0.424] [lr 0.000548] [CE 3.304 (3.199)] [KD 0.000 (0.000)] 2024-10-12 21:31:01,932 - Train: 72.60% [272450/375300] [217.8/300.0] [batch_t 0.444 (0.418)] [data_t 0.016] [optim_t 0.428] [lr 0.000547] [CE 3.455 (3.155)] [KD 0.000 (0.000)] 2024-10-12 21:31:23,529 - Train: 72.61% [272500/375300] [217.8/300.0] [batch_t 0.462 (0.432)] [data_t 0.016] [optim_t 0.446] [lr 0.000547] [CE 2.878 (3.169)] [KD 0.000 (0.000)] 2024-10-12 21:31:45,472 - Train: 72.62% [272550/375300] [217.9/300.0] [batch_t 0.406 (0.439)] [data_t 0.016] [optim_t 0.391] [lr 0.000546] [CE 3.060 (3.144)] [KD 0.000 (0.000)] 2024-10-12 21:32:07,294 - Train: 72.64% [272600/375300] [217.9/300.0] [batch_t 0.325 (0.436)] [data_t 0.015] [optim_t 0.310] [lr 0.000546] [CE 3.318 (3.194)] [KD 0.000 (0.000)] 2024-10-12 21:32:28,984 - Train: 72.65% [272650/375300] [217.9/300.0] [batch_t 0.384 (0.434)] [data_t 0.016] [optim_t 0.368] [lr 0.000545] [CE 2.825 (3.163)] [KD 0.000 (0.000)] 2024-10-12 21:32:51,389 - Train: 72.66% [272700/375300] [218.0/300.0] [batch_t 0.429 (0.448)] [data_t 0.016] [optim_t 0.414] [lr 0.000545] [CE 2.809 (3.220)] [KD 0.000 (0.000)] 2024-10-12 21:33:19,721 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.431)] [top1_cnt 39525] [top5_cnt 47426] [top_all 50000] 2024-10-12 21:33:19,722 - net: 79.050 (94.852) 2024-10-12 21:33:42,266 - Test (net_E): 100.00% [50/50] [batch_t 0.132 (0.443)] [top1_cnt 40698] [top5_cnt 47909] [top_all 50000] 2024-10-12 21:33:42,267 - net_E: 81.396 (95.818) 2024-10-12 21:33:42,488 - Max [top1: 79.050 (epoch: 218)] [top1-ema: 81.398 (epoch: 216)] 2024-10-12 21:33:42,489 - ==> Total time: 1 day, 9:46:46 Eta: 12:42:21 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 21:34:01,462 - Train: 72.68% [272750/375300] [218.0/300.0] [batch_t 0.477 (0.430)] [data_t 0.178] [optim_t 0.298] [lr 0.000544] [CE 3.044 (3.178)] [KD 0.000 (0.000)] 2024-10-12 21:34:22,852 - Train: 72.69% [272800/375300] [218.1/300.0] [batch_t 0.319 (0.428)] [data_t 0.021] [optim_t 0.298] [lr 0.000544] [CE 3.098 (3.130)] [KD 0.000 (0.000)] 2024-10-12 21:34:44,394 - Train: 72.70% [272850/375300] [218.1/300.0] [batch_t 0.402 (0.431)] [data_t 0.108] [optim_t 0.294] [lr 0.000543] [CE 3.317 (3.126)] [KD 0.000 (0.000)] 2024-10-12 21:35:06,215 - Train: 72.72% [272900/375300] [218.1/300.0] [batch_t 0.411 (0.436)] [data_t 0.118] [optim_t 0.293] [lr 0.000543] [CE 3.378 (3.191)] [KD 0.000 (0.000)] 2024-10-12 21:35:28,452 - Train: 72.73% [272950/375300] [218.2/300.0] [batch_t 0.434 (0.445)] [data_t 0.016] [optim_t 0.418] [lr 0.000542] [CE 3.280 (3.179)] [KD 0.000 (0.000)] 2024-10-12 21:35:50,663 - Train: 72.74% [273000/375300] [218.2/300.0] [batch_t 0.316 (0.444)] [data_t 0.016] [optim_t 0.301] [lr 0.000542] [CE 2.971 (3.131)] [KD 0.000 (0.000)] 2024-10-12 21:36:13,031 - Train: 72.76% [273050/375300] [218.3/300.0] [batch_t 0.514 (0.447)] [data_t 0.016] [optim_t 0.499] [lr 0.000542] [CE 3.101 (3.148)] [KD 0.000 (0.000)] 2024-10-12 21:36:35,036 - Train: 72.77% [273100/375300] [218.3/300.0] [batch_t 0.425 (0.440)] [data_t 0.016] [optim_t 0.409] [lr 0.000541] [CE 3.038 (3.207)] [KD 0.000 (0.000)] 2024-10-12 21:36:57,424 - Train: 72.78% [273150/375300] [218.3/300.0] [batch_t 0.460 (0.448)] [data_t 0.016] [optim_t 0.444] [lr 0.000541] [CE 3.382 (3.213)] [KD 0.000 (0.000)] 2024-10-12 21:37:19,748 - Train: 72.80% [273200/375300] [218.4/300.0] [batch_t 0.478 (0.446)] [data_t 0.016] [optim_t 0.462] [lr 0.000540] [CE 3.237 (3.190)] [KD 0.000 (0.000)] 2024-10-12 21:37:41,597 - Train: 72.81% [273250/375300] [218.4/300.0] [batch_t 0.461 (0.437)] [data_t 0.016] [optim_t 0.445] [lr 0.000540] [CE 3.064 (3.188)] [KD 0.000 (0.000)] 2024-10-12 21:38:03,289 - Train: 72.82% [273300/375300] [218.5/300.0] [batch_t 0.439 (0.434)] [data_t 0.016] [optim_t 0.423] [lr 0.000539] [CE 3.376 (3.178)] [KD 0.000 (0.000)] 2024-10-12 21:38:25,142 - Train: 72.84% [273350/375300] [218.5/300.0] [batch_t 0.455 (0.437)] [data_t 0.016] [optim_t 0.439] [lr 0.000539] [CE 3.221 (3.126)] [KD 0.000 (0.000)] 2024-10-12 21:38:46,689 - Train: 72.85% [273400/375300] [218.5/300.0] [batch_t 0.312 (0.431)] [data_t 0.015] [optim_t 0.297] [lr 0.000538] [CE 3.259 (3.183)] [KD 0.000 (0.000)] 2024-10-12 21:39:08,833 - Train: 72.86% [273450/375300] [218.6/300.0] [batch_t 0.475 (0.443)] [data_t 0.016] [optim_t 0.460] [lr 0.000538] [CE 3.229 (3.131)] [KD 0.000 (0.000)] 2024-10-12 21:39:30,508 - Train: 72.88% [273500/375300] [218.6/300.0] [batch_t 0.466 (0.433)] [data_t 0.016] [optim_t 0.450] [lr 0.000537] [CE 2.969 (3.186)] [KD 0.000 (0.000)] 2024-10-12 21:39:52,056 - Train: 72.89% [273550/375300] [218.7/300.0] [batch_t 0.326 (0.431)] [data_t 0.015] [optim_t 0.311] [lr 0.000537] [CE 2.976 (3.177)] [KD 0.000 (0.000)] 2024-10-12 21:40:14,613 - Train: 72.90% [273600/375300] [218.7/300.0] [batch_t 0.865 (0.451)] [data_t 0.016] [optim_t 0.850] [lr 0.000536] [CE 3.433 (3.156)] [KD 0.000 (0.000)] 2024-10-12 21:40:35,391 - Train: 72.92% [273650/375300] [218.7/300.0] [batch_t 0.416 (0.415)] [data_t 0.016] [optim_t 0.400] [lr 0.000536] [CE 3.093 (3.184)] [KD 0.000 (0.000)] 2024-10-12 21:40:56,628 - Train: 72.93% [273700/375300] [218.8/300.0] [batch_t 0.433 (0.425)] [data_t 0.015] [optim_t 0.417] [lr 0.000535] [CE 3.104 (3.130)] [KD 0.000 (0.000)] 2024-10-12 21:41:18,466 - Train: 72.94% [273750/375300] [218.8/300.0] [batch_t 0.455 (0.437)] [data_t 0.015] [optim_t 0.440] [lr 0.000535] [CE 3.040 (3.153)] [KD 0.000 (0.000)] 2024-10-12 21:41:39,943 - Train: 72.95% [273800/375300] [218.9/300.0] [batch_t 0.445 (0.429)] [data_t 0.015] [optim_t 0.430] [lr 0.000535] [CE 3.220 (3.168)] [KD 0.000 (0.000)] 2024-10-12 21:42:01,784 - Train: 72.97% [273850/375300] [218.9/300.0] [batch_t 0.457 (0.437)] [data_t 0.016] [optim_t 0.442] [lr 0.000534] [CE 3.064 (3.124)] [KD 0.000 (0.000)] 2024-10-12 21:42:23,155 - Train: 72.98% [273900/375300] [218.9/300.0] [batch_t 0.385 (0.427)] [data_t 0.016] [optim_t 0.370] [lr 0.000534] [CE 3.371 (3.198)] [KD 0.000 (0.000)] 2024-10-12 21:42:44,893 - Train: 72.99% [273950/375300] [219.0/300.0] [batch_t 0.389 (0.435)] [data_t 0.016] [optim_t 0.373] [lr 0.000533] [CE 2.750 (3.238)] [KD 0.000 (0.000)] 2024-10-12 21:43:13,234 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.425)] [top1_cnt 39405] [top5_cnt 47412] [top_all 50000] 2024-10-12 21:43:13,234 - net: 78.810 (94.824) 2024-10-12 21:43:35,557 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.438)] [top1_cnt 40680] [top5_cnt 47924] [top_all 50000] 2024-10-12 21:43:35,557 - net_E: 81.360 (95.848) 2024-10-12 21:43:35,732 - Max [top1: 79.050 (epoch: 218)] [top1-ema: 81.398 (epoch: 216)] 2024-10-12 21:43:35,732 - ==> Total time: 1 day, 9:56:39 Eta: 12:33:17 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 21:43:53,933 - Train: 73.01% [274000/375300] [219.0/300.0] [batch_t 0.374 (0.538)] [data_t 0.016] [optim_t 0.358] [lr 0.000533] [CE 3.174 (3.163)] [KD 0.000 (0.000)] 2024-10-12 21:44:15,300 - Train: 73.02% [274050/375300] [219.1/300.0] [batch_t 0.312 (0.427)] [data_t 0.015] [optim_t 0.297] [lr 0.000532] [CE 2.798 (3.153)] [KD 0.000 (0.000)] 2024-10-12 21:44:37,400 - Train: 73.03% [274100/375300] [219.1/300.0] [batch_t 0.432 (0.442)] [data_t 0.016] [optim_t 0.417] [lr 0.000532] [CE 3.471 (3.147)] [KD 0.000 (0.000)] 2024-10-12 21:44:59,160 - Train: 73.05% [274150/375300] [219.1/300.0] [batch_t 0.407 (0.435)] [data_t 0.016] [optim_t 0.391] [lr 0.000531] [CE 3.167 (3.144)] [KD 0.000 (0.000)] 2024-10-12 21:45:22,587 - Train: 73.06% [274200/375300] [219.2/300.0] [batch_t 0.459 (0.468)] [data_t 0.016] [optim_t 0.443] [lr 0.000531] [CE 3.257 (3.179)] [KD 0.000 (0.000)] 2024-10-12 21:45:45,014 - Train: 73.07% [274250/375300] [219.2/300.0] [batch_t 0.393 (0.448)] [data_t 0.016] [optim_t 0.378] [lr 0.000530] [CE 3.067 (3.173)] [KD 0.000 (0.000)] 2024-10-12 21:46:06,786 - Train: 73.09% [274300/375300] [219.3/300.0] [batch_t 0.427 (0.435)] [data_t 0.016] [optim_t 0.411] [lr 0.000530] [CE 3.145 (3.156)] [KD 0.000 (0.000)] 2024-10-12 21:46:28,316 - Train: 73.10% [274350/375300] [219.3/300.0] [batch_t 0.334 (0.430)] [data_t 0.015] [optim_t 0.319] [lr 0.000529] [CE 3.166 (3.171)] [KD 0.000 (0.000)] 2024-10-12 21:46:50,239 - Train: 73.11% [274400/375300] [219.3/300.0] [batch_t 0.394 (0.438)] [data_t 0.015] [optim_t 0.379] [lr 0.000529] [CE 3.030 (3.157)] [KD 0.000 (0.000)] 2024-10-12 21:47:12,310 - Train: 73.13% [274450/375300] [219.4/300.0] [batch_t 0.369 (0.441)] [data_t 0.016] [optim_t 0.353] [lr 0.000528] [CE 2.833 (3.103)] [KD 0.000 (0.000)] 2024-10-12 21:47:34,339 - Train: 73.14% [274500/375300] [219.4/300.0] [batch_t 0.356 (0.440)] [data_t 0.016] [optim_t 0.341] [lr 0.000528] [CE 3.165 (3.180)] [KD 0.000 (0.000)] 2024-10-12 21:47:55,986 - Train: 73.15% [274550/375300] [219.5/300.0] [batch_t 0.496 (0.433)] [data_t 0.015] [optim_t 0.480] [lr 0.000528] [CE 2.889 (3.169)] [KD 0.000 (0.000)] 2024-10-12 21:48:17,361 - Train: 73.17% [274600/375300] [219.5/300.0] [batch_t 0.481 (0.427)] [data_t 0.015] [optim_t 0.466] [lr 0.000527] [CE 3.201 (3.162)] [KD 0.000 (0.000)] 2024-10-12 21:48:40,153 - Train: 73.18% [274650/375300] [219.5/300.0] [batch_t 0.310 (0.456)] [data_t 0.016] [optim_t 0.295] [lr 0.000527] [CE 3.402 (3.160)] [KD 0.000 (0.000)] 2024-10-12 21:49:01,087 - Train: 73.19% [274700/375300] [219.6/300.0] [batch_t 0.317 (0.419)] [data_t 0.016] [optim_t 0.301] [lr 0.000526] [CE 3.114 (3.222)] [KD 0.000 (0.000)] 2024-10-12 21:49:23,313 - Train: 73.21% [274750/375300] [219.6/300.0] [batch_t 0.463 (0.444)] [data_t 0.016] [optim_t 0.447] [lr 0.000526] [CE 2.883 (3.177)] [KD 0.000 (0.000)] 2024-10-12 21:49:46,134 - Train: 73.22% [274800/375300] [219.7/300.0] [batch_t 0.498 (0.456)] [data_t 0.015] [optim_t 0.483] [lr 0.000525] [CE 3.335 (3.165)] [KD 0.000 (0.000)] 2024-10-12 21:50:07,660 - Train: 73.23% [274850/375300] [219.7/300.0] [batch_t 0.472 (0.430)] [data_t 0.015] [optim_t 0.456] [lr 0.000525] [CE 3.169 (3.164)] [KD 0.000 (0.000)] 2024-10-12 21:50:29,868 - Train: 73.25% [274900/375300] [219.7/300.0] [batch_t 0.465 (0.444)] [data_t 0.015] [optim_t 0.450] [lr 0.000524] [CE 3.000 (3.180)] [KD 0.000 (0.000)] 2024-10-12 21:50:52,177 - Train: 73.26% [274950/375300] [219.8/300.0] [batch_t 0.454 (0.446)] [data_t 0.015] [optim_t 0.438] [lr 0.000524] [CE 3.135 (3.185)] [KD 0.000 (0.000)] 2024-10-12 21:51:15,001 - Train: 73.27% [275000/375300] [219.8/300.0] [batch_t 0.442 (0.456)] [data_t 0.016] [optim_t 0.426] [lr 0.000523] [CE 3.008 (3.145)] [KD 0.000 (0.000)] 2024-10-12 21:51:37,660 - Train: 73.29% [275050/375300] [219.9/300.0] [batch_t 0.400 (0.453)] [data_t 0.015] [optim_t 0.385] [lr 0.000523] [CE 3.116 (3.124)] [KD 0.000 (0.000)] 2024-10-12 21:52:00,344 - Train: 73.30% [275100/375300] [219.9/300.0] [batch_t 0.475 (0.454)] [data_t 0.015] [optim_t 0.460] [lr 0.000522] [CE 3.183 (3.205)] [KD 0.000 (0.000)] 2024-10-12 21:52:23,283 - Train: 73.31% [275150/375300] [219.9/300.0] [batch_t 0.512 (0.459)] [data_t 0.016] [optim_t 0.496] [lr 0.000522] [CE 3.346 (3.182)] [KD 0.000 (0.000)] 2024-10-12 21:52:45,594 - Train: 73.33% [275200/375300] [220.0/300.0] [batch_t 0.431 (0.446)] [data_t 0.016] [optim_t 0.416] [lr 0.000522] [CE 3.313 (3.139)] [KD 0.000 (0.000)] 2024-10-12 21:53:15,114 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.436)] [top1_cnt 39549] [top5_cnt 47417] [top_all 50000] 2024-10-12 21:53:15,114 - net: 79.098 (94.834) 2024-10-12 21:53:37,413 - Test (net_E): 100.00% [50/50] [batch_t 0.142 (0.437)] [top1_cnt 40708] [top5_cnt 47941] [top_all 50000] 2024-10-12 21:53:37,413 - net_E: 81.416 (95.882) 2024-10-12 21:53:37,626 - Max [top1: 79.098 (epoch: 220)] [top1-ema: 81.416 (epoch: 220)] 2024-10-12 21:53:37,626 - ==> Total time: 1 day, 10:06:41 Eta: 12:24:15 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 21:53:56,905 - Train: 73.34% [275250/375300] [220.0/300.0] [batch_t 0.573 (0.429)] [data_t 0.016] [optim_t 0.557] [lr 0.000521] [CE 3.110 (3.119)] [KD 0.000 (0.000)] 2024-10-12 21:54:19,782 - Train: 73.35% [275300/375300] [220.1/300.0] [batch_t 0.520 (0.457)] [data_t 0.016] [optim_t 0.504] [lr 0.000521] [CE 3.337 (3.153)] [KD 0.000 (0.000)] 2024-10-12 21:54:42,377 - Train: 73.37% [275350/375300] [220.1/300.0] [batch_t 0.478 (0.452)] [data_t 0.016] [optim_t 0.462] [lr 0.000520] [CE 3.222 (3.186)] [KD 0.000 (0.000)] 2024-10-12 21:55:05,117 - Train: 73.38% [275400/375300] [220.1/300.0] [batch_t 0.452 (0.455)] [data_t 0.016] [optim_t 0.437] [lr 0.000520] [CE 3.109 (3.124)] [KD 0.000 (0.000)] 2024-10-12 21:55:27,245 - Train: 73.39% [275450/375300] [220.2/300.0] [batch_t 0.460 (0.442)] [data_t 0.016] [optim_t 0.445] [lr 0.000519] [CE 3.148 (3.164)] [KD 0.000 (0.000)] 2024-10-12 21:55:49,395 - Train: 73.41% [275500/375300] [220.2/300.0] [batch_t 0.476 (0.443)] [data_t 0.016] [optim_t 0.460] [lr 0.000519] [CE 2.982 (3.146)] [KD 0.000 (0.000)] 2024-10-12 21:56:11,013 - Train: 73.42% [275550/375300] [220.3/300.0] [batch_t 0.395 (0.432)] [data_t 0.016] [optim_t 0.379] [lr 0.000518] [CE 3.158 (3.155)] [KD 0.000 (0.000)] 2024-10-12 21:56:33,116 - Train: 73.43% [275600/375300] [220.3/300.0] [batch_t 0.425 (0.442)] [data_t 0.016] [optim_t 0.409] [lr 0.000518] [CE 2.977 (3.142)] [KD 0.000 (0.000)] 2024-10-12 21:56:54,706 - Train: 73.45% [275650/375300] [220.3/300.0] [batch_t 0.391 (0.432)] [data_t 0.016] [optim_t 0.376] [lr 0.000517] [CE 3.124 (3.179)] [KD 0.000 (0.000)] 2024-10-12 21:57:16,078 - Train: 73.46% [275700/375300] [220.4/300.0] [batch_t 0.396 (0.427)] [data_t 0.016] [optim_t 0.381] [lr 0.000517] [CE 3.492 (3.187)] [KD 0.000 (0.000)] 2024-10-12 21:57:37,007 - Train: 73.47% [275750/375300] [220.4/300.0] [batch_t 0.405 (0.418)] [data_t 0.016] [optim_t 0.389] [lr 0.000516] [CE 3.430 (3.156)] [KD 0.000 (0.000)] 2024-10-12 21:57:58,406 - Train: 73.49% [275800/375300] [220.5/300.0] [batch_t 0.466 (0.428)] [data_t 0.016] [optim_t 0.450] [lr 0.000516] [CE 3.095 (3.160)] [KD 0.000 (0.000)] 2024-10-12 21:58:21,089 - Train: 73.50% [275850/375300] [220.5/300.0] [batch_t 0.517 (0.454)] [data_t 0.016] [optim_t 0.501] [lr 0.000516] [CE 3.259 (3.163)] [KD 0.000 (0.000)] 2024-10-12 21:58:42,894 - Train: 73.51% [275900/375300] [220.5/300.0] [batch_t 0.418 (0.436)] [data_t 0.015] [optim_t 0.403] [lr 0.000515] [CE 2.866 (3.164)] [KD 0.000 (0.000)] 2024-10-12 21:59:04,459 - Train: 73.53% [275950/375300] [220.6/300.0] [batch_t 0.455 (0.431)] [data_t 0.016] [optim_t 0.440] [lr 0.000515] [CE 3.124 (3.167)] [KD 0.000 (0.000)] 2024-10-12 21:59:25,574 - Train: 73.54% [276000/375300] [220.6/300.0] [batch_t 0.424 (0.422)] [data_t 0.016] [optim_t 0.409] [lr 0.000514] [CE 3.300 (3.165)] [KD 0.000 (0.000)] 2024-10-12 21:59:47,630 - Train: 73.55% [276050/375300] [220.7/300.0] [batch_t 0.439 (0.441)] [data_t 0.015] [optim_t 0.424] [lr 0.000514] [CE 3.199 (3.152)] [KD 0.000 (0.000)] 2024-10-12 22:00:09,258 - Train: 73.57% [276100/375300] [220.7/300.0] [batch_t 0.467 (0.432)] [data_t 0.015] [optim_t 0.452] [lr 0.000513] [CE 2.916 (3.143)] [KD 0.000 (0.000)] 2024-10-12 22:00:31,110 - Train: 73.58% [276150/375300] [220.7/300.0] [batch_t 0.441 (0.437)] [data_t 0.016] [optim_t 0.426] [lr 0.000513] [CE 3.144 (3.145)] [KD 0.000 (0.000)] 2024-10-12 22:00:52,551 - Train: 73.59% [276200/375300] [220.8/300.0] [batch_t 0.433 (0.429)] [data_t 0.016] [optim_t 0.418] [lr 0.000512] [CE 2.808 (3.124)] [KD 0.000 (0.000)] 2024-10-12 22:01:14,109 - Train: 73.61% [276250/375300] [220.8/300.0] [batch_t 0.406 (0.431)] [data_t 0.016] [optim_t 0.390] [lr 0.000512] [CE 2.718 (3.088)] [KD 0.000 (0.000)] 2024-10-12 22:01:35,940 - Train: 73.62% [276300/375300] [220.9/300.0] [batch_t 0.440 (0.437)] [data_t 0.016] [optim_t 0.424] [lr 0.000511] [CE 2.880 (3.161)] [KD 0.000 (0.000)] 2024-10-12 22:01:58,018 - Train: 73.63% [276350/375300] [220.9/300.0] [batch_t 0.426 (0.441)] [data_t 0.016] [optim_t 0.411] [lr 0.000511] [CE 3.120 (3.145)] [KD 0.000 (0.000)] 2024-10-12 22:02:20,589 - Train: 73.65% [276400/375300] [220.9/300.0] [batch_t 0.401 (0.451)] [data_t 0.015] [optim_t 0.385] [lr 0.000510] [CE 2.891 (3.208)] [KD 0.000 (0.000)] 2024-10-12 22:02:42,926 - Train: 73.66% [276450/375300] [221.0/300.0] [batch_t 0.439 (0.447)] [data_t 0.015] [optim_t 0.424] [lr 0.000510] [CE 3.035 (3.209)] [KD 0.000 (0.000)] 2024-10-12 22:03:12,681 - Test (net): 100.00% [50/50] [batch_t 0.147 (0.435)] [top1_cnt 39585] [top5_cnt 47503] [top_all 50000] 2024-10-12 22:03:12,681 - net: 79.170 (95.006) 2024-10-12 22:03:34,523 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.428)] [top1_cnt 40700] [top5_cnt 47940] [top_all 50000] 2024-10-12 22:03:34,524 - net_E: 81.400 (95.880) 2024-10-12 22:03:34,733 - Max [top1: 79.170 (epoch: 221)] [top1-ema: 81.416 (epoch: 220)] 2024-10-12 22:03:34,733 - ==> Total time: 1 day, 10:16:38 Eta: 12:15:10 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 22:03:53,695 - Train: 73.67% [276500/375300] [221.0/300.0] [batch_t 1.151 (0.481)] [data_t 0.016] [optim_t 1.135] [lr 0.000510] [CE 3.003 (3.155)] [KD 0.000 (0.000)] 2024-10-12 22:04:16,548 - Train: 73.69% [276550/375300] [221.1/300.0] [batch_t 0.390 (0.457)] [data_t 0.015] [optim_t 0.374] [lr 0.000509] [CE 3.477 (3.144)] [KD 0.000 (0.000)] 2024-10-12 22:04:37,287 - Train: 73.70% [276600/375300] [221.1/300.0] [batch_t 0.423 (0.415)] [data_t 0.015] [optim_t 0.407] [lr 0.000509] [CE 3.120 (3.138)] [KD 0.000 (0.000)] 2024-10-12 22:04:58,892 - Train: 73.71% [276650/375300] [221.1/300.0] [batch_t 0.355 (0.432)] [data_t 0.016] [optim_t 0.339] [lr 0.000508] [CE 3.278 (3.175)] [KD 0.000 (0.000)] 2024-10-12 22:05:20,237 - Train: 73.73% [276700/375300] [221.2/300.0] [batch_t 0.317 (0.427)] [data_t 0.016] [optim_t 0.301] [lr 0.000508] [CE 2.937 (3.163)] [KD 0.000 (0.000)] 2024-10-12 22:05:42,052 - Train: 73.74% [276750/375300] [221.2/300.0] [batch_t 0.804 (0.436)] [data_t 0.015] [optim_t 0.789] [lr 0.000507] [CE 2.863 (3.123)] [KD 0.000 (0.000)] 2024-10-12 22:06:03,055 - Train: 73.75% [276800/375300] [221.3/300.0] [batch_t 0.321 (0.420)] [data_t 0.015] [optim_t 0.305] [lr 0.000507] [CE 3.155 (3.147)] [KD 0.000 (0.000)] 2024-10-12 22:06:24,713 - Train: 73.77% [276850/375300] [221.3/300.0] [batch_t 0.400 (0.433)] [data_t 0.016] [optim_t 0.384] [lr 0.000506] [CE 3.174 (3.124)] [KD 0.000 (0.000)] 2024-10-12 22:06:46,120 - Train: 73.78% [276900/375300] [221.3/300.0] [batch_t 0.428 (0.428)] [data_t 0.016] [optim_t 0.412] [lr 0.000506] [CE 3.133 (3.147)] [KD 0.000 (0.000)] 2024-10-12 22:07:08,087 - Train: 73.79% [276950/375300] [221.4/300.0] [batch_t 0.863 (0.439)] [data_t 0.016] [optim_t 0.847] [lr 0.000505] [CE 3.167 (3.139)] [KD 0.000 (0.000)] 2024-10-12 22:07:29,193 - Train: 73.81% [277000/375300] [221.4/300.0] [batch_t 0.315 (0.422)] [data_t 0.016] [optim_t 0.300] [lr 0.000505] [CE 2.935 (3.141)] [KD 0.000 (0.000)] 2024-10-12 22:07:50,675 - Train: 73.82% [277050/375300] [221.5/300.0] [batch_t 0.496 (0.430)] [data_t 0.016] [optim_t 0.480] [lr 0.000505] [CE 3.258 (3.144)] [KD 0.000 (0.000)] 2024-10-12 22:08:12,770 - Train: 73.83% [277100/375300] [221.5/300.0] [batch_t 0.462 (0.442)] [data_t 0.016] [optim_t 0.447] [lr 0.000504] [CE 2.784 (3.151)] [KD 0.000 (0.000)] 2024-10-12 22:08:33,947 - Train: 73.85% [277150/375300] [221.5/300.0] [batch_t 0.463 (0.423)] [data_t 0.016] [optim_t 0.448] [lr 0.000504] [CE 3.442 (3.154)] [KD 0.000 (0.000)] 2024-10-12 22:08:55,491 - Train: 73.86% [277200/375300] [221.6/300.0] [batch_t 0.477 (0.431)] [data_t 0.016] [optim_t 0.461] [lr 0.000503] [CE 3.081 (3.205)] [KD 0.000 (0.000)] 2024-10-12 22:09:17,078 - Train: 73.87% [277250/375300] [221.6/300.0] [batch_t 0.433 (0.432)] [data_t 0.015] [optim_t 0.418] [lr 0.000503] [CE 3.111 (3.157)] [KD 0.000 (0.000)] 2024-10-12 22:09:38,774 - Train: 73.89% [277300/375300] [221.7/300.0] [batch_t 0.448 (0.434)] [data_t 0.015] [optim_t 0.432] [lr 0.000502] [CE 3.145 (3.122)] [KD 0.000 (0.000)] 2024-10-12 22:10:00,119 - Train: 73.90% [277350/375300] [221.7/300.0] [batch_t 0.466 (0.427)] [data_t 0.016] [optim_t 0.451] [lr 0.000502] [CE 2.960 (3.163)] [KD 0.000 (0.000)] 2024-10-12 22:10:21,753 - Train: 73.91% [277400/375300] [221.7/300.0] [batch_t 0.470 (0.433)] [data_t 0.015] [optim_t 0.454] [lr 0.000501] [CE 3.326 (3.180)] [KD 0.000 (0.000)] 2024-10-12 22:10:43,680 - Train: 73.93% [277450/375300] [221.8/300.0] [batch_t 0.432 (0.438)] [data_t 0.015] [optim_t 0.416] [lr 0.000501] [CE 3.167 (3.137)] [KD 0.000 (0.000)] 2024-10-12 22:11:06,172 - Train: 73.94% [277500/375300] [221.8/300.0] [batch_t 0.454 (0.450)] [data_t 0.016] [optim_t 0.438] [lr 0.000500] [CE 3.199 (3.181)] [KD 0.000 (0.000)] 2024-10-12 22:11:29,086 - Train: 73.95% [277550/375300] [221.9/300.0] [batch_t 0.519 (0.458)] [data_t 0.016] [optim_t 0.503] [lr 0.000500] [CE 3.171 (3.157)] [KD 0.000 (0.000)] 2024-10-12 22:11:51,822 - Train: 73.97% [277600/375300] [221.9/300.0] [batch_t 0.469 (0.455)] [data_t 0.016] [optim_t 0.453] [lr 0.000500] [CE 3.331 (3.137)] [KD 0.000 (0.000)] 2024-10-12 22:12:14,283 - Train: 73.98% [277650/375300] [221.9/300.0] [batch_t 0.506 (0.449)] [data_t 0.015] [optim_t 0.491] [lr 0.000499] [CE 3.393 (3.152)] [KD 0.000 (0.000)] 2024-10-12 22:12:37,120 - Train: 73.99% [277700/375300] [222.0/300.0] [batch_t 0.450 (0.457)] [data_t 0.016] [optim_t 0.434] [lr 0.000499] [CE 3.181 (3.150)] [KD 0.000 (0.000)] 2024-10-12 22:13:07,347 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.438)] [top1_cnt 39681] [top5_cnt 47473] [top_all 50000] 2024-10-12 22:13:07,347 - net: 79.362 (94.946) 2024-10-12 22:13:29,436 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.433)] [top1_cnt 40684] [top5_cnt 47955] [top_all 50000] 2024-10-12 22:13:29,437 - net_E: 81.368 (95.910) 2024-10-12 22:13:29,640 - Max [top1: 79.362 (epoch: 222)] [top1-ema: 81.416 (epoch: 220)] 2024-10-12 22:13:29,640 - ==> Total time: 1 day, 10:26:33 Eta: 12:06:05 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 22:13:48,649 - Train: 74.01% [277750/375300] [222.0/300.0] [batch_t 0.314 (0.450)] [data_t 0.016] [optim_t 0.298] [lr 0.000498] [CE 2.581 (3.068)] [KD 0.000 (0.000)] 2024-10-12 22:14:10,321 - Train: 74.02% [277800/375300] [222.1/300.0] [batch_t 0.315 (0.433)] [data_t 0.015] [optim_t 0.300] [lr 0.000498] [CE 3.314 (3.106)] [KD 0.000 (0.000)] 2024-10-12 22:14:32,208 - Train: 74.03% [277850/375300] [222.1/300.0] [batch_t 0.416 (0.438)] [data_t 0.016] [optim_t 0.400] [lr 0.000497] [CE 2.884 (3.110)] [KD 0.000 (0.000)] 2024-10-12 22:14:54,371 - Train: 74.05% [277900/375300] [222.1/300.0] [batch_t 0.313 (0.443)] [data_t 0.016] [optim_t 0.298] [lr 0.000497] [CE 3.571 (3.157)] [KD 0.000 (0.000)] 2024-10-12 22:15:16,157 - Train: 74.06% [277950/375300] [222.2/300.0] [batch_t 0.361 (0.436)] [data_t 0.016] [optim_t 0.346] [lr 0.000496] [CE 3.230 (3.101)] [KD 0.000 (0.000)] 2024-10-12 22:15:37,876 - Train: 74.07% [278000/375300] [222.2/300.0] [batch_t 0.406 (0.434)] [data_t 0.016] [optim_t 0.390] [lr 0.000496] [CE 3.245 (3.148)] [KD 0.000 (0.000)] 2024-10-12 22:15:59,494 - Train: 74.09% [278050/375300] [222.3/300.0] [batch_t 0.502 (0.432)] [data_t 0.016] [optim_t 0.486] [lr 0.000495] [CE 3.003 (3.124)] [KD 0.000 (0.000)] 2024-10-12 22:16:21,835 - Train: 74.10% [278100/375300] [222.3/300.0] [batch_t 0.437 (0.447)] [data_t 0.137] [optim_t 0.300] [lr 0.000495] [CE 3.471 (3.178)] [KD 0.000 (0.000)] 2024-10-12 22:16:42,829 - Train: 74.11% [278150/375300] [222.3/300.0] [batch_t 0.508 (0.420)] [data_t 0.203] [optim_t 0.305] [lr 0.000495] [CE 2.965 (3.154)] [KD 0.000 (0.000)] 2024-10-12 22:17:04,824 - Train: 74.13% [278200/375300] [222.4/300.0] [batch_t 0.345 (0.440)] [data_t 0.016] [optim_t 0.329] [lr 0.000494] [CE 3.049 (3.139)] [KD 0.000 (0.000)] 2024-10-12 22:17:26,508 - Train: 74.14% [278250/375300] [222.4/300.0] [batch_t 0.406 (0.434)] [data_t 0.016] [optim_t 0.390] [lr 0.000494] [CE 3.174 (3.157)] [KD 0.000 (0.000)] 2024-10-12 22:17:47,565 - Train: 74.15% [278300/375300] [222.5/300.0] [batch_t 0.415 (0.421)] [data_t 0.016] [optim_t 0.399] [lr 0.000493] [CE 3.246 (3.154)] [KD 0.000 (0.000)] 2024-10-12 22:18:09,051 - Train: 74.17% [278350/375300] [222.5/300.0] [batch_t 0.316 (0.430)] [data_t 0.016] [optim_t 0.301] [lr 0.000493] [CE 3.296 (3.137)] [KD 0.000 (0.000)] 2024-10-12 22:18:30,523 - Train: 74.18% [278400/375300] [222.5/300.0] [batch_t 0.538 (0.429)] [data_t 0.016] [optim_t 0.522] [lr 0.000492] [CE 3.290 (3.149)] [KD 0.000 (0.000)] 2024-10-12 22:18:52,377 - Train: 74.19% [278450/375300] [222.6/300.0] [batch_t 0.415 (0.437)] [data_t 0.016] [optim_t 0.399] [lr 0.000492] [CE 3.136 (3.140)] [KD 0.000 (0.000)] 2024-10-12 22:19:13,947 - Train: 74.21% [278500/375300] [222.6/300.0] [batch_t 0.439 (0.431)] [data_t 0.016] [optim_t 0.423] [lr 0.000491] [CE 2.962 (3.110)] [KD 0.000 (0.000)] 2024-10-12 22:19:35,864 - Train: 74.22% [278550/375300] [222.7/300.0] [batch_t 0.501 (0.438)] [data_t 0.016] [optim_t 0.485] [lr 0.000491] [CE 3.189 (3.121)] [KD 0.000 (0.000)] 2024-10-12 22:19:58,363 - Train: 74.23% [278600/375300] [222.7/300.0] [batch_t 0.317 (0.450)] [data_t 0.015] [optim_t 0.302] [lr 0.000491] [CE 3.388 (3.128)] [KD 0.000 (0.000)] 2024-10-12 22:20:19,977 - Train: 74.25% [278650/375300] [222.7/300.0] [batch_t 0.375 (0.432)] [data_t 0.016] [optim_t 0.359] [lr 0.000490] [CE 3.220 (3.148)] [KD 0.000 (0.000)] 2024-10-12 22:20:41,130 - Train: 74.26% [278700/375300] [222.8/300.0] [batch_t 0.426 (0.423)] [data_t 0.016] [optim_t 0.410] [lr 0.000490] [CE 3.191 (3.124)] [KD 0.000 (0.000)] 2024-10-12 22:21:03,467 - Train: 74.27% [278750/375300] [222.8/300.0] [batch_t 0.507 (0.447)] [data_t 0.016] [optim_t 0.492] [lr 0.000489] [CE 3.356 (3.148)] [KD 0.000 (0.000)] 2024-10-12 22:21:25,348 - Train: 74.29% [278800/375300] [222.9/300.0] [batch_t 0.402 (0.437)] [data_t 0.016] [optim_t 0.386] [lr 0.000489] [CE 2.935 (3.127)] [KD 0.000 (0.000)] 2024-10-12 22:21:47,414 - Train: 74.30% [278850/375300] [222.9/300.0] [batch_t 0.350 (0.441)] [data_t 0.015] [optim_t 0.335] [lr 0.000488] [CE 3.316 (3.170)] [KD 0.000 (0.000)] 2024-10-12 22:22:09,149 - Train: 74.31% [278900/375300] [222.9/300.0] [batch_t 0.461 (0.435)] [data_t 0.016] [optim_t 0.445] [lr 0.000488] [CE 2.962 (3.131)] [KD 0.000 (0.000)] 2024-10-12 22:22:30,966 - Train: 74.33% [278950/375300] [223.0/300.0] [batch_t 0.470 (0.436)] [data_t 0.016] [optim_t 0.454] [lr 0.000487] [CE 3.141 (3.129)] [KD 0.000 (0.000)] 2024-10-12 22:23:01,829 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.436)] [top1_cnt 39542] [top5_cnt 47474] [top_all 50000] 2024-10-12 22:23:01,829 - net: 79.084 (94.948) 2024-10-12 22:23:23,991 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.435)] [top1_cnt 40720] [top5_cnt 47942] [top_all 50000] 2024-10-12 22:23:23,991 - net_E: 81.440 (95.884) 2024-10-12 22:23:24,158 - Max [top1: 79.362 (epoch: 222)] [top1-ema: 81.440 (epoch: 223)] 2024-10-12 22:23:24,159 - ==> Total time: 1 day, 10:36:28 Eta: 11:56:59 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 22:23:41,500 - Train: 74.34% [279000/375300] [223.0/300.0] [batch_t 0.546 (0.469)] [data_t 0.247] [optim_t 0.299] [lr 0.000487] [CE 3.139 (3.106)] [KD 0.000 (0.000)] 2024-10-12 22:24:03,167 - Train: 74.35% [279050/375300] [223.1/300.0] [batch_t 0.459 (0.433)] [data_t 0.166] [optim_t 0.294] [lr 0.000486] [CE 3.237 (3.132)] [KD 0.000 (0.000)] 2024-10-12 22:24:24,611 - Train: 74.37% [279100/375300] [223.1/300.0] [batch_t 0.415 (0.429)] [data_t 0.117] [optim_t 0.298] [lr 0.000486] [CE 3.103 (3.149)] [KD 0.000 (0.000)] 2024-10-12 22:24:45,985 - Train: 74.38% [279150/375300] [223.1/300.0] [batch_t 0.402 (0.427)] [data_t 0.105] [optim_t 0.296] [lr 0.000486] [CE 3.146 (3.139)] [KD 0.000 (0.000)] 2024-10-12 22:25:06,962 - Train: 74.39% [279200/375300] [223.2/300.0] [batch_t 0.395 (0.419)] [data_t 0.015] [optim_t 0.380] [lr 0.000485] [CE 3.027 (3.152)] [KD 0.000 (0.000)] 2024-10-12 22:25:29,199 - Train: 74.41% [279250/375300] [223.2/300.0] [batch_t 0.469 (0.445)] [data_t 0.016] [optim_t 0.454] [lr 0.000485] [CE 3.026 (3.149)] [KD 0.000 (0.000)] 2024-10-12 22:25:51,399 - Train: 74.42% [279300/375300] [223.3/300.0] [batch_t 0.449 (0.444)] [data_t 0.015] [optim_t 0.434] [lr 0.000484] [CE 3.568 (3.145)] [KD 0.000 (0.000)] 2024-10-12 22:26:13,244 - Train: 74.43% [279350/375300] [223.3/300.0] [batch_t 0.485 (0.437)] [data_t 0.015] [optim_t 0.469] [lr 0.000484] [CE 2.953 (3.144)] [KD 0.000 (0.000)] 2024-10-12 22:26:34,742 - Train: 74.45% [279400/375300] [223.3/300.0] [batch_t 0.330 (0.430)] [data_t 0.015] [optim_t 0.315] [lr 0.000483] [CE 3.207 (3.174)] [KD 0.000 (0.000)] 2024-10-12 22:26:55,600 - Train: 74.46% [279450/375300] [223.4/300.0] [batch_t 0.312 (0.417)] [data_t 0.016] [optim_t 0.296] [lr 0.000483] [CE 3.300 (3.154)] [KD 0.000 (0.000)] 2024-10-12 22:27:17,149 - Train: 74.47% [279500/375300] [223.4/300.0] [batch_t 0.417 (0.431)] [data_t 0.015] [optim_t 0.402] [lr 0.000482] [CE 3.021 (3.155)] [KD 0.000 (0.000)] 2024-10-12 22:27:39,049 - Train: 74.49% [279550/375300] [223.5/300.0] [batch_t 0.426 (0.438)] [data_t 0.015] [optim_t 0.411] [lr 0.000482] [CE 3.004 (3.168)] [KD 0.000 (0.000)] 2024-10-12 22:28:00,871 - Train: 74.50% [279600/375300] [223.5/300.0] [batch_t 0.437 (0.436)] [data_t 0.015] [optim_t 0.421] [lr 0.000482] [CE 3.099 (3.153)] [KD 0.000 (0.000)] 2024-10-12 22:28:23,099 - Train: 74.51% [279650/375300] [223.5/300.0] [batch_t 0.489 (0.444)] [data_t 0.015] [optim_t 0.474] [lr 0.000481] [CE 2.840 (3.143)] [KD 0.000 (0.000)] 2024-10-12 22:28:45,035 - Train: 74.53% [279700/375300] [223.6/300.0] [batch_t 0.470 (0.439)] [data_t 0.015] [optim_t 0.454] [lr 0.000481] [CE 3.227 (3.157)] [KD 0.000 (0.000)] 2024-10-12 22:29:06,947 - Train: 74.54% [279750/375300] [223.6/300.0] [batch_t 0.384 (0.438)] [data_t 0.015] [optim_t 0.369] [lr 0.000480] [CE 3.135 (3.149)] [KD 0.000 (0.000)] 2024-10-12 22:29:28,638 - Train: 74.55% [279800/375300] [223.7/300.0] [batch_t 0.457 (0.434)] [data_t 0.016] [optim_t 0.441] [lr 0.000480] [CE 2.879 (3.164)] [KD 0.000 (0.000)] 2024-10-12 22:29:50,234 - Train: 74.57% [279850/375300] [223.7/300.0] [batch_t 0.433 (0.432)] [data_t 0.016] [optim_t 0.418] [lr 0.000479] [CE 3.185 (3.140)] [KD 0.000 (0.000)] 2024-10-12 22:30:11,677 - Train: 74.58% [279900/375300] [223.7/300.0] [batch_t 0.316 (0.429)] [data_t 0.015] [optim_t 0.301] [lr 0.000479] [CE 2.964 (3.142)] [KD 0.000 (0.000)] 2024-10-12 22:30:32,967 - Train: 74.59% [279950/375300] [223.8/300.0] [batch_t 0.315 (0.426)] [data_t 0.015] [optim_t 0.300] [lr 0.000478] [CE 3.180 (3.107)] [KD 0.000 (0.000)] 2024-10-12 22:30:54,409 - Train: 74.61% [280000/375300] [223.8/300.0] [batch_t 0.499 (0.429)] [data_t 0.016] [optim_t 0.483] [lr 0.000478] [CE 2.997 (3.141)] [KD 0.000 (0.000)] 2024-10-12 22:31:16,234 - Train: 74.62% [280050/375300] [223.9/300.0] [batch_t 0.864 (0.436)] [data_t 0.015] [optim_t 0.848] [lr 0.000478] [CE 2.795 (3.146)] [KD 0.000 (0.000)] 2024-10-12 22:31:37,858 - Train: 74.63% [280100/375300] [223.9/300.0] [batch_t 0.484 (0.432)] [data_t 0.016] [optim_t 0.468] [lr 0.000477] [CE 3.295 (3.153)] [KD 0.000 (0.000)] 2024-10-12 22:31:58,795 - Train: 74.65% [280150/375300] [223.9/300.0] [batch_t 0.448 (0.419)] [data_t 0.015] [optim_t 0.433] [lr 0.000477] [CE 2.985 (3.123)] [KD 0.000 (0.000)] 2024-10-12 22:32:20,859 - Train: 74.66% [280200/375300] [224.0/300.0] [batch_t 0.544 (0.441)] [data_t 0.016] [optim_t 0.528] [lr 0.000476] [CE 3.092 (3.138)] [KD 0.000 (0.000)] 2024-10-12 22:32:52,017 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.439)] [top1_cnt 39661] [top5_cnt 47419] [top_all 50000] 2024-10-12 22:32:52,017 - net: 79.322 (94.838) 2024-10-12 22:33:14,373 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.439)] [top1_cnt 40736] [top5_cnt 47941] [top_all 50000] 2024-10-12 22:33:14,373 - net_E: 81.472 (95.882) 2024-10-12 22:33:14,521 - Max [top1: 79.362 (epoch: 222)] [top1-ema: 81.472 (epoch: 224)] 2024-10-12 22:33:14,521 - ==> Total time: 1 day, 10:46:18 Eta: 11:47:51 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 22:33:31,581 - Train: 74.67% [280250/375300] [224.0/300.0] [batch_t 0.320 (0.455)] [data_t 0.016] [optim_t 0.305] [lr 0.000476] [CE 2.884 (3.081)] [KD 0.000 (0.000)] 2024-10-12 22:33:52,894 - Train: 74.69% [280300/375300] [224.1/300.0] [batch_t 0.427 (0.426)] [data_t 0.015] [optim_t 0.412] [lr 0.000475] [CE 3.496 (3.136)] [KD 0.000 (0.000)] 2024-10-12 22:34:15,056 - Train: 74.70% [280350/375300] [224.1/300.0] [batch_t 0.465 (0.443)] [data_t 0.015] [optim_t 0.450] [lr 0.000475] [CE 3.156 (3.110)] [KD 0.000 (0.000)] 2024-10-12 22:34:36,221 - Train: 74.71% [280400/375300] [224.1/300.0] [batch_t 0.418 (0.423)] [data_t 0.016] [optim_t 0.402] [lr 0.000474] [CE 3.137 (3.101)] [KD 0.000 (0.000)] 2024-10-12 22:34:58,012 - Train: 74.73% [280450/375300] [224.2/300.0] [batch_t 0.536 (0.436)] [data_t 0.016] [optim_t 0.520] [lr 0.000474] [CE 2.930 (3.135)] [KD 0.000 (0.000)] 2024-10-12 22:35:20,441 - Train: 74.74% [280500/375300] [224.2/300.0] [batch_t 0.475 (0.448)] [data_t 0.015] [optim_t 0.460] [lr 0.000474] [CE 3.265 (3.082)] [KD 0.000 (0.000)] 2024-10-12 22:35:41,362 - Train: 74.75% [280550/375300] [224.3/300.0] [batch_t 0.391 (0.418)] [data_t 0.016] [optim_t 0.375] [lr 0.000473] [CE 3.174 (3.115)] [KD 0.000 (0.000)] 2024-10-12 22:36:02,330 - Train: 74.77% [280600/375300] [224.3/300.0] [batch_t 0.431 (0.419)] [data_t 0.016] [optim_t 0.416] [lr 0.000473] [CE 3.327 (3.095)] [KD 0.000 (0.000)] 2024-10-12 22:36:22,944 - Train: 74.78% [280650/375300] [224.3/300.0] [batch_t 0.315 (0.412)] [data_t 0.015] [optim_t 0.300] [lr 0.000472] [CE 3.099 (3.113)] [KD 0.000 (0.000)] 2024-10-12 22:36:44,343 - Train: 74.79% [280700/375300] [224.4/300.0] [batch_t 0.411 (0.428)] [data_t 0.016] [optim_t 0.395] [lr 0.000472] [CE 3.332 (3.114)] [KD 0.000 (0.000)] 2024-10-12 22:37:05,846 - Train: 74.81% [280750/375300] [224.4/300.0] [batch_t 0.416 (0.430)] [data_t 0.015] [optim_t 0.400] [lr 0.000471] [CE 3.243 (3.162)] [KD 0.000 (0.000)] 2024-10-12 22:37:27,107 - Train: 74.82% [280800/375300] [224.5/300.0] [batch_t 0.419 (0.425)] [data_t 0.016] [optim_t 0.403] [lr 0.000471] [CE 3.211 (3.151)] [KD 0.000 (0.000)] 2024-10-12 22:37:48,222 - Train: 74.83% [280850/375300] [224.5/300.0] [batch_t 0.399 (0.422)] [data_t 0.016] [optim_t 0.383] [lr 0.000470] [CE 3.104 (3.150)] [KD 0.000 (0.000)] 2024-10-12 22:38:09,693 - Train: 74.85% [280900/375300] [224.5/300.0] [batch_t 0.438 (0.429)] [data_t 0.015] [optim_t 0.422] [lr 0.000470] [CE 2.830 (3.140)] [KD 0.000 (0.000)] 2024-10-12 22:38:30,910 - Train: 74.86% [280950/375300] [224.6/300.0] [batch_t 0.401 (0.424)] [data_t 0.015] [optim_t 0.386] [lr 0.000470] [CE 3.265 (3.114)] [KD 0.000 (0.000)] 2024-10-12 22:38:52,946 - Train: 74.87% [281000/375300] [224.6/300.0] [batch_t 0.439 (0.441)] [data_t 0.016] [optim_t 0.423] [lr 0.000469] [CE 3.091 (3.142)] [KD 0.000 (0.000)] 2024-10-12 22:39:14,895 - Train: 74.89% [281050/375300] [224.7/300.0] [batch_t 0.469 (0.439)] [data_t 0.016] [optim_t 0.454] [lr 0.000469] [CE 3.429 (3.123)] [KD 0.000 (0.000)] 2024-10-12 22:39:36,867 - Train: 74.90% [281100/375300] [224.7/300.0] [batch_t 0.461 (0.439)] [data_t 0.016] [optim_t 0.445] [lr 0.000468] [CE 3.194 (3.113)] [KD 0.000 (0.000)] 2024-10-12 22:39:57,960 - Train: 74.91% [281150/375300] [224.7/300.0] [batch_t 0.388 (0.422)] [data_t 0.015] [optim_t 0.372] [lr 0.000468] [CE 3.118 (3.111)] [KD 0.000 (0.000)] 2024-10-12 22:40:18,815 - Train: 74.93% [281200/375300] [224.8/300.0] [batch_t 0.379 (0.417)] [data_t 0.016] [optim_t 0.363] [lr 0.000467] [CE 3.404 (3.148)] [KD 0.000 (0.000)] 2024-10-12 22:40:40,607 - Train: 74.94% [281250/375300] [224.8/300.0] [batch_t 0.447 (0.436)] [data_t 0.015] [optim_t 0.432] [lr 0.000467] [CE 3.171 (3.131)] [KD 0.000 (0.000)] 2024-10-12 22:41:02,542 - Train: 74.95% [281300/375300] [224.9/300.0] [batch_t 0.489 (0.439)] [data_t 0.015] [optim_t 0.474] [lr 0.000466] [CE 3.083 (3.072)] [KD 0.000 (0.000)] 2024-10-12 22:41:24,432 - Train: 74.97% [281350/375300] [224.9/300.0] [batch_t 0.313 (0.438)] [data_t 0.015] [optim_t 0.298] [lr 0.000466] [CE 3.024 (3.164)] [KD 0.000 (0.000)] 2024-10-12 22:41:45,971 - Train: 74.98% [281400/375300] [224.9/300.0] [batch_t 0.506 (0.431)] [data_t 0.015] [optim_t 0.490] [lr 0.000466] [CE 3.104 (3.145)] [KD 0.000 (0.000)] 2024-10-12 22:42:07,737 - Train: 74.99% [281450/375300] [225.0/300.0] [batch_t 0.438 (0.435)] [data_t 0.015] [optim_t 0.422] [lr 0.000465] [CE 2.891 (3.169)] [KD 0.000 (0.000)] 2024-10-12 22:42:38,818 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.425)] [top1_cnt 39724] [top5_cnt 47515] [top_all 50000] 2024-10-12 22:42:38,819 - net: 79.448 (95.030) 2024-10-12 22:43:00,734 - Test (net_E): 100.00% [50/50] [batch_t 0.141 (0.432)] [top1_cnt 40745] [top5_cnt 47946] [top_all 50000] 2024-10-12 22:43:00,735 - net_E: 81.490 (95.892) 2024-10-12 22:43:00,891 - Max [top1: 79.448 (epoch: 225)] [top1-ema: 81.490 (epoch: 225)] 2024-10-12 22:43:00,892 - ==> Total time: 1 day, 10:56:04 Eta: 11:38:41 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 22:43:20,849 - Train: 75.01% [281500/375300] [225.0/300.0] [batch_t 0.620 (0.426)] [data_t 0.321] [optim_t 0.299] [lr 0.000465] [CE 3.174 (3.069)] [KD 0.000 (0.000)] 2024-10-12 22:43:42,075 - Train: 75.02% [281550/375300] [225.1/300.0] [batch_t 0.464 (0.424)] [data_t 0.016] [optim_t 0.448] [lr 0.000464] [CE 3.227 (3.114)] [KD 0.000 (0.000)] 2024-10-12 22:44:04,604 - Train: 75.03% [281600/375300] [225.1/300.0] [batch_t 0.490 (0.450)] [data_t 0.195] [optim_t 0.295] [lr 0.000464] [CE 3.235 (3.131)] [KD 0.000 (0.000)] 2024-10-12 22:44:27,580 - Train: 75.05% [281650/375300] [225.1/300.0] [batch_t 0.420 (0.459)] [data_t 0.126] [optim_t 0.293] [lr 0.000463] [CE 3.268 (3.139)] [KD 0.000 (0.000)] 2024-10-12 22:44:49,993 - Train: 75.06% [281700/375300] [225.2/300.0] [batch_t 0.499 (0.448)] [data_t 0.165] [optim_t 0.334] [lr 0.000463] [CE 3.236 (3.108)] [KD 0.000 (0.000)] 2024-10-12 22:45:12,393 - Train: 75.07% [281750/375300] [225.2/300.0] [batch_t 0.376 (0.448)] [data_t 0.079] [optim_t 0.297] [lr 0.000463] [CE 3.305 (3.110)] [KD 0.000 (0.000)] 2024-10-12 22:45:34,338 - Train: 75.09% [281800/375300] [225.3/300.0] [batch_t 0.415 (0.439)] [data_t 0.119] [optim_t 0.297] [lr 0.000462] [CE 2.854 (3.095)] [KD 0.000 (0.000)] 2024-10-12 22:45:56,378 - Train: 75.10% [281850/375300] [225.3/300.0] [batch_t 0.720 (0.441)] [data_t 0.414] [optim_t 0.306] [lr 0.000462] [CE 3.038 (3.116)] [KD 0.000 (0.000)] 2024-10-12 22:46:18,520 - Train: 75.11% [281900/375300] [225.3/300.0] [batch_t 0.320 (0.443)] [data_t 0.016] [optim_t 0.304] [lr 0.000461] [CE 3.154 (3.157)] [KD 0.000 (0.000)] 2024-10-12 22:46:41,705 - Train: 75.13% [281950/375300] [225.4/300.0] [batch_t 0.386 (0.464)] [data_t 0.091] [optim_t 0.294] [lr 0.000461] [CE 2.965 (3.090)] [KD 0.000 (0.000)] 2024-10-12 22:47:04,226 - Train: 75.14% [282000/375300] [225.4/300.0] [batch_t 0.377 (0.450)] [data_t 0.056] [optim_t 0.321] [lr 0.000460] [CE 3.121 (3.104)] [KD 0.000 (0.000)] 2024-10-12 22:47:27,300 - Train: 75.15% [282050/375300] [225.5/300.0] [batch_t 0.490 (0.461)] [data_t 0.194] [optim_t 0.296] [lr 0.000460] [CE 3.161 (3.190)] [KD 0.000 (0.000)] 2024-10-12 22:47:49,615 - Train: 75.17% [282100/375300] [225.5/300.0] [batch_t 0.440 (0.446)] [data_t 0.145] [optim_t 0.296] [lr 0.000459] [CE 3.141 (3.131)] [KD 0.000 (0.000)] 2024-10-12 22:48:11,219 - Train: 75.18% [282150/375300] [225.5/300.0] [batch_t 0.474 (0.432)] [data_t 0.158] [optim_t 0.316] [lr 0.000459] [CE 3.011 (3.118)] [KD 0.000 (0.000)] 2024-10-12 22:48:32,699 - Train: 75.19% [282200/375300] [225.6/300.0] [batch_t 0.516 (0.429)] [data_t 0.015] [optim_t 0.501] [lr 0.000459] [CE 3.261 (3.142)] [KD 0.000 (0.000)] 2024-10-12 22:48:54,981 - Train: 75.21% [282250/375300] [225.6/300.0] [batch_t 0.431 (0.446)] [data_t 0.016] [optim_t 0.416] [lr 0.000458] [CE 3.426 (3.153)] [KD 0.000 (0.000)] 2024-10-12 22:49:17,415 - Train: 75.22% [282300/375300] [225.7/300.0] [batch_t 0.496 (0.449)] [data_t 0.016] [optim_t 0.480] [lr 0.000458] [CE 3.483 (3.149)] [KD 0.000 (0.000)] 2024-10-12 22:49:38,920 - Train: 75.23% [282350/375300] [225.7/300.0] [batch_t 0.450 (0.430)] [data_t 0.016] [optim_t 0.435] [lr 0.000457] [CE 3.069 (3.123)] [KD 0.000 (0.000)] 2024-10-12 22:50:01,065 - Train: 75.25% [282400/375300] [225.7/300.0] [batch_t 0.411 (0.443)] [data_t 0.114] [optim_t 0.297] [lr 0.000457] [CE 3.440 (3.125)] [KD 0.000 (0.000)] 2024-10-12 22:50:24,490 - Train: 75.26% [282450/375300] [225.8/300.0] [batch_t 0.484 (0.468)] [data_t 0.016] [optim_t 0.469] [lr 0.000456] [CE 3.237 (3.088)] [KD 0.000 (0.000)] 2024-10-12 22:50:45,968 - Train: 75.27% [282500/375300] [225.8/300.0] [batch_t 0.384 (0.429)] [data_t 0.016] [optim_t 0.369] [lr 0.000456] [CE 2.886 (3.195)] [KD 0.000 (0.000)] 2024-10-12 22:51:07,249 - Train: 75.29% [282550/375300] [225.9/300.0] [batch_t 0.438 (0.426)] [data_t 0.015] [optim_t 0.423] [lr 0.000456] [CE 3.134 (3.121)] [KD 0.000 (0.000)] 2024-10-12 22:51:28,338 - Train: 75.30% [282600/375300] [225.9/300.0] [batch_t 0.464 (0.422)] [data_t 0.016] [optim_t 0.448] [lr 0.000455] [CE 3.074 (3.120)] [KD 0.000 (0.000)] 2024-10-12 22:51:49,967 - Train: 75.31% [282650/375300] [225.9/300.0] [batch_t 0.366 (0.432)] [data_t 0.068] [optim_t 0.298] [lr 0.000455] [CE 3.101 (3.128)] [KD 0.000 (0.000)] 2024-10-12 22:52:11,611 - Train: 75.33% [282700/375300] [226.0/300.0] [batch_t 0.481 (0.433)] [data_t 0.015] [optim_t 0.466] [lr 0.000454] [CE 3.182 (3.128)] [KD 0.000 (0.000)] 2024-10-12 22:52:45,268 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.470)] [top1_cnt 39808] [top5_cnt 47502] [top_all 50000] 2024-10-12 22:52:45,269 - net: 79.616 (95.004) 2024-10-12 22:53:07,561 - Test (net_E): 100.00% [50/50] [batch_t 0.133 (0.439)] [top1_cnt 40787] [top5_cnt 47925] [top_all 50000] 2024-10-12 22:53:07,562 - net_E: 81.574 (95.850) 2024-10-12 22:53:07,806 - Max [top1: 79.616 (epoch: 226)] [top1-ema: 81.574 (epoch: 226)] 2024-10-12 22:53:07,807 - ==> Total time: 1 day, 11:06:11 Eta: 11:29:38 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 22:53:24,293 - Train: 75.34% [282750/375300] [226.0/300.0] [batch_t 0.320 (0.416)] [data_t 0.016] [optim_t 0.305] [lr 0.000454] [CE 3.105 (3.127)] [KD 0.000 (0.000)] 2024-10-12 22:53:46,147 - Train: 75.35% [282800/375300] [226.1/300.0] [batch_t 0.312 (0.437)] [data_t 0.015] [optim_t 0.297] [lr 0.000453] [CE 3.024 (3.112)] [KD 0.000 (0.000)] 2024-10-12 22:54:07,721 - Train: 75.37% [282850/375300] [226.1/300.0] [batch_t 0.466 (0.431)] [data_t 0.016] [optim_t 0.450] [lr 0.000453] [CE 3.160 (3.080)] [KD 0.000 (0.000)] 2024-10-12 22:54:28,988 - Train: 75.38% [282900/375300] [226.1/300.0] [batch_t 0.447 (0.425)] [data_t 0.016] [optim_t 0.432] [lr 0.000453] [CE 3.026 (3.106)] [KD 0.000 (0.000)] 2024-10-12 22:54:50,750 - Train: 75.39% [282950/375300] [226.2/300.0] [batch_t 0.442 (0.435)] [data_t 0.016] [optim_t 0.426] [lr 0.000452] [CE 3.233 (3.124)] [KD 0.000 (0.000)] 2024-10-12 22:55:13,249 - Train: 75.41% [283000/375300] [226.2/300.0] [batch_t 0.434 (0.450)] [data_t 0.016] [optim_t 0.418] [lr 0.000452] [CE 2.807 (3.104)] [KD 0.000 (0.000)] 2024-10-12 22:55:34,941 - Train: 75.42% [283050/375300] [226.3/300.0] [batch_t 0.312 (0.434)] [data_t 0.016] [optim_t 0.296] [lr 0.000451] [CE 3.005 (3.081)] [KD 0.000 (0.000)] 2024-10-12 22:55:56,410 - Train: 75.43% [283100/375300] [226.3/300.0] [batch_t 0.443 (0.429)] [data_t 0.016] [optim_t 0.427] [lr 0.000451] [CE 3.127 (3.077)] [KD 0.000 (0.000)] 2024-10-12 22:56:19,302 - Train: 75.45% [283150/375300] [226.3/300.0] [batch_t 0.444 (0.458)] [data_t 0.016] [optim_t 0.428] [lr 0.000450] [CE 3.071 (3.121)] [KD 0.000 (0.000)] 2024-10-12 22:56:41,066 - Train: 75.46% [283200/375300] [226.4/300.0] [batch_t 0.489 (0.435)] [data_t 0.015] [optim_t 0.473] [lr 0.000450] [CE 3.105 (3.139)] [KD 0.000 (0.000)] 2024-10-12 22:57:01,978 - Train: 75.47% [283250/375300] [226.4/300.0] [batch_t 0.386 (0.418)] [data_t 0.015] [optim_t 0.371] [lr 0.000449] [CE 3.043 (3.114)] [KD 0.000 (0.000)] 2024-10-12 22:57:23,359 - Train: 75.49% [283300/375300] [226.5/300.0] [batch_t 0.411 (0.427)] [data_t 0.016] [optim_t 0.395] [lr 0.000449] [CE 2.670 (3.088)] [KD 0.000 (0.000)] 2024-10-12 22:57:45,316 - Train: 75.50% [283350/375300] [226.5/300.0] [batch_t 0.480 (0.439)] [data_t 0.015] [optim_t 0.465] [lr 0.000449] [CE 3.143 (3.087)] [KD 0.000 (0.000)] 2024-10-12 22:58:06,873 - Train: 75.51% [283400/375300] [226.5/300.0] [batch_t 0.505 (0.431)] [data_t 0.015] [optim_t 0.489] [lr 0.000448] [CE 3.080 (3.096)] [KD 0.000 (0.000)] 2024-10-12 22:58:29,007 - Train: 75.53% [283450/375300] [226.6/300.0] [batch_t 0.495 (0.443)] [data_t 0.015] [optim_t 0.480] [lr 0.000448] [CE 3.130 (3.110)] [KD 0.000 (0.000)] 2024-10-12 22:58:51,774 - Train: 75.54% [283500/375300] [226.6/300.0] [batch_t 0.432 (0.455)] [data_t 0.015] [optim_t 0.417] [lr 0.000447] [CE 2.906 (3.130)] [KD 0.000 (0.000)] 2024-10-12 22:59:14,286 - Train: 75.55% [283550/375300] [226.7/300.0] [batch_t 0.428 (0.450)] [data_t 0.015] [optim_t 0.413] [lr 0.000447] [CE 3.358 (3.170)] [KD 0.000 (0.000)] 2024-10-12 22:59:36,679 - Train: 75.57% [283600/375300] [226.7/300.0] [batch_t 0.387 (0.448)] [data_t 0.015] [optim_t 0.372] [lr 0.000446] [CE 3.191 (3.124)] [KD 0.000 (0.000)] 2024-10-12 22:59:59,283 - Train: 75.58% [283650/375300] [226.7/300.0] [batch_t 0.419 (0.452)] [data_t 0.016] [optim_t 0.403] [lr 0.000446] [CE 2.949 (3.105)] [KD 0.000 (0.000)] 2024-10-12 23:00:22,219 - Train: 75.59% [283700/375300] [226.8/300.0] [batch_t 0.362 (0.459)] [data_t 0.016] [optim_t 0.347] [lr 0.000446] [CE 3.131 (3.117)] [KD 0.000 (0.000)] 2024-10-12 23:00:44,271 - Train: 75.61% [283750/375300] [226.8/300.0] [batch_t 0.393 (0.441)] [data_t 0.016] [optim_t 0.377] [lr 0.000445] [CE 3.301 (3.126)] [KD 0.000 (0.000)] 2024-10-12 23:01:05,606 - Train: 75.62% [283800/375300] [226.9/300.0] [batch_t 0.399 (0.427)] [data_t 0.016] [optim_t 0.383] [lr 0.000445] [CE 3.101 (3.130)] [KD 0.000 (0.000)] 2024-10-12 23:01:26,987 - Train: 75.63% [283850/375300] [226.9/300.0] [batch_t 0.445 (0.427)] [data_t 0.015] [optim_t 0.429] [lr 0.000444] [CE 3.250 (3.126)] [KD 0.000 (0.000)] 2024-10-12 23:01:48,376 - Train: 75.65% [283900/375300] [226.9/300.0] [batch_t 0.377 (0.428)] [data_t 0.016] [optim_t 0.361] [lr 0.000444] [CE 3.331 (3.106)] [KD 0.000 (0.000)] 2024-10-12 23:02:09,764 - Train: 75.66% [283950/375300] [227.0/300.0] [batch_t 0.397 (0.428)] [data_t 0.016] [optim_t 0.381] [lr 0.000443] [CE 3.172 (3.130)] [KD 0.000 (0.000)] 2024-10-12 23:02:42,778 - Test (net): 100.00% [50/50] [batch_t 0.134 (0.441)] [top1_cnt 39812] [top5_cnt 47540] [top_all 50000] 2024-10-12 23:02:42,778 - net: 79.624 (95.080) 2024-10-12 23:03:04,246 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.423)] [top1_cnt 40846] [top5_cnt 47914] [top_all 50000] 2024-10-12 23:03:04,246 - net_E: 81.692 (95.828) 2024-10-12 23:03:04,419 - Max [top1: 79.624 (epoch: 227)] [top1-ema: 81.692 (epoch: 227)] 2024-10-12 23:03:04,419 - ==> Total time: 1 day, 11:16:08 Eta: 11:20:31 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 23:03:21,947 - Train: 75.67% [284000/375300] [227.0/300.0] [batch_t 0.320 (0.427)] [data_t 0.016] [optim_t 0.304] [lr 0.000443] [CE 3.132 (3.157)] [KD 0.000 (0.000)] 2024-10-12 23:03:43,551 - Train: 75.69% [284050/375300] [227.1/300.0] [batch_t 0.466 (0.432)] [data_t 0.167] [optim_t 0.299] [lr 0.000443] [CE 3.415 (3.086)] [KD 0.000 (0.000)] 2024-10-12 23:04:05,904 - Train: 75.70% [284100/375300] [227.1/300.0] [batch_t 0.472 (0.447)] [data_t 0.180] [optim_t 0.292] [lr 0.000442] [CE 3.098 (3.054)] [KD 0.000 (0.000)] 2024-10-12 23:04:28,246 - Train: 75.71% [284150/375300] [227.1/300.0] [batch_t 0.310 (0.447)] [data_t 0.015] [optim_t 0.295] [lr 0.000442] [CE 3.391 (3.141)] [KD 0.000 (0.000)] 2024-10-12 23:04:50,148 - Train: 75.73% [284200/375300] [227.2/300.0] [batch_t 0.467 (0.438)] [data_t 0.167] [optim_t 0.300] [lr 0.000441] [CE 3.076 (3.100)] [KD 0.000 (0.000)] 2024-10-12 23:05:11,428 - Train: 75.74% [284250/375300] [227.2/300.0] [batch_t 0.423 (0.425)] [data_t 0.129] [optim_t 0.295] [lr 0.000441] [CE 2.956 (3.092)] [KD 0.000 (0.000)] 2024-10-12 23:05:32,629 - Train: 75.75% [284300/375300] [227.3/300.0] [batch_t 0.386 (0.424)] [data_t 0.089] [optim_t 0.297] [lr 0.000440] [CE 3.293 (3.121)] [KD 0.000 (0.000)] 2024-10-12 23:05:53,883 - Train: 75.77% [284350/375300] [227.3/300.0] [batch_t 0.454 (0.425)] [data_t 0.016] [optim_t 0.438] [lr 0.000440] [CE 3.089 (3.163)] [KD 0.000 (0.000)] 2024-10-12 23:06:14,808 - Train: 75.78% [284400/375300] [227.3/300.0] [batch_t 0.407 (0.418)] [data_t 0.016] [optim_t 0.391] [lr 0.000440] [CE 2.708 (3.069)] [KD 0.000 (0.000)] 2024-10-12 23:06:35,888 - Train: 75.79% [284450/375300] [227.4/300.0] [batch_t 0.313 (0.421)] [data_t 0.015] [optim_t 0.297] [lr 0.000439] [CE 2.901 (3.114)] [KD 0.000 (0.000)] 2024-10-12 23:06:57,444 - Train: 75.81% [284500/375300] [227.4/300.0] [batch_t 0.398 (0.431)] [data_t 0.015] [optim_t 0.382] [lr 0.000439] [CE 2.905 (3.092)] [KD 0.000 (0.000)] 2024-10-12 23:07:18,639 - Train: 75.82% [284550/375300] [227.5/300.0] [batch_t 0.362 (0.424)] [data_t 0.015] [optim_t 0.346] [lr 0.000438] [CE 3.201 (3.105)] [KD 0.000 (0.000)] 2024-10-12 23:07:40,758 - Train: 75.83% [284600/375300] [227.5/300.0] [batch_t 0.435 (0.442)] [data_t 0.142] [optim_t 0.293] [lr 0.000438] [CE 3.217 (3.120)] [KD 0.000 (0.000)] 2024-10-12 23:08:02,629 - Train: 75.85% [284650/375300] [227.5/300.0] [batch_t 0.427 (0.437)] [data_t 0.128] [optim_t 0.299] [lr 0.000437] [CE 3.013 (3.095)] [KD 0.000 (0.000)] 2024-10-12 23:08:24,864 - Train: 75.86% [284700/375300] [227.6/300.0] [batch_t 0.388 (0.445)] [data_t 0.092] [optim_t 0.296] [lr 0.000437] [CE 3.060 (3.084)] [KD 0.000 (0.000)] 2024-10-12 23:08:46,313 - Train: 75.87% [284750/375300] [227.6/300.0] [batch_t 0.403 (0.429)] [data_t 0.108] [optim_t 0.296] [lr 0.000437] [CE 3.166 (3.112)] [KD 0.000 (0.000)] 2024-10-12 23:09:06,999 - Train: 75.89% [284800/375300] [227.7/300.0] [batch_t 0.436 (0.414)] [data_t 0.136] [optim_t 0.299] [lr 0.000436] [CE 2.989 (3.122)] [KD 0.000 (0.000)] 2024-10-12 23:09:28,510 - Train: 75.90% [284850/375300] [227.7/300.0] [batch_t 0.403 (0.430)] [data_t 0.016] [optim_t 0.388] [lr 0.000436] [CE 3.231 (3.098)] [KD 0.000 (0.000)] 2024-10-12 23:09:50,833 - Train: 75.91% [284900/375300] [227.7/300.0] [batch_t 0.421 (0.446)] [data_t 0.016] [optim_t 0.405] [lr 0.000435] [CE 2.731 (3.135)] [KD 0.000 (0.000)] 2024-10-12 23:10:12,505 - Train: 75.93% [284950/375300] [227.8/300.0] [batch_t 0.475 (0.433)] [data_t 0.016] [optim_t 0.459] [lr 0.000435] [CE 3.095 (3.131)] [KD 0.000 (0.000)] 2024-10-12 23:10:34,090 - Train: 75.94% [285000/375300] [227.8/300.0] [batch_t 0.416 (0.432)] [data_t 0.015] [optim_t 0.401] [lr 0.000434] [CE 3.398 (3.116)] [KD 0.000 (0.000)] 2024-10-12 23:10:54,945 - Train: 75.95% [285050/375300] [227.9/300.0] [batch_t 0.521 (0.417)] [data_t 0.016] [optim_t 0.505] [lr 0.000434] [CE 3.261 (3.120)] [KD 0.000 (0.000)] 2024-10-12 23:11:16,212 - Train: 75.97% [285100/375300] [227.9/300.0] [batch_t 0.436 (0.425)] [data_t 0.015] [optim_t 0.420] [lr 0.000434] [CE 2.849 (3.144)] [KD 0.000 (0.000)] 2024-10-12 23:11:38,049 - Train: 75.98% [285150/375300] [227.9/300.0] [batch_t 0.466 (0.437)] [data_t 0.016] [optim_t 0.450] [lr 0.000433] [CE 3.068 (3.095)] [KD 0.000 (0.000)] 2024-10-12 23:12:00,647 - Train: 75.99% [285200/375300] [228.0/300.0] [batch_t 1.002 (0.452)] [data_t 0.016] [optim_t 0.987] [lr 0.000433] [CE 3.221 (3.083)] [KD 0.000 (0.000)] 2024-10-12 23:12:33,722 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.454)] [top1_cnt 39837] [top5_cnt 47525] [top_all 50000] 2024-10-12 23:12:33,722 - net: 79.674 (95.050) 2024-10-12 23:12:55,773 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.434)] [top1_cnt 40877] [top5_cnt 47932] [top_all 50000] 2024-10-12 23:12:55,773 - net_E: 81.754 (95.864) 2024-10-12 23:12:56,005 - Max [top1: 79.674 (epoch: 228)] [top1-ema: 81.754 (epoch: 228)] 2024-10-12 23:12:56,006 - ==> Total time: 1 day, 11:25:59 Eta: 11:11:22 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 23:13:12,034 - Train: 76.01% [285250/375300] [228.0/300.0] [batch_t 0.317 (0.425)] [data_t 0.015] [optim_t 0.302] [lr 0.000432] [CE 3.119 (3.108)] [KD 0.000 (0.000)] 2024-10-12 23:13:33,262 - Train: 76.02% [285300/375300] [228.1/300.0] [batch_t 0.438 (0.424)] [data_t 0.015] [optim_t 0.422] [lr 0.000432] [CE 3.088 (3.094)] [KD 0.000 (0.000)] 2024-10-12 23:13:55,583 - Train: 76.03% [285350/375300] [228.1/300.0] [batch_t 0.443 (0.446)] [data_t 0.015] [optim_t 0.428] [lr 0.000431] [CE 2.787 (3.073)] [KD 0.000 (0.000)] 2024-10-12 23:14:17,872 - Train: 76.05% [285400/375300] [228.1/300.0] [batch_t 0.423 (0.446)] [data_t 0.015] [optim_t 0.407] [lr 0.000431] [CE 3.199 (3.116)] [KD 0.000 (0.000)] 2024-10-12 23:14:39,933 - Train: 76.06% [285450/375300] [228.2/300.0] [batch_t 0.432 (0.441)] [data_t 0.015] [optim_t 0.416] [lr 0.000431] [CE 2.943 (3.116)] [KD 0.000 (0.000)] 2024-10-12 23:15:02,072 - Train: 76.07% [285500/375300] [228.2/300.0] [batch_t 0.614 (0.443)] [data_t 0.015] [optim_t 0.599] [lr 0.000430] [CE 3.203 (3.079)] [KD 0.000 (0.000)] 2024-10-12 23:15:23,460 - Train: 76.09% [285550/375300] [228.3/300.0] [batch_t 0.462 (0.428)] [data_t 0.015] [optim_t 0.446] [lr 0.000430] [CE 3.227 (3.073)] [KD 0.000 (0.000)] 2024-10-12 23:15:44,943 - Train: 76.10% [285600/375300] [228.3/300.0] [batch_t 0.398 (0.430)] [data_t 0.015] [optim_t 0.383] [lr 0.000429] [CE 3.071 (3.137)] [KD 0.000 (0.000)] 2024-10-12 23:16:07,016 - Train: 76.11% [285650/375300] [228.3/300.0] [batch_t 0.532 (0.441)] [data_t 0.016] [optim_t 0.517] [lr 0.000429] [CE 3.023 (3.085)] [KD 0.000 (0.000)] 2024-10-12 23:16:29,032 - Train: 76.13% [285700/375300] [228.4/300.0] [batch_t 0.318 (0.440)] [data_t 0.016] [optim_t 0.302] [lr 0.000428] [CE 3.376 (3.089)] [KD 0.000 (0.000)] 2024-10-12 23:16:51,493 - Train: 76.14% [285750/375300] [228.4/300.0] [batch_t 0.472 (0.449)] [data_t 0.016] [optim_t 0.456] [lr 0.000428] [CE 3.088 (3.139)] [KD 0.000 (0.000)] 2024-10-12 23:17:13,765 - Train: 76.15% [285800/375300] [228.5/300.0] [batch_t 0.442 (0.445)] [data_t 0.015] [optim_t 0.427] [lr 0.000428] [CE 2.930 (3.076)] [KD 0.000 (0.000)] 2024-10-12 23:17:35,673 - Train: 76.17% [285850/375300] [228.5/300.0] [batch_t 0.422 (0.438)] [data_t 0.015] [optim_t 0.406] [lr 0.000427] [CE 3.136 (3.074)] [KD 0.000 (0.000)] 2024-10-12 23:17:57,877 - Train: 76.18% [285900/375300] [228.5/300.0] [batch_t 0.459 (0.444)] [data_t 0.016] [optim_t 0.444] [lr 0.000427] [CE 3.277 (3.130)] [KD 0.000 (0.000)] 2024-10-12 23:18:19,755 - Train: 76.19% [285950/375300] [228.6/300.0] [batch_t 0.540 (0.437)] [data_t 0.015] [optim_t 0.525] [lr 0.000426] [CE 3.248 (3.122)] [KD 0.000 (0.000)] 2024-10-12 23:18:42,163 - Train: 76.21% [286000/375300] [228.6/300.0] [batch_t 0.319 (0.448)] [data_t 0.016] [optim_t 0.303] [lr 0.000426] [CE 3.063 (3.086)] [KD 0.000 (0.000)] 2024-10-12 23:19:03,894 - Train: 76.22% [286050/375300] [228.7/300.0] [batch_t 0.481 (0.435)] [data_t 0.186] [optim_t 0.295] [lr 0.000426] [CE 2.738 (3.132)] [KD 0.000 (0.000)] 2024-10-12 23:19:25,744 - Train: 76.23% [286100/375300] [228.7/300.0] [batch_t 0.483 (0.437)] [data_t 0.186] [optim_t 0.297] [lr 0.000425] [CE 3.065 (3.109)] [KD 0.000 (0.000)] 2024-10-12 23:19:47,473 - Train: 76.25% [286150/375300] [228.7/300.0] [batch_t 0.437 (0.434)] [data_t 0.016] [optim_t 0.421] [lr 0.000425] [CE 2.782 (3.115)] [KD 0.000 (0.000)] 2024-10-12 23:20:09,713 - Train: 76.26% [286200/375300] [228.8/300.0] [batch_t 0.317 (0.445)] [data_t 0.015] [optim_t 0.302] [lr 0.000424] [CE 3.004 (3.137)] [KD 0.000 (0.000)] 2024-10-12 23:20:32,198 - Train: 76.27% [286250/375300] [228.8/300.0] [batch_t 0.417 (0.450)] [data_t 0.015] [optim_t 0.401] [lr 0.000424] [CE 2.902 (3.055)] [KD 0.000 (0.000)] 2024-10-12 23:20:54,478 - Train: 76.29% [286300/375300] [228.9/300.0] [batch_t 0.458 (0.445)] [data_t 0.015] [optim_t 0.442] [lr 0.000423] [CE 3.296 (3.092)] [KD 0.000 (0.000)] 2024-10-12 23:21:16,439 - Train: 76.30% [286350/375300] [228.9/300.0] [batch_t 0.319 (0.439)] [data_t 0.015] [optim_t 0.303] [lr 0.000423] [CE 3.174 (3.144)] [KD 0.000 (0.000)] 2024-10-12 23:21:38,291 - Train: 76.31% [286400/375300] [228.9/300.0] [batch_t 0.367 (0.437)] [data_t 0.015] [optim_t 0.352] [lr 0.000423] [CE 3.090 (3.136)] [KD 0.000 (0.000)] 2024-10-12 23:21:59,691 - Train: 76.33% [286450/375300] [229.0/300.0] [batch_t 0.497 (0.428)] [data_t 0.016] [optim_t 0.482] [lr 0.000422] [CE 2.960 (3.080)] [KD 0.000 (0.000)] 2024-10-12 23:22:32,802 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.438)] [top1_cnt 39784] [top5_cnt 47535] [top_all 50000] 2024-10-12 23:22:32,802 - net: 79.568 (95.070) 2024-10-12 23:22:54,950 - Test (net_E): 100.00% [50/50] [batch_t 0.130 (0.436)] [top1_cnt 40875] [top5_cnt 47941] [top_all 50000] 2024-10-12 23:22:54,951 - net_E: 81.750 (95.882) 2024-10-12 23:22:55,151 - Max [top1: 79.674 (epoch: 228)] [top1-ema: 81.754 (epoch: 228)] 2024-10-12 23:22:55,152 - ==> Total time: 1 day, 11:35:59 Eta: 11:02:14 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 23:23:09,117 - Train: 76.34% [286500/375300] [229.0/300.0] [batch_t 0.317 (0.595)] [data_t 0.016] [optim_t 0.301] [lr 0.000422] [CE 3.171 (3.071)] [KD 0.000 (0.000)] 2024-10-12 23:23:31,986 - Train: 76.35% [286550/375300] [229.1/300.0] [batch_t 0.406 (0.457)] [data_t 0.016] [optim_t 0.390] [lr 0.000421] [CE 3.185 (3.105)] [KD 0.000 (0.000)] 2024-10-12 23:23:54,592 - Train: 76.37% [286600/375300] [229.1/300.0] [batch_t 0.364 (0.452)] [data_t 0.064] [optim_t 0.300] [lr 0.000421] [CE 3.100 (3.059)] [KD 0.000 (0.000)] 2024-10-12 23:24:18,064 - Train: 76.38% [286650/375300] [229.1/300.0] [batch_t 0.563 (0.469)] [data_t 0.265] [optim_t 0.298] [lr 0.000420] [CE 2.850 (3.126)] [KD 0.000 (0.000)] 2024-10-12 23:24:41,600 - Train: 76.39% [286700/375300] [229.2/300.0] [batch_t 0.492 (0.471)] [data_t 0.198] [optim_t 0.294] [lr 0.000420] [CE 3.081 (3.116)] [KD 0.000 (0.000)] 2024-10-12 23:25:04,497 - Train: 76.41% [286750/375300] [229.2/300.0] [batch_t 0.317 (0.458)] [data_t 0.016] [optim_t 0.301] [lr 0.000420] [CE 3.120 (3.123)] [KD 0.000 (0.000)] 2024-10-12 23:25:27,264 - Train: 76.42% [286800/375300] [229.3/300.0] [batch_t 0.494 (0.455)] [data_t 0.196] [optim_t 0.298] [lr 0.000419] [CE 3.005 (3.090)] [KD 0.000 (0.000)] 2024-10-12 23:25:49,446 - Train: 76.43% [286850/375300] [229.3/300.0] [batch_t 0.440 (0.444)] [data_t 0.144] [optim_t 0.297] [lr 0.000419] [CE 3.031 (3.076)] [KD 0.000 (0.000)] 2024-10-12 23:26:11,725 - Train: 76.45% [286900/375300] [229.3/300.0] [batch_t 0.325 (0.445)] [data_t 0.030] [optim_t 0.295] [lr 0.000418] [CE 3.294 (3.059)] [KD 0.000 (0.000)] 2024-10-12 23:26:34,469 - Train: 76.46% [286950/375300] [229.4/300.0] [batch_t 0.472 (0.455)] [data_t 0.178] [optim_t 0.294] [lr 0.000418] [CE 3.128 (3.122)] [KD 0.000 (0.000)] 2024-10-12 23:26:56,745 - Train: 76.47% [287000/375300] [229.4/300.0] [batch_t 0.373 (0.445)] [data_t 0.077] [optim_t 0.296] [lr 0.000418] [CE 3.104 (3.091)] [KD 0.000 (0.000)] 2024-10-12 23:27:17,830 - Train: 76.49% [287050/375300] [229.5/300.0] [batch_t 0.392 (0.422)] [data_t 0.095] [optim_t 0.298] [lr 0.000417] [CE 2.777 (3.145)] [KD 0.000 (0.000)] 2024-10-12 23:27:39,362 - Train: 76.50% [287100/375300] [229.5/300.0] [batch_t 0.473 (0.431)] [data_t 0.015] [optim_t 0.458] [lr 0.000417] [CE 3.111 (3.073)] [KD 0.000 (0.000)] 2024-10-12 23:28:01,302 - Train: 76.51% [287150/375300] [229.5/300.0] [batch_t 0.391 (0.439)] [data_t 0.016] [optim_t 0.375] [lr 0.000416] [CE 3.200 (3.112)] [KD 0.000 (0.000)] 2024-10-12 23:28:23,486 - Train: 76.53% [287200/375300] [229.6/300.0] [batch_t 0.496 (0.444)] [data_t 0.015] [optim_t 0.480] [lr 0.000416] [CE 3.157 (3.107)] [KD 0.000 (0.000)] 2024-10-12 23:28:45,784 - Train: 76.54% [287250/375300] [229.6/300.0] [batch_t 0.506 (0.446)] [data_t 0.016] [optim_t 0.490] [lr 0.000415] [CE 3.192 (3.132)] [KD 0.000 (0.000)] 2024-10-12 23:29:08,166 - Train: 76.55% [287300/375300] [229.7/300.0] [batch_t 0.466 (0.448)] [data_t 0.015] [optim_t 0.451] [lr 0.000415] [CE 3.024 (3.107)] [KD 0.000 (0.000)] 2024-10-12 23:29:30,877 - Train: 76.57% [287350/375300] [229.7/300.0] [batch_t 0.432 (0.454)] [data_t 0.015] [optim_t 0.417] [lr 0.000415] [CE 3.263 (3.109)] [KD 0.000 (0.000)] 2024-10-12 23:29:52,945 - Train: 76.58% [287400/375300] [229.7/300.0] [batch_t 0.417 (0.441)] [data_t 0.016] [optim_t 0.402] [lr 0.000414] [CE 3.509 (3.119)] [KD 0.000 (0.000)] 2024-10-12 23:30:15,026 - Train: 76.59% [287450/375300] [229.8/300.0] [batch_t 0.901 (0.441)] [data_t 0.016] [optim_t 0.886] [lr 0.000414] [CE 3.381 (3.132)] [KD 0.000 (0.000)] 2024-10-12 23:30:36,374 - Train: 76.61% [287500/375300] [229.8/300.0] [batch_t 0.433 (0.427)] [data_t 0.016] [optim_t 0.417] [lr 0.000413] [CE 3.398 (3.131)] [KD 0.000 (0.000)] 2024-10-12 23:30:57,899 - Train: 76.62% [287550/375300] [229.9/300.0] [batch_t 0.482 (0.430)] [data_t 0.184] [optim_t 0.298] [lr 0.000413] [CE 3.267 (3.110)] [KD 0.000 (0.000)] 2024-10-12 23:31:20,106 - Train: 76.63% [287600/375300] [229.9/300.0] [batch_t 0.539 (0.444)] [data_t 0.015] [optim_t 0.524] [lr 0.000413] [CE 2.842 (3.064)] [KD 0.000 (0.000)] 2024-10-12 23:31:42,340 - Train: 76.65% [287650/375300] [229.9/300.0] [batch_t 0.433 (0.445)] [data_t 0.016] [optim_t 0.417] [lr 0.000412] [CE 2.773 (3.063)] [KD 0.000 (0.000)] 2024-10-12 23:32:04,173 - Train: 76.66% [287700/375300] [230.0/300.0] [batch_t 0.371 (0.437)] [data_t 0.015] [optim_t 0.356] [lr 0.000412] [CE 3.032 (3.121)] [KD 0.000 (0.000)] 2024-10-12 23:32:38,209 - Test (net): 100.00% [50/50] [batch_t 0.135 (0.445)] [top1_cnt 39855] [top5_cnt 47546] [top_all 50000] 2024-10-12 23:32:38,210 - net: 79.710 (95.092) 2024-10-12 23:33:00,036 - Test (net_E): 100.00% [50/50] [batch_t 0.136 (0.428)] [top1_cnt 40882] [top5_cnt 47939] [top_all 50000] 2024-10-12 23:33:00,037 - net_E: 81.764 (95.878) 2024-10-12 23:33:00,211 - Max [top1: 79.710 (epoch: 230)] [top1-ema: 81.764 (epoch: 230)] 2024-10-12 23:33:00,211 - ==> Total time: 1 day, 11:46:04 Eta: 10:53:09 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 23:33:17,464 - Train: 76.67% [287750/375300] [230.0/300.0] [batch_t 0.317 (0.399)] [data_t 0.016] [optim_t 0.301] [lr 0.000411] [CE 2.535 (3.052)] [KD 0.000 (0.000)] 2024-10-12 23:33:39,245 - Train: 76.69% [287800/375300] [230.1/300.0] [batch_t 0.315 (0.435)] [data_t 0.015] [optim_t 0.300] [lr 0.000411] [CE 3.154 (3.091)] [KD 0.000 (0.000)] 2024-10-12 23:34:00,555 - Train: 76.70% [287850/375300] [230.1/300.0] [batch_t 0.455 (0.426)] [data_t 0.016] [optim_t 0.440] [lr 0.000410] [CE 2.604 (3.088)] [KD 0.000 (0.000)] 2024-10-12 23:34:22,157 - Train: 76.71% [287900/375300] [230.1/300.0] [batch_t 0.317 (0.432)] [data_t 0.015] [optim_t 0.302] [lr 0.000410] [CE 2.912 (3.102)] [KD 0.000 (0.000)] 2024-10-12 23:34:43,294 - Train: 76.73% [287950/375300] [230.2/300.0] [batch_t 0.379 (0.423)] [data_t 0.016] [optim_t 0.363] [lr 0.000410] [CE 3.174 (3.099)] [KD 0.000 (0.000)] 2024-10-12 23:35:04,974 - Train: 76.74% [288000/375300] [230.2/300.0] [batch_t 0.370 (0.433)] [data_t 0.016] [optim_t 0.355] [lr 0.000409] [CE 3.537 (3.110)] [KD 0.000 (0.000)] 2024-10-12 23:35:26,908 - Train: 76.75% [288050/375300] [230.3/300.0] [batch_t 0.450 (0.439)] [data_t 0.015] [optim_t 0.434] [lr 0.000409] [CE 3.153 (3.126)] [KD 0.000 (0.000)] 2024-10-12 23:35:49,308 - Train: 76.77% [288100/375300] [230.3/300.0] [batch_t 0.446 (0.448)] [data_t 0.015] [optim_t 0.431] [lr 0.000408] [CE 2.930 (3.114)] [KD 0.000 (0.000)] 2024-10-12 23:36:11,219 - Train: 76.78% [288150/375300] [230.3/300.0] [batch_t 0.378 (0.438)] [data_t 0.016] [optim_t 0.362] [lr 0.000408] [CE 3.116 (3.091)] [KD 0.000 (0.000)] 2024-10-12 23:36:32,624 - Train: 76.79% [288200/375300] [230.4/300.0] [batch_t 0.409 (0.428)] [data_t 0.016] [optim_t 0.393] [lr 0.000408] [CE 2.765 (3.061)] [KD 0.000 (0.000)] 2024-10-12 23:36:54,658 - Train: 76.81% [288250/375300] [230.4/300.0] [batch_t 0.464 (0.441)] [data_t 0.016] [optim_t 0.449] [lr 0.000407] [CE 2.722 (3.055)] [KD 0.000 (0.000)] 2024-10-12 23:37:16,737 - Train: 76.82% [288300/375300] [230.5/300.0] [batch_t 0.504 (0.441)] [data_t 0.015] [optim_t 0.488] [lr 0.000407] [CE 3.100 (3.068)] [KD 0.000 (0.000)] 2024-10-12 23:37:38,456 - Train: 76.83% [288350/375300] [230.5/300.0] [batch_t 0.447 (0.434)] [data_t 0.016] [optim_t 0.431] [lr 0.000406] [CE 3.176 (3.108)] [KD 0.000 (0.000)] 2024-10-12 23:38:00,414 - Train: 76.85% [288400/375300] [230.5/300.0] [batch_t 0.409 (0.439)] [data_t 0.016] [optim_t 0.393] [lr 0.000406] [CE 3.176 (3.067)] [KD 0.000 (0.000)] 2024-10-12 23:38:22,009 - Train: 76.86% [288450/375300] [230.6/300.0] [batch_t 0.484 (0.432)] [data_t 0.015] [optim_t 0.468] [lr 0.000405] [CE 3.112 (3.095)] [KD 0.000 (0.000)] 2024-10-12 23:38:44,005 - Train: 76.87% [288500/375300] [230.6/300.0] [batch_t 0.459 (0.440)] [data_t 0.015] [optim_t 0.443] [lr 0.000405] [CE 3.202 (3.084)] [KD 0.000 (0.000)] 2024-10-12 23:39:05,490 - Train: 76.89% [288550/375300] [230.7/300.0] [batch_t 0.482 (0.430)] [data_t 0.016] [optim_t 0.466] [lr 0.000405] [CE 2.812 (3.097)] [KD 0.000 (0.000)] 2024-10-12 23:39:27,641 - Train: 76.90% [288600/375300] [230.7/300.0] [batch_t 0.603 (0.443)] [data_t 0.033] [optim_t 0.570] [lr 0.000404] [CE 3.018 (3.119)] [KD 0.000 (0.000)] 2024-10-12 23:39:49,337 - Train: 76.91% [288650/375300] [230.7/300.0] [batch_t 0.463 (0.434)] [data_t 0.016] [optim_t 0.447] [lr 0.000404] [CE 3.178 (3.096)] [KD 0.000 (0.000)] 2024-10-12 23:40:11,301 - Train: 76.93% [288700/375300] [230.8/300.0] [batch_t 0.509 (0.439)] [data_t 0.016] [optim_t 0.493] [lr 0.000403] [CE 3.396 (3.103)] [KD 0.000 (0.000)] 2024-10-12 23:40:33,321 - Train: 76.94% [288750/375300] [230.8/300.0] [batch_t 0.408 (0.440)] [data_t 0.102] [optim_t 0.307] [lr 0.000403] [CE 3.286 (3.109)] [KD 0.000 (0.000)] 2024-10-12 23:40:55,186 - Train: 76.95% [288800/375300] [230.9/300.0] [batch_t 0.469 (0.437)] [data_t 0.150] [optim_t 0.319] [lr 0.000403] [CE 2.985 (3.126)] [KD 0.000 (0.000)] 2024-10-12 23:41:16,880 - Train: 76.97% [288850/375300] [230.9/300.0] [batch_t 0.470 (0.434)] [data_t 0.175] [optim_t 0.296] [lr 0.000402] [CE 2.945 (3.086)] [KD 0.000 (0.000)] 2024-10-12 23:41:38,987 - Train: 76.98% [288900/375300] [230.9/300.0] [batch_t 0.490 (0.442)] [data_t 0.016] [optim_t 0.474] [lr 0.000402] [CE 2.967 (3.081)] [KD 0.000 (0.000)] 2024-10-12 23:42:00,980 - Train: 76.99% [288950/375300] [231.0/300.0] [batch_t 0.486 (0.440)] [data_t 0.016] [optim_t 0.470] [lr 0.000401] [CE 2.801 (3.098)] [KD 0.000 (0.000)] 2024-10-12 23:42:35,528 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.441)] [top1_cnt 39899] [top5_cnt 47561] [top_all 50000] 2024-10-12 23:42:35,528 - net: 79.798 (95.122) 2024-10-12 23:42:57,236 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.427)] [top1_cnt 40900] [top5_cnt 47953] [top_all 50000] 2024-10-12 23:42:57,237 - net_E: 81.800 (95.906) 2024-10-12 23:42:57,448 - Max [top1: 79.798 (epoch: 231)] [top1-ema: 81.800 (epoch: 231)] 2024-10-12 23:42:57,448 - ==> Total time: 1 day, 11:56:01 Eta: 10:44:00 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 23:43:17,485 - Train: 77.01% [289000/375300] [231.0/300.0] [batch_t 0.314 (0.547)] [data_t 0.015] [optim_t 0.299] [lr 0.000401] [CE 2.665 (3.071)] [KD 0.000 (0.000)] 2024-10-12 23:43:36,665 - Train: 77.02% [289050/375300] [231.1/300.0] [batch_t 0.405 (0.383)] [data_t 0.108] [optim_t 0.297] [lr 0.000401] [CE 2.959 (3.069)] [KD 0.000 (0.000)] 2024-10-12 23:43:58,692 - Train: 77.03% [289100/375300] [231.1/300.0] [batch_t 0.313 (0.440)] [data_t 0.015] [optim_t 0.297] [lr 0.000400] [CE 3.210 (3.054)] [KD 0.000 (0.000)] 2024-10-12 23:44:20,351 - Train: 77.05% [289150/375300] [231.1/300.0] [batch_t 0.357 (0.433)] [data_t 0.016] [optim_t 0.341] [lr 0.000400] [CE 3.298 (3.094)] [KD 0.000 (0.000)] 2024-10-12 23:44:41,674 - Train: 77.06% [289200/375300] [231.2/300.0] [batch_t 0.453 (0.426)] [data_t 0.016] [optim_t 0.437] [lr 0.000399] [CE 3.066 (3.106)] [KD 0.000 (0.000)] 2024-10-12 23:45:03,157 - Train: 77.07% [289250/375300] [231.2/300.0] [batch_t 0.463 (0.430)] [data_t 0.015] [optim_t 0.447] [lr 0.000399] [CE 3.234 (3.099)] [KD 0.000 (0.000)] 2024-10-12 23:45:25,694 - Train: 77.08% [289300/375300] [231.3/300.0] [batch_t 0.463 (0.451)] [data_t 0.015] [optim_t 0.447] [lr 0.000398] [CE 2.995 (3.088)] [KD 0.000 (0.000)] 2024-10-12 23:45:47,732 - Train: 77.10% [289350/375300] [231.3/300.0] [batch_t 0.499 (0.441)] [data_t 0.016] [optim_t 0.483] [lr 0.000398] [CE 3.315 (3.104)] [KD 0.000 (0.000)] 2024-10-12 23:46:09,098 - Train: 77.11% [289400/375300] [231.3/300.0] [batch_t 0.491 (0.427)] [data_t 0.015] [optim_t 0.475] [lr 0.000398] [CE 3.132 (3.098)] [KD 0.000 (0.000)] 2024-10-12 23:46:30,429 - Train: 77.12% [289450/375300] [231.4/300.0] [batch_t 0.425 (0.426)] [data_t 0.016] [optim_t 0.409] [lr 0.000397] [CE 3.100 (3.107)] [KD 0.000 (0.000)] 2024-10-12 23:46:51,914 - Train: 77.14% [289500/375300] [231.4/300.0] [batch_t 0.371 (0.430)] [data_t 0.015] [optim_t 0.355] [lr 0.000397] [CE 3.270 (3.051)] [KD 0.000 (0.000)] 2024-10-12 23:47:13,778 - Train: 77.15% [289550/375300] [231.5/300.0] [batch_t 0.460 (0.437)] [data_t 0.016] [optim_t 0.444] [lr 0.000396] [CE 3.207 (3.081)] [KD 0.000 (0.000)] 2024-10-12 23:47:35,996 - Train: 77.16% [289600/375300] [231.5/300.0] [batch_t 0.500 (0.444)] [data_t 0.015] [optim_t 0.485] [lr 0.000396] [CE 3.101 (3.107)] [KD 0.000 (0.000)] 2024-10-12 23:47:58,129 - Train: 77.18% [289650/375300] [231.5/300.0] [batch_t 0.319 (0.443)] [data_t 0.015] [optim_t 0.304] [lr 0.000396] [CE 2.994 (3.079)] [KD 0.000 (0.000)] 2024-10-12 23:48:20,778 - Train: 77.19% [289700/375300] [231.6/300.0] [batch_t 0.311 (0.453)] [data_t 0.015] [optim_t 0.296] [lr 0.000395] [CE 2.821 (3.084)] [KD 0.000 (0.000)] 2024-10-12 23:48:42,878 - Train: 77.20% [289750/375300] [231.6/300.0] [batch_t 0.442 (0.442)] [data_t 0.149] [optim_t 0.293] [lr 0.000395] [CE 2.989 (3.105)] [KD 0.000 (0.000)] 2024-10-12 23:49:05,304 - Train: 77.22% [289800/375300] [231.7/300.0] [batch_t 0.418 (0.448)] [data_t 0.121] [optim_t 0.297] [lr 0.000394] [CE 3.068 (3.062)] [KD 0.000 (0.000)] 2024-10-12 23:49:27,021 - Train: 77.23% [289850/375300] [231.7/300.0] [batch_t 0.405 (0.434)] [data_t 0.106] [optim_t 0.298] [lr 0.000394] [CE 3.215 (3.078)] [KD 0.000 (0.000)] 2024-10-12 23:49:48,966 - Train: 77.24% [289900/375300] [231.7/300.0] [batch_t 0.454 (0.439)] [data_t 0.162] [optim_t 0.292] [lr 0.000394] [CE 2.930 (3.127)] [KD 0.000 (0.000)] 2024-10-12 23:50:10,095 - Train: 77.26% [289950/375300] [231.8/300.0] [batch_t 0.449 (0.422)] [data_t 0.156] [optim_t 0.293] [lr 0.000393] [CE 3.010 (3.116)] [KD 0.000 (0.000)] 2024-10-12 23:50:32,146 - Train: 77.27% [290000/375300] [231.8/300.0] [batch_t 0.480 (0.441)] [data_t 0.015] [optim_t 0.465] [lr 0.000393] [CE 3.011 (3.033)] [KD 0.000 (0.000)] 2024-10-12 23:50:54,221 - Train: 77.28% [290050/375300] [231.9/300.0] [batch_t 0.405 (0.441)] [data_t 0.015] [optim_t 0.389] [lr 0.000392] [CE 3.118 (3.041)] [KD 0.000 (0.000)] 2024-10-12 23:51:15,584 - Train: 77.30% [290100/375300] [231.9/300.0] [batch_t 0.455 (0.427)] [data_t 0.015] [optim_t 0.439] [lr 0.000392] [CE 3.232 (3.064)] [KD 0.000 (0.000)] 2024-10-12 23:51:37,232 - Train: 77.31% [290150/375300] [231.9/300.0] [batch_t 0.470 (0.433)] [data_t 0.016] [optim_t 0.455] [lr 0.000392] [CE 3.292 (3.077)] [KD 0.000 (0.000)] 2024-10-12 23:51:59,217 - Train: 77.32% [290200/375300] [232.0/300.0] [batch_t 0.370 (0.440)] [data_t 0.015] [optim_t 0.355] [lr 0.000391] [CE 3.299 (3.127)] [KD 0.000 (0.000)] 2024-10-12 23:52:33,597 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.435)] [top1_cnt 39911] [top5_cnt 47589] [top_all 50000] 2024-10-12 23:52:33,597 - net: 79.822 (95.178) 2024-10-12 23:52:56,649 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.455)] [top1_cnt 40914] [top5_cnt 47959] [top_all 50000] 2024-10-12 23:52:56,649 - net_E: 81.828 (95.918) 2024-10-12 23:52:56,807 - Max [top1: 79.822 (epoch: 232)] [top1-ema: 81.828 (epoch: 232)] 2024-10-12 23:52:56,808 - ==> Total time: 1 day, 12:06:00 Eta: 10:34:51 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-12 23:53:14,804 - Train: 77.34% [290250/375300] [232.0/300.0] [batch_t 0.313 (0.480)] [data_t 0.015] [optim_t 0.297] [lr 0.000391] [CE 3.323 (2.989)] [KD 0.000 (0.000)] 2024-10-12 23:53:35,973 - Train: 77.35% [290300/375300] [232.1/300.0] [batch_t 0.320 (0.423)] [data_t 0.016] [optim_t 0.304] [lr 0.000390] [CE 2.687 (3.079)] [KD 0.000 (0.000)] 2024-10-12 23:53:56,997 - Train: 77.36% [290350/375300] [232.1/300.0] [batch_t 0.456 (0.420)] [data_t 0.161] [optim_t 0.295] [lr 0.000390] [CE 3.222 (3.060)] [KD 0.000 (0.000)] 2024-10-12 23:54:19,530 - Train: 77.38% [290400/375300] [232.1/300.0] [batch_t 0.429 (0.451)] [data_t 0.129] [optim_t 0.300] [lr 0.000390] [CE 3.163 (3.055)] [KD 0.000 (0.000)] 2024-10-12 23:54:40,808 - Train: 77.39% [290450/375300] [232.2/300.0] [batch_t 0.351 (0.425)] [data_t 0.054] [optim_t 0.298] [lr 0.000389] [CE 3.117 (3.082)] [KD 0.000 (0.000)] 2024-10-12 23:55:03,154 - Train: 77.40% [290500/375300] [232.2/300.0] [batch_t 0.483 (0.447)] [data_t 0.129] [optim_t 0.354] [lr 0.000389] [CE 2.976 (3.064)] [KD 0.000 (0.000)] 2024-10-12 23:55:25,192 - Train: 77.42% [290550/375300] [232.3/300.0] [batch_t 0.481 (0.441)] [data_t 0.186] [optim_t 0.295] [lr 0.000388] [CE 3.259 (3.080)] [KD 0.000 (0.000)] 2024-10-12 23:55:47,450 - Train: 77.43% [290600/375300] [232.3/300.0] [batch_t 0.385 (0.445)] [data_t 0.087] [optim_t 0.299] [lr 0.000388] [CE 3.174 (3.077)] [KD 0.000 (0.000)] 2024-10-12 23:56:09,490 - Train: 77.44% [290650/375300] [232.3/300.0] [batch_t 0.491 (0.441)] [data_t 0.193] [optim_t 0.297] [lr 0.000387] [CE 3.076 (3.124)] [KD 0.000 (0.000)] 2024-10-12 23:56:31,027 - Train: 77.46% [290700/375300] [232.4/300.0] [batch_t 0.443 (0.431)] [data_t 0.146] [optim_t 0.297] [lr 0.000387] [CE 3.141 (3.102)] [KD 0.000 (0.000)] 2024-10-12 23:56:52,263 - Train: 77.47% [290750/375300] [232.4/300.0] [batch_t 0.393 (0.425)] [data_t 0.095] [optim_t 0.298] [lr 0.000387] [CE 3.134 (3.117)] [KD 0.000 (0.000)] 2024-10-12 23:57:14,509 - Train: 77.48% [290800/375300] [232.5/300.0] [batch_t 0.494 (0.445)] [data_t 0.016] [optim_t 0.479] [lr 0.000386] [CE 2.965 (3.095)] [KD 0.000 (0.000)] 2024-10-12 23:57:36,598 - Train: 77.50% [290850/375300] [232.5/300.0] [batch_t 0.487 (0.442)] [data_t 0.016] [optim_t 0.471] [lr 0.000386] [CE 3.408 (3.067)] [KD 0.000 (0.000)] 2024-10-12 23:57:59,216 - Train: 77.51% [290900/375300] [232.5/300.0] [batch_t 0.427 (0.452)] [data_t 0.016] [optim_t 0.411] [lr 0.000385] [CE 3.009 (3.104)] [KD 0.000 (0.000)] 2024-10-12 23:58:20,378 - Train: 77.52% [290950/375300] [232.6/300.0] [batch_t 0.384 (0.423)] [data_t 0.016] [optim_t 0.368] [lr 0.000385] [CE 3.100 (3.061)] [KD 0.000 (0.000)] 2024-10-12 23:58:42,530 - Train: 77.54% [291000/375300] [232.6/300.0] [batch_t 0.397 (0.443)] [data_t 0.016] [optim_t 0.381] [lr 0.000385] [CE 2.982 (3.075)] [KD 0.000 (0.000)] 2024-10-12 23:59:04,295 - Train: 77.55% [291050/375300] [232.7/300.0] [batch_t 0.457 (0.435)] [data_t 0.015] [optim_t 0.442] [lr 0.000384] [CE 2.984 (3.028)] [KD 0.000 (0.000)] 2024-10-12 23:59:25,365 - Train: 77.56% [291100/375300] [232.7/300.0] [batch_t 0.373 (0.421)] [data_t 0.015] [optim_t 0.357] [lr 0.000384] [CE 2.983 (3.037)] [KD 0.000 (0.000)] 2024-10-12 23:59:45,850 - Train: 77.58% [291150/375300] [232.7/300.0] [batch_t 0.379 (0.410)] [data_t 0.016] [optim_t 0.364] [lr 0.000383] [CE 3.036 (3.080)] [KD 0.000 (0.000)] 2024-10-13 00:00:07,921 - Train: 77.59% [291200/375300] [232.8/300.0] [batch_t 0.501 (0.441)] [data_t 0.197] [optim_t 0.304] [lr 0.000383] [CE 2.999 (3.068)] [KD 0.000 (0.000)] 2024-10-13 00:00:29,914 - Train: 77.60% [291250/375300] [232.8/300.0] [batch_t 0.439 (0.440)] [data_t 0.136] [optim_t 0.303] [lr 0.000383] [CE 3.254 (3.083)] [KD 0.000 (0.000)] 2024-10-13 00:00:51,931 - Train: 77.62% [291300/375300] [232.9/300.0] [batch_t 0.455 (0.440)] [data_t 0.151] [optim_t 0.304] [lr 0.000382] [CE 2.986 (3.083)] [KD 0.000 (0.000)] 2024-10-13 00:01:14,060 - Train: 77.63% [291350/375300] [232.9/300.0] [batch_t 0.404 (0.442)] [data_t 0.103] [optim_t 0.301] [lr 0.000382] [CE 3.066 (3.039)] [KD 0.000 (0.000)] 2024-10-13 00:01:35,537 - Train: 77.64% [291400/375300] [232.9/300.0] [batch_t 0.453 (0.429)] [data_t 0.150] [optim_t 0.303] [lr 0.000381] [CE 3.204 (3.067)] [KD 0.000 (0.000)] 2024-10-13 00:01:57,698 - Train: 77.66% [291450/375300] [233.0/300.0] [batch_t 0.930 (0.443)] [data_t 0.630] [optim_t 0.300] [lr 0.000381] [CE 3.305 (3.089)] [KD 0.000 (0.000)] 2024-10-13 00:02:32,780 - Test (net): 100.00% [50/50] [batch_t 0.141 (0.446)] [top1_cnt 39841] [top5_cnt 47626] [top_all 50000] 2024-10-13 00:02:32,781 - net: 79.682 (95.252) 2024-10-13 00:02:55,173 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.440)] [top1_cnt 40946] [top5_cnt 47985] [top_all 50000] 2024-10-13 00:02:55,174 - net_E: 81.892 (95.970) 2024-10-13 00:02:55,354 - Max [top1: 79.822 (epoch: 232)] [top1-ema: 81.892 (epoch: 233)] 2024-10-13 00:02:55,354 - ==> Total time: 1 day, 12:15:59 Eta: 10:25:42 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 00:03:08,965 - Train: 77.67% [291500/375300] [233.0/300.0] [batch_t 0.318 (0.495)] [data_t 0.016] [optim_t 0.302] [lr 0.000381] [CE 2.875 (3.019)] [KD 0.000 (0.000)] 2024-10-13 00:03:29,140 - Train: 77.68% [291550/375300] [233.1/300.0] [batch_t 0.309 (0.403)] [data_t 0.015] [optim_t 0.293] [lr 0.000380] [CE 3.320 (3.073)] [KD 0.000 (0.000)] 2024-10-13 00:03:50,686 - Train: 77.70% [291600/375300] [233.1/300.0] [batch_t 0.490 (0.431)] [data_t 0.015] [optim_t 0.475] [lr 0.000380] [CE 2.923 (3.022)] [KD 0.000 (0.000)] 2024-10-13 00:04:12,747 - Train: 77.71% [291650/375300] [233.1/300.0] [batch_t 0.439 (0.441)] [data_t 0.016] [optim_t 0.423] [lr 0.000379] [CE 3.133 (3.052)] [KD 0.000 (0.000)] 2024-10-13 00:04:34,978 - Train: 77.72% [291700/375300] [233.2/300.0] [batch_t 0.430 (0.445)] [data_t 0.015] [optim_t 0.415] [lr 0.000379] [CE 3.053 (3.088)] [KD 0.000 (0.000)] 2024-10-13 00:04:57,082 - Train: 77.74% [291750/375300] [233.2/300.0] [batch_t 0.461 (0.442)] [data_t 0.016] [optim_t 0.445] [lr 0.000379] [CE 3.045 (3.118)] [KD 0.000 (0.000)] 2024-10-13 00:05:18,605 - Train: 77.75% [291800/375300] [233.3/300.0] [batch_t 0.447 (0.430)] [data_t 0.015] [optim_t 0.431] [lr 0.000378] [CE 3.208 (3.058)] [KD 0.000 (0.000)] 2024-10-13 00:05:39,892 - Train: 77.76% [291850/375300] [233.3/300.0] [batch_t 0.419 (0.426)] [data_t 0.015] [optim_t 0.403] [lr 0.000378] [CE 3.068 (3.090)] [KD 0.000 (0.000)] 2024-10-13 00:06:01,751 - Train: 77.78% [291900/375300] [233.3/300.0] [batch_t 0.439 (0.437)] [data_t 0.015] [optim_t 0.423] [lr 0.000377] [CE 3.181 (3.071)] [KD 0.000 (0.000)] 2024-10-13 00:06:24,144 - Train: 77.79% [291950/375300] [233.4/300.0] [batch_t 0.496 (0.448)] [data_t 0.015] [optim_t 0.481] [lr 0.000377] [CE 2.783 (3.077)] [KD 0.000 (0.000)] 2024-10-13 00:06:46,583 - Train: 77.80% [292000/375300] [233.4/300.0] [batch_t 0.442 (0.449)] [data_t 0.015] [optim_t 0.427] [lr 0.000377] [CE 3.489 (3.070)] [KD 0.000 (0.000)] 2024-10-13 00:07:08,573 - Train: 77.82% [292050/375300] [233.5/300.0] [batch_t 0.418 (0.440)] [data_t 0.015] [optim_t 0.402] [lr 0.000376] [CE 3.106 (3.122)] [KD 0.000 (0.000)] 2024-10-13 00:07:30,859 - Train: 77.83% [292100/375300] [233.5/300.0] [batch_t 0.464 (0.446)] [data_t 0.015] [optim_t 0.449] [lr 0.000376] [CE 2.930 (3.068)] [KD 0.000 (0.000)] 2024-10-13 00:07:53,184 - Train: 77.84% [292150/375300] [233.5/300.0] [batch_t 0.406 (0.446)] [data_t 0.016] [optim_t 0.391] [lr 0.000375] [CE 3.096 (3.071)] [KD 0.000 (0.000)] 2024-10-13 00:08:15,026 - Train: 77.86% [292200/375300] [233.6/300.0] [batch_t 0.373 (0.437)] [data_t 0.016] [optim_t 0.358] [lr 0.000375] [CE 2.963 (3.099)] [KD 0.000 (0.000)] 2024-10-13 00:08:36,457 - Train: 77.87% [292250/375300] [233.6/300.0] [batch_t 0.416 (0.428)] [data_t 0.016] [optim_t 0.400] [lr 0.000375] [CE 3.014 (3.023)] [KD 0.000 (0.000)] 2024-10-13 00:08:59,140 - Train: 77.88% [292300/375300] [233.7/300.0] [batch_t 0.442 (0.454)] [data_t 0.015] [optim_t 0.427] [lr 0.000374] [CE 3.250 (3.097)] [KD 0.000 (0.000)] 2024-10-13 00:09:21,341 - Train: 77.90% [292350/375300] [233.7/300.0] [batch_t 0.512 (0.444)] [data_t 0.016] [optim_t 0.496] [lr 0.000374] [CE 3.388 (3.078)] [KD 0.000 (0.000)] 2024-10-13 00:09:43,380 - Train: 77.91% [292400/375300] [233.7/300.0] [batch_t 0.385 (0.441)] [data_t 0.016] [optim_t 0.370] [lr 0.000373] [CE 3.170 (3.097)] [KD 0.000 (0.000)] 2024-10-13 00:10:05,710 - Train: 77.92% [292450/375300] [233.8/300.0] [batch_t 0.420 (0.446)] [data_t 0.016] [optim_t 0.404] [lr 0.000373] [CE 3.000 (3.080)] [KD 0.000 (0.000)] 2024-10-13 00:10:28,429 - Train: 77.94% [292500/375300] [233.8/300.0] [batch_t 0.876 (0.454)] [data_t 0.015] [optim_t 0.861] [lr 0.000373] [CE 2.988 (3.077)] [KD 0.000 (0.000)] 2024-10-13 00:10:49,743 - Train: 77.95% [292550/375300] [233.9/300.0] [batch_t 0.520 (0.426)] [data_t 0.016] [optim_t 0.505] [lr 0.000372] [CE 2.887 (3.072)] [KD 0.000 (0.000)] 2024-10-13 00:11:11,736 - Train: 77.96% [292600/375300] [233.9/300.0] [batch_t 0.416 (0.440)] [data_t 0.016] [optim_t 0.400] [lr 0.000372] [CE 3.371 (3.121)] [KD 0.000 (0.000)] 2024-10-13 00:11:34,130 - Train: 77.98% [292650/375300] [233.9/300.0] [batch_t 0.470 (0.448)] [data_t 0.016] [optim_t 0.454] [lr 0.000371] [CE 3.374 (3.083)] [KD 0.000 (0.000)] 2024-10-13 00:11:55,980 - Train: 77.99% [292700/375300] [234.0/300.0] [batch_t 0.503 (0.437)] [data_t 0.016] [optim_t 0.488] [lr 0.000371] [CE 3.243 (3.025)] [KD 0.000 (0.000)] 2024-10-13 00:12:31,998 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.448)] [top1_cnt 40056] [top5_cnt 47646] [top_all 50000] 2024-10-13 00:12:31,999 - net: 80.112 (95.292) 2024-10-13 00:12:54,147 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.435)] [top1_cnt 40925] [top5_cnt 48001] [top_all 50000] 2024-10-13 00:12:54,147 - net_E: 81.850 (96.002) 2024-10-13 00:12:54,309 - Max [top1: 80.112 (epoch: 234)] [top1-ema: 81.892 (epoch: 233)] 2024-10-13 00:12:54,309 - ==> Total time: 1 day, 12:25:58 Eta: 10:16:33 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 00:13:07,558 - Train: 78.00% [292750/375300] [234.0/300.0] [batch_t 0.316 (0.531)] [data_t 0.015] [optim_t 0.300] [lr 0.000371] [CE 2.841 (3.062)] [KD 0.000 (0.000)] 2024-10-13 00:13:28,869 - Train: 78.02% [292800/375300] [234.1/300.0] [batch_t 0.491 (0.426)] [data_t 0.015] [optim_t 0.476] [lr 0.000370] [CE 2.885 (3.088)] [KD 0.000 (0.000)] 2024-10-13 00:13:50,588 - Train: 78.03% [292850/375300] [234.1/300.0] [batch_t 0.318 (0.434)] [data_t 0.016] [optim_t 0.303] [lr 0.000370] [CE 3.362 (3.106)] [KD 0.000 (0.000)] 2024-10-13 00:14:12,426 - Train: 78.04% [292900/375300] [234.1/300.0] [batch_t 0.443 (0.437)] [data_t 0.016] [optim_t 0.427] [lr 0.000369] [CE 2.827 (3.089)] [KD 0.000 (0.000)] 2024-10-13 00:14:34,927 - Train: 78.06% [292950/375300] [234.2/300.0] [batch_t 0.398 (0.450)] [data_t 0.016] [optim_t 0.382] [lr 0.000369] [CE 3.151 (3.016)] [KD 0.000 (0.000)] 2024-10-13 00:14:57,380 - Train: 78.07% [293000/375300] [234.2/300.0] [batch_t 0.484 (0.449)] [data_t 0.015] [optim_t 0.468] [lr 0.000369] [CE 3.063 (3.015)] [KD 0.000 (0.000)] 2024-10-13 00:15:19,853 - Train: 78.08% [293050/375300] [234.3/300.0] [batch_t 0.411 (0.449)] [data_t 0.015] [optim_t 0.395] [lr 0.000368] [CE 3.082 (3.068)] [KD 0.000 (0.000)] 2024-10-13 00:15:41,797 - Train: 78.10% [293100/375300] [234.3/300.0] [batch_t 0.420 (0.439)] [data_t 0.015] [optim_t 0.404] [lr 0.000368] [CE 3.116 (3.044)] [KD 0.000 (0.000)] 2024-10-13 00:16:02,530 - Train: 78.11% [293150/375300] [234.3/300.0] [batch_t 0.415 (0.415)] [data_t 0.015] [optim_t 0.400] [lr 0.000368] [CE 3.417 (3.045)] [KD 0.000 (0.000)] 2024-10-13 00:16:23,908 - Train: 78.12% [293200/375300] [234.4/300.0] [batch_t 0.488 (0.427)] [data_t 0.015] [optim_t 0.473] [lr 0.000367] [CE 3.223 (3.086)] [KD 0.000 (0.000)] 2024-10-13 00:16:45,428 - Train: 78.14% [293250/375300] [234.4/300.0] [batch_t 0.485 (0.430)] [data_t 0.016] [optim_t 0.470] [lr 0.000367] [CE 3.003 (3.054)] [KD 0.000 (0.000)] 2024-10-13 00:17:07,243 - Train: 78.15% [293300/375300] [234.5/300.0] [batch_t 0.476 (0.436)] [data_t 0.016] [optim_t 0.460] [lr 0.000366] [CE 3.354 (3.081)] [KD 0.000 (0.000)] 2024-10-13 00:17:29,102 - Train: 78.16% [293350/375300] [234.5/300.0] [batch_t 0.488 (0.437)] [data_t 0.016] [optim_t 0.472] [lr 0.000366] [CE 3.159 (3.060)] [KD 0.000 (0.000)] 2024-10-13 00:17:50,943 - Train: 78.18% [293400/375300] [234.5/300.0] [batch_t 0.501 (0.437)] [data_t 0.016] [optim_t 0.485] [lr 0.000366] [CE 3.005 (3.054)] [KD 0.000 (0.000)] 2024-10-13 00:18:12,741 - Train: 78.19% [293450/375300] [234.6/300.0] [batch_t 0.316 (0.436)] [data_t 0.015] [optim_t 0.301] [lr 0.000365] [CE 3.317 (3.104)] [KD 0.000 (0.000)] 2024-10-13 00:18:33,821 - Train: 78.20% [293500/375300] [234.6/300.0] [batch_t 0.384 (0.421)] [data_t 0.016] [optim_t 0.368] [lr 0.000365] [CE 3.111 (3.088)] [KD 0.000 (0.000)] 2024-10-13 00:18:55,162 - Train: 78.22% [293550/375300] [234.7/300.0] [batch_t 0.453 (0.427)] [data_t 0.016] [optim_t 0.437] [lr 0.000364] [CE 3.085 (3.068)] [KD 0.000 (0.000)] 2024-10-13 00:19:16,525 - Train: 78.23% [293600/375300] [234.7/300.0] [batch_t 0.474 (0.427)] [data_t 0.016] [optim_t 0.458] [lr 0.000364] [CE 3.089 (3.074)] [KD 0.000 (0.000)] 2024-10-13 00:19:38,296 - Train: 78.24% [293650/375300] [234.7/300.0] [batch_t 0.482 (0.435)] [data_t 0.016] [optim_t 0.466] [lr 0.000364] [CE 3.033 (3.041)] [KD 0.000 (0.000)] 2024-10-13 00:19:59,588 - Train: 78.26% [293700/375300] [234.8/300.0] [batch_t 0.414 (0.426)] [data_t 0.015] [optim_t 0.399] [lr 0.000363] [CE 3.236 (3.063)] [KD 0.000 (0.000)] 2024-10-13 00:20:21,245 - Train: 78.27% [293750/375300] [234.8/300.0] [batch_t 0.454 (0.433)] [data_t 0.016] [optim_t 0.438] [lr 0.000363] [CE 3.214 (3.079)] [KD 0.000 (0.000)] 2024-10-13 00:20:42,580 - Train: 78.28% [293800/375300] [234.9/300.0] [batch_t 0.449 (0.427)] [data_t 0.016] [optim_t 0.434] [lr 0.000362] [CE 3.340 (3.084)] [KD 0.000 (0.000)] 2024-10-13 00:21:03,612 - Train: 78.30% [293850/375300] [234.9/300.0] [batch_t 0.318 (0.420)] [data_t 0.016] [optim_t 0.302] [lr 0.000362] [CE 3.074 (3.090)] [KD 0.000 (0.000)] 2024-10-13 00:21:24,570 - Train: 78.31% [293900/375300] [234.9/300.0] [batch_t 0.403 (0.419)] [data_t 0.016] [optim_t 0.387] [lr 0.000362] [CE 2.932 (3.065)] [KD 0.000 (0.000)] 2024-10-13 00:21:46,065 - Train: 78.32% [293950/375300] [235.0/300.0] [batch_t 0.396 (0.430)] [data_t 0.016] [optim_t 0.380] [lr 0.000361] [CE 2.972 (3.072)] [KD 0.000 (0.000)] 2024-10-13 00:22:21,571 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.429)] [top1_cnt 39995] [top5_cnt 47600] [top_all 50000] 2024-10-13 00:22:21,572 - net: 79.990 (95.200) 2024-10-13 00:22:43,118 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.423)] [top1_cnt 40933] [top5_cnt 47994] [top_all 50000] 2024-10-13 00:22:43,118 - net_E: 81.866 (95.988) 2024-10-13 00:22:43,282 - Max [top1: 80.112 (epoch: 234)] [top1-ema: 81.892 (epoch: 233)] 2024-10-13 00:22:43,283 - ==> Total time: 1 day, 12:35:47 Eta: 10:07:20 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 00:22:54,680 - Train: 78.34% [294000/375300] [235.0/300.0] [batch_t 0.318 (0.635)] [data_t 0.015] [optim_t 0.303] [lr 0.000361] [CE 3.114 (3.087)] [KD 0.000 (0.000)] 2024-10-13 00:23:15,576 - Train: 78.35% [294050/375300] [235.1/300.0] [batch_t 0.380 (0.418)] [data_t 0.015] [optim_t 0.364] [lr 0.000360] [CE 3.168 (3.046)] [KD 0.000 (0.000)] 2024-10-13 00:23:37,228 - Train: 78.36% [294100/375300] [235.1/300.0] [batch_t 0.414 (0.433)] [data_t 0.016] [optim_t 0.399] [lr 0.000360] [CE 3.423 (3.069)] [KD 0.000 (0.000)] 2024-10-13 00:23:59,293 - Train: 78.38% [294150/375300] [235.1/300.0] [batch_t 0.479 (0.441)] [data_t 0.015] [optim_t 0.463] [lr 0.000360] [CE 3.177 (3.071)] [KD 0.000 (0.000)] 2024-10-13 00:24:20,751 - Train: 78.39% [294200/375300] [235.2/300.0] [batch_t 0.453 (0.429)] [data_t 0.016] [optim_t 0.438] [lr 0.000359] [CE 2.680 (3.089)] [KD 0.000 (0.000)] 2024-10-13 00:24:41,618 - Train: 78.40% [294250/375300] [235.2/300.0] [batch_t 0.451 (0.417)] [data_t 0.016] [optim_t 0.436] [lr 0.000359] [CE 3.243 (3.045)] [KD 0.000 (0.000)] 2024-10-13 00:25:02,434 - Train: 78.42% [294300/375300] [235.3/300.0] [batch_t 0.461 (0.416)] [data_t 0.016] [optim_t 0.445] [lr 0.000358] [CE 3.034 (3.095)] [KD 0.000 (0.000)] 2024-10-13 00:25:23,028 - Train: 78.43% [294350/375300] [235.3/300.0] [batch_t 0.415 (0.412)] [data_t 0.016] [optim_t 0.399] [lr 0.000358] [CE 2.822 (3.029)] [KD 0.000 (0.000)] 2024-10-13 00:25:44,061 - Train: 78.44% [294400/375300] [235.3/300.0] [batch_t 0.424 (0.420)] [data_t 0.016] [optim_t 0.409] [lr 0.000358] [CE 2.855 (3.056)] [KD 0.000 (0.000)] 2024-10-13 00:26:05,480 - Train: 78.46% [294450/375300] [235.4/300.0] [batch_t 0.315 (0.428)] [data_t 0.016] [optim_t 0.299] [lr 0.000357] [CE 3.059 (3.027)] [KD 0.000 (0.000)] 2024-10-13 00:26:26,775 - Train: 78.47% [294500/375300] [235.4/300.0] [batch_t 0.483 (0.426)] [data_t 0.016] [optim_t 0.467] [lr 0.000357] [CE 3.151 (3.071)] [KD 0.000 (0.000)] 2024-10-13 00:26:48,020 - Train: 78.48% [294550/375300] [235.5/300.0] [batch_t 0.459 (0.425)] [data_t 0.016] [optim_t 0.443] [lr 0.000357] [CE 3.134 (3.042)] [KD 0.000 (0.000)] 2024-10-13 00:27:08,966 - Train: 78.50% [294600/375300] [235.5/300.0] [batch_t 0.427 (0.419)] [data_t 0.015] [optim_t 0.412] [lr 0.000356] [CE 3.070 (3.045)] [KD 0.000 (0.000)] 2024-10-13 00:27:30,728 - Train: 78.51% [294650/375300] [235.5/300.0] [batch_t 0.421 (0.435)] [data_t 0.121] [optim_t 0.300] [lr 0.000356] [CE 3.090 (3.069)] [KD 0.000 (0.000)] 2024-10-13 00:27:53,152 - Train: 78.52% [294700/375300] [235.6/300.0] [batch_t 0.312 (0.448)] [data_t 0.016] [optim_t 0.297] [lr 0.000355] [CE 3.016 (3.068)] [KD 0.000 (0.000)] 2024-10-13 00:28:14,444 - Train: 78.54% [294750/375300] [235.6/300.0] [batch_t 0.395 (0.426)] [data_t 0.091] [optim_t 0.304] [lr 0.000355] [CE 3.062 (3.084)] [KD 0.000 (0.000)] 2024-10-13 00:28:34,848 - Train: 78.55% [294800/375300] [235.7/300.0] [batch_t 0.494 (0.408)] [data_t 0.199] [optim_t 0.296] [lr 0.000355] [CE 3.271 (3.055)] [KD 0.000 (0.000)] 2024-10-13 00:28:56,985 - Train: 78.56% [294850/375300] [235.7/300.0] [batch_t 0.431 (0.443)] [data_t 0.139] [optim_t 0.292] [lr 0.000354] [CE 3.080 (3.026)] [KD 0.000 (0.000)] 2024-10-13 00:29:19,302 - Train: 78.58% [294900/375300] [235.7/300.0] [batch_t 0.380 (0.446)] [data_t 0.079] [optim_t 0.301] [lr 0.000354] [CE 3.286 (3.044)] [KD 0.000 (0.000)] 2024-10-13 00:29:40,812 - Train: 78.59% [294950/375300] [235.8/300.0] [batch_t 0.403 (0.430)] [data_t 0.097] [optim_t 0.306] [lr 0.000353] [CE 3.045 (3.073)] [KD 0.000 (0.000)] 2024-10-13 00:30:01,649 - Train: 78.60% [295000/375300] [235.8/300.0] [batch_t 0.318 (0.417)] [data_t 0.016] [optim_t 0.302] [lr 0.000353] [CE 3.214 (3.047)] [KD 0.000 (0.000)] 2024-10-13 00:30:22,675 - Train: 78.62% [295050/375300] [235.9/300.0] [batch_t 0.421 (0.420)] [data_t 0.015] [optim_t 0.405] [lr 0.000353] [CE 3.157 (3.046)] [KD 0.000 (0.000)] 2024-10-13 00:30:43,552 - Train: 78.63% [295100/375300] [235.9/300.0] [batch_t 0.483 (0.417)] [data_t 0.187] [optim_t 0.296] [lr 0.000352] [CE 3.084 (3.028)] [KD 0.000 (0.000)] 2024-10-13 00:31:05,073 - Train: 78.64% [295150/375300] [235.9/300.0] [batch_t 0.478 (0.430)] [data_t 0.175] [optim_t 0.303] [lr 0.000352] [CE 3.051 (3.071)] [KD 0.000 (0.000)] 2024-10-13 00:31:26,282 - Train: 78.66% [295200/375300] [236.0/300.0] [batch_t 0.402 (0.424)] [data_t 0.104] [optim_t 0.299] [lr 0.000352] [CE 3.020 (3.089)] [KD 0.000 (0.000)] 2024-10-13 00:32:01,911 - Test (net): 100.00% [50/50] [batch_t 0.131 (0.425)] [top1_cnt 40044] [top5_cnt 47621] [top_all 50000] 2024-10-13 00:32:01,912 - net: 80.088 (95.242) 2024-10-13 00:32:23,710 - Test (net_E): 100.00% [50/50] [batch_t 0.130 (0.430)] [top1_cnt 40930] [top5_cnt 48013] [top_all 50000] 2024-10-13 00:32:23,710 - net_E: 81.860 (96.026) 2024-10-13 00:32:23,857 - Max [top1: 80.112 (epoch: 234)] [top1-ema: 81.892 (epoch: 233)] 2024-10-13 00:32:23,858 - ==> Total time: 1 day, 12:45:27 Eta: 9:58:05 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 00:32:34,825 - Train: 78.67% [295250/375300] [236.0/300.0] [batch_t 0.314 (0.666)] [data_t 0.015] [optim_t 0.299] [lr 0.000351] [CE 2.925 (3.075)] [KD 0.000 (0.000)] 2024-10-13 00:32:56,834 - Train: 78.68% [295300/375300] [236.1/300.0] [batch_t 0.462 (0.440)] [data_t 0.016] [optim_t 0.446] [lr 0.000351] [CE 3.091 (3.017)] [KD 0.000 (0.000)] 2024-10-13 00:33:19,444 - Train: 78.70% [295350/375300] [236.1/300.0] [batch_t 0.323 (0.452)] [data_t 0.016] [optim_t 0.307] [lr 0.000350] [CE 2.693 (3.042)] [KD 0.000 (0.000)] 2024-10-13 00:33:40,366 - Train: 78.71% [295400/375300] [236.1/300.0] [batch_t 0.380 (0.418)] [data_t 0.015] [optim_t 0.365] [lr 0.000350] [CE 2.724 (3.053)] [KD 0.000 (0.000)] 2024-10-13 00:34:01,483 - Train: 78.72% [295450/375300] [236.2/300.0] [batch_t 0.440 (0.422)] [data_t 0.016] [optim_t 0.425] [lr 0.000350] [CE 3.055 (3.071)] [KD 0.000 (0.000)] 2024-10-13 00:34:22,919 - Train: 78.74% [295500/375300] [236.2/300.0] [batch_t 0.408 (0.429)] [data_t 0.016] [optim_t 0.392] [lr 0.000349] [CE 3.096 (3.039)] [KD 0.000 (0.000)] 2024-10-13 00:34:44,411 - Train: 78.75% [295550/375300] [236.3/300.0] [batch_t 0.430 (0.430)] [data_t 0.016] [optim_t 0.414] [lr 0.000349] [CE 3.019 (3.069)] [KD 0.000 (0.000)] 2024-10-13 00:35:06,266 - Train: 78.76% [295600/375300] [236.3/300.0] [batch_t 0.447 (0.437)] [data_t 0.016] [optim_t 0.431] [lr 0.000348] [CE 2.975 (3.040)] [KD 0.000 (0.000)] 2024-10-13 00:35:28,304 - Train: 78.78% [295650/375300] [236.3/300.0] [batch_t 0.441 (0.441)] [data_t 0.015] [optim_t 0.425] [lr 0.000348] [CE 2.830 (3.030)] [KD 0.000 (0.000)] 2024-10-13 00:35:50,474 - Train: 78.79% [295700/375300] [236.4/300.0] [batch_t 0.479 (0.443)] [data_t 0.016] [optim_t 0.464] [lr 0.000348] [CE 3.104 (3.044)] [KD 0.000 (0.000)] 2024-10-13 00:36:12,578 - Train: 78.80% [295750/375300] [236.4/300.0] [batch_t 0.432 (0.442)] [data_t 0.015] [optim_t 0.417] [lr 0.000347] [CE 3.172 (3.036)] [KD 0.000 (0.000)] 2024-10-13 00:36:34,480 - Train: 78.82% [295800/375300] [236.5/300.0] [batch_t 0.485 (0.438)] [data_t 0.015] [optim_t 0.469] [lr 0.000347] [CE 3.161 (3.075)] [KD 0.000 (0.000)] 2024-10-13 00:36:56,593 - Train: 78.83% [295850/375300] [236.5/300.0] [batch_t 0.502 (0.442)] [data_t 0.016] [optim_t 0.486] [lr 0.000346] [CE 3.208 (3.066)] [KD 0.000 (0.000)] 2024-10-13 00:37:18,736 - Train: 78.84% [295900/375300] [236.5/300.0] [batch_t 0.464 (0.443)] [data_t 0.016] [optim_t 0.449] [lr 0.000346] [CE 3.039 (3.051)] [KD 0.000 (0.000)] 2024-10-13 00:37:40,566 - Train: 78.86% [295950/375300] [236.6/300.0] [batch_t 0.463 (0.436)] [data_t 0.015] [optim_t 0.447] [lr 0.000346] [CE 2.975 (3.073)] [KD 0.000 (0.000)] 2024-10-13 00:38:01,408 - Train: 78.87% [296000/375300] [236.6/300.0] [batch_t 0.390 (0.417)] [data_t 0.016] [optim_t 0.374] [lr 0.000345] [CE 3.020 (3.025)] [KD 0.000 (0.000)] 2024-10-13 00:38:22,878 - Train: 78.88% [296050/375300] [236.7/300.0] [batch_t 0.482 (0.429)] [data_t 0.186] [optim_t 0.296] [lr 0.000345] [CE 2.987 (3.054)] [KD 0.000 (0.000)] 2024-10-13 00:38:44,696 - Train: 78.90% [296100/375300] [236.7/300.0] [batch_t 0.409 (0.436)] [data_t 0.112] [optim_t 0.297] [lr 0.000345] [CE 2.826 (3.058)] [KD 0.000 (0.000)] 2024-10-13 00:39:05,320 - Train: 78.91% [296150/375300] [236.7/300.0] [batch_t 0.390 (0.412)] [data_t 0.094] [optim_t 0.296] [lr 0.000344] [CE 3.205 (3.039)] [KD 0.000 (0.000)] 2024-10-13 00:39:26,220 - Train: 78.92% [296200/375300] [236.8/300.0] [batch_t 0.418 (0.418)] [data_t 0.116] [optim_t 0.302] [lr 0.000344] [CE 3.245 (3.079)] [KD 0.000 (0.000)] 2024-10-13 00:39:47,191 - Train: 78.94% [296250/375300] [236.8/300.0] [batch_t 0.446 (0.419)] [data_t 0.015] [optim_t 0.431] [lr 0.000343] [CE 2.985 (3.088)] [KD 0.000 (0.000)] 2024-10-13 00:40:08,415 - Train: 78.95% [296300/375300] [236.9/300.0] [batch_t 0.376 (0.424)] [data_t 0.015] [optim_t 0.360] [lr 0.000343] [CE 3.003 (3.077)] [KD 0.000 (0.000)] 2024-10-13 00:40:30,370 - Train: 78.96% [296350/375300] [236.9/300.0] [batch_t 0.410 (0.439)] [data_t 0.015] [optim_t 0.395] [lr 0.000343] [CE 2.971 (3.081)] [KD 0.000 (0.000)] 2024-10-13 00:40:52,276 - Train: 78.98% [296400/375300] [236.9/300.0] [batch_t 0.399 (0.438)] [data_t 0.016] [optim_t 0.384] [lr 0.000342] [CE 2.907 (3.067)] [KD 0.000 (0.000)] 2024-10-13 00:41:13,588 - Train: 78.99% [296450/375300] [237.0/300.0] [batch_t 0.435 (0.426)] [data_t 0.015] [optim_t 0.419] [lr 0.000342] [CE 2.931 (3.067)] [KD 0.000 (0.000)] 2024-10-13 00:41:49,757 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.428)] [top1_cnt 39814] [top5_cnt 47610] [top_all 50000] 2024-10-13 00:41:49,758 - net: 79.628 (95.220) 2024-10-13 00:42:11,377 - Test (net_E): 100.00% [50/50] [batch_t 0.133 (0.425)] [top1_cnt 40942] [top5_cnt 48011] [top_all 50000] 2024-10-13 00:42:11,378 - net_E: 81.884 (96.022) 2024-10-13 00:42:11,600 - Max [top1: 80.112 (epoch: 234)] [top1-ema: 81.892 (epoch: 233)] 2024-10-13 00:42:11,601 - ==> Total time: 1 day, 12:55:15 Eta: 9:48:51 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 00:42:22,560 - Train: 79.00% [296500/375300] [237.0/300.0] [batch_t 0.320 (0.735)] [data_t 0.015] [optim_t 0.305] [lr 0.000342] [CE 2.890 (3.063)] [KD 0.000 (0.000)] 2024-10-13 00:42:43,050 - Train: 79.02% [296550/375300] [237.1/300.0] [batch_t 0.363 (0.410)] [data_t 0.015] [optim_t 0.347] [lr 0.000341] [CE 3.115 (3.028)] [KD 0.000 (0.000)] 2024-10-13 00:43:06,179 - Train: 79.03% [296600/375300] [237.1/300.0] [batch_t 0.438 (0.462)] [data_t 0.016] [optim_t 0.422] [lr 0.000341] [CE 2.988 (3.033)] [KD 0.000 (0.000)] 2024-10-13 00:43:29,233 - Train: 79.04% [296650/375300] [237.1/300.0] [batch_t 0.441 (0.461)] [data_t 0.016] [optim_t 0.426] [lr 0.000340] [CE 2.894 (3.006)] [KD 0.000 (0.000)] 2024-10-13 00:43:51,362 - Train: 79.06% [296700/375300] [237.2/300.0] [batch_t 0.397 (0.442)] [data_t 0.015] [optim_t 0.382] [lr 0.000340] [CE 3.194 (3.018)] [KD 0.000 (0.000)] 2024-10-13 00:44:12,367 - Train: 79.07% [296750/375300] [237.2/300.0] [batch_t 0.407 (0.420)] [data_t 0.015] [optim_t 0.391] [lr 0.000340] [CE 2.895 (3.062)] [KD 0.000 (0.000)] 2024-10-13 00:44:33,605 - Train: 79.08% [296800/375300] [237.3/300.0] [batch_t 0.461 (0.425)] [data_t 0.015] [optim_t 0.445] [lr 0.000339] [CE 2.984 (3.054)] [KD 0.000 (0.000)] 2024-10-13 00:44:55,578 - Train: 79.10% [296850/375300] [237.3/300.0] [batch_t 0.431 (0.439)] [data_t 0.016] [optim_t 0.416] [lr 0.000339] [CE 3.127 (3.059)] [KD 0.000 (0.000)] 2024-10-13 00:45:18,058 - Train: 79.11% [296900/375300] [237.3/300.0] [batch_t 0.421 (0.449)] [data_t 0.016] [optim_t 0.406] [lr 0.000338] [CE 3.206 (3.054)] [KD 0.000 (0.000)] 2024-10-13 00:45:40,289 - Train: 79.12% [296950/375300] [237.4/300.0] [batch_t 0.446 (0.445)] [data_t 0.016] [optim_t 0.431] [lr 0.000338] [CE 2.887 (3.064)] [KD 0.000 (0.000)] 2024-10-13 00:46:02,714 - Train: 79.14% [297000/375300] [237.4/300.0] [batch_t 0.461 (0.448)] [data_t 0.163] [optim_t 0.297] [lr 0.000338] [CE 3.168 (3.092)] [KD 0.000 (0.000)] 2024-10-13 00:46:24,662 - Train: 79.15% [297050/375300] [237.5/300.0] [batch_t 0.435 (0.439)] [data_t 0.141] [optim_t 0.294] [lr 0.000337] [CE 3.044 (3.036)] [KD 0.000 (0.000)] 2024-10-13 00:46:45,838 - Train: 79.16% [297100/375300] [237.5/300.0] [batch_t 0.445 (0.423)] [data_t 0.149] [optim_t 0.296] [lr 0.000337] [CE 3.228 (3.038)] [KD 0.000 (0.000)] 2024-10-13 00:47:07,784 - Train: 79.18% [297150/375300] [237.5/300.0] [batch_t 0.463 (0.439)] [data_t 0.015] [optim_t 0.448] [lr 0.000337] [CE 3.218 (3.084)] [KD 0.000 (0.000)] 2024-10-13 00:47:29,636 - Train: 79.19% [297200/375300] [237.6/300.0] [batch_t 0.432 (0.437)] [data_t 0.015] [optim_t 0.417] [lr 0.000336] [CE 2.893 (3.040)] [KD 0.000 (0.000)] 2024-10-13 00:47:51,614 - Train: 79.20% [297250/375300] [237.6/300.0] [batch_t 0.504 (0.439)] [data_t 0.016] [optim_t 0.489] [lr 0.000336] [CE 3.396 (3.080)] [KD 0.000 (0.000)] 2024-10-13 00:48:13,833 - Train: 79.22% [297300/375300] [237.6/300.0] [batch_t 0.461 (0.444)] [data_t 0.016] [optim_t 0.446] [lr 0.000335] [CE 3.284 (3.073)] [KD 0.000 (0.000)] 2024-10-13 00:48:36,244 - Train: 79.23% [297350/375300] [237.7/300.0] [batch_t 0.443 (0.448)] [data_t 0.015] [optim_t 0.428] [lr 0.000335] [CE 3.180 (3.035)] [KD 0.000 (0.000)] 2024-10-13 00:48:59,128 - Train: 79.24% [297400/375300] [237.7/300.0] [batch_t 0.318 (0.458)] [data_t 0.016] [optim_t 0.303] [lr 0.000335] [CE 2.855 (3.044)] [KD 0.000 (0.000)] 2024-10-13 00:49:20,764 - Train: 79.26% [297450/375300] [237.8/300.0] [batch_t 0.376 (0.433)] [data_t 0.016] [optim_t 0.360] [lr 0.000334] [CE 3.065 (3.070)] [KD 0.000 (0.000)] 2024-10-13 00:49:42,560 - Train: 79.27% [297500/375300] [237.8/300.0] [batch_t 0.413 (0.436)] [data_t 0.016] [optim_t 0.398] [lr 0.000334] [CE 2.984 (3.104)] [KD 0.000 (0.000)] 2024-10-13 00:50:04,981 - Train: 79.28% [297550/375300] [237.8/300.0] [batch_t 0.469 (0.448)] [data_t 0.016] [optim_t 0.453] [lr 0.000334] [CE 2.763 (3.066)] [KD 0.000 (0.000)] 2024-10-13 00:50:26,330 - Train: 79.30% [297600/375300] [237.9/300.0] [batch_t 0.433 (0.427)] [data_t 0.015] [optim_t 0.418] [lr 0.000333] [CE 3.234 (3.050)] [KD 0.000 (0.000)] 2024-10-13 00:50:47,664 - Train: 79.31% [297650/375300] [237.9/300.0] [batch_t 0.456 (0.427)] [data_t 0.015] [optim_t 0.441] [lr 0.000333] [CE 3.167 (3.060)] [KD 0.000 (0.000)] 2024-10-13 00:51:09,523 - Train: 79.32% [297700/375300] [238.0/300.0] [batch_t 0.422 (0.437)] [data_t 0.015] [optim_t 0.407] [lr 0.000332] [CE 3.051 (3.068)] [KD 0.000 (0.000)] 2024-10-13 00:51:47,275 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.452)] [top1_cnt 40259] [top5_cnt 47684] [top_all 50000] 2024-10-13 00:51:47,276 - net: 80.518 (95.368) 2024-10-13 00:52:10,045 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.448)] [top1_cnt 40977] [top5_cnt 48011] [top_all 50000] 2024-10-13 00:52:10,045 - net_E: 81.954 (96.022) 2024-10-13 00:52:10,321 - Max [top1: 80.518 (epoch: 238)] [top1-ema: 81.954 (epoch: 238)] 2024-10-13 00:52:10,322 - ==> Total time: 1 day, 13:05:14 Eta: 9:39:41 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 00:52:23,029 - Train: 79.34% [297750/375300] [238.0/300.0] [batch_t 0.316 (0.512)] [data_t 0.015] [optim_t 0.300] [lr 0.000332] [CE 3.017 (2.996)] [KD 0.000 (0.000)] 2024-10-13 00:52:44,402 - Train: 79.35% [297800/375300] [238.0/300.0] [batch_t 0.452 (0.427)] [data_t 0.016] [optim_t 0.437] [lr 0.000332] [CE 2.867 (3.045)] [KD 0.000 (0.000)] 2024-10-13 00:53:06,721 - Train: 79.36% [297850/375300] [238.1/300.0] [batch_t 0.458 (0.446)] [data_t 0.016] [optim_t 0.442] [lr 0.000331] [CE 2.794 (3.016)] [KD 0.000 (0.000)] 2024-10-13 00:53:28,911 - Train: 79.38% [297900/375300] [238.1/300.0] [batch_t 0.506 (0.444)] [data_t 0.015] [optim_t 0.491] [lr 0.000331] [CE 2.899 (3.063)] [KD 0.000 (0.000)] 2024-10-13 00:53:50,955 - Train: 79.39% [297950/375300] [238.2/300.0] [batch_t 0.445 (0.441)] [data_t 0.016] [optim_t 0.429] [lr 0.000331] [CE 2.831 (3.027)] [KD 0.000 (0.000)] 2024-10-13 00:54:13,048 - Train: 79.40% [298000/375300] [238.2/300.0] [batch_t 0.319 (0.442)] [data_t 0.016] [optim_t 0.303] [lr 0.000330] [CE 2.980 (3.059)] [KD 0.000 (0.000)] 2024-10-13 00:54:35,087 - Train: 79.42% [298050/375300] [238.2/300.0] [batch_t 0.458 (0.441)] [data_t 0.016] [optim_t 0.442] [lr 0.000330] [CE 3.075 (3.015)] [KD 0.000 (0.000)] 2024-10-13 00:54:57,168 - Train: 79.43% [298100/375300] [238.3/300.0] [batch_t 0.374 (0.442)] [data_t 0.015] [optim_t 0.358] [lr 0.000329] [CE 2.690 (3.056)] [KD 0.000 (0.000)] 2024-10-13 00:55:19,348 - Train: 79.44% [298150/375300] [238.3/300.0] [batch_t 0.374 (0.443)] [data_t 0.016] [optim_t 0.358] [lr 0.000329] [CE 2.719 (3.043)] [KD 0.000 (0.000)] 2024-10-13 00:55:41,666 - Train: 79.46% [298200/375300] [238.4/300.0] [batch_t 0.424 (0.446)] [data_t 0.016] [optim_t 0.407] [lr 0.000329] [CE 3.124 (3.072)] [KD 0.000 (0.000)] 2024-10-13 00:56:03,958 - Train: 79.47% [298250/375300] [238.4/300.0] [batch_t 0.446 (0.446)] [data_t 0.016] [optim_t 0.430] [lr 0.000328] [CE 2.960 (3.048)] [KD 0.000 (0.000)] 2024-10-13 00:56:25,811 - Train: 79.48% [298300/375300] [238.4/300.0] [batch_t 0.358 (0.437)] [data_t 0.016] [optim_t 0.342] [lr 0.000328] [CE 3.137 (3.053)] [KD 0.000 (0.000)] 2024-10-13 00:56:47,417 - Train: 79.50% [298350/375300] [238.5/300.0] [batch_t 0.372 (0.432)] [data_t 0.015] [optim_t 0.356] [lr 0.000328] [CE 3.170 (3.045)] [KD 0.000 (0.000)] 2024-10-13 00:57:09,260 - Train: 79.51% [298400/375300] [238.5/300.0] [batch_t 0.413 (0.437)] [data_t 0.015] [optim_t 0.398] [lr 0.000327] [CE 2.916 (2.987)] [KD 0.000 (0.000)] 2024-10-13 00:57:30,821 - Train: 79.52% [298450/375300] [238.6/300.0] [batch_t 0.468 (0.431)] [data_t 0.060] [optim_t 0.409] [lr 0.000327] [CE 2.986 (3.062)] [KD 0.000 (0.000)] 2024-10-13 00:57:53,494 - Train: 79.54% [298500/375300] [238.6/300.0] [batch_t 0.473 (0.453)] [data_t 0.015] [optim_t 0.457] [lr 0.000326] [CE 2.657 (3.040)] [KD 0.000 (0.000)] 2024-10-13 00:58:16,040 - Train: 79.55% [298550/375300] [238.6/300.0] [batch_t 0.887 (0.451)] [data_t 0.015] [optim_t 0.872] [lr 0.000326] [CE 3.066 (3.060)] [KD 0.000 (0.000)] 2024-10-13 00:58:37,732 - Train: 79.56% [298600/375300] [238.7/300.0] [batch_t 0.396 (0.434)] [data_t 0.015] [optim_t 0.380] [lr 0.000326] [CE 3.250 (3.050)] [KD 0.000 (0.000)] 2024-10-13 00:58:59,259 - Train: 79.58% [298650/375300] [238.7/300.0] [batch_t 0.386 (0.430)] [data_t 0.015] [optim_t 0.371] [lr 0.000325] [CE 2.978 (3.025)] [KD 0.000 (0.000)] 2024-10-13 00:59:20,920 - Train: 79.59% [298700/375300] [238.8/300.0] [batch_t 0.407 (0.433)] [data_t 0.015] [optim_t 0.391] [lr 0.000325] [CE 3.301 (3.032)] [KD 0.000 (0.000)] 2024-10-13 00:59:42,874 - Train: 79.60% [298750/375300] [238.8/300.0] [batch_t 0.416 (0.439)] [data_t 0.016] [optim_t 0.400] [lr 0.000325] [CE 3.260 (3.057)] [KD 0.000 (0.000)] 2024-10-13 01:00:05,103 - Train: 79.62% [298800/375300] [238.8/300.0] [batch_t 0.355 (0.444)] [data_t 0.016] [optim_t 0.339] [lr 0.000324] [CE 3.197 (3.010)] [KD 0.000 (0.000)] 2024-10-13 01:00:26,842 - Train: 79.63% [298850/375300] [238.9/300.0] [batch_t 0.433 (0.435)] [data_t 0.016] [optim_t 0.418] [lr 0.000324] [CE 2.994 (3.064)] [KD 0.000 (0.000)] 2024-10-13 01:00:48,644 - Train: 79.64% [298900/375300] [238.9/300.0] [batch_t 0.397 (0.436)] [data_t 0.015] [optim_t 0.381] [lr 0.000323] [CE 2.938 (3.069)] [KD 0.000 (0.000)] 2024-10-13 01:01:10,557 - Train: 79.66% [298950/375300] [239.0/300.0] [batch_t 0.401 (0.438)] [data_t 0.015] [optim_t 0.386] [lr 0.000323] [CE 3.057 (3.051)] [KD 0.000 (0.000)] 2024-10-13 01:01:47,232 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.424)] [top1_cnt 40008] [top5_cnt 47640] [top_all 50000] 2024-10-13 01:01:47,232 - net: 80.016 (95.280) 2024-10-13 01:02:09,374 - Test (net_E): 100.00% [50/50] [batch_t 0.141 (0.436)] [top1_cnt 40951] [top5_cnt 48015] [top_all 50000] 2024-10-13 01:02:09,375 - net_E: 81.902 (96.030) 2024-10-13 01:02:09,520 - Max [top1: 80.518 (epoch: 238)] [top1-ema: 81.954 (epoch: 238)] 2024-10-13 01:02:09,520 - ==> Total time: 1 day, 13:15:13 Eta: 9:30:29 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 01:02:19,695 - Train: 79.67% [299000/375300] [239.0/300.0] [batch_t 0.317 (0.764)] [data_t 0.015] [optim_t 0.302] [lr 0.000323] [CE 2.922 (3.066)] [KD 0.000 (0.000)] 2024-10-13 01:02:41,048 - Train: 79.68% [299050/375300] [239.0/300.0] [batch_t 0.431 (0.427)] [data_t 0.016] [optim_t 0.415] [lr 0.000322] [CE 2.861 (3.043)] [KD 0.000 (0.000)] 2024-10-13 01:03:03,862 - Train: 79.70% [299100/375300] [239.1/300.0] [batch_t 0.422 (0.456)] [data_t 0.015] [optim_t 0.406] [lr 0.000322] [CE 3.144 (2.994)] [KD 0.000 (0.000)] 2024-10-13 01:03:24,804 - Train: 79.71% [299150/375300] [239.1/300.0] [batch_t 0.417 (0.419)] [data_t 0.015] [optim_t 0.401] [lr 0.000322] [CE 3.297 (3.030)] [KD 0.000 (0.000)] 2024-10-13 01:03:46,305 - Train: 79.72% [299200/375300] [239.2/300.0] [batch_t 0.381 (0.430)] [data_t 0.016] [optim_t 0.365] [lr 0.000321] [CE 3.059 (3.073)] [KD 0.000 (0.000)] 2024-10-13 01:04:08,228 - Train: 79.74% [299250/375300] [239.2/300.0] [batch_t 0.466 (0.438)] [data_t 0.016] [optim_t 0.450] [lr 0.000321] [CE 3.039 (3.055)] [KD 0.000 (0.000)] 2024-10-13 01:04:29,477 - Train: 79.75% [299300/375300] [239.2/300.0] [batch_t 0.420 (0.425)] [data_t 0.016] [optim_t 0.404] [lr 0.000321] [CE 3.252 (3.027)] [KD 0.000 (0.000)] 2024-10-13 01:04:51,013 - Train: 79.76% [299350/375300] [239.3/300.0] [batch_t 0.398 (0.431)] [data_t 0.016] [optim_t 0.382] [lr 0.000320] [CE 2.597 (3.016)] [KD 0.000 (0.000)] 2024-10-13 01:05:13,283 - Train: 79.78% [299400/375300] [239.3/300.0] [batch_t 0.433 (0.445)] [data_t 0.015] [optim_t 0.418] [lr 0.000320] [CE 2.867 (3.023)] [KD 0.000 (0.000)] 2024-10-13 01:05:35,932 - Train: 79.79% [299450/375300] [239.4/300.0] [batch_t 0.513 (0.453)] [data_t 0.015] [optim_t 0.498] [lr 0.000319] [CE 2.918 (3.034)] [KD 0.000 (0.000)] 2024-10-13 01:05:58,011 - Train: 79.80% [299500/375300] [239.4/300.0] [batch_t 0.449 (0.441)] [data_t 0.015] [optim_t 0.433] [lr 0.000319] [CE 3.258 (3.013)] [KD 0.000 (0.000)] 2024-10-13 01:06:20,512 - Train: 79.82% [299550/375300] [239.4/300.0] [batch_t 0.315 (0.450)] [data_t 0.015] [optim_t 0.299] [lr 0.000319] [CE 3.185 (3.059)] [KD 0.000 (0.000)] 2024-10-13 01:06:42,578 - Train: 79.83% [299600/375300] [239.5/300.0] [batch_t 0.489 (0.441)] [data_t 0.016] [optim_t 0.474] [lr 0.000318] [CE 3.135 (3.025)] [KD 0.000 (0.000)] 2024-10-13 01:07:04,978 - Train: 79.84% [299650/375300] [239.5/300.0] [batch_t 0.441 (0.448)] [data_t 0.015] [optim_t 0.426] [lr 0.000318] [CE 2.869 (3.019)] [KD 0.000 (0.000)] 2024-10-13 01:07:26,982 - Train: 79.86% [299700/375300] [239.6/300.0] [batch_t 0.418 (0.440)] [data_t 0.016] [optim_t 0.402] [lr 0.000318] [CE 2.934 (2.996)] [KD 0.000 (0.000)] 2024-10-13 01:07:49,115 - Train: 79.87% [299750/375300] [239.6/300.0] [batch_t 0.405 (0.443)] [data_t 0.015] [optim_t 0.390] [lr 0.000317] [CE 3.066 (3.066)] [KD 0.000 (0.000)] 2024-10-13 01:08:11,185 - Train: 79.88% [299800/375300] [239.6/300.0] [batch_t 0.451 (0.441)] [data_t 0.015] [optim_t 0.436] [lr 0.000317] [CE 2.924 (3.036)] [KD 0.000 (0.000)] 2024-10-13 01:08:32,440 - Train: 79.90% [299850/375300] [239.7/300.0] [batch_t 0.454 (0.425)] [data_t 0.015] [optim_t 0.439] [lr 0.000316] [CE 2.947 (3.011)] [KD 0.000 (0.000)] 2024-10-13 01:08:53,434 - Train: 79.91% [299900/375300] [239.7/300.0] [batch_t 0.418 (0.420)] [data_t 0.015] [optim_t 0.402] [lr 0.000316] [CE 3.100 (3.072)] [KD 0.000 (0.000)] 2024-10-13 01:09:14,346 - Train: 79.92% [299950/375300] [239.8/300.0] [batch_t 0.318 (0.418)] [data_t 0.015] [optim_t 0.302] [lr 0.000316] [CE 2.996 (3.053)] [KD 0.000 (0.000)] 2024-10-13 01:09:35,605 - Train: 79.94% [300000/375300] [239.8/300.0] [batch_t 0.541 (0.425)] [data_t 0.015] [optim_t 0.526] [lr 0.000315] [CE 3.182 (3.051)] [KD 0.000 (0.000)] 2024-10-13 01:09:57,838 - Train: 79.95% [300050/375300] [239.8/300.0] [batch_t 0.319 (0.445)] [data_t 0.015] [optim_t 0.304] [lr 0.000315] [CE 2.839 (3.064)] [KD 0.000 (0.000)] 2024-10-13 01:10:19,815 - Train: 79.96% [300100/375300] [239.9/300.0] [batch_t 0.423 (0.439)] [data_t 0.015] [optim_t 0.407] [lr 0.000315] [CE 3.140 (3.008)] [KD 0.000 (0.000)] 2024-10-13 01:10:41,353 - Train: 79.98% [300150/375300] [239.9/300.0] [batch_t 0.494 (0.431)] [data_t 0.015] [optim_t 0.478] [lr 0.000314] [CE 2.853 (3.039)] [KD 0.000 (0.000)] 2024-10-13 01:11:03,686 - Train: 79.99% [300200/375300] [240.0/300.0] [batch_t 0.476 (0.447)] [data_t 0.015] [optim_t 0.460] [lr 0.000314] [CE 3.036 (3.016)] [KD 0.000 (0.000)] 2024-10-13 01:11:41,630 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.433)] [top1_cnt 40135] [top5_cnt 47684] [top_all 50000] 2024-10-13 01:11:41,630 - net: 80.270 (95.368) 2024-10-13 01:12:03,582 - Test (net_E): 100.00% [50/50] [batch_t 0.133 (0.431)] [top1_cnt 40958] [top5_cnt 48035] [top_all 50000] 2024-10-13 01:12:03,583 - net_E: 81.916 (96.070) 2024-10-13 01:12:03,726 - Max [top1: 80.518 (epoch: 238)] [top1-ema: 81.954 (epoch: 238)] 2024-10-13 01:12:03,726 - ==> Total time: 1 day, 13:25:07 Eta: 9:21:16 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 01:12:16,182 - Train: 80.00% [300250/375300] [240.0/300.0] [batch_t 0.318 (0.562)] [data_t 0.016] [optim_t 0.303] [lr 0.000314] [CE 2.927 (3.046)] [KD 0.000 (0.000)] 2024-10-13 01:12:37,626 - Train: 80.02% [300300/375300] [240.0/300.0] [batch_t 0.518 (0.429)] [data_t 0.221] [optim_t 0.296] [lr 0.000313] [CE 3.285 (3.037)] [KD 0.000 (0.000)] 2024-10-13 01:13:00,666 - Train: 80.03% [300350/375300] [240.1/300.0] [batch_t 0.465 (0.461)] [data_t 0.175] [optim_t 0.290] [lr 0.000313] [CE 3.232 (3.062)] [KD 0.000 (0.000)] 2024-10-13 01:13:22,691 - Train: 80.04% [300400/375300] [240.1/300.0] [batch_t 0.438 (0.440)] [data_t 0.143] [optim_t 0.294] [lr 0.000312] [CE 3.187 (2.996)] [KD 0.000 (0.000)] 2024-10-13 01:13:44,738 - Train: 80.06% [300450/375300] [240.2/300.0] [batch_t 0.489 (0.441)] [data_t 0.193] [optim_t 0.296] [lr 0.000312] [CE 2.867 (3.047)] [KD 0.000 (0.000)] 2024-10-13 01:14:06,746 - Train: 80.07% [300500/375300] [240.2/300.0] [batch_t 0.404 (0.440)] [data_t 0.108] [optim_t 0.296] [lr 0.000312] [CE 2.892 (3.073)] [KD 0.000 (0.000)] 2024-10-13 01:14:29,057 - Train: 80.08% [300550/375300] [240.2/300.0] [batch_t 0.426 (0.446)] [data_t 0.129] [optim_t 0.297] [lr 0.000311] [CE 2.675 (3.045)] [KD 0.000 (0.000)] 2024-10-13 01:14:50,960 - Train: 80.10% [300600/375300] [240.3/300.0] [batch_t 0.438 (0.438)] [data_t 0.139] [optim_t 0.299] [lr 0.000311] [CE 2.953 (3.053)] [KD 0.000 (0.000)] 2024-10-13 01:15:12,697 - Train: 80.11% [300650/375300] [240.3/300.0] [batch_t 0.499 (0.435)] [data_t 0.207] [optim_t 0.292] [lr 0.000311] [CE 2.821 (2.991)] [KD 0.000 (0.000)] 2024-10-13 01:15:33,642 - Train: 80.12% [300700/375300] [240.4/300.0] [batch_t 0.385 (0.419)] [data_t 0.086] [optim_t 0.299] [lr 0.000310] [CE 3.214 (3.029)] [KD 0.000 (0.000)] 2024-10-13 01:15:55,367 - Train: 80.14% [300750/375300] [240.4/300.0] [batch_t 0.384 (0.434)] [data_t 0.016] [optim_t 0.369] [lr 0.000310] [CE 3.171 (3.048)] [KD 0.000 (0.000)] 2024-10-13 01:16:17,370 - Train: 80.15% [300800/375300] [240.4/300.0] [batch_t 0.487 (0.440)] [data_t 0.015] [optim_t 0.472] [lr 0.000310] [CE 3.022 (3.021)] [KD 0.000 (0.000)] 2024-10-13 01:16:38,963 - Train: 80.16% [300850/375300] [240.5/300.0] [batch_t 0.388 (0.432)] [data_t 0.015] [optim_t 0.372] [lr 0.000309] [CE 2.978 (3.031)] [KD 0.000 (0.000)] 2024-10-13 01:17:00,623 - Train: 80.18% [300900/375300] [240.5/300.0] [batch_t 0.447 (0.433)] [data_t 0.016] [optim_t 0.432] [lr 0.000309] [CE 2.894 (3.010)] [KD 0.000 (0.000)] 2024-10-13 01:17:22,210 - Train: 80.19% [300950/375300] [240.6/300.0] [batch_t 0.395 (0.432)] [data_t 0.016] [optim_t 0.379] [lr 0.000308] [CE 3.013 (3.015)] [KD 0.000 (0.000)] 2024-10-13 01:17:43,496 - Train: 80.20% [301000/375300] [240.6/300.0] [batch_t 0.389 (0.426)] [data_t 0.016] [optim_t 0.374] [lr 0.000308] [CE 3.130 (3.045)] [KD 0.000 (0.000)] 2024-10-13 01:18:04,883 - Train: 80.22% [301050/375300] [240.6/300.0] [batch_t 0.497 (0.428)] [data_t 0.015] [optim_t 0.482] [lr 0.000308] [CE 3.234 (3.028)] [KD 0.000 (0.000)] 2024-10-13 01:18:26,932 - Train: 80.23% [301100/375300] [240.7/300.0] [batch_t 0.314 (0.441)] [data_t 0.015] [optim_t 0.299] [lr 0.000307] [CE 2.872 (3.022)] [KD 0.000 (0.000)] 2024-10-13 01:18:48,917 - Train: 80.24% [301150/375300] [240.7/300.0] [batch_t 0.403 (0.440)] [data_t 0.015] [optim_t 0.387] [lr 0.000307] [CE 3.236 (3.020)] [KD 0.000 (0.000)] 2024-10-13 01:19:10,865 - Train: 80.26% [301200/375300] [240.8/300.0] [batch_t 0.421 (0.439)] [data_t 0.015] [optim_t 0.406] [lr 0.000307] [CE 2.673 (2.986)] [KD 0.000 (0.000)] 2024-10-13 01:19:33,005 - Train: 80.27% [301250/375300] [240.8/300.0] [batch_t 0.431 (0.443)] [data_t 0.015] [optim_t 0.416] [lr 0.000306] [CE 3.019 (3.079)] [KD 0.000 (0.000)] 2024-10-13 01:19:54,832 - Train: 80.28% [301300/375300] [240.8/300.0] [batch_t 0.374 (0.436)] [data_t 0.015] [optim_t 0.358] [lr 0.000306] [CE 3.180 (3.049)] [KD 0.000 (0.000)] 2024-10-13 01:20:15,685 - Train: 80.30% [301350/375300] [240.9/300.0] [batch_t 0.416 (0.417)] [data_t 0.015] [optim_t 0.401] [lr 0.000306] [CE 3.020 (3.054)] [KD 0.000 (0.000)] 2024-10-13 01:20:37,314 - Train: 80.31% [301400/375300] [240.9/300.0] [batch_t 0.313 (0.432)] [data_t 0.016] [optim_t 0.298] [lr 0.000305] [CE 2.802 (3.017)] [KD 0.000 (0.000)] 2024-10-13 01:20:59,005 - Train: 80.32% [301450/375300] [241.0/300.0] [batch_t 0.438 (0.434)] [data_t 0.016] [optim_t 0.423] [lr 0.000305] [CE 3.113 (3.061)] [KD 0.000 (0.000)] 2024-10-13 01:21:37,899 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.438)] [top1_cnt 40123] [top5_cnt 47641] [top_all 50000] 2024-10-13 01:21:37,900 - net: 80.246 (95.282) 2024-10-13 01:22:00,327 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.442)] [top1_cnt 40958] [top5_cnt 48040] [top_all 50000] 2024-10-13 01:22:00,328 - net_E: 81.916 (96.080) 2024-10-13 01:22:00,475 - Max [top1: 80.518 (epoch: 238)] [top1-ema: 81.954 (epoch: 238)] 2024-10-13 01:22:00,476 - ==> Total time: 1 day, 13:35:04 Eta: 9:12:04 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 01:22:09,945 - Train: 80.34% [301500/375300] [241.0/300.0] [batch_t 0.314 (0.885)] [data_t 0.016] [optim_t 0.299] [lr 0.000304] [CE 3.149 (2.989)] [KD 0.000 (0.000)] 2024-10-13 01:22:29,584 - Train: 80.35% [301550/375300] [241.0/300.0] [batch_t 0.413 (0.393)] [data_t 0.015] [optim_t 0.398] [lr 0.000304] [CE 2.823 (2.974)] [KD 0.000 (0.000)] 2024-10-13 01:22:51,976 - Train: 80.36% [301600/375300] [241.1/300.0] [batch_t 0.428 (0.448)] [data_t 0.136] [optim_t 0.292] [lr 0.000304] [CE 2.673 (3.008)] [KD 0.000 (0.000)] 2024-10-13 01:23:13,655 - Train: 80.38% [301650/375300] [241.1/300.0] [batch_t 0.463 (0.433)] [data_t 0.169] [optim_t 0.294] [lr 0.000303] [CE 3.002 (3.014)] [KD 0.000 (0.000)] 2024-10-13 01:23:34,758 - Train: 80.39% [301700/375300] [241.2/300.0] [batch_t 0.312 (0.422)] [data_t 0.015] [optim_t 0.297] [lr 0.000303] [CE 2.723 (3.013)] [KD 0.000 (0.000)] 2024-10-13 01:23:56,702 - Train: 80.40% [301750/375300] [241.2/300.0] [batch_t 0.375 (0.439)] [data_t 0.016] [optim_t 0.360] [lr 0.000303] [CE 3.214 (2.994)] [KD 0.000 (0.000)] 2024-10-13 01:24:18,627 - Train: 80.42% [301800/375300] [241.2/300.0] [batch_t 0.406 (0.438)] [data_t 0.015] [optim_t 0.390] [lr 0.000302] [CE 3.215 (3.016)] [KD 0.000 (0.000)] 2024-10-13 01:24:40,551 - Train: 80.43% [301850/375300] [241.3/300.0] [batch_t 0.473 (0.438)] [data_t 0.015] [optim_t 0.457] [lr 0.000302] [CE 2.888 (3.033)] [KD 0.000 (0.000)] 2024-10-13 01:25:01,882 - Train: 80.44% [301900/375300] [241.3/300.0] [batch_t 0.463 (0.427)] [data_t 0.015] [optim_t 0.448] [lr 0.000302] [CE 2.966 (3.002)] [KD 0.000 (0.000)] 2024-10-13 01:25:23,577 - Train: 80.46% [301950/375300] [241.4/300.0] [batch_t 0.380 (0.434)] [data_t 0.015] [optim_t 0.365] [lr 0.000301] [CE 3.148 (3.071)] [KD 0.000 (0.000)] 2024-10-13 01:25:45,323 - Train: 80.47% [302000/375300] [241.4/300.0] [batch_t 0.413 (0.435)] [data_t 0.016] [optim_t 0.398] [lr 0.000301] [CE 3.351 (3.001)] [KD 0.000 (0.000)] 2024-10-13 01:26:07,273 - Train: 80.48% [302050/375300] [241.4/300.0] [batch_t 0.482 (0.439)] [data_t 0.016] [optim_t 0.467] [lr 0.000301] [CE 3.194 (3.013)] [KD 0.000 (0.000)] 2024-10-13 01:26:29,115 - Train: 80.50% [302100/375300] [241.5/300.0] [batch_t 0.449 (0.437)] [data_t 0.016] [optim_t 0.433] [lr 0.000300] [CE 3.010 (3.014)] [KD 0.000 (0.000)] 2024-10-13 01:26:50,753 - Train: 80.51% [302150/375300] [241.5/300.0] [batch_t 0.414 (0.433)] [data_t 0.016] [optim_t 0.398] [lr 0.000300] [CE 3.046 (3.040)] [KD 0.000 (0.000)] 2024-10-13 01:27:12,337 - Train: 80.52% [302200/375300] [241.6/300.0] [batch_t 0.387 (0.432)] [data_t 0.015] [optim_t 0.372] [lr 0.000299] [CE 3.295 (3.056)] [KD 0.000 (0.000)] 2024-10-13 01:27:33,607 - Train: 80.54% [302250/375300] [241.6/300.0] [batch_t 0.441 (0.425)] [data_t 0.016] [optim_t 0.426] [lr 0.000299] [CE 2.943 (3.025)] [KD 0.000 (0.000)] 2024-10-13 01:27:55,533 - Train: 80.55% [302300/375300] [241.6/300.0] [batch_t 0.460 (0.438)] [data_t 0.015] [optim_t 0.444] [lr 0.000299] [CE 3.371 (3.029)] [KD 0.000 (0.000)] 2024-10-13 01:28:17,366 - Train: 80.56% [302350/375300] [241.7/300.0] [batch_t 0.434 (0.437)] [data_t 0.015] [optim_t 0.419] [lr 0.000298] [CE 2.969 (3.015)] [KD 0.000 (0.000)] 2024-10-13 01:28:39,181 - Train: 80.58% [302400/375300] [241.7/300.0] [batch_t 0.452 (0.436)] [data_t 0.015] [optim_t 0.437] [lr 0.000298] [CE 3.113 (3.003)] [KD 0.000 (0.000)] 2024-10-13 01:29:00,548 - Train: 80.59% [302450/375300] [241.8/300.0] [batch_t 0.315 (0.427)] [data_t 0.015] [optim_t 0.300] [lr 0.000298] [CE 2.853 (3.033)] [KD 0.000 (0.000)] 2024-10-13 01:29:22,411 - Train: 80.60% [302500/375300] [241.8/300.0] [batch_t 0.485 (0.437)] [data_t 0.015] [optim_t 0.470] [lr 0.000297] [CE 2.865 (3.013)] [KD 0.000 (0.000)] 2024-10-13 01:29:44,153 - Train: 80.62% [302550/375300] [241.8/300.0] [batch_t 0.416 (0.435)] [data_t 0.015] [optim_t 0.401] [lr 0.000297] [CE 3.279 (2.989)] [KD 0.000 (0.000)] 2024-10-13 01:30:04,932 - Train: 80.63% [302600/375300] [241.9/300.0] [batch_t 0.396 (0.415)] [data_t 0.015] [optim_t 0.380] [lr 0.000297] [CE 3.234 (3.014)] [KD 0.000 (0.000)] 2024-10-13 01:30:26,424 - Train: 80.64% [302650/375300] [241.9/300.0] [batch_t 0.463 (0.430)] [data_t 0.015] [optim_t 0.447] [lr 0.000296] [CE 2.838 (2.986)] [KD 0.000 (0.000)] 2024-10-13 01:30:48,060 - Train: 80.66% [302700/375300] [242.0/300.0] [batch_t 0.452 (0.433)] [data_t 0.015] [optim_t 0.437] [lr 0.000296] [CE 2.935 (3.045)] [KD 0.000 (0.000)] 2024-10-13 01:31:26,371 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.431)] [top1_cnt 40263] [top5_cnt 47765] [top_all 50000] 2024-10-13 01:31:26,371 - net: 80.526 (95.530) 2024-10-13 01:31:48,173 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.429)] [top1_cnt 40975] [top5_cnt 48030] [top_all 50000] 2024-10-13 01:31:48,174 - net_E: 81.950 (96.060) 2024-10-13 01:31:48,344 - Max [top1: 80.526 (epoch: 242)] [top1-ema: 81.954 (epoch: 238)] 2024-10-13 01:31:48,344 - ==> Total time: 1 day, 13:44:52 Eta: 9:02:49 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 01:31:58,829 - Train: 80.67% [302750/375300] [242.0/300.0] [batch_t 0.314 (0.766)] [data_t 0.016] [optim_t 0.298] [lr 0.000296] [CE 2.917 (2.984)] [KD 0.000 (0.000)] 2024-10-13 01:32:18,568 - Train: 80.68% [302800/375300] [242.0/300.0] [batch_t 0.477 (0.395)] [data_t 0.016] [optim_t 0.462] [lr 0.000295] [CE 2.996 (3.028)] [KD 0.000 (0.000)] 2024-10-13 01:32:40,133 - Train: 80.70% [302850/375300] [242.1/300.0] [batch_t 0.465 (0.431)] [data_t 0.015] [optim_t 0.449] [lr 0.000295] [CE 3.248 (3.007)] [KD 0.000 (0.000)] 2024-10-13 01:33:01,800 - Train: 80.71% [302900/375300] [242.1/300.0] [batch_t 0.422 (0.433)] [data_t 0.015] [optim_t 0.406] [lr 0.000294] [CE 3.090 (3.017)] [KD 0.000 (0.000)] 2024-10-13 01:33:23,878 - Train: 80.72% [302950/375300] [242.2/300.0] [batch_t 0.466 (0.441)] [data_t 0.015] [optim_t 0.451] [lr 0.000294] [CE 3.105 (3.033)] [KD 0.000 (0.000)] 2024-10-13 01:33:45,917 - Train: 80.74% [303000/375300] [242.2/300.0] [batch_t 0.464 (0.441)] [data_t 0.016] [optim_t 0.449] [lr 0.000294] [CE 2.802 (3.014)] [KD 0.000 (0.000)] 2024-10-13 01:34:07,981 - Train: 80.75% [303050/375300] [242.2/300.0] [batch_t 0.442 (0.441)] [data_t 0.016] [optim_t 0.426] [lr 0.000293] [CE 2.963 (2.990)] [KD 0.000 (0.000)] 2024-10-13 01:34:29,935 - Train: 80.76% [303100/375300] [242.3/300.0] [batch_t 0.440 (0.439)] [data_t 0.016] [optim_t 0.425] [lr 0.000293] [CE 3.098 (3.047)] [KD 0.000 (0.000)] 2024-10-13 01:34:51,669 - Train: 80.78% [303150/375300] [242.3/300.0] [batch_t 0.462 (0.435)] [data_t 0.016] [optim_t 0.447] [lr 0.000293] [CE 2.901 (3.034)] [KD 0.000 (0.000)] 2024-10-13 01:35:13,427 - Train: 80.79% [303200/375300] [242.4/300.0] [batch_t 0.316 (0.435)] [data_t 0.015] [optim_t 0.300] [lr 0.000292] [CE 3.146 (3.036)] [KD 0.000 (0.000)] 2024-10-13 01:35:34,753 - Train: 80.80% [303250/375300] [242.4/300.0] [batch_t 0.457 (0.426)] [data_t 0.015] [optim_t 0.441] [lr 0.000292] [CE 3.141 (2.982)] [KD 0.000 (0.000)] 2024-10-13 01:35:55,769 - Train: 80.82% [303300/375300] [242.4/300.0] [batch_t 0.391 (0.420)] [data_t 0.015] [optim_t 0.375] [lr 0.000292] [CE 2.995 (3.019)] [KD 0.000 (0.000)] 2024-10-13 01:36:18,049 - Train: 80.83% [303350/375300] [242.5/300.0] [batch_t 0.403 (0.445)] [data_t 0.112] [optim_t 0.292] [lr 0.000291] [CE 3.015 (3.020)] [KD 0.000 (0.000)] 2024-10-13 01:36:39,546 - Train: 80.84% [303400/375300] [242.5/300.0] [batch_t 0.394 (0.430)] [data_t 0.094] [optim_t 0.300] [lr 0.000291] [CE 3.022 (3.013)] [KD 0.000 (0.000)] 2024-10-13 01:37:01,549 - Train: 80.86% [303450/375300] [242.6/300.0] [batch_t 0.488 (0.440)] [data_t 0.193] [optim_t 0.295] [lr 0.000291] [CE 2.996 (2.981)] [KD 0.000 (0.000)] 2024-10-13 01:37:23,471 - Train: 80.87% [303500/375300] [242.6/300.0] [batch_t 0.468 (0.438)] [data_t 0.167] [optim_t 0.300] [lr 0.000290] [CE 3.100 (3.046)] [KD 0.000 (0.000)] 2024-10-13 01:37:44,629 - Train: 80.88% [303550/375300] [242.6/300.0] [batch_t 0.382 (0.423)] [data_t 0.088] [optim_t 0.294] [lr 0.000290] [CE 2.791 (3.020)] [KD 0.000 (0.000)] 2024-10-13 01:38:07,142 - Train: 80.90% [303600/375300] [242.7/300.0] [batch_t 0.335 (0.450)] [data_t 0.015] [optim_t 0.320] [lr 0.000290] [CE 2.762 (3.030)] [KD 0.000 (0.000)] 2024-10-13 01:38:29,080 - Train: 80.91% [303650/375300] [242.7/300.0] [batch_t 0.463 (0.439)] [data_t 0.165] [optim_t 0.298] [lr 0.000289] [CE 3.188 (3.016)] [KD 0.000 (0.000)] 2024-10-13 01:38:50,774 - Train: 80.92% [303700/375300] [242.8/300.0] [batch_t 0.309 (0.434)] [data_t 0.016] [optim_t 0.294] [lr 0.000289] [CE 2.876 (3.013)] [KD 0.000 (0.000)] 2024-10-13 01:39:13,125 - Train: 80.94% [303750/375300] [242.8/300.0] [batch_t 0.505 (0.447)] [data_t 0.015] [optim_t 0.489] [lr 0.000288] [CE 2.474 (2.989)] [KD 0.000 (0.000)] 2024-10-13 01:39:34,877 - Train: 80.95% [303800/375300] [242.8/300.0] [batch_t 0.444 (0.435)] [data_t 0.150] [optim_t 0.294] [lr 0.000288] [CE 2.859 (3.063)] [KD 0.000 (0.000)] 2024-10-13 01:39:56,837 - Train: 80.96% [303850/375300] [242.9/300.0] [batch_t 0.480 (0.439)] [data_t 0.186] [optim_t 0.294] [lr 0.000288] [CE 2.874 (3.045)] [KD 0.000 (0.000)] 2024-10-13 01:40:18,785 - Train: 80.98% [303900/375300] [242.9/300.0] [batch_t 0.399 (0.439)] [data_t 0.101] [optim_t 0.297] [lr 0.000287] [CE 3.030 (3.032)] [KD 0.000 (0.000)] 2024-10-13 01:40:40,086 - Train: 80.99% [303950/375300] [243.0/300.0] [batch_t 0.464 (0.426)] [data_t 0.016] [optim_t 0.449] [lr 0.000287] [CE 3.203 (3.032)] [KD 0.000 (0.000)] 2024-10-13 01:41:18,618 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.423)] [top1_cnt 40279] [top5_cnt 47796] [top_all 50000] 2024-10-13 01:41:18,618 - net: 80.558 (95.592) 2024-10-13 01:41:40,981 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.440)] [top1_cnt 40990] [top5_cnt 48038] [top_all 50000] 2024-10-13 01:41:40,982 - net_E: 81.980 (96.076) 2024-10-13 01:41:41,141 - Max [top1: 80.558 (epoch: 243)] [top1-ema: 81.980 (epoch: 243)] 2024-10-13 01:41:41,142 - ==> Total time: 1 day, 13:54:45 Eta: 8:53:35 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 01:41:52,465 - Train: 81.00% [304000/375300] [243.0/300.0] [batch_t 0.317 (0.650)] [data_t 0.015] [optim_t 0.302] [lr 0.000287] [CE 2.703 (2.922)] [KD 0.000 (0.000)] 2024-10-13 01:42:12,943 - Train: 81.02% [304050/375300] [243.0/300.0] [batch_t 0.514 (0.409)] [data_t 0.015] [optim_t 0.499] [lr 0.000286] [CE 2.872 (3.006)] [KD 0.000 (0.000)] 2024-10-13 01:42:34,644 - Train: 81.03% [304100/375300] [243.1/300.0] [batch_t 0.440 (0.434)] [data_t 0.143] [optim_t 0.296] [lr 0.000286] [CE 2.815 (2.987)] [KD 0.000 (0.000)] 2024-10-13 01:42:56,804 - Train: 81.04% [304150/375300] [243.1/300.0] [batch_t 0.404 (0.443)] [data_t 0.111] [optim_t 0.293] [lr 0.000286] [CE 2.997 (3.045)] [KD 0.000 (0.000)] 2024-10-13 01:43:17,591 - Train: 81.06% [304200/375300] [243.2/300.0] [batch_t 0.433 (0.416)] [data_t 0.132] [optim_t 0.301] [lr 0.000285] [CE 2.895 (2.993)] [KD 0.000 (0.000)] 2024-10-13 01:43:40,153 - Train: 81.07% [304250/375300] [243.2/300.0] [batch_t 0.310 (0.451)] [data_t 0.016] [optim_t 0.295] [lr 0.000285] [CE 2.857 (3.008)] [KD 0.000 (0.000)] 2024-10-13 01:44:03,263 - Train: 81.08% [304300/375300] [243.2/300.0] [batch_t 0.436 (0.462)] [data_t 0.015] [optim_t 0.420] [lr 0.000285] [CE 3.010 (2.992)] [KD 0.000 (0.000)] 2024-10-13 01:44:25,073 - Train: 81.10% [304350/375300] [243.3/300.0] [batch_t 0.378 (0.436)] [data_t 0.016] [optim_t 0.362] [lr 0.000284] [CE 3.034 (2.988)] [KD 0.000 (0.000)] 2024-10-13 01:44:46,325 - Train: 81.11% [304400/375300] [243.3/300.0] [batch_t 0.401 (0.425)] [data_t 0.016] [optim_t 0.386] [lr 0.000284] [CE 3.310 (2.983)] [KD 0.000 (0.000)] 2024-10-13 01:45:07,999 - Train: 81.12% [304450/375300] [243.4/300.0] [batch_t 0.482 (0.433)] [data_t 0.016] [optim_t 0.467] [lr 0.000284] [CE 2.609 (2.996)] [KD 0.000 (0.000)] 2024-10-13 01:45:28,651 - Train: 81.14% [304500/375300] [243.4/300.0] [batch_t 0.427 (0.413)] [data_t 0.015] [optim_t 0.412] [lr 0.000283] [CE 3.307 (3.045)] [KD 0.000 (0.000)] 2024-10-13 01:45:50,693 - Train: 81.15% [304550/375300] [243.4/300.0] [batch_t 0.362 (0.441)] [data_t 0.015] [optim_t 0.347] [lr 0.000283] [CE 3.135 (3.013)] [KD 0.000 (0.000)] 2024-10-13 01:46:12,720 - Train: 81.16% [304600/375300] [243.5/300.0] [batch_t 0.496 (0.440)] [data_t 0.015] [optim_t 0.480] [lr 0.000283] [CE 3.088 (2.980)] [KD 0.000 (0.000)] 2024-10-13 01:46:34,644 - Train: 81.18% [304650/375300] [243.5/300.0] [batch_t 0.453 (0.438)] [data_t 0.016] [optim_t 0.437] [lr 0.000282] [CE 2.869 (3.016)] [KD 0.000 (0.000)] 2024-10-13 01:46:57,289 - Train: 81.19% [304700/375300] [243.6/300.0] [batch_t 0.483 (0.453)] [data_t 0.015] [optim_t 0.468] [lr 0.000282] [CE 3.130 (3.022)] [KD 0.000 (0.000)] 2024-10-13 01:47:18,589 - Train: 81.20% [304750/375300] [243.6/300.0] [batch_t 0.563 (0.426)] [data_t 0.015] [optim_t 0.548] [lr 0.000282] [CE 3.242 (2.998)] [KD 0.000 (0.000)] 2024-10-13 01:47:41,084 - Train: 81.22% [304800/375300] [243.6/300.0] [batch_t 0.447 (0.450)] [data_t 0.016] [optim_t 0.431] [lr 0.000281] [CE 2.924 (2.983)] [KD 0.000 (0.000)] 2024-10-13 01:48:02,803 - Train: 81.23% [304850/375300] [243.7/300.0] [batch_t 0.317 (0.434)] [data_t 0.016] [optim_t 0.302] [lr 0.000281] [CE 2.830 (3.011)] [KD 0.000 (0.000)] 2024-10-13 01:48:24,358 - Train: 81.24% [304900/375300] [243.7/300.0] [batch_t 0.452 (0.431)] [data_t 0.016] [optim_t 0.436] [lr 0.000280] [CE 3.182 (3.029)] [KD 0.000 (0.000)] 2024-10-13 01:48:45,889 - Train: 81.25% [304950/375300] [243.8/300.0] [batch_t 0.425 (0.431)] [data_t 0.015] [optim_t 0.410] [lr 0.000280] [CE 3.166 (3.001)] [KD 0.000 (0.000)] 2024-10-13 01:49:08,258 - Train: 81.27% [305000/375300] [243.8/300.0] [batch_t 0.478 (0.447)] [data_t 0.016] [optim_t 0.462] [lr 0.000280] [CE 3.039 (3.033)] [KD 0.000 (0.000)] 2024-10-13 01:49:31,334 - Train: 81.28% [305050/375300] [243.8/300.0] [batch_t 0.492 (0.461)] [data_t 0.015] [optim_t 0.477] [lr 0.000279] [CE 2.978 (3.040)] [KD 0.000 (0.000)] 2024-10-13 01:49:53,272 - Train: 81.29% [305100/375300] [243.9/300.0] [batch_t 0.510 (0.439)] [data_t 0.015] [optim_t 0.495] [lr 0.000279] [CE 2.962 (3.021)] [KD 0.000 (0.000)] 2024-10-13 01:50:14,839 - Train: 81.31% [305150/375300] [243.9/300.0] [batch_t 0.397 (0.431)] [data_t 0.015] [optim_t 0.382] [lr 0.000279] [CE 3.100 (2.986)] [KD 0.000 (0.000)] 2024-10-13 01:50:36,026 - Train: 81.32% [305200/375300] [244.0/300.0] [batch_t 0.345 (0.424)] [data_t 0.015] [optim_t 0.329] [lr 0.000278] [CE 3.329 (2.989)] [KD 0.000 (0.000)] 2024-10-13 01:51:16,052 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.452)] [top1_cnt 40152] [top5_cnt 47703] [top_all 50000] 2024-10-13 01:51:16,053 - net: 80.304 (95.406) 2024-10-13 01:51:38,265 - Test (net_E): 100.00% [50/50] [batch_t 0.133 (0.436)] [top1_cnt 40971] [top5_cnt 48033] [top_all 50000] 2024-10-13 01:51:38,266 - net_E: 81.942 (96.066) 2024-10-13 01:51:38,499 - Max [top1: 80.558 (epoch: 243)] [top1-ema: 81.980 (epoch: 243)] 2024-10-13 01:51:38,500 - ==> Total time: 1 day, 14:04:42 Eta: 8:44:21 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 01:51:46,965 - Train: 81.33% [305250/375300] [244.0/300.0] [batch_t 0.317 (1.180)] [data_t 0.015] [optim_t 0.301] [lr 0.000278] [CE 3.025 (3.055)] [KD 0.000 (0.000)] 2024-10-13 01:52:06,792 - Train: 81.35% [305300/375300] [244.0/300.0] [batch_t 0.315 (0.396)] [data_t 0.016] [optim_t 0.299] [lr 0.000278] [CE 2.798 (2.984)] [KD 0.000 (0.000)] 2024-10-13 01:52:28,202 - Train: 81.36% [305350/375300] [244.1/300.0] [batch_t 0.379 (0.428)] [data_t 0.016] [optim_t 0.363] [lr 0.000277] [CE 2.824 (2.961)] [KD 0.000 (0.000)] 2024-10-13 01:52:49,556 - Train: 81.37% [305400/375300] [244.1/300.0] [batch_t 0.391 (0.427)] [data_t 0.016] [optim_t 0.376] [lr 0.000277] [CE 3.094 (2.981)] [KD 0.000 (0.000)] 2024-10-13 01:53:11,323 - Train: 81.39% [305450/375300] [244.2/300.0] [batch_t 0.324 (0.435)] [data_t 0.016] [optim_t 0.309] [lr 0.000277] [CE 3.217 (3.022)] [KD 0.000 (0.000)] 2024-10-13 01:53:33,015 - Train: 81.40% [305500/375300] [244.2/300.0] [batch_t 0.478 (0.434)] [data_t 0.016] [optim_t 0.462] [lr 0.000276] [CE 2.806 (2.969)] [KD 0.000 (0.000)] 2024-10-13 01:53:54,659 - Train: 81.41% [305550/375300] [244.2/300.0] [batch_t 0.449 (0.433)] [data_t 0.016] [optim_t 0.433] [lr 0.000276] [CE 3.135 (3.027)] [KD 0.000 (0.000)] 2024-10-13 01:54:16,269 - Train: 81.43% [305600/375300] [244.3/300.0] [batch_t 0.338 (0.432)] [data_t 0.016] [optim_t 0.322] [lr 0.000276] [CE 3.211 (3.024)] [KD 0.000 (0.000)] 2024-10-13 01:54:39,151 - Train: 81.44% [305650/375300] [244.3/300.0] [batch_t 0.546 (0.457)] [data_t 0.016] [optim_t 0.530] [lr 0.000275] [CE 2.754 (3.003)] [KD 0.000 (0.000)] 2024-10-13 01:55:01,356 - Train: 81.45% [305700/375300] [244.4/300.0] [batch_t 0.467 (0.444)] [data_t 0.016] [optim_t 0.451] [lr 0.000275] [CE 2.883 (2.984)] [KD 0.000 (0.000)] 2024-10-13 01:55:23,262 - Train: 81.47% [305750/375300] [244.4/300.0] [batch_t 0.315 (0.438)] [data_t 0.016] [optim_t 0.300] [lr 0.000275] [CE 3.092 (3.011)] [KD 0.000 (0.000)] 2024-10-13 01:55:45,164 - Train: 81.48% [305800/375300] [244.4/300.0] [batch_t 0.320 (0.438)] [data_t 0.016] [optim_t 0.304] [lr 0.000274] [CE 3.008 (3.024)] [KD 0.000 (0.000)] 2024-10-13 01:56:07,691 - Train: 81.49% [305850/375300] [244.5/300.0] [batch_t 0.499 (0.450)] [data_t 0.192] [optim_t 0.307] [lr 0.000274] [CE 2.809 (3.008)] [KD 0.000 (0.000)] 2024-10-13 01:56:29,778 - Train: 81.51% [305900/375300] [244.5/300.0] [batch_t 0.460 (0.442)] [data_t 0.016] [optim_t 0.445] [lr 0.000274] [CE 3.040 (3.039)] [KD 0.000 (0.000)] 2024-10-13 01:56:51,795 - Train: 81.52% [305950/375300] [244.6/300.0] [batch_t 0.413 (0.440)] [data_t 0.016] [optim_t 0.397] [lr 0.000273] [CE 2.849 (2.977)] [KD 0.000 (0.000)] 2024-10-13 01:57:13,098 - Train: 81.53% [306000/375300] [244.6/300.0] [batch_t 0.431 (0.426)] [data_t 0.016] [optim_t 0.415] [lr 0.000273] [CE 3.018 (3.024)] [KD 0.000 (0.000)] 2024-10-13 01:57:35,464 - Train: 81.55% [306050/375300] [244.6/300.0] [batch_t 0.927 (0.447)] [data_t 0.627] [optim_t 0.300] [lr 0.000273] [CE 2.804 (2.979)] [KD 0.000 (0.000)] 2024-10-13 01:57:57,292 - Train: 81.56% [306100/375300] [244.7/300.0] [batch_t 0.413 (0.436)] [data_t 0.113] [optim_t 0.300] [lr 0.000272] [CE 3.081 (3.019)] [KD 0.000 (0.000)] 2024-10-13 01:58:19,202 - Train: 81.57% [306150/375300] [244.7/300.0] [batch_t 0.403 (0.438)] [data_t 0.106] [optim_t 0.297] [lr 0.000272] [CE 3.013 (3.017)] [KD 0.000 (0.000)] 2024-10-13 01:58:41,317 - Train: 81.59% [306200/375300] [244.8/300.0] [batch_t 0.314 (0.442)] [data_t 0.016] [optim_t 0.299] [lr 0.000272] [CE 3.086 (3.033)] [KD 0.000 (0.000)] 2024-10-13 01:59:03,157 - Train: 81.60% [306250/375300] [244.8/300.0] [batch_t 0.409 (0.437)] [data_t 0.016] [optim_t 0.393] [lr 0.000271] [CE 3.077 (3.025)] [KD 0.000 (0.000)] 2024-10-13 01:59:25,628 - Train: 81.61% [306300/375300] [244.8/300.0] [batch_t 0.436 (0.449)] [data_t 0.016] [optim_t 0.420] [lr 0.000271] [CE 3.287 (3.029)] [KD 0.000 (0.000)] 2024-10-13 01:59:47,437 - Train: 81.63% [306350/375300] [244.9/300.0] [batch_t 0.428 (0.436)] [data_t 0.016] [optim_t 0.412] [lr 0.000271] [CE 2.995 (3.050)] [KD 0.000 (0.000)] 2024-10-13 02:00:09,290 - Train: 81.64% [306400/375300] [244.9/300.0] [batch_t 0.378 (0.437)] [data_t 0.016] [optim_t 0.363] [lr 0.000270] [CE 3.004 (3.008)] [KD 0.000 (0.000)] 2024-10-13 02:00:30,946 - Train: 81.65% [306450/375300] [245.0/300.0] [batch_t 0.469 (0.433)] [data_t 0.015] [optim_t 0.454] [lr 0.000270] [CE 3.282 (3.036)] [KD 0.000 (0.000)] 2024-10-13 02:01:11,253 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.442)] [top1_cnt 40211] [top5_cnt 47709] [top_all 50000] 2024-10-13 02:01:11,254 - net: 80.422 (95.418) 2024-10-13 02:01:33,316 - Test (net_E): 100.00% [50/50] [batch_t 0.130 (0.432)] [top1_cnt 40992] [top5_cnt 48039] [top_all 50000] 2024-10-13 02:01:33,317 - net_E: 81.984 (96.078) 2024-10-13 02:01:33,553 - Max [top1: 80.558 (epoch: 243)] [top1-ema: 81.984 (epoch: 245)] 2024-10-13 02:01:33,554 - ==> Total time: 1 day, 14:14:37 Eta: 8:35:07 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 02:01:43,645 - Train: 81.67% [306500/375300] [245.0/300.0] [batch_t 0.320 (1.101)] [data_t 0.016] [optim_t 0.305] [lr 0.000270] [CE 2.807 (3.047)] [KD 0.000 (0.000)] 2024-10-13 02:02:03,508 - Train: 81.68% [306550/375300] [245.0/300.0] [batch_t 0.544 (0.397)] [data_t 0.016] [optim_t 0.528] [lr 0.000269] [CE 2.974 (2.996)] [KD 0.000 (0.000)] 2024-10-13 02:02:26,304 - Train: 81.69% [306600/375300] [245.1/300.0] [batch_t 0.420 (0.456)] [data_t 0.016] [optim_t 0.404] [lr 0.000269] [CE 2.761 (2.990)] [KD 0.000 (0.000)] 2024-10-13 02:02:49,178 - Train: 81.71% [306650/375300] [245.1/300.0] [batch_t 0.389 (0.457)] [data_t 0.016] [optim_t 0.374] [lr 0.000269] [CE 3.048 (2.942)] [KD 0.000 (0.000)] 2024-10-13 02:03:11,575 - Train: 81.72% [306700/375300] [245.2/300.0] [batch_t 0.383 (0.448)] [data_t 0.016] [optim_t 0.367] [lr 0.000268] [CE 2.722 (3.005)] [KD 0.000 (0.000)] 2024-10-13 02:03:32,227 - Train: 81.73% [306750/375300] [245.2/300.0] [batch_t 0.408 (0.413)] [data_t 0.016] [optim_t 0.392] [lr 0.000268] [CE 3.166 (3.015)] [KD 0.000 (0.000)] 2024-10-13 02:03:53,139 - Train: 81.75% [306800/375300] [245.2/300.0] [batch_t 0.397 (0.418)] [data_t 0.016] [optim_t 0.382] [lr 0.000268] [CE 2.991 (2.964)] [KD 0.000 (0.000)] 2024-10-13 02:04:14,230 - Train: 81.76% [306850/375300] [245.3/300.0] [batch_t 0.318 (0.422)] [data_t 0.016] [optim_t 0.302] [lr 0.000267] [CE 3.126 (2.970)] [KD 0.000 (0.000)] 2024-10-13 02:04:35,783 - Train: 81.77% [306900/375300] [245.3/300.0] [batch_t 0.368 (0.431)] [data_t 0.016] [optim_t 0.352] [lr 0.000267] [CE 2.718 (2.985)] [KD 0.000 (0.000)] 2024-10-13 02:04:57,722 - Train: 81.79% [306950/375300] [245.4/300.0] [batch_t 0.487 (0.439)] [data_t 0.016] [optim_t 0.472] [lr 0.000267] [CE 3.361 (3.029)] [KD 0.000 (0.000)] 2024-10-13 02:05:20,073 - Train: 81.80% [307000/375300] [245.4/300.0] [batch_t 0.420 (0.447)] [data_t 0.016] [optim_t 0.404] [lr 0.000266] [CE 2.992 (3.039)] [KD 0.000 (0.000)] 2024-10-13 02:05:42,614 - Train: 81.81% [307050/375300] [245.4/300.0] [batch_t 0.496 (0.451)] [data_t 0.015] [optim_t 0.481] [lr 0.000266] [CE 2.745 (3.012)] [KD 0.000 (0.000)] 2024-10-13 02:06:05,030 - Train: 81.83% [307100/375300] [245.5/300.0] [batch_t 0.492 (0.448)] [data_t 0.016] [optim_t 0.476] [lr 0.000266] [CE 2.965 (3.005)] [KD 0.000 (0.000)] 2024-10-13 02:06:27,052 - Train: 81.84% [307150/375300] [245.5/300.0] [batch_t 0.475 (0.440)] [data_t 0.016] [optim_t 0.460] [lr 0.000265] [CE 3.061 (3.024)] [KD 0.000 (0.000)] 2024-10-13 02:06:48,885 - Train: 81.85% [307200/375300] [245.6/300.0] [batch_t 0.434 (0.437)] [data_t 0.015] [optim_t 0.419] [lr 0.000265] [CE 3.018 (3.004)] [KD 0.000 (0.000)] 2024-10-13 02:07:11,235 - Train: 81.87% [307250/375300] [245.6/300.0] [batch_t 0.453 (0.447)] [data_t 0.016] [optim_t 0.437] [lr 0.000264] [CE 2.637 (2.984)] [KD 0.000 (0.000)] 2024-10-13 02:07:32,869 - Train: 81.88% [307300/375300] [245.6/300.0] [batch_t 0.428 (0.433)] [data_t 0.016] [optim_t 0.413] [lr 0.000264] [CE 2.924 (3.010)] [KD 0.000 (0.000)] 2024-10-13 02:07:54,424 - Train: 81.89% [307350/375300] [245.7/300.0] [batch_t 0.398 (0.431)] [data_t 0.016] [optim_t 0.382] [lr 0.000264] [CE 2.815 (2.988)] [KD 0.000 (0.000)] 2024-10-13 02:08:15,518 - Train: 81.91% [307400/375300] [245.7/300.0] [batch_t 0.387 (0.422)] [data_t 0.016] [optim_t 0.371] [lr 0.000263] [CE 3.072 (2.991)] [KD 0.000 (0.000)] 2024-10-13 02:08:37,055 - Train: 81.92% [307450/375300] [245.8/300.0] [batch_t 0.519 (0.431)] [data_t 0.016] [optim_t 0.503] [lr 0.000263] [CE 3.069 (3.026)] [KD 0.000 (0.000)] 2024-10-13 02:08:59,037 - Train: 81.93% [307500/375300] [245.8/300.0] [batch_t 0.510 (0.439)] [data_t 0.016] [optim_t 0.495] [lr 0.000263] [CE 2.864 (3.009)] [KD 0.000 (0.000)] 2024-10-13 02:09:21,176 - Train: 81.95% [307550/375300] [245.8/300.0] [batch_t 0.407 (0.443)] [data_t 0.016] [optim_t 0.391] [lr 0.000262] [CE 2.847 (3.042)] [KD 0.000 (0.000)] 2024-10-13 02:09:42,758 - Train: 81.96% [307600/375300] [245.9/300.0] [batch_t 0.538 (0.431)] [data_t 0.015] [optim_t 0.522] [lr 0.000262] [CE 3.046 (3.018)] [KD 0.000 (0.000)] 2024-10-13 02:10:05,159 - Train: 81.97% [307650/375300] [245.9/300.0] [batch_t 0.489 (0.448)] [data_t 0.016] [optim_t 0.474] [lr 0.000262] [CE 3.045 (2.963)] [KD 0.000 (0.000)] 2024-10-13 02:10:27,652 - Train: 81.99% [307700/375300] [246.0/300.0] [batch_t 0.319 (0.450)] [data_t 0.016] [optim_t 0.304] [lr 0.000261] [CE 2.780 (3.015)] [KD 0.000 (0.000)] 2024-10-13 02:11:08,906 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.446)] [top1_cnt 40316] [top5_cnt 47719] [top_all 50000] 2024-10-13 02:11:08,906 - net: 80.632 (95.438) 2024-10-13 02:11:30,963 - Test (net_E): 100.00% [50/50] [batch_t 0.130 (0.435)] [top1_cnt 40989] [top5_cnt 48047] [top_all 50000] 2024-10-13 02:11:30,964 - net_E: 81.978 (96.094) 2024-10-13 02:11:31,107 - Max [top1: 80.632 (epoch: 246)] [top1-ema: 81.984 (epoch: 245)] 2024-10-13 02:11:31,107 - ==> Total time: 1 day, 14:24:35 Eta: 8:25:53 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 02:11:41,167 - Train: 82.00% [307750/375300] [246.0/300.0] [batch_t 0.311 (1.217)] [data_t 0.015] [optim_t 0.296] [lr 0.000261] [CE 3.000 (3.020)] [KD 0.000 (0.000)] 2024-10-13 02:12:00,986 - Train: 82.01% [307800/375300] [246.0/300.0] [batch_t 0.410 (0.396)] [data_t 0.115] [optim_t 0.295] [lr 0.000261] [CE 3.071 (2.988)] [KD 0.000 (0.000)] 2024-10-13 02:12:22,470 - Train: 82.03% [307850/375300] [246.1/300.0] [batch_t 0.470 (0.430)] [data_t 0.016] [optim_t 0.454] [lr 0.000260] [CE 2.774 (3.005)] [KD 0.000 (0.000)] 2024-10-13 02:12:43,733 - Train: 82.04% [307900/375300] [246.1/300.0] [batch_t 0.444 (0.425)] [data_t 0.126] [optim_t 0.317] [lr 0.000260] [CE 2.622 (3.004)] [KD 0.000 (0.000)] 2024-10-13 02:13:05,649 - Train: 82.05% [307950/375300] [246.2/300.0] [batch_t 0.470 (0.438)] [data_t 0.016] [optim_t 0.454] [lr 0.000260] [CE 3.251 (3.017)] [KD 0.000 (0.000)] 2024-10-13 02:13:27,535 - Train: 82.07% [308000/375300] [246.2/300.0] [batch_t 0.444 (0.438)] [data_t 0.016] [optim_t 0.429] [lr 0.000259] [CE 3.324 (3.016)] [KD 0.000 (0.000)] 2024-10-13 02:13:49,681 - Train: 82.08% [308050/375300] [246.2/300.0] [batch_t 0.474 (0.443)] [data_t 0.016] [optim_t 0.458] [lr 0.000259] [CE 3.063 (2.974)] [KD 0.000 (0.000)] 2024-10-13 02:14:12,042 - Train: 82.09% [308100/375300] [246.3/300.0] [batch_t 0.320 (0.447)] [data_t 0.015] [optim_t 0.305] [lr 0.000259] [CE 2.920 (2.997)] [KD 0.000 (0.000)] 2024-10-13 02:14:33,191 - Train: 82.11% [308150/375300] [246.3/300.0] [batch_t 0.393 (0.423)] [data_t 0.015] [optim_t 0.378] [lr 0.000258] [CE 3.059 (2.983)] [KD 0.000 (0.000)] 2024-10-13 02:14:55,958 - Train: 82.12% [308200/375300] [246.4/300.0] [batch_t 0.415 (0.455)] [data_t 0.016] [optim_t 0.399] [lr 0.000258] [CE 2.877 (2.963)] [KD 0.000 (0.000)] 2024-10-13 02:15:17,158 - Train: 82.13% [308250/375300] [246.4/300.0] [batch_t 0.485 (0.424)] [data_t 0.015] [optim_t 0.470] [lr 0.000258] [CE 2.938 (2.994)] [KD 0.000 (0.000)] 2024-10-13 02:15:37,979 - Train: 82.15% [308300/375300] [246.4/300.0] [batch_t 0.425 (0.416)] [data_t 0.015] [optim_t 0.410] [lr 0.000258] [CE 2.966 (2.952)] [KD 0.000 (0.000)] 2024-10-13 02:15:59,777 - Train: 82.16% [308350/375300] [246.5/300.0] [batch_t 0.412 (0.436)] [data_t 0.016] [optim_t 0.396] [lr 0.000257] [CE 3.281 (3.042)] [KD 0.000 (0.000)] 2024-10-13 02:16:22,147 - Train: 82.17% [308400/375300] [246.5/300.0] [batch_t 0.428 (0.447)] [data_t 0.015] [optim_t 0.413] [lr 0.000257] [CE 3.017 (3.003)] [KD 0.000 (0.000)] 2024-10-13 02:16:44,302 - Train: 82.19% [308450/375300] [246.6/300.0] [batch_t 0.355 (0.443)] [data_t 0.015] [optim_t 0.339] [lr 0.000257] [CE 2.945 (2.983)] [KD 0.000 (0.000)] 2024-10-13 02:17:05,868 - Train: 82.20% [308500/375300] [246.6/300.0] [batch_t 0.406 (0.431)] [data_t 0.015] [optim_t 0.391] [lr 0.000256] [CE 2.977 (3.011)] [KD 0.000 (0.000)] 2024-10-13 02:17:26,788 - Train: 82.21% [308550/375300] [246.6/300.0] [batch_t 0.408 (0.418)] [data_t 0.016] [optim_t 0.393] [lr 0.000256] [CE 2.697 (2.979)] [KD 0.000 (0.000)] 2024-10-13 02:17:48,310 - Train: 82.23% [308600/375300] [246.7/300.0] [batch_t 0.472 (0.430)] [data_t 0.015] [optim_t 0.457] [lr 0.000256] [CE 2.892 (3.025)] [KD 0.000 (0.000)] 2024-10-13 02:18:09,819 - Train: 82.24% [308650/375300] [246.7/300.0] [batch_t 0.464 (0.430)] [data_t 0.016] [optim_t 0.449] [lr 0.000255] [CE 3.014 (2.986)] [KD 0.000 (0.000)] 2024-10-13 02:18:31,362 - Train: 82.25% [308700/375300] [246.8/300.0] [batch_t 0.430 (0.431)] [data_t 0.016] [optim_t 0.414] [lr 0.000255] [CE 2.753 (2.980)] [KD 0.000 (0.000)] 2024-10-13 02:18:54,117 - Train: 82.27% [308750/375300] [246.8/300.0] [batch_t 0.470 (0.455)] [data_t 0.015] [optim_t 0.455] [lr 0.000255] [CE 3.117 (2.950)] [KD 0.000 (0.000)] 2024-10-13 02:19:16,478 - Train: 82.28% [308800/375300] [246.8/300.0] [batch_t 0.425 (0.447)] [data_t 0.015] [optim_t 0.410] [lr 0.000254] [CE 3.118 (2.978)] [KD 0.000 (0.000)] 2024-10-13 02:19:37,997 - Train: 82.29% [308850/375300] [246.9/300.0] [batch_t 0.528 (0.430)] [data_t 0.016] [optim_t 0.512] [lr 0.000254] [CE 2.891 (2.995)] [KD 0.000 (0.000)] 2024-10-13 02:19:59,733 - Train: 82.31% [308900/375300] [246.9/300.0] [batch_t 0.437 (0.435)] [data_t 0.015] [optim_t 0.421] [lr 0.000254] [CE 3.068 (2.990)] [KD 0.000 (0.000)] 2024-10-13 02:20:22,076 - Train: 82.32% [308950/375300] [247.0/300.0] [batch_t 0.490 (0.447)] [data_t 0.016] [optim_t 0.475] [lr 0.000253] [CE 2.909 (3.009)] [KD 0.000 (0.000)] 2024-10-13 02:21:03,057 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.451)] [top1_cnt 40396] [top5_cnt 47785] [top_all 50000] 2024-10-13 02:21:03,058 - net: 80.792 (95.570) 2024-10-13 02:21:25,423 - Test (net_E): 100.00% [50/50] [batch_t 0.142 (0.440)] [top1_cnt 41007] [top5_cnt 48036] [top_all 50000] 2024-10-13 02:21:25,424 - net_E: 82.014 (96.072) 2024-10-13 02:21:25,573 - Max [top1: 80.792 (epoch: 247)] [top1-ema: 82.014 (epoch: 247)] 2024-10-13 02:21:25,574 - ==> Total time: 1 day, 14:34:29 Eta: 8:16:37 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 02:21:35,826 - Train: 82.33% [309000/375300] [247.0/300.0] [batch_t 0.309 (1.155)] [data_t 0.015] [optim_t 0.293] [lr 0.000253] [CE 3.113 (3.089)] [KD 0.000 (0.000)] 2024-10-13 02:21:55,780 - Train: 82.35% [309050/375300] [247.0/300.0] [batch_t 0.396 (0.399)] [data_t 0.016] [optim_t 0.381] [lr 0.000253] [CE 2.865 (3.042)] [KD 0.000 (0.000)] 2024-10-13 02:22:18,196 - Train: 82.36% [309100/375300] [247.1/300.0] [batch_t 0.500 (0.448)] [data_t 0.016] [optim_t 0.485] [lr 0.000252] [CE 3.147 (2.981)] [KD 0.000 (0.000)] 2024-10-13 02:22:40,342 - Train: 82.37% [309150/375300] [247.1/300.0] [batch_t 0.480 (0.443)] [data_t 0.015] [optim_t 0.465] [lr 0.000252] [CE 3.157 (2.974)] [KD 0.000 (0.000)] 2024-10-13 02:23:02,749 - Train: 82.39% [309200/375300] [247.2/300.0] [batch_t 0.367 (0.448)] [data_t 0.016] [optim_t 0.351] [lr 0.000252] [CE 2.928 (2.980)] [KD 0.000 (0.000)] 2024-10-13 02:23:24,832 - Train: 82.40% [309250/375300] [247.2/300.0] [batch_t 0.428 (0.442)] [data_t 0.016] [optim_t 0.413] [lr 0.000251] [CE 2.873 (2.963)] [KD 0.000 (0.000)] 2024-10-13 02:23:46,647 - Train: 82.41% [309300/375300] [247.2/300.0] [batch_t 0.488 (0.436)] [data_t 0.015] [optim_t 0.473] [lr 0.000251] [CE 2.947 (2.957)] [KD 0.000 (0.000)] 2024-10-13 02:24:08,951 - Train: 82.43% [309350/375300] [247.3/300.0] [batch_t 0.480 (0.446)] [data_t 0.016] [optim_t 0.464] [lr 0.000251] [CE 3.082 (3.011)] [KD 0.000 (0.000)] 2024-10-13 02:24:30,810 - Train: 82.44% [309400/375300] [247.3/300.0] [batch_t 0.479 (0.437)] [data_t 0.015] [optim_t 0.464] [lr 0.000250] [CE 3.007 (2.985)] [KD 0.000 (0.000)] 2024-10-13 02:24:51,922 - Train: 82.45% [309450/375300] [247.4/300.0] [batch_t 0.450 (0.422)] [data_t 0.015] [optim_t 0.435] [lr 0.000250] [CE 2.774 (2.971)] [KD 0.000 (0.000)] 2024-10-13 02:25:13,420 - Train: 82.47% [309500/375300] [247.4/300.0] [batch_t 0.461 (0.430)] [data_t 0.015] [optim_t 0.446] [lr 0.000250] [CE 2.753 (2.949)] [KD 0.000 (0.000)] 2024-10-13 02:25:35,572 - Train: 82.48% [309550/375300] [247.4/300.0] [batch_t 0.412 (0.443)] [data_t 0.015] [optim_t 0.397] [lr 0.000249] [CE 2.978 (2.965)] [KD 0.000 (0.000)] 2024-10-13 02:25:57,563 - Train: 82.49% [309600/375300] [247.5/300.0] [batch_t 0.375 (0.440)] [data_t 0.015] [optim_t 0.360] [lr 0.000249] [CE 2.797 (2.978)] [KD 0.000 (0.000)] 2024-10-13 02:26:19,349 - Train: 82.51% [309650/375300] [247.5/300.0] [batch_t 0.446 (0.436)] [data_t 0.015] [optim_t 0.431] [lr 0.000249] [CE 2.930 (2.961)] [KD 0.000 (0.000)] 2024-10-13 02:26:41,734 - Train: 82.52% [309700/375300] [247.6/300.0] [batch_t 0.453 (0.448)] [data_t 0.015] [optim_t 0.437] [lr 0.000248] [CE 3.038 (2.957)] [KD 0.000 (0.000)] 2024-10-13 02:27:03,183 - Train: 82.53% [309750/375300] [247.6/300.0] [batch_t 0.408 (0.429)] [data_t 0.015] [optim_t 0.393] [lr 0.000248] [CE 3.246 (2.987)] [KD 0.000 (0.000)] 2024-10-13 02:27:24,488 - Train: 82.55% [309800/375300] [247.6/300.0] [batch_t 0.418 (0.426)] [data_t 0.015] [optim_t 0.402] [lr 0.000248] [CE 3.106 (3.020)] [KD 0.000 (0.000)] 2024-10-13 02:27:46,095 - Train: 82.56% [309850/375300] [247.7/300.0] [batch_t 0.408 (0.432)] [data_t 0.016] [optim_t 0.393] [lr 0.000247] [CE 2.844 (2.996)] [KD 0.000 (0.000)] 2024-10-13 02:28:07,493 - Train: 82.57% [309900/375300] [247.7/300.0] [batch_t 0.437 (0.428)] [data_t 0.016] [optim_t 0.422] [lr 0.000247] [CE 2.941 (2.945)] [KD 0.000 (0.000)] 2024-10-13 02:28:28,916 - Train: 82.59% [309950/375300] [247.8/300.0] [batch_t 0.429 (0.428)] [data_t 0.016] [optim_t 0.413] [lr 0.000247] [CE 2.992 (2.993)] [KD 0.000 (0.000)] 2024-10-13 02:28:50,561 - Train: 82.60% [310000/375300] [247.8/300.0] [batch_t 0.439 (0.433)] [data_t 0.016] [optim_t 0.424] [lr 0.000246] [CE 3.029 (2.985)] [KD 0.000 (0.000)] 2024-10-13 02:29:12,143 - Train: 82.61% [310050/375300] [247.8/300.0] [batch_t 0.361 (0.432)] [data_t 0.015] [optim_t 0.345] [lr 0.000246] [CE 3.197 (3.002)] [KD 0.000 (0.000)] 2024-10-13 02:29:34,687 - Train: 82.63% [310100/375300] [247.9/300.0] [batch_t 0.469 (0.451)] [data_t 0.168] [optim_t 0.302] [lr 0.000246] [CE 2.671 (2.989)] [KD 0.000 (0.000)] 2024-10-13 02:29:57,438 - Train: 82.64% [310150/375300] [247.9/300.0] [batch_t 0.450 (0.455)] [data_t 0.155] [optim_t 0.295] [lr 0.000245] [CE 2.955 (3.003)] [KD 0.000 (0.000)] 2024-10-13 02:30:19,013 - Train: 82.65% [310200/375300] [248.0/300.0] [batch_t 0.398 (0.431)] [data_t 0.103] [optim_t 0.295] [lr 0.000245] [CE 3.169 (2.970)] [KD 0.000 (0.000)] 2024-10-13 02:31:01,072 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.449)] [top1_cnt 40254] [top5_cnt 47795] [top_all 50000] 2024-10-13 02:31:01,072 - net: 80.508 (95.590) 2024-10-13 02:31:23,403 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.440)] [top1_cnt 40985] [top5_cnt 48069] [top_all 50000] 2024-10-13 02:31:23,403 - net_E: 81.970 (96.138) 2024-10-13 02:31:23,537 - Max [top1: 80.792 (epoch: 247)] [top1-ema: 82.014 (epoch: 247)] 2024-10-13 02:31:23,537 - ==> Total time: 1 day, 14:44:27 Eta: 8:07:23 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 02:31:30,965 - Train: 82.67% [310250/375300] [248.0/300.0] [batch_t 0.317 (2.841)] [data_t 0.015] [optim_t 0.301] [lr 0.000245] [CE 3.258 (3.246)] [KD 0.000 (0.000)] 2024-10-13 02:31:51,187 - Train: 82.68% [310300/375300] [248.0/300.0] [batch_t 0.452 (0.404)] [data_t 0.157] [optim_t 0.295] [lr 0.000244] [CE 3.129 (2.939)] [KD 0.000 (0.000)] 2024-10-13 02:32:13,047 - Train: 82.69% [310350/375300] [248.1/300.0] [batch_t 0.448 (0.437)] [data_t 0.016] [optim_t 0.432] [lr 0.000244] [CE 3.145 (2.994)] [KD 0.000 (0.000)] 2024-10-13 02:32:34,220 - Train: 82.71% [310400/375300] [248.1/300.0] [batch_t 0.371 (0.423)] [data_t 0.015] [optim_t 0.356] [lr 0.000244] [CE 3.018 (2.992)] [KD 0.000 (0.000)] 2024-10-13 02:32:56,364 - Train: 82.72% [310450/375300] [248.2/300.0] [batch_t 0.471 (0.443)] [data_t 0.016] [optim_t 0.456] [lr 0.000243] [CE 3.068 (2.968)] [KD 0.000 (0.000)] 2024-10-13 02:33:17,808 - Train: 82.73% [310500/375300] [248.2/300.0] [batch_t 0.400 (0.429)] [data_t 0.016] [optim_t 0.385] [lr 0.000243] [CE 2.947 (2.994)] [KD 0.000 (0.000)] 2024-10-13 02:33:39,665 - Train: 82.75% [310550/375300] [248.2/300.0] [batch_t 0.438 (0.437)] [data_t 0.143] [optim_t 0.295] [lr 0.000243] [CE 3.007 (2.960)] [KD 0.000 (0.000)] 2024-10-13 02:34:02,805 - Train: 82.76% [310600/375300] [248.3/300.0] [batch_t 0.499 (0.463)] [data_t 0.203] [optim_t 0.296] [lr 0.000243] [CE 3.016 (2.982)] [KD 0.000 (0.000)] 2024-10-13 02:34:25,523 - Train: 82.77% [310650/375300] [248.3/300.0] [batch_t 0.328 (0.454)] [data_t 0.032] [optim_t 0.296] [lr 0.000242] [CE 2.961 (2.987)] [KD 0.000 (0.000)] 2024-10-13 02:34:47,713 - Train: 82.79% [310700/375300] [248.4/300.0] [batch_t 0.430 (0.444)] [data_t 0.135] [optim_t 0.294] [lr 0.000242] [CE 2.809 (2.961)] [KD 0.000 (0.000)] 2024-10-13 02:35:09,596 - Train: 82.80% [310750/375300] [248.4/300.0] [batch_t 0.474 (0.438)] [data_t 0.172] [optim_t 0.302] [lr 0.000242] [CE 3.026 (3.017)] [KD 0.000 (0.000)] 2024-10-13 02:35:31,808 - Train: 82.81% [310800/375300] [248.4/300.0] [batch_t 0.463 (0.444)] [data_t 0.164] [optim_t 0.298] [lr 0.000241] [CE 3.215 (2.928)] [KD 0.000 (0.000)] 2024-10-13 02:35:53,532 - Train: 82.83% [310850/375300] [248.5/300.0] [batch_t 0.412 (0.434)] [data_t 0.119] [optim_t 0.293] [lr 0.000241] [CE 2.933 (2.975)] [KD 0.000 (0.000)] 2024-10-13 02:36:14,575 - Train: 82.84% [310900/375300] [248.5/300.0] [batch_t 0.384 (0.421)] [data_t 0.087] [optim_t 0.297] [lr 0.000241] [CE 2.987 (2.988)] [KD 0.000 (0.000)] 2024-10-13 02:36:36,311 - Train: 82.85% [310950/375300] [248.6/300.0] [batch_t 0.449 (0.435)] [data_t 0.157] [optim_t 0.292] [lr 0.000240] [CE 2.855 (2.993)] [KD 0.000 (0.000)] 2024-10-13 02:36:57,036 - Train: 82.87% [311000/375300] [248.6/300.0] [batch_t 0.511 (0.414)] [data_t 0.217] [optim_t 0.294] [lr 0.000240] [CE 2.956 (2.979)] [KD 0.000 (0.000)] 2024-10-13 02:37:19,270 - Train: 82.88% [311050/375300] [248.6/300.0] [batch_t 0.462 (0.445)] [data_t 0.160] [optim_t 0.302] [lr 0.000240] [CE 2.835 (2.986)] [KD 0.000 (0.000)] 2024-10-13 02:37:40,508 - Train: 82.89% [311100/375300] [248.7/300.0] [batch_t 0.485 (0.425)] [data_t 0.016] [optim_t 0.470] [lr 0.000239] [CE 3.004 (3.010)] [KD 0.000 (0.000)] 2024-10-13 02:38:02,141 - Train: 82.91% [311150/375300] [248.7/300.0] [batch_t 0.442 (0.433)] [data_t 0.016] [optim_t 0.426] [lr 0.000239] [CE 2.876 (2.974)] [KD 0.000 (0.000)] 2024-10-13 02:38:24,241 - Train: 82.92% [311200/375300] [248.8/300.0] [batch_t 0.421 (0.442)] [data_t 0.015] [optim_t 0.406] [lr 0.000239] [CE 2.913 (2.977)] [KD 0.000 (0.000)] 2024-10-13 02:38:46,910 - Train: 82.93% [311250/375300] [248.8/300.0] [batch_t 0.393 (0.453)] [data_t 0.098] [optim_t 0.294] [lr 0.000238] [CE 2.689 (3.035)] [KD 0.000 (0.000)] 2024-10-13 02:39:09,065 - Train: 82.95% [311300/375300] [248.8/300.0] [batch_t 0.418 (0.443)] [data_t 0.121] [optim_t 0.297] [lr 0.000238] [CE 3.067 (2.996)] [KD 0.000 (0.000)] 2024-10-13 02:39:30,405 - Train: 82.96% [311350/375300] [248.9/300.0] [batch_t 0.319 (0.427)] [data_t 0.022] [optim_t 0.296] [lr 0.000238] [CE 2.838 (3.034)] [KD 0.000 (0.000)] 2024-10-13 02:39:51,958 - Train: 82.97% [311400/375300] [248.9/300.0] [batch_t 0.394 (0.431)] [data_t 0.015] [optim_t 0.379] [lr 0.000237] [CE 2.855 (2.953)] [KD 0.000 (0.000)] 2024-10-13 02:40:13,876 - Train: 82.99% [311450/375300] [249.0/300.0] [batch_t 0.405 (0.438)] [data_t 0.015] [optim_t 0.390] [lr 0.000237] [CE 3.173 (2.982)] [KD 0.000 (0.000)] 2024-10-13 02:40:56,096 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.445)] [top1_cnt 40281] [top5_cnt 47737] [top_all 50000] 2024-10-13 02:40:56,097 - net: 80.562 (95.474) 2024-10-13 02:41:18,638 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.444)] [top1_cnt 41007] [top5_cnt 48073] [top_all 50000] 2024-10-13 02:41:18,639 - net_E: 82.014 (96.146) 2024-10-13 02:41:18,796 - Max [top1: 80.792 (epoch: 247)] [top1-ema: 82.014 (epoch: 247)] 2024-10-13 02:41:18,796 - ==> Total time: 1 day, 14:54:22 Eta: 7:58:07 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 02:41:26,158 - Train: 83.00% [311500/375300] [249.0/300.0] [batch_t 5.743 (5.743)] [data_t 5.438] [optim_t 0.305] [lr 0.000237] [CE 3.125 (3.125)] [KD 0.000 (0.000)] 2024-10-13 02:41:46,109 - Train: 83.01% [311550/375300] [249.0/300.0] [batch_t 0.538 (0.399)] [data_t 0.016] [optim_t 0.522] [lr 0.000236] [CE 2.373 (2.923)] [KD 0.000 (0.000)] 2024-10-13 02:42:08,761 - Train: 83.03% [311600/375300] [249.1/300.0] [batch_t 0.519 (0.453)] [data_t 0.016] [optim_t 0.503] [lr 0.000236] [CE 2.965 (2.974)] [KD 0.000 (0.000)] 2024-10-13 02:42:30,402 - Train: 83.04% [311650/375300] [249.1/300.0] [batch_t 0.489 (0.433)] [data_t 0.016] [optim_t 0.473] [lr 0.000236] [CE 2.859 (2.952)] [KD 0.000 (0.000)] 2024-10-13 02:42:52,776 - Train: 83.05% [311700/375300] [249.2/300.0] [batch_t 0.515 (0.447)] [data_t 0.015] [optim_t 0.500] [lr 0.000236] [CE 2.874 (2.948)] [KD 0.000 (0.000)] 2024-10-13 02:43:15,103 - Train: 83.07% [311750/375300] [249.2/300.0] [batch_t 0.432 (0.446)] [data_t 0.016] [optim_t 0.416] [lr 0.000235] [CE 2.765 (2.951)] [KD 0.000 (0.000)] 2024-10-13 02:43:36,931 - Train: 83.08% [311800/375300] [249.2/300.0] [batch_t 0.437 (0.436)] [data_t 0.016] [optim_t 0.421] [lr 0.000235] [CE 3.068 (2.997)] [KD 0.000 (0.000)] 2024-10-13 02:43:58,802 - Train: 83.09% [311850/375300] [249.3/300.0] [batch_t 0.468 (0.437)] [data_t 0.016] [optim_t 0.453] [lr 0.000235] [CE 2.828 (2.966)] [KD 0.000 (0.000)] 2024-10-13 02:44:20,697 - Train: 83.11% [311900/375300] [249.3/300.0] [batch_t 0.428 (0.438)] [data_t 0.016] [optim_t 0.412] [lr 0.000234] [CE 2.965 (3.006)] [KD 0.000 (0.000)] 2024-10-13 02:44:42,642 - Train: 83.12% [311950/375300] [249.4/300.0] [batch_t 0.323 (0.439)] [data_t 0.016] [optim_t 0.308] [lr 0.000234] [CE 3.083 (2.991)] [KD 0.000 (0.000)] 2024-10-13 02:45:05,049 - Train: 83.13% [312000/375300] [249.4/300.0] [batch_t 0.424 (0.448)] [data_t 0.016] [optim_t 0.408] [lr 0.000234] [CE 3.018 (2.925)] [KD 0.000 (0.000)] 2024-10-13 02:45:26,948 - Train: 83.15% [312050/375300] [249.4/300.0] [batch_t 0.408 (0.438)] [data_t 0.015] [optim_t 0.392] [lr 0.000233] [CE 3.037 (2.982)] [KD 0.000 (0.000)] 2024-10-13 02:45:48,626 - Train: 83.16% [312100/375300] [249.5/300.0] [batch_t 0.420 (0.433)] [data_t 0.016] [optim_t 0.405] [lr 0.000233] [CE 3.134 (2.969)] [KD 0.000 (0.000)] 2024-10-13 02:46:09,148 - Train: 83.17% [312150/375300] [249.5/300.0] [batch_t 0.312 (0.410)] [data_t 0.016] [optim_t 0.296] [lr 0.000233] [CE 3.097 (2.931)] [KD 0.000 (0.000)] 2024-10-13 02:46:30,156 - Train: 83.19% [312200/375300] [249.6/300.0] [batch_t 0.317 (0.420)] [data_t 0.016] [optim_t 0.302] [lr 0.000232] [CE 3.110 (2.965)] [KD 0.000 (0.000)] 2024-10-13 02:46:52,260 - Train: 83.20% [312250/375300] [249.6/300.0] [batch_t 0.402 (0.442)] [data_t 0.103] [optim_t 0.299] [lr 0.000232] [CE 3.103 (2.944)] [KD 0.000 (0.000)] 2024-10-13 02:47:13,721 - Train: 83.21% [312300/375300] [249.6/300.0] [batch_t 0.323 (0.429)] [data_t 0.016] [optim_t 0.308] [lr 0.000232] [CE 2.986 (2.972)] [KD 0.000 (0.000)] 2024-10-13 02:47:35,244 - Train: 83.23% [312350/375300] [249.7/300.0] [batch_t 0.410 (0.430)] [data_t 0.111] [optim_t 0.299] [lr 0.000231] [CE 2.675 (2.960)] [KD 0.000 (0.000)] 2024-10-13 02:47:56,982 - Train: 83.24% [312400/375300] [249.7/300.0] [batch_t 0.425 (0.435)] [data_t 0.123] [optim_t 0.302] [lr 0.000231] [CE 3.111 (2.963)] [KD 0.000 (0.000)] 2024-10-13 02:48:18,597 - Train: 83.25% [312450/375300] [249.8/300.0] [batch_t 0.515 (0.432)] [data_t 0.016] [optim_t 0.499] [lr 0.000231] [CE 3.056 (3.002)] [KD 0.000 (0.000)] 2024-10-13 02:48:40,448 - Train: 83.27% [312500/375300] [249.8/300.0] [batch_t 0.424 (0.437)] [data_t 0.016] [optim_t 0.408] [lr 0.000231] [CE 3.341 (2.986)] [KD 0.000 (0.000)] 2024-10-13 02:49:01,970 - Train: 83.28% [312550/375300] [249.8/300.0] [batch_t 0.414 (0.430)] [data_t 0.016] [optim_t 0.398] [lr 0.000230] [CE 2.813 (3.000)] [KD 0.000 (0.000)] 2024-10-13 02:49:23,901 - Train: 83.29% [312600/375300] [249.9/300.0] [batch_t 0.395 (0.438)] [data_t 0.016] [optim_t 0.380] [lr 0.000230] [CE 3.249 (2.965)] [KD 0.000 (0.000)] 2024-10-13 02:49:46,011 - Train: 83.31% [312650/375300] [249.9/300.0] [batch_t 0.391 (0.442)] [data_t 0.016] [optim_t 0.375] [lr 0.000230] [CE 3.256 (2.951)] [KD 0.000 (0.000)] 2024-10-13 02:50:07,338 - Train: 83.32% [312700/375300] [250.0/300.0] [batch_t 0.414 (0.426)] [data_t 0.017] [optim_t 0.397] [lr 0.000229] [CE 3.045 (2.977)] [KD 0.000 (0.000)] 2024-10-13 02:50:27,743 - Train: 83.33% [312750/375300] [250.0/300.0] [batch_t 0.313 (0.408)] [data_t 0.015] [optim_t 0.298] [lr 0.000229] [CE 3.133 (2.984)] [KD 0.000 (0.000)] 2024-10-13 02:50:49,586 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.432)] [top1_cnt 40484] [top5_cnt 47770] [top_all 50000] 2024-10-13 02:50:49,586 - net: 80.968 (95.540) 2024-10-13 02:51:11,487 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.429)] [top1_cnt 41016] [top5_cnt 48098] [top_all 50000] 2024-10-13 02:51:11,488 - net_E: 82.032 (96.196) 2024-10-13 02:51:11,672 - Max [top1: 80.968 (epoch: 250)] [top1-ema: 82.032 (epoch: 250)] 2024-10-13 02:51:11,673 - ==> Total time: 1 day, 15:04:15 Eta: 7:48:51 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 02:51:38,828 - Train: 83.35% [312800/375300] [250.0/300.0] [batch_t 0.453 (0.439)] [data_t 0.015] [optim_t 0.438] [lr 0.000229] [CE 3.173 (2.956)] [KD 0.000 (0.000)] 2024-10-13 02:52:00,497 - Train: 83.36% [312850/375300] [250.1/300.0] [batch_t 0.461 (0.433)] [data_t 0.016] [optim_t 0.446] [lr 0.000228] [CE 2.886 (2.976)] [KD 0.000 (0.000)] 2024-10-13 02:52:23,332 - Train: 83.37% [312900/375300] [250.1/300.0] [batch_t 0.475 (0.457)] [data_t 0.015] [optim_t 0.459] [lr 0.000228] [CE 2.727 (2.967)] [KD 0.000 (0.000)] 2024-10-13 02:52:44,828 - Train: 83.39% [312950/375300] [250.2/300.0] [batch_t 0.418 (0.430)] [data_t 0.016] [optim_t 0.402] [lr 0.000228] [CE 2.900 (2.981)] [KD 0.000 (0.000)] 2024-10-13 02:53:06,942 - Train: 83.40% [313000/375300] [250.2/300.0] [batch_t 0.463 (0.442)] [data_t 0.015] [optim_t 0.447] [lr 0.000227] [CE 3.089 (2.979)] [KD 0.000 (0.000)] 2024-10-13 02:53:29,252 - Train: 83.41% [313050/375300] [250.2/300.0] [batch_t 0.462 (0.446)] [data_t 0.015] [optim_t 0.446] [lr 0.000227] [CE 2.940 (2.971)] [KD 0.000 (0.000)] 2024-10-13 02:53:50,576 - Train: 83.43% [313100/375300] [250.3/300.0] [batch_t 0.396 (0.426)] [data_t 0.015] [optim_t 0.380] [lr 0.000227] [CE 3.115 (2.962)] [KD 0.000 (0.000)] 2024-10-13 02:54:12,784 - Train: 83.44% [313150/375300] [250.3/300.0] [batch_t 0.432 (0.444)] [data_t 0.015] [optim_t 0.417] [lr 0.000226] [CE 2.847 (2.943)] [KD 0.000 (0.000)] 2024-10-13 02:54:34,320 - Train: 83.45% [313200/375300] [250.4/300.0] [batch_t 0.406 (0.431)] [data_t 0.015] [optim_t 0.390] [lr 0.000226] [CE 3.086 (2.959)] [KD 0.000 (0.000)] 2024-10-13 02:54:55,676 - Train: 83.47% [313250/375300] [250.4/300.0] [batch_t 0.492 (0.427)] [data_t 0.015] [optim_t 0.476] [lr 0.000226] [CE 2.696 (2.980)] [KD 0.000 (0.000)] 2024-10-13 02:55:17,577 - Train: 83.48% [313300/375300] [250.4/300.0] [batch_t 0.392 (0.438)] [data_t 0.015] [optim_t 0.376] [lr 0.000226] [CE 2.814 (2.949)] [KD 0.000 (0.000)] 2024-10-13 02:55:39,441 - Train: 83.49% [313350/375300] [250.5/300.0] [batch_t 0.386 (0.437)] [data_t 0.016] [optim_t 0.370] [lr 0.000225] [CE 3.053 (2.973)] [KD 0.000 (0.000)] 2024-10-13 02:56:01,114 - Train: 83.51% [313400/375300] [250.5/300.0] [batch_t 0.469 (0.433)] [data_t 0.015] [optim_t 0.453] [lr 0.000225] [CE 3.198 (3.001)] [KD 0.000 (0.000)] 2024-10-13 02:56:23,018 - Train: 83.52% [313450/375300] [250.6/300.0] [batch_t 0.436 (0.438)] [data_t 0.015] [optim_t 0.421] [lr 0.000225] [CE 2.868 (2.977)] [KD 0.000 (0.000)] 2024-10-13 02:56:45,001 - Train: 83.53% [313500/375300] [250.6/300.0] [batch_t 0.393 (0.440)] [data_t 0.016] [optim_t 0.377] [lr 0.000224] [CE 3.081 (2.926)] [KD 0.000 (0.000)] 2024-10-13 02:57:06,874 - Train: 83.55% [313550/375300] [250.6/300.0] [batch_t 0.411 (0.437)] [data_t 0.015] [optim_t 0.395] [lr 0.000224] [CE 3.028 (2.923)] [KD 0.000 (0.000)] 2024-10-13 02:57:29,136 - Train: 83.56% [313600/375300] [250.7/300.0] [batch_t 0.407 (0.445)] [data_t 0.016] [optim_t 0.392] [lr 0.000224] [CE 3.151 (2.976)] [KD 0.000 (0.000)] 2024-10-13 02:57:51,039 - Train: 83.57% [313650/375300] [250.7/300.0] [batch_t 0.472 (0.438)] [data_t 0.016] [optim_t 0.456] [lr 0.000223] [CE 3.208 (2.989)] [KD 0.000 (0.000)] 2024-10-13 02:58:12,274 - Train: 83.59% [313700/375300] [250.8/300.0] [batch_t 0.404 (0.425)] [data_t 0.016] [optim_t 0.388] [lr 0.000223] [CE 2.942 (2.961)] [KD 0.000 (0.000)] 2024-10-13 02:58:33,469 - Train: 83.60% [313750/375300] [250.8/300.0] [batch_t 0.478 (0.424)] [data_t 0.016] [optim_t 0.463] [lr 0.000223] [CE 3.186 (2.989)] [KD 0.000 (0.000)] 2024-10-13 02:58:54,848 - Train: 83.61% [313800/375300] [250.8/300.0] [batch_t 0.364 (0.427)] [data_t 0.015] [optim_t 0.348] [lr 0.000222] [CE 3.022 (2.974)] [KD 0.000 (0.000)] 2024-10-13 02:59:16,874 - Train: 83.63% [313850/375300] [250.9/300.0] [batch_t 0.548 (0.440)] [data_t 0.015] [optim_t 0.533] [lr 0.000222] [CE 3.323 (2.959)] [KD 0.000 (0.000)] 2024-10-13 02:59:38,293 - Train: 83.64% [313900/375300] [250.9/300.0] [batch_t 0.370 (0.428)] [data_t 0.015] [optim_t 0.355] [lr 0.000222] [CE 2.903 (2.986)] [KD 0.000 (0.000)] 2024-10-13 03:00:00,344 - Train: 83.65% [313950/375300] [251.0/300.0] [batch_t 0.480 (0.441)] [data_t 0.015] [optim_t 0.465] [lr 0.000222] [CE 2.785 (2.973)] [KD 0.000 (0.000)] 2024-10-13 03:00:21,056 - Train: 83.67% [314000/375300] [251.0/300.0] [batch_t 0.312 (0.414)] [data_t 0.015] [optim_t 0.297] [lr 0.000221] [CE 3.159 (2.985)] [KD 0.000 (0.000)] 2024-10-13 03:00:43,210 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.432)] [top1_cnt 40507] [top5_cnt 47804] [top_all 50000] 2024-10-13 03:00:43,211 - net: 81.014 (95.608) 2024-10-13 03:01:04,711 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.422)] [top1_cnt 41039] [top5_cnt 48059] [top_all 50000] 2024-10-13 03:01:04,712 - net_E: 82.078 (96.118) 2024-10-13 03:01:04,877 - Max [top1: 81.014 (epoch: 251)] [top1-ema: 82.078 (epoch: 251)] 2024-10-13 03:01:04,877 - ==> Total time: 1 day, 15:14:08 Eta: 7:39:34 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 03:01:32,891 - Train: 83.68% [314050/375300] [251.0/300.0] [batch_t 0.481 (0.421)] [data_t 0.168] [optim_t 0.313] [lr 0.000221] [CE 2.846 (2.952)] [KD 0.000 (0.000)] 2024-10-13 03:01:55,842 - Train: 83.69% [314100/375300] [251.1/300.0] [batch_t 0.558 (0.459)] [data_t 0.016] [optim_t 0.543] [lr 0.000221] [CE 2.842 (2.961)] [KD 0.000 (0.000)] 2024-10-13 03:02:16,975 - Train: 83.71% [314150/375300] [251.1/300.0] [batch_t 0.421 (0.423)] [data_t 0.016] [optim_t 0.405] [lr 0.000220] [CE 2.685 (2.952)] [KD 0.000 (0.000)] 2024-10-13 03:02:39,445 - Train: 83.72% [314200/375300] [251.2/300.0] [batch_t 0.442 (0.449)] [data_t 0.015] [optim_t 0.427] [lr 0.000220] [CE 2.717 (2.946)] [KD 0.000 (0.000)] 2024-10-13 03:03:00,932 - Train: 83.73% [314250/375300] [251.2/300.0] [batch_t 0.457 (0.430)] [data_t 0.016] [optim_t 0.442] [lr 0.000220] [CE 2.871 (2.991)] [KD 0.000 (0.000)] 2024-10-13 03:03:22,577 - Train: 83.75% [314300/375300] [251.2/300.0] [batch_t 0.386 (0.433)] [data_t 0.016] [optim_t 0.370] [lr 0.000219] [CE 2.996 (2.970)] [KD 0.000 (0.000)] 2024-10-13 03:03:44,623 - Train: 83.76% [314350/375300] [251.3/300.0] [batch_t 0.979 (0.441)] [data_t 0.016] [optim_t 0.964] [lr 0.000219] [CE 2.999 (2.967)] [KD 0.000 (0.000)] 2024-10-13 03:04:06,727 - Train: 83.77% [314400/375300] [251.3/300.0] [batch_t 0.315 (0.442)] [data_t 0.015] [optim_t 0.300] [lr 0.000219] [CE 2.855 (2.944)] [KD 0.000 (0.000)] 2024-10-13 03:04:27,865 - Train: 83.79% [314450/375300] [251.4/300.0] [batch_t 0.403 (0.423)] [data_t 0.015] [optim_t 0.387] [lr 0.000219] [CE 3.078 (2.946)] [KD 0.000 (0.000)] 2024-10-13 03:04:49,884 - Train: 83.80% [314500/375300] [251.4/300.0] [batch_t 0.872 (0.440)] [data_t 0.015] [optim_t 0.857] [lr 0.000218] [CE 2.805 (2.951)] [KD 0.000 (0.000)] 2024-10-13 03:05:12,054 - Train: 83.81% [314550/375300] [251.4/300.0] [batch_t 0.409 (0.443)] [data_t 0.016] [optim_t 0.394] [lr 0.000218] [CE 3.119 (2.962)] [KD 0.000 (0.000)] 2024-10-13 03:05:34,475 - Train: 83.83% [314600/375300] [251.5/300.0] [batch_t 0.444 (0.448)] [data_t 0.016] [optim_t 0.428] [lr 0.000218] [CE 2.962 (2.973)] [KD 0.000 (0.000)] 2024-10-13 03:05:57,055 - Train: 83.84% [314650/375300] [251.5/300.0] [batch_t 0.496 (0.451)] [data_t 0.015] [optim_t 0.481] [lr 0.000217] [CE 2.826 (2.948)] [KD 0.000 (0.000)] 2024-10-13 03:06:19,355 - Train: 83.85% [314700/375300] [251.6/300.0] [batch_t 0.506 (0.446)] [data_t 0.016] [optim_t 0.490] [lr 0.000217] [CE 3.108 (3.006)] [KD 0.000 (0.000)] 2024-10-13 03:06:40,668 - Train: 83.87% [314750/375300] [251.6/300.0] [batch_t 0.444 (0.426)] [data_t 0.016] [optim_t 0.428] [lr 0.000217] [CE 2.983 (2.920)] [KD 0.000 (0.000)] 2024-10-13 03:07:01,852 - Train: 83.88% [314800/375300] [251.6/300.0] [batch_t 0.471 (0.424)] [data_t 0.015] [optim_t 0.455] [lr 0.000216] [CE 2.869 (2.926)] [KD 0.000 (0.000)] 2024-10-13 03:07:23,530 - Train: 83.89% [314850/375300] [251.7/300.0] [batch_t 0.461 (0.433)] [data_t 0.015] [optim_t 0.446] [lr 0.000216] [CE 3.106 (2.958)] [KD 0.000 (0.000)] 2024-10-13 03:07:46,291 - Train: 83.91% [314900/375300] [251.7/300.0] [batch_t 0.487 (0.455)] [data_t 0.016] [optim_t 0.472] [lr 0.000216] [CE 2.981 (3.003)] [KD 0.000 (0.000)] 2024-10-13 03:08:08,586 - Train: 83.92% [314950/375300] [251.8/300.0] [batch_t 0.480 (0.446)] [data_t 0.015] [optim_t 0.464] [lr 0.000216] [CE 3.095 (2.977)] [KD 0.000 (0.000)] 2024-10-13 03:08:30,684 - Train: 83.93% [315000/375300] [251.8/300.0] [batch_t 0.421 (0.442)] [data_t 0.015] [optim_t 0.405] [lr 0.000215] [CE 2.719 (2.985)] [KD 0.000 (0.000)] 2024-10-13 03:08:52,837 - Train: 83.95% [315050/375300] [251.8/300.0] [batch_t 0.447 (0.443)] [data_t 0.016] [optim_t 0.431] [lr 0.000215] [CE 2.961 (2.986)] [KD 0.000 (0.000)] 2024-10-13 03:09:15,066 - Train: 83.96% [315100/375300] [251.9/300.0] [batch_t 0.798 (0.444)] [data_t 0.015] [optim_t 0.782] [lr 0.000215] [CE 2.823 (2.993)] [KD 0.000 (0.000)] 2024-10-13 03:09:35,775 - Train: 83.97% [315150/375300] [251.9/300.0] [batch_t 0.318 (0.414)] [data_t 0.015] [optim_t 0.302] [lr 0.000214] [CE 2.452 (2.944)] [KD 0.000 (0.000)] 2024-10-13 03:09:58,069 - Train: 83.99% [315200/375300] [252.0/300.0] [batch_t 0.569 (0.446)] [data_t 0.015] [optim_t 0.553] [lr 0.000214] [CE 3.058 (2.921)] [KD 0.000 (0.000)] 2024-10-13 03:10:18,751 - Train: 84.00% [315250/375300] [252.0/300.0] [batch_t 0.312 (0.414)] [data_t 0.015] [optim_t 0.297] [lr 0.000214] [CE 3.049 (2.971)] [KD 0.000 (0.000)] 2024-10-13 03:10:41,285 - Test (net): 100.00% [50/50] [batch_t 0.148 (0.433)] [top1_cnt 40440] [top5_cnt 47830] [top_all 50000] 2024-10-13 03:10:41,286 - net: 80.880 (95.660) 2024-10-13 03:11:03,024 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.426)] [top1_cnt 41057] [top5_cnt 48078] [top_all 50000] 2024-10-13 03:11:03,024 - net_E: 82.114 (96.156) 2024-10-13 03:11:03,196 - Max [top1: 81.014 (epoch: 251)] [top1-ema: 82.114 (epoch: 252)] 2024-10-13 03:11:03,197 - ==> Total time: 1 day, 15:24:07 Eta: 7:30:18 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 03:11:30,428 - Train: 84.01% [315300/375300] [252.0/300.0] [batch_t 0.474 (0.407)] [data_t 0.180] [optim_t 0.295] [lr 0.000213] [CE 3.048 (2.950)] [KD 0.000 (0.000)] 2024-10-13 03:11:51,781 - Train: 84.03% [315350/375300] [252.1/300.0] [batch_t 0.431 (0.427)] [data_t 0.016] [optim_t 0.415] [lr 0.000213] [CE 3.055 (2.957)] [KD 0.000 (0.000)] 2024-10-13 03:12:13,004 - Train: 84.04% [315400/375300] [252.1/300.0] [batch_t 0.314 (0.424)] [data_t 0.016] [optim_t 0.298] [lr 0.000213] [CE 2.763 (2.941)] [KD 0.000 (0.000)] 2024-10-13 03:12:33,996 - Train: 84.05% [315450/375300] [252.2/300.0] [batch_t 0.403 (0.420)] [data_t 0.016] [optim_t 0.388] [lr 0.000213] [CE 3.102 (2.955)] [KD 0.000 (0.000)] 2024-10-13 03:12:54,630 - Train: 84.07% [315500/375300] [252.2/300.0] [batch_t 0.432 (0.413)] [data_t 0.033] [optim_t 0.399] [lr 0.000212] [CE 2.896 (2.908)] [KD 0.000 (0.000)] 2024-10-13 03:13:15,285 - Train: 84.08% [315550/375300] [252.2/300.0] [batch_t 0.411 (0.413)] [data_t 0.117] [optim_t 0.294] [lr 0.000212] [CE 2.960 (2.944)] [KD 0.000 (0.000)] 2024-10-13 03:13:36,924 - Train: 84.09% [315600/375300] [252.3/300.0] [batch_t 0.409 (0.433)] [data_t 0.016] [optim_t 0.394] [lr 0.000212] [CE 2.945 (2.924)] [KD 0.000 (0.000)] 2024-10-13 03:13:58,743 - Train: 84.11% [315650/375300] [252.3/300.0] [batch_t 0.428 (0.436)] [data_t 0.016] [optim_t 0.413] [lr 0.000211] [CE 2.666 (2.999)] [KD 0.000 (0.000)] 2024-10-13 03:14:20,204 - Train: 84.12% [315700/375300] [252.4/300.0] [batch_t 0.404 (0.429)] [data_t 0.016] [optim_t 0.388] [lr 0.000211] [CE 3.122 (2.938)] [KD 0.000 (0.000)] 2024-10-13 03:14:41,696 - Train: 84.13% [315750/375300] [252.4/300.0] [batch_t 0.392 (0.430)] [data_t 0.015] [optim_t 0.377] [lr 0.000211] [CE 3.018 (2.980)] [KD 0.000 (0.000)] 2024-10-13 03:15:03,441 - Train: 84.15% [315800/375300] [252.4/300.0] [batch_t 0.436 (0.435)] [data_t 0.016] [optim_t 0.420] [lr 0.000210] [CE 3.001 (2.934)] [KD 0.000 (0.000)] 2024-10-13 03:15:25,139 - Train: 84.16% [315850/375300] [252.5/300.0] [batch_t 0.335 (0.434)] [data_t 0.016] [optim_t 0.319] [lr 0.000210] [CE 3.204 (3.026)] [KD 0.000 (0.000)] 2024-10-13 03:15:47,418 - Train: 84.17% [315900/375300] [252.5/300.0] [batch_t 0.432 (0.445)] [data_t 0.015] [optim_t 0.417] [lr 0.000210] [CE 2.849 (2.983)] [KD 0.000 (0.000)] 2024-10-13 03:16:09,555 - Train: 84.19% [315950/375300] [252.6/300.0] [batch_t 0.422 (0.443)] [data_t 0.016] [optim_t 0.406] [lr 0.000210] [CE 2.936 (2.971)] [KD 0.000 (0.000)] 2024-10-13 03:16:31,160 - Train: 84.20% [316000/375300] [252.6/300.0] [batch_t 0.442 (0.432)] [data_t 0.015] [optim_t 0.427] [lr 0.000209] [CE 2.569 (2.939)] [KD 0.000 (0.000)] 2024-10-13 03:16:52,467 - Train: 84.21% [316050/375300] [252.6/300.0] [batch_t 0.390 (0.426)] [data_t 0.015] [optim_t 0.375] [lr 0.000209] [CE 3.229 (2.966)] [KD 0.000 (0.000)] 2024-10-13 03:17:14,216 - Train: 84.23% [316100/375300] [252.7/300.0] [batch_t 0.487 (0.435)] [data_t 0.016] [optim_t 0.472] [lr 0.000209] [CE 3.177 (2.917)] [KD 0.000 (0.000)] 2024-10-13 03:17:35,925 - Train: 84.24% [316150/375300] [252.7/300.0] [batch_t 0.471 (0.434)] [data_t 0.016] [optim_t 0.455] [lr 0.000208] [CE 2.844 (2.978)] [KD 0.000 (0.000)] 2024-10-13 03:17:57,838 - Train: 84.25% [316200/375300] [252.8/300.0] [batch_t 0.433 (0.438)] [data_t 0.016] [optim_t 0.417] [lr 0.000208] [CE 3.225 (2.985)] [KD 0.000 (0.000)] 2024-10-13 03:18:20,037 - Train: 84.27% [316250/375300] [252.8/300.0] [batch_t 0.506 (0.444)] [data_t 0.015] [optim_t 0.490] [lr 0.000208] [CE 2.901 (2.982)] [KD 0.000 (0.000)] 2024-10-13 03:18:42,262 - Train: 84.28% [316300/375300] [252.8/300.0] [batch_t 0.500 (0.444)] [data_t 0.015] [optim_t 0.485] [lr 0.000207] [CE 3.034 (2.996)] [KD 0.000 (0.000)] 2024-10-13 03:19:04,641 - Train: 84.29% [316350/375300] [252.9/300.0] [batch_t 0.779 (0.447)] [data_t 0.015] [optim_t 0.763] [lr 0.000207] [CE 2.993 (2.913)] [KD 0.000 (0.000)] 2024-10-13 03:19:26,490 - Train: 84.31% [316400/375300] [252.9/300.0] [batch_t 0.314 (0.437)] [data_t 0.016] [optim_t 0.298] [lr 0.000207] [CE 3.122 (2.954)] [KD 0.000 (0.000)] 2024-10-13 03:19:48,108 - Train: 84.32% [316450/375300] [253.0/300.0] [batch_t 0.440 (0.432)] [data_t 0.016] [optim_t 0.424] [lr 0.000207] [CE 3.093 (2.984)] [KD 0.000 (0.000)] 2024-10-13 03:20:08,804 - Train: 84.33% [316500/375300] [253.0/300.0] [batch_t 0.310 (0.414)] [data_t 0.015] [optim_t 0.295] [lr 0.000206] [CE 3.004 (2.943)] [KD 0.000 (0.000)] 2024-10-13 03:20:31,196 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.424)] [top1_cnt 40451] [top5_cnt 47814] [top_all 50000] 2024-10-13 03:20:31,197 - net: 80.902 (95.628) 2024-10-13 03:20:52,217 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.412)] [top1_cnt 41071] [top5_cnt 48085] [top_all 50000] 2024-10-13 03:20:52,218 - net_E: 82.142 (96.170) 2024-10-13 03:20:52,395 - Max [top1: 81.014 (epoch: 251)] [top1-ema: 82.142 (epoch: 253)] 2024-10-13 03:20:52,396 - ==> Total time: 1 day, 15:33:56 Eta: 7:21:00 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 03:21:17,302 - Train: 84.35% [316550/375300] [253.0/300.0] [batch_t 0.483 (0.435)] [data_t 0.190] [optim_t 0.293] [lr 0.000206] [CE 3.072 (2.924)] [KD 0.000 (0.000)] 2024-10-13 03:21:38,707 - Train: 84.36% [316600/375300] [253.1/300.0] [batch_t 0.347 (0.428)] [data_t 0.016] [optim_t 0.331] [lr 0.000206] [CE 3.084 (2.953)] [KD 0.000 (0.000)] 2024-10-13 03:21:59,808 - Train: 84.37% [316650/375300] [253.1/300.0] [batch_t 0.419 (0.422)] [data_t 0.015] [optim_t 0.404] [lr 0.000205] [CE 3.215 (2.935)] [KD 0.000 (0.000)] 2024-10-13 03:22:21,247 - Train: 84.39% [316700/375300] [253.2/300.0] [batch_t 0.453 (0.429)] [data_t 0.016] [optim_t 0.437] [lr 0.000205] [CE 2.999 (2.924)] [KD 0.000 (0.000)] 2024-10-13 03:22:43,818 - Train: 84.40% [316750/375300] [253.2/300.0] [batch_t 0.317 (0.451)] [data_t 0.015] [optim_t 0.302] [lr 0.000205] [CE 2.863 (2.941)] [KD 0.000 (0.000)] 2024-10-13 03:23:05,618 - Train: 84.41% [316800/375300] [253.2/300.0] [batch_t 0.386 (0.436)] [data_t 0.015] [optim_t 0.371] [lr 0.000205] [CE 2.973 (2.947)] [KD 0.000 (0.000)] 2024-10-13 03:23:27,229 - Train: 84.43% [316850/375300] [253.3/300.0] [batch_t 0.418 (0.432)] [data_t 0.016] [optim_t 0.403] [lr 0.000204] [CE 2.972 (2.927)] [KD 0.000 (0.000)] 2024-10-13 03:23:48,652 - Train: 84.44% [316900/375300] [253.3/300.0] [batch_t 0.714 (0.428)] [data_t 0.016] [optim_t 0.699] [lr 0.000204] [CE 3.037 (2.955)] [KD 0.000 (0.000)] 2024-10-13 03:24:10,130 - Train: 84.45% [316950/375300] [253.4/300.0] [batch_t 0.768 (0.429)] [data_t 0.015] [optim_t 0.753] [lr 0.000204] [CE 3.022 (3.002)] [KD 0.000 (0.000)] 2024-10-13 03:24:31,333 - Train: 84.47% [317000/375300] [253.4/300.0] [batch_t 0.405 (0.424)] [data_t 0.015] [optim_t 0.390] [lr 0.000203] [CE 2.730 (2.928)] [KD 0.000 (0.000)] 2024-10-13 03:24:53,466 - Train: 84.48% [317050/375300] [253.4/300.0] [batch_t 0.337 (0.443)] [data_t 0.016] [optim_t 0.321] [lr 0.000203] [CE 3.035 (2.945)] [KD 0.000 (0.000)] 2024-10-13 03:25:15,277 - Train: 84.49% [317100/375300] [253.5/300.0] [batch_t 0.408 (0.436)] [data_t 0.015] [optim_t 0.393] [lr 0.000203] [CE 2.898 (2.988)] [KD 0.000 (0.000)] 2024-10-13 03:25:37,935 - Train: 84.51% [317150/375300] [253.5/300.0] [batch_t 0.856 (0.453)] [data_t 0.016] [optim_t 0.840] [lr 0.000202] [CE 3.036 (2.916)] [KD 0.000 (0.000)] 2024-10-13 03:25:58,316 - Train: 84.52% [317200/375300] [253.6/300.0] [batch_t 0.369 (0.407)] [data_t 0.016] [optim_t 0.353] [lr 0.000202] [CE 2.934 (2.924)] [KD 0.000 (0.000)] 2024-10-13 03:26:19,728 - Train: 84.53% [317250/375300] [253.6/300.0] [batch_t 0.312 (0.428)] [data_t 0.015] [optim_t 0.297] [lr 0.000202] [CE 3.019 (2.977)] [KD 0.000 (0.000)] 2024-10-13 03:26:41,164 - Train: 84.55% [317300/375300] [253.6/300.0] [batch_t 0.445 (0.429)] [data_t 0.016] [optim_t 0.429] [lr 0.000202] [CE 2.566 (2.901)] [KD 0.000 (0.000)] 2024-10-13 03:27:03,983 - Train: 84.56% [317350/375300] [253.7/300.0] [batch_t 0.461 (0.456)] [data_t 0.016] [optim_t 0.446] [lr 0.000201] [CE 2.895 (2.965)] [KD 0.000 (0.000)] 2024-10-13 03:27:26,342 - Train: 84.57% [317400/375300] [253.7/300.0] [batch_t 0.429 (0.447)] [data_t 0.015] [optim_t 0.413] [lr 0.000201] [CE 2.883 (2.930)] [KD 0.000 (0.000)] 2024-10-13 03:27:48,538 - Train: 84.59% [317450/375300] [253.8/300.0] [batch_t 0.517 (0.444)] [data_t 0.016] [optim_t 0.502] [lr 0.000201] [CE 3.199 (2.949)] [KD 0.000 (0.000)] 2024-10-13 03:28:10,774 - Train: 84.60% [317500/375300] [253.8/300.0] [batch_t 0.465 (0.445)] [data_t 0.016] [optim_t 0.450] [lr 0.000200] [CE 3.319 (2.965)] [KD 0.000 (0.000)] 2024-10-13 03:28:32,616 - Train: 84.61% [317550/375300] [253.8/300.0] [batch_t 0.502 (0.437)] [data_t 0.016] [optim_t 0.486] [lr 0.000200] [CE 2.904 (2.955)] [KD 0.000 (0.000)] 2024-10-13 03:28:54,580 - Train: 84.63% [317600/375300] [253.9/300.0] [batch_t 0.470 (0.439)] [data_t 0.016] [optim_t 0.455] [lr 0.000200] [CE 3.102 (2.956)] [KD 0.000 (0.000)] 2024-10-13 03:29:16,685 - Train: 84.64% [317650/375300] [253.9/300.0] [batch_t 0.427 (0.442)] [data_t 0.015] [optim_t 0.412] [lr 0.000200] [CE 2.877 (2.899)] [KD 0.000 (0.000)] 2024-10-13 03:29:38,447 - Train: 84.65% [317700/375300] [254.0/300.0] [batch_t 0.491 (0.435)] [data_t 0.015] [optim_t 0.475] [lr 0.000199] [CE 2.955 (2.951)] [KD 0.000 (0.000)] 2024-10-13 03:29:59,405 - Train: 84.67% [317750/375300] [254.0/300.0] [batch_t 0.306 (0.419)] [data_t 0.015] [optim_t 0.291] [lr 0.000199] [CE 3.067 (2.949)] [KD 0.000 (0.000)] 2024-10-13 03:30:22,544 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.434)] [top1_cnt 40523] [top5_cnt 47879] [top_all 50000] 2024-10-13 03:30:22,544 - net: 81.046 (95.758) 2024-10-13 03:30:44,570 - Test (net_E): 100.00% [50/50] [batch_t 0.132 (0.432)] [top1_cnt 41089] [top5_cnt 48082] [top_all 50000] 2024-10-13 03:30:44,570 - net_E: 82.178 (96.164) 2024-10-13 03:30:44,744 - Max [top1: 81.046 (epoch: 254)] [top1-ema: 82.178 (epoch: 254)] 2024-10-13 03:30:44,745 - ==> Total time: 1 day, 15:43:48 Eta: 7:11:42 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 03:31:10,245 - Train: 84.68% [317800/375300] [254.0/300.0] [batch_t 0.317 (0.439)] [data_t 0.016] [optim_t 0.301] [lr 0.000199] [CE 2.643 (2.929)] [KD 0.000 (0.000)] 2024-10-13 03:31:31,696 - Train: 84.69% [317850/375300] [254.1/300.0] [batch_t 0.436 (0.429)] [data_t 0.015] [optim_t 0.420] [lr 0.000198] [CE 3.011 (2.940)] [KD 0.000 (0.000)] 2024-10-13 03:31:54,410 - Train: 84.71% [317900/375300] [254.1/300.0] [batch_t 0.476 (0.454)] [data_t 0.016] [optim_t 0.460] [lr 0.000198] [CE 2.901 (2.896)] [KD 0.000 (0.000)] 2024-10-13 03:32:17,049 - Train: 84.72% [317950/375300] [254.2/300.0] [batch_t 0.318 (0.453)] [data_t 0.016] [optim_t 0.302] [lr 0.000198] [CE 3.174 (2.912)] [KD 0.000 (0.000)] 2024-10-13 03:32:39,290 - Train: 84.73% [318000/375300] [254.2/300.0] [batch_t 0.397 (0.445)] [data_t 0.015] [optim_t 0.381] [lr 0.000198] [CE 2.780 (2.924)] [KD 0.000 (0.000)] 2024-10-13 03:33:00,809 - Train: 84.75% [318050/375300] [254.2/300.0] [batch_t 0.510 (0.430)] [data_t 0.016] [optim_t 0.494] [lr 0.000197] [CE 3.158 (2.917)] [KD 0.000 (0.000)] 2024-10-13 03:33:22,047 - Train: 84.76% [318100/375300] [254.3/300.0] [batch_t 0.374 (0.425)] [data_t 0.016] [optim_t 0.358] [lr 0.000197] [CE 2.964 (2.950)] [KD 0.000 (0.000)] 2024-10-13 03:33:44,876 - Train: 84.77% [318150/375300] [254.3/300.0] [batch_t 0.325 (0.456)] [data_t 0.016] [optim_t 0.310] [lr 0.000197] [CE 3.075 (2.915)] [KD 0.000 (0.000)] 2024-10-13 03:34:06,762 - Train: 84.79% [318200/375300] [254.4/300.0] [batch_t 0.434 (0.438)] [data_t 0.015] [optim_t 0.418] [lr 0.000196] [CE 3.208 (2.939)] [KD 0.000 (0.000)] 2024-10-13 03:34:28,860 - Train: 84.80% [318250/375300] [254.4/300.0] [batch_t 0.457 (0.442)] [data_t 0.016] [optim_t 0.441] [lr 0.000196] [CE 2.732 (2.955)] [KD 0.000 (0.000)] 2024-10-13 03:34:50,886 - Train: 84.81% [318300/375300] [254.4/300.0] [batch_t 0.452 (0.440)] [data_t 0.016] [optim_t 0.436] [lr 0.000196] [CE 3.107 (2.981)] [KD 0.000 (0.000)] 2024-10-13 03:35:13,488 - Train: 84.83% [318350/375300] [254.5/300.0] [batch_t 0.448 (0.452)] [data_t 0.016] [optim_t 0.432] [lr 0.000196] [CE 3.089 (2.961)] [KD 0.000 (0.000)] 2024-10-13 03:35:35,818 - Train: 84.84% [318400/375300] [254.5/300.0] [batch_t 0.469 (0.446)] [data_t 0.016] [optim_t 0.454] [lr 0.000195] [CE 3.325 (2.975)] [KD 0.000 (0.000)] 2024-10-13 03:35:57,617 - Train: 84.85% [318450/375300] [254.6/300.0] [batch_t 0.400 (0.436)] [data_t 0.016] [optim_t 0.384] [lr 0.000195] [CE 2.784 (2.941)] [KD 0.000 (0.000)] 2024-10-13 03:36:19,148 - Train: 84.87% [318500/375300] [254.6/300.0] [batch_t 0.513 (0.430)] [data_t 0.016] [optim_t 0.497] [lr 0.000195] [CE 2.929 (2.923)] [KD 0.000 (0.000)] 2024-10-13 03:36:41,004 - Train: 84.88% [318550/375300] [254.6/300.0] [batch_t 0.459 (0.437)] [data_t 0.016] [optim_t 0.443] [lr 0.000194] [CE 2.839 (2.899)] [KD 0.000 (0.000)] 2024-10-13 03:37:03,269 - Train: 84.89% [318600/375300] [254.7/300.0] [batch_t 0.497 (0.445)] [data_t 0.016] [optim_t 0.482] [lr 0.000194] [CE 2.853 (2.938)] [KD 0.000 (0.000)] 2024-10-13 03:37:24,843 - Train: 84.91% [318650/375300] [254.7/300.0] [batch_t 0.405 (0.431)] [data_t 0.015] [optim_t 0.389] [lr 0.000194] [CE 2.867 (2.959)] [KD 0.000 (0.000)] 2024-10-13 03:37:46,187 - Train: 84.92% [318700/375300] [254.8/300.0] [batch_t 0.419 (0.427)] [data_t 0.016] [optim_t 0.403] [lr 0.000194] [CE 2.790 (2.942)] [KD 0.000 (0.000)] 2024-10-13 03:38:07,752 - Train: 84.93% [318750/375300] [254.8/300.0] [batch_t 0.409 (0.431)] [data_t 0.016] [optim_t 0.393] [lr 0.000193] [CE 2.690 (2.952)] [KD 0.000 (0.000)] 2024-10-13 03:38:30,114 - Train: 84.95% [318800/375300] [254.8/300.0] [batch_t 0.431 (0.447)] [data_t 0.015] [optim_t 0.416] [lr 0.000193] [CE 2.949 (2.917)] [KD 0.000 (0.000)] 2024-10-13 03:38:51,849 - Train: 84.96% [318850/375300] [254.9/300.0] [batch_t 0.451 (0.435)] [data_t 0.016] [optim_t 0.435] [lr 0.000193] [CE 2.948 (2.976)] [KD 0.000 (0.000)] 2024-10-13 03:39:13,120 - Train: 84.97% [318900/375300] [254.9/300.0] [batch_t 0.474 (0.425)] [data_t 0.016] [optim_t 0.459] [lr 0.000192] [CE 3.226 (2.922)] [KD 0.000 (0.000)] 2024-10-13 03:39:35,916 - Train: 84.99% [318950/375300] [255.0/300.0] [batch_t 0.486 (0.456)] [data_t 0.016] [optim_t 0.470] [lr 0.000192] [CE 3.057 (2.913)] [KD 0.000 (0.000)] 2024-10-13 03:39:57,490 - Train: 85.00% [319000/375300] [255.0/300.0] [batch_t 0.313 (0.431)] [data_t 0.015] [optim_t 0.297] [lr 0.000192] [CE 3.081 (2.929)] [KD 0.000 (0.000)] 2024-10-13 03:40:20,891 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.432)] [top1_cnt 40576] [top5_cnt 47851] [top_all 50000] 2024-10-13 03:40:20,891 - net: 81.152 (95.702) 2024-10-13 03:40:43,610 - Test (net_E): 100.00% [50/50] [batch_t 0.159 (0.446)] [top1_cnt 41073] [top5_cnt 48080] [top_all 50000] 2024-10-13 03:40:43,611 - net_E: 82.146 (96.160) 2024-10-13 03:40:43,827 - Max [top1: 81.152 (epoch: 255)] [top1-ema: 82.178 (epoch: 254)] 2024-10-13 03:40:43,828 - ==> Total time: 1 day, 15:53:47 Eta: 7:02:26 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 03:41:07,482 - Train: 85.01% [319050/375300] [255.0/300.0] [batch_t 0.416 (0.416)] [data_t 0.122] [optim_t 0.294] [lr 0.000192] [CE 3.033 (2.901)] [KD 0.000 (0.000)] 2024-10-13 03:41:29,272 - Train: 85.03% [319100/375300] [255.1/300.0] [batch_t 0.310 (0.436)] [data_t 0.016] [optim_t 0.294] [lr 0.000191] [CE 2.649 (2.983)] [KD 0.000 (0.000)] 2024-10-13 03:41:51,110 - Train: 85.04% [319150/375300] [255.1/300.0] [batch_t 0.477 (0.437)] [data_t 0.016] [optim_t 0.461] [lr 0.000191] [CE 3.108 (2.905)] [KD 0.000 (0.000)] 2024-10-13 03:42:13,085 - Train: 85.05% [319200/375300] [255.2/300.0] [batch_t 0.461 (0.439)] [data_t 0.016] [optim_t 0.446] [lr 0.000191] [CE 2.920 (2.918)] [KD 0.000 (0.000)] 2024-10-13 03:42:35,888 - Train: 85.07% [319250/375300] [255.2/300.0] [batch_t 0.459 (0.456)] [data_t 0.015] [optim_t 0.443] [lr 0.000190] [CE 2.833 (2.980)] [KD 0.000 (0.000)] 2024-10-13 03:42:58,264 - Train: 85.08% [319300/375300] [255.2/300.0] [batch_t 0.314 (0.447)] [data_t 0.015] [optim_t 0.298] [lr 0.000190] [CE 2.904 (2.926)] [KD 0.000 (0.000)] 2024-10-13 03:43:19,923 - Train: 85.09% [319350/375300] [255.3/300.0] [batch_t 0.466 (0.433)] [data_t 0.016] [optim_t 0.451] [lr 0.000190] [CE 3.090 (2.944)] [KD 0.000 (0.000)] 2024-10-13 03:43:41,847 - Train: 85.11% [319400/375300] [255.3/300.0] [batch_t 0.498 (0.438)] [data_t 0.016] [optim_t 0.482] [lr 0.000190] [CE 2.761 (2.875)] [KD 0.000 (0.000)] 2024-10-13 03:44:05,151 - Train: 85.12% [319450/375300] [255.4/300.0] [batch_t 0.500 (0.466)] [data_t 0.016] [optim_t 0.484] [lr 0.000189] [CE 3.119 (2.932)] [KD 0.000 (0.000)] 2024-10-13 03:44:27,516 - Train: 85.13% [319500/375300] [255.4/300.0] [batch_t 0.405 (0.447)] [data_t 0.016] [optim_t 0.390] [lr 0.000189] [CE 2.716 (2.889)] [KD 0.000 (0.000)] 2024-10-13 03:44:49,833 - Train: 85.15% [319550/375300] [255.4/300.0] [batch_t 0.463 (0.446)] [data_t 0.016] [optim_t 0.447] [lr 0.000189] [CE 2.948 (2.975)] [KD 0.000 (0.000)] 2024-10-13 03:45:11,935 - Train: 85.16% [319600/375300] [255.5/300.0] [batch_t 0.497 (0.442)] [data_t 0.016] [optim_t 0.481] [lr 0.000189] [CE 2.888 (2.912)] [KD 0.000 (0.000)] 2024-10-13 03:45:33,661 - Train: 85.17% [319650/375300] [255.5/300.0] [batch_t 0.494 (0.434)] [data_t 0.016] [optim_t 0.479] [lr 0.000188] [CE 2.646 (2.934)] [KD 0.000 (0.000)] 2024-10-13 03:45:55,735 - Train: 85.19% [319700/375300] [255.6/300.0] [batch_t 0.421 (0.441)] [data_t 0.015] [optim_t 0.405] [lr 0.000188] [CE 2.870 (2.970)] [KD 0.000 (0.000)] 2024-10-13 03:46:17,821 - Train: 85.20% [319750/375300] [255.6/300.0] [batch_t 0.452 (0.442)] [data_t 0.015] [optim_t 0.436] [lr 0.000188] [CE 2.940 (2.979)] [KD 0.000 (0.000)] 2024-10-13 03:46:40,480 - Train: 85.21% [319800/375300] [255.6/300.0] [batch_t 0.534 (0.453)] [data_t 0.016] [optim_t 0.518] [lr 0.000187] [CE 3.098 (2.901)] [KD 0.000 (0.000)] 2024-10-13 03:47:02,059 - Train: 85.23% [319850/375300] [255.7/300.0] [batch_t 0.364 (0.431)] [data_t 0.016] [optim_t 0.348] [lr 0.000187] [CE 3.061 (2.931)] [KD 0.000 (0.000)] 2024-10-13 03:47:24,789 - Train: 85.24% [319900/375300] [255.7/300.0] [batch_t 0.310 (0.454)] [data_t 0.016] [optim_t 0.294] [lr 0.000187] [CE 3.044 (2.881)] [KD 0.000 (0.000)] 2024-10-13 03:47:47,127 - Train: 85.25% [319950/375300] [255.8/300.0] [batch_t 0.707 (0.447)] [data_t 0.015] [optim_t 0.691] [lr 0.000187] [CE 2.967 (2.903)] [KD 0.000 (0.000)] 2024-10-13 03:48:08,753 - Train: 85.27% [320000/375300] [255.8/300.0] [batch_t 0.366 (0.432)] [data_t 0.016] [optim_t 0.350] [lr 0.000186] [CE 2.879 (2.893)] [KD 0.000 (0.000)] 2024-10-13 03:48:30,127 - Train: 85.28% [320050/375300] [255.8/300.0] [batch_t 0.396 (0.427)] [data_t 0.015] [optim_t 0.380] [lr 0.000186] [CE 2.865 (2.934)] [KD 0.000 (0.000)] 2024-10-13 03:48:51,496 - Train: 85.29% [320100/375300] [255.9/300.0] [batch_t 0.425 (0.427)] [data_t 0.016] [optim_t 0.409] [lr 0.000186] [CE 2.588 (2.895)] [KD 0.000 (0.000)] 2024-10-13 03:49:13,155 - Train: 85.31% [320150/375300] [255.9/300.0] [batch_t 0.619 (0.433)] [data_t 0.015] [optim_t 0.603] [lr 0.000185] [CE 2.738 (2.913)] [KD 0.000 (0.000)] 2024-10-13 03:49:34,727 - Train: 85.32% [320200/375300] [256.0/300.0] [batch_t 0.471 (0.431)] [data_t 0.016] [optim_t 0.456] [lr 0.000185] [CE 3.073 (2.939)] [KD 0.000 (0.000)] 2024-10-13 03:49:55,885 - Train: 85.33% [320250/375300] [256.0/300.0] [batch_t 0.433 (0.423)] [data_t 0.015] [optim_t 0.418] [lr 0.000185] [CE 2.872 (2.923)] [KD 0.000 (0.000)] 2024-10-13 03:50:20,740 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.455)] [top1_cnt 40504] [top5_cnt 47857] [top_all 50000] 2024-10-13 03:50:20,741 - net: 81.008 (95.714) 2024-10-13 03:50:43,132 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.439)] [top1_cnt 41066] [top5_cnt 48104] [top_all 50000] 2024-10-13 03:50:43,133 - net_E: 82.132 (96.208) 2024-10-13 03:50:43,304 - Max [top1: 81.152 (epoch: 255)] [top1-ema: 82.178 (epoch: 254)] 2024-10-13 03:50:43,304 - ==> Total time: 1 day, 16:03:47 Eta: 6:53:09 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 03:51:07,850 - Train: 85.35% [320300/375300] [256.0/300.0] [batch_t 0.325 (0.517)] [data_t 0.015] [optim_t 0.309] [lr 0.000185] [CE 2.950 (2.901)] [KD 0.000 (0.000)] 2024-10-13 03:51:31,026 - Train: 85.36% [320350/375300] [256.1/300.0] [batch_t 0.495 (0.463)] [data_t 0.015] [optim_t 0.480] [lr 0.000184] [CE 3.132 (2.930)] [KD 0.000 (0.000)] 2024-10-13 03:51:53,703 - Train: 85.37% [320400/375300] [256.1/300.0] [batch_t 0.314 (0.453)] [data_t 0.016] [optim_t 0.299] [lr 0.000184] [CE 2.761 (2.935)] [KD 0.000 (0.000)] 2024-10-13 03:52:15,583 - Train: 85.39% [320450/375300] [256.2/300.0] [batch_t 0.536 (0.437)] [data_t 0.015] [optim_t 0.520] [lr 0.000184] [CE 3.156 (2.920)] [KD 0.000 (0.000)] 2024-10-13 03:52:38,698 - Train: 85.40% [320500/375300] [256.2/300.0] [batch_t 0.482 (0.462)] [data_t 0.015] [optim_t 0.466] [lr 0.000184] [CE 3.263 (2.956)] [KD 0.000 (0.000)] 2024-10-13 03:53:00,876 - Train: 85.41% [320550/375300] [256.2/300.0] [batch_t 0.455 (0.443)] [data_t 0.015] [optim_t 0.440] [lr 0.000183] [CE 2.913 (2.840)] [KD 0.000 (0.000)] 2024-10-13 03:53:22,990 - Train: 85.42% [320600/375300] [256.3/300.0] [batch_t 0.323 (0.442)] [data_t 0.015] [optim_t 0.307] [lr 0.000183] [CE 3.143 (2.902)] [KD 0.000 (0.000)] 2024-10-13 03:53:46,021 - Train: 85.44% [320650/375300] [256.3/300.0] [batch_t 0.480 (0.460)] [data_t 0.182] [optim_t 0.297] [lr 0.000183] [CE 3.050 (2.924)] [KD 0.000 (0.000)] 2024-10-13 03:54:08,631 - Train: 85.45% [320700/375300] [256.4/300.0] [batch_t 0.513 (0.452)] [data_t 0.217] [optim_t 0.297] [lr 0.000182] [CE 2.943 (2.936)] [KD 0.000 (0.000)] 2024-10-13 03:54:30,549 - Train: 85.46% [320750/375300] [256.4/300.0] [batch_t 0.501 (0.438)] [data_t 0.206] [optim_t 0.295] [lr 0.000182] [CE 2.795 (2.932)] [KD 0.000 (0.000)] 2024-10-13 03:54:52,876 - Train: 85.48% [320800/375300] [256.4/300.0] [batch_t 0.380 (0.446)] [data_t 0.081] [optim_t 0.300] [lr 0.000182] [CE 3.177 (2.954)] [KD 0.000 (0.000)] 2024-10-13 03:55:14,719 - Train: 85.49% [320850/375300] [256.5/300.0] [batch_t 0.469 (0.437)] [data_t 0.168] [optim_t 0.300] [lr 0.000182] [CE 3.020 (2.950)] [KD 0.000 (0.000)] 2024-10-13 03:55:36,742 - Train: 85.50% [320900/375300] [256.5/300.0] [batch_t 0.429 (0.440)] [data_t 0.131] [optim_t 0.298] [lr 0.000181] [CE 3.011 (2.957)] [KD 0.000 (0.000)] 2024-10-13 03:55:58,891 - Train: 85.52% [320950/375300] [256.6/300.0] [batch_t 0.392 (0.443)] [data_t 0.093] [optim_t 0.300] [lr 0.000181] [CE 2.589 (2.939)] [KD 0.000 (0.000)] 2024-10-13 03:56:21,238 - Train: 85.53% [321000/375300] [256.6/300.0] [batch_t 0.527 (0.447)] [data_t 0.225] [optim_t 0.303] [lr 0.000181] [CE 2.931 (2.961)] [KD 0.000 (0.000)] 2024-10-13 03:56:43,203 - Train: 85.54% [321050/375300] [256.6/300.0] [batch_t 0.412 (0.439)] [data_t 0.114] [optim_t 0.297] [lr 0.000181] [CE 2.917 (2.914)] [KD 0.000 (0.000)] 2024-10-13 03:57:05,254 - Train: 85.56% [321100/375300] [256.7/300.0] [batch_t 0.451 (0.441)] [data_t 0.154] [optim_t 0.297] [lr 0.000180] [CE 3.101 (2.936)] [KD 0.000 (0.000)] 2024-10-13 03:57:27,401 - Train: 85.57% [321150/375300] [256.7/300.0] [batch_t 0.436 (0.443)] [data_t 0.015] [optim_t 0.420] [lr 0.000180] [CE 2.908 (2.944)] [KD 0.000 (0.000)] 2024-10-13 03:57:49,712 - Train: 85.58% [321200/375300] [256.8/300.0] [batch_t 0.457 (0.446)] [data_t 0.015] [optim_t 0.441] [lr 0.000180] [CE 2.856 (2.932)] [KD 0.000 (0.000)] 2024-10-13 03:58:12,005 - Train: 85.60% [321250/375300] [256.8/300.0] [batch_t 0.364 (0.446)] [data_t 0.016] [optim_t 0.348] [lr 0.000179] [CE 3.113 (2.947)] [KD 0.000 (0.000)] 2024-10-13 03:58:34,341 - Train: 85.61% [321300/375300] [256.8/300.0] [batch_t 0.449 (0.447)] [data_t 0.015] [optim_t 0.433] [lr 0.000179] [CE 2.529 (2.900)] [KD 0.000 (0.000)] 2024-10-13 03:58:55,841 - Train: 85.62% [321350/375300] [256.9/300.0] [batch_t 0.323 (0.430)] [data_t 0.015] [optim_t 0.308] [lr 0.000179] [CE 2.851 (2.955)] [KD 0.000 (0.000)] 2024-10-13 03:59:18,313 - Train: 85.64% [321400/375300] [256.9/300.0] [batch_t 0.476 (0.449)] [data_t 0.015] [optim_t 0.461] [lr 0.000179] [CE 2.879 (2.926)] [KD 0.000 (0.000)] 2024-10-13 03:59:39,823 - Train: 85.65% [321450/375300] [257.0/300.0] [batch_t 0.376 (0.430)] [data_t 0.015] [optim_t 0.360] [lr 0.000178] [CE 2.921 (2.918)] [KD 0.000 (0.000)] 2024-10-13 04:00:01,288 - Train: 85.66% [321500/375300] [257.0/300.0] [batch_t 0.309 (0.429)] [data_t 0.015] [optim_t 0.294] [lr 0.000178] [CE 2.931 (2.883)] [KD 0.000 (0.000)] 2024-10-13 04:00:25,532 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.438)] [top1_cnt 40566] [top5_cnt 47881] [top_all 50000] 2024-10-13 04:00:25,533 - net: 81.132 (95.762) 2024-10-13 04:00:47,138 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.424)] [top1_cnt 41057] [top5_cnt 48096] [top_all 50000] 2024-10-13 04:00:47,139 - net_E: 82.114 (96.192) 2024-10-13 04:00:47,366 - Max [top1: 81.152 (epoch: 255)] [top1-ema: 82.178 (epoch: 254)] 2024-10-13 04:00:47,367 - ==> Total time: 1 day, 16:13:51 Eta: 6:43:52 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 04:01:11,872 - Train: 85.68% [321550/375300] [257.0/300.0] [batch_t 0.440 (0.532)] [data_t 0.015] [optim_t 0.424] [lr 0.000178] [CE 2.850 (2.922)] [KD 0.000 (0.000)] 2024-10-13 04:01:34,832 - Train: 85.69% [321600/375300] [257.1/300.0] [batch_t 0.462 (0.459)] [data_t 0.016] [optim_t 0.446] [lr 0.000178] [CE 2.770 (2.911)] [KD 0.000 (0.000)] 2024-10-13 04:01:57,466 - Train: 85.70% [321650/375300] [257.1/300.0] [batch_t 0.512 (0.453)] [data_t 0.015] [optim_t 0.497] [lr 0.000177] [CE 3.057 (2.930)] [KD 0.000 (0.000)] 2024-10-13 04:02:19,958 - Train: 85.72% [321700/375300] [257.2/300.0] [batch_t 0.397 (0.450)] [data_t 0.015] [optim_t 0.381] [lr 0.000177] [CE 3.019 (2.929)] [KD 0.000 (0.000)] 2024-10-13 04:02:42,539 - Train: 85.73% [321750/375300] [257.2/300.0] [batch_t 0.430 (0.452)] [data_t 0.015] [optim_t 0.414] [lr 0.000177] [CE 2.907 (2.928)] [KD 0.000 (0.000)] 2024-10-13 04:03:05,049 - Train: 85.74% [321800/375300] [257.2/300.0] [batch_t 0.414 (0.450)] [data_t 0.016] [optim_t 0.398] [lr 0.000176] [CE 2.775 (2.886)] [KD 0.000 (0.000)] 2024-10-13 04:03:27,541 - Train: 85.76% [321850/375300] [257.3/300.0] [batch_t 0.447 (0.450)] [data_t 0.016] [optim_t 0.431] [lr 0.000176] [CE 2.816 (2.927)] [KD 0.000 (0.000)] 2024-10-13 04:03:50,081 - Train: 85.77% [321900/375300] [257.3/300.0] [batch_t 0.457 (0.451)] [data_t 0.016] [optim_t 0.441] [lr 0.000176] [CE 2.714 (2.936)] [KD 0.000 (0.000)] 2024-10-13 04:04:12,958 - Train: 85.78% [321950/375300] [257.4/300.0] [batch_t 0.471 (0.457)] [data_t 0.016] [optim_t 0.455] [lr 0.000176] [CE 2.787 (2.964)] [KD 0.000 (0.000)] 2024-10-13 04:04:35,487 - Train: 85.80% [322000/375300] [257.4/300.0] [batch_t 0.478 (0.450)] [data_t 0.016] [optim_t 0.462] [lr 0.000175] [CE 2.891 (2.920)] [KD 0.000 (0.000)] 2024-10-13 04:04:58,525 - Train: 85.81% [322050/375300] [257.4/300.0] [batch_t 0.534 (0.461)] [data_t 0.015] [optim_t 0.518] [lr 0.000175] [CE 3.109 (2.922)] [KD 0.000 (0.000)] 2024-10-13 04:05:21,219 - Train: 85.82% [322100/375300] [257.5/300.0] [batch_t 0.474 (0.454)] [data_t 0.016] [optim_t 0.458] [lr 0.000175] [CE 2.689 (2.944)] [KD 0.000 (0.000)] 2024-10-13 04:05:43,961 - Train: 85.84% [322150/375300] [257.5/300.0] [batch_t 0.383 (0.455)] [data_t 0.015] [optim_t 0.367] [lr 0.000175] [CE 2.983 (2.940)] [KD 0.000 (0.000)] 2024-10-13 04:06:06,212 - Train: 85.85% [322200/375300] [257.6/300.0] [batch_t 0.484 (0.445)] [data_t 0.015] [optim_t 0.469] [lr 0.000174] [CE 3.043 (2.914)] [KD 0.000 (0.000)] 2024-10-13 04:06:28,581 - Train: 85.86% [322250/375300] [257.6/300.0] [batch_t 0.498 (0.447)] [data_t 0.015] [optim_t 0.483] [lr 0.000174] [CE 2.974 (2.953)] [KD 0.000 (0.000)] 2024-10-13 04:06:51,424 - Train: 85.88% [322300/375300] [257.6/300.0] [batch_t 0.464 (0.457)] [data_t 0.015] [optim_t 0.448] [lr 0.000174] [CE 2.939 (2.892)] [KD 0.000 (0.000)] 2024-10-13 04:07:13,805 - Train: 85.89% [322350/375300] [257.7/300.0] [batch_t 0.446 (0.448)] [data_t 0.015] [optim_t 0.431] [lr 0.000174] [CE 2.628 (2.943)] [KD 0.000 (0.000)] 2024-10-13 04:07:36,347 - Train: 85.90% [322400/375300] [257.7/300.0] [batch_t 0.456 (0.451)] [data_t 0.016] [optim_t 0.440] [lr 0.000173] [CE 3.088 (2.908)] [KD 0.000 (0.000)] 2024-10-13 04:07:58,824 - Train: 85.92% [322450/375300] [257.8/300.0] [batch_t 0.447 (0.449)] [data_t 0.015] [optim_t 0.432] [lr 0.000173] [CE 3.110 (2.927)] [KD 0.000 (0.000)] 2024-10-13 04:08:20,511 - Train: 85.93% [322500/375300] [257.8/300.0] [batch_t 0.431 (0.434)] [data_t 0.016] [optim_t 0.415] [lr 0.000173] [CE 2.992 (2.924)] [KD 0.000 (0.000)] 2024-10-13 04:08:42,085 - Train: 85.94% [322550/375300] [257.8/300.0] [batch_t 0.503 (0.431)] [data_t 0.201] [optim_t 0.302] [lr 0.000172] [CE 2.873 (2.928)] [KD 0.000 (0.000)] 2024-10-13 04:09:05,115 - Train: 85.96% [322600/375300] [257.9/300.0] [batch_t 0.443 (0.460)] [data_t 0.149] [optim_t 0.294] [lr 0.000172] [CE 2.885 (2.914)] [KD 0.000 (0.000)] 2024-10-13 04:09:27,336 - Train: 85.97% [322650/375300] [257.9/300.0] [batch_t 0.539 (0.444)] [data_t 0.243] [optim_t 0.297] [lr 0.000172] [CE 2.771 (2.974)] [KD 0.000 (0.000)] 2024-10-13 04:09:49,858 - Train: 85.98% [322700/375300] [258.0/300.0] [batch_t 0.440 (0.450)] [data_t 0.134] [optim_t 0.307] [lr 0.000172] [CE 2.648 (2.949)] [KD 0.000 (0.000)] 2024-10-13 04:10:11,290 - Train: 86.00% [322750/375300] [258.0/300.0] [batch_t 0.309 (0.429)] [data_t 0.015] [optim_t 0.294] [lr 0.000171] [CE 2.738 (2.922)] [KD 0.000 (0.000)] 2024-10-13 04:10:37,061 - Test (net): 100.00% [50/50] [batch_t 0.148 (0.462)] [top1_cnt 40681] [top5_cnt 47894] [top_all 50000] 2024-10-13 04:10:37,061 - net: 81.362 (95.788) 2024-10-13 04:11:00,671 - Test (net_E): 100.00% [50/50] [batch_t 0.142 (0.465)] [top1_cnt 41070] [top5_cnt 48105] [top_all 50000] 2024-10-13 04:11:00,671 - net_E: 82.140 (96.210) 2024-10-13 04:11:00,834 - Max [top1: 81.362 (epoch: 258)] [top1-ema: 82.178 (epoch: 254)] 2024-10-13 04:11:00,835 - ==> Total time: 1 day, 16:24:04 Eta: 6:34:37 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 04:11:25,600 - Train: 86.01% [322800/375300] [258.0/300.0] [batch_t 0.377 (0.415)] [data_t 0.080] [optim_t 0.297] [lr 0.000171] [CE 2.873 (2.929)] [KD 0.000 (0.000)] 2024-10-13 04:11:48,307 - Train: 86.02% [322850/375300] [258.1/300.0] [batch_t 0.471 (0.454)] [data_t 0.016] [optim_t 0.456] [lr 0.000171] [CE 2.952 (2.889)] [KD 0.000 (0.000)] 2024-10-13 04:12:10,453 - Train: 86.04% [322900/375300] [258.1/300.0] [batch_t 0.431 (0.443)] [data_t 0.016] [optim_t 0.416] [lr 0.000171] [CE 2.762 (2.886)] [KD 0.000 (0.000)] 2024-10-13 04:12:32,547 - Train: 86.05% [322950/375300] [258.2/300.0] [batch_t 0.391 (0.442)] [data_t 0.016] [optim_t 0.376] [lr 0.000170] [CE 3.108 (2.937)] [KD 0.000 (0.000)] 2024-10-13 04:12:54,725 - Train: 86.06% [323000/375300] [258.2/300.0] [batch_t 0.447 (0.443)] [data_t 0.016] [optim_t 0.432] [lr 0.000170] [CE 2.786 (2.884)] [KD 0.000 (0.000)] 2024-10-13 04:13:16,845 - Train: 86.08% [323050/375300] [258.2/300.0] [batch_t 0.472 (0.442)] [data_t 0.016] [optim_t 0.457] [lr 0.000170] [CE 3.170 (2.899)] [KD 0.000 (0.000)] 2024-10-13 04:13:38,797 - Train: 86.09% [323100/375300] [258.3/300.0] [batch_t 0.426 (0.439)] [data_t 0.016] [optim_t 0.410] [lr 0.000170] [CE 2.920 (2.901)] [KD 0.000 (0.000)] 2024-10-13 04:14:00,706 - Train: 86.10% [323150/375300] [258.3/300.0] [batch_t 0.492 (0.438)] [data_t 0.016] [optim_t 0.476] [lr 0.000169] [CE 2.892 (2.869)] [KD 0.000 (0.000)] 2024-10-13 04:14:23,072 - Train: 86.12% [323200/375300] [258.4/300.0] [batch_t 0.423 (0.447)] [data_t 0.016] [optim_t 0.407] [lr 0.000169] [CE 3.179 (2.928)] [KD 0.000 (0.000)] 2024-10-13 04:14:45,432 - Train: 86.13% [323250/375300] [258.4/300.0] [batch_t 0.444 (0.447)] [data_t 0.016] [optim_t 0.428] [lr 0.000169] [CE 2.830 (2.884)] [KD 0.000 (0.000)] 2024-10-13 04:15:06,937 - Train: 86.14% [323300/375300] [258.4/300.0] [batch_t 0.476 (0.430)] [data_t 0.016] [optim_t 0.460] [lr 0.000168] [CE 2.888 (2.885)] [KD 0.000 (0.000)] 2024-10-13 04:15:28,369 - Train: 86.16% [323350/375300] [258.5/300.0] [batch_t 0.637 (0.428)] [data_t 0.016] [optim_t 0.622] [lr 0.000168] [CE 2.792 (2.931)] [KD 0.000 (0.000)] 2024-10-13 04:15:49,357 - Train: 86.17% [323400/375300] [258.5/300.0] [batch_t 0.436 (0.420)] [data_t 0.016] [optim_t 0.421] [lr 0.000168] [CE 3.025 (2.960)] [KD 0.000 (0.000)] 2024-10-13 04:16:10,106 - Train: 86.18% [323450/375300] [258.6/300.0] [batch_t 0.392 (0.415)] [data_t 0.016] [optim_t 0.376] [lr 0.000168] [CE 2.942 (2.902)] [KD 0.000 (0.000)] 2024-10-13 04:16:31,649 - Train: 86.20% [323500/375300] [258.6/300.0] [batch_t 0.452 (0.431)] [data_t 0.016] [optim_t 0.436] [lr 0.000167] [CE 2.960 (2.937)] [KD 0.000 (0.000)] 2024-10-13 04:16:52,986 - Train: 86.21% [323550/375300] [258.6/300.0] [batch_t 0.388 (0.427)] [data_t 0.016] [optim_t 0.372] [lr 0.000167] [CE 2.626 (2.888)] [KD 0.000 (0.000)] 2024-10-13 04:17:15,194 - Train: 86.22% [323600/375300] [258.7/300.0] [batch_t 0.429 (0.444)] [data_t 0.016] [optim_t 0.413] [lr 0.000167] [CE 2.914 (2.905)] [KD 0.000 (0.000)] 2024-10-13 04:17:36,599 - Train: 86.24% [323650/375300] [258.7/300.0] [batch_t 0.439 (0.428)] [data_t 0.015] [optim_t 0.423] [lr 0.000167] [CE 2.951 (2.934)] [KD 0.000 (0.000)] 2024-10-13 04:17:58,374 - Train: 86.25% [323700/375300] [258.8/300.0] [batch_t 0.407 (0.435)] [data_t 0.016] [optim_t 0.391] [lr 0.000166] [CE 2.917 (2.877)] [KD 0.000 (0.000)] 2024-10-13 04:18:19,971 - Train: 86.26% [323750/375300] [258.8/300.0] [batch_t 0.506 (0.432)] [data_t 0.016] [optim_t 0.491] [lr 0.000166] [CE 3.102 (2.947)] [KD 0.000 (0.000)] 2024-10-13 04:18:41,543 - Train: 86.28% [323800/375300] [258.8/300.0] [batch_t 0.437 (0.431)] [data_t 0.016] [optim_t 0.421] [lr 0.000166] [CE 2.997 (2.966)] [KD 0.000 (0.000)] 2024-10-13 04:19:02,967 - Train: 86.29% [323850/375300] [258.9/300.0] [batch_t 0.381 (0.428)] [data_t 0.016] [optim_t 0.366] [lr 0.000166] [CE 2.988 (2.901)] [KD 0.000 (0.000)] 2024-10-13 04:19:24,706 - Train: 86.30% [323900/375300] [258.9/300.0] [batch_t 0.405 (0.435)] [data_t 0.016] [optim_t 0.389] [lr 0.000165] [CE 3.113 (2.908)] [KD 0.000 (0.000)] 2024-10-13 04:19:46,902 - Train: 86.32% [323950/375300] [259.0/300.0] [batch_t 0.451 (0.444)] [data_t 0.016] [optim_t 0.436] [lr 0.000165] [CE 2.887 (2.918)] [KD 0.000 (0.000)] 2024-10-13 04:20:08,675 - Train: 86.33% [324000/375300] [259.0/300.0] [batch_t 0.315 (0.435)] [data_t 0.015] [optim_t 0.300] [lr 0.000165] [CE 2.859 (2.911)] [KD 0.000 (0.000)] 2024-10-13 04:20:33,683 - Test (net): 100.00% [50/50] [batch_t 0.148 (0.438)] [top1_cnt 40547] [top5_cnt 47885] [top_all 50000] 2024-10-13 04:20:33,684 - net: 81.094 (95.770) 2024-10-13 04:20:55,833 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.434)] [top1_cnt 41072] [top5_cnt 48111] [top_all 50000] 2024-10-13 04:20:55,833 - net_E: 82.144 (96.222) 2024-10-13 04:20:56,034 - Max [top1: 81.362 (epoch: 258)] [top1-ema: 82.178 (epoch: 254)] 2024-10-13 04:20:56,034 - ==> Total time: 1 day, 16:33:59 Eta: 6:25:18 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 04:21:18,725 - Train: 86.34% [324050/375300] [259.0/300.0] [batch_t 0.316 (0.508)] [data_t 0.016] [optim_t 0.301] [lr 0.000165] [CE 2.579 (2.936)] [KD 0.000 (0.000)] 2024-10-13 04:21:40,218 - Train: 86.36% [324100/375300] [259.1/300.0] [batch_t 0.363 (0.430)] [data_t 0.015] [optim_t 0.348] [lr 0.000164] [CE 2.920 (2.903)] [KD 0.000 (0.000)] 2024-10-13 04:22:02,340 - Train: 86.37% [324150/375300] [259.1/300.0] [batch_t 0.483 (0.442)] [data_t 0.016] [optim_t 0.468] [lr 0.000164] [CE 3.019 (2.866)] [KD 0.000 (0.000)] 2024-10-13 04:22:24,318 - Train: 86.38% [324200/375300] [259.2/300.0] [batch_t 0.434 (0.439)] [data_t 0.016] [optim_t 0.418] [lr 0.000164] [CE 2.816 (2.925)] [KD 0.000 (0.000)] 2024-10-13 04:22:45,005 - Train: 86.40% [324250/375300] [259.2/300.0] [batch_t 0.397 (0.414)] [data_t 0.015] [optim_t 0.381] [lr 0.000164] [CE 3.080 (2.891)] [KD 0.000 (0.000)] 2024-10-13 04:23:06,096 - Train: 86.41% [324300/375300] [259.2/300.0] [batch_t 0.541 (0.422)] [data_t 0.016] [optim_t 0.526] [lr 0.000163] [CE 3.020 (2.915)] [KD 0.000 (0.000)] 2024-10-13 04:23:26,438 - Train: 86.42% [324350/375300] [259.3/300.0] [batch_t 0.440 (0.407)] [data_t 0.016] [optim_t 0.424] [lr 0.000163] [CE 2.854 (2.936)] [KD 0.000 (0.000)] 2024-10-13 04:23:47,181 - Train: 86.44% [324400/375300] [259.3/300.0] [batch_t 0.405 (0.415)] [data_t 0.016] [optim_t 0.389] [lr 0.000163] [CE 3.029 (2.904)] [KD 0.000 (0.000)] 2024-10-13 04:24:09,155 - Train: 86.45% [324450/375300] [259.4/300.0] [batch_t 0.400 (0.439)] [data_t 0.015] [optim_t 0.384] [lr 0.000163] [CE 3.104 (2.906)] [KD 0.000 (0.000)] 2024-10-13 04:24:30,319 - Train: 86.46% [324500/375300] [259.4/300.0] [batch_t 0.388 (0.423)] [data_t 0.015] [optim_t 0.372] [lr 0.000162] [CE 2.897 (2.918)] [KD 0.000 (0.000)] 2024-10-13 04:24:52,366 - Train: 86.48% [324550/375300] [259.4/300.0] [batch_t 0.435 (0.441)] [data_t 0.016] [optim_t 0.420] [lr 0.000162] [CE 2.767 (2.914)] [KD 0.000 (0.000)] 2024-10-13 04:25:14,145 - Train: 86.49% [324600/375300] [259.5/300.0] [batch_t 0.435 (0.435)] [data_t 0.016] [optim_t 0.419] [lr 0.000162] [CE 2.839 (2.920)] [KD 0.000 (0.000)] 2024-10-13 04:25:36,596 - Train: 86.50% [324650/375300] [259.5/300.0] [batch_t 0.429 (0.449)] [data_t 0.015] [optim_t 0.413] [lr 0.000161] [CE 2.916 (2.947)] [KD 0.000 (0.000)] 2024-10-13 04:25:58,567 - Train: 86.52% [324700/375300] [259.6/300.0] [batch_t 0.440 (0.439)] [data_t 0.015] [optim_t 0.424] [lr 0.000161] [CE 2.716 (2.888)] [KD 0.000 (0.000)] 2024-10-13 04:26:19,997 - Train: 86.53% [324750/375300] [259.6/300.0] [batch_t 0.427 (0.428)] [data_t 0.015] [optim_t 0.412] [lr 0.000161] [CE 3.010 (2.913)] [KD 0.000 (0.000)] 2024-10-13 04:26:41,521 - Train: 86.54% [324800/375300] [259.6/300.0] [batch_t 0.397 (0.430)] [data_t 0.016] [optim_t 0.382] [lr 0.000161] [CE 2.862 (2.910)] [KD 0.000 (0.000)] 2024-10-13 04:27:04,057 - Train: 86.56% [324850/375300] [259.7/300.0] [batch_t 0.506 (0.451)] [data_t 0.015] [optim_t 0.490] [lr 0.000160] [CE 3.003 (2.950)] [KD 0.000 (0.000)] 2024-10-13 04:27:26,139 - Train: 86.57% [324900/375300] [259.7/300.0] [batch_t 0.451 (0.442)] [data_t 0.015] [optim_t 0.436] [lr 0.000160] [CE 2.955 (2.894)] [KD 0.000 (0.000)] 2024-10-13 04:27:47,757 - Train: 86.58% [324950/375300] [259.8/300.0] [batch_t 0.444 (0.432)] [data_t 0.016] [optim_t 0.428] [lr 0.000160] [CE 2.988 (2.947)] [KD 0.000 (0.000)] 2024-10-13 04:28:09,541 - Train: 86.60% [325000/375300] [259.8/300.0] [batch_t 0.465 (0.436)] [data_t 0.015] [optim_t 0.449] [lr 0.000160] [CE 2.842 (2.893)] [KD 0.000 (0.000)] 2024-10-13 04:28:31,676 - Train: 86.61% [325050/375300] [259.8/300.0] [batch_t 0.459 (0.443)] [data_t 0.015] [optim_t 0.443] [lr 0.000159] [CE 2.814 (2.893)] [KD 0.000 (0.000)] 2024-10-13 04:28:53,650 - Train: 86.62% [325100/375300] [259.9/300.0] [batch_t 0.310 (0.439)] [data_t 0.016] [optim_t 0.294] [lr 0.000159] [CE 2.923 (2.900)] [KD 0.000 (0.000)] 2024-10-13 04:29:15,138 - Train: 86.64% [325150/375300] [259.9/300.0] [batch_t 0.417 (0.430)] [data_t 0.016] [optim_t 0.402] [lr 0.000159] [CE 2.669 (2.892)] [KD 0.000 (0.000)] 2024-10-13 04:29:36,544 - Train: 86.65% [325200/375300] [260.0/300.0] [batch_t 0.326 (0.428)] [data_t 0.015] [optim_t 0.311] [lr 0.000159] [CE 2.586 (2.876)] [KD 0.000 (0.000)] 2024-10-13 04:29:57,624 - Train: 86.66% [325250/375300] [260.0/300.0] [batch_t 0.325 (0.421)] [data_t 0.015] [optim_t 0.310] [lr 0.000158] [CE 2.755 (2.920)] [KD 0.000 (0.000)] 2024-10-13 04:30:22,587 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.431)] [top1_cnt 40623] [top5_cnt 47891] [top_all 50000] 2024-10-13 04:30:22,588 - net: 81.246 (95.782) 2024-10-13 04:30:44,444 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.429)] [top1_cnt 41076] [top5_cnt 48106] [top_all 50000] 2024-10-13 04:30:44,444 - net_E: 82.152 (96.212) 2024-10-13 04:30:44,634 - Max [top1: 81.362 (epoch: 258)] [top1-ema: 82.178 (epoch: 254)] 2024-10-13 04:30:44,634 - ==> Total time: 1 day, 16:43:48 Eta: 6:15:58 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 04:31:06,913 - Train: 86.68% [325300/375300] [260.0/300.0] [batch_t 0.312 (0.517)] [data_t 0.015] [optim_t 0.296] [lr 0.000158] [CE 2.712 (2.892)] [KD 0.000 (0.000)] 2024-10-13 04:31:28,638 - Train: 86.69% [325350/375300] [260.1/300.0] [batch_t 0.434 (0.434)] [data_t 0.016] [optim_t 0.418] [lr 0.000158] [CE 3.036 (2.934)] [KD 0.000 (0.000)] 2024-10-13 04:31:50,044 - Train: 86.70% [325400/375300] [260.1/300.0] [batch_t 0.428 (0.428)] [data_t 0.016] [optim_t 0.412] [lr 0.000158] [CE 2.793 (2.913)] [KD 0.000 (0.000)] 2024-10-13 04:32:11,029 - Train: 86.72% [325450/375300] [260.2/300.0] [batch_t 0.398 (0.420)] [data_t 0.016] [optim_t 0.383] [lr 0.000157] [CE 3.111 (2.923)] [KD 0.000 (0.000)] 2024-10-13 04:32:32,664 - Train: 86.73% [325500/375300] [260.2/300.0] [batch_t 0.457 (0.433)] [data_t 0.016] [optim_t 0.441] [lr 0.000157] [CE 3.151 (2.895)] [KD 0.000 (0.000)] 2024-10-13 04:32:54,603 - Train: 86.74% [325550/375300] [260.2/300.0] [batch_t 0.391 (0.439)] [data_t 0.016] [optim_t 0.376] [lr 0.000157] [CE 2.945 (2.884)] [KD 0.000 (0.000)] 2024-10-13 04:33:16,272 - Train: 86.76% [325600/375300] [260.3/300.0] [batch_t 0.461 (0.433)] [data_t 0.016] [optim_t 0.446] [lr 0.000157] [CE 2.882 (2.905)] [KD 0.000 (0.000)] 2024-10-13 04:33:37,595 - Train: 86.77% [325650/375300] [260.3/300.0] [batch_t 0.470 (0.426)] [data_t 0.016] [optim_t 0.455] [lr 0.000156] [CE 2.618 (2.867)] [KD 0.000 (0.000)] 2024-10-13 04:33:59,069 - Train: 86.78% [325700/375300] [260.4/300.0] [batch_t 0.513 (0.429)] [data_t 0.016] [optim_t 0.497] [lr 0.000156] [CE 3.074 (2.882)] [KD 0.000 (0.000)] 2024-10-13 04:34:20,869 - Train: 86.80% [325750/375300] [260.4/300.0] [batch_t 0.403 (0.436)] [data_t 0.016] [optim_t 0.387] [lr 0.000156] [CE 2.771 (2.901)] [KD 0.000 (0.000)] 2024-10-13 04:34:42,821 - Train: 86.81% [325800/375300] [260.4/300.0] [batch_t 0.475 (0.439)] [data_t 0.181] [optim_t 0.294] [lr 0.000156] [CE 3.011 (2.922)] [KD 0.000 (0.000)] 2024-10-13 04:35:05,538 - Train: 86.82% [325850/375300] [260.5/300.0] [batch_t 0.373 (0.454)] [data_t 0.076] [optim_t 0.297] [lr 0.000155] [CE 3.092 (2.927)] [KD 0.000 (0.000)] 2024-10-13 04:35:26,682 - Train: 86.84% [325900/375300] [260.5/300.0] [batch_t 0.466 (0.423)] [data_t 0.166] [optim_t 0.301] [lr 0.000155] [CE 2.822 (2.911)] [KD 0.000 (0.000)] 2024-10-13 04:35:48,692 - Train: 86.85% [325950/375300] [260.6/300.0] [batch_t 0.475 (0.440)] [data_t 0.178] [optim_t 0.297] [lr 0.000155] [CE 3.152 (2.901)] [KD 0.000 (0.000)] 2024-10-13 04:36:10,454 - Train: 86.86% [326000/375300] [260.6/300.0] [batch_t 0.925 (0.435)] [data_t 0.628] [optim_t 0.297] [lr 0.000155] [CE 2.905 (2.927)] [KD 0.000 (0.000)] 2024-10-13 04:36:31,347 - Train: 86.88% [326050/375300] [260.6/300.0] [batch_t 0.477 (0.418)] [data_t 0.176] [optim_t 0.301] [lr 0.000154] [CE 2.627 (2.906)] [KD 0.000 (0.000)] 2024-10-13 04:36:52,566 - Train: 86.89% [326100/375300] [260.7/300.0] [batch_t 0.417 (0.424)] [data_t 0.123] [optim_t 0.294] [lr 0.000154] [CE 2.992 (2.938)] [KD 0.000 (0.000)] 2024-10-13 04:37:14,054 - Train: 86.90% [326150/375300] [260.7/300.0] [batch_t 0.407 (0.430)] [data_t 0.112] [optim_t 0.295] [lr 0.000154] [CE 3.057 (2.907)] [KD 0.000 (0.000)] 2024-10-13 04:37:35,493 - Train: 86.92% [326200/375300] [260.8/300.0] [batch_t 0.505 (0.429)] [data_t 0.211] [optim_t 0.294] [lr 0.000154] [CE 2.844 (2.934)] [KD 0.000 (0.000)] 2024-10-13 04:37:56,746 - Train: 86.93% [326250/375300] [260.8/300.0] [batch_t 0.420 (0.425)] [data_t 0.122] [optim_t 0.298] [lr 0.000153] [CE 3.157 (2.903)] [KD 0.000 (0.000)] 2024-10-13 04:38:19,378 - Train: 86.94% [326300/375300] [260.8/300.0] [batch_t 0.395 (0.453)] [data_t 0.016] [optim_t 0.379] [lr 0.000153] [CE 3.007 (2.911)] [KD 0.000 (0.000)] 2024-10-13 04:38:40,793 - Train: 86.96% [326350/375300] [260.9/300.0] [batch_t 0.432 (0.428)] [data_t 0.016] [optim_t 0.416] [lr 0.000153] [CE 3.072 (2.931)] [KD 0.000 (0.000)] 2024-10-13 04:39:02,525 - Train: 86.97% [326400/375300] [260.9/300.0] [batch_t 0.428 (0.434)] [data_t 0.016] [optim_t 0.412] [lr 0.000153] [CE 2.790 (2.934)] [KD 0.000 (0.000)] 2024-10-13 04:39:24,141 - Train: 86.98% [326450/375300] [261.0/300.0] [batch_t 0.487 (0.432)] [data_t 0.016] [optim_t 0.471] [lr 0.000152] [CE 2.902 (2.874)] [KD 0.000 (0.000)] 2024-10-13 04:39:45,314 - Train: 87.00% [326500/375300] [261.0/300.0] [batch_t 0.325 (0.423)] [data_t 0.015] [optim_t 0.309] [lr 0.000152] [CE 2.974 (2.926)] [KD 0.000 (0.000)] 2024-10-13 04:40:10,934 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.436)] [top1_cnt 40779] [top5_cnt 47904] [top_all 50000] 2024-10-13 04:40:10,935 - net: 81.558 (95.808) 2024-10-13 04:40:33,301 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.438)] [top1_cnt 41101] [top5_cnt 48114] [top_all 50000] 2024-10-13 04:40:33,302 - net_E: 82.202 (96.228) 2024-10-13 04:40:33,489 - Max [top1: 81.558 (epoch: 261)] [top1-ema: 82.202 (epoch: 261)] 2024-10-13 04:40:33,490 - ==> Total time: 1 day, 16:53:37 Eta: 6:06:38 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 04:40:56,441 - Train: 87.01% [326550/375300] [261.0/300.0] [batch_t 0.318 (0.427)] [data_t 0.015] [optim_t 0.302] [lr 0.000152] [CE 2.823 (2.860)] [KD 0.000 (0.000)] 2024-10-13 04:41:18,492 - Train: 87.02% [326600/375300] [261.1/300.0] [batch_t 0.468 (0.441)] [data_t 0.015] [optim_t 0.453] [lr 0.000152] [CE 2.829 (2.886)] [KD 0.000 (0.000)] 2024-10-13 04:41:41,253 - Train: 87.04% [326650/375300] [261.1/300.0] [batch_t 0.506 (0.455)] [data_t 0.016] [optim_t 0.490] [lr 0.000151] [CE 2.856 (2.889)] [KD 0.000 (0.000)] 2024-10-13 04:42:03,386 - Train: 87.05% [326700/375300] [261.2/300.0] [batch_t 0.402 (0.443)] [data_t 0.015] [optim_t 0.387] [lr 0.000151] [CE 3.023 (2.884)] [KD 0.000 (0.000)] 2024-10-13 04:42:25,566 - Train: 87.06% [326750/375300] [261.2/300.0] [batch_t 0.442 (0.444)] [data_t 0.016] [optim_t 0.426] [lr 0.000151] [CE 2.786 (2.894)] [KD 0.000 (0.000)] 2024-10-13 04:42:47,632 - Train: 87.08% [326800/375300] [261.2/300.0] [batch_t 0.416 (0.441)] [data_t 0.016] [optim_t 0.400] [lr 0.000151] [CE 3.159 (2.862)] [KD 0.000 (0.000)] 2024-10-13 04:43:09,029 - Train: 87.09% [326850/375300] [261.3/300.0] [batch_t 0.424 (0.428)] [data_t 0.016] [optim_t 0.408] [lr 0.000150] [CE 2.940 (2.888)] [KD 0.000 (0.000)] 2024-10-13 04:43:31,056 - Train: 87.10% [326900/375300] [261.3/300.0] [batch_t 0.451 (0.440)] [data_t 0.015] [optim_t 0.436] [lr 0.000150] [CE 2.789 (2.858)] [KD 0.000 (0.000)] 2024-10-13 04:43:52,985 - Train: 87.12% [326950/375300] [261.4/300.0] [batch_t 0.464 (0.438)] [data_t 0.016] [optim_t 0.448] [lr 0.000150] [CE 3.162 (2.934)] [KD 0.000 (0.000)] 2024-10-13 04:44:15,020 - Train: 87.13% [327000/375300] [261.4/300.0] [batch_t 0.421 (0.441)] [data_t 0.016] [optim_t 0.405] [lr 0.000150] [CE 2.866 (2.906)] [KD 0.000 (0.000)] 2024-10-13 04:44:37,157 - Train: 87.14% [327050/375300] [261.4/300.0] [batch_t 0.482 (0.443)] [data_t 0.016] [optim_t 0.466] [lr 0.000149] [CE 2.945 (2.917)] [KD 0.000 (0.000)] 2024-10-13 04:44:59,011 - Train: 87.16% [327100/375300] [261.5/300.0] [batch_t 0.447 (0.437)] [data_t 0.016] [optim_t 0.432] [lr 0.000149] [CE 3.021 (2.860)] [KD 0.000 (0.000)] 2024-10-13 04:45:21,256 - Train: 87.17% [327150/375300] [261.5/300.0] [batch_t 0.466 (0.445)] [data_t 0.015] [optim_t 0.451] [lr 0.000149] [CE 2.975 (2.938)] [KD 0.000 (0.000)] 2024-10-13 04:45:43,203 - Train: 87.18% [327200/375300] [261.6/300.0] [batch_t 0.449 (0.439)] [data_t 0.016] [optim_t 0.433] [lr 0.000149] [CE 2.954 (2.891)] [KD 0.000 (0.000)] 2024-10-13 04:46:05,263 - Train: 87.20% [327250/375300] [261.6/300.0] [batch_t 0.493 (0.441)] [data_t 0.015] [optim_t 0.478] [lr 0.000149] [CE 2.415 (2.911)] [KD 0.000 (0.000)] 2024-10-13 04:46:27,688 - Train: 87.21% [327300/375300] [261.6/300.0] [batch_t 0.474 (0.448)] [data_t 0.015] [optim_t 0.459] [lr 0.000148] [CE 3.164 (2.902)] [KD 0.000 (0.000)] 2024-10-13 04:46:50,126 - Train: 87.22% [327350/375300] [261.7/300.0] [batch_t 0.497 (0.449)] [data_t 0.016] [optim_t 0.481] [lr 0.000148] [CE 3.078 (2.886)] [KD 0.000 (0.000)] 2024-10-13 04:47:12,030 - Train: 87.24% [327400/375300] [261.7/300.0] [batch_t 0.429 (0.438)] [data_t 0.015] [optim_t 0.413] [lr 0.000148] [CE 3.045 (2.897)] [KD 0.000 (0.000)] 2024-10-13 04:47:34,152 - Train: 87.25% [327450/375300] [261.8/300.0] [batch_t 0.411 (0.442)] [data_t 0.016] [optim_t 0.395] [lr 0.000148] [CE 2.981 (2.933)] [KD 0.000 (0.000)] 2024-10-13 04:47:55,809 - Train: 87.26% [327500/375300] [261.8/300.0] [batch_t 0.464 (0.433)] [data_t 0.016] [optim_t 0.449] [lr 0.000147] [CE 3.066 (2.921)] [KD 0.000 (0.000)] 2024-10-13 04:48:17,455 - Train: 87.28% [327550/375300] [261.8/300.0] [batch_t 0.466 (0.433)] [data_t 0.016] [optim_t 0.450] [lr 0.000147] [CE 3.040 (2.896)] [KD 0.000 (0.000)] 2024-10-13 04:48:39,553 - Train: 87.29% [327600/375300] [261.9/300.0] [batch_t 0.432 (0.442)] [data_t 0.015] [optim_t 0.417] [lr 0.000147] [CE 2.819 (2.897)] [KD 0.000 (0.000)] 2024-10-13 04:49:01,287 - Train: 87.30% [327650/375300] [261.9/300.0] [batch_t 0.373 (0.435)] [data_t 0.016] [optim_t 0.357] [lr 0.000147] [CE 3.079 (2.840)] [KD 0.000 (0.000)] 2024-10-13 04:49:23,432 - Train: 87.32% [327700/375300] [262.0/300.0] [batch_t 0.503 (0.443)] [data_t 0.016] [optim_t 0.487] [lr 0.000146] [CE 3.156 (2.932)] [KD 0.000 (0.000)] 2024-10-13 04:49:45,404 - Train: 87.33% [327750/375300] [262.0/300.0] [batch_t 0.431 (0.439)] [data_t 0.015] [optim_t 0.416] [lr 0.000146] [CE 2.896 (2.899)] [KD 0.000 (0.000)] 2024-10-13 04:50:12,691 - Test (net): 100.00% [50/50] [batch_t 0.131 (0.464)] [top1_cnt 40792] [top5_cnt 47966] [top_all 50000] 2024-10-13 04:50:12,692 - net: 81.584 (95.932) 2024-10-13 04:50:34,884 - Test (net_E): 100.00% [50/50] [batch_t 0.153 (0.437)] [top1_cnt 41100] [top5_cnt 48110] [top_all 50000] 2024-10-13 04:50:34,885 - net_E: 82.200 (96.220) 2024-10-13 04:50:35,118 - Max [top1: 81.584 (epoch: 262)] [top1-ema: 82.202 (epoch: 261)] 2024-10-13 04:50:35,119 - ==> Total time: 1 day, 17:03:39 Eta: 5:57:19 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 04:50:57,062 - Train: 87.34% [327800/375300] [262.0/300.0] [batch_t 0.504 (0.455)] [data_t 0.016] [optim_t 0.488] [lr 0.000146] [CE 2.963 (2.883)] [KD 0.000 (0.000)] 2024-10-13 04:51:18,503 - Train: 87.36% [327850/375300] [262.1/300.0] [batch_t 0.442 (0.429)] [data_t 0.016] [optim_t 0.427] [lr 0.000146] [CE 3.003 (2.865)] [KD 0.000 (0.000)] 2024-10-13 04:51:41,274 - Train: 87.37% [327900/375300] [262.1/300.0] [batch_t 0.452 (0.455)] [data_t 0.016] [optim_t 0.436] [lr 0.000145] [CE 2.883 (2.911)] [KD 0.000 (0.000)] 2024-10-13 04:52:02,280 - Train: 87.38% [327950/375300] [262.2/300.0] [batch_t 0.430 (0.420)] [data_t 0.016] [optim_t 0.414] [lr 0.000145] [CE 2.952 (2.843)] [KD 0.000 (0.000)] 2024-10-13 04:52:23,543 - Train: 87.40% [328000/375300] [262.2/300.0] [batch_t 0.335 (0.425)] [data_t 0.016] [optim_t 0.319] [lr 0.000145] [CE 2.692 (2.856)] [KD 0.000 (0.000)] 2024-10-13 04:52:45,362 - Train: 87.41% [328050/375300] [262.2/300.0] [batch_t 0.438 (0.436)] [data_t 0.016] [optim_t 0.422] [lr 0.000145] [CE 3.151 (2.898)] [KD 0.000 (0.000)] 2024-10-13 04:53:06,872 - Train: 87.42% [328100/375300] [262.3/300.0] [batch_t 0.471 (0.430)] [data_t 0.016] [optim_t 0.455] [lr 0.000144] [CE 3.037 (2.882)] [KD 0.000 (0.000)] 2024-10-13 04:53:28,252 - Train: 87.44% [328150/375300] [262.3/300.0] [batch_t 0.466 (0.427)] [data_t 0.015] [optim_t 0.451] [lr 0.000144] [CE 3.013 (2.902)] [KD 0.000 (0.000)] 2024-10-13 04:53:49,477 - Train: 87.45% [328200/375300] [262.4/300.0] [batch_t 0.462 (0.424)] [data_t 0.016] [optim_t 0.447] [lr 0.000144] [CE 2.890 (2.824)] [KD 0.000 (0.000)] 2024-10-13 04:54:10,948 - Train: 87.46% [328250/375300] [262.4/300.0] [batch_t 0.445 (0.429)] [data_t 0.016] [optim_t 0.429] [lr 0.000144] [CE 3.022 (2.914)] [KD 0.000 (0.000)] 2024-10-13 04:54:32,932 - Train: 87.48% [328300/375300] [262.4/300.0] [batch_t 0.437 (0.440)] [data_t 0.016] [optim_t 0.422] [lr 0.000143] [CE 3.001 (2.874)] [KD 0.000 (0.000)] 2024-10-13 04:54:54,646 - Train: 87.49% [328350/375300] [262.5/300.0] [batch_t 0.386 (0.434)] [data_t 0.016] [optim_t 0.371] [lr 0.000143] [CE 2.997 (2.879)] [KD 0.000 (0.000)] 2024-10-13 04:55:16,548 - Train: 87.50% [328400/375300] [262.5/300.0] [batch_t 0.449 (0.438)] [data_t 0.016] [optim_t 0.433] [lr 0.000143] [CE 3.141 (2.936)] [KD 0.000 (0.000)] 2024-10-13 04:55:38,774 - Train: 87.52% [328450/375300] [262.5/300.0] [batch_t 0.465 (0.444)] [data_t 0.016] [optim_t 0.450] [lr 0.000143] [CE 3.007 (2.916)] [KD 0.000 (0.000)] 2024-10-13 04:56:00,890 - Train: 87.53% [328500/375300] [262.6/300.0] [batch_t 0.484 (0.442)] [data_t 0.016] [optim_t 0.468] [lr 0.000143] [CE 3.004 (2.873)] [KD 0.000 (0.000)] 2024-10-13 04:56:22,777 - Train: 87.54% [328550/375300] [262.6/300.0] [batch_t 0.437 (0.438)] [data_t 0.016] [optim_t 0.421] [lr 0.000142] [CE 3.005 (2.893)] [KD 0.000 (0.000)] 2024-10-13 04:56:44,471 - Train: 87.56% [328600/375300] [262.7/300.0] [batch_t 0.453 (0.434)] [data_t 0.015] [optim_t 0.437] [lr 0.000142] [CE 2.839 (2.915)] [KD 0.000 (0.000)] 2024-10-13 04:57:06,109 - Train: 87.57% [328650/375300] [262.7/300.0] [batch_t 0.412 (0.433)] [data_t 0.016] [optim_t 0.396] [lr 0.000142] [CE 3.127 (2.916)] [KD 0.000 (0.000)] 2024-10-13 04:57:27,745 - Train: 87.58% [328700/375300] [262.7/300.0] [batch_t 0.422 (0.433)] [data_t 0.016] [optim_t 0.406] [lr 0.000142] [CE 2.773 (2.893)] [KD 0.000 (0.000)] 2024-10-13 04:57:49,834 - Train: 87.60% [328750/375300] [262.8/300.0] [batch_t 0.435 (0.442)] [data_t 0.016] [optim_t 0.420] [lr 0.000141] [CE 3.105 (2.880)] [KD 0.000 (0.000)] 2024-10-13 04:58:11,805 - Train: 87.61% [328800/375300] [262.8/300.0] [batch_t 0.437 (0.439)] [data_t 0.016] [optim_t 0.421] [lr 0.000141] [CE 2.942 (2.899)] [KD 0.000 (0.000)] 2024-10-13 04:58:33,530 - Train: 87.62% [328850/375300] [262.9/300.0] [batch_t 0.400 (0.434)] [data_t 0.016] [optim_t 0.384] [lr 0.000141] [CE 3.119 (2.899)] [KD 0.000 (0.000)] 2024-10-13 04:58:54,847 - Train: 87.64% [328900/375300] [262.9/300.0] [batch_t 0.424 (0.426)] [data_t 0.015] [optim_t 0.409] [lr 0.000141] [CE 3.043 (2.898)] [KD 0.000 (0.000)] 2024-10-13 04:59:16,662 - Train: 87.65% [328950/375300] [262.9/300.0] [batch_t 0.430 (0.436)] [data_t 0.015] [optim_t 0.415] [lr 0.000140] [CE 3.017 (2.875)] [KD 0.000 (0.000)] 2024-10-13 04:59:38,722 - Train: 87.66% [329000/375300] [263.0/300.0] [batch_t 0.381 (0.441)] [data_t 0.015] [optim_t 0.366] [lr 0.000140] [CE 2.752 (2.901)] [KD 0.000 (0.000)] 2024-10-13 05:00:04,928 - Test (net): 100.00% [50/50] [batch_t 0.164 (0.435)] [top1_cnt 40724] [top5_cnt 47935] [top_all 50000] 2024-10-13 05:00:04,929 - net: 81.448 (95.870) 2024-10-13 05:00:28,436 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.462)] [top1_cnt 41105] [top5_cnt 48108] [top_all 50000] 2024-10-13 05:00:28,436 - net_E: 82.210 (96.216) 2024-10-13 05:00:28,594 - Max [top1: 81.584 (epoch: 262)] [top1-ema: 82.210 (epoch: 263)] 2024-10-13 05:00:28,595 - ==> Total time: 1 day, 17:13:32 Eta: 5:47:59 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 05:00:49,380 - Train: 87.68% [329050/375300] [263.0/300.0] [batch_t 0.477 (0.432)] [data_t 0.184] [optim_t 0.293] [lr 0.000140] [CE 2.621 (2.869)] [KD 0.000 (0.000)] 2024-10-13 05:01:11,228 - Train: 87.69% [329100/375300] [263.1/300.0] [batch_t 0.561 (0.437)] [data_t 0.015] [optim_t 0.545] [lr 0.000140] [CE 2.894 (2.904)] [KD 0.000 (0.000)] 2024-10-13 05:01:32,774 - Train: 87.70% [329150/375300] [263.1/300.0] [batch_t 0.317 (0.431)] [data_t 0.015] [optim_t 0.302] [lr 0.000139] [CE 2.712 (2.878)] [KD 0.000 (0.000)] 2024-10-13 05:01:55,315 - Train: 87.72% [329200/375300] [263.1/300.0] [batch_t 0.360 (0.451)] [data_t 0.016] [optim_t 0.344] [lr 0.000139] [CE 2.570 (2.910)] [KD 0.000 (0.000)] 2024-10-13 05:02:18,072 - Train: 87.73% [329250/375300] [263.2/300.0] [batch_t 0.488 (0.455)] [data_t 0.015] [optim_t 0.473] [lr 0.000139] [CE 3.083 (2.904)] [KD 0.000 (0.000)] 2024-10-13 05:02:40,790 - Train: 87.74% [329300/375300] [263.2/300.0] [batch_t 0.313 (0.454)] [data_t 0.015] [optim_t 0.298] [lr 0.000139] [CE 2.797 (2.847)] [KD 0.000 (0.000)] 2024-10-13 05:03:03,397 - Train: 87.76% [329350/375300] [263.3/300.0] [batch_t 0.443 (0.452)] [data_t 0.016] [optim_t 0.427] [lr 0.000139] [CE 2.988 (2.894)] [KD 0.000 (0.000)] 2024-10-13 05:03:25,617 - Train: 87.77% [329400/375300] [263.3/300.0] [batch_t 0.433 (0.444)] [data_t 0.016] [optim_t 0.417] [lr 0.000138] [CE 2.653 (2.908)] [KD 0.000 (0.000)] 2024-10-13 05:03:47,895 - Train: 87.78% [329450/375300] [263.3/300.0] [batch_t 0.473 (0.445)] [data_t 0.015] [optim_t 0.457] [lr 0.000138] [CE 2.768 (2.884)] [KD 0.000 (0.000)] 2024-10-13 05:04:09,773 - Train: 87.80% [329500/375300] [263.4/300.0] [batch_t 0.363 (0.437)] [data_t 0.015] [optim_t 0.348] [lr 0.000138] [CE 3.143 (2.847)] [KD 0.000 (0.000)] 2024-10-13 05:04:30,702 - Train: 87.81% [329550/375300] [263.4/300.0] [batch_t 0.412 (0.418)] [data_t 0.015] [optim_t 0.396] [lr 0.000138] [CE 3.107 (2.866)] [KD 0.000 (0.000)] 2024-10-13 05:04:53,433 - Train: 87.82% [329600/375300] [263.5/300.0] [batch_t 0.477 (0.455)] [data_t 0.016] [optim_t 0.462] [lr 0.000137] [CE 2.806 (2.893)] [KD 0.000 (0.000)] 2024-10-13 05:05:15,665 - Train: 87.84% [329650/375300] [263.5/300.0] [batch_t 0.402 (0.445)] [data_t 0.016] [optim_t 0.387] [lr 0.000137] [CE 3.114 (2.882)] [KD 0.000 (0.000)] 2024-10-13 05:05:37,735 - Train: 87.85% [329700/375300] [263.5/300.0] [batch_t 0.460 (0.441)] [data_t 0.015] [optim_t 0.445] [lr 0.000137] [CE 2.687 (2.931)] [KD 0.000 (0.000)] 2024-10-13 05:06:00,300 - Train: 87.86% [329750/375300] [263.6/300.0] [batch_t 0.554 (0.451)] [data_t 0.015] [optim_t 0.539] [lr 0.000137] [CE 2.853 (2.888)] [KD 0.000 (0.000)] 2024-10-13 05:06:22,958 - Train: 87.88% [329800/375300] [263.6/300.0] [batch_t 0.459 (0.453)] [data_t 0.016] [optim_t 0.443] [lr 0.000136] [CE 2.898 (2.907)] [KD 0.000 (0.000)] 2024-10-13 05:06:44,953 - Train: 87.89% [329850/375300] [263.7/300.0] [batch_t 0.402 (0.440)] [data_t 0.016] [optim_t 0.386] [lr 0.000136] [CE 2.889 (2.888)] [KD 0.000 (0.000)] 2024-10-13 05:07:06,483 - Train: 87.90% [329900/375300] [263.7/300.0] [batch_t 0.448 (0.430)] [data_t 0.016] [optim_t 0.432] [lr 0.000136] [CE 3.004 (2.889)] [KD 0.000 (0.000)] 2024-10-13 05:07:27,751 - Train: 87.92% [329950/375300] [263.7/300.0] [batch_t 0.464 (0.425)] [data_t 0.016] [optim_t 0.449] [lr 0.000136] [CE 2.876 (2.894)] [KD 0.000 (0.000)] 2024-10-13 05:07:49,560 - Train: 87.93% [330000/375300] [263.8/300.0] [batch_t 0.501 (0.436)] [data_t 0.016] [optim_t 0.485] [lr 0.000135] [CE 2.621 (2.887)] [KD 0.000 (0.000)] 2024-10-13 05:08:12,065 - Train: 87.94% [330050/375300] [263.8/300.0] [batch_t 0.435 (0.450)] [data_t 0.015] [optim_t 0.420] [lr 0.000135] [CE 2.536 (2.875)] [KD 0.000 (0.000)] 2024-10-13 05:08:33,832 - Train: 87.96% [330100/375300] [263.9/300.0] [batch_t 0.387 (0.435)] [data_t 0.016] [optim_t 0.371] [lr 0.000135] [CE 2.968 (2.862)] [KD 0.000 (0.000)] 2024-10-13 05:08:56,143 - Train: 87.97% [330150/375300] [263.9/300.0] [batch_t 0.319 (0.446)] [data_t 0.016] [optim_t 0.304] [lr 0.000135] [CE 2.520 (2.907)] [KD 0.000 (0.000)] 2024-10-13 05:09:18,146 - Train: 87.98% [330200/375300] [263.9/300.0] [batch_t 0.451 (0.440)] [data_t 0.015] [optim_t 0.435] [lr 0.000135] [CE 2.853 (2.911)] [KD 0.000 (0.000)] 2024-10-13 05:09:39,961 - Train: 88.00% [330250/375300] [264.0/300.0] [batch_t 0.445 (0.436)] [data_t 0.015] [optim_t 0.430] [lr 0.000134] [CE 3.096 (2.868)] [KD 0.000 (0.000)] 2024-10-13 05:10:06,504 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.428)] [top1_cnt 40819] [top5_cnt 47949] [top_all 50000] 2024-10-13 05:10:06,505 - net: 81.638 (95.898) 2024-10-13 05:10:28,708 - Test (net_E): 100.00% [50/50] [batch_t 0.155 (0.436)] [top1_cnt 41149] [top5_cnt 48104] [top_all 50000] 2024-10-13 05:10:28,708 - net_E: 82.298 (96.208) 2024-10-13 05:10:28,881 - Max [top1: 81.638 (epoch: 264)] [top1-ema: 82.298 (epoch: 264)] 2024-10-13 05:10:28,882 - ==> Total time: 1 day, 17:23:32 Eta: 5:38:39 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 05:10:51,215 - Train: 88.01% [330300/375300] [264.0/300.0] [batch_t 0.322 (0.428)] [data_t 0.016] [optim_t 0.307] [lr 0.000134] [CE 2.851 (2.869)] [KD 0.000 (0.000)] 2024-10-13 05:11:12,027 - Train: 88.02% [330350/375300] [264.1/300.0] [batch_t 0.437 (0.416)] [data_t 0.139] [optim_t 0.298] [lr 0.000134] [CE 2.922 (2.879)] [KD 0.000 (0.000)] 2024-10-13 05:11:33,421 - Train: 88.04% [330400/375300] [264.1/300.0] [batch_t 0.438 (0.428)] [data_t 0.016] [optim_t 0.422] [lr 0.000134] [CE 2.908 (2.875)] [KD 0.000 (0.000)] 2024-10-13 05:11:55,346 - Train: 88.05% [330450/375300] [264.1/300.0] [batch_t 0.420 (0.438)] [data_t 0.016] [optim_t 0.404] [lr 0.000133] [CE 2.563 (2.914)] [KD 0.000 (0.000)] 2024-10-13 05:12:16,966 - Train: 88.06% [330500/375300] [264.2/300.0] [batch_t 0.507 (0.432)] [data_t 0.016] [optim_t 0.492] [lr 0.000133] [CE 2.881 (2.878)] [KD 0.000 (0.000)] 2024-10-13 05:12:38,340 - Train: 88.08% [330550/375300] [264.2/300.0] [batch_t 0.466 (0.427)] [data_t 0.016] [optim_t 0.450] [lr 0.000133] [CE 3.007 (2.880)] [KD 0.000 (0.000)] 2024-10-13 05:13:00,080 - Train: 88.09% [330600/375300] [264.3/300.0] [batch_t 0.438 (0.435)] [data_t 0.016] [optim_t 0.422] [lr 0.000133] [CE 2.740 (2.869)] [KD 0.000 (0.000)] 2024-10-13 05:13:21,241 - Train: 88.10% [330650/375300] [264.3/300.0] [batch_t 0.460 (0.423)] [data_t 0.016] [optim_t 0.444] [lr 0.000133] [CE 3.115 (2.892)] [KD 0.000 (0.000)] 2024-10-13 05:13:42,477 - Train: 88.12% [330700/375300] [264.3/300.0] [batch_t 0.418 (0.425)] [data_t 0.016] [optim_t 0.402] [lr 0.000132] [CE 2.745 (2.941)] [KD 0.000 (0.000)] 2024-10-13 05:14:03,015 - Train: 88.13% [330750/375300] [264.4/300.0] [batch_t 0.335 (0.411)] [data_t 0.016] [optim_t 0.319] [lr 0.000132] [CE 2.592 (2.890)] [KD 0.000 (0.000)] 2024-10-13 05:14:24,772 - Train: 88.14% [330800/375300] [264.4/300.0] [batch_t 0.429 (0.435)] [data_t 0.016] [optim_t 0.413] [lr 0.000132] [CE 2.562 (2.876)] [KD 0.000 (0.000)] 2024-10-13 05:14:45,770 - Train: 88.16% [330850/375300] [264.5/300.0] [batch_t 0.418 (0.420)] [data_t 0.016] [optim_t 0.402] [lr 0.000132] [CE 2.872 (2.877)] [KD 0.000 (0.000)] 2024-10-13 05:15:07,172 - Train: 88.17% [330900/375300] [264.5/300.0] [batch_t 0.412 (0.428)] [data_t 0.016] [optim_t 0.396] [lr 0.000131] [CE 2.901 (2.870)] [KD 0.000 (0.000)] 2024-10-13 05:15:28,951 - Train: 88.18% [330950/375300] [264.5/300.0] [batch_t 0.428 (0.435)] [data_t 0.016] [optim_t 0.412] [lr 0.000131] [CE 3.006 (2.890)] [KD 0.000 (0.000)] 2024-10-13 05:15:50,587 - Train: 88.20% [331000/375300] [264.6/300.0] [batch_t 0.385 (0.433)] [data_t 0.016] [optim_t 0.369] [lr 0.000131] [CE 2.884 (2.918)] [KD 0.000 (0.000)] 2024-10-13 05:16:11,665 - Train: 88.21% [331050/375300] [264.6/300.0] [batch_t 0.363 (0.421)] [data_t 0.016] [optim_t 0.347] [lr 0.000131] [CE 2.997 (2.909)] [KD 0.000 (0.000)] 2024-10-13 05:16:33,049 - Train: 88.22% [331100/375300] [264.7/300.0] [batch_t 0.469 (0.428)] [data_t 0.017] [optim_t 0.453] [lr 0.000130] [CE 3.054 (2.875)] [KD 0.000 (0.000)] 2024-10-13 05:16:54,751 - Train: 88.24% [331150/375300] [264.7/300.0] [batch_t 0.431 (0.434)] [data_t 0.016] [optim_t 0.415] [lr 0.000130] [CE 2.768 (2.873)] [KD 0.000 (0.000)] 2024-10-13 05:17:16,912 - Train: 88.25% [331200/375300] [264.7/300.0] [batch_t 0.468 (0.443)] [data_t 0.016] [optim_t 0.452] [lr 0.000130] [CE 2.658 (2.909)] [KD 0.000 (0.000)] 2024-10-13 05:17:38,897 - Train: 88.26% [331250/375300] [264.8/300.0] [batch_t 0.421 (0.440)] [data_t 0.015] [optim_t 0.405] [lr 0.000130] [CE 2.658 (2.882)] [KD 0.000 (0.000)] 2024-10-13 05:18:01,986 - Train: 88.28% [331300/375300] [264.8/300.0] [batch_t 0.453 (0.462)] [data_t 0.015] [optim_t 0.438] [lr 0.000130] [CE 2.998 (2.876)] [KD 0.000 (0.000)] 2024-10-13 05:18:24,587 - Train: 88.29% [331350/375300] [264.9/300.0] [batch_t 0.458 (0.452)] [data_t 0.016] [optim_t 0.442] [lr 0.000129] [CE 3.060 (2.849)] [KD 0.000 (0.000)] 2024-10-13 05:18:46,522 - Train: 88.30% [331400/375300] [264.9/300.0] [batch_t 0.468 (0.439)] [data_t 0.016] [optim_t 0.452] [lr 0.000129] [CE 2.930 (2.900)] [KD 0.000 (0.000)] 2024-10-13 05:19:08,728 - Train: 88.32% [331450/375300] [264.9/300.0] [batch_t 0.399 (0.444)] [data_t 0.016] [optim_t 0.383] [lr 0.000129] [CE 3.016 (2.883)] [KD 0.000 (0.000)] 2024-10-13 05:19:31,288 - Train: 88.33% [331500/375300] [265.0/300.0] [batch_t 0.494 (0.451)] [data_t 0.031] [optim_t 0.462] [lr 0.000129] [CE 2.907 (2.893)] [KD 0.000 (0.000)] 2024-10-13 05:19:58,514 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.437)] [top1_cnt 40853] [top5_cnt 47984] [top_all 50000] 2024-10-13 05:19:58,515 - net: 81.706 (95.968) 2024-10-13 05:20:20,981 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.440)] [top1_cnt 41133] [top5_cnt 48110] [top_all 50000] 2024-10-13 05:20:20,982 - net_E: 82.266 (96.220) 2024-10-13 05:20:21,177 - Max [top1: 81.706 (epoch: 265)] [top1-ema: 82.298 (epoch: 264)] 2024-10-13 05:20:21,178 - ==> Total time: 1 day, 17:33:25 Eta: 5:29:19 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 05:20:41,720 - Train: 88.34% [331550/375300] [265.0/300.0] [batch_t 0.562 (0.438)] [data_t 0.016] [optim_t 0.547] [lr 0.000128] [CE 2.515 (2.868)] [KD 0.000 (0.000)] 2024-10-13 05:21:03,949 - Train: 88.36% [331600/375300] [265.1/300.0] [batch_t 0.313 (0.444)] [data_t 0.016] [optim_t 0.298] [lr 0.000128] [CE 2.987 (2.902)] [KD 0.000 (0.000)] 2024-10-13 05:21:25,605 - Train: 88.37% [331650/375300] [265.1/300.0] [batch_t 0.543 (0.433)] [data_t 0.015] [optim_t 0.528] [lr 0.000128] [CE 2.943 (2.866)] [KD 0.000 (0.000)] 2024-10-13 05:21:46,930 - Train: 88.38% [331700/375300] [265.1/300.0] [batch_t 0.427 (0.426)] [data_t 0.016] [optim_t 0.412] [lr 0.000128] [CE 2.832 (2.827)] [KD 0.000 (0.000)] 2024-10-13 05:22:09,492 - Train: 88.40% [331750/375300] [265.2/300.0] [batch_t 0.427 (0.451)] [data_t 0.016] [optim_t 0.411] [lr 0.000128] [CE 2.934 (2.894)] [KD 0.000 (0.000)] 2024-10-13 05:22:31,308 - Train: 88.41% [331800/375300] [265.2/300.0] [batch_t 0.444 (0.436)] [data_t 0.015] [optim_t 0.429] [lr 0.000127] [CE 2.881 (2.874)] [KD 0.000 (0.000)] 2024-10-13 05:22:52,392 - Train: 88.42% [331850/375300] [265.3/300.0] [batch_t 0.445 (0.422)] [data_t 0.015] [optim_t 0.429] [lr 0.000127] [CE 2.852 (2.919)] [KD 0.000 (0.000)] 2024-10-13 05:23:13,546 - Train: 88.44% [331900/375300] [265.3/300.0] [batch_t 0.419 (0.423)] [data_t 0.016] [optim_t 0.403] [lr 0.000127] [CE 2.893 (2.882)] [KD 0.000 (0.000)] 2024-10-13 05:23:35,205 - Train: 88.45% [331950/375300] [265.3/300.0] [batch_t 0.468 (0.433)] [data_t 0.016] [optim_t 0.452] [lr 0.000127] [CE 2.453 (2.892)] [KD 0.000 (0.000)] 2024-10-13 05:23:57,055 - Train: 88.46% [332000/375300] [265.4/300.0] [batch_t 0.431 (0.437)] [data_t 0.015] [optim_t 0.416] [lr 0.000126] [CE 2.489 (2.876)] [KD 0.000 (0.000)] 2024-10-13 05:24:19,342 - Train: 88.48% [332050/375300] [265.4/300.0] [batch_t 0.424 (0.446)] [data_t 0.016] [optim_t 0.408] [lr 0.000126] [CE 2.910 (2.861)] [KD 0.000 (0.000)] 2024-10-13 05:24:41,762 - Train: 88.49% [332100/375300] [265.5/300.0] [batch_t 0.450 (0.448)] [data_t 0.016] [optim_t 0.434] [lr 0.000126] [CE 2.746 (2.842)] [KD 0.000 (0.000)] 2024-10-13 05:25:04,019 - Train: 88.50% [332150/375300] [265.5/300.0] [batch_t 0.483 (0.445)] [data_t 0.016] [optim_t 0.467] [lr 0.000126] [CE 2.756 (2.869)] [KD 0.000 (0.000)] 2024-10-13 05:25:26,370 - Train: 88.52% [332200/375300] [265.5/300.0] [batch_t 0.411 (0.447)] [data_t 0.015] [optim_t 0.396] [lr 0.000126] [CE 2.990 (2.887)] [KD 0.000 (0.000)] 2024-10-13 05:25:48,594 - Train: 88.53% [332250/375300] [265.6/300.0] [batch_t 0.494 (0.444)] [data_t 0.016] [optim_t 0.478] [lr 0.000125] [CE 2.758 (2.843)] [KD 0.000 (0.000)] 2024-10-13 05:26:10,737 - Train: 88.54% [332300/375300] [265.6/300.0] [batch_t 0.439 (0.443)] [data_t 0.016] [optim_t 0.424] [lr 0.000125] [CE 2.644 (2.875)] [KD 0.000 (0.000)] 2024-10-13 05:26:32,667 - Train: 88.56% [332350/375300] [265.7/300.0] [batch_t 0.483 (0.438)] [data_t 0.015] [optim_t 0.467] [lr 0.000125] [CE 3.077 (2.868)] [KD 0.000 (0.000)] 2024-10-13 05:26:54,866 - Train: 88.57% [332400/375300] [265.7/300.0] [batch_t 0.454 (0.444)] [data_t 0.016] [optim_t 0.439] [lr 0.000125] [CE 2.863 (2.866)] [KD 0.000 (0.000)] 2024-10-13 05:27:17,232 - Train: 88.58% [332450/375300] [265.7/300.0] [batch_t 0.465 (0.447)] [data_t 0.015] [optim_t 0.450] [lr 0.000125] [CE 2.950 (2.889)] [KD 0.000 (0.000)] 2024-10-13 05:27:39,657 - Train: 88.60% [332500/375300] [265.8/300.0] [batch_t 0.479 (0.448)] [data_t 0.016] [optim_t 0.463] [lr 0.000124] [CE 2.887 (2.894)] [KD 0.000 (0.000)] 2024-10-13 05:28:02,335 - Train: 88.61% [332550/375300] [265.8/300.0] [batch_t 0.492 (0.453)] [data_t 0.016] [optim_t 0.476] [lr 0.000124] [CE 2.855 (2.875)] [KD 0.000 (0.000)] 2024-10-13 05:28:24,277 - Train: 88.62% [332600/375300] [265.9/300.0] [batch_t 0.315 (0.439)] [data_t 0.016] [optim_t 0.299] [lr 0.000124] [CE 2.830 (2.907)] [KD 0.000 (0.000)] 2024-10-13 05:28:46,043 - Train: 88.64% [332650/375300] [265.9/300.0] [batch_t 0.480 (0.435)] [data_t 0.016] [optim_t 0.464] [lr 0.000124] [CE 3.065 (2.906)] [KD 0.000 (0.000)] 2024-10-13 05:29:07,917 - Train: 88.65% [332700/375300] [265.9/300.0] [batch_t 0.464 (0.437)] [data_t 0.016] [optim_t 0.448] [lr 0.000123] [CE 3.054 (2.902)] [KD 0.000 (0.000)] 2024-10-13 05:29:30,293 - Train: 88.66% [332750/375300] [266.0/300.0] [batch_t 0.402 (0.447)] [data_t 0.016] [optim_t 0.386] [lr 0.000123] [CE 2.944 (2.884)] [KD 0.000 (0.000)] 2024-10-13 05:29:57,943 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.439)] [top1_cnt 40701] [top5_cnt 47879] [top_all 50000] 2024-10-13 05:29:57,944 - net: 81.402 (95.758) 2024-10-13 05:30:19,399 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.420)] [top1_cnt 41108] [top5_cnt 48103] [top_all 50000] 2024-10-13 05:30:19,399 - net_E: 82.216 (96.206) 2024-10-13 05:30:19,572 - Max [top1: 81.706 (epoch: 265)] [top1-ema: 82.298 (epoch: 264)] 2024-10-13 05:30:19,572 - ==> Total time: 1 day, 17:43:23 Eta: 5:19:58 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 05:30:38,676 - Train: 88.68% [332800/375300] [266.0/300.0] [batch_t 0.315 (0.516)] [data_t 0.016] [optim_t 0.300] [lr 0.000123] [CE 2.876 (2.812)] [KD 0.000 (0.000)] 2024-10-13 05:31:00,310 - Train: 88.69% [332850/375300] [266.1/300.0] [batch_t 0.455 (0.432)] [data_t 0.016] [optim_t 0.440] [lr 0.000123] [CE 2.778 (2.850)] [KD 0.000 (0.000)] 2024-10-13 05:31:21,939 - Train: 88.70% [332900/375300] [266.1/300.0] [batch_t 0.488 (0.432)] [data_t 0.016] [optim_t 0.472] [lr 0.000123] [CE 2.927 (2.853)] [KD 0.000 (0.000)] 2024-10-13 05:31:43,830 - Train: 88.72% [332950/375300] [266.1/300.0] [batch_t 0.436 (0.438)] [data_t 0.016] [optim_t 0.421] [lr 0.000122] [CE 2.768 (2.867)] [KD 0.000 (0.000)] 2024-10-13 05:32:05,237 - Train: 88.73% [333000/375300] [266.2/300.0] [batch_t 0.437 (0.428)] [data_t 0.016] [optim_t 0.421] [lr 0.000122] [CE 2.781 (2.873)] [KD 0.000 (0.000)] 2024-10-13 05:32:26,850 - Train: 88.74% [333050/375300] [266.2/300.0] [batch_t 0.412 (0.432)] [data_t 0.016] [optim_t 0.396] [lr 0.000122] [CE 2.833 (2.843)] [KD 0.000 (0.000)] 2024-10-13 05:32:48,503 - Train: 88.76% [333100/375300] [266.3/300.0] [batch_t 0.426 (0.433)] [data_t 0.016] [optim_t 0.410] [lr 0.000122] [CE 3.006 (2.897)] [KD 0.000 (0.000)] 2024-10-13 05:33:09,863 - Train: 88.77% [333150/375300] [266.3/300.0] [batch_t 0.503 (0.427)] [data_t 0.016] [optim_t 0.487] [lr 0.000121] [CE 2.836 (2.903)] [KD 0.000 (0.000)] 2024-10-13 05:33:31,186 - Train: 88.78% [333200/375300] [266.3/300.0] [batch_t 0.401 (0.426)] [data_t 0.016] [optim_t 0.385] [lr 0.000121] [CE 2.652 (2.840)] [KD 0.000 (0.000)] 2024-10-13 05:33:52,859 - Train: 88.80% [333250/375300] [266.4/300.0] [batch_t 0.445 (0.433)] [data_t 0.016] [optim_t 0.429] [lr 0.000121] [CE 2.817 (2.860)] [KD 0.000 (0.000)] 2024-10-13 05:34:13,973 - Train: 88.81% [333300/375300] [266.4/300.0] [batch_t 0.421 (0.422)] [data_t 0.016] [optim_t 0.405] [lr 0.000121] [CE 2.909 (2.890)] [KD 0.000 (0.000)] 2024-10-13 05:34:35,399 - Train: 88.82% [333350/375300] [266.5/300.0] [batch_t 0.489 (0.428)] [data_t 0.016] [optim_t 0.473] [lr 0.000121] [CE 2.769 (2.870)] [KD 0.000 (0.000)] 2024-10-13 05:34:56,574 - Train: 88.84% [333400/375300] [266.5/300.0] [batch_t 0.428 (0.423)] [data_t 0.016] [optim_t 0.413] [lr 0.000120] [CE 2.963 (2.871)] [KD 0.000 (0.000)] 2024-10-13 05:35:17,982 - Train: 88.85% [333450/375300] [266.5/300.0] [batch_t 0.438 (0.428)] [data_t 0.016] [optim_t 0.422] [lr 0.000120] [CE 2.779 (2.873)] [KD 0.000 (0.000)] 2024-10-13 05:35:39,667 - Train: 88.86% [333500/375300] [266.6/300.0] [batch_t 0.445 (0.434)] [data_t 0.016] [optim_t 0.429] [lr 0.000120] [CE 3.217 (2.851)] [KD 0.000 (0.000)] 2024-10-13 05:36:00,877 - Train: 88.88% [333550/375300] [266.6/300.0] [batch_t 0.419 (0.424)] [data_t 0.016] [optim_t 0.404] [lr 0.000120] [CE 2.547 (2.871)] [KD 0.000 (0.000)] 2024-10-13 05:36:21,988 - Train: 88.89% [333600/375300] [266.7/300.0] [batch_t 0.409 (0.422)] [data_t 0.016] [optim_t 0.393] [lr 0.000120] [CE 2.791 (2.864)] [KD 0.000 (0.000)] 2024-10-13 05:36:43,362 - Train: 88.90% [333650/375300] [266.7/300.0] [batch_t 0.496 (0.427)] [data_t 0.015] [optim_t 0.480] [lr 0.000119] [CE 2.639 (2.866)] [KD 0.000 (0.000)] 2024-10-13 05:37:04,953 - Train: 88.92% [333700/375300] [266.7/300.0] [batch_t 0.433 (0.432)] [data_t 0.016] [optim_t 0.418] [lr 0.000119] [CE 2.784 (2.873)] [KD 0.000 (0.000)] 2024-10-13 05:37:27,548 - Train: 88.93% [333750/375300] [266.8/300.0] [batch_t 0.485 (0.452)] [data_t 0.016] [optim_t 0.469] [lr 0.000119] [CE 3.000 (2.867)] [KD 0.000 (0.000)] 2024-10-13 05:37:50,055 - Train: 88.94% [333800/375300] [266.8/300.0] [batch_t 0.453 (0.450)] [data_t 0.015] [optim_t 0.438] [lr 0.000119] [CE 2.709 (2.867)] [KD 0.000 (0.000)] 2024-10-13 05:38:11,436 - Train: 88.96% [333850/375300] [266.9/300.0] [batch_t 0.408 (0.428)] [data_t 0.016] [optim_t 0.392] [lr 0.000119] [CE 3.065 (2.852)] [KD 0.000 (0.000)] 2024-10-13 05:38:32,875 - Train: 88.97% [333900/375300] [266.9/300.0] [batch_t 0.431 (0.429)] [data_t 0.015] [optim_t 0.416] [lr 0.000118] [CE 2.888 (2.872)] [KD 0.000 (0.000)] 2024-10-13 05:38:53,642 - Train: 88.98% [333950/375300] [266.9/300.0] [batch_t 0.407 (0.415)] [data_t 0.015] [optim_t 0.391] [lr 0.000118] [CE 2.692 (2.869)] [KD 0.000 (0.000)] 2024-10-13 05:39:15,677 - Train: 89.00% [334000/375300] [267.0/300.0] [batch_t 0.474 (0.441)] [data_t 0.015] [optim_t 0.459] [lr 0.000118] [CE 2.901 (2.895)] [KD 0.000 (0.000)] 2024-10-13 05:39:44,185 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.450)] [top1_cnt 40693] [top5_cnt 47950] [top_all 50000] 2024-10-13 05:39:44,185 - net: 81.386 (95.900) 2024-10-13 05:40:05,651 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.421)] [top1_cnt 41120] [top5_cnt 48097] [top_all 50000] 2024-10-13 05:40:05,652 - net_E: 82.240 (96.194) 2024-10-13 05:40:05,814 - Max [top1: 81.706 (epoch: 265)] [top1-ema: 82.298 (epoch: 264)] 2024-10-13 05:40:05,814 - ==> Total time: 1 day, 17:53:09 Eta: 5:10:36 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 05:40:24,918 - Train: 89.01% [334050/375300] [267.0/300.0] [batch_t 0.974 (0.523)] [data_t 0.015] [optim_t 0.958] [lr 0.000118] [CE 3.091 (2.873)] [KD 0.000 (0.000)] 2024-10-13 05:40:46,739 - Train: 89.02% [334100/375300] [267.1/300.0] [batch_t 0.432 (0.436)] [data_t 0.015] [optim_t 0.417] [lr 0.000117] [CE 2.877 (2.869)] [KD 0.000 (0.000)] 2024-10-13 05:41:07,854 - Train: 89.04% [334150/375300] [267.1/300.0] [batch_t 0.431 (0.422)] [data_t 0.016] [optim_t 0.415] [lr 0.000117] [CE 2.824 (2.905)] [KD 0.000 (0.000)] 2024-10-13 05:41:29,701 - Train: 89.05% [334200/375300] [267.1/300.0] [batch_t 0.466 (0.437)] [data_t 0.016] [optim_t 0.450] [lr 0.000117] [CE 2.731 (2.847)] [KD 0.000 (0.000)] 2024-10-13 05:41:51,383 - Train: 89.06% [334250/375300] [267.2/300.0] [batch_t 0.405 (0.434)] [data_t 0.016] [optim_t 0.390] [lr 0.000117] [CE 3.137 (2.859)] [KD 0.000 (0.000)] 2024-10-13 05:42:13,503 - Train: 89.08% [334300/375300] [267.2/300.0] [batch_t 0.414 (0.442)] [data_t 0.016] [optim_t 0.398] [lr 0.000117] [CE 3.088 (2.861)] [KD 0.000 (0.000)] 2024-10-13 05:42:35,471 - Train: 89.09% [334350/375300] [267.3/300.0] [batch_t 0.440 (0.439)] [data_t 0.016] [optim_t 0.425] [lr 0.000116] [CE 2.866 (2.872)] [KD 0.000 (0.000)] 2024-10-13 05:42:56,811 - Train: 89.10% [334400/375300] [267.3/300.0] [batch_t 0.386 (0.427)] [data_t 0.016] [optim_t 0.370] [lr 0.000116] [CE 2.736 (2.885)] [KD 0.000 (0.000)] 2024-10-13 05:43:18,058 - Train: 89.12% [334450/375300] [267.3/300.0] [batch_t 0.423 (0.425)] [data_t 0.016] [optim_t 0.407] [lr 0.000116] [CE 2.788 (2.846)] [KD 0.000 (0.000)] 2024-10-13 05:43:39,705 - Train: 89.13% [334500/375300] [267.4/300.0] [batch_t 0.450 (0.433)] [data_t 0.015] [optim_t 0.434] [lr 0.000116] [CE 2.846 (2.862)] [KD 0.000 (0.000)] 2024-10-13 05:44:01,466 - Train: 89.14% [334550/375300] [267.4/300.0] [batch_t 0.406 (0.435)] [data_t 0.016] [optim_t 0.390] [lr 0.000116] [CE 2.825 (2.891)] [KD 0.000 (0.000)] 2024-10-13 05:44:23,588 - Train: 89.16% [334600/375300] [267.5/300.0] [batch_t 0.429 (0.442)] [data_t 0.016] [optim_t 0.413] [lr 0.000115] [CE 3.143 (2.890)] [KD 0.000 (0.000)] 2024-10-13 05:44:45,455 - Train: 89.17% [334650/375300] [267.5/300.0] [batch_t 0.481 (0.437)] [data_t 0.015] [optim_t 0.465] [lr 0.000115] [CE 2.578 (2.832)] [KD 0.000 (0.000)] 2024-10-13 05:45:07,311 - Train: 89.18% [334700/375300] [267.5/300.0] [batch_t 0.451 (0.437)] [data_t 0.016] [optim_t 0.436] [lr 0.000115] [CE 2.728 (2.853)] [KD 0.000 (0.000)] 2024-10-13 05:45:29,309 - Train: 89.20% [334750/375300] [267.6/300.0] [batch_t 0.463 (0.440)] [data_t 0.015] [optim_t 0.447] [lr 0.000115] [CE 2.956 (2.892)] [KD 0.000 (0.000)] 2024-10-13 05:45:51,011 - Train: 89.21% [334800/375300] [267.6/300.0] [batch_t 0.379 (0.434)] [data_t 0.016] [optim_t 0.363] [lr 0.000115] [CE 2.644 (2.842)] [KD 0.000 (0.000)] 2024-10-13 05:46:11,075 - Train: 89.22% [334850/375300] [267.7/300.0] [batch_t 0.437 (0.401)] [data_t 0.015] [optim_t 0.421] [lr 0.000114] [CE 2.766 (2.863)] [KD 0.000 (0.000)] 2024-10-13 05:46:31,519 - Train: 89.24% [334900/375300] [267.7/300.0] [batch_t 0.382 (0.409)] [data_t 0.016] [optim_t 0.366] [lr 0.000114] [CE 3.108 (2.853)] [KD 0.000 (0.000)] 2024-10-13 05:46:53,206 - Train: 89.25% [334950/375300] [267.7/300.0] [batch_t 0.465 (0.434)] [data_t 0.015] [optim_t 0.450] [lr 0.000114] [CE 2.904 (2.871)] [KD 0.000 (0.000)] 2024-10-13 05:47:15,228 - Train: 89.26% [335000/375300] [267.8/300.0] [batch_t 0.479 (0.440)] [data_t 0.015] [optim_t 0.463] [lr 0.000114] [CE 2.754 (2.867)] [KD 0.000 (0.000)] 2024-10-13 05:47:36,439 - Train: 89.28% [335050/375300] [267.8/300.0] [batch_t 0.419 (0.424)] [data_t 0.015] [optim_t 0.403] [lr 0.000113] [CE 3.116 (2.882)] [KD 0.000 (0.000)] 2024-10-13 05:47:57,276 - Train: 89.29% [335100/375300] [267.9/300.0] [batch_t 0.393 (0.417)] [data_t 0.015] [optim_t 0.378] [lr 0.000113] [CE 2.962 (2.875)] [KD 0.000 (0.000)] 2024-10-13 05:48:18,524 - Train: 89.30% [335150/375300] [267.9/300.0] [batch_t 0.436 (0.425)] [data_t 0.016] [optim_t 0.420] [lr 0.000113] [CE 3.103 (2.862)] [KD 0.000 (0.000)] 2024-10-13 05:48:39,416 - Train: 89.32% [335200/375300] [267.9/300.0] [batch_t 0.412 (0.418)] [data_t 0.016] [optim_t 0.396] [lr 0.000113] [CE 2.939 (2.872)] [KD 0.000 (0.000)] 2024-10-13 05:49:01,217 - Train: 89.33% [335250/375300] [268.0/300.0] [batch_t 0.496 (0.436)] [data_t 0.016] [optim_t 0.480] [lr 0.000113] [CE 2.682 (2.868)] [KD 0.000 (0.000)] 2024-10-13 05:49:30,174 - Test (net): 100.00% [50/50] [batch_t 0.128 (0.439)] [top1_cnt 40822] [top5_cnt 47948] [top_all 50000] 2024-10-13 05:49:30,174 - net: 81.644 (95.896) 2024-10-13 05:49:51,323 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.413)] [top1_cnt 41133] [top5_cnt 48103] [top_all 50000] 2024-10-13 05:49:51,324 - net_E: 82.266 (96.206) 2024-10-13 05:49:51,481 - Max [top1: 81.706 (epoch: 265)] [top1-ema: 82.298 (epoch: 264)] 2024-10-13 05:49:51,482 - ==> Total time: 1 day, 18:02:55 Eta: 5:01:14 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 05:50:10,315 - Train: 89.34% [335300/375300] [268.0/300.0] [batch_t 0.370 (0.537)] [data_t 0.071] [optim_t 0.299] [lr 0.000112] [CE 2.843 (2.889)] [KD 0.000 (0.000)] 2024-10-13 05:50:33,198 - Train: 89.36% [335350/375300] [268.1/300.0] [batch_t 0.469 (0.458)] [data_t 0.172] [optim_t 0.297] [lr 0.000112] [CE 2.902 (2.858)] [KD 0.000 (0.000)] 2024-10-13 05:50:55,416 - Train: 89.37% [335400/375300] [268.1/300.0] [batch_t 0.484 (0.444)] [data_t 0.192] [optim_t 0.292] [lr 0.000112] [CE 3.110 (2.884)] [KD 0.000 (0.000)] 2024-10-13 05:51:17,579 - Train: 89.38% [335450/375300] [268.1/300.0] [batch_t 0.453 (0.443)] [data_t 0.155] [optim_t 0.298] [lr 0.000112] [CE 2.757 (2.807)] [KD 0.000 (0.000)] 2024-10-13 05:51:39,186 - Train: 89.40% [335500/375300] [268.2/300.0] [batch_t 0.474 (0.432)] [data_t 0.174] [optim_t 0.300] [lr 0.000112] [CE 2.793 (2.847)] [KD 0.000 (0.000)] 2024-10-13 05:52:00,184 - Train: 89.41% [335550/375300] [268.2/300.0] [batch_t 0.321 (0.420)] [data_t 0.015] [optim_t 0.305] [lr 0.000111] [CE 2.788 (2.843)] [KD 0.000 (0.000)] 2024-10-13 05:52:22,197 - Train: 89.42% [335600/375300] [268.3/300.0] [batch_t 0.320 (0.440)] [data_t 0.015] [optim_t 0.305] [lr 0.000111] [CE 3.194 (2.880)] [KD 0.000 (0.000)] 2024-10-13 05:52:43,871 - Train: 89.44% [335650/375300] [268.3/300.0] [batch_t 0.464 (0.433)] [data_t 0.167] [optim_t 0.297] [lr 0.000111] [CE 3.020 (2.864)] [KD 0.000 (0.000)] 2024-10-13 05:53:06,170 - Train: 89.45% [335700/375300] [268.3/300.0] [batch_t 0.440 (0.446)] [data_t 0.148] [optim_t 0.292] [lr 0.000111] [CE 2.878 (2.867)] [KD 0.000 (0.000)] 2024-10-13 05:53:27,958 - Train: 89.46% [335750/375300] [268.4/300.0] [batch_t 0.434 (0.436)] [data_t 0.016] [optim_t 0.418] [lr 0.000111] [CE 2.852 (2.845)] [KD 0.000 (0.000)] 2024-10-13 05:53:50,025 - Train: 89.48% [335800/375300] [268.4/300.0] [batch_t 0.442 (0.441)] [data_t 0.016] [optim_t 0.427] [lr 0.000110] [CE 2.934 (2.838)] [KD 0.000 (0.000)] 2024-10-13 05:54:11,833 - Train: 89.49% [335850/375300] [268.5/300.0] [batch_t 0.483 (0.436)] [data_t 0.016] [optim_t 0.467] [lr 0.000110] [CE 2.949 (2.878)] [KD 0.000 (0.000)] 2024-10-13 05:54:33,994 - Train: 89.50% [335900/375300] [268.5/300.0] [batch_t 0.408 (0.443)] [data_t 0.015] [optim_t 0.393] [lr 0.000110] [CE 2.741 (2.824)] [KD 0.000 (0.000)] 2024-10-13 05:54:56,050 - Train: 89.52% [335950/375300] [268.5/300.0] [batch_t 0.315 (0.441)] [data_t 0.016] [optim_t 0.300] [lr 0.000110] [CE 2.695 (2.890)] [KD 0.000 (0.000)] 2024-10-13 05:55:17,042 - Train: 89.53% [336000/375300] [268.6/300.0] [batch_t 0.403 (0.420)] [data_t 0.016] [optim_t 0.387] [lr 0.000110] [CE 2.697 (2.859)] [KD 0.000 (0.000)] 2024-10-13 05:55:38,064 - Train: 89.54% [336050/375300] [268.6/300.0] [batch_t 0.424 (0.420)] [data_t 0.016] [optim_t 0.409] [lr 0.000109] [CE 2.762 (2.887)] [KD 0.000 (0.000)] 2024-10-13 05:55:59,829 - Train: 89.56% [336100/375300] [268.7/300.0] [batch_t 0.542 (0.435)] [data_t 0.016] [optim_t 0.526] [lr 0.000109] [CE 2.934 (2.875)] [KD 0.000 (0.000)] 2024-10-13 05:56:21,880 - Train: 89.57% [336150/375300] [268.7/300.0] [batch_t 0.493 (0.441)] [data_t 0.016] [optim_t 0.477] [lr 0.000109] [CE 2.904 (2.848)] [KD 0.000 (0.000)] 2024-10-13 05:56:44,563 - Train: 89.58% [336200/375300] [268.7/300.0] [batch_t 0.401 (0.454)] [data_t 0.015] [optim_t 0.385] [lr 0.000109] [CE 2.852 (2.891)] [KD 0.000 (0.000)] 2024-10-13 05:57:06,222 - Train: 89.59% [336250/375300] [268.8/300.0] [batch_t 0.342 (0.433)] [data_t 0.015] [optim_t 0.327] [lr 0.000109] [CE 2.698 (2.831)] [KD 0.000 (0.000)] 2024-10-13 05:57:28,861 - Train: 89.61% [336300/375300] [268.8/300.0] [batch_t 0.326 (0.453)] [data_t 0.015] [optim_t 0.311] [lr 0.000108] [CE 2.766 (2.882)] [KD 0.000 (0.000)] 2024-10-13 05:57:50,131 - Train: 89.62% [336350/375300] [268.9/300.0] [batch_t 0.392 (0.425)] [data_t 0.016] [optim_t 0.376] [lr 0.000108] [CE 3.078 (2.871)] [KD 0.000 (0.000)] 2024-10-13 05:58:11,774 - Train: 89.63% [336400/375300] [268.9/300.0] [batch_t 0.404 (0.433)] [data_t 0.016] [optim_t 0.388] [lr 0.000108] [CE 2.815 (2.851)] [KD 0.000 (0.000)] 2024-10-13 05:58:33,405 - Train: 89.65% [336450/375300] [268.9/300.0] [batch_t 0.522 (0.432)] [data_t 0.016] [optim_t 0.507] [lr 0.000108] [CE 2.640 (2.888)] [KD 0.000 (0.000)] 2024-10-13 05:58:54,910 - Train: 89.66% [336500/375300] [269.0/300.0] [batch_t 0.409 (0.430)] [data_t 0.015] [optim_t 0.394] [lr 0.000108] [CE 2.867 (2.876)] [KD 0.000 (0.000)] 2024-10-13 05:59:24,332 - Test (net): 100.00% [50/50] [batch_t 0.143 (0.449)] [top1_cnt 40799] [top5_cnt 47970] [top_all 50000] 2024-10-13 05:59:24,332 - net: 81.598 (95.940) 2024-10-13 05:59:46,584 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.437)] [top1_cnt 41140] [top5_cnt 48106] [top_all 50000] 2024-10-13 05:59:46,584 - net_E: 82.280 (96.212) 2024-10-13 05:59:46,749 - Max [top1: 81.706 (epoch: 265)] [top1-ema: 82.298 (epoch: 264)] 2024-10-13 05:59:46,749 - ==> Total time: 1 day, 18:12:50 Eta: 4:51:53 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 06:00:04,549 - Train: 89.67% [336550/375300] [269.0/300.0] [batch_t 0.451 (0.517)] [data_t 0.015] [optim_t 0.435] [lr 0.000107] [CE 2.878 (2.870)] [KD 0.000 (0.000)] 2024-10-13 06:00:26,425 - Train: 89.69% [336600/375300] [269.1/300.0] [batch_t 0.507 (0.437)] [data_t 0.015] [optim_t 0.492] [lr 0.000107] [CE 2.858 (2.859)] [KD 0.000 (0.000)] 2024-10-13 06:00:48,832 - Train: 89.70% [336650/375300] [269.1/300.0] [batch_t 0.440 (0.448)] [data_t 0.016] [optim_t 0.425] [lr 0.000107] [CE 3.030 (2.844)] [KD 0.000 (0.000)] 2024-10-13 06:01:10,363 - Train: 89.71% [336700/375300] [269.1/300.0] [batch_t 0.396 (0.430)] [data_t 0.016] [optim_t 0.381] [lr 0.000107] [CE 2.857 (2.845)] [KD 0.000 (0.000)] 2024-10-13 06:01:32,222 - Train: 89.73% [336750/375300] [269.2/300.0] [batch_t 0.459 (0.437)] [data_t 0.015] [optim_t 0.444] [lr 0.000107] [CE 2.997 (2.862)] [KD 0.000 (0.000)] 2024-10-13 06:01:53,102 - Train: 89.74% [336800/375300] [269.2/300.0] [batch_t 0.348 (0.417)] [data_t 0.016] [optim_t 0.332] [lr 0.000106] [CE 2.804 (2.864)] [KD 0.000 (0.000)] 2024-10-13 06:02:15,195 - Train: 89.75% [336850/375300] [269.3/300.0] [batch_t 0.416 (0.442)] [data_t 0.015] [optim_t 0.400] [lr 0.000106] [CE 3.109 (2.863)] [KD 0.000 (0.000)] 2024-10-13 06:02:36,493 - Train: 89.77% [336900/375300] [269.3/300.0] [batch_t 0.441 (0.426)] [data_t 0.016] [optim_t 0.425] [lr 0.000106] [CE 2.847 (2.833)] [KD 0.000 (0.000)] 2024-10-13 06:02:57,584 - Train: 89.78% [336950/375300] [269.3/300.0] [batch_t 0.451 (0.422)] [data_t 0.154] [optim_t 0.297] [lr 0.000106] [CE 2.825 (2.841)] [KD 0.000 (0.000)] 2024-10-13 06:03:18,882 - Train: 89.79% [337000/375300] [269.4/300.0] [batch_t 0.427 (0.426)] [data_t 0.016] [optim_t 0.411] [lr 0.000106] [CE 2.882 (2.865)] [KD 0.000 (0.000)] 2024-10-13 06:03:41,767 - Train: 89.81% [337050/375300] [269.4/300.0] [batch_t 0.467 (0.458)] [data_t 0.016] [optim_t 0.452] [lr 0.000105] [CE 2.978 (2.863)] [KD 0.000 (0.000)] 2024-10-13 06:04:03,472 - Train: 89.82% [337100/375300] [269.5/300.0] [batch_t 0.444 (0.434)] [data_t 0.015] [optim_t 0.429] [lr 0.000105] [CE 2.753 (2.831)] [KD 0.000 (0.000)] 2024-10-13 06:04:25,391 - Train: 89.83% [337150/375300] [269.5/300.0] [batch_t 0.424 (0.438)] [data_t 0.016] [optim_t 0.409] [lr 0.000105] [CE 2.922 (2.864)] [KD 0.000 (0.000)] 2024-10-13 06:04:46,687 - Train: 89.85% [337200/375300] [269.5/300.0] [batch_t 0.404 (0.426)] [data_t 0.017] [optim_t 0.387] [lr 0.000105] [CE 2.783 (2.875)] [KD 0.000 (0.000)] 2024-10-13 06:05:07,565 - Train: 89.86% [337250/375300] [269.6/300.0] [batch_t 0.399 (0.417)] [data_t 0.016] [optim_t 0.384] [lr 0.000105] [CE 2.897 (2.823)] [KD 0.000 (0.000)] 2024-10-13 06:05:28,274 - Train: 89.87% [337300/375300] [269.6/300.0] [batch_t 0.427 (0.414)] [data_t 0.015] [optim_t 0.411] [lr 0.000105] [CE 2.962 (2.852)] [KD 0.000 (0.000)] 2024-10-13 06:05:49,498 - Train: 89.89% [337350/375300] [269.7/300.0] [batch_t 0.448 (0.424)] [data_t 0.015] [optim_t 0.432] [lr 0.000104] [CE 2.809 (2.806)] [KD 0.000 (0.000)] 2024-10-13 06:06:10,590 - Train: 89.90% [337400/375300] [269.7/300.0] [batch_t 0.321 (0.422)] [data_t 0.015] [optim_t 0.306] [lr 0.000104] [CE 2.507 (2.863)] [KD 0.000 (0.000)] 2024-10-13 06:06:32,211 - Train: 89.91% [337450/375300] [269.7/300.0] [batch_t 0.323 (0.432)] [data_t 0.015] [optim_t 0.308] [lr 0.000104] [CE 2.760 (2.883)] [KD 0.000 (0.000)] 2024-10-13 06:06:53,821 - Train: 89.93% [337500/375300] [269.8/300.0] [batch_t 0.324 (0.432)] [data_t 0.016] [optim_t 0.308] [lr 0.000104] [CE 2.780 (2.859)] [KD 0.000 (0.000)] 2024-10-13 06:07:15,210 - Train: 89.94% [337550/375300] [269.8/300.0] [batch_t 0.322 (0.428)] [data_t 0.016] [optim_t 0.306] [lr 0.000104] [CE 2.629 (2.846)] [KD 0.000 (0.000)] 2024-10-13 06:07:36,841 - Train: 89.95% [337600/375300] [269.9/300.0] [batch_t 0.394 (0.433)] [data_t 0.015] [optim_t 0.379] [lr 0.000103] [CE 2.905 (2.848)] [KD 0.000 (0.000)] 2024-10-13 06:07:58,607 - Train: 89.97% [337650/375300] [269.9/300.0] [batch_t 0.706 (0.435)] [data_t 0.015] [optim_t 0.691] [lr 0.000103] [CE 2.274 (2.847)] [KD 0.000 (0.000)] 2024-10-13 06:08:19,471 - Train: 89.98% [337700/375300] [269.9/300.0] [batch_t 0.351 (0.417)] [data_t 0.016] [optim_t 0.335] [lr 0.000103] [CE 2.855 (2.878)] [KD 0.000 (0.000)] 2024-10-13 06:08:41,235 - Train: 89.99% [337750/375300] [270.0/300.0] [batch_t 0.322 (0.435)] [data_t 0.016] [optim_t 0.306] [lr 0.000103] [CE 2.966 (2.878)] [KD 0.000 (0.000)] 2024-10-13 06:09:10,389 - Test (net): 100.00% [50/50] [batch_t 0.132 (0.445)] [top1_cnt 40886] [top5_cnt 47990] [top_all 50000] 2024-10-13 06:09:10,389 - net: 81.772 (95.980) 2024-10-13 06:09:32,367 - Test (net_E): 100.00% [50/50] [batch_t 0.130 (0.431)] [top1_cnt 41135] [top5_cnt 48099] [top_all 50000] 2024-10-13 06:09:32,367 - net_E: 82.270 (96.198) 2024-10-13 06:09:32,551 - Max [top1: 81.772 (epoch: 270)] [top1-ema: 82.298 (epoch: 264)] 2024-10-13 06:09:32,551 - ==> Total time: 1 day, 18:22:36 Eta: 4:42:30 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 06:09:51,513 - Train: 90.01% [337800/375300] [270.0/300.0] [batch_t 0.611 (0.445)] [data_t 0.016] [optim_t 0.595] [lr 0.000103] [CE 2.798 (2.854)] [KD 0.000 (0.000)] 2024-10-13 06:10:12,685 - Train: 90.02% [337850/375300] [270.1/300.0] [batch_t 0.313 (0.423)] [data_t 0.016] [optim_t 0.298] [lr 0.000102] [CE 2.959 (2.845)] [KD 0.000 (0.000)] 2024-10-13 06:10:34,601 - Train: 90.03% [337900/375300] [270.1/300.0] [batch_t 0.374 (0.438)] [data_t 0.015] [optim_t 0.358] [lr 0.000102] [CE 2.853 (2.831)] [KD 0.000 (0.000)] 2024-10-13 06:10:57,054 - Train: 90.05% [337950/375300] [270.1/300.0] [batch_t 0.491 (0.449)] [data_t 0.016] [optim_t 0.476] [lr 0.000102] [CE 2.629 (2.857)] [KD 0.000 (0.000)] 2024-10-13 06:11:19,156 - Train: 90.06% [338000/375300] [270.2/300.0] [batch_t 0.480 (0.442)] [data_t 0.015] [optim_t 0.464] [lr 0.000102] [CE 2.693 (2.841)] [KD 0.000 (0.000)] 2024-10-13 06:11:39,953 - Train: 90.07% [338050/375300] [270.2/300.0] [batch_t 0.406 (0.416)] [data_t 0.015] [optim_t 0.391] [lr 0.000102] [CE 2.797 (2.822)] [KD 0.000 (0.000)] 2024-10-13 06:12:00,849 - Train: 90.09% [338100/375300] [270.3/300.0] [batch_t 0.504 (0.418)] [data_t 0.015] [optim_t 0.488] [lr 0.000101] [CE 2.822 (2.847)] [KD 0.000 (0.000)] 2024-10-13 06:12:21,886 - Train: 90.10% [338150/375300] [270.3/300.0] [batch_t 0.390 (0.421)] [data_t 0.015] [optim_t 0.375] [lr 0.000101] [CE 2.986 (2.830)] [KD 0.000 (0.000)] 2024-10-13 06:12:42,752 - Train: 90.11% [338200/375300] [270.3/300.0] [batch_t 0.375 (0.417)] [data_t 0.016] [optim_t 0.359] [lr 0.000101] [CE 2.636 (2.788)] [KD 0.000 (0.000)] 2024-10-13 06:13:04,551 - Train: 90.13% [338250/375300] [270.4/300.0] [batch_t 0.417 (0.436)] [data_t 0.016] [optim_t 0.401] [lr 0.000101] [CE 2.880 (2.873)] [KD 0.000 (0.000)] 2024-10-13 06:13:26,662 - Train: 90.14% [338300/375300] [270.4/300.0] [batch_t 0.473 (0.442)] [data_t 0.015] [optim_t 0.458] [lr 0.000101] [CE 2.700 (2.844)] [KD 0.000 (0.000)] 2024-10-13 06:13:48,087 - Train: 90.15% [338350/375300] [270.5/300.0] [batch_t 0.370 (0.428)] [data_t 0.015] [optim_t 0.355] [lr 0.000100] [CE 3.017 (2.849)] [KD 0.000 (0.000)] 2024-10-13 06:14:09,767 - Train: 90.17% [338400/375300] [270.5/300.0] [batch_t 0.399 (0.433)] [data_t 0.016] [optim_t 0.383] [lr 0.000100] [CE 2.889 (2.842)] [KD 0.000 (0.000)] 2024-10-13 06:14:30,843 - Train: 90.18% [338450/375300] [270.5/300.0] [batch_t 0.459 (0.421)] [data_t 0.015] [optim_t 0.444] [lr 0.000100] [CE 2.803 (2.846)] [KD 0.000 (0.000)] 2024-10-13 06:14:52,872 - Train: 90.19% [338500/375300] [270.6/300.0] [batch_t 0.402 (0.440)] [data_t 0.015] [optim_t 0.387] [lr 0.000100] [CE 2.791 (2.833)] [KD 0.000 (0.000)] 2024-10-13 06:15:14,419 - Train: 90.21% [338550/375300] [270.6/300.0] [batch_t 0.417 (0.431)] [data_t 0.016] [optim_t 0.401] [lr 0.000100] [CE 3.011 (2.861)] [KD 0.000 (0.000)] 2024-10-13 06:15:35,801 - Train: 90.22% [338600/375300] [270.7/300.0] [batch_t 0.445 (0.428)] [data_t 0.015] [optim_t 0.429] [lr 0.000100] [CE 2.881 (2.840)] [KD 0.000 (0.000)] 2024-10-13 06:15:57,025 - Train: 90.23% [338650/375300] [270.7/300.0] [batch_t 0.392 (0.424)] [data_t 0.016] [optim_t 0.376] [lr 0.000099] [CE 2.846 (2.836)] [KD 0.000 (0.000)] 2024-10-13 06:16:18,233 - Train: 90.25% [338700/375300] [270.7/300.0] [batch_t 0.447 (0.424)] [data_t 0.015] [optim_t 0.432] [lr 0.000099] [CE 3.009 (2.845)] [KD 0.000 (0.000)] 2024-10-13 06:16:39,337 - Train: 90.26% [338750/375300] [270.8/300.0] [batch_t 0.414 (0.422)] [data_t 0.016] [optim_t 0.399] [lr 0.000099] [CE 2.866 (2.871)] [KD 0.000 (0.000)] 2024-10-13 06:17:00,862 - Train: 90.27% [338800/375300] [270.8/300.0] [batch_t 0.493 (0.430)] [data_t 0.016] [optim_t 0.478] [lr 0.000099] [CE 2.775 (2.865)] [KD 0.000 (0.000)] 2024-10-13 06:17:22,479 - Train: 90.29% [338850/375300] [270.9/300.0] [batch_t 0.451 (0.432)] [data_t 0.016] [optim_t 0.435] [lr 0.000099] [CE 2.836 (2.837)] [KD 0.000 (0.000)] 2024-10-13 06:17:43,531 - Train: 90.30% [338900/375300] [270.9/300.0] [batch_t 0.444 (0.421)] [data_t 0.026] [optim_t 0.418] [lr 0.000098] [CE 2.906 (2.816)] [KD 0.000 (0.000)] 2024-10-13 06:18:05,206 - Train: 90.31% [338950/375300] [270.9/300.0] [batch_t 0.323 (0.433)] [data_t 0.015] [optim_t 0.307] [lr 0.000098] [CE 2.861 (2.871)] [KD 0.000 (0.000)] 2024-10-13 06:18:26,338 - Train: 90.33% [339000/375300] [271.0/300.0] [batch_t 0.378 (0.423)] [data_t 0.016] [optim_t 0.362] [lr 0.000098] [CE 2.649 (2.883)] [KD 0.000 (0.000)] 2024-10-13 06:18:57,884 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.465)] [top1_cnt 40839] [top5_cnt 47984] [top_all 50000] 2024-10-13 06:18:57,885 - net: 81.678 (95.968) 2024-10-13 06:19:20,692 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.448)] [top1_cnt 41151] [top5_cnt 48120] [top_all 50000] 2024-10-13 06:19:20,692 - net_E: 82.302 (96.240) 2024-10-13 06:19:20,857 - Max [top1: 81.772 (epoch: 270)] [top1-ema: 82.302 (epoch: 271)] 2024-10-13 06:19:20,857 - ==> Total time: 1 day, 18:32:24 Eta: 4:33:08 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 06:19:39,293 - Train: 90.34% [339050/375300] [271.0/300.0] [batch_t 0.320 (0.482)] [data_t 0.015] [optim_t 0.304] [lr 0.000098] [CE 2.612 (2.813)] [KD 0.000 (0.000)] 2024-10-13 06:20:02,040 - Train: 90.35% [339100/375300] [271.1/300.0] [batch_t 0.429 (0.455)] [data_t 0.016] [optim_t 0.413] [lr 0.000098] [CE 2.977 (2.837)] [KD 0.000 (0.000)] 2024-10-13 06:20:24,349 - Train: 90.37% [339150/375300] [271.1/300.0] [batch_t 0.474 (0.446)] [data_t 0.016] [optim_t 0.459] [lr 0.000097] [CE 3.003 (2.839)] [KD 0.000 (0.000)] 2024-10-13 06:20:47,002 - Train: 90.38% [339200/375300] [271.1/300.0] [batch_t 0.394 (0.453)] [data_t 0.016] [optim_t 0.378] [lr 0.000097] [CE 2.817 (2.843)] [KD 0.000 (0.000)] 2024-10-13 06:21:08,563 - Train: 90.39% [339250/375300] [271.2/300.0] [batch_t 0.429 (0.431)] [data_t 0.016] [optim_t 0.413] [lr 0.000097] [CE 2.799 (2.834)] [KD 0.000 (0.000)] 2024-10-13 06:21:29,942 - Train: 90.41% [339300/375300] [271.2/300.0] [batch_t 0.370 (0.427)] [data_t 0.015] [optim_t 0.354] [lr 0.000097] [CE 3.069 (2.838)] [KD 0.000 (0.000)] 2024-10-13 06:21:51,493 - Train: 90.42% [339350/375300] [271.3/300.0] [batch_t 0.333 (0.431)] [data_t 0.038] [optim_t 0.296] [lr 0.000097] [CE 3.043 (2.838)] [KD 0.000 (0.000)] 2024-10-13 06:22:13,009 - Train: 90.43% [339400/375300] [271.3/300.0] [batch_t 0.468 (0.430)] [data_t 0.015] [optim_t 0.453] [lr 0.000097] [CE 2.772 (2.806)] [KD 0.000 (0.000)] 2024-10-13 06:22:34,827 - Train: 90.45% [339450/375300] [271.3/300.0] [batch_t 0.419 (0.436)] [data_t 0.015] [optim_t 0.403] [lr 0.000096] [CE 2.853 (2.810)] [KD 0.000 (0.000)] 2024-10-13 06:22:56,526 - Train: 90.46% [339500/375300] [271.4/300.0] [batch_t 0.409 (0.434)] [data_t 0.016] [optim_t 0.393] [lr 0.000096] [CE 2.939 (2.847)] [KD 0.000 (0.000)] 2024-10-13 06:23:18,365 - Train: 90.47% [339550/375300] [271.4/300.0] [batch_t 0.391 (0.437)] [data_t 0.016] [optim_t 0.375] [lr 0.000096] [CE 2.830 (2.843)] [KD 0.000 (0.000)] 2024-10-13 06:23:40,276 - Train: 90.49% [339600/375300] [271.5/300.0] [batch_t 0.380 (0.438)] [data_t 0.016] [optim_t 0.364] [lr 0.000096] [CE 2.769 (2.855)] [KD 0.000 (0.000)] 2024-10-13 06:24:02,044 - Train: 90.50% [339650/375300] [271.5/300.0] [batch_t 0.318 (0.435)] [data_t 0.016] [optim_t 0.302] [lr 0.000096] [CE 2.695 (2.855)] [KD 0.000 (0.000)] 2024-10-13 06:24:23,789 - Train: 90.51% [339700/375300] [271.5/300.0] [batch_t 0.468 (0.435)] [data_t 0.016] [optim_t 0.452] [lr 0.000095] [CE 3.071 (2.820)] [KD 0.000 (0.000)] 2024-10-13 06:24:46,441 - Train: 90.53% [339750/375300] [271.6/300.0] [batch_t 0.412 (0.453)] [data_t 0.016] [optim_t 0.396] [lr 0.000095] [CE 2.680 (2.844)] [KD 0.000 (0.000)] 2024-10-13 06:25:08,080 - Train: 90.54% [339800/375300] [271.6/300.0] [batch_t 0.446 (0.433)] [data_t 0.016] [optim_t 0.431] [lr 0.000095] [CE 2.951 (2.816)] [KD 0.000 (0.000)] 2024-10-13 06:25:30,356 - Train: 90.55% [339850/375300] [271.7/300.0] [batch_t 0.450 (0.445)] [data_t 0.015] [optim_t 0.434] [lr 0.000095] [CE 3.064 (2.876)] [KD 0.000 (0.000)] 2024-10-13 06:25:52,352 - Train: 90.57% [339900/375300] [271.7/300.0] [batch_t 0.383 (0.440)] [data_t 0.016] [optim_t 0.368] [lr 0.000095] [CE 2.763 (2.837)] [KD 0.000 (0.000)] 2024-10-13 06:26:14,291 - Train: 90.58% [339950/375300] [271.7/300.0] [batch_t 0.435 (0.439)] [data_t 0.015] [optim_t 0.419] [lr 0.000095] [CE 2.645 (2.863)] [KD 0.000 (0.000)] 2024-10-13 06:26:36,181 - Train: 90.59% [340000/375300] [271.8/300.0] [batch_t 0.481 (0.438)] [data_t 0.016] [optim_t 0.465] [lr 0.000094] [CE 2.936 (2.843)] [KD 0.000 (0.000)] 2024-10-13 06:26:58,001 - Train: 90.61% [340050/375300] [271.8/300.0] [batch_t 0.434 (0.436)] [data_t 0.015] [optim_t 0.418] [lr 0.000094] [CE 2.906 (2.880)] [KD 0.000 (0.000)] 2024-10-13 06:27:19,900 - Train: 90.62% [340100/375300] [271.9/300.0] [batch_t 0.360 (0.438)] [data_t 0.016] [optim_t 0.344] [lr 0.000094] [CE 2.978 (2.857)] [KD 0.000 (0.000)] 2024-10-13 06:27:41,540 - Train: 90.63% [340150/375300] [271.9/300.0] [batch_t 0.476 (0.433)] [data_t 0.016] [optim_t 0.461] [lr 0.000094] [CE 2.744 (2.818)] [KD 0.000 (0.000)] 2024-10-13 06:28:03,100 - Train: 90.65% [340200/375300] [271.9/300.0] [batch_t 0.386 (0.431)] [data_t 0.015] [optim_t 0.371] [lr 0.000094] [CE 2.920 (2.864)] [KD 0.000 (0.000)] 2024-10-13 06:28:24,969 - Train: 90.66% [340250/375300] [272.0/300.0] [batch_t 0.431 (0.437)] [data_t 0.016] [optim_t 0.416] [lr 0.000093] [CE 2.750 (2.817)] [KD 0.000 (0.000)] 2024-10-13 06:28:54,478 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.415)] [top1_cnt 40828] [top5_cnt 47991] [top_all 50000] 2024-10-13 06:28:54,478 - net: 81.656 (95.982) 2024-10-13 06:29:16,691 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.435)] [top1_cnt 41140] [top5_cnt 48115] [top_all 50000] 2024-10-13 06:29:16,692 - net_E: 82.280 (96.230) 2024-10-13 06:29:16,920 - Max [top1: 81.772 (epoch: 270)] [top1-ema: 82.302 (epoch: 271)] 2024-10-13 06:29:16,920 - ==> Total time: 1 day, 18:42:20 Eta: 4:23:46 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 06:29:33,540 - Train: 90.67% [340300/375300] [272.0/300.0] [batch_t 0.533 (0.537)] [data_t 0.016] [optim_t 0.517] [lr 0.000093] [CE 2.837 (2.796)] [KD 0.000 (0.000)] 2024-10-13 06:29:56,755 - Train: 90.69% [340350/375300] [272.1/300.0] [batch_t 0.339 (0.464)] [data_t 0.016] [optim_t 0.323] [lr 0.000093] [CE 2.581 (2.833)] [KD 0.000 (0.000)] 2024-10-13 06:30:18,023 - Train: 90.70% [340400/375300] [272.1/300.0] [batch_t 0.401 (0.425)] [data_t 0.016] [optim_t 0.385] [lr 0.000093] [CE 2.984 (2.829)] [KD 0.000 (0.000)] 2024-10-13 06:30:40,474 - Train: 90.71% [340450/375300] [272.1/300.0] [batch_t 0.473 (0.449)] [data_t 0.016] [optim_t 0.458] [lr 0.000093] [CE 2.735 (2.803)] [KD 0.000 (0.000)] 2024-10-13 06:31:02,808 - Train: 90.73% [340500/375300] [272.2/300.0] [batch_t 0.423 (0.447)] [data_t 0.016] [optim_t 0.408] [lr 0.000093] [CE 2.960 (2.846)] [KD 0.000 (0.000)] 2024-10-13 06:31:25,371 - Train: 90.74% [340550/375300] [272.2/300.0] [batch_t 0.399 (0.451)] [data_t 0.015] [optim_t 0.383] [lr 0.000092] [CE 2.871 (2.838)] [KD 0.000 (0.000)] 2024-10-13 06:31:47,684 - Train: 90.75% [340600/375300] [272.3/300.0] [batch_t 0.485 (0.446)] [data_t 0.015] [optim_t 0.470] [lr 0.000092] [CE 2.634 (2.888)] [KD 0.000 (0.000)] 2024-10-13 06:32:09,996 - Train: 90.77% [340650/375300] [272.3/300.0] [batch_t 0.480 (0.446)] [data_t 0.016] [optim_t 0.464] [lr 0.000092] [CE 2.964 (2.834)] [KD 0.000 (0.000)] 2024-10-13 06:32:32,399 - Train: 90.78% [340700/375300] [272.3/300.0] [batch_t 0.372 (0.448)] [data_t 0.016] [optim_t 0.356] [lr 0.000092] [CE 2.746 (2.858)] [KD 0.000 (0.000)] 2024-10-13 06:32:54,795 - Train: 90.79% [340750/375300] [272.4/300.0] [batch_t 0.428 (0.448)] [data_t 0.016] [optim_t 0.412] [lr 0.000092] [CE 2.951 (2.846)] [KD 0.000 (0.000)] 2024-10-13 06:33:16,977 - Train: 90.81% [340800/375300] [272.4/300.0] [batch_t 0.431 (0.444)] [data_t 0.016] [optim_t 0.416] [lr 0.000092] [CE 2.801 (2.832)] [KD 0.000 (0.000)] 2024-10-13 06:33:38,849 - Train: 90.82% [340850/375300] [272.5/300.0] [batch_t 0.350 (0.437)] [data_t 0.016] [optim_t 0.335] [lr 0.000091] [CE 2.696 (2.838)] [KD 0.000 (0.000)] 2024-10-13 06:34:00,994 - Train: 90.83% [340900/375300] [272.5/300.0] [batch_t 0.417 (0.443)] [data_t 0.015] [optim_t 0.402] [lr 0.000091] [CE 2.937 (2.830)] [KD 0.000 (0.000)] 2024-10-13 06:34:23,391 - Train: 90.85% [340950/375300] [272.5/300.0] [batch_t 0.421 (0.448)] [data_t 0.015] [optim_t 0.405] [lr 0.000091] [CE 2.771 (2.822)] [KD 0.000 (0.000)] 2024-10-13 06:34:46,084 - Train: 90.86% [341000/375300] [272.6/300.0] [batch_t 0.453 (0.454)] [data_t 0.016] [optim_t 0.438] [lr 0.000091] [CE 2.820 (2.828)] [KD 0.000 (0.000)] 2024-10-13 06:35:08,137 - Train: 90.87% [341050/375300] [272.6/300.0] [batch_t 0.429 (0.441)] [data_t 0.015] [optim_t 0.413] [lr 0.000091] [CE 2.493 (2.872)] [KD 0.000 (0.000)] 2024-10-13 06:35:29,107 - Train: 90.89% [341100/375300] [272.7/300.0] [batch_t 0.396 (0.419)] [data_t 0.015] [optim_t 0.381] [lr 0.000090] [CE 2.877 (2.841)] [KD 0.000 (0.000)] 2024-10-13 06:35:50,098 - Train: 90.90% [341150/375300] [272.7/300.0] [batch_t 0.448 (0.420)] [data_t 0.016] [optim_t 0.433] [lr 0.000090] [CE 2.938 (2.883)] [KD 0.000 (0.000)] 2024-10-13 06:36:12,165 - Train: 90.91% [341200/375300] [272.7/300.0] [batch_t 0.385 (0.441)] [data_t 0.015] [optim_t 0.370] [lr 0.000090] [CE 2.798 (2.814)] [KD 0.000 (0.000)] 2024-10-13 06:36:33,971 - Train: 90.93% [341250/375300] [272.8/300.0] [batch_t 0.430 (0.436)] [data_t 0.016] [optim_t 0.415] [lr 0.000090] [CE 2.788 (2.828)] [KD 0.000 (0.000)] 2024-10-13 06:36:56,117 - Train: 90.94% [341300/375300] [272.8/300.0] [batch_t 0.403 (0.443)] [data_t 0.015] [optim_t 0.388] [lr 0.000090] [CE 3.015 (2.849)] [KD 0.000 (0.000)] 2024-10-13 06:37:17,786 - Train: 90.95% [341350/375300] [272.9/300.0] [batch_t 0.394 (0.433)] [data_t 0.016] [optim_t 0.379] [lr 0.000090] [CE 2.735 (2.787)] [KD 0.000 (0.000)] 2024-10-13 06:37:39,234 - Train: 90.97% [341400/375300] [272.9/300.0] [batch_t 0.468 (0.429)] [data_t 0.015] [optim_t 0.452] [lr 0.000089] [CE 3.012 (2.871)] [KD 0.000 (0.000)] 2024-10-13 06:38:01,436 - Train: 90.98% [341450/375300] [272.9/300.0] [batch_t 0.415 (0.444)] [data_t 0.016] [optim_t 0.399] [lr 0.000089] [CE 2.695 (2.825)] [KD 0.000 (0.000)] 2024-10-13 06:38:22,602 - Train: 90.99% [341500/375300] [273.0/300.0] [batch_t 0.421 (0.423)] [data_t 0.016] [optim_t 0.405] [lr 0.000089] [CE 2.827 (2.829)] [KD 0.000 (0.000)] 2024-10-13 06:38:53,279 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.440)] [top1_cnt 40939] [top5_cnt 47975] [top_all 50000] 2024-10-13 06:38:53,279 - net: 81.878 (95.950) 2024-10-13 06:39:15,483 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.435)] [top1_cnt 41179] [top5_cnt 48109] [top_all 50000] 2024-10-13 06:39:15,484 - net_E: 82.358 (96.218) 2024-10-13 06:39:15,665 - Max [top1: 81.878 (epoch: 273)] [top1-ema: 82.358 (epoch: 273)] 2024-10-13 06:39:15,666 - ==> Total time: 1 day, 18:52:19 Eta: 4:14:24 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 06:39:34,087 - Train: 91.01% [341550/375300] [273.0/300.0] [batch_t 0.468 (0.432)] [data_t 0.016] [optim_t 0.452] [lr 0.000089] [CE 2.724 (2.820)] [KD 0.000 (0.000)] 2024-10-13 06:39:56,302 - Train: 91.02% [341600/375300] [273.1/300.0] [batch_t 0.423 (0.444)] [data_t 0.123] [optim_t 0.300] [lr 0.000089] [CE 3.059 (2.777)] [KD 0.000 (0.000)] 2024-10-13 06:40:19,482 - Train: 91.03% [341650/375300] [273.1/300.0] [batch_t 0.535 (0.463)] [data_t 0.234] [optim_t 0.301] [lr 0.000089] [CE 2.768 (2.836)] [KD 0.000 (0.000)] 2024-10-13 06:40:42,479 - Train: 91.05% [341700/375300] [273.1/300.0] [batch_t 0.503 (0.460)] [data_t 0.208] [optim_t 0.295] [lr 0.000088] [CE 2.816 (2.836)] [KD 0.000 (0.000)] 2024-10-13 06:41:05,071 - Train: 91.06% [341750/375300] [273.2/300.0] [batch_t 0.375 (0.452)] [data_t 0.076] [optim_t 0.300] [lr 0.000088] [CE 2.831 (2.838)] [KD 0.000 (0.000)] 2024-10-13 06:41:27,640 - Train: 91.07% [341800/375300] [273.2/300.0] [batch_t 0.413 (0.451)] [data_t 0.117] [optim_t 0.295] [lr 0.000088] [CE 2.677 (2.830)] [KD 0.000 (0.000)] 2024-10-13 06:41:50,097 - Train: 91.09% [341850/375300] [273.3/300.0] [batch_t 0.512 (0.449)] [data_t 0.209] [optim_t 0.303] [lr 0.000088] [CE 2.809 (2.821)] [KD 0.000 (0.000)] 2024-10-13 06:42:12,178 - Train: 91.10% [341900/375300] [273.3/300.0] [batch_t 0.498 (0.441)] [data_t 0.200] [optim_t 0.298] [lr 0.000088] [CE 2.769 (2.829)] [KD 0.000 (0.000)] 2024-10-13 06:42:35,001 - Train: 91.11% [341950/375300] [273.3/300.0] [batch_t 0.474 (0.456)] [data_t 0.016] [optim_t 0.458] [lr 0.000087] [CE 2.994 (2.843)] [KD 0.000 (0.000)] 2024-10-13 06:42:57,755 - Train: 91.13% [342000/375300] [273.4/300.0] [batch_t 0.358 (0.455)] [data_t 0.016] [optim_t 0.343] [lr 0.000087] [CE 2.592 (2.819)] [KD 0.000 (0.000)] 2024-10-13 06:43:20,255 - Train: 91.14% [342050/375300] [273.4/300.0] [batch_t 0.490 (0.450)] [data_t 0.016] [optim_t 0.474] [lr 0.000087] [CE 2.754 (2.829)] [KD 0.000 (0.000)] 2024-10-13 06:43:42,833 - Train: 91.15% [342100/375300] [273.5/300.0] [batch_t 0.450 (0.451)] [data_t 0.016] [optim_t 0.434] [lr 0.000087] [CE 2.862 (2.827)] [KD 0.000 (0.000)] 2024-10-13 06:44:05,057 - Train: 91.17% [342150/375300] [273.5/300.0] [batch_t 0.512 (0.444)] [data_t 0.016] [optim_t 0.497] [lr 0.000087] [CE 2.521 (2.830)] [KD 0.000 (0.000)] 2024-10-13 06:44:27,798 - Train: 91.18% [342200/375300] [273.5/300.0] [batch_t 0.341 (0.455)] [data_t 0.016] [optim_t 0.325] [lr 0.000087] [CE 3.085 (2.837)] [KD 0.000 (0.000)] 2024-10-13 06:44:49,082 - Train: 91.19% [342250/375300] [273.6/300.0] [batch_t 0.420 (0.426)] [data_t 0.015] [optim_t 0.404] [lr 0.000086] [CE 3.048 (2.839)] [KD 0.000 (0.000)] 2024-10-13 06:45:10,500 - Train: 91.21% [342300/375300] [273.6/300.0] [batch_t 0.441 (0.428)] [data_t 0.016] [optim_t 0.425] [lr 0.000086] [CE 2.832 (2.866)] [KD 0.000 (0.000)] 2024-10-13 06:45:32,594 - Train: 91.22% [342350/375300] [273.7/300.0] [batch_t 0.431 (0.442)] [data_t 0.016] [optim_t 0.416] [lr 0.000086] [CE 3.089 (2.833)] [KD 0.000 (0.000)] 2024-10-13 06:45:54,149 - Train: 91.23% [342400/375300] [273.7/300.0] [batch_t 0.422 (0.431)] [data_t 0.016] [optim_t 0.406] [lr 0.000086] [CE 3.091 (2.828)] [KD 0.000 (0.000)] 2024-10-13 06:46:16,284 - Train: 91.25% [342450/375300] [273.7/300.0] [batch_t 0.366 (0.443)] [data_t 0.016] [optim_t 0.350] [lr 0.000086] [CE 2.890 (2.854)] [KD 0.000 (0.000)] 2024-10-13 06:46:38,563 - Train: 91.26% [342500/375300] [273.8/300.0] [batch_t 0.473 (0.445)] [data_t 0.016] [optim_t 0.457] [lr 0.000086] [CE 2.819 (2.852)] [KD 0.000 (0.000)] 2024-10-13 06:47:01,261 - Train: 91.27% [342550/375300] [273.8/300.0] [batch_t 0.453 (0.454)] [data_t 0.015] [optim_t 0.437] [lr 0.000085] [CE 2.931 (2.844)] [KD 0.000 (0.000)] 2024-10-13 06:47:23,825 - Train: 91.29% [342600/375300] [273.9/300.0] [batch_t 0.489 (0.451)] [data_t 0.016] [optim_t 0.474] [lr 0.000085] [CE 2.993 (2.866)] [KD 0.000 (0.000)] 2024-10-13 06:47:45,974 - Train: 91.30% [342650/375300] [273.9/300.0] [batch_t 0.407 (0.443)] [data_t 0.015] [optim_t 0.392] [lr 0.000085] [CE 2.603 (2.818)] [KD 0.000 (0.000)] 2024-10-13 06:48:08,544 - Train: 91.31% [342700/375300] [273.9/300.0] [batch_t 0.469 (0.451)] [data_t 0.015] [optim_t 0.453] [lr 0.000085] [CE 2.768 (2.859)] [KD 0.000 (0.000)] 2024-10-13 06:48:31,124 - Train: 91.33% [342750/375300] [274.0/300.0] [batch_t 0.514 (0.452)] [data_t 0.016] [optim_t 0.498] [lr 0.000085] [CE 2.849 (2.851)] [KD 0.000 (0.000)] 2024-10-13 06:49:02,971 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.453)] [top1_cnt 40946] [top5_cnt 48015] [top_all 50000] 2024-10-13 06:49:02,972 - net: 81.892 (96.030) 2024-10-13 06:49:25,315 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.438)] [top1_cnt 41195] [top5_cnt 48117] [top_all 50000] 2024-10-13 06:49:25,315 - net_E: 82.390 (96.234) 2024-10-13 06:49:25,499 - Max [top1: 81.892 (epoch: 274)] [top1-ema: 82.390 (epoch: 274)] 2024-10-13 06:49:25,499 - ==> Total time: 1 day, 19:02:29 Eta: 4:05:03 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 06:49:44,334 - Train: 91.34% [342800/375300] [274.0/300.0] [batch_t 0.315 (0.473)] [data_t 0.016] [optim_t 0.299] [lr 0.000085] [CE 2.937 (2.820)] [KD 0.000 (0.000)] 2024-10-13 06:50:06,717 - Train: 91.35% [342850/375300] [274.1/300.0] [batch_t 0.540 (0.448)] [data_t 0.239] [optim_t 0.301] [lr 0.000084] [CE 2.862 (2.817)] [KD 0.000 (0.000)] 2024-10-13 06:50:29,372 - Train: 91.37% [342900/375300] [274.1/300.0] [batch_t 0.506 (0.453)] [data_t 0.015] [optim_t 0.490] [lr 0.000084] [CE 2.792 (2.791)] [KD 0.000 (0.000)] 2024-10-13 06:50:51,426 - Train: 91.38% [342950/375300] [274.1/300.0] [batch_t 0.498 (0.441)] [data_t 0.015] [optim_t 0.483] [lr 0.000084] [CE 2.784 (2.836)] [KD 0.000 (0.000)] 2024-10-13 06:51:13,932 - Train: 91.39% [343000/375300] [274.2/300.0] [batch_t 0.432 (0.450)] [data_t 0.015] [optim_t 0.416] [lr 0.000084] [CE 2.856 (2.830)] [KD 0.000 (0.000)] 2024-10-13 06:51:36,256 - Train: 91.41% [343050/375300] [274.2/300.0] [batch_t 0.437 (0.446)] [data_t 0.015] [optim_t 0.422] [lr 0.000084] [CE 2.577 (2.836)] [KD 0.000 (0.000)] 2024-10-13 06:51:58,503 - Train: 91.42% [343100/375300] [274.3/300.0] [batch_t 0.459 (0.445)] [data_t 0.015] [optim_t 0.443] [lr 0.000084] [CE 2.756 (2.845)] [KD 0.000 (0.000)] 2024-10-13 06:52:20,961 - Train: 91.43% [343150/375300] [274.3/300.0] [batch_t 0.504 (0.449)] [data_t 0.016] [optim_t 0.489] [lr 0.000083] [CE 2.692 (2.846)] [KD 0.000 (0.000)] 2024-10-13 06:52:43,266 - Train: 91.45% [343200/375300] [274.3/300.0] [batch_t 0.463 (0.446)] [data_t 0.015] [optim_t 0.448] [lr 0.000083] [CE 3.030 (2.835)] [KD 0.000 (0.000)] 2024-10-13 06:53:05,617 - Train: 91.46% [343250/375300] [274.4/300.0] [batch_t 0.505 (0.447)] [data_t 0.015] [optim_t 0.489] [lr 0.000083] [CE 2.736 (2.811)] [KD 0.000 (0.000)] 2024-10-13 06:53:28,441 - Train: 91.47% [343300/375300] [274.4/300.0] [batch_t 0.548 (0.456)] [data_t 0.016] [optim_t 0.532] [lr 0.000083] [CE 2.763 (2.808)] [KD 0.000 (0.000)] 2024-10-13 06:53:50,398 - Train: 91.49% [343350/375300] [274.5/300.0] [batch_t 0.454 (0.439)] [data_t 0.016] [optim_t 0.438] [lr 0.000083] [CE 2.875 (2.833)] [KD 0.000 (0.000)] 2024-10-13 06:54:12,837 - Train: 91.50% [343400/375300] [274.5/300.0] [batch_t 0.477 (0.449)] [data_t 0.015] [optim_t 0.461] [lr 0.000083] [CE 2.830 (2.810)] [KD 0.000 (0.000)] 2024-10-13 06:54:35,071 - Train: 91.51% [343450/375300] [274.5/300.0] [batch_t 0.366 (0.445)] [data_t 0.016] [optim_t 0.350] [lr 0.000082] [CE 3.072 (2.882)] [KD 0.000 (0.000)] 2024-10-13 06:54:57,217 - Train: 91.53% [343500/375300] [274.6/300.0] [batch_t 0.424 (0.443)] [data_t 0.015] [optim_t 0.409] [lr 0.000082] [CE 3.000 (2.849)] [KD 0.000 (0.000)] 2024-10-13 06:55:19,325 - Train: 91.54% [343550/375300] [274.6/300.0] [batch_t 0.425 (0.442)] [data_t 0.016] [optim_t 0.409] [lr 0.000082] [CE 2.938 (2.825)] [KD 0.000 (0.000)] 2024-10-13 06:55:41,815 - Train: 91.55% [343600/375300] [274.7/300.0] [batch_t 0.496 (0.450)] [data_t 0.015] [optim_t 0.480] [lr 0.000082] [CE 2.788 (2.818)] [KD 0.000 (0.000)] 2024-10-13 06:56:03,865 - Train: 91.57% [343650/375300] [274.7/300.0] [batch_t 0.378 (0.441)] [data_t 0.015] [optim_t 0.362] [lr 0.000082] [CE 2.804 (2.836)] [KD 0.000 (0.000)] 2024-10-13 06:56:26,229 - Train: 91.58% [343700/375300] [274.7/300.0] [batch_t 0.617 (0.447)] [data_t 0.016] [optim_t 0.601] [lr 0.000082] [CE 3.058 (2.859)] [KD 0.000 (0.000)] 2024-10-13 06:56:47,632 - Train: 91.59% [343750/375300] [274.8/300.0] [batch_t 0.454 (0.428)] [data_t 0.015] [optim_t 0.439] [lr 0.000081] [CE 2.804 (2.843)] [KD 0.000 (0.000)] 2024-10-13 06:57:10,338 - Train: 91.61% [343800/375300] [274.8/300.0] [batch_t 0.424 (0.454)] [data_t 0.016] [optim_t 0.409] [lr 0.000081] [CE 2.746 (2.828)] [KD 0.000 (0.000)] 2024-10-13 06:57:33,026 - Train: 91.62% [343850/375300] [274.9/300.0] [batch_t 0.512 (0.454)] [data_t 0.163] [optim_t 0.349] [lr 0.000081] [CE 2.907 (2.815)] [KD 0.000 (0.000)] 2024-10-13 06:57:55,275 - Train: 91.63% [343900/375300] [274.9/300.0] [batch_t 0.424 (0.445)] [data_t 0.125] [optim_t 0.299] [lr 0.000081] [CE 2.859 (2.837)] [KD 0.000 (0.000)] 2024-10-13 06:58:17,685 - Train: 91.65% [343950/375300] [274.9/300.0] [batch_t 0.362 (0.448)] [data_t 0.015] [optim_t 0.347] [lr 0.000081] [CE 2.766 (2.797)] [KD 0.000 (0.000)] 2024-10-13 06:58:39,485 - Train: 91.66% [344000/375300] [275.0/300.0] [batch_t 0.411 (0.436)] [data_t 0.015] [optim_t 0.395] [lr 0.000081] [CE 2.659 (2.854)] [KD 0.000 (0.000)] 2024-10-13 06:59:11,057 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.437)] [top1_cnt 40934] [top5_cnt 47987] [top_all 50000] 2024-10-13 06:59:11,058 - net: 81.868 (95.974) 2024-10-13 06:59:32,516 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.423)] [top1_cnt 41209] [top5_cnt 48117] [top_all 50000] 2024-10-13 06:59:32,517 - net_E: 82.418 (96.234) 2024-10-13 06:59:32,667 - Max [top1: 81.892 (epoch: 274)] [top1-ema: 82.418 (epoch: 275)] 2024-10-13 06:59:32,667 - ==> Total time: 1 day, 19:12:36 Eta: 3:55:41 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 06:59:49,278 - Train: 91.67% [344050/375300] [275.0/300.0] [batch_t 0.314 (0.471)] [data_t 0.015] [optim_t 0.298] [lr 0.000081] [CE 2.977 (2.820)] [KD 0.000 (0.000)] 2024-10-13 07:00:10,739 - Train: 91.69% [344100/375300] [275.1/300.0] [batch_t 0.423 (0.429)] [data_t 0.015] [optim_t 0.408] [lr 0.000080] [CE 2.610 (2.824)] [KD 0.000 (0.000)] 2024-10-13 07:00:32,022 - Train: 91.70% [344150/375300] [275.1/300.0] [batch_t 0.394 (0.426)] [data_t 0.015] [optim_t 0.378] [lr 0.000080] [CE 2.780 (2.843)] [KD 0.000 (0.000)] 2024-10-13 07:00:52,791 - Train: 91.71% [344200/375300] [275.1/300.0] [batch_t 0.471 (0.415)] [data_t 0.016] [optim_t 0.455] [lr 0.000080] [CE 2.664 (2.816)] [KD 0.000 (0.000)] 2024-10-13 07:01:13,855 - Train: 91.73% [344250/375300] [275.2/300.0] [batch_t 0.441 (0.421)] [data_t 0.016] [optim_t 0.425] [lr 0.000080] [CE 2.842 (2.805)] [KD 0.000 (0.000)] 2024-10-13 07:01:35,063 - Train: 91.74% [344300/375300] [275.2/300.0] [batch_t 0.424 (0.424)] [data_t 0.015] [optim_t 0.409] [lr 0.000080] [CE 2.960 (2.817)] [KD 0.000 (0.000)] 2024-10-13 07:01:56,896 - Train: 91.75% [344350/375300] [275.3/300.0] [batch_t 0.400 (0.437)] [data_t 0.015] [optim_t 0.385] [lr 0.000080] [CE 2.963 (2.829)] [KD 0.000 (0.000)] 2024-10-13 07:02:18,636 - Train: 91.77% [344400/375300] [275.3/300.0] [batch_t 0.319 (0.435)] [data_t 0.015] [optim_t 0.304] [lr 0.000079] [CE 2.749 (2.808)] [KD 0.000 (0.000)] 2024-10-13 07:02:39,616 - Train: 91.78% [344450/375300] [275.3/300.0] [batch_t 0.409 (0.419)] [data_t 0.015] [optim_t 0.394] [lr 0.000079] [CE 3.014 (2.805)] [KD 0.000 (0.000)] 2024-10-13 07:03:00,882 - Train: 91.79% [344500/375300] [275.4/300.0] [batch_t 0.385 (0.425)] [data_t 0.016] [optim_t 0.369] [lr 0.000079] [CE 2.677 (2.838)] [KD 0.000 (0.000)] 2024-10-13 07:03:21,642 - Train: 91.81% [344550/375300] [275.4/300.0] [batch_t 0.432 (0.415)] [data_t 0.016] [optim_t 0.416] [lr 0.000079] [CE 2.621 (2.815)] [KD 0.000 (0.000)] 2024-10-13 07:03:43,156 - Train: 91.82% [344600/375300] [275.5/300.0] [batch_t 0.389 (0.430)] [data_t 0.015] [optim_t 0.373] [lr 0.000079] [CE 2.647 (2.817)] [KD 0.000 (0.000)] 2024-10-13 07:04:04,782 - Train: 91.83% [344650/375300] [275.5/300.0] [batch_t 0.445 (0.432)] [data_t 0.016] [optim_t 0.429] [lr 0.000079] [CE 2.968 (2.865)] [KD 0.000 (0.000)] 2024-10-13 07:04:27,199 - Train: 91.85% [344700/375300] [275.5/300.0] [batch_t 0.482 (0.448)] [data_t 0.016] [optim_t 0.467] [lr 0.000078] [CE 2.943 (2.789)] [KD 0.000 (0.000)] 2024-10-13 07:04:49,411 - Train: 91.86% [344750/375300] [275.6/300.0] [batch_t 0.466 (0.444)] [data_t 0.015] [optim_t 0.450] [lr 0.000078] [CE 2.676 (2.808)] [KD 0.000 (0.000)] 2024-10-13 07:05:11,035 - Train: 91.87% [344800/375300] [275.6/300.0] [batch_t 0.417 (0.432)] [data_t 0.016] [optim_t 0.401] [lr 0.000078] [CE 2.818 (2.826)] [KD 0.000 (0.000)] 2024-10-13 07:05:32,878 - Train: 91.89% [344850/375300] [275.7/300.0] [batch_t 0.400 (0.437)] [data_t 0.016] [optim_t 0.384] [lr 0.000078] [CE 2.900 (2.812)] [KD 0.000 (0.000)] 2024-10-13 07:05:55,131 - Train: 91.90% [344900/375300] [275.7/300.0] [batch_t 0.424 (0.445)] [data_t 0.016] [optim_t 0.408] [lr 0.000078] [CE 2.838 (2.827)] [KD 0.000 (0.000)] 2024-10-13 07:06:17,351 - Train: 91.91% [344950/375300] [275.7/300.0] [batch_t 0.420 (0.444)] [data_t 0.016] [optim_t 0.404] [lr 0.000078] [CE 3.009 (2.818)] [KD 0.000 (0.000)] 2024-10-13 07:06:38,985 - Train: 91.93% [345000/375300] [275.8/300.0] [batch_t 0.458 (0.433)] [data_t 0.016] [optim_t 0.442] [lr 0.000078] [CE 2.887 (2.808)] [KD 0.000 (0.000)] 2024-10-13 07:07:00,770 - Train: 91.94% [345050/375300] [275.8/300.0] [batch_t 0.437 (0.436)] [data_t 0.016] [optim_t 0.422] [lr 0.000077] [CE 2.781 (2.823)] [KD 0.000 (0.000)] 2024-10-13 07:07:22,517 - Train: 91.95% [345100/375300] [275.9/300.0] [batch_t 0.411 (0.435)] [data_t 0.016] [optim_t 0.395] [lr 0.000077] [CE 2.968 (2.834)] [KD 0.000 (0.000)] 2024-10-13 07:07:44,202 - Train: 91.97% [345150/375300] [275.9/300.0] [batch_t 0.394 (0.434)] [data_t 0.015] [optim_t 0.379] [lr 0.000077] [CE 2.482 (2.814)] [KD 0.000 (0.000)] 2024-10-13 07:08:06,363 - Train: 91.98% [345200/375300] [275.9/300.0] [batch_t 0.399 (0.443)] [data_t 0.016] [optim_t 0.383] [lr 0.000077] [CE 2.841 (2.827)] [KD 0.000 (0.000)] 2024-10-13 07:08:27,841 - Train: 91.99% [345250/375300] [276.0/300.0] [batch_t 0.427 (0.429)] [data_t 0.016] [optim_t 0.412] [lr 0.000077] [CE 2.968 (2.864)] [KD 0.000 (0.000)] 2024-10-13 07:09:01,309 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.462)] [top1_cnt 40908] [top5_cnt 48016] [top_all 50000] 2024-10-13 07:09:01,309 - net: 81.816 (96.032) 2024-10-13 07:09:23,462 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.434)] [top1_cnt 41204] [top5_cnt 48113] [top_all 50000] 2024-10-13 07:09:23,463 - net_E: 82.408 (96.226) 2024-10-13 07:09:23,648 - Max [top1: 81.892 (epoch: 274)] [top1-ema: 82.418 (epoch: 275)] 2024-10-13 07:09:23,648 - ==> Total time: 1 day, 19:22:27 Eta: 3:46:18 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 07:09:37,894 - Train: 92.01% [345300/375300] [276.0/300.0] [batch_t 0.323 (0.530)] [data_t 0.016] [optim_t 0.308] [lr 0.000077] [CE 2.995 (2.836)] [KD 0.000 (0.000)] 2024-10-13 07:09:59,520 - Train: 92.02% [345350/375300] [276.1/300.0] [batch_t 0.351 (0.432)] [data_t 0.015] [optim_t 0.336] [lr 0.000076] [CE 2.828 (2.839)] [KD 0.000 (0.000)] 2024-10-13 07:10:21,316 - Train: 92.03% [345400/375300] [276.1/300.0] [batch_t 0.417 (0.436)] [data_t 0.016] [optim_t 0.402] [lr 0.000076] [CE 2.844 (2.800)] [KD 0.000 (0.000)] 2024-10-13 07:10:43,052 - Train: 92.05% [345450/375300] [276.1/300.0] [batch_t 0.428 (0.435)] [data_t 0.016] [optim_t 0.412] [lr 0.000076] [CE 3.060 (2.811)] [KD 0.000 (0.000)] 2024-10-13 07:11:04,513 - Train: 92.06% [345500/375300] [276.2/300.0] [batch_t 0.480 (0.429)] [data_t 0.015] [optim_t 0.465] [lr 0.000076] [CE 2.765 (2.807)] [KD 0.000 (0.000)] 2024-10-13 07:11:26,495 - Train: 92.07% [345550/375300] [276.2/300.0] [batch_t 0.438 (0.440)] [data_t 0.016] [optim_t 0.422] [lr 0.000076] [CE 2.597 (2.834)] [KD 0.000 (0.000)] 2024-10-13 07:11:48,331 - Train: 92.09% [345600/375300] [276.3/300.0] [batch_t 0.430 (0.437)] [data_t 0.015] [optim_t 0.415] [lr 0.000076] [CE 2.904 (2.804)] [KD 0.000 (0.000)] 2024-10-13 07:12:10,543 - Train: 92.10% [345650/375300] [276.3/300.0] [batch_t 0.315 (0.444)] [data_t 0.016] [optim_t 0.299] [lr 0.000076] [CE 2.818 (2.807)] [KD 0.000 (0.000)] 2024-10-13 07:12:32,337 - Train: 92.11% [345700/375300] [276.3/300.0] [batch_t 0.505 (0.436)] [data_t 0.016] [optim_t 0.489] [lr 0.000075] [CE 2.687 (2.809)] [KD 0.000 (0.000)] 2024-10-13 07:12:54,169 - Train: 92.13% [345750/375300] [276.4/300.0] [batch_t 0.425 (0.437)] [data_t 0.016] [optim_t 0.409] [lr 0.000075] [CE 2.486 (2.799)] [KD 0.000 (0.000)] 2024-10-13 07:13:15,952 - Train: 92.14% [345800/375300] [276.4/300.0] [batch_t 0.420 (0.436)] [data_t 0.015] [optim_t 0.405] [lr 0.000075] [CE 2.780 (2.803)] [KD 0.000 (0.000)] 2024-10-13 07:13:37,618 - Train: 92.15% [345850/375300] [276.5/300.0] [batch_t 0.549 (0.433)] [data_t 0.016] [optim_t 0.533] [lr 0.000075] [CE 2.912 (2.813)] [KD 0.000 (0.000)] 2024-10-13 07:13:59,724 - Train: 92.17% [345900/375300] [276.5/300.0] [batch_t 0.315 (0.442)] [data_t 0.016] [optim_t 0.299] [lr 0.000075] [CE 2.959 (2.854)] [KD 0.000 (0.000)] 2024-10-13 07:14:21,612 - Train: 92.18% [345950/375300] [276.5/300.0] [batch_t 0.343 (0.438)] [data_t 0.015] [optim_t 0.327] [lr 0.000075] [CE 2.860 (2.787)] [KD 0.000 (0.000)] 2024-10-13 07:14:42,892 - Train: 92.19% [346000/375300] [276.6/300.0] [batch_t 0.409 (0.425)] [data_t 0.016] [optim_t 0.393] [lr 0.000074] [CE 2.705 (2.814)] [KD 0.000 (0.000)] 2024-10-13 07:15:05,248 - Train: 92.21% [346050/375300] [276.6/300.0] [batch_t 0.348 (0.447)] [data_t 0.016] [optim_t 0.332] [lr 0.000074] [CE 3.006 (2.820)] [KD 0.000 (0.000)] 2024-10-13 07:15:27,300 - Train: 92.22% [346100/375300] [276.7/300.0] [batch_t 0.509 (0.441)] [data_t 0.016] [optim_t 0.493] [lr 0.000074] [CE 2.967 (2.826)] [KD 0.000 (0.000)] 2024-10-13 07:15:49,018 - Train: 92.23% [346150/375300] [276.7/300.0] [batch_t 0.410 (0.434)] [data_t 0.016] [optim_t 0.394] [lr 0.000074] [CE 2.751 (2.839)] [KD 0.000 (0.000)] 2024-10-13 07:16:10,779 - Train: 92.25% [346200/375300] [276.7/300.0] [batch_t 0.317 (0.435)] [data_t 0.017] [optim_t 0.300] [lr 0.000074] [CE 2.755 (2.818)] [KD 0.000 (0.000)] 2024-10-13 07:16:32,623 - Train: 92.26% [346250/375300] [276.8/300.0] [batch_t 0.349 (0.437)] [data_t 0.016] [optim_t 0.333] [lr 0.000074] [CE 3.067 (2.846)] [KD 0.000 (0.000)] 2024-10-13 07:16:54,981 - Train: 92.27% [346300/375300] [276.8/300.0] [batch_t 0.520 (0.447)] [data_t 0.016] [optim_t 0.505] [lr 0.000074] [CE 2.722 (2.824)] [KD 0.000 (0.000)] 2024-10-13 07:17:16,459 - Train: 92.29% [346350/375300] [276.9/300.0] [batch_t 0.398 (0.429)] [data_t 0.015] [optim_t 0.382] [lr 0.000073] [CE 2.976 (2.827)] [KD 0.000 (0.000)] 2024-10-13 07:17:37,981 - Train: 92.30% [346400/375300] [276.9/300.0] [batch_t 0.548 (0.430)] [data_t 0.016] [optim_t 0.532] [lr 0.000073] [CE 2.533 (2.807)] [KD 0.000 (0.000)] 2024-10-13 07:17:59,819 - Train: 92.31% [346450/375300] [276.9/300.0] [batch_t 0.464 (0.437)] [data_t 0.015] [optim_t 0.448] [lr 0.000073] [CE 2.923 (2.836)] [KD 0.000 (0.000)] 2024-10-13 07:18:21,520 - Train: 92.33% [346500/375300] [277.0/300.0] [batch_t 0.358 (0.434)] [data_t 0.016] [optim_t 0.342] [lr 0.000073] [CE 2.791 (2.781)] [KD 0.000 (0.000)] 2024-10-13 07:18:53,978 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.437)] [top1_cnt 40922] [top5_cnt 47997] [top_all 50000] 2024-10-13 07:18:53,979 - net: 81.844 (95.994) 2024-10-13 07:19:15,684 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.425)] [top1_cnt 41204] [top5_cnt 48107] [top_all 50000] 2024-10-13 07:19:15,684 - net_E: 82.408 (96.214) 2024-10-13 07:19:15,858 - Max [top1: 81.892 (epoch: 274)] [top1-ema: 82.418 (epoch: 275)] 2024-10-13 07:19:15,858 - ==> Total time: 1 day, 19:32:19 Eta: 3:36:54 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 07:19:30,554 - Train: 92.34% [346550/375300] [277.0/300.0] [batch_t 0.464 (0.571)] [data_t 0.167] [optim_t 0.297] [lr 0.000073] [CE 2.675 (2.831)] [KD 0.000 (0.000)] 2024-10-13 07:19:53,235 - Train: 92.35% [346600/375300] [277.1/300.0] [batch_t 0.436 (0.453)] [data_t 0.141] [optim_t 0.294] [lr 0.000073] [CE 2.740 (2.799)] [KD 0.000 (0.000)] 2024-10-13 07:20:14,742 - Train: 92.37% [346650/375300] [277.1/300.0] [batch_t 0.418 (0.430)] [data_t 0.118] [optim_t 0.299] [lr 0.000073] [CE 2.983 (2.842)] [KD 0.000 (0.000)] 2024-10-13 07:20:36,039 - Train: 92.38% [346700/375300] [277.1/300.0] [batch_t 0.428 (0.426)] [data_t 0.131] [optim_t 0.297] [lr 0.000072] [CE 2.836 (2.819)] [KD 0.000 (0.000)] 2024-10-13 07:20:57,559 - Train: 92.39% [346750/375300] [277.2/300.0] [batch_t 0.442 (0.430)] [data_t 0.016] [optim_t 0.426] [lr 0.000072] [CE 2.789 (2.784)] [KD 0.000 (0.000)] 2024-10-13 07:21:20,166 - Train: 92.41% [346800/375300] [277.2/300.0] [batch_t 0.470 (0.452)] [data_t 0.016] [optim_t 0.454] [lr 0.000072] [CE 2.947 (2.864)] [KD 0.000 (0.000)] 2024-10-13 07:21:42,048 - Train: 92.42% [346850/375300] [277.3/300.0] [batch_t 0.437 (0.437)] [data_t 0.016] [optim_t 0.421] [lr 0.000072] [CE 2.732 (2.807)] [KD 0.000 (0.000)] 2024-10-13 07:22:04,155 - Train: 92.43% [346900/375300] [277.3/300.0] [batch_t 0.833 (0.442)] [data_t 0.016] [optim_t 0.816] [lr 0.000072] [CE 3.050 (2.817)] [KD 0.000 (0.000)] 2024-10-13 07:22:25,337 - Train: 92.45% [346950/375300] [277.3/300.0] [batch_t 0.340 (0.423)] [data_t 0.016] [optim_t 0.324] [lr 0.000072] [CE 2.646 (2.845)] [KD 0.000 (0.000)] 2024-10-13 07:22:47,155 - Train: 92.46% [347000/375300] [277.4/300.0] [batch_t 0.488 (0.436)] [data_t 0.016] [optim_t 0.473] [lr 0.000071] [CE 3.004 (2.839)] [KD 0.000 (0.000)] 2024-10-13 07:23:09,504 - Train: 92.47% [347050/375300] [277.4/300.0] [batch_t 0.393 (0.447)] [data_t 0.016] [optim_t 0.376] [lr 0.000071] [CE 2.789 (2.790)] [KD 0.000 (0.000)] 2024-10-13 07:23:30,865 - Train: 92.49% [347100/375300] [277.5/300.0] [batch_t 0.365 (0.427)] [data_t 0.016] [optim_t 0.349] [lr 0.000071] [CE 2.872 (2.838)] [KD 0.000 (0.000)] 2024-10-13 07:23:52,389 - Train: 92.50% [347150/375300] [277.5/300.0] [batch_t 0.510 (0.430)] [data_t 0.016] [optim_t 0.494] [lr 0.000071] [CE 2.563 (2.788)] [KD 0.000 (0.000)] 2024-10-13 07:24:14,486 - Train: 92.51% [347200/375300] [277.5/300.0] [batch_t 0.381 (0.442)] [data_t 0.016] [optim_t 0.365] [lr 0.000071] [CE 2.663 (2.820)] [KD 0.000 (0.000)] 2024-10-13 07:24:35,903 - Train: 92.53% [347250/375300] [277.6/300.0] [batch_t 0.316 (0.428)] [data_t 0.016] [optim_t 0.301] [lr 0.000071] [CE 2.642 (2.804)] [KD 0.000 (0.000)] 2024-10-13 07:24:57,112 - Train: 92.54% [347300/375300] [277.6/300.0] [batch_t 0.465 (0.424)] [data_t 0.015] [optim_t 0.449] [lr 0.000071] [CE 2.358 (2.819)] [KD 0.000 (0.000)] 2024-10-13 07:25:18,498 - Train: 92.55% [347350/375300] [277.7/300.0] [batch_t 0.439 (0.428)] [data_t 0.016] [optim_t 0.423] [lr 0.000070] [CE 2.724 (2.822)] [KD 0.000 (0.000)] 2024-10-13 07:25:40,062 - Train: 92.57% [347400/375300] [277.7/300.0] [batch_t 0.439 (0.431)] [data_t 0.016] [optim_t 0.424] [lr 0.000070] [CE 2.662 (2.813)] [KD 0.000 (0.000)] 2024-10-13 07:26:01,629 - Train: 92.58% [347450/375300] [277.7/300.0] [batch_t 0.339 (0.431)] [data_t 0.016] [optim_t 0.323] [lr 0.000070] [CE 3.048 (2.802)] [KD 0.000 (0.000)] 2024-10-13 07:26:23,295 - Train: 92.59% [347500/375300] [277.8/300.0] [batch_t 0.402 (0.433)] [data_t 0.016] [optim_t 0.387] [lr 0.000070] [CE 2.534 (2.813)] [KD 0.000 (0.000)] 2024-10-13 07:26:45,298 - Train: 92.61% [347550/375300] [277.8/300.0] [batch_t 0.466 (0.440)] [data_t 0.015] [optim_t 0.451] [lr 0.000070] [CE 2.677 (2.834)] [KD 0.000 (0.000)] 2024-10-13 07:27:07,022 - Train: 92.62% [347600/375300] [277.9/300.0] [batch_t 0.425 (0.434)] [data_t 0.015] [optim_t 0.410] [lr 0.000070] [CE 2.790 (2.835)] [KD 0.000 (0.000)] 2024-10-13 07:27:29,077 - Train: 92.63% [347650/375300] [277.9/300.0] [batch_t 0.453 (0.441)] [data_t 0.015] [optim_t 0.438] [lr 0.000070] [CE 2.677 (2.824)] [KD 0.000 (0.000)] 2024-10-13 07:27:50,269 - Train: 92.65% [347700/375300] [277.9/300.0] [batch_t 0.374 (0.424)] [data_t 0.015] [optim_t 0.359] [lr 0.000069] [CE 2.628 (2.785)] [KD 0.000 (0.000)] 2024-10-13 07:28:12,719 - Train: 92.66% [347750/375300] [278.0/300.0] [batch_t 0.522 (0.449)] [data_t 0.016] [optim_t 0.506] [lr 0.000069] [CE 2.755 (2.821)] [KD 0.000 (0.000)] 2024-10-13 07:28:46,867 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.455)] [top1_cnt 41016] [top5_cnt 48020] [top_all 50000] 2024-10-13 07:28:46,867 - net: 82.032 (96.040) 2024-10-13 07:29:09,188 - Test (net_E): 100.00% [50/50] [batch_t 0.133 (0.439)] [top1_cnt 41206] [top5_cnt 48110] [top_all 50000] 2024-10-13 07:29:09,189 - net_E: 82.412 (96.220) 2024-10-13 07:29:09,343 - Max [top1: 82.032 (epoch: 278)] [top1-ema: 82.418 (epoch: 275)] 2024-10-13 07:29:09,343 - ==> Total time: 1 day, 19:42:13 Eta: 3:27:30 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 07:29:24,225 - Train: 92.67% [347800/375300] [278.0/300.0] [batch_t 0.324 (0.479)] [data_t 0.016] [optim_t 0.308] [lr 0.000069] [CE 3.054 (2.881)] [KD 0.000 (0.000)] 2024-10-13 07:29:45,550 - Train: 92.69% [347850/375300] [278.1/300.0] [batch_t 0.438 (0.426)] [data_t 0.016] [optim_t 0.422] [lr 0.000069] [CE 2.923 (2.817)] [KD 0.000 (0.000)] 2024-10-13 07:30:07,257 - Train: 92.70% [347900/375300] [278.1/300.0] [batch_t 0.493 (0.434)] [data_t 0.016] [optim_t 0.478] [lr 0.000069] [CE 2.768 (2.805)] [KD 0.000 (0.000)] 2024-10-13 07:30:29,012 - Train: 92.71% [347950/375300] [278.1/300.0] [batch_t 0.419 (0.435)] [data_t 0.015] [optim_t 0.404] [lr 0.000069] [CE 2.637 (2.796)] [KD 0.000 (0.000)] 2024-10-13 07:30:50,078 - Train: 92.73% [348000/375300] [278.2/300.0] [batch_t 0.441 (0.421)] [data_t 0.016] [optim_t 0.425] [lr 0.000069] [CE 2.684 (2.781)] [KD 0.000 (0.000)] 2024-10-13 07:31:11,359 - Train: 92.74% [348050/375300] [278.2/300.0] [batch_t 0.416 (0.425)] [data_t 0.016] [optim_t 0.401] [lr 0.000068] [CE 2.602 (2.822)] [KD 0.000 (0.000)] 2024-10-13 07:31:33,153 - Train: 92.75% [348100/375300] [278.3/300.0] [batch_t 0.448 (0.436)] [data_t 0.015] [optim_t 0.432] [lr 0.000068] [CE 2.515 (2.812)] [KD 0.000 (0.000)] 2024-10-13 07:31:55,111 - Train: 92.77% [348150/375300] [278.3/300.0] [batch_t 0.399 (0.439)] [data_t 0.015] [optim_t 0.383] [lr 0.000068] [CE 3.183 (2.818)] [KD 0.000 (0.000)] 2024-10-13 07:32:17,174 - Train: 92.78% [348200/375300] [278.3/300.0] [batch_t 0.310 (0.441)] [data_t 0.015] [optim_t 0.294] [lr 0.000068] [CE 2.604 (2.812)] [KD 0.000 (0.000)] 2024-10-13 07:32:38,296 - Train: 92.79% [348250/375300] [278.4/300.0] [batch_t 0.402 (0.422)] [data_t 0.016] [optim_t 0.387] [lr 0.000068] [CE 2.952 (2.829)] [KD 0.000 (0.000)] 2024-10-13 07:32:59,500 - Train: 92.81% [348300/375300] [278.4/300.0] [batch_t 0.419 (0.424)] [data_t 0.015] [optim_t 0.404] [lr 0.000068] [CE 2.894 (2.809)] [KD 0.000 (0.000)] 2024-10-13 07:33:21,259 - Train: 92.82% [348350/375300] [278.5/300.0] [batch_t 0.470 (0.435)] [data_t 0.015] [optim_t 0.454] [lr 0.000068] [CE 2.973 (2.823)] [KD 0.000 (0.000)] 2024-10-13 07:33:42,674 - Train: 92.83% [348400/375300] [278.5/300.0] [batch_t 0.450 (0.428)] [data_t 0.016] [optim_t 0.435] [lr 0.000067] [CE 2.882 (2.852)] [KD 0.000 (0.000)] 2024-10-13 07:34:04,389 - Train: 92.85% [348450/375300] [278.5/300.0] [batch_t 0.340 (0.434)] [data_t 0.015] [optim_t 0.324] [lr 0.000067] [CE 3.026 (2.828)] [KD 0.000 (0.000)] 2024-10-13 07:34:26,440 - Train: 92.86% [348500/375300] [278.6/300.0] [batch_t 0.413 (0.441)] [data_t 0.015] [optim_t 0.398] [lr 0.000067] [CE 3.053 (2.799)] [KD 0.000 (0.000)] 2024-10-13 07:34:48,235 - Train: 92.87% [348550/375300] [278.6/300.0] [batch_t 0.316 (0.436)] [data_t 0.015] [optim_t 0.300] [lr 0.000067] [CE 2.626 (2.801)] [KD 0.000 (0.000)] 2024-10-13 07:35:10,392 - Train: 92.89% [348600/375300] [278.7/300.0] [batch_t 0.461 (0.443)] [data_t 0.016] [optim_t 0.446] [lr 0.000067] [CE 2.811 (2.798)] [KD 0.000 (0.000)] 2024-10-13 07:35:32,340 - Train: 92.90% [348650/375300] [278.7/300.0] [batch_t 0.447 (0.439)] [data_t 0.015] [optim_t 0.431] [lr 0.000067] [CE 2.561 (2.755)] [KD 0.000 (0.000)] 2024-10-13 07:35:54,723 - Train: 92.91% [348700/375300] [278.7/300.0] [batch_t 0.413 (0.448)] [data_t 0.016] [optim_t 0.397] [lr 0.000067] [CE 2.875 (2.820)] [KD 0.000 (0.000)] 2024-10-13 07:36:16,643 - Train: 92.93% [348750/375300] [278.8/300.0] [batch_t 0.443 (0.438)] [data_t 0.016] [optim_t 0.428] [lr 0.000067] [CE 2.881 (2.792)] [KD 0.000 (0.000)] 2024-10-13 07:36:39,033 - Train: 92.94% [348800/375300] [278.8/300.0] [batch_t 0.445 (0.448)] [data_t 0.016] [optim_t 0.429] [lr 0.000066] [CE 2.844 (2.801)] [KD 0.000 (0.000)] 2024-10-13 07:37:01,026 - Train: 92.95% [348850/375300] [278.9/300.0] [batch_t 0.475 (0.440)] [data_t 0.015] [optim_t 0.460] [lr 0.000066] [CE 3.091 (2.817)] [KD 0.000 (0.000)] 2024-10-13 07:37:22,633 - Train: 92.97% [348900/375300] [278.9/300.0] [batch_t 0.780 (0.432)] [data_t 0.015] [optim_t 0.764] [lr 0.000066] [CE 2.712 (2.778)] [KD 0.000 (0.000)] 2024-10-13 07:37:44,582 - Train: 92.98% [348950/375300] [278.9/300.0] [batch_t 0.890 (0.439)] [data_t 0.016] [optim_t 0.874] [lr 0.000066] [CE 2.763 (2.803)] [KD 0.000 (0.000)] 2024-10-13 07:38:05,889 - Train: 92.99% [349000/375300] [279.0/300.0] [batch_t 0.477 (0.426)] [data_t 0.016] [optim_t 0.462] [lr 0.000066] [CE 2.810 (2.839)] [KD 0.000 (0.000)] 2024-10-13 07:38:39,609 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.447)] [top1_cnt 40983] [top5_cnt 48030] [top_all 50000] 2024-10-13 07:38:39,609 - net: 81.966 (96.060) 2024-10-13 07:39:02,025 - Test (net_E): 100.00% [50/50] [batch_t 0.135 (0.442)] [top1_cnt 41212] [top5_cnt 48112] [top_all 50000] 2024-10-13 07:39:02,026 - net_E: 82.424 (96.224) 2024-10-13 07:39:02,174 - Max [top1: 82.032 (epoch: 278)] [top1-ema: 82.424 (epoch: 279)] 2024-10-13 07:39:02,175 - ==> Total time: 1 day, 19:52:06 Eta: 3:18:06 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 07:39:18,496 - Train: 93.01% [349050/375300] [279.0/300.0] [batch_t 0.321 (0.426)] [data_t 0.016] [optim_t 0.306] [lr 0.000066] [CE 2.684 (2.796)] [KD 0.000 (0.000)] 2024-10-13 07:39:40,352 - Train: 93.02% [349100/375300] [279.1/300.0] [batch_t 0.314 (0.437)] [data_t 0.016] [optim_t 0.299] [lr 0.000066] [CE 2.754 (2.813)] [KD 0.000 (0.000)] 2024-10-13 07:40:02,468 - Train: 93.03% [349150/375300] [279.1/300.0] [batch_t 0.477 (0.442)] [data_t 0.016] [optim_t 0.461] [lr 0.000065] [CE 2.623 (2.774)] [KD 0.000 (0.000)] 2024-10-13 07:40:24,637 - Train: 93.05% [349200/375300] [279.1/300.0] [batch_t 0.429 (0.443)] [data_t 0.016] [optim_t 0.413] [lr 0.000065] [CE 2.754 (2.824)] [KD 0.000 (0.000)] 2024-10-13 07:40:47,006 - Train: 93.06% [349250/375300] [279.2/300.0] [batch_t 0.474 (0.447)] [data_t 0.015] [optim_t 0.458] [lr 0.000065] [CE 2.962 (2.836)] [KD 0.000 (0.000)] 2024-10-13 07:41:08,639 - Train: 93.07% [349300/375300] [279.2/300.0] [batch_t 0.410 (0.433)] [data_t 0.116] [optim_t 0.294] [lr 0.000065] [CE 2.755 (2.844)] [KD 0.000 (0.000)] 2024-10-13 07:41:30,273 - Train: 93.09% [349350/375300] [279.3/300.0] [batch_t 0.388 (0.433)] [data_t 0.016] [optim_t 0.373] [lr 0.000065] [CE 3.022 (2.797)] [KD 0.000 (0.000)] 2024-10-13 07:41:52,198 - Train: 93.10% [349400/375300] [279.3/300.0] [batch_t 0.441 (0.438)] [data_t 0.016] [optim_t 0.425] [lr 0.000065] [CE 2.749 (2.758)] [KD 0.000 (0.000)] 2024-10-13 07:42:15,241 - Train: 93.11% [349450/375300] [279.3/300.0] [batch_t 0.500 (0.461)] [data_t 0.016] [optim_t 0.485] [lr 0.000065] [CE 2.644 (2.803)] [KD 0.000 (0.000)] 2024-10-13 07:42:37,936 - Train: 93.13% [349500/375300] [279.4/300.0] [batch_t 0.433 (0.454)] [data_t 0.015] [optim_t 0.418] [lr 0.000065] [CE 2.978 (2.813)] [KD 0.000 (0.000)] 2024-10-13 07:43:00,416 - Train: 93.14% [349550/375300] [279.4/300.0] [batch_t 0.439 (0.449)] [data_t 0.016] [optim_t 0.423] [lr 0.000064] [CE 2.715 (2.791)] [KD 0.000 (0.000)] 2024-10-13 07:43:21,073 - Train: 93.15% [349600/375300] [279.5/300.0] [batch_t 0.406 (0.413)] [data_t 0.016] [optim_t 0.390] [lr 0.000064] [CE 2.691 (2.803)] [KD 0.000 (0.000)] 2024-10-13 07:43:42,243 - Train: 93.17% [349650/375300] [279.5/300.0] [batch_t 0.452 (0.423)] [data_t 0.156] [optim_t 0.295] [lr 0.000064] [CE 2.695 (2.828)] [KD 0.000 (0.000)] 2024-10-13 07:44:04,595 - Train: 93.18% [349700/375300] [279.5/300.0] [batch_t 0.386 (0.447)] [data_t 0.081] [optim_t 0.305] [lr 0.000064] [CE 3.083 (2.823)] [KD 0.000 (0.000)] 2024-10-13 07:44:26,646 - Train: 93.19% [349750/375300] [279.6/300.0] [batch_t 0.470 (0.441)] [data_t 0.115] [optim_t 0.355] [lr 0.000064] [CE 2.480 (2.823)] [KD 0.000 (0.000)] 2024-10-13 07:44:48,654 - Train: 93.21% [349800/375300] [279.6/300.0] [batch_t 0.430 (0.440)] [data_t 0.133] [optim_t 0.297] [lr 0.000064] [CE 2.767 (2.818)] [KD 0.000 (0.000)] 2024-10-13 07:45:10,667 - Train: 93.22% [349850/375300] [279.7/300.0] [batch_t 0.492 (0.440)] [data_t 0.190] [optim_t 0.302] [lr 0.000064] [CE 2.738 (2.781)] [KD 0.000 (0.000)] 2024-10-13 07:45:32,665 - Train: 93.23% [349900/375300] [279.7/300.0] [batch_t 0.392 (0.440)] [data_t 0.094] [optim_t 0.298] [lr 0.000063] [CE 2.755 (2.761)] [KD 0.000 (0.000)] 2024-10-13 07:45:53,707 - Train: 93.25% [349950/375300] [279.7/300.0] [batch_t 0.521 (0.421)] [data_t 0.225] [optim_t 0.296] [lr 0.000063] [CE 2.630 (2.802)] [KD 0.000 (0.000)] 2024-10-13 07:46:15,087 - Train: 93.26% [350000/375300] [279.8/300.0] [batch_t 0.387 (0.427)] [data_t 0.089] [optim_t 0.297] [lr 0.000063] [CE 2.874 (2.784)] [KD 0.000 (0.000)] 2024-10-13 07:46:36,676 - Train: 93.27% [350050/375300] [279.8/300.0] [batch_t 0.430 (0.432)] [data_t 0.015] [optim_t 0.415] [lr 0.000063] [CE 2.778 (2.741)] [KD 0.000 (0.000)] 2024-10-13 07:46:58,556 - Train: 93.29% [350100/375300] [279.9/300.0] [batch_t 0.456 (0.437)] [data_t 0.015] [optim_t 0.440] [lr 0.000063] [CE 2.923 (2.837)] [KD 0.000 (0.000)] 2024-10-13 07:47:20,725 - Train: 93.30% [350150/375300] [279.9/300.0] [batch_t 0.320 (0.443)] [data_t 0.016] [optim_t 0.304] [lr 0.000063] [CE 2.771 (2.788)] [KD 0.000 (0.000)] 2024-10-13 07:47:42,731 - Train: 93.31% [350200/375300] [279.9/300.0] [batch_t 0.433 (0.440)] [data_t 0.016] [optim_t 0.417] [lr 0.000063] [CE 2.787 (2.823)] [KD 0.000 (0.000)] 2024-10-13 07:48:04,831 - Train: 93.33% [350250/375300] [280.0/300.0] [batch_t 0.464 (0.442)] [data_t 0.015] [optim_t 0.449] [lr 0.000063] [CE 2.578 (2.810)] [KD 0.000 (0.000)] 2024-10-13 07:48:38,379 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.437)] [top1_cnt 41052] [top5_cnt 48065] [top_all 50000] 2024-10-13 07:48:38,380 - net: 82.104 (96.130) 2024-10-13 07:49:01,272 - Test (net_E): 100.00% [50/50] [batch_t 0.146 (0.451)] [top1_cnt 41216] [top5_cnt 48127] [top_all 50000] 2024-10-13 07:49:01,272 - net_E: 82.432 (96.254) 2024-10-13 07:49:01,443 - Max [top1: 82.104 (epoch: 280)] [top1-ema: 82.432 (epoch: 280)] 2024-10-13 07:49:01,443 - ==> Total time: 1 day, 20:02:05 Eta: 3:08:43 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 07:49:20,537 - Train: 93.34% [350300/375300] [280.0/300.0] [batch_t 0.544 (0.475)] [data_t 0.015] [optim_t 0.529] [lr 0.000062] [CE 2.699 (2.760)] [KD 0.000 (0.000)] 2024-10-13 07:49:42,323 - Train: 93.35% [350350/375300] [280.1/300.0] [batch_t 0.409 (0.436)] [data_t 0.115] [optim_t 0.295] [lr 0.000062] [CE 2.632 (2.780)] [KD 0.000 (0.000)] 2024-10-13 07:50:04,947 - Train: 93.37% [350400/375300] [280.1/300.0] [batch_t 0.441 (0.452)] [data_t 0.146] [optim_t 0.295] [lr 0.000062] [CE 2.859 (2.779)] [KD 0.000 (0.000)] 2024-10-13 07:50:27,260 - Train: 93.38% [350450/375300] [280.1/300.0] [batch_t 0.346 (0.446)] [data_t 0.047] [optim_t 0.299] [lr 0.000062] [CE 2.423 (2.802)] [KD 0.000 (0.000)] 2024-10-13 07:50:49,230 - Train: 93.39% [350500/375300] [280.2/300.0] [batch_t 0.482 (0.439)] [data_t 0.185] [optim_t 0.296] [lr 0.000062] [CE 2.747 (2.773)] [KD 0.000 (0.000)] 2024-10-13 07:51:11,307 - Train: 93.41% [350550/375300] [280.2/300.0] [batch_t 0.440 (0.441)] [data_t 0.141] [optim_t 0.299] [lr 0.000062] [CE 2.784 (2.810)] [KD 0.000 (0.000)] 2024-10-13 07:51:33,187 - Train: 93.42% [350600/375300] [280.3/300.0] [batch_t 0.423 (0.437)] [data_t 0.129] [optim_t 0.294] [lr 0.000062] [CE 2.677 (2.783)] [KD 0.000 (0.000)] 2024-10-13 07:51:54,728 - Train: 93.43% [350650/375300] [280.3/300.0] [batch_t 0.440 (0.431)] [data_t 0.137] [optim_t 0.303] [lr 0.000062] [CE 2.897 (2.811)] [KD 0.000 (0.000)] 2024-10-13 07:52:15,433 - Train: 93.45% [350700/375300] [280.3/300.0] [batch_t 0.404 (0.414)] [data_t 0.106] [optim_t 0.298] [lr 0.000061] [CE 2.730 (2.841)] [KD 0.000 (0.000)] 2024-10-13 07:52:36,853 - Train: 93.46% [350750/375300] [280.4/300.0] [batch_t 0.320 (0.428)] [data_t 0.016] [optim_t 0.304] [lr 0.000061] [CE 2.782 (2.784)] [KD 0.000 (0.000)] 2024-10-13 07:52:58,556 - Train: 93.47% [350800/375300] [280.4/300.0] [batch_t 0.379 (0.434)] [data_t 0.083] [optim_t 0.296] [lr 0.000061] [CE 2.741 (2.813)] [KD 0.000 (0.000)] 2024-10-13 07:53:20,910 - Train: 93.49% [350850/375300] [280.5/300.0] [batch_t 0.480 (0.447)] [data_t 0.016] [optim_t 0.464] [lr 0.000061] [CE 2.995 (2.802)] [KD 0.000 (0.000)] 2024-10-13 07:53:43,706 - Train: 93.50% [350900/375300] [280.5/300.0] [batch_t 0.459 (0.456)] [data_t 0.016] [optim_t 0.443] [lr 0.000061] [CE 2.593 (2.769)] [KD 0.000 (0.000)] 2024-10-13 07:54:06,082 - Train: 93.51% [350950/375300] [280.5/300.0] [batch_t 0.411 (0.447)] [data_t 0.015] [optim_t 0.395] [lr 0.000061] [CE 2.917 (2.801)] [KD 0.000 (0.000)] 2024-10-13 07:54:28,146 - Train: 93.53% [351000/375300] [280.6/300.0] [batch_t 0.450 (0.441)] [data_t 0.016] [optim_t 0.434] [lr 0.000061] [CE 2.658 (2.807)] [KD 0.000 (0.000)] 2024-10-13 07:54:49,970 - Train: 93.54% [351050/375300] [280.6/300.0] [batch_t 0.484 (0.436)] [data_t 0.016] [optim_t 0.468] [lr 0.000060] [CE 2.538 (2.792)] [KD 0.000 (0.000)] 2024-10-13 07:55:11,839 - Train: 93.55% [351100/375300] [280.7/300.0] [batch_t 0.459 (0.437)] [data_t 0.016] [optim_t 0.443] [lr 0.000060] [CE 2.683 (2.870)] [KD 0.000 (0.000)] 2024-10-13 07:55:34,012 - Train: 93.57% [351150/375300] [280.7/300.0] [batch_t 0.463 (0.443)] [data_t 0.016] [optim_t 0.447] [lr 0.000060] [CE 2.657 (2.809)] [KD 0.000 (0.000)] 2024-10-13 07:55:56,061 - Train: 93.58% [351200/375300] [280.7/300.0] [batch_t 0.501 (0.441)] [data_t 0.015] [optim_t 0.486] [lr 0.000060] [CE 2.854 (2.830)] [KD 0.000 (0.000)] 2024-10-13 07:56:18,048 - Train: 93.59% [351250/375300] [280.8/300.0] [batch_t 0.411 (0.440)] [data_t 0.015] [optim_t 0.396] [lr 0.000060] [CE 2.611 (2.801)] [KD 0.000 (0.000)] 2024-10-13 07:56:40,961 - Train: 93.61% [351300/375300] [280.8/300.0] [batch_t 0.317 (0.458)] [data_t 0.016] [optim_t 0.301] [lr 0.000060] [CE 2.830 (2.787)] [KD 0.000 (0.000)] 2024-10-13 07:57:02,847 - Train: 93.62% [351350/375300] [280.9/300.0] [batch_t 0.372 (0.438)] [data_t 0.016] [optim_t 0.356] [lr 0.000060] [CE 2.938 (2.794)] [KD 0.000 (0.000)] 2024-10-13 07:57:25,836 - Train: 93.63% [351400/375300] [280.9/300.0] [batch_t 0.427 (0.460)] [data_t 0.016] [optim_t 0.411] [lr 0.000060] [CE 2.704 (2.815)] [KD 0.000 (0.000)] 2024-10-13 07:57:47,652 - Train: 93.65% [351450/375300] [280.9/300.0] [batch_t 0.476 (0.436)] [data_t 0.016] [optim_t 0.461] [lr 0.000059] [CE 2.846 (2.816)] [KD 0.000 (0.000)] 2024-10-13 07:58:08,834 - Train: 93.66% [351500/375300] [281.0/300.0] [batch_t 0.413 (0.423)] [data_t 0.016] [optim_t 0.397] [lr 0.000059] [CE 2.770 (2.775)] [KD 0.000 (0.000)] 2024-10-13 07:58:42,495 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.427)] [top1_cnt 41049] [top5_cnt 48068] [top_all 50000] 2024-10-13 07:58:42,496 - net: 82.098 (96.136) 2024-10-13 07:59:04,522 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.431)] [top1_cnt 41215] [top5_cnt 48151] [top_all 50000] 2024-10-13 07:59:04,522 - net_E: 82.430 (96.302) 2024-10-13 07:59:04,693 - Max [top1: 82.104 (epoch: 280)] [top1-ema: 82.432 (epoch: 280)] 2024-10-13 07:59:04,694 - ==> Total time: 1 day, 20:12:08 Eta: 2:59:19 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 07:59:18,802 - Train: 93.67% [351550/375300] [281.0/300.0] [batch_t 0.318 (0.582)] [data_t 0.016] [optim_t 0.302] [lr 0.000059] [CE 2.640 (2.770)] [KD 0.000 (0.000)] 2024-10-13 07:59:40,698 - Train: 93.69% [351600/375300] [281.1/300.0] [batch_t 0.454 (0.438)] [data_t 0.016] [optim_t 0.438] [lr 0.000059] [CE 2.494 (2.784)] [KD 0.000 (0.000)] 2024-10-13 08:00:03,002 - Train: 93.70% [351650/375300] [281.1/300.0] [batch_t 0.483 (0.446)] [data_t 0.016] [optim_t 0.467] [lr 0.000059] [CE 3.071 (2.789)] [KD 0.000 (0.000)] 2024-10-13 08:00:24,516 - Train: 93.71% [351700/375300] [281.1/300.0] [batch_t 0.415 (0.430)] [data_t 0.016] [optim_t 0.399] [lr 0.000059] [CE 2.655 (2.797)] [KD 0.000 (0.000)] 2024-10-13 08:00:46,200 - Train: 93.73% [351750/375300] [281.2/300.0] [batch_t 0.434 (0.434)] [data_t 0.015] [optim_t 0.418] [lr 0.000059] [CE 2.936 (2.826)] [KD 0.000 (0.000)] 2024-10-13 08:01:08,583 - Train: 93.74% [351800/375300] [281.2/300.0] [batch_t 0.343 (0.448)] [data_t 0.015] [optim_t 0.328] [lr 0.000059] [CE 2.809 (2.780)] [KD 0.000 (0.000)] 2024-10-13 08:01:30,648 - Train: 93.75% [351850/375300] [281.3/300.0] [batch_t 0.414 (0.441)] [data_t 0.016] [optim_t 0.398] [lr 0.000059] [CE 2.841 (2.796)] [KD 0.000 (0.000)] 2024-10-13 08:01:52,799 - Train: 93.76% [351900/375300] [281.3/300.0] [batch_t 0.483 (0.443)] [data_t 0.015] [optim_t 0.468] [lr 0.000058] [CE 2.631 (2.745)] [KD 0.000 (0.000)] 2024-10-13 08:02:15,715 - Train: 93.78% [351950/375300] [281.3/300.0] [batch_t 0.541 (0.458)] [data_t 0.015] [optim_t 0.526] [lr 0.000058] [CE 2.826 (2.758)] [KD 0.000 (0.000)] 2024-10-13 08:02:37,716 - Train: 93.79% [352000/375300] [281.4/300.0] [batch_t 0.481 (0.440)] [data_t 0.015] [optim_t 0.466] [lr 0.000058] [CE 2.658 (2.783)] [KD 0.000 (0.000)] 2024-10-13 08:02:59,622 - Train: 93.80% [352050/375300] [281.4/300.0] [batch_t 0.521 (0.438)] [data_t 0.016] [optim_t 0.505] [lr 0.000058] [CE 2.945 (2.824)] [KD 0.000 (0.000)] 2024-10-13 08:03:22,129 - Train: 93.82% [352100/375300] [281.5/300.0] [batch_t 0.452 (0.450)] [data_t 0.015] [optim_t 0.436] [lr 0.000058] [CE 2.864 (2.818)] [KD 0.000 (0.000)] 2024-10-13 08:03:44,278 - Train: 93.83% [352150/375300] [281.5/300.0] [batch_t 0.468 (0.443)] [data_t 0.015] [optim_t 0.453] [lr 0.000058] [CE 2.899 (2.789)] [KD 0.000 (0.000)] 2024-10-13 08:04:06,248 - Train: 93.84% [352200/375300] [281.5/300.0] [batch_t 0.457 (0.439)] [data_t 0.015] [optim_t 0.441] [lr 0.000058] [CE 2.857 (2.825)] [KD 0.000 (0.000)] 2024-10-13 08:04:28,450 - Train: 93.86% [352250/375300] [281.6/300.0] [batch_t 0.481 (0.444)] [data_t 0.016] [optim_t 0.465] [lr 0.000058] [CE 2.917 (2.803)] [KD 0.000 (0.000)] 2024-10-13 08:04:50,608 - Train: 93.87% [352300/375300] [281.6/300.0] [batch_t 0.374 (0.443)] [data_t 0.016] [optim_t 0.358] [lr 0.000057] [CE 2.848 (2.790)] [KD 0.000 (0.000)] 2024-10-13 08:05:12,089 - Train: 93.88% [352350/375300] [281.7/300.0] [batch_t 0.482 (0.430)] [data_t 0.016] [optim_t 0.467] [lr 0.000057] [CE 3.046 (2.783)] [KD 0.000 (0.000)] 2024-10-13 08:05:34,096 - Train: 93.90% [352400/375300] [281.7/300.0] [batch_t 0.514 (0.440)] [data_t 0.016] [optim_t 0.498] [lr 0.000057] [CE 2.815 (2.770)] [KD 0.000 (0.000)] 2024-10-13 08:05:56,021 - Train: 93.91% [352450/375300] [281.7/300.0] [batch_t 0.467 (0.438)] [data_t 0.016] [optim_t 0.452] [lr 0.000057] [CE 2.927 (2.775)] [KD 0.000 (0.000)] 2024-10-13 08:06:18,170 - Train: 93.92% [352500/375300] [281.8/300.0] [batch_t 0.838 (0.443)] [data_t 0.016] [optim_t 0.823] [lr 0.000057] [CE 2.899 (2.793)] [KD 0.000 (0.000)] 2024-10-13 08:06:39,140 - Train: 93.94% [352550/375300] [281.8/300.0] [batch_t 0.472 (0.419)] [data_t 0.016] [optim_t 0.455] [lr 0.000057] [CE 2.545 (2.782)] [KD 0.000 (0.000)] 2024-10-13 08:07:00,848 - Train: 93.95% [352600/375300] [281.9/300.0] [batch_t 0.450 (0.434)] [data_t 0.105] [optim_t 0.345] [lr 0.000057] [CE 2.805 (2.807)] [KD 0.000 (0.000)] 2024-10-13 08:07:23,411 - Train: 93.96% [352650/375300] [281.9/300.0] [batch_t 0.315 (0.451)] [data_t 0.016] [optim_t 0.300] [lr 0.000057] [CE 2.876 (2.762)] [KD 0.000 (0.000)] 2024-10-13 08:07:45,925 - Train: 93.98% [352700/375300] [281.9/300.0] [batch_t 0.400 (0.450)] [data_t 0.100] [optim_t 0.300] [lr 0.000056] [CE 2.757 (2.797)] [KD 0.000 (0.000)] 2024-10-13 08:08:09,136 - Train: 93.99% [352750/375300] [282.0/300.0] [batch_t 0.494 (0.464)] [data_t 0.193] [optim_t 0.301] [lr 0.000056] [CE 2.760 (2.803)] [KD 0.000 (0.000)] 2024-10-13 08:08:44,638 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.451)] [top1_cnt 41109] [top5_cnt 48068] [top_all 50000] 2024-10-13 08:08:44,638 - net: 82.218 (96.136) 2024-10-13 08:09:06,274 - Test (net_E): 100.00% [50/50] [batch_t 0.133 (0.424)] [top1_cnt 41194] [top5_cnt 48142] [top_all 50000] 2024-10-13 08:09:06,275 - net_E: 82.388 (96.284) 2024-10-13 08:09:06,447 - Max [top1: 82.218 (epoch: 282)] [top1-ema: 82.432 (epoch: 280)] 2024-10-13 08:09:06,447 - ==> Total time: 1 day, 20:22:10 Eta: 2:49:55 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 08:09:21,299 - Train: 94.00% [352800/375300] [282.0/300.0] [batch_t 0.467 (0.429)] [data_t 0.171] [optim_t 0.296] [lr 0.000056] [CE 2.694 (2.738)] [KD 0.000 (0.000)] 2024-10-13 08:09:42,793 - Train: 94.02% [352850/375300] [282.1/300.0] [batch_t 0.582 (0.430)] [data_t 0.073] [optim_t 0.509] [lr 0.000056] [CE 2.638 (2.821)] [KD 0.000 (0.000)] 2024-10-13 08:10:04,812 - Train: 94.03% [352900/375300] [282.1/300.0] [batch_t 0.360 (0.440)] [data_t 0.016] [optim_t 0.344] [lr 0.000056] [CE 2.764 (2.791)] [KD 0.000 (0.000)] 2024-10-13 08:10:26,588 - Train: 94.04% [352950/375300] [282.1/300.0] [batch_t 0.434 (0.435)] [data_t 0.138] [optim_t 0.296] [lr 0.000056] [CE 3.076 (2.795)] [KD 0.000 (0.000)] 2024-10-13 08:10:48,712 - Train: 94.06% [353000/375300] [282.2/300.0] [batch_t 0.440 (0.442)] [data_t 0.145] [optim_t 0.296] [lr 0.000056] [CE 2.831 (2.800)] [KD 0.000 (0.000)] 2024-10-13 08:11:10,604 - Train: 94.07% [353050/375300] [282.2/300.0] [batch_t 0.452 (0.438)] [data_t 0.159] [optim_t 0.293] [lr 0.000056] [CE 2.658 (2.808)] [KD 0.000 (0.000)] 2024-10-13 08:11:32,049 - Train: 94.08% [353100/375300] [282.3/300.0] [batch_t 0.465 (0.429)] [data_t 0.171] [optim_t 0.294] [lr 0.000056] [CE 2.439 (2.774)] [KD 0.000 (0.000)] 2024-10-13 08:11:53,579 - Train: 94.10% [353150/375300] [282.3/300.0] [batch_t 0.424 (0.430)] [data_t 0.126] [optim_t 0.298] [lr 0.000055] [CE 2.712 (2.807)] [KD 0.000 (0.000)] 2024-10-13 08:12:15,975 - Train: 94.11% [353200/375300] [282.3/300.0] [batch_t 0.974 (0.448)] [data_t 0.675] [optim_t 0.299] [lr 0.000055] [CE 2.771 (2.775)] [KD 0.000 (0.000)] 2024-10-13 08:12:37,300 - Train: 94.12% [353250/375300] [282.4/300.0] [batch_t 0.461 (0.426)] [data_t 0.016] [optim_t 0.446] [lr 0.000055] [CE 2.719 (2.788)] [KD 0.000 (0.000)] 2024-10-13 08:12:59,162 - Train: 94.14% [353300/375300] [282.4/300.0] [batch_t 0.377 (0.437)] [data_t 0.080] [optim_t 0.297] [lr 0.000055] [CE 2.774 (2.812)] [KD 0.000 (0.000)] 2024-10-13 08:13:21,643 - Train: 94.15% [353350/375300] [282.5/300.0] [batch_t 0.498 (0.450)] [data_t 0.205] [optim_t 0.293] [lr 0.000055] [CE 2.980 (2.803)] [KD 0.000 (0.000)] 2024-10-13 08:13:43,378 - Train: 94.16% [353400/375300] [282.5/300.0] [batch_t 0.479 (0.435)] [data_t 0.184] [optim_t 0.296] [lr 0.000055] [CE 2.823 (2.794)] [KD 0.000 (0.000)] 2024-10-13 08:14:04,797 - Train: 94.18% [353450/375300] [282.5/300.0] [batch_t 0.436 (0.428)] [data_t 0.015] [optim_t 0.421] [lr 0.000055] [CE 2.909 (2.784)] [KD 0.000 (0.000)] 2024-10-13 08:14:26,316 - Train: 94.19% [353500/375300] [282.6/300.0] [batch_t 0.464 (0.430)] [data_t 0.016] [optim_t 0.448] [lr 0.000055] [CE 2.690 (2.795)] [KD 0.000 (0.000)] 2024-10-13 08:14:47,485 - Train: 94.20% [353550/375300] [282.6/300.0] [batch_t 0.554 (0.423)] [data_t 0.257] [optim_t 0.298] [lr 0.000055] [CE 2.775 (2.784)] [KD 0.000 (0.000)] 2024-10-13 08:15:09,731 - Train: 94.22% [353600/375300] [282.7/300.0] [batch_t 0.655 (0.445)] [data_t 0.363] [optim_t 0.292] [lr 0.000054] [CE 2.863 (2.809)] [KD 0.000 (0.000)] 2024-10-13 08:15:32,650 - Train: 94.23% [353650/375300] [282.7/300.0] [batch_t 0.462 (0.458)] [data_t 0.015] [optim_t 0.446] [lr 0.000054] [CE 2.725 (2.793)] [KD 0.000 (0.000)] 2024-10-13 08:15:54,485 - Train: 94.24% [353700/375300] [282.7/300.0] [batch_t 0.458 (0.437)] [data_t 0.015] [optim_t 0.443] [lr 0.000054] [CE 2.845 (2.815)] [KD 0.000 (0.000)] 2024-10-13 08:16:15,698 - Train: 94.26% [353750/375300] [282.8/300.0] [batch_t 0.580 (0.424)] [data_t 0.016] [optim_t 0.564] [lr 0.000054] [CE 2.771 (2.809)] [KD 0.000 (0.000)] 2024-10-13 08:16:38,498 - Train: 94.27% [353800/375300] [282.8/300.0] [batch_t 0.387 (0.456)] [data_t 0.016] [optim_t 0.372] [lr 0.000054] [CE 2.700 (2.775)] [KD 0.000 (0.000)] 2024-10-13 08:17:00,864 - Train: 94.28% [353850/375300] [282.9/300.0] [batch_t 0.480 (0.447)] [data_t 0.015] [optim_t 0.465] [lr 0.000054] [CE 2.614 (2.844)] [KD 0.000 (0.000)] 2024-10-13 08:17:23,088 - Train: 94.30% [353900/375300] [282.9/300.0] [batch_t 0.448 (0.444)] [data_t 0.016] [optim_t 0.433] [lr 0.000054] [CE 2.593 (2.758)] [KD 0.000 (0.000)] 2024-10-13 08:17:44,689 - Train: 94.31% [353950/375300] [282.9/300.0] [batch_t 0.470 (0.432)] [data_t 0.016] [optim_t 0.454] [lr 0.000054] [CE 3.114 (2.812)] [KD 0.000 (0.000)] 2024-10-13 08:18:06,021 - Train: 94.32% [354000/375300] [283.0/300.0] [batch_t 0.427 (0.426)] [data_t 0.016] [optim_t 0.411] [lr 0.000054] [CE 3.003 (2.790)] [KD 0.000 (0.000)] 2024-10-13 08:18:41,044 - Test (net): 100.00% [50/50] [batch_t 0.145 (0.430)] [top1_cnt 41122] [top5_cnt 48076] [top_all 50000] 2024-10-13 08:18:41,044 - net: 82.244 (96.152) 2024-10-13 08:19:02,776 - Test (net_E): 100.00% [50/50] [batch_t 0.150 (0.426)] [top1_cnt 41195] [top5_cnt 48144] [top_all 50000] 2024-10-13 08:19:02,777 - net_E: 82.390 (96.288) 2024-10-13 08:19:02,988 - Max [top1: 82.244 (epoch: 283)] [top1-ema: 82.432 (epoch: 280)] 2024-10-13 08:19:02,988 - ==> Total time: 1 day, 20:32:06 Eta: 2:40:30 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 08:19:17,756 - Train: 94.34% [354050/375300] [283.0/300.0] [batch_t 0.315 (0.451)] [data_t 0.016] [optim_t 0.300] [lr 0.000053] [CE 2.935 (2.796)] [KD 0.000 (0.000)] 2024-10-13 08:19:39,371 - Train: 94.35% [354100/375300] [283.1/300.0] [batch_t 0.321 (0.432)] [data_t 0.016] [optim_t 0.305] [lr 0.000053] [CE 2.754 (2.784)] [KD 0.000 (0.000)] 2024-10-13 08:20:01,976 - Train: 94.36% [354150/375300] [283.1/300.0] [batch_t 0.901 (0.452)] [data_t 0.016] [optim_t 0.885] [lr 0.000053] [CE 2.764 (2.777)] [KD 0.000 (0.000)] 2024-10-13 08:20:23,714 - Train: 94.38% [354200/375300] [283.1/300.0] [batch_t 0.381 (0.435)] [data_t 0.016] [optim_t 0.365] [lr 0.000053] [CE 3.062 (2.779)] [KD 0.000 (0.000)] 2024-10-13 08:20:45,582 - Train: 94.39% [354250/375300] [283.2/300.0] [batch_t 0.318 (0.437)] [data_t 0.016] [optim_t 0.302] [lr 0.000053] [CE 3.073 (2.795)] [KD 0.000 (0.000)] 2024-10-13 08:21:07,319 - Train: 94.40% [354300/375300] [283.2/300.0] [batch_t 0.368 (0.435)] [data_t 0.016] [optim_t 0.352] [lr 0.000053] [CE 3.028 (2.787)] [KD 0.000 (0.000)] 2024-10-13 08:21:29,575 - Train: 94.42% [354350/375300] [283.3/300.0] [batch_t 0.885 (0.445)] [data_t 0.016] [optim_t 0.869] [lr 0.000053] [CE 3.125 (2.804)] [KD 0.000 (0.000)] 2024-10-13 08:21:51,233 - Train: 94.43% [354400/375300] [283.3/300.0] [batch_t 0.524 (0.433)] [data_t 0.016] [optim_t 0.507] [lr 0.000053] [CE 2.985 (2.778)] [KD 0.000 (0.000)] 2024-10-13 08:22:13,039 - Train: 94.44% [354450/375300] [283.3/300.0] [batch_t 0.405 (0.436)] [data_t 0.016] [optim_t 0.388] [lr 0.000053] [CE 2.776 (2.794)] [KD 0.000 (0.000)] 2024-10-13 08:22:34,931 - Train: 94.46% [354500/375300] [283.4/300.0] [batch_t 0.375 (0.438)] [data_t 0.016] [optim_t 0.360] [lr 0.000052] [CE 2.804 (2.816)] [KD 0.000 (0.000)] 2024-10-13 08:22:56,341 - Train: 94.47% [354550/375300] [283.4/300.0] [batch_t 0.397 (0.428)] [data_t 0.016] [optim_t 0.382] [lr 0.000052] [CE 2.628 (2.784)] [KD 0.000 (0.000)] 2024-10-13 08:23:18,071 - Train: 94.48% [354600/375300] [283.5/300.0] [batch_t 0.404 (0.434)] [data_t 0.016] [optim_t 0.388] [lr 0.000052] [CE 2.902 (2.806)] [KD 0.000 (0.000)] 2024-10-13 08:23:40,211 - Train: 94.50% [354650/375300] [283.5/300.0] [batch_t 0.316 (0.443)] [data_t 0.016] [optim_t 0.300] [lr 0.000052] [CE 2.907 (2.818)] [KD 0.000 (0.000)] 2024-10-13 08:24:01,824 - Train: 94.51% [354700/375300] [283.5/300.0] [batch_t 0.455 (0.432)] [data_t 0.016] [optim_t 0.439] [lr 0.000052] [CE 2.981 (2.733)] [KD 0.000 (0.000)] 2024-10-13 08:24:23,525 - Train: 94.52% [354750/375300] [283.6/300.0] [batch_t 0.531 (0.434)] [data_t 0.016] [optim_t 0.515] [lr 0.000052] [CE 3.087 (2.815)] [KD 0.000 (0.000)] 2024-10-13 08:24:45,193 - Train: 94.54% [354800/375300] [283.6/300.0] [batch_t 0.317 (0.433)] [data_t 0.016] [optim_t 0.301] [lr 0.000052] [CE 2.639 (2.814)] [KD 0.000 (0.000)] 2024-10-13 08:25:06,879 - Train: 94.55% [354850/375300] [283.7/300.0] [batch_t 0.510 (0.434)] [data_t 0.016] [optim_t 0.494] [lr 0.000052] [CE 2.827 (2.748)] [KD 0.000 (0.000)] 2024-10-13 08:25:29,094 - Train: 94.56% [354900/375300] [283.7/300.0] [batch_t 0.315 (0.444)] [data_t 0.016] [optim_t 0.299] [lr 0.000052] [CE 3.026 (2.804)] [KD 0.000 (0.000)] 2024-10-13 08:25:51,445 - Train: 94.58% [354950/375300] [283.7/300.0] [batch_t 0.471 (0.447)] [data_t 0.015] [optim_t 0.455] [lr 0.000051] [CE 2.904 (2.807)] [KD 0.000 (0.000)] 2024-10-13 08:26:13,591 - Train: 94.59% [355000/375300] [283.8/300.0] [batch_t 0.447 (0.443)] [data_t 0.015] [optim_t 0.432] [lr 0.000051] [CE 2.674 (2.783)] [KD 0.000 (0.000)] 2024-10-13 08:26:35,008 - Train: 94.60% [355050/375300] [283.8/300.0] [batch_t 0.534 (0.428)] [data_t 0.016] [optim_t 0.518] [lr 0.000051] [CE 2.804 (2.816)] [KD 0.000 (0.000)] 2024-10-13 08:26:57,583 - Train: 94.62% [355100/375300] [283.9/300.0] [batch_t 0.413 (0.451)] [data_t 0.015] [optim_t 0.398] [lr 0.000051] [CE 2.931 (2.789)] [KD 0.000 (0.000)] 2024-10-13 08:27:20,477 - Train: 94.63% [355150/375300] [283.9/300.0] [batch_t 0.317 (0.458)] [data_t 0.016] [optim_t 0.301] [lr 0.000051] [CE 2.897 (2.799)] [KD 0.000 (0.000)] 2024-10-13 08:27:42,901 - Train: 94.64% [355200/375300] [283.9/300.0] [batch_t 0.319 (0.448)] [data_t 0.016] [optim_t 0.303] [lr 0.000051] [CE 2.325 (2.769)] [KD 0.000 (0.000)] 2024-10-13 08:28:04,481 - Train: 94.66% [355250/375300] [284.0/300.0] [batch_t 0.413 (0.431)] [data_t 0.016] [optim_t 0.397] [lr 0.000051] [CE 2.966 (2.779)] [KD 0.000 (0.000)] 2024-10-13 08:28:40,100 - Test (net): 100.00% [50/50] [batch_t 0.171 (0.441)] [top1_cnt 41015] [top5_cnt 48082] [top_all 50000] 2024-10-13 08:28:40,101 - net: 82.030 (96.164) 2024-10-13 08:29:02,262 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.434)] [top1_cnt 41201] [top5_cnt 48141] [top_all 50000] 2024-10-13 08:29:02,262 - net_E: 82.402 (96.282) 2024-10-13 08:29:02,442 - Max [top1: 82.244 (epoch: 283)] [top1-ema: 82.432 (epoch: 280)] 2024-10-13 08:29:02,442 - ==> Total time: 1 day, 20:42:06 Eta: 2:31:06 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 08:29:15,748 - Train: 94.67% [355300/375300] [284.0/300.0] [batch_t 0.318 (0.515)] [data_t 0.016] [optim_t 0.303] [lr 0.000051] [CE 2.700 (2.810)] [KD 0.000 (0.000)] 2024-10-13 08:29:38,114 - Train: 94.68% [355350/375300] [284.1/300.0] [batch_t 0.496 (0.447)] [data_t 0.016] [optim_t 0.481] [lr 0.000051] [CE 2.858 (2.763)] [KD 0.000 (0.000)] 2024-10-13 08:30:00,977 - Train: 94.70% [355400/375300] [284.1/300.0] [batch_t 0.445 (0.457)] [data_t 0.015] [optim_t 0.430] [lr 0.000051] [CE 2.921 (2.789)] [KD 0.000 (0.000)] 2024-10-13 08:30:22,337 - Train: 94.71% [355450/375300] [284.1/300.0] [batch_t 0.462 (0.427)] [data_t 0.016] [optim_t 0.447] [lr 0.000050] [CE 3.045 (2.787)] [KD 0.000 (0.000)] 2024-10-13 08:30:43,992 - Train: 94.72% [355500/375300] [284.2/300.0] [batch_t 0.438 (0.433)] [data_t 0.017] [optim_t 0.422] [lr 0.000050] [CE 2.589 (2.725)] [KD 0.000 (0.000)] 2024-10-13 08:31:06,061 - Train: 94.74% [355550/375300] [284.2/300.0] [batch_t 0.520 (0.441)] [data_t 0.015] [optim_t 0.505] [lr 0.000050] [CE 2.655 (2.780)] [KD 0.000 (0.000)] 2024-10-13 08:31:28,421 - Train: 94.75% [355600/375300] [284.3/300.0] [batch_t 0.450 (0.447)] [data_t 0.016] [optim_t 0.435] [lr 0.000050] [CE 2.909 (2.805)] [KD 0.000 (0.000)] 2024-10-13 08:31:50,373 - Train: 94.76% [355650/375300] [284.3/300.0] [batch_t 0.428 (0.439)] [data_t 0.016] [optim_t 0.412] [lr 0.000050] [CE 2.751 (2.785)] [KD 0.000 (0.000)] 2024-10-13 08:32:11,678 - Train: 94.78% [355700/375300] [284.3/300.0] [batch_t 0.478 (0.426)] [data_t 0.016] [optim_t 0.462] [lr 0.000050] [CE 2.727 (2.811)] [KD 0.000 (0.000)] 2024-10-13 08:32:33,349 - Train: 94.79% [355750/375300] [284.4/300.0] [batch_t 0.397 (0.433)] [data_t 0.016] [optim_t 0.382] [lr 0.000050] [CE 2.606 (2.797)] [KD 0.000 (0.000)] 2024-10-13 08:32:55,334 - Train: 94.80% [355800/375300] [284.4/300.0] [batch_t 0.416 (0.440)] [data_t 0.016] [optim_t 0.400] [lr 0.000050] [CE 2.592 (2.791)] [KD 0.000 (0.000)] 2024-10-13 08:33:16,634 - Train: 94.82% [355850/375300] [284.5/300.0] [batch_t 0.413 (0.426)] [data_t 0.016] [optim_t 0.397] [lr 0.000050] [CE 2.807 (2.778)] [KD 0.000 (0.000)] 2024-10-13 08:33:38,010 - Train: 94.83% [355900/375300] [284.5/300.0] [batch_t 0.499 (0.427)] [data_t 0.015] [optim_t 0.484] [lr 0.000050] [CE 2.832 (2.818)] [KD 0.000 (0.000)] 2024-10-13 08:33:59,417 - Train: 94.84% [355950/375300] [284.5/300.0] [batch_t 0.402 (0.428)] [data_t 0.016] [optim_t 0.386] [lr 0.000049] [CE 2.735 (2.762)] [KD 0.000 (0.000)] 2024-10-13 08:34:21,530 - Train: 94.86% [356000/375300] [284.6/300.0] [batch_t 0.312 (0.442)] [data_t 0.015] [optim_t 0.297] [lr 0.000049] [CE 3.043 (2.763)] [KD 0.000 (0.000)] 2024-10-13 08:34:43,525 - Train: 94.87% [356050/375300] [284.6/300.0] [batch_t 0.397 (0.440)] [data_t 0.016] [optim_t 0.382] [lr 0.000049] [CE 2.905 (2.830)] [KD 0.000 (0.000)] 2024-10-13 08:35:05,159 - Train: 94.88% [356100/375300] [284.7/300.0] [batch_t 0.357 (0.433)] [data_t 0.016] [optim_t 0.341] [lr 0.000049] [CE 2.776 (2.801)] [KD 0.000 (0.000)] 2024-10-13 08:35:28,064 - Train: 94.90% [356150/375300] [284.7/300.0] [batch_t 0.457 (0.458)] [data_t 0.016] [optim_t 0.442] [lr 0.000049] [CE 2.648 (2.826)] [KD 0.000 (0.000)] 2024-10-13 08:35:49,354 - Train: 94.91% [356200/375300] [284.7/300.0] [batch_t 0.465 (0.426)] [data_t 0.016] [optim_t 0.449] [lr 0.000049] [CE 2.543 (2.780)] [KD 0.000 (0.000)] 2024-10-13 08:36:11,623 - Train: 94.92% [356250/375300] [284.8/300.0] [batch_t 0.499 (0.445)] [data_t 0.016] [optim_t 0.483] [lr 0.000049] [CE 2.862 (2.780)] [KD 0.000 (0.000)] 2024-10-13 08:36:33,841 - Train: 94.94% [356300/375300] [284.8/300.0] [batch_t 0.451 (0.444)] [data_t 0.016] [optim_t 0.436] [lr 0.000049] [CE 3.060 (2.788)] [KD 0.000 (0.000)] 2024-10-13 08:36:55,910 - Train: 94.95% [356350/375300] [284.9/300.0] [batch_t 0.435 (0.441)] [data_t 0.016] [optim_t 0.419] [lr 0.000049] [CE 2.256 (2.753)] [KD 0.000 (0.000)] 2024-10-13 08:37:17,896 - Train: 94.96% [356400/375300] [284.9/300.0] [batch_t 0.377 (0.440)] [data_t 0.015] [optim_t 0.362] [lr 0.000049] [CE 2.888 (2.806)] [KD 0.000 (0.000)] 2024-10-13 08:37:39,830 - Train: 94.98% [356450/375300] [284.9/300.0] [batch_t 0.466 (0.439)] [data_t 0.016] [optim_t 0.450] [lr 0.000048] [CE 2.920 (2.774)] [KD 0.000 (0.000)] 2024-10-13 08:38:02,223 - Train: 94.99% [356500/375300] [285.0/300.0] [batch_t 0.451 (0.448)] [data_t 0.015] [optim_t 0.436] [lr 0.000048] [CE 2.466 (2.807)] [KD 0.000 (0.000)] 2024-10-13 08:38:38,918 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.448)] [top1_cnt 41040] [top5_cnt 48081] [top_all 50000] 2024-10-13 08:38:38,918 - net: 82.080 (96.162) 2024-10-13 08:39:00,763 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.428)] [top1_cnt 41200] [top5_cnt 48125] [top_all 50000] 2024-10-13 08:39:00,763 - net_E: 82.400 (96.250) 2024-10-13 08:39:00,948 - Max [top1: 82.244 (epoch: 283)] [top1-ema: 82.432 (epoch: 280)] 2024-10-13 08:39:00,948 - ==> Total time: 1 day, 20:52:04 Eta: 2:21:41 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 08:39:16,262 - Train: 95.00% [356550/375300] [285.0/300.0] [batch_t 0.319 (0.459)] [data_t 0.016] [optim_t 0.303] [lr 0.000048] [CE 2.781 (2.779)] [KD 0.000 (0.000)] 2024-10-13 08:39:38,272 - Train: 95.02% [356600/375300] [285.1/300.0] [batch_t 0.526 (0.440)] [data_t 0.016] [optim_t 0.510] [lr 0.000048] [CE 2.802 (2.749)] [KD 0.000 (0.000)] 2024-10-13 08:40:01,215 - Train: 95.03% [356650/375300] [285.1/300.0] [batch_t 0.506 (0.459)] [data_t 0.015] [optim_t 0.491] [lr 0.000048] [CE 2.521 (2.770)] [KD 0.000 (0.000)] 2024-10-13 08:40:23,021 - Train: 95.04% [356700/375300] [285.1/300.0] [batch_t 0.316 (0.436)] [data_t 0.015] [optim_t 0.301] [lr 0.000048] [CE 2.897 (2.816)] [KD 0.000 (0.000)] 2024-10-13 08:40:45,224 - Train: 95.06% [356750/375300] [285.2/300.0] [batch_t 0.366 (0.444)] [data_t 0.016] [optim_t 0.351] [lr 0.000048] [CE 2.782 (2.804)] [KD 0.000 (0.000)] 2024-10-13 08:41:06,867 - Train: 95.07% [356800/375300] [285.2/300.0] [batch_t 0.454 (0.433)] [data_t 0.015] [optim_t 0.438] [lr 0.000048] [CE 2.782 (2.793)] [KD 0.000 (0.000)] 2024-10-13 08:41:28,518 - Train: 95.08% [356850/375300] [285.3/300.0] [batch_t 0.440 (0.433)] [data_t 0.016] [optim_t 0.424] [lr 0.000048] [CE 3.171 (2.782)] [KD 0.000 (0.000)] 2024-10-13 08:41:50,513 - Train: 95.10% [356900/375300] [285.3/300.0] [batch_t 0.528 (0.440)] [data_t 0.016] [optim_t 0.512] [lr 0.000048] [CE 2.980 (2.807)] [KD 0.000 (0.000)] 2024-10-13 08:42:13,056 - Train: 95.11% [356950/375300] [285.3/300.0] [batch_t 0.476 (0.451)] [data_t 0.016] [optim_t 0.460] [lr 0.000047] [CE 2.859 (2.799)] [KD 0.000 (0.000)] 2024-10-13 08:42:35,213 - Train: 95.12% [357000/375300] [285.4/300.0] [batch_t 0.401 (0.443)] [data_t 0.015] [optim_t 0.385] [lr 0.000047] [CE 2.658 (2.777)] [KD 0.000 (0.000)] 2024-10-13 08:42:57,619 - Train: 95.14% [357050/375300] [285.4/300.0] [batch_t 0.421 (0.448)] [data_t 0.016] [optim_t 0.406] [lr 0.000047] [CE 2.722 (2.781)] [KD 0.000 (0.000)] 2024-10-13 08:43:20,148 - Train: 95.15% [357100/375300] [285.5/300.0] [batch_t 0.473 (0.450)] [data_t 0.015] [optim_t 0.457] [lr 0.000047] [CE 2.750 (2.749)] [KD 0.000 (0.000)] 2024-10-13 08:43:42,347 - Train: 95.16% [357150/375300] [285.5/300.0] [batch_t 0.388 (0.444)] [data_t 0.016] [optim_t 0.372] [lr 0.000047] [CE 2.711 (2.784)] [KD 0.000 (0.000)] 2024-10-13 08:44:04,373 - Train: 95.18% [357200/375300] [285.5/300.0] [batch_t 0.434 (0.440)] [data_t 0.016] [optim_t 0.418] [lr 0.000047] [CE 2.792 (2.813)] [KD 0.000 (0.000)] 2024-10-13 08:44:26,702 - Train: 95.19% [357250/375300] [285.6/300.0] [batch_t 0.466 (0.446)] [data_t 0.015] [optim_t 0.451] [lr 0.000047] [CE 3.211 (2.807)] [KD 0.000 (0.000)] 2024-10-13 08:44:48,973 - Train: 95.20% [357300/375300] [285.6/300.0] [batch_t 0.496 (0.445)] [data_t 0.015] [optim_t 0.481] [lr 0.000047] [CE 2.779 (2.768)] [KD 0.000 (0.000)] 2024-10-13 08:45:11,048 - Train: 95.22% [357350/375300] [285.7/300.0] [batch_t 0.384 (0.441)] [data_t 0.016] [optim_t 0.369] [lr 0.000047] [CE 2.784 (2.774)] [KD 0.000 (0.000)] 2024-10-13 08:45:32,460 - Train: 95.23% [357400/375300] [285.7/300.0] [batch_t 0.469 (0.428)] [data_t 0.015] [optim_t 0.454] [lr 0.000047] [CE 2.374 (2.791)] [KD 0.000 (0.000)] 2024-10-13 08:45:53,355 - Train: 95.24% [357450/375300] [285.7/300.0] [batch_t 0.330 (0.418)] [data_t 0.016] [optim_t 0.314] [lr 0.000047] [CE 2.932 (2.820)] [KD 0.000 (0.000)] 2024-10-13 08:46:14,899 - Train: 95.26% [357500/375300] [285.8/300.0] [batch_t 0.313 (0.431)] [data_t 0.015] [optim_t 0.298] [lr 0.000046] [CE 2.501 (2.753)] [KD 0.000 (0.000)] 2024-10-13 08:46:37,154 - Train: 95.27% [357550/375300] [285.8/300.0] [batch_t 0.925 (0.445)] [data_t 0.016] [optim_t 0.909] [lr 0.000046] [CE 2.738 (2.759)] [KD 0.000 (0.000)] 2024-10-13 08:46:58,767 - Train: 95.28% [357600/375300] [285.9/300.0] [batch_t 0.419 (0.432)] [data_t 0.016] [optim_t 0.403] [lr 0.000046] [CE 2.784 (2.769)] [KD 0.000 (0.000)] 2024-10-13 08:47:21,232 - Train: 95.30% [357650/375300] [285.9/300.0] [batch_t 0.484 (0.449)] [data_t 0.016] [optim_t 0.468] [lr 0.000046] [CE 2.681 (2.809)] [KD 0.000 (0.000)] 2024-10-13 08:47:43,157 - Train: 95.31% [357700/375300] [285.9/300.0] [batch_t 0.440 (0.438)] [data_t 0.015] [optim_t 0.425] [lr 0.000046] [CE 2.916 (2.796)] [KD 0.000 (0.000)] 2024-10-13 08:48:05,478 - Train: 95.32% [357750/375300] [286.0/300.0] [batch_t 0.319 (0.446)] [data_t 0.015] [optim_t 0.303] [lr 0.000046] [CE 2.762 (2.782)] [KD 0.000 (0.000)] 2024-10-13 08:48:43,361 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.465)] [top1_cnt 41140] [top5_cnt 48078] [top_all 50000] 2024-10-13 08:48:43,362 - net: 82.280 (96.156) 2024-10-13 08:49:05,413 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.434)] [top1_cnt 41223] [top5_cnt 48132] [top_all 50000] 2024-10-13 08:49:05,413 - net_E: 82.446 (96.264) 2024-10-13 08:49:05,606 - Max [top1: 82.280 (epoch: 286)] [top1-ema: 82.446 (epoch: 286)] 2024-10-13 08:49:05,607 - ==> Total time: 1 day, 21:02:09 Eta: 2:12:16 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 08:49:18,968 - Train: 95.34% [357800/375300] [286.0/300.0] [batch_t 0.323 (0.516)] [data_t 0.016] [optim_t 0.308] [lr 0.000046] [CE 2.809 (2.787)] [KD 0.000 (0.000)] 2024-10-13 08:49:39,568 - Train: 95.35% [357850/375300] [286.1/300.0] [batch_t 0.400 (0.412)] [data_t 0.102] [optim_t 0.298] [lr 0.000046] [CE 2.996 (2.809)] [KD 0.000 (0.000)] 2024-10-13 08:50:02,159 - Train: 95.36% [357900/375300] [286.1/300.0] [batch_t 0.392 (0.452)] [data_t 0.092] [optim_t 0.300] [lr 0.000046] [CE 2.980 (2.783)] [KD 0.000 (0.000)] 2024-10-13 08:50:24,292 - Train: 95.38% [357950/375300] [286.1/300.0] [batch_t 0.457 (0.443)] [data_t 0.016] [optim_t 0.441] [lr 0.000046] [CE 2.801 (2.766)] [KD 0.000 (0.000)] 2024-10-13 08:50:46,251 - Train: 95.39% [358000/375300] [286.2/300.0] [batch_t 0.389 (0.439)] [data_t 0.015] [optim_t 0.374] [lr 0.000046] [CE 2.862 (2.806)] [KD 0.000 (0.000)] 2024-10-13 08:51:08,172 - Train: 95.40% [358050/375300] [286.2/300.0] [batch_t 0.457 (0.438)] [data_t 0.016] [optim_t 0.441] [lr 0.000045] [CE 3.067 (2.772)] [KD 0.000 (0.000)] 2024-10-13 08:51:29,577 - Train: 95.42% [358100/375300] [286.3/300.0] [batch_t 0.471 (0.428)] [data_t 0.016] [optim_t 0.455] [lr 0.000045] [CE 2.818 (2.793)] [KD 0.000 (0.000)] 2024-10-13 08:51:50,944 - Train: 95.43% [358150/375300] [286.3/300.0] [batch_t 0.433 (0.427)] [data_t 0.016] [optim_t 0.417] [lr 0.000045] [CE 2.611 (2.761)] [KD 0.000 (0.000)] 2024-10-13 08:52:12,141 - Train: 95.44% [358200/375300] [286.3/300.0] [batch_t 0.466 (0.424)] [data_t 0.016] [optim_t 0.450] [lr 0.000045] [CE 2.615 (2.830)] [KD 0.000 (0.000)] 2024-10-13 08:52:33,130 - Train: 95.46% [358250/375300] [286.4/300.0] [batch_t 0.416 (0.420)] [data_t 0.016] [optim_t 0.401] [lr 0.000045] [CE 2.951 (2.779)] [KD 0.000 (0.000)] 2024-10-13 08:52:54,719 - Train: 95.47% [358300/375300] [286.4/300.0] [batch_t 0.447 (0.432)] [data_t 0.147] [optim_t 0.300] [lr 0.000045] [CE 2.970 (2.781)] [KD 0.000 (0.000)] 2024-10-13 08:53:16,454 - Train: 95.48% [358350/375300] [286.5/300.0] [batch_t 0.432 (0.435)] [data_t 0.132] [optim_t 0.300] [lr 0.000045] [CE 2.845 (2.809)] [KD 0.000 (0.000)] 2024-10-13 08:53:37,700 - Train: 95.50% [358400/375300] [286.5/300.0] [batch_t 0.367 (0.425)] [data_t 0.067] [optim_t 0.300] [lr 0.000045] [CE 2.767 (2.787)] [KD 0.000 (0.000)] 2024-10-13 08:53:59,020 - Train: 95.51% [358450/375300] [286.5/300.0] [batch_t 0.416 (0.426)] [data_t 0.015] [optim_t 0.400] [lr 0.000045] [CE 2.843 (2.781)] [KD 0.000 (0.000)] 2024-10-13 08:54:20,044 - Train: 95.52% [358500/375300] [286.6/300.0] [batch_t 0.423 (0.420)] [data_t 0.016] [optim_t 0.407] [lr 0.000045] [CE 2.815 (2.783)] [KD 0.000 (0.000)] 2024-10-13 08:54:41,546 - Train: 95.54% [358550/375300] [286.6/300.0] [batch_t 0.465 (0.430)] [data_t 0.015] [optim_t 0.450] [lr 0.000045] [CE 2.827 (2.798)] [KD 0.000 (0.000)] 2024-10-13 08:55:03,243 - Train: 95.55% [358600/375300] [286.7/300.0] [batch_t 0.487 (0.434)] [data_t 0.016] [optim_t 0.471] [lr 0.000044] [CE 2.749 (2.760)] [KD 0.000 (0.000)] 2024-10-13 08:55:25,544 - Train: 95.56% [358650/375300] [286.7/300.0] [batch_t 0.497 (0.446)] [data_t 0.016] [optim_t 0.481] [lr 0.000044] [CE 2.958 (2.801)] [KD 0.000 (0.000)] 2024-10-13 08:55:47,166 - Train: 95.58% [358700/375300] [286.7/300.0] [batch_t 0.457 (0.432)] [data_t 0.016] [optim_t 0.441] [lr 0.000044] [CE 2.759 (2.792)] [KD 0.000 (0.000)] 2024-10-13 08:56:08,804 - Train: 95.59% [358750/375300] [286.8/300.0] [batch_t 0.474 (0.433)] [data_t 0.016] [optim_t 0.459] [lr 0.000044] [CE 2.898 (2.752)] [KD 0.000 (0.000)] 2024-10-13 08:56:30,496 - Train: 95.60% [358800/375300] [286.8/300.0] [batch_t 0.390 (0.434)] [data_t 0.016] [optim_t 0.374] [lr 0.000044] [CE 2.873 (2.804)] [KD 0.000 (0.000)] 2024-10-13 08:56:52,521 - Train: 95.62% [358850/375300] [286.9/300.0] [batch_t 0.443 (0.440)] [data_t 0.016] [optim_t 0.427] [lr 0.000044] [CE 2.868 (2.832)] [KD 0.000 (0.000)] 2024-10-13 08:57:14,527 - Train: 95.63% [358900/375300] [286.9/300.0] [batch_t 0.391 (0.440)] [data_t 0.016] [optim_t 0.376] [lr 0.000044] [CE 2.650 (2.765)] [KD 0.000 (0.000)] 2024-10-13 08:57:36,489 - Train: 95.64% [358950/375300] [286.9/300.0] [batch_t 0.405 (0.439)] [data_t 0.016] [optim_t 0.389] [lr 0.000044] [CE 2.954 (2.785)] [KD 0.000 (0.000)] 2024-10-13 08:57:58,543 - Train: 95.66% [359000/375300] [287.0/300.0] [batch_t 0.312 (0.441)] [data_t 0.016] [optim_t 0.297] [lr 0.000044] [CE 2.925 (2.785)] [KD 0.000 (0.000)] 2024-10-13 08:58:36,336 - Test (net): 100.00% [50/50] [batch_t 0.155 (0.460)] [top1_cnt 41057] [top5_cnt 48057] [top_all 50000] 2024-10-13 08:58:36,336 - net: 82.114 (96.114) 2024-10-13 08:58:58,588 - Test (net_E): 100.00% [50/50] [batch_t 0.155 (0.436)] [top1_cnt 41237] [top5_cnt 48140] [top_all 50000] 2024-10-13 08:58:58,588 - net_E: 82.474 (96.280) 2024-10-13 08:58:58,759 - Max [top1: 82.280 (epoch: 286)] [top1-ema: 82.474 (epoch: 287)] 2024-10-13 08:58:58,759 - ==> Total time: 1 day, 21:12:02 Eta: 2:02:50 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 08:59:13,043 - Train: 95.67% [359050/375300] [287.0/300.0] [batch_t 0.316 (0.447)] [data_t 0.016] [optim_t 0.301] [lr 0.000044] [CE 2.992 (2.787)] [KD 0.000 (0.000)] 2024-10-13 08:59:33,909 - Train: 95.68% [359100/375300] [287.1/300.0] [batch_t 0.439 (0.417)] [data_t 0.140] [optim_t 0.298] [lr 0.000044] [CE 2.756 (2.725)] [KD 0.000 (0.000)] 2024-10-13 08:59:56,118 - Train: 95.70% [359150/375300] [287.1/300.0] [batch_t 0.902 (0.444)] [data_t 0.016] [optim_t 0.886] [lr 0.000044] [CE 2.572 (2.764)] [KD 0.000 (0.000)] 2024-10-13 09:00:17,934 - Train: 95.71% [359200/375300] [287.1/300.0] [batch_t 0.366 (0.436)] [data_t 0.016] [optim_t 0.351] [lr 0.000043] [CE 3.010 (2.826)] [KD 0.000 (0.000)] 2024-10-13 09:00:39,923 - Train: 95.72% [359250/375300] [287.2/300.0] [batch_t 0.507 (0.440)] [data_t 0.016] [optim_t 0.491] [lr 0.000043] [CE 2.772 (2.789)] [KD 0.000 (0.000)] 2024-10-13 09:01:01,714 - Train: 95.74% [359300/375300] [287.2/300.0] [batch_t 0.340 (0.436)] [data_t 0.016] [optim_t 0.324] [lr 0.000043] [CE 2.701 (2.726)] [KD 0.000 (0.000)] 2024-10-13 09:01:23,236 - Train: 95.75% [359350/375300] [287.3/300.0] [batch_t 0.427 (0.430)] [data_t 0.015] [optim_t 0.412] [lr 0.000043] [CE 2.874 (2.749)] [KD 0.000 (0.000)] 2024-10-13 09:01:44,039 - Train: 95.76% [359400/375300] [287.3/300.0] [batch_t 0.426 (0.416)] [data_t 0.016] [optim_t 0.410] [lr 0.000043] [CE 2.813 (2.795)] [KD 0.000 (0.000)] 2024-10-13 09:02:05,954 - Train: 95.78% [359450/375300] [287.3/300.0] [batch_t 0.315 (0.438)] [data_t 0.016] [optim_t 0.299] [lr 0.000043] [CE 2.481 (2.761)] [KD 0.000 (0.000)] 2024-10-13 09:02:27,706 - Train: 95.79% [359500/375300] [287.4/300.0] [batch_t 0.490 (0.435)] [data_t 0.016] [optim_t 0.474] [lr 0.000043] [CE 2.861 (2.768)] [KD 0.000 (0.000)] 2024-10-13 09:02:50,411 - Train: 95.80% [359550/375300] [287.4/300.0] [batch_t 0.470 (0.454)] [data_t 0.016] [optim_t 0.454] [lr 0.000043] [CE 2.746 (2.797)] [KD 0.000 (0.000)] 2024-10-13 09:03:11,493 - Train: 95.82% [359600/375300] [287.5/300.0] [batch_t 0.365 (0.421)] [data_t 0.016] [optim_t 0.349] [lr 0.000043] [CE 2.961 (2.776)] [KD 0.000 (0.000)] 2024-10-13 09:03:32,213 - Train: 95.83% [359650/375300] [287.5/300.0] [batch_t 0.436 (0.414)] [data_t 0.016] [optim_t 0.420] [lr 0.000043] [CE 2.667 (2.744)] [KD 0.000 (0.000)] 2024-10-13 09:03:54,113 - Train: 95.84% [359700/375300] [287.5/300.0] [batch_t 0.313 (0.438)] [data_t 0.016] [optim_t 0.297] [lr 0.000043] [CE 2.843 (2.785)] [KD 0.000 (0.000)] 2024-10-13 09:04:15,601 - Train: 95.86% [359750/375300] [287.6/300.0] [batch_t 0.502 (0.430)] [data_t 0.016] [optim_t 0.486] [lr 0.000043] [CE 2.736 (2.779)] [KD 0.000 (0.000)] 2024-10-13 09:04:37,579 - Train: 95.87% [359800/375300] [287.6/300.0] [batch_t 0.432 (0.439)] [data_t 0.015] [optim_t 0.416] [lr 0.000042] [CE 2.984 (2.780)] [KD 0.000 (0.000)] 2024-10-13 09:04:58,692 - Train: 95.88% [359850/375300] [287.6/300.0] [batch_t 0.320 (0.422)] [data_t 0.015] [optim_t 0.304] [lr 0.000042] [CE 2.701 (2.755)] [KD 0.000 (0.000)] 2024-10-13 09:05:20,217 - Train: 95.90% [359900/375300] [287.7/300.0] [batch_t 0.478 (0.430)] [data_t 0.015] [optim_t 0.463] [lr 0.000042] [CE 2.819 (2.782)] [KD 0.000 (0.000)] 2024-10-13 09:05:42,744 - Train: 95.91% [359950/375300] [287.7/300.0] [batch_t 0.490 (0.450)] [data_t 0.016] [optim_t 0.474] [lr 0.000042] [CE 2.486 (2.789)] [KD 0.000 (0.000)] 2024-10-13 09:06:05,013 - Train: 95.92% [360000/375300] [287.8/300.0] [batch_t 0.440 (0.445)] [data_t 0.016] [optim_t 0.424] [lr 0.000042] [CE 2.750 (2.754)] [KD 0.000 (0.000)] 2024-10-13 09:06:27,656 - Train: 95.94% [360050/375300] [287.8/300.0] [batch_t 0.315 (0.453)] [data_t 0.016] [optim_t 0.299] [lr 0.000042] [CE 3.052 (2.777)] [KD 0.000 (0.000)] 2024-10-13 09:06:49,540 - Train: 95.95% [360100/375300] [287.8/300.0] [batch_t 0.428 (0.438)] [data_t 0.016] [optim_t 0.412] [lr 0.000042] [CE 2.949 (2.760)] [KD 0.000 (0.000)] 2024-10-13 09:07:10,965 - Train: 95.96% [360150/375300] [287.9/300.0] [batch_t 0.514 (0.428)] [data_t 0.015] [optim_t 0.499] [lr 0.000042] [CE 2.826 (2.773)] [KD 0.000 (0.000)] 2024-10-13 09:07:32,892 - Train: 95.98% [360200/375300] [287.9/300.0] [batch_t 0.472 (0.438)] [data_t 0.016] [optim_t 0.456] [lr 0.000042] [CE 2.890 (2.759)] [KD 0.000 (0.000)] 2024-10-13 09:07:54,958 - Train: 95.99% [360250/375300] [288.0/300.0] [batch_t 0.451 (0.441)] [data_t 0.016] [optim_t 0.435] [lr 0.000042] [CE 2.687 (2.766)] [KD 0.000 (0.000)] 2024-10-13 09:08:31,682 - Test (net): 100.00% [50/50] [batch_t 0.136 (0.432)] [top1_cnt 41058] [top5_cnt 48070] [top_all 50000] 2024-10-13 09:08:31,683 - net: 82.116 (96.140) 2024-10-13 09:08:53,815 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.434)] [top1_cnt 41231] [top5_cnt 48130] [top_all 50000] 2024-10-13 09:08:53,816 - net_E: 82.462 (96.260) 2024-10-13 09:08:53,994 - Max [top1: 82.280 (epoch: 286)] [top1-ema: 82.474 (epoch: 287)] 2024-10-13 09:08:53,995 - ==> Total time: 1 day, 21:21:57 Eta: 1:53:24 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 09:09:04,313 - Train: 96.00% [360300/375300] [288.0/300.0] [batch_t 0.322 (0.720)] [data_t 0.016] [optim_t 0.307] [lr 0.000042] [CE 2.388 (2.714)] [KD 0.000 (0.000)] 2024-10-13 09:09:25,361 - Train: 96.02% [360350/375300] [288.0/300.0] [batch_t 0.448 (0.421)] [data_t 0.015] [optim_t 0.432] [lr 0.000042] [CE 2.706 (2.756)] [KD 0.000 (0.000)] 2024-10-13 09:09:46,674 - Train: 96.03% [360400/375300] [288.1/300.0] [batch_t 0.473 (0.426)] [data_t 0.015] [optim_t 0.457] [lr 0.000042] [CE 2.715 (2.783)] [KD 0.000 (0.000)] 2024-10-13 09:10:08,015 - Train: 96.04% [360450/375300] [288.1/300.0] [batch_t 0.446 (0.427)] [data_t 0.015] [optim_t 0.431] [lr 0.000041] [CE 2.774 (2.818)] [KD 0.000 (0.000)] 2024-10-13 09:10:29,056 - Train: 96.06% [360500/375300] [288.2/300.0] [batch_t 0.436 (0.421)] [data_t 0.015] [optim_t 0.420] [lr 0.000041] [CE 3.031 (2.789)] [KD 0.000 (0.000)] 2024-10-13 09:10:50,191 - Train: 96.07% [360550/375300] [288.2/300.0] [batch_t 0.394 (0.423)] [data_t 0.016] [optim_t 0.378] [lr 0.000041] [CE 2.848 (2.767)] [KD 0.000 (0.000)] 2024-10-13 09:11:11,425 - Train: 96.08% [360600/375300] [288.2/300.0] [batch_t 0.496 (0.425)] [data_t 0.016] [optim_t 0.480] [lr 0.000041] [CE 2.921 (2.730)] [KD 0.000 (0.000)] 2024-10-13 09:11:32,804 - Train: 96.10% [360650/375300] [288.3/300.0] [batch_t 0.468 (0.427)] [data_t 0.015] [optim_t 0.452] [lr 0.000041] [CE 2.828 (2.749)] [KD 0.000 (0.000)] 2024-10-13 09:11:53,792 - Train: 96.11% [360700/375300] [288.3/300.0] [batch_t 0.446 (0.420)] [data_t 0.016] [optim_t 0.430] [lr 0.000041] [CE 2.539 (2.750)] [KD 0.000 (0.000)] 2024-10-13 09:12:14,954 - Train: 96.12% [360750/375300] [288.4/300.0] [batch_t 0.432 (0.423)] [data_t 0.016] [optim_t 0.416] [lr 0.000041] [CE 2.891 (2.778)] [KD 0.000 (0.000)] 2024-10-13 09:12:36,681 - Train: 96.14% [360800/375300] [288.4/300.0] [batch_t 0.507 (0.434)] [data_t 0.016] [optim_t 0.491] [lr 0.000041] [CE 2.771 (2.765)] [KD 0.000 (0.000)] 2024-10-13 09:12:58,024 - Train: 96.15% [360850/375300] [288.4/300.0] [batch_t 0.426 (0.427)] [data_t 0.015] [optim_t 0.411] [lr 0.000041] [CE 2.835 (2.802)] [KD 0.000 (0.000)] 2024-10-13 09:13:19,697 - Train: 96.16% [360900/375300] [288.5/300.0] [batch_t 0.469 (0.433)] [data_t 0.015] [optim_t 0.454] [lr 0.000041] [CE 2.528 (2.774)] [KD 0.000 (0.000)] 2024-10-13 09:13:41,373 - Train: 96.18% [360950/375300] [288.5/300.0] [batch_t 0.430 (0.433)] [data_t 0.016] [optim_t 0.414] [lr 0.000041] [CE 2.657 (2.774)] [KD 0.000 (0.000)] 2024-10-13 09:14:02,996 - Train: 96.19% [361000/375300] [288.6/300.0] [batch_t 0.396 (0.432)] [data_t 0.016] [optim_t 0.381] [lr 0.000041] [CE 2.847 (2.766)] [KD 0.000 (0.000)] 2024-10-13 09:14:24,771 - Train: 96.20% [361050/375300] [288.6/300.0] [batch_t 0.449 (0.435)] [data_t 0.016] [optim_t 0.434] [lr 0.000041] [CE 2.969 (2.767)] [KD 0.000 (0.000)] 2024-10-13 09:14:46,266 - Train: 96.22% [361100/375300] [288.6/300.0] [batch_t 0.423 (0.430)] [data_t 0.016] [optim_t 0.407] [lr 0.000040] [CE 2.880 (2.801)] [KD 0.000 (0.000)] 2024-10-13 09:15:07,772 - Train: 96.23% [361150/375300] [288.7/300.0] [batch_t 0.455 (0.430)] [data_t 0.016] [optim_t 0.440] [lr 0.000040] [CE 2.604 (2.766)] [KD 0.000 (0.000)] 2024-10-13 09:15:29,177 - Train: 96.24% [361200/375300] [288.7/300.0] [batch_t 0.382 (0.428)] [data_t 0.015] [optim_t 0.367] [lr 0.000040] [CE 2.919 (2.775)] [KD 0.000 (0.000)] 2024-10-13 09:15:50,649 - Train: 96.26% [361250/375300] [288.8/300.0] [batch_t 0.474 (0.429)] [data_t 0.015] [optim_t 0.459] [lr 0.000040] [CE 2.670 (2.765)] [KD 0.000 (0.000)] 2024-10-13 09:16:12,433 - Train: 96.27% [361300/375300] [288.8/300.0] [batch_t 0.499 (0.436)] [data_t 0.015] [optim_t 0.483] [lr 0.000040] [CE 2.713 (2.797)] [KD 0.000 (0.000)] 2024-10-13 09:16:34,148 - Train: 96.28% [361350/375300] [288.8/300.0] [batch_t 0.508 (0.434)] [data_t 0.015] [optim_t 0.492] [lr 0.000040] [CE 2.731 (2.754)] [KD 0.000 (0.000)] 2024-10-13 09:16:55,730 - Train: 96.30% [361400/375300] [288.9/300.0] [batch_t 0.381 (0.432)] [data_t 0.016] [optim_t 0.366] [lr 0.000040] [CE 2.510 (2.765)] [KD 0.000 (0.000)] 2024-10-13 09:17:17,443 - Train: 96.31% [361450/375300] [288.9/300.0] [batch_t 0.425 (0.434)] [data_t 0.015] [optim_t 0.409] [lr 0.000040] [CE 2.878 (2.804)] [KD 0.000 (0.000)] 2024-10-13 09:17:39,346 - Train: 96.32% [361500/375300] [289.0/300.0] [batch_t 0.442 (0.438)] [data_t 0.015] [optim_t 0.426] [lr 0.000040] [CE 2.648 (2.732)] [KD 0.000 (0.000)] 2024-10-13 09:18:16,574 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.441)] [top1_cnt 41170] [top5_cnt 48078] [top_all 50000] 2024-10-13 09:18:16,575 - net: 82.340 (96.156) 2024-10-13 09:18:38,748 - Test (net_E): 100.00% [50/50] [batch_t 0.134 (0.437)] [top1_cnt 41247] [top5_cnt 48128] [top_all 50000] 2024-10-13 09:18:38,749 - net_E: 82.494 (96.256) 2024-10-13 09:18:38,929 - Max [top1: 82.340 (epoch: 289)] [top1-ema: 82.494 (epoch: 289)] 2024-10-13 09:18:38,929 - ==> Total time: 1 day, 21:31:42 Eta: 1:43:58 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 09:18:51,328 - Train: 96.34% [361550/375300] [289.0/300.0] [batch_t 0.317 (0.586)] [data_t 0.015] [optim_t 0.301] [lr 0.000040] [CE 2.914 (2.766)] [KD 0.000 (0.000)] 2024-10-13 09:19:11,751 - Train: 96.35% [361600/375300] [289.0/300.0] [batch_t 0.416 (0.408)] [data_t 0.016] [optim_t 0.400] [lr 0.000040] [CE 2.775 (2.763)] [KD 0.000 (0.000)] 2024-10-13 09:19:34,137 - Train: 96.36% [361650/375300] [289.1/300.0] [batch_t 0.369 (0.448)] [data_t 0.015] [optim_t 0.354] [lr 0.000040] [CE 2.817 (2.779)] [KD 0.000 (0.000)] 2024-10-13 09:19:55,799 - Train: 96.38% [361700/375300] [289.1/300.0] [batch_t 0.491 (0.433)] [data_t 0.016] [optim_t 0.475] [lr 0.000040] [CE 2.629 (2.768)] [KD 0.000 (0.000)] 2024-10-13 09:20:17,637 - Train: 96.39% [361750/375300] [289.2/300.0] [batch_t 0.461 (0.437)] [data_t 0.016] [optim_t 0.445] [lr 0.000040] [CE 2.645 (2.762)] [KD 0.000 (0.000)] 2024-10-13 09:20:39,206 - Train: 96.40% [361800/375300] [289.2/300.0] [batch_t 0.461 (0.431)] [data_t 0.016] [optim_t 0.446] [lr 0.000039] [CE 2.969 (2.770)] [KD 0.000 (0.000)] 2024-10-13 09:21:01,615 - Train: 96.42% [361850/375300] [289.2/300.0] [batch_t 0.482 (0.448)] [data_t 0.015] [optim_t 0.466] [lr 0.000039] [CE 2.883 (2.771)] [KD 0.000 (0.000)] 2024-10-13 09:21:24,219 - Train: 96.43% [361900/375300] [289.3/300.0] [batch_t 0.405 (0.452)] [data_t 0.015] [optim_t 0.390] [lr 0.000039] [CE 2.700 (2.786)] [KD 0.000 (0.000)] 2024-10-13 09:21:46,295 - Train: 96.44% [361950/375300] [289.3/300.0] [batch_t 0.443 (0.441)] [data_t 0.016] [optim_t 0.428] [lr 0.000039] [CE 2.583 (2.749)] [KD 0.000 (0.000)] 2024-10-13 09:22:07,514 - Train: 96.46% [362000/375300] [289.4/300.0] [batch_t 0.318 (0.424)] [data_t 0.015] [optim_t 0.303] [lr 0.000039] [CE 2.807 (2.798)] [KD 0.000 (0.000)] 2024-10-13 09:22:28,159 - Train: 96.47% [362050/375300] [289.4/300.0] [batch_t 0.470 (0.413)] [data_t 0.015] [optim_t 0.455] [lr 0.000039] [CE 2.888 (2.780)] [KD 0.000 (0.000)] 2024-10-13 09:22:50,416 - Train: 96.48% [362100/375300] [289.4/300.0] [batch_t 0.394 (0.445)] [data_t 0.016] [optim_t 0.378] [lr 0.000039] [CE 2.753 (2.750)] [KD 0.000 (0.000)] 2024-10-13 09:23:12,921 - Train: 96.50% [362150/375300] [289.5/300.0] [batch_t 0.449 (0.450)] [data_t 0.015] [optim_t 0.434] [lr 0.000039] [CE 2.638 (2.811)] [KD 0.000 (0.000)] 2024-10-13 09:23:34,816 - Train: 96.51% [362200/375300] [289.5/300.0] [batch_t 0.438 (0.438)] [data_t 0.016] [optim_t 0.423] [lr 0.000039] [CE 2.909 (2.793)] [KD 0.000 (0.000)] 2024-10-13 09:23:57,186 - Train: 96.52% [362250/375300] [289.6/300.0] [batch_t 0.462 (0.447)] [data_t 0.015] [optim_t 0.447] [lr 0.000039] [CE 2.910 (2.782)] [KD 0.000 (0.000)] 2024-10-13 09:24:19,204 - Train: 96.54% [362300/375300] [289.6/300.0] [batch_t 0.401 (0.440)] [data_t 0.015] [optim_t 0.386] [lr 0.000039] [CE 3.019 (2.763)] [KD 0.000 (0.000)] 2024-10-13 09:24:40,519 - Train: 96.55% [362350/375300] [289.6/300.0] [batch_t 0.435 (0.426)] [data_t 0.015] [optim_t 0.419] [lr 0.000039] [CE 2.770 (2.744)] [KD 0.000 (0.000)] 2024-10-13 09:25:02,368 - Train: 96.56% [362400/375300] [289.7/300.0] [batch_t 0.482 (0.437)] [data_t 0.015] [optim_t 0.467] [lr 0.000039] [CE 2.720 (2.758)] [KD 0.000 (0.000)] 2024-10-13 09:25:24,531 - Train: 96.58% [362450/375300] [289.7/300.0] [batch_t 0.488 (0.443)] [data_t 0.016] [optim_t 0.472] [lr 0.000039] [CE 2.797 (2.807)] [KD 0.000 (0.000)] 2024-10-13 09:25:46,647 - Train: 96.59% [362500/375300] [289.8/300.0] [batch_t 0.432 (0.442)] [data_t 0.016] [optim_t 0.417] [lr 0.000039] [CE 2.841 (2.784)] [KD 0.000 (0.000)] 2024-10-13 09:26:08,533 - Train: 96.60% [362550/375300] [289.8/300.0] [batch_t 0.443 (0.438)] [data_t 0.016] [optim_t 0.428] [lr 0.000038] [CE 2.878 (2.778)] [KD 0.000 (0.000)] 2024-10-13 09:26:30,622 - Train: 96.62% [362600/375300] [289.8/300.0] [batch_t 0.404 (0.442)] [data_t 0.016] [optim_t 0.388] [lr 0.000038] [CE 2.628 (2.774)] [KD 0.000 (0.000)] 2024-10-13 09:26:51,910 - Train: 96.63% [362650/375300] [289.9/300.0] [batch_t 0.320 (0.426)] [data_t 0.016] [optim_t 0.304] [lr 0.000038] [CE 2.917 (2.790)] [KD 0.000 (0.000)] 2024-10-13 09:27:13,954 - Train: 96.64% [362700/375300] [289.9/300.0] [batch_t 0.409 (0.441)] [data_t 0.016] [optim_t 0.393] [lr 0.000038] [CE 2.596 (2.828)] [KD 0.000 (0.000)] 2024-10-13 09:27:35,840 - Train: 96.66% [362750/375300] [290.0/300.0] [batch_t 0.421 (0.438)] [data_t 0.015] [optim_t 0.406] [lr 0.000038] [CE 2.617 (2.771)] [KD 0.000 (0.000)] 2024-10-13 09:28:14,650 - Test (net): 100.00% [50/50] [batch_t 0.143 (0.449)] [top1_cnt 41074] [top5_cnt 48073] [top_all 50000] 2024-10-13 09:28:14,651 - net: 82.148 (96.146) 2024-10-13 09:28:37,054 - Test (net_E): 100.00% [50/50] [batch_t 0.133 (0.440)] [top1_cnt 41244] [top5_cnt 48124] [top_all 50000] 2024-10-13 09:28:37,055 - net_E: 82.488 (96.248) 2024-10-13 09:28:37,204 - Max [top1: 82.340 (epoch: 289)] [top1-ema: 82.494 (epoch: 289)] 2024-10-13 09:28:37,204 - ==> Total time: 1 day, 21:41:41 Eta: 1:34:32 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 09:28:47,317 - Train: 96.67% [362800/375300] [290.0/300.0] [batch_t 0.320 (0.858)] [data_t 0.015] [optim_t 0.305] [lr 0.000038] [CE 2.889 (2.736)] [KD 0.000 (0.000)] 2024-10-13 09:29:07,749 - Train: 96.68% [362850/375300] [290.0/300.0] [batch_t 0.316 (0.408)] [data_t 0.015] [optim_t 0.301] [lr 0.000038] [CE 2.761 (2.759)] [KD 0.000 (0.000)] 2024-10-13 09:29:29,664 - Train: 96.70% [362900/375300] [290.1/300.0] [batch_t 0.352 (0.438)] [data_t 0.016] [optim_t 0.336] [lr 0.000038] [CE 2.901 (2.740)] [KD 0.000 (0.000)] 2024-10-13 09:29:51,563 - Train: 96.71% [362950/375300] [290.1/300.0] [batch_t 0.478 (0.438)] [data_t 0.016] [optim_t 0.462] [lr 0.000038] [CE 2.855 (2.777)] [KD 0.000 (0.000)] 2024-10-13 09:30:13,532 - Train: 96.72% [363000/375300] [290.2/300.0] [batch_t 0.336 (0.439)] [data_t 0.016] [optim_t 0.321] [lr 0.000038] [CE 2.505 (2.754)] [KD 0.000 (0.000)] 2024-10-13 09:30:35,439 - Train: 96.74% [363050/375300] [290.2/300.0] [batch_t 0.408 (0.438)] [data_t 0.015] [optim_t 0.393] [lr 0.000038] [CE 2.919 (2.798)] [KD 0.000 (0.000)] 2024-10-13 09:30:57,669 - Train: 96.75% [363100/375300] [290.2/300.0] [batch_t 0.457 (0.444)] [data_t 0.016] [optim_t 0.442] [lr 0.000038] [CE 2.700 (2.773)] [KD 0.000 (0.000)] 2024-10-13 09:31:18,769 - Train: 96.76% [363150/375300] [290.3/300.0] [batch_t 0.361 (0.422)] [data_t 0.016] [optim_t 0.345] [lr 0.000038] [CE 2.734 (2.755)] [KD 0.000 (0.000)] 2024-10-13 09:31:41,258 - Train: 96.78% [363200/375300] [290.3/300.0] [batch_t 0.381 (0.450)] [data_t 0.016] [optim_t 0.365] [lr 0.000038] [CE 2.573 (2.773)] [KD 0.000 (0.000)] 2024-10-13 09:32:02,723 - Train: 96.79% [363250/375300] [290.4/300.0] [batch_t 0.484 (0.429)] [data_t 0.016] [optim_t 0.469] [lr 0.000038] [CE 2.688 (2.767)] [KD 0.000 (0.000)] 2024-10-13 09:32:25,668 - Train: 96.80% [363300/375300] [290.4/300.0] [batch_t 0.428 (0.459)] [data_t 0.015] [optim_t 0.413] [lr 0.000037] [CE 2.729 (2.723)] [KD 0.000 (0.000)] 2024-10-13 09:32:48,020 - Train: 96.82% [363350/375300] [290.4/300.0] [batch_t 0.486 (0.447)] [data_t 0.016] [optim_t 0.470] [lr 0.000037] [CE 2.844 (2.770)] [KD 0.000 (0.000)] 2024-10-13 09:33:10,234 - Train: 96.83% [363400/375300] [290.5/300.0] [batch_t 0.401 (0.444)] [data_t 0.016] [optim_t 0.385] [lr 0.000037] [CE 2.687 (2.739)] [KD 0.000 (0.000)] 2024-10-13 09:33:32,402 - Train: 96.84% [363450/375300] [290.5/300.0] [batch_t 0.510 (0.443)] [data_t 0.016] [optim_t 0.494] [lr 0.000037] [CE 2.667 (2.785)] [KD 0.000 (0.000)] 2024-10-13 09:33:54,465 - Train: 96.86% [363500/375300] [290.6/300.0] [batch_t 0.432 (0.441)] [data_t 0.016] [optim_t 0.416] [lr 0.000037] [CE 2.907 (2.763)] [KD 0.000 (0.000)] 2024-10-13 09:34:16,375 - Train: 96.87% [363550/375300] [290.6/300.0] [batch_t 0.474 (0.438)] [data_t 0.015] [optim_t 0.458] [lr 0.000037] [CE 2.622 (2.774)] [KD 0.000 (0.000)] 2024-10-13 09:34:37,467 - Train: 96.88% [363600/375300] [290.6/300.0] [batch_t 0.470 (0.422)] [data_t 0.015] [optim_t 0.455] [lr 0.000037] [CE 2.766 (2.744)] [KD 0.000 (0.000)] 2024-10-13 09:34:58,550 - Train: 96.90% [363650/375300] [290.7/300.0] [batch_t 0.438 (0.422)] [data_t 0.016] [optim_t 0.422] [lr 0.000037] [CE 2.740 (2.755)] [KD 0.000 (0.000)] 2024-10-13 09:35:20,913 - Train: 96.91% [363700/375300] [290.7/300.0] [batch_t 0.388 (0.447)] [data_t 0.015] [optim_t 0.373] [lr 0.000037] [CE 2.859 (2.749)] [KD 0.000 (0.000)] 2024-10-13 09:35:43,036 - Train: 96.92% [363750/375300] [290.8/300.0] [batch_t 0.464 (0.442)] [data_t 0.016] [optim_t 0.448] [lr 0.000037] [CE 2.999 (2.779)] [KD 0.000 (0.000)] 2024-10-13 09:36:05,239 - Train: 96.94% [363800/375300] [290.8/300.0] [batch_t 0.455 (0.444)] [data_t 0.016] [optim_t 0.440] [lr 0.000037] [CE 2.382 (2.798)] [KD 0.000 (0.000)] 2024-10-13 09:36:26,254 - Train: 96.95% [363850/375300] [290.8/300.0] [batch_t 0.448 (0.420)] [data_t 0.016] [optim_t 0.432] [lr 0.000037] [CE 2.806 (2.752)] [KD 0.000 (0.000)] 2024-10-13 09:36:48,126 - Train: 96.96% [363900/375300] [290.9/300.0] [batch_t 0.496 (0.437)] [data_t 0.016] [optim_t 0.480] [lr 0.000037] [CE 2.636 (2.772)] [KD 0.000 (0.000)] 2024-10-13 09:37:09,727 - Train: 96.98% [363950/375300] [290.9/300.0] [batch_t 0.367 (0.432)] [data_t 0.015] [optim_t 0.351] [lr 0.000037] [CE 2.781 (2.782)] [KD 0.000 (0.000)] 2024-10-13 09:37:31,380 - Train: 96.99% [364000/375300] [291.0/300.0] [batch_t 0.554 (0.433)] [data_t 0.015] [optim_t 0.539] [lr 0.000037] [CE 2.482 (2.715)] [KD 0.000 (0.000)] 2024-10-13 09:38:11,625 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.475)] [top1_cnt 41047] [top5_cnt 48069] [top_all 50000] 2024-10-13 09:38:11,626 - net: 82.094 (96.138) 2024-10-13 09:38:34,123 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.442)] [top1_cnt 41233] [top5_cnt 48131] [top_all 50000] 2024-10-13 09:38:34,123 - net_E: 82.466 (96.262) 2024-10-13 09:38:34,317 - Max [top1: 82.340 (epoch: 289)] [top1-ema: 82.494 (epoch: 289)] 2024-10-13 09:38:34,318 - ==> Total time: 1 day, 21:51:38 Eta: 1:25:06 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 09:38:44,514 - Train: 97.00% [364050/375300] [291.0/300.0] [batch_t 1.039 (0.923)] [data_t 0.015] [optim_t 1.023] [lr 0.000037] [CE 2.421 (2.723)] [KD 0.000 (0.000)] 2024-10-13 09:39:04,567 - Train: 97.02% [364100/375300] [291.0/300.0] [batch_t 0.498 (0.401)] [data_t 0.015] [optim_t 0.483] [lr 0.000037] [CE 2.297 (2.736)] [KD 0.000 (0.000)] 2024-10-13 09:39:26,394 - Train: 97.03% [364150/375300] [291.1/300.0] [batch_t 0.496 (0.436)] [data_t 0.016] [optim_t 0.480] [lr 0.000036] [CE 2.917 (2.796)] [KD 0.000 (0.000)] 2024-10-13 09:39:48,380 - Train: 97.04% [364200/375300] [291.1/300.0] [batch_t 0.397 (0.440)] [data_t 0.016] [optim_t 0.382] [lr 0.000036] [CE 2.408 (2.770)] [KD 0.000 (0.000)] 2024-10-13 09:40:10,654 - Train: 97.06% [364250/375300] [291.2/300.0] [batch_t 1.114 (0.445)] [data_t 0.016] [optim_t 1.098] [lr 0.000036] [CE 2.779 (2.709)] [KD 0.000 (0.000)] 2024-10-13 09:40:32,705 - Train: 97.07% [364300/375300] [291.2/300.0] [batch_t 0.558 (0.441)] [data_t 0.015] [optim_t 0.542] [lr 0.000036] [CE 2.620 (2.755)] [KD 0.000 (0.000)] 2024-10-13 09:40:55,207 - Train: 97.08% [364350/375300] [291.2/300.0] [batch_t 0.325 (0.450)] [data_t 0.016] [optim_t 0.309] [lr 0.000036] [CE 2.747 (2.796)] [KD 0.000 (0.000)] 2024-10-13 09:41:17,123 - Train: 97.10% [364400/375300] [291.3/300.0] [batch_t 0.468 (0.438)] [data_t 0.016] [optim_t 0.453] [lr 0.000036] [CE 2.877 (2.729)] [KD 0.000 (0.000)] 2024-10-13 09:41:38,783 - Train: 97.11% [364450/375300] [291.3/300.0] [batch_t 0.926 (0.433)] [data_t 0.015] [optim_t 0.910] [lr 0.000036] [CE 2.800 (2.813)] [KD 0.000 (0.000)] 2024-10-13 09:41:59,734 - Train: 97.12% [364500/375300] [291.4/300.0] [batch_t 0.327 (0.419)] [data_t 0.015] [optim_t 0.312] [lr 0.000036] [CE 2.714 (2.774)] [KD 0.000 (0.000)] 2024-10-13 09:42:21,463 - Train: 97.14% [364550/375300] [291.4/300.0] [batch_t 0.528 (0.434)] [data_t 0.016] [optim_t 0.512] [lr 0.000036] [CE 2.825 (2.786)] [KD 0.000 (0.000)] 2024-10-13 09:42:42,689 - Train: 97.15% [364600/375300] [291.4/300.0] [batch_t 0.472 (0.424)] [data_t 0.015] [optim_t 0.456] [lr 0.000036] [CE 3.007 (2.760)] [KD 0.000 (0.000)] 2024-10-13 09:43:03,597 - Train: 97.16% [364650/375300] [291.5/300.0] [batch_t 0.430 (0.418)] [data_t 0.016] [optim_t 0.415] [lr 0.000036] [CE 2.914 (2.729)] [KD 0.000 (0.000)] 2024-10-13 09:43:24,939 - Train: 97.18% [364700/375300] [291.5/300.0] [batch_t 0.441 (0.427)] [data_t 0.015] [optim_t 0.426] [lr 0.000036] [CE 2.849 (2.750)] [KD 0.000 (0.000)] 2024-10-13 09:43:46,186 - Train: 97.19% [364750/375300] [291.6/300.0] [batch_t 0.467 (0.425)] [data_t 0.015] [optim_t 0.451] [lr 0.000036] [CE 2.869 (2.773)] [KD 0.000 (0.000)] 2024-10-13 09:44:07,717 - Train: 97.20% [364800/375300] [291.6/300.0] [batch_t 0.386 (0.431)] [data_t 0.016] [optim_t 0.371] [lr 0.000036] [CE 2.776 (2.767)] [KD 0.000 (0.000)] 2024-10-13 09:44:29,819 - Train: 97.22% [364850/375300] [291.6/300.0] [batch_t 0.384 (0.442)] [data_t 0.016] [optim_t 0.369] [lr 0.000036] [CE 2.864 (2.761)] [KD 0.000 (0.000)] 2024-10-13 09:44:52,012 - Train: 97.23% [364900/375300] [291.7/300.0] [batch_t 0.480 (0.444)] [data_t 0.016] [optim_t 0.464] [lr 0.000036] [CE 2.970 (2.795)] [KD 0.000 (0.000)] 2024-10-13 09:45:14,349 - Train: 97.24% [364950/375300] [291.7/300.0] [batch_t 0.455 (0.447)] [data_t 0.015] [optim_t 0.439] [lr 0.000036] [CE 3.075 (2.791)] [KD 0.000 (0.000)] 2024-10-13 09:45:36,323 - Train: 97.26% [365000/375300] [291.8/300.0] [batch_t 0.358 (0.439)] [data_t 0.016] [optim_t 0.342] [lr 0.000036] [CE 2.528 (2.782)] [KD 0.000 (0.000)] 2024-10-13 09:45:58,303 - Train: 97.27% [365050/375300] [291.8/300.0] [batch_t 0.446 (0.439)] [data_t 0.016] [optim_t 0.431] [lr 0.000035] [CE 2.923 (2.764)] [KD 0.000 (0.000)] 2024-10-13 09:46:20,305 - Train: 97.28% [365100/375300] [291.8/300.0] [batch_t 0.408 (0.440)] [data_t 0.016] [optim_t 0.392] [lr 0.000035] [CE 2.919 (2.747)] [KD 0.000 (0.000)] 2024-10-13 09:46:42,911 - Train: 97.30% [365150/375300] [291.9/300.0] [batch_t 0.504 (0.452)] [data_t 0.015] [optim_t 0.488] [lr 0.000035] [CE 2.789 (2.775)] [KD 0.000 (0.000)] 2024-10-13 09:47:05,074 - Train: 97.31% [365200/375300] [291.9/300.0] [batch_t 0.365 (0.443)] [data_t 0.016] [optim_t 0.349] [lr 0.000035] [CE 2.814 (2.767)] [KD 0.000 (0.000)] 2024-10-13 09:47:27,261 - Train: 97.32% [365250/375300] [292.0/300.0] [batch_t 0.451 (0.444)] [data_t 0.016] [optim_t 0.435] [lr 0.000035] [CE 2.873 (2.804)] [KD 0.000 (0.000)] 2024-10-13 09:48:06,111 - Test (net): 100.00% [50/50] [batch_t 0.133 (0.428)] [top1_cnt 41121] [top5_cnt 48089] [top_all 50000] 2024-10-13 09:48:06,112 - net: 82.242 (96.178) 2024-10-13 09:48:28,220 - Test (net_E): 100.00% [50/50] [batch_t 0.132 (0.434)] [top1_cnt 41239] [top5_cnt 48121] [top_all 50000] 2024-10-13 09:48:28,220 - net_E: 82.478 (96.242) 2024-10-13 09:48:28,384 - Max [top1: 82.340 (epoch: 289)] [top1-ema: 82.494 (epoch: 289)] 2024-10-13 09:48:28,384 - ==> Total time: 1 day, 22:01:32 Eta: 1:15:39 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 09:48:37,580 - Train: 97.34% [365300/375300] [292.0/300.0] [batch_t 0.319 (0.948)] [data_t 0.016] [optim_t 0.303] [lr 0.000035] [CE 2.774 (2.783)] [KD 0.000 (0.000)] 2024-10-13 09:48:59,132 - Train: 97.35% [365350/375300] [292.0/300.0] [batch_t 0.496 (0.431)] [data_t 0.016] [optim_t 0.480] [lr 0.000035] [CE 2.636 (2.762)] [KD 0.000 (0.000)] 2024-10-13 09:49:21,767 - Train: 97.36% [365400/375300] [292.1/300.0] [batch_t 0.465 (0.453)] [data_t 0.016] [optim_t 0.449] [lr 0.000035] [CE 2.959 (2.748)] [KD 0.000 (0.000)] 2024-10-13 09:49:44,293 - Train: 97.38% [365450/375300] [292.1/300.0] [batch_t 0.419 (0.450)] [data_t 0.016] [optim_t 0.403] [lr 0.000035] [CE 2.586 (2.762)] [KD 0.000 (0.000)] 2024-10-13 09:50:06,463 - Train: 97.39% [365500/375300] [292.2/300.0] [batch_t 0.431 (0.443)] [data_t 0.016] [optim_t 0.415] [lr 0.000035] [CE 2.938 (2.745)] [KD 0.000 (0.000)] 2024-10-13 09:50:28,841 - Train: 97.40% [365550/375300] [292.2/300.0] [batch_t 0.392 (0.447)] [data_t 0.015] [optim_t 0.376] [lr 0.000035] [CE 2.824 (2.747)] [KD 0.000 (0.000)] 2024-10-13 09:50:51,119 - Train: 97.42% [365600/375300] [292.2/300.0] [batch_t 0.391 (0.445)] [data_t 0.015] [optim_t 0.376] [lr 0.000035] [CE 2.754 (2.720)] [KD 0.000 (0.000)] 2024-10-13 09:51:13,449 - Train: 97.43% [365650/375300] [292.3/300.0] [batch_t 0.445 (0.446)] [data_t 0.015] [optim_t 0.429] [lr 0.000035] [CE 3.045 (2.767)] [KD 0.000 (0.000)] 2024-10-13 09:51:36,063 - Train: 97.44% [365700/375300] [292.3/300.0] [batch_t 0.514 (0.452)] [data_t 0.015] [optim_t 0.498] [lr 0.000035] [CE 2.684 (2.740)] [KD 0.000 (0.000)] 2024-10-13 09:51:58,971 - Train: 97.46% [365750/375300] [292.4/300.0] [batch_t 0.316 (0.458)] [data_t 0.015] [optim_t 0.300] [lr 0.000035] [CE 2.728 (2.768)] [KD 0.000 (0.000)] 2024-10-13 09:52:21,346 - Train: 97.47% [365800/375300] [292.4/300.0] [batch_t 0.492 (0.447)] [data_t 0.015] [optim_t 0.476] [lr 0.000035] [CE 2.827 (2.782)] [KD 0.000 (0.000)] 2024-10-13 09:52:43,774 - Train: 97.48% [365850/375300] [292.4/300.0] [batch_t 0.498 (0.448)] [data_t 0.016] [optim_t 0.483] [lr 0.000035] [CE 2.718 (2.762)] [KD 0.000 (0.000)] 2024-10-13 09:53:06,577 - Train: 97.50% [365900/375300] [292.5/300.0] [batch_t 0.541 (0.456)] [data_t 0.016] [optim_t 0.525] [lr 0.000035] [CE 2.878 (2.761)] [KD 0.000 (0.000)] 2024-10-13 09:53:29,182 - Train: 97.51% [365950/375300] [292.5/300.0] [batch_t 0.433 (0.452)] [data_t 0.015] [optim_t 0.418] [lr 0.000035] [CE 2.905 (2.759)] [KD 0.000 (0.000)] 2024-10-13 09:53:50,929 - Train: 97.52% [366000/375300] [292.6/300.0] [batch_t 0.356 (0.435)] [data_t 0.015] [optim_t 0.341] [lr 0.000034] [CE 2.589 (2.768)] [KD 0.000 (0.000)] 2024-10-13 09:54:13,378 - Train: 97.54% [366050/375300] [292.6/300.0] [batch_t 0.511 (0.449)] [data_t 0.016] [optim_t 0.495] [lr 0.000034] [CE 2.298 (2.728)] [KD 0.000 (0.000)] 2024-10-13 09:54:35,400 - Train: 97.55% [366100/375300] [292.6/300.0] [batch_t 0.428 (0.440)] [data_t 0.016] [optim_t 0.413] [lr 0.000034] [CE 2.723 (2.759)] [KD 0.000 (0.000)] 2024-10-13 09:54:57,622 - Train: 97.56% [366150/375300] [292.7/300.0] [batch_t 0.314 (0.444)] [data_t 0.016] [optim_t 0.298] [lr 0.000034] [CE 2.647 (2.819)] [KD 0.000 (0.000)] 2024-10-13 09:55:20,151 - Train: 97.58% [366200/375300] [292.7/300.0] [batch_t 0.435 (0.450)] [data_t 0.015] [optim_t 0.419] [lr 0.000034] [CE 2.616 (2.717)] [KD 0.000 (0.000)] 2024-10-13 09:55:42,220 - Train: 97.59% [366250/375300] [292.8/300.0] [batch_t 0.434 (0.441)] [data_t 0.015] [optim_t 0.418] [lr 0.000034] [CE 2.919 (2.776)] [KD 0.000 (0.000)] 2024-10-13 09:56:03,910 - Train: 97.60% [366300/375300] [292.8/300.0] [batch_t 0.485 (0.434)] [data_t 0.016] [optim_t 0.469] [lr 0.000034] [CE 2.858 (2.749)] [KD 0.000 (0.000)] 2024-10-13 09:56:25,758 - Train: 97.62% [366350/375300] [292.8/300.0] [batch_t 0.497 (0.437)] [data_t 0.015] [optim_t 0.481] [lr 0.000034] [CE 2.639 (2.776)] [KD 0.000 (0.000)] 2024-10-13 09:56:47,930 - Train: 97.63% [366400/375300] [292.9/300.0] [batch_t 0.484 (0.443)] [data_t 0.015] [optim_t 0.469] [lr 0.000034] [CE 2.803 (2.768)] [KD 0.000 (0.000)] 2024-10-13 09:57:10,043 - Train: 97.64% [366450/375300] [292.9/300.0] [batch_t 0.511 (0.442)] [data_t 0.016] [optim_t 0.496] [lr 0.000034] [CE 2.824 (2.755)] [KD 0.000 (0.000)] 2024-10-13 09:57:32,439 - Train: 97.66% [366500/375300] [293.0/300.0] [batch_t 0.478 (0.448)] [data_t 0.016] [optim_t 0.462] [lr 0.000034] [CE 2.651 (2.774)] [KD 0.000 (0.000)] 2024-10-13 09:58:11,446 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.431)] [top1_cnt 41144] [top5_cnt 48094] [top_all 50000] 2024-10-13 09:58:11,446 - net: 82.288 (96.188) 2024-10-13 09:58:33,454 - Test (net_E): 100.00% [50/50] [batch_t 0.143 (0.432)] [top1_cnt 41244] [top5_cnt 48135] [top_all 50000] 2024-10-13 09:58:33,455 - net_E: 82.488 (96.270) 2024-10-13 09:58:33,624 - Max [top1: 82.340 (epoch: 289)] [top1-ema: 82.494 (epoch: 289)] 2024-10-13 09:58:33,624 - ==> Total time: 1 day, 22:11:37 Eta: 1:06:12 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 09:58:42,613 - Train: 97.67% [366550/375300] [293.0/300.0] [batch_t 0.313 (1.055)] [data_t 0.015] [optim_t 0.297] [lr 0.000034] [CE 2.860 (2.750)] [KD 0.000 (0.000)] 2024-10-13 09:59:02,052 - Train: 97.68% [366600/375300] [293.0/300.0] [batch_t 0.406 (0.389)] [data_t 0.015] [optim_t 0.390] [lr 0.000034] [CE 2.839 (2.780)] [KD 0.000 (0.000)] 2024-10-13 09:59:25,077 - Train: 97.70% [366650/375300] [293.1/300.0] [batch_t 0.449 (0.460)] [data_t 0.016] [optim_t 0.434] [lr 0.000034] [CE 2.707 (2.761)] [KD 0.000 (0.000)] 2024-10-13 09:59:47,086 - Train: 97.71% [366700/375300] [293.1/300.0] [batch_t 0.437 (0.440)] [data_t 0.015] [optim_t 0.422] [lr 0.000034] [CE 2.802 (2.737)] [KD 0.000 (0.000)] 2024-10-13 10:00:09,193 - Train: 97.72% [366750/375300] [293.2/300.0] [batch_t 0.479 (0.442)] [data_t 0.015] [optim_t 0.463] [lr 0.000034] [CE 2.884 (2.790)] [KD 0.000 (0.000)] 2024-10-13 10:00:30,599 - Train: 97.74% [366800/375300] [293.2/300.0] [batch_t 0.402 (0.428)] [data_t 0.015] [optim_t 0.386] [lr 0.000034] [CE 3.056 (2.770)] [KD 0.000 (0.000)] 2024-10-13 10:00:52,599 - Train: 97.75% [366850/375300] [293.2/300.0] [batch_t 0.309 (0.440)] [data_t 0.015] [optim_t 0.294] [lr 0.000034] [CE 2.740 (2.807)] [KD 0.000 (0.000)] 2024-10-13 10:01:14,336 - Train: 97.76% [366900/375300] [293.3/300.0] [batch_t 0.491 (0.435)] [data_t 0.016] [optim_t 0.476] [lr 0.000034] [CE 2.698 (2.750)] [KD 0.000 (0.000)] 2024-10-13 10:01:35,560 - Train: 97.78% [366950/375300] [293.3/300.0] [batch_t 0.403 (0.424)] [data_t 0.016] [optim_t 0.388] [lr 0.000034] [CE 2.698 (2.782)] [KD 0.000 (0.000)] 2024-10-13 10:01:57,461 - Train: 97.79% [367000/375300] [293.4/300.0] [batch_t 0.490 (0.438)] [data_t 0.015] [optim_t 0.474] [lr 0.000034] [CE 3.028 (2.801)] [KD 0.000 (0.000)] 2024-10-13 10:02:19,149 - Train: 97.80% [367050/375300] [293.4/300.0] [batch_t 0.515 (0.434)] [data_t 0.016] [optim_t 0.499] [lr 0.000034] [CE 2.666 (2.757)] [KD 0.000 (0.000)] 2024-10-13 10:02:39,959 - Train: 97.82% [367100/375300] [293.4/300.0] [batch_t 0.502 (0.416)] [data_t 0.015] [optim_t 0.487] [lr 0.000033] [CE 2.697 (2.772)] [KD 0.000 (0.000)] 2024-10-13 10:03:01,316 - Train: 97.83% [367150/375300] [293.5/300.0] [batch_t 0.414 (0.427)] [data_t 0.015] [optim_t 0.399] [lr 0.000033] [CE 2.755 (2.754)] [KD 0.000 (0.000)] 2024-10-13 10:03:22,479 - Train: 97.84% [367200/375300] [293.5/300.0] [batch_t 0.471 (0.423)] [data_t 0.016] [optim_t 0.455] [lr 0.000033] [CE 2.508 (2.771)] [KD 0.000 (0.000)] 2024-10-13 10:03:44,015 - Train: 97.86% [367250/375300] [293.6/300.0] [batch_t 0.446 (0.431)] [data_t 0.016] [optim_t 0.431] [lr 0.000033] [CE 2.780 (2.756)] [KD 0.000 (0.000)] 2024-10-13 10:04:04,892 - Train: 97.87% [367300/375300] [293.6/300.0] [batch_t 0.433 (0.417)] [data_t 0.015] [optim_t 0.418] [lr 0.000033] [CE 2.823 (2.768)] [KD 0.000 (0.000)] 2024-10-13 10:04:26,392 - Train: 97.88% [367350/375300] [293.6/300.0] [batch_t 0.309 (0.430)] [data_t 0.016] [optim_t 0.294] [lr 0.000033] [CE 3.026 (2.748)] [KD 0.000 (0.000)] 2024-10-13 10:04:48,254 - Train: 97.90% [367400/375300] [293.7/300.0] [batch_t 0.484 (0.437)] [data_t 0.015] [optim_t 0.469] [lr 0.000033] [CE 2.961 (2.785)] [KD 0.000 (0.000)] 2024-10-13 10:05:10,089 - Train: 97.91% [367450/375300] [293.7/300.0] [batch_t 0.435 (0.437)] [data_t 0.015] [optim_t 0.419] [lr 0.000033] [CE 2.568 (2.727)] [KD 0.000 (0.000)] 2024-10-13 10:05:31,679 - Train: 97.92% [367500/375300] [293.8/300.0] [batch_t 0.407 (0.432)] [data_t 0.015] [optim_t 0.391] [lr 0.000033] [CE 2.586 (2.741)] [KD 0.000 (0.000)] 2024-10-13 10:05:53,487 - Train: 97.93% [367550/375300] [293.8/300.0] [batch_t 0.485 (0.436)] [data_t 0.016] [optim_t 0.470] [lr 0.000033] [CE 2.739 (2.770)] [KD 0.000 (0.000)] 2024-10-13 10:06:15,795 - Train: 97.95% [367600/375300] [293.8/300.0] [batch_t 0.410 (0.446)] [data_t 0.015] [optim_t 0.395] [lr 0.000033] [CE 2.938 (2.785)] [KD 0.000 (0.000)] 2024-10-13 10:06:37,588 - Train: 97.96% [367650/375300] [293.9/300.0] [batch_t 0.406 (0.436)] [data_t 0.016] [optim_t 0.391] [lr 0.000033] [CE 2.950 (2.769)] [KD 0.000 (0.000)] 2024-10-13 10:06:59,250 - Train: 97.97% [367700/375300] [293.9/300.0] [batch_t 0.440 (0.433)] [data_t 0.015] [optim_t 0.425] [lr 0.000033] [CE 2.824 (2.778)] [KD 0.000 (0.000)] 2024-10-13 10:07:21,122 - Train: 97.99% [367750/375300] [294.0/300.0] [batch_t 0.321 (0.437)] [data_t 0.016] [optim_t 0.305] [lr 0.000033] [CE 2.826 (2.766)] [KD 0.000 (0.000)] 2024-10-13 10:08:01,089 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.445)] [top1_cnt 41096] [top5_cnt 48059] [top_all 50000] 2024-10-13 10:08:01,090 - net: 82.192 (96.118) 2024-10-13 10:08:23,798 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.446)] [top1_cnt 41227] [top5_cnt 48136] [top_all 50000] 2024-10-13 10:08:23,799 - net_E: 82.454 (96.272) 2024-10-13 10:08:23,980 - Max [top1: 82.340 (epoch: 289)] [top1-ema: 82.494 (epoch: 289)] 2024-10-13 10:08:23,980 - ==> Total time: 1 day, 22:21:27 Eta: 0:56:45 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 10:08:32,843 - Train: 98.00% [367800/375300] [294.0/300.0] [batch_t 0.319 (1.225)] [data_t 0.016] [optim_t 0.304] [lr 0.000033] [CE 2.843 (2.791)] [KD 0.000 (0.000)] 2024-10-13 10:08:53,440 - Train: 98.01% [367850/375300] [294.0/300.0] [batch_t 0.376 (0.412)] [data_t 0.016] [optim_t 0.361] [lr 0.000033] [CE 2.638 (2.770)] [KD 0.000 (0.000)] 2024-10-13 10:09:15,878 - Train: 98.03% [367900/375300] [294.1/300.0] [batch_t 0.462 (0.449)] [data_t 0.015] [optim_t 0.446] [lr 0.000033] [CE 2.956 (2.806)] [KD 0.000 (0.000)] 2024-10-13 10:09:38,630 - Train: 98.04% [367950/375300] [294.1/300.0] [batch_t 0.455 (0.455)] [data_t 0.016] [optim_t 0.439] [lr 0.000033] [CE 2.919 (2.750)] [KD 0.000 (0.000)] 2024-10-13 10:10:01,575 - Train: 98.05% [368000/375300] [294.2/300.0] [batch_t 0.535 (0.459)] [data_t 0.016] [optim_t 0.519] [lr 0.000033] [CE 2.509 (2.757)] [KD 0.000 (0.000)] 2024-10-13 10:10:25,043 - Train: 98.07% [368050/375300] [294.2/300.0] [batch_t 0.507 (0.469)] [data_t 0.015] [optim_t 0.492] [lr 0.000033] [CE 2.731 (2.785)] [KD 0.000 (0.000)] 2024-10-13 10:10:48,073 - Train: 98.08% [368100/375300] [294.2/300.0] [batch_t 0.482 (0.460)] [data_t 0.015] [optim_t 0.467] [lr 0.000033] [CE 2.883 (2.781)] [KD 0.000 (0.000)] 2024-10-13 10:11:11,106 - Train: 98.09% [368150/375300] [294.3/300.0] [batch_t 0.363 (0.461)] [data_t 0.016] [optim_t 0.347] [lr 0.000033] [CE 2.768 (2.793)] [KD 0.000 (0.000)] 2024-10-13 10:11:33,734 - Train: 98.11% [368200/375300] [294.3/300.0] [batch_t 0.338 (0.452)] [data_t 0.016] [optim_t 0.322] [lr 0.000033] [CE 2.714 (2.747)] [KD 0.000 (0.000)] 2024-10-13 10:11:56,316 - Train: 98.12% [368250/375300] [294.4/300.0] [batch_t 0.434 (0.452)] [data_t 0.016] [optim_t 0.417] [lr 0.000033] [CE 2.981 (2.753)] [KD 0.000 (0.000)] 2024-10-13 10:12:19,296 - Train: 98.13% [368300/375300] [294.4/300.0] [batch_t 0.462 (0.459)] [data_t 0.016] [optim_t 0.447] [lr 0.000033] [CE 2.780 (2.715)] [KD 0.000 (0.000)] 2024-10-13 10:12:41,992 - Train: 98.15% [368350/375300] [294.4/300.0] [batch_t 0.496 (0.454)] [data_t 0.016] [optim_t 0.480] [lr 0.000033] [CE 2.746 (2.737)] [KD 0.000 (0.000)] 2024-10-13 10:13:04,811 - Train: 98.16% [368400/375300] [294.5/300.0] [batch_t 0.436 (0.456)] [data_t 0.015] [optim_t 0.421] [lr 0.000032] [CE 2.725 (2.737)] [KD 0.000 (0.000)] 2024-10-13 10:13:27,474 - Train: 98.17% [368450/375300] [294.5/300.0] [batch_t 0.487 (0.453)] [data_t 0.016] [optim_t 0.472] [lr 0.000032] [CE 2.667 (2.784)] [KD 0.000 (0.000)] 2024-10-13 10:13:50,040 - Train: 98.19% [368500/375300] [294.6/300.0] [batch_t 0.457 (0.451)] [data_t 0.015] [optim_t 0.441] [lr 0.000032] [CE 2.681 (2.792)] [KD 0.000 (0.000)] 2024-10-13 10:14:12,628 - Train: 98.20% [368550/375300] [294.6/300.0] [batch_t 0.451 (0.452)] [data_t 0.015] [optim_t 0.435] [lr 0.000032] [CE 2.413 (2.737)] [KD 0.000 (0.000)] 2024-10-13 10:14:34,554 - Train: 98.21% [368600/375300] [294.6/300.0] [batch_t 0.410 (0.438)] [data_t 0.017] [optim_t 0.393] [lr 0.000032] [CE 2.705 (2.760)] [KD 0.000 (0.000)] 2024-10-13 10:14:56,269 - Train: 98.23% [368650/375300] [294.7/300.0] [batch_t 0.394 (0.434)] [data_t 0.016] [optim_t 0.378] [lr 0.000032] [CE 2.904 (2.769)] [KD 0.000 (0.000)] 2024-10-13 10:15:18,960 - Train: 98.24% [368700/375300] [294.7/300.0] [batch_t 0.435 (0.454)] [data_t 0.015] [optim_t 0.420] [lr 0.000032] [CE 2.507 (2.754)] [KD 0.000 (0.000)] 2024-10-13 10:15:41,533 - Train: 98.25% [368750/375300] [294.8/300.0] [batch_t 0.410 (0.451)] [data_t 0.016] [optim_t 0.395] [lr 0.000032] [CE 2.529 (2.751)] [KD 0.000 (0.000)] 2024-10-13 10:16:03,853 - Train: 98.27% [368800/375300] [294.8/300.0] [batch_t 0.415 (0.446)] [data_t 0.015] [optim_t 0.399] [lr 0.000032] [CE 2.717 (2.769)] [KD 0.000 (0.000)] 2024-10-13 10:16:25,907 - Train: 98.28% [368850/375300] [294.8/300.0] [batch_t 0.438 (0.441)] [data_t 0.016] [optim_t 0.422] [lr 0.000032] [CE 2.588 (2.797)] [KD 0.000 (0.000)] 2024-10-13 10:16:47,048 - Train: 98.29% [368900/375300] [294.9/300.0] [batch_t 0.458 (0.423)] [data_t 0.016] [optim_t 0.443] [lr 0.000032] [CE 2.730 (2.781)] [KD 0.000 (0.000)] 2024-10-13 10:17:08,103 - Train: 98.31% [368950/375300] [294.9/300.0] [batch_t 0.805 (0.421)] [data_t 0.016] [optim_t 0.789] [lr 0.000032] [CE 2.724 (2.752)] [KD 0.000 (0.000)] 2024-10-13 10:17:29,816 - Train: 98.32% [369000/375300] [295.0/300.0] [batch_t 0.520 (0.434)] [data_t 0.016] [optim_t 0.504] [lr 0.000032] [CE 2.822 (2.739)] [KD 0.000 (0.000)] 2024-10-13 10:18:09,688 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.434)] [top1_cnt 41181] [top5_cnt 48090] [top_all 50000] 2024-10-13 10:18:09,689 - net: 82.362 (96.180) 2024-10-13 10:18:32,177 - Test (net_E): 100.00% [50/50] [batch_t 0.153 (0.440)] [top1_cnt 41244] [top5_cnt 48127] [top_all 50000] 2024-10-13 10:18:32,178 - net_E: 82.488 (96.254) 2024-10-13 10:18:32,382 - Max [top1: 82.362 (epoch: 295)] [top1-ema: 82.494 (epoch: 289)] 2024-10-13 10:18:32,382 - ==> Total time: 1 day, 22:31:36 Eta: 0:47:18 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 10:18:41,920 - Train: 98.33% [369050/375300] [295.0/300.0] [batch_t 0.312 (0.886)] [data_t 0.016] [optim_t 0.296] [lr 0.000032] [CE 2.831 (2.769)] [KD 0.000 (0.000)] 2024-10-13 10:19:01,067 - Train: 98.35% [369100/375300] [295.0/300.0] [batch_t 0.514 (0.383)] [data_t 0.016] [optim_t 0.498] [lr 0.000032] [CE 2.454 (2.733)] [KD 0.000 (0.000)] 2024-10-13 10:19:23,038 - Train: 98.36% [369150/375300] [295.1/300.0] [batch_t 0.417 (0.439)] [data_t 0.015] [optim_t 0.402] [lr 0.000032] [CE 2.937 (2.772)] [KD 0.000 (0.000)] 2024-10-13 10:19:44,199 - Train: 98.37% [369200/375300] [295.1/300.0] [batch_t 0.316 (0.423)] [data_t 0.016] [optim_t 0.300] [lr 0.000032] [CE 2.975 (2.776)] [KD 0.000 (0.000)] 2024-10-13 10:20:06,314 - Train: 98.39% [369250/375300] [295.2/300.0] [batch_t 0.447 (0.442)] [data_t 0.016] [optim_t 0.432] [lr 0.000032] [CE 2.887 (2.764)] [KD 0.000 (0.000)] 2024-10-13 10:20:28,251 - Train: 98.40% [369300/375300] [295.2/300.0] [batch_t 0.338 (0.439)] [data_t 0.016] [optim_t 0.322] [lr 0.000032] [CE 2.877 (2.716)] [KD 0.000 (0.000)] 2024-10-13 10:20:50,146 - Train: 98.41% [369350/375300] [295.2/300.0] [batch_t 0.443 (0.438)] [data_t 0.016] [optim_t 0.427] [lr 0.000032] [CE 2.926 (2.754)] [KD 0.000 (0.000)] 2024-10-13 10:21:11,453 - Train: 98.43% [369400/375300] [295.3/300.0] [batch_t 0.414 (0.426)] [data_t 0.016] [optim_t 0.398] [lr 0.000032] [CE 2.739 (2.782)] [KD 0.000 (0.000)] 2024-10-13 10:21:33,079 - Train: 98.44% [369450/375300] [295.3/300.0] [batch_t 0.473 (0.432)] [data_t 0.016] [optim_t 0.457] [lr 0.000032] [CE 2.876 (2.720)] [KD 0.000 (0.000)] 2024-10-13 10:21:54,977 - Train: 98.45% [369500/375300] [295.4/300.0] [batch_t 0.445 (0.438)] [data_t 0.016] [optim_t 0.429] [lr 0.000032] [CE 2.811 (2.745)] [KD 0.000 (0.000)] 2024-10-13 10:22:17,046 - Train: 98.47% [369550/375300] [295.4/300.0] [batch_t 0.463 (0.441)] [data_t 0.016] [optim_t 0.448] [lr 0.000032] [CE 2.740 (2.777)] [KD 0.000 (0.000)] 2024-10-13 10:22:38,696 - Train: 98.48% [369600/375300] [295.4/300.0] [batch_t 0.492 (0.433)] [data_t 0.016] [optim_t 0.476] [lr 0.000032] [CE 2.684 (2.756)] [KD 0.000 (0.000)] 2024-10-13 10:23:00,764 - Train: 98.49% [369650/375300] [295.5/300.0] [batch_t 0.421 (0.441)] [data_t 0.016] [optim_t 0.405] [lr 0.000032] [CE 2.692 (2.804)] [KD 0.000 (0.000)] 2024-10-13 10:23:22,835 - Train: 98.51% [369700/375300] [295.5/300.0] [batch_t 0.414 (0.441)] [data_t 0.016] [optim_t 0.398] [lr 0.000032] [CE 2.595 (2.763)] [KD 0.000 (0.000)] 2024-10-13 10:23:44,608 - Train: 98.52% [369750/375300] [295.6/300.0] [batch_t 0.417 (0.435)] [data_t 0.016] [optim_t 0.401] [lr 0.000032] [CE 2.555 (2.731)] [KD 0.000 (0.000)] 2024-10-13 10:24:06,159 - Train: 98.53% [369800/375300] [295.6/300.0] [batch_t 0.434 (0.431)] [data_t 0.015] [optim_t 0.418] [lr 0.000032] [CE 2.527 (2.784)] [KD 0.000 (0.000)] 2024-10-13 10:24:27,854 - Train: 98.55% [369850/375300] [295.6/300.0] [batch_t 0.404 (0.434)] [data_t 0.016] [optim_t 0.388] [lr 0.000032] [CE 2.501 (2.737)] [KD 0.000 (0.000)] 2024-10-13 10:24:49,462 - Train: 98.56% [369900/375300] [295.7/300.0] [batch_t 0.438 (0.432)] [data_t 0.016] [optim_t 0.422] [lr 0.000032] [CE 2.552 (2.774)] [KD 0.000 (0.000)] 2024-10-13 10:25:11,111 - Train: 98.57% [369950/375300] [295.7/300.0] [batch_t 0.403 (0.433)] [data_t 0.016] [optim_t 0.387] [lr 0.000031] [CE 2.763 (2.751)] [KD 0.000 (0.000)] 2024-10-13 10:25:33,449 - Train: 98.59% [370000/375300] [295.8/300.0] [batch_t 0.468 (0.447)] [data_t 0.016] [optim_t 0.452] [lr 0.000031] [CE 2.551 (2.730)] [KD 0.000 (0.000)] 2024-10-13 10:25:55,236 - Train: 98.60% [370050/375300] [295.8/300.0] [batch_t 0.415 (0.436)] [data_t 0.016] [optim_t 0.399] [lr 0.000031] [CE 2.902 (2.713)] [KD 0.000 (0.000)] 2024-10-13 10:26:16,788 - Train: 98.61% [370100/375300] [295.8/300.0] [batch_t 0.457 (0.431)] [data_t 0.016] [optim_t 0.441] [lr 0.000031] [CE 2.686 (2.773)] [KD 0.000 (0.000)] 2024-10-13 10:26:38,957 - Train: 98.63% [370150/375300] [295.9/300.0] [batch_t 0.435 (0.443)] [data_t 0.016] [optim_t 0.420] [lr 0.000031] [CE 2.843 (2.786)] [KD 0.000 (0.000)] 2024-10-13 10:27:00,673 - Train: 98.64% [370200/375300] [295.9/300.0] [batch_t 0.448 (0.434)] [data_t 0.016] [optim_t 0.432] [lr 0.000031] [CE 2.906 (2.772)] [KD 0.000 (0.000)] 2024-10-13 10:27:22,542 - Train: 98.65% [370250/375300] [296.0/300.0] [batch_t 0.419 (0.437)] [data_t 0.016] [optim_t 0.404] [lr 0.000031] [CE 2.681 (2.762)] [KD 0.000 (0.000)] 2024-10-13 10:28:03,363 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.438)] [top1_cnt 41206] [top5_cnt 48101] [top_all 50000] 2024-10-13 10:28:03,364 - net: 82.412 (96.202) 2024-10-13 10:28:26,179 - Test (net_E): 100.00% [50/50] [batch_t 0.129 (0.447)] [top1_cnt 41243] [top5_cnt 48122] [top_all 50000] 2024-10-13 10:28:26,180 - net_E: 82.486 (96.244) 2024-10-13 10:28:26,344 - Max [top1: 82.412 (epoch: 296)] [top1-ema: 82.494 (epoch: 289)] 2024-10-13 10:28:26,344 - ==> Total time: 1 day, 22:41:30 Eta: 0:37:51 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 10:28:36,420 - Train: 98.67% [370300/375300] [296.0/300.0] [batch_t 0.313 (0.994)] [data_t 0.015] [optim_t 0.297] [lr 0.000031] [CE 2.833 (2.836)] [KD 0.000 (0.000)] 2024-10-13 10:28:56,116 - Train: 98.68% [370350/375300] [296.0/300.0] [batch_t 0.392 (0.394)] [data_t 0.016] [optim_t 0.376] [lr 0.000031] [CE 2.757 (2.764)] [KD 0.000 (0.000)] 2024-10-13 10:29:17,935 - Train: 98.69% [370400/375300] [296.1/300.0] [batch_t 0.391 (0.436)] [data_t 0.016] [optim_t 0.375] [lr 0.000031] [CE 2.843 (2.765)] [KD 0.000 (0.000)] 2024-10-13 10:29:40,176 - Train: 98.71% [370450/375300] [296.1/300.0] [batch_t 0.340 (0.445)] [data_t 0.016] [optim_t 0.324] [lr 0.000031] [CE 2.685 (2.787)] [KD 0.000 (0.000)] 2024-10-13 10:30:02,410 - Train: 98.72% [370500/375300] [296.2/300.0] [batch_t 0.410 (0.445)] [data_t 0.016] [optim_t 0.394] [lr 0.000031] [CE 2.668 (2.789)] [KD 0.000 (0.000)] 2024-10-13 10:30:24,152 - Train: 98.73% [370550/375300] [296.2/300.0] [batch_t 0.443 (0.435)] [data_t 0.016] [optim_t 0.427] [lr 0.000031] [CE 2.890 (2.777)] [KD 0.000 (0.000)] 2024-10-13 10:30:45,731 - Train: 98.75% [370600/375300] [296.2/300.0] [batch_t 0.416 (0.431)] [data_t 0.015] [optim_t 0.401] [lr 0.000031] [CE 2.600 (2.727)] [KD 0.000 (0.000)] 2024-10-13 10:31:07,373 - Train: 98.76% [370650/375300] [296.3/300.0] [batch_t 0.322 (0.433)] [data_t 0.015] [optim_t 0.307] [lr 0.000031] [CE 2.663 (2.742)] [KD 0.000 (0.000)] 2024-10-13 10:31:29,050 - Train: 98.77% [370700/375300] [296.3/300.0] [batch_t 0.434 (0.433)] [data_t 0.015] [optim_t 0.419] [lr 0.000031] [CE 2.799 (2.780)] [KD 0.000 (0.000)] 2024-10-13 10:31:51,434 - Train: 98.79% [370750/375300] [296.4/300.0] [batch_t 0.318 (0.448)] [data_t 0.015] [optim_t 0.303] [lr 0.000031] [CE 2.919 (2.741)] [KD 0.000 (0.000)] 2024-10-13 10:32:13,291 - Train: 98.80% [370800/375300] [296.4/300.0] [batch_t 0.491 (0.437)] [data_t 0.016] [optim_t 0.475] [lr 0.000031] [CE 2.664 (2.743)] [KD 0.000 (0.000)] 2024-10-13 10:32:35,141 - Train: 98.81% [370850/375300] [296.4/300.0] [batch_t 0.376 (0.437)] [data_t 0.016] [optim_t 0.360] [lr 0.000031] [CE 2.586 (2.776)] [KD 0.000 (0.000)] 2024-10-13 10:32:57,252 - Train: 98.83% [370900/375300] [296.5/300.0] [batch_t 0.471 (0.442)] [data_t 0.015] [optim_t 0.455] [lr 0.000031] [CE 2.675 (2.786)] [KD 0.000 (0.000)] 2024-10-13 10:33:19,446 - Train: 98.84% [370950/375300] [296.5/300.0] [batch_t 0.312 (0.444)] [data_t 0.015] [optim_t 0.296] [lr 0.000031] [CE 2.594 (2.794)] [KD 0.000 (0.000)] 2024-10-13 10:33:40,865 - Train: 98.85% [371000/375300] [296.6/300.0] [batch_t 0.316 (0.428)] [data_t 0.015] [optim_t 0.301] [lr 0.000031] [CE 2.699 (2.798)] [KD 0.000 (0.000)] 2024-10-13 10:34:02,111 - Train: 98.87% [371050/375300] [296.6/300.0] [batch_t 0.355 (0.425)] [data_t 0.016] [optim_t 0.339] [lr 0.000031] [CE 2.467 (2.730)] [KD 0.000 (0.000)] 2024-10-13 10:34:23,741 - Train: 98.88% [371100/375300] [296.6/300.0] [batch_t 0.511 (0.432)] [data_t 0.016] [optim_t 0.496] [lr 0.000031] [CE 2.869 (2.718)] [KD 0.000 (0.000)] 2024-10-13 10:34:45,158 - Train: 98.89% [371150/375300] [296.7/300.0] [batch_t 0.426 (0.428)] [data_t 0.016] [optim_t 0.410] [lr 0.000031] [CE 2.738 (2.741)] [KD 0.000 (0.000)] 2024-10-13 10:35:06,779 - Train: 98.91% [371200/375300] [296.7/300.0] [batch_t 0.417 (0.432)] [data_t 0.016] [optim_t 0.401] [lr 0.000031] [CE 2.501 (2.796)] [KD 0.000 (0.000)] 2024-10-13 10:35:28,383 - Train: 98.92% [371250/375300] [296.8/300.0] [batch_t 0.401 (0.432)] [data_t 0.016] [optim_t 0.386] [lr 0.000031] [CE 2.914 (2.778)] [KD 0.000 (0.000)] 2024-10-13 10:35:49,675 - Train: 98.93% [371300/375300] [296.8/300.0] [batch_t 0.439 (0.426)] [data_t 0.016] [optim_t 0.423] [lr 0.000031] [CE 3.112 (2.761)] [KD 0.000 (0.000)] 2024-10-13 10:36:10,942 - Train: 98.95% [371350/375300] [296.8/300.0] [batch_t 0.320 (0.425)] [data_t 0.016] [optim_t 0.304] [lr 0.000031] [CE 2.560 (2.754)] [KD 0.000 (0.000)] 2024-10-13 10:36:32,969 - Train: 98.96% [371400/375300] [296.9/300.0] [batch_t 0.457 (0.440)] [data_t 0.164] [optim_t 0.293] [lr 0.000031] [CE 2.921 (2.752)] [KD 0.000 (0.000)] 2024-10-13 10:36:55,892 - Train: 98.97% [371450/375300] [296.9/300.0] [batch_t 0.892 (0.458)] [data_t 0.598] [optim_t 0.294] [lr 0.000031] [CE 2.461 (2.725)] [KD 0.000 (0.000)] 2024-10-13 10:37:17,686 - Train: 98.99% [371500/375300] [297.0/300.0] [batch_t 0.560 (0.436)] [data_t 0.259] [optim_t 0.301] [lr 0.000031] [CE 2.962 (2.800)] [KD 0.000 (0.000)] 2024-10-13 10:37:58,904 - Test (net): 100.00% [50/50] [batch_t 0.129 (0.434)] [top1_cnt 41118] [top5_cnt 48106] [top_all 50000] 2024-10-13 10:37:58,905 - net: 82.236 (96.212) 2024-10-13 10:38:20,573 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.427)] [top1_cnt 41249] [top5_cnt 48126] [top_all 50000] 2024-10-13 10:38:20,573 - net_E: 82.498 (96.252) 2024-10-13 10:38:20,737 - Max [top1: 82.412 (epoch: 296)] [top1-ema: 82.498 (epoch: 297)] 2024-10-13 10:38:20,737 - ==> Total time: 1 day, 22:51:24 Eta: 0:28:23 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 10:38:30,382 - Train: 99.00% [371550/375300] [297.0/300.0] [batch_t 0.509 (1.669)] [data_t 0.016] [optim_t 0.493] [lr 0.000031] [CE 2.706 (2.738)] [KD 0.000 (0.000)] 2024-10-13 10:38:50,904 - Train: 99.01% [371600/375300] [297.0/300.0] [batch_t 0.848 (0.410)] [data_t 0.016] [optim_t 0.832] [lr 0.000031] [CE 2.655 (2.749)] [KD 0.000 (0.000)] 2024-10-13 10:39:12,686 - Train: 99.03% [371650/375300] [297.1/300.0] [batch_t 0.471 (0.436)] [data_t 0.016] [optim_t 0.455] [lr 0.000031] [CE 2.696 (2.743)] [KD 0.000 (0.000)] 2024-10-13 10:39:34,478 - Train: 99.04% [371700/375300] [297.1/300.0] [batch_t 0.410 (0.436)] [data_t 0.016] [optim_t 0.395] [lr 0.000031] [CE 3.067 (2.773)] [KD 0.000 (0.000)] 2024-10-13 10:39:55,662 - Train: 99.05% [371750/375300] [297.2/300.0] [batch_t 0.501 (0.424)] [data_t 0.016] [optim_t 0.485] [lr 0.000031] [CE 2.794 (2.746)] [KD 0.000 (0.000)] 2024-10-13 10:40:17,454 - Train: 99.07% [371800/375300] [297.2/300.0] [batch_t 0.446 (0.436)] [data_t 0.015] [optim_t 0.431] [lr 0.000031] [CE 2.990 (2.765)] [KD 0.000 (0.000)] 2024-10-13 10:40:38,393 - Train: 99.08% [371850/375300] [297.2/300.0] [batch_t 0.444 (0.419)] [data_t 0.016] [optim_t 0.428] [lr 0.000031] [CE 3.004 (2.760)] [KD 0.000 (0.000)] 2024-10-13 10:40:58,898 - Train: 99.09% [371900/375300] [297.3/300.0] [batch_t 0.479 (0.410)] [data_t 0.016] [optim_t 0.464] [lr 0.000031] [CE 2.757 (2.753)] [KD 0.000 (0.000)] 2024-10-13 10:41:20,629 - Train: 99.11% [371950/375300] [297.3/300.0] [batch_t 0.470 (0.434)] [data_t 0.016] [optim_t 0.454] [lr 0.000031] [CE 2.688 (2.758)] [KD 0.000 (0.000)] 2024-10-13 10:41:42,188 - Train: 99.12% [372000/375300] [297.4/300.0] [batch_t 0.388 (0.431)] [data_t 0.015] [optim_t 0.373] [lr 0.000031] [CE 3.062 (2.763)] [KD 0.000 (0.000)] 2024-10-13 10:42:02,585 - Train: 99.13% [372050/375300] [297.4/300.0] [batch_t 0.401 (0.408)] [data_t 0.016] [optim_t 0.385] [lr 0.000031] [CE 2.899 (2.748)] [KD 0.000 (0.000)] 2024-10-13 10:42:23,372 - Train: 99.15% [372100/375300] [297.4/300.0] [batch_t 0.487 (0.416)] [data_t 0.015] [optim_t 0.472] [lr 0.000031] [CE 2.501 (2.745)] [KD 0.000 (0.000)] 2024-10-13 10:42:45,725 - Train: 99.16% [372150/375300] [297.5/300.0] [batch_t 0.433 (0.447)] [data_t 0.138] [optim_t 0.296] [lr 0.000031] [CE 2.841 (2.764)] [KD 0.000 (0.000)] 2024-10-13 10:43:07,853 - Train: 99.17% [372200/375300] [297.5/300.0] [batch_t 0.456 (0.442)] [data_t 0.159] [optim_t 0.297] [lr 0.000031] [CE 2.917 (2.736)] [KD 0.000 (0.000)] 2024-10-13 10:43:30,152 - Train: 99.19% [372250/375300] [297.6/300.0] [batch_t 0.355 (0.446)] [data_t 0.061] [optim_t 0.294] [lr 0.000030] [CE 2.930 (2.755)] [KD 0.000 (0.000)] 2024-10-13 10:43:51,107 - Train: 99.20% [372300/375300] [297.6/300.0] [batch_t 0.402 (0.419)] [data_t 0.104] [optim_t 0.298] [lr 0.000030] [CE 2.931 (2.776)] [KD 0.000 (0.000)] 2024-10-13 10:44:12,027 - Train: 99.21% [372350/375300] [297.6/300.0] [batch_t 0.384 (0.418)] [data_t 0.090] [optim_t 0.294] [lr 0.000030] [CE 2.899 (2.730)] [KD 0.000 (0.000)] 2024-10-13 10:44:34,119 - Train: 99.23% [372400/375300] [297.7/300.0] [batch_t 0.388 (0.442)] [data_t 0.015] [optim_t 0.373] [lr 0.000030] [CE 2.612 (2.755)] [KD 0.000 (0.000)] 2024-10-13 10:44:55,710 - Train: 99.24% [372450/375300] [297.7/300.0] [batch_t 0.503 (0.432)] [data_t 0.015] [optim_t 0.488] [lr 0.000030] [CE 2.864 (2.780)] [KD 0.000 (0.000)] 2024-10-13 10:45:17,688 - Train: 99.25% [372500/375300] [297.8/300.0] [batch_t 0.314 (0.439)] [data_t 0.015] [optim_t 0.299] [lr 0.000030] [CE 2.568 (2.732)] [KD 0.000 (0.000)] 2024-10-13 10:45:39,216 - Train: 99.27% [372550/375300] [297.8/300.0] [batch_t 0.394 (0.430)] [data_t 0.015] [optim_t 0.379] [lr 0.000030] [CE 2.777 (2.761)] [KD 0.000 (0.000)] 2024-10-13 10:46:00,789 - Train: 99.28% [372600/375300] [297.8/300.0] [batch_t 0.320 (0.431)] [data_t 0.016] [optim_t 0.305] [lr 0.000030] [CE 2.327 (2.752)] [KD 0.000 (0.000)] 2024-10-13 10:46:21,777 - Train: 99.29% [372650/375300] [297.9/300.0] [batch_t 0.385 (0.420)] [data_t 0.015] [optim_t 0.370] [lr 0.000030] [CE 2.371 (2.722)] [KD 0.000 (0.000)] 2024-10-13 10:46:42,418 - Train: 99.31% [372700/375300] [297.9/300.0] [batch_t 0.439 (0.413)] [data_t 0.016] [optim_t 0.423] [lr 0.000030] [CE 2.902 (2.803)] [KD 0.000 (0.000)] 2024-10-13 10:47:03,449 - Train: 99.32% [372750/375300] [298.0/300.0] [batch_t 0.471 (0.421)] [data_t 0.015] [optim_t 0.456] [lr 0.000030] [CE 2.915 (2.743)] [KD 0.000 (0.000)] 2024-10-13 10:47:44,335 - Test (net): 100.00% [50/50] [batch_t 0.134 (0.422)] [top1_cnt 41180] [top5_cnt 48074] [top_all 50000] 2024-10-13 10:47:44,335 - net: 82.360 (96.148) 2024-10-13 10:48:05,956 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.426)] [top1_cnt 41249] [top5_cnt 48129] [top_all 50000] 2024-10-13 10:48:05,956 - net_E: 82.498 (96.258) 2024-10-13 10:48:06,122 - Max [top1: 82.412 (epoch: 296)] [top1-ema: 82.498 (epoch: 297)] 2024-10-13 10:48:06,123 - ==> Total time: 1 day, 23:01:10 Eta: 0:18:56 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 10:48:13,335 - Train: 99.33% [372800/375300] [298.0/300.0] [batch_t 0.325 (2.772)] [data_t 0.016] [optim_t 0.309] [lr 0.000030] [CE 2.936 (2.952)] [KD 0.000 (0.000)] 2024-10-13 10:48:32,825 - Train: 99.35% [372850/375300] [298.0/300.0] [batch_t 0.407 (0.390)] [data_t 0.015] [optim_t 0.392] [lr 0.000030] [CE 2.700 (2.745)] [KD 0.000 (0.000)] 2024-10-13 10:48:54,938 - Train: 99.36% [372900/375300] [298.1/300.0] [batch_t 0.549 (0.442)] [data_t 0.016] [optim_t 0.534] [lr 0.000030] [CE 2.782 (2.747)] [KD 0.000 (0.000)] 2024-10-13 10:49:18,002 - Train: 99.37% [372950/375300] [298.1/300.0] [batch_t 0.499 (0.461)] [data_t 0.016] [optim_t 0.483] [lr 0.000030] [CE 2.597 (2.779)] [KD 0.000 (0.000)] 2024-10-13 10:49:39,820 - Train: 99.39% [373000/375300] [298.2/300.0] [batch_t 0.477 (0.436)] [data_t 0.016] [optim_t 0.461] [lr 0.000030] [CE 2.885 (2.745)] [KD 0.000 (0.000)] 2024-10-13 10:50:01,788 - Train: 99.40% [373050/375300] [298.2/300.0] [batch_t 0.496 (0.439)] [data_t 0.016] [optim_t 0.480] [lr 0.000030] [CE 2.574 (2.753)] [KD 0.000 (0.000)] 2024-10-13 10:50:23,507 - Train: 99.41% [373100/375300] [298.2/300.0] [batch_t 0.480 (0.434)] [data_t 0.016] [optim_t 0.465] [lr 0.000030] [CE 2.894 (2.778)] [KD 0.000 (0.000)] 2024-10-13 10:50:45,166 - Train: 99.43% [373150/375300] [298.3/300.0] [batch_t 0.477 (0.433)] [data_t 0.016] [optim_t 0.461] [lr 0.000030] [CE 2.800 (2.784)] [KD 0.000 (0.000)] 2024-10-13 10:51:06,399 - Train: 99.44% [373200/375300] [298.3/300.0] [batch_t 0.374 (0.425)] [data_t 0.016] [optim_t 0.359] [lr 0.000030] [CE 2.457 (2.739)] [KD 0.000 (0.000)] 2024-10-13 10:51:27,658 - Train: 99.45% [373250/375300] [298.4/300.0] [batch_t 0.400 (0.425)] [data_t 0.106] [optim_t 0.294] [lr 0.000030] [CE 2.815 (2.735)] [KD 0.000 (0.000)] 2024-10-13 10:51:48,794 - Train: 99.47% [373300/375300] [298.4/300.0] [batch_t 0.427 (0.423)] [data_t 0.015] [optim_t 0.412] [lr 0.000030] [CE 2.787 (2.746)] [KD 0.000 (0.000)] 2024-10-13 10:52:09,911 - Train: 99.48% [373350/375300] [298.4/300.0] [batch_t 0.472 (0.422)] [data_t 0.016] [optim_t 0.456] [lr 0.000030] [CE 2.503 (2.748)] [KD 0.000 (0.000)] 2024-10-13 10:52:31,239 - Train: 99.49% [373400/375300] [298.5/300.0] [batch_t 0.409 (0.426)] [data_t 0.015] [optim_t 0.393] [lr 0.000030] [CE 2.850 (2.744)] [KD 0.000 (0.000)] 2024-10-13 10:52:53,064 - Train: 99.51% [373450/375300] [298.5/300.0] [batch_t 0.448 (0.436)] [data_t 0.016] [optim_t 0.432] [lr 0.000030] [CE 2.883 (2.756)] [KD 0.000 (0.000)] 2024-10-13 10:53:14,750 - Train: 99.52% [373500/375300] [298.6/300.0] [batch_t 0.463 (0.434)] [data_t 0.015] [optim_t 0.448] [lr 0.000030] [CE 2.953 (2.787)] [KD 0.000 (0.000)] 2024-10-13 10:53:37,119 - Train: 99.53% [373550/375300] [298.6/300.0] [batch_t 0.406 (0.447)] [data_t 0.015] [optim_t 0.391] [lr 0.000030] [CE 2.727 (2.769)] [KD 0.000 (0.000)] 2024-10-13 10:53:59,135 - Train: 99.55% [373600/375300] [298.6/300.0] [batch_t 0.421 (0.440)] [data_t 0.015] [optim_t 0.406] [lr 0.000030] [CE 2.689 (2.783)] [KD 0.000 (0.000)] 2024-10-13 10:54:20,746 - Train: 99.56% [373650/375300] [298.7/300.0] [batch_t 0.395 (0.432)] [data_t 0.015] [optim_t 0.379] [lr 0.000030] [CE 2.751 (2.738)] [KD 0.000 (0.000)] 2024-10-13 10:54:42,328 - Train: 99.57% [373700/375300] [298.7/300.0] [batch_t 0.420 (0.432)] [data_t 0.016] [optim_t 0.405] [lr 0.000030] [CE 2.747 (2.779)] [KD 0.000 (0.000)] 2024-10-13 10:55:03,607 - Train: 99.59% [373750/375300] [298.8/300.0] [batch_t 0.448 (0.425)] [data_t 0.015] [optim_t 0.433] [lr 0.000030] [CE 2.663 (2.747)] [KD 0.000 (0.000)] 2024-10-13 10:55:25,016 - Train: 99.60% [373800/375300] [298.8/300.0] [batch_t 0.355 (0.428)] [data_t 0.016] [optim_t 0.340] [lr 0.000030] [CE 2.962 (2.781)] [KD 0.000 (0.000)] 2024-10-13 10:55:46,639 - Train: 99.61% [373850/375300] [298.8/300.0] [batch_t 0.480 (0.432)] [data_t 0.016] [optim_t 0.464] [lr 0.000030] [CE 2.954 (2.739)] [KD 0.000 (0.000)] 2024-10-13 10:56:08,740 - Train: 99.63% [373900/375300] [298.9/300.0] [batch_t 0.435 (0.442)] [data_t 0.016] [optim_t 0.419] [lr 0.000030] [CE 2.653 (2.751)] [KD 0.000 (0.000)] 2024-10-13 10:56:30,786 - Train: 99.64% [373950/375300] [298.9/300.0] [batch_t 0.321 (0.441)] [data_t 0.016] [optim_t 0.305] [lr 0.000030] [CE 3.064 (2.777)] [KD 0.000 (0.000)] 2024-10-13 10:56:53,020 - Train: 99.65% [374000/375300] [299.0/300.0] [batch_t 0.513 (0.445)] [data_t 0.016] [optim_t 0.497] [lr 0.000030] [CE 2.774 (2.756)] [KD 0.000 (0.000)] 2024-10-13 10:57:35,158 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.427)] [top1_cnt 41112] [top5_cnt 48090] [top_all 50000] 2024-10-13 10:57:35,159 - net: 82.224 (96.180) 2024-10-13 10:57:56,560 - Test (net_E): 100.00% [50/50] [batch_t 0.166 (0.420)] [top1_cnt 41236] [top5_cnt 48126] [top_all 50000] 2024-10-13 10:57:56,561 - net_E: 82.472 (96.252) 2024-10-13 10:57:56,706 - Max [top1: 82.412 (epoch: 296)] [top1-ema: 82.498 (epoch: 297)] 2024-10-13 10:57:56,706 - ==> Total time: 1 day, 23:11:00 Eta: 0:09:28 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 10:58:03,283 - Train: 99.67% [374050/375300] [299.0/300.0] [batch_t 5.171 (5.171)] [data_t 4.271] [optim_t 0.900] [lr 0.000030] [CE 2.731 (2.731)] [KD 0.000 (0.000)] 2024-10-13 10:58:23,114 - Train: 99.68% [374100/375300] [299.0/300.0] [batch_t 0.315 (0.396)] [data_t 0.016] [optim_t 0.300] [lr 0.000030] [CE 2.607 (2.751)] [KD 0.000 (0.000)] 2024-10-13 10:58:45,745 - Train: 99.69% [374150/375300] [299.1/300.0] [batch_t 0.434 (0.452)] [data_t 0.016] [optim_t 0.418] [lr 0.000030] [CE 2.986 (2.757)] [KD 0.000 (0.000)] 2024-10-13 10:59:07,900 - Train: 99.71% [374200/375300] [299.1/300.0] [batch_t 0.502 (0.443)] [data_t 0.016] [optim_t 0.487] [lr 0.000030] [CE 2.598 (2.735)] [KD 0.000 (0.000)] 2024-10-13 10:59:30,329 - Train: 99.72% [374250/375300] [299.2/300.0] [batch_t 0.496 (0.448)] [data_t 0.016] [optim_t 0.480] [lr 0.000030] [CE 2.934 (2.742)] [KD 0.000 (0.000)] 2024-10-13 10:59:52,294 - Train: 99.73% [374300/375300] [299.2/300.0] [batch_t 0.437 (0.439)] [data_t 0.016] [optim_t 0.421] [lr 0.000030] [CE 2.811 (2.747)] [KD 0.000 (0.000)] 2024-10-13 11:00:14,946 - Train: 99.75% [374350/375300] [299.2/300.0] [batch_t 0.408 (0.453)] [data_t 0.016] [optim_t 0.392] [lr 0.000030] [CE 2.907 (2.768)] [KD 0.000 (0.000)] 2024-10-13 11:00:36,195 - Train: 99.76% [374400/375300] [299.3/300.0] [batch_t 0.404 (0.425)] [data_t 0.016] [optim_t 0.388] [lr 0.000030] [CE 2.939 (2.741)] [KD 0.000 (0.000)] 2024-10-13 11:00:58,025 - Train: 99.77% [374450/375300] [299.3/300.0] [batch_t 0.434 (0.436)] [data_t 0.016] [optim_t 0.418] [lr 0.000030] [CE 2.730 (2.737)] [KD 0.000 (0.000)] 2024-10-13 11:01:21,215 - Train: 99.79% [374500/375300] [299.4/300.0] [batch_t 0.426 (0.464)] [data_t 0.016] [optim_t 0.410] [lr 0.000030] [CE 2.717 (2.719)] [KD 0.000 (0.000)] 2024-10-13 11:01:43,417 - Train: 99.80% [374550/375300] [299.4/300.0] [batch_t 0.518 (0.444)] [data_t 0.016] [optim_t 0.503] [lr 0.000030] [CE 2.753 (2.779)] [KD 0.000 (0.000)] 2024-10-13 11:02:05,764 - Train: 99.81% [374600/375300] [299.4/300.0] [batch_t 0.415 (0.447)] [data_t 0.016] [optim_t 0.399] [lr 0.000030] [CE 2.531 (2.764)] [KD 0.000 (0.000)] 2024-10-13 11:02:27,841 - Train: 99.83% [374650/375300] [299.5/300.0] [batch_t 0.420 (0.441)] [data_t 0.015] [optim_t 0.404] [lr 0.000030] [CE 2.499 (2.761)] [KD 0.000 (0.000)] 2024-10-13 11:02:49,915 - Train: 99.84% [374700/375300] [299.5/300.0] [batch_t 0.422 (0.441)] [data_t 0.015] [optim_t 0.407] [lr 0.000030] [CE 2.623 (2.746)] [KD 0.000 (0.000)] 2024-10-13 11:03:12,168 - Train: 99.85% [374750/375300] [299.6/300.0] [batch_t 0.499 (0.445)] [data_t 0.016] [optim_t 0.482] [lr 0.000030] [CE 2.862 (2.751)] [KD 0.000 (0.000)] 2024-10-13 11:03:34,079 - Train: 99.87% [374800/375300] [299.6/300.0] [batch_t 0.457 (0.438)] [data_t 0.016] [optim_t 0.442] [lr 0.000030] [CE 2.701 (2.719)] [KD 0.000 (0.000)] 2024-10-13 11:03:55,257 - Train: 99.88% [374850/375300] [299.6/300.0] [batch_t 0.422 (0.423)] [data_t 0.016] [optim_t 0.406] [lr 0.000030] [CE 2.743 (2.724)] [KD 0.000 (0.000)] 2024-10-13 11:04:16,762 - Train: 99.89% [374900/375300] [299.7/300.0] [batch_t 0.434 (0.430)] [data_t 0.016] [optim_t 0.418] [lr 0.000030] [CE 2.629 (2.752)] [KD 0.000 (0.000)] 2024-10-13 11:04:37,895 - Train: 99.91% [374950/375300] [299.7/300.0] [batch_t 0.380 (0.423)] [data_t 0.016] [optim_t 0.364] [lr 0.000030] [CE 2.613 (2.717)] [KD 0.000 (0.000)] 2024-10-13 11:04:59,017 - Train: 99.92% [375000/375300] [299.8/300.0] [batch_t 0.380 (0.422)] [data_t 0.016] [optim_t 0.364] [lr 0.000030] [CE 2.736 (2.773)] [KD 0.000 (0.000)] 2024-10-13 11:05:20,488 - Train: 99.93% [375050/375300] [299.8/300.0] [batch_t 0.444 (0.429)] [data_t 0.015] [optim_t 0.429] [lr 0.000030] [CE 2.880 (2.775)] [KD 0.000 (0.000)] 2024-10-13 11:05:42,792 - Train: 99.95% [375100/375300] [299.8/300.0] [batch_t 0.437 (0.446)] [data_t 0.016] [optim_t 0.421] [lr 0.000030] [CE 2.698 (2.761)] [KD 0.000 (0.000)] 2024-10-13 11:06:05,388 - Train: 99.96% [375150/375300] [299.9/300.0] [batch_t 0.467 (0.452)] [data_t 0.016] [optim_t 0.451] [lr 0.000030] [CE 2.835 (2.736)] [KD 0.000 (0.000)] 2024-10-13 11:06:27,647 - Train: 99.97% [375200/375300] [299.9/300.0] [batch_t 0.478 (0.445)] [data_t 0.016] [optim_t 0.462] [lr 0.000030] [CE 2.595 (2.789)] [KD 0.000 (0.000)] 2024-10-13 11:06:48,751 - Train: 99.99% [375250/375300] [300.0/300.0] [batch_t 0.412 (0.422)] [data_t 0.016] [optim_t 0.396] [lr 0.000030] [CE 2.716 (2.750)] [KD 0.000 (0.000)] 2024-10-13 11:07:09,474 - Train: 100.00% [375300/375300] [300.0/300.0] [batch_t 0.310 (0.414)] [data_t 0.015] [optim_t 0.294] [lr 0.000030] [CE 3.010 (2.761)] [KD 0.000 (0.000)] 2024-10-13 11:07:31,671 - Test (net): 100.00% [50/50] [batch_t 0.130 (0.438)] [top1_cnt 41153] [top5_cnt 48076] [top_all 50000] 2024-10-13 11:07:31,671 - net: 82.306 (96.152) 2024-10-13 11:07:52,912 - Test (net_E): 100.00% [50/50] [batch_t 0.128 (0.416)] [top1_cnt 41230] [top5_cnt 48130] [top_all 50000] 2024-10-13 11:07:52,912 - net_E: 82.460 (96.260) 2024-10-13 11:07:53,101 - Max [top1: 82.412 (epoch: 296)] [top1-ema: 82.498 (epoch: 297)] 2024-10-13 11:07:53,101 - ==> Total time: 1 day, 23:20:57 Eta: 0:00:00 Logged in 'runs/mobilemamba/CLSTrainer_MobileMamba_B4_ImageFolderLMDB_20241011-081000' 2024-10-13 11:07:57,310 - finish training