Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot reprouduce the reported accuracy when asym noisy rate = 0.4 #2

Closed
qinwei-hfut opened this issue Oct 15, 2020 · 5 comments
Closed

Comments

@qinwei-hfut
Copy link

Hi authors,

Thank you for your excellent paper. It is very interesting. But I cannot reproduce the reported accuracy when asym noise rate is 40%. The reported accuracy is 91.35%(Table 1) while my reproduced accuracy is 83.98%. I have checked the hyper-parameters carefully. I don't know what went wrong. Here is the log file:
info.log

2020-10-15 08:46:19,342 - train - INFO - OrderedDict([('name', 'cifar10_resnet34_cosine'), ('n_gpu', 1), ('seed', 123), ('arch', OrderedDict([('type', 'resnet34'), ('args', OrderedDict([('num_classes', 10)]))])), ('num_classes', 10), ('data_loader', OrderedDict([('type', 'CIFAR10DataLoader'), ('args', OrderedDict([('data_dir', '/BS/sun_project_multimodal/nobackup/weiqin/project_code/cifar/data'), ('batch_size', 128), ('shuffle', True), ('num_batches', 0), ('validation_split', 0), ('num_workers', 8), ('pin_memory', True)]))])), ('optimizer', OrderedDict([('type', 'SGD'), ('args', OrderedDict([('lr', 0.02), ('momentum', 0.9), ('weight_decay', 0.001)]))])), ('train_loss', OrderedDict([('type', 'elr_loss'), ('args', OrderedDict([('beta', 0.7), ('lambda', 3)]))])), ('val_loss', 'cross_entropy'), ('metrics', ['my_metric', 'my_metric2']), ('lr_scheduler', OrderedDict([('type', 'CosineAnnealingWarmRestarts'), ('args', OrderedDict([('T_0', 10), ('eta_min', 0.001)]))])), ('trainer', OrderedDict([('epochs', 150), ('warmup', 0), ('save_dir', 'saved/'), ('save_period', 1), ('verbosity', 2), ('label_dir', 'saved/'), ('monitor', 'max val_my_metric'), ('early_stop', 2000), ('tensorboard', False), ('mlflow', True), ('_percent', 'Percentage of noise'), ('percent', 0.4), ('_begin', 'When to begin updating labels'), ('begin', 0), ('_asym', 'symmetric noise if false'), ('asym', True)]))])
2020-10-15 08:47:14,464 - trainer - INFO - epoch : 1
2020-10-15 08:47:14,465 - trainer - INFO - loss : 1.344432446089658
2020-10-15 08:47:14,465 - trainer - INFO - my_metric : 0.39873589409722227
2020-10-15 08:47:14,465 - trainer - INFO - my_metric2 : 0.8694094262941919
2020-10-15 08:47:14,465 - trainer - INFO - learning rate : [0.02]
2020-10-15 08:47:14,465 - trainer - INFO - val_loss : 1.5482196092605591
2020-10-15 08:47:14,465 - trainer - INFO - val_my_metric : 0.4622
2020-10-15 08:47:14,465 - trainer - INFO - val_my_metric2 : 0.9202
2020-10-15 08:47:14,465 - trainer - INFO - test_loss : 1.6651179790496826
2020-10-15 08:47:14,465 - trainer - INFO - test_my_metric : 0.44430000000000003
2020-10-15 08:47:14,465 - trainer - INFO - test_my_metric2: 0.9111
2020-10-15 08:47:15,653 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 08:48:06,965 - trainer - INFO - epoch : 2
2020-10-15 08:48:06,966 - trainer - INFO - loss : 0.4895803125744516
2020-10-15 08:48:06,966 - trainer - INFO - my_metric : 0.5340810448232323
2020-10-15 08:48:06,966 - trainer - INFO - my_metric2 : 0.9381263809974747
2020-10-15 08:48:06,966 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 08:48:06,966 - trainer - INFO - val_loss : 1.3158581495285033
2020-10-15 08:48:06,966 - trainer - INFO - val_my_metric : 0.5566
2020-10-15 08:48:06,966 - trainer - INFO - val_my_metric2 : 0.9461999999999999
2020-10-15 08:48:06,966 - trainer - INFO - test_loss : 1.3092092037200929
2020-10-15 08:48:06,966 - trainer - INFO - test_my_metric : 0.564
2020-10-15 08:48:06,966 - trainer - INFO - test_my_metric2: 0.9545
2020-10-15 08:48:08,502 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 08:49:00,009 - trainer - INFO - epoch : 3
2020-10-15 08:49:00,010 - trainer - INFO - loss : -0.240642855621197
2020-10-15 08:49:00,010 - trainer - INFO - my_metric : 0.6000088778409091
2020-10-15 08:49:00,010 - trainer - INFO - my_metric2 : 0.9635761916035354
2020-10-15 08:49:00,011 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 08:49:00,011 - trainer - INFO - val_loss : 1.152392363548279
2020-10-15 08:49:00,011 - trainer - INFO - val_my_metric : 0.6098
2020-10-15 08:49:00,011 - trainer - INFO - val_my_metric2 : 0.9725999999999999
2020-10-15 08:49:00,011 - trainer - INFO - test_loss : 1.1857561945915223
2020-10-15 08:49:00,011 - trainer - INFO - test_my_metric : 0.6124
2020-10-15 08:49:00,011 - trainer - INFO - test_my_metric2: 0.9701000000000001
2020-10-15 08:49:01,237 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 08:49:52,730 - trainer - INFO - epoch : 4
2020-10-15 08:49:52,730 - trainer - INFO - loss : -0.8794587168165229
2020-10-15 08:49:52,730 - trainer - INFO - my_metric : 0.6326300110479798
2020-10-15 08:49:52,731 - trainer - INFO - my_metric2 : 0.9740964330808081
2020-10-15 08:49:52,731 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 08:49:52,731 - trainer - INFO - val_loss : 1.1226544380187988
2020-10-15 08:49:52,731 - trainer - INFO - val_my_metric : 0.6220000000000001
2020-10-15 08:49:52,731 - trainer - INFO - val_my_metric2 : 0.9728
2020-10-15 08:49:52,731 - trainer - INFO - test_loss : 1.1971492290496826
2020-10-15 08:49:52,731 - trainer - INFO - test_my_metric : 0.6138999999999999
2020-10-15 08:49:52,731 - trainer - INFO - test_my_metric2: 0.9738
2020-10-15 08:49:53,581 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 08:50:44,931 - trainer - INFO - epoch : 5
2020-10-15 08:50:44,932 - trainer - INFO - loss : -1.5189955092289231
2020-10-15 08:50:44,932 - trainer - INFO - my_metric : 0.6595101404671717
2020-10-15 08:50:44,932 - trainer - INFO - my_metric2 : 0.9804169625946969
2020-10-15 08:50:44,932 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 08:50:44,932 - trainer - INFO - val_loss : 0.9797059774398804
2020-10-15 08:50:44,932 - trainer - INFO - val_my_metric : 0.6586000000000001
2020-10-15 08:50:44,933 - trainer - INFO - val_my_metric2 : 0.9816
2020-10-15 08:50:44,933 - trainer - INFO - test_loss : 1.0395137190818786
2020-10-15 08:50:44,933 - trainer - INFO - test_my_metric : 0.6499
2020-10-15 08:50:44,933 - trainer - INFO - test_my_metric2: 0.9795999999999999
2020-10-15 08:50:45,972 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 08:51:37,623 - trainer - INFO - epoch : 6
2020-10-15 08:51:37,624 - trainer - INFO - loss : -2.174734660170295
2020-10-15 08:51:37,624 - trainer - INFO - my_metric : 0.6780870225694445
2020-10-15 08:51:37,624 - trainer - INFO - my_metric2 : 0.9831641611426768
2020-10-15 08:51:37,624 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 08:51:37,624 - trainer - INFO - val_loss : 1.0242573857307433
2020-10-15 08:51:37,624 - trainer - INFO - val_my_metric : 0.6568000000000002
2020-10-15 08:51:37,624 - trainer - INFO - val_my_metric2 : 0.9812
2020-10-15 08:51:37,625 - trainer - INFO - test_loss : 1.1581454396247863
2020-10-15 08:51:37,625 - trainer - INFO - test_my_metric : 0.63
2020-10-15 08:51:37,625 - trainer - INFO - test_my_metric2: 0.9795000000000001
2020-10-15 08:52:29,136 - trainer - INFO - epoch : 7
2020-10-15 08:52:29,137 - trainer - INFO - loss : -2.84861582653089
2020-10-15 08:52:29,137 - trainer - INFO - my_metric : 0.6926565459280303
2020-10-15 08:52:29,137 - trainer - INFO - my_metric2 : 0.9865328085542928
2020-10-15 08:52:29,137 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 08:52:29,137 - trainer - INFO - val_loss : 1.0583856463432313
2020-10-15 08:52:29,137 - trainer - INFO - val_my_metric : 0.6744
2020-10-15 08:52:29,138 - trainer - INFO - val_my_metric2 : 0.9806000000000001
2020-10-15 08:52:29,138 - trainer - INFO - test_loss : 1.0291040420532227
2020-10-15 08:52:29,138 - trainer - INFO - test_my_metric : 0.6909000000000001
2020-10-15 08:52:29,138 - trainer - INFO - test_my_metric2: 0.9845
2020-10-15 08:52:30,628 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 08:53:22,265 - trainer - INFO - epoch : 8
2020-10-15 08:53:22,266 - trainer - INFO - loss : -3.547497575933283
2020-10-15 08:53:22,266 - trainer - INFO - my_metric : 0.7078351878156566
2020-10-15 08:53:22,266 - trainer - INFO - my_metric2 : 0.9899236505681818
2020-10-15 08:53:22,266 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 08:53:22,266 - trainer - INFO - val_loss : 1.011834692955017
2020-10-15 08:53:22,266 - trainer - INFO - val_my_metric : 0.6926
2020-10-15 08:53:22,266 - trainer - INFO - val_my_metric2 : 0.9875999999999999
2020-10-15 08:53:22,267 - trainer - INFO - test_loss : 1.0503479421138764
2020-10-15 08:53:22,267 - trainer - INFO - test_my_metric : 0.7002
2020-10-15 08:53:22,267 - trainer - INFO - test_my_metric2: 0.9896999999999998
2020-10-15 08:53:23,013 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 08:54:14,603 - trainer - INFO - epoch : 9
2020-10-15 08:54:14,603 - trainer - INFO - loss : -4.280280420725996
2020-10-15 08:54:14,604 - trainer - INFO - my_metric : 0.7220545296717172
2020-10-15 08:54:14,604 - trainer - INFO - my_metric2 : 0.9910432449494949
2020-10-15 08:54:14,604 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 08:54:14,604 - trainer - INFO - val_loss : 0.9829131960868835
2020-10-15 08:54:14,604 - trainer - INFO - val_my_metric : 0.7086
2020-10-15 08:54:14,604 - trainer - INFO - val_my_metric2 : 0.9898
2020-10-15 08:54:14,604 - trainer - INFO - test_loss : 0.9280257821083069
2020-10-15 08:54:14,604 - trainer - INFO - test_my_metric : 0.7321000000000001
2020-10-15 08:54:14,604 - trainer - INFO - test_my_metric2: 0.99
2020-10-15 08:54:15,969 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 08:55:07,215 - trainer - INFO - epoch : 10
2020-10-15 08:55:07,215 - trainer - INFO - loss : -5.016697179864753
2020-10-15 08:55:07,216 - trainer - INFO - my_metric : 0.7309619633838383
2020-10-15 08:55:07,216 - trainer - INFO - my_metric2 : 0.9930308948863636
2020-10-15 08:55:07,216 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 08:55:07,216 - trainer - INFO - val_loss : 1.034061896800995
2020-10-15 08:55:07,216 - trainer - INFO - val_my_metric : 0.7152000000000001
2020-10-15 08:55:07,216 - trainer - INFO - val_my_metric2 : 0.9915999999999998
2020-10-15 08:55:07,216 - trainer - INFO - test_loss : 1.013739413022995
2020-10-15 08:55:07,216 - trainer - INFO - test_my_metric : 0.7297
2020-10-15 08:55:07,217 - trainer - INFO - test_my_metric2: 0.9915
2020-10-15 08:55:08,204 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 08:56:00,181 - trainer - INFO - epoch : 11
2020-10-15 08:56:00,181 - trainer - INFO - loss : -4.495085256343538
2020-10-15 08:56:00,182 - trainer - INFO - my_metric : 0.6456286497790404
2020-10-15 08:56:00,182 - trainer - INFO - my_metric2 : 0.9714232165404041
2020-10-15 08:56:00,182 - trainer - INFO - learning rate : [0.02]
2020-10-15 08:56:00,182 - trainer - INFO - val_loss : 1.6481608629226685
2020-10-15 08:56:00,182 - trainer - INFO - val_my_metric : 0.6368
2020-10-15 08:56:00,182 - trainer - INFO - val_my_metric2 : 0.978
2020-10-15 08:56:00,183 - trainer - INFO - test_loss : 1.7316111087799073
2020-10-15 08:56:00,183 - trainer - INFO - test_my_metric : 0.6388
2020-10-15 08:56:00,183 - trainer - INFO - test_my_metric2: 0.9753000000000001
2020-10-15 08:56:52,207 - trainer - INFO - epoch : 12
2020-10-15 08:56:52,207 - trainer - INFO - loss : -5.320813852277669
2020-10-15 08:56:52,207 - trainer - INFO - my_metric : 0.6790487886679293
2020-10-15 08:56:52,208 - trainer - INFO - my_metric2 : 0.9826043639520201
2020-10-15 08:56:52,208 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 08:56:52,208 - trainer - INFO - val_loss : 1.2839585304260255
2020-10-15 08:56:52,208 - trainer - INFO - val_my_metric : 0.6732000000000001
2020-10-15 08:56:52,208 - trainer - INFO - val_my_metric2 : 0.9853999999999999
2020-10-15 08:56:52,208 - trainer - INFO - test_loss : 1.3266695380210876
2020-10-15 08:56:52,208 - trainer - INFO - test_my_metric : 0.6841999999999999
2020-10-15 08:56:52,208 - trainer - INFO - test_my_metric2: 0.9808000000000001
2020-10-15 08:57:44,244 - trainer - INFO - epoch : 13
2020-10-15 08:57:44,244 - trainer - INFO - loss : -5.982854127883911
2020-10-15 08:57:44,244 - trainer - INFO - my_metric : 0.6946836529356061
2020-10-15 08:57:44,244 - trainer - INFO - my_metric2 : 0.9855291193181818
2020-10-15 08:57:44,244 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 08:57:44,245 - trainer - INFO - val_loss : 1.2791999578475952
2020-10-15 08:57:44,245 - trainer - INFO - val_my_metric : 0.6925999999999999
2020-10-15 08:57:44,245 - trainer - INFO - val_my_metric2 : 0.986
2020-10-15 08:57:44,245 - trainer - INFO - test_loss : 1.2082904934883119
2020-10-15 08:57:44,245 - trainer - INFO - test_my_metric : 0.7186999999999999
2020-10-15 08:57:44,245 - trainer - INFO - test_my_metric2: 0.9867999999999999
2020-10-15 08:58:36,046 - trainer - INFO - epoch : 14
2020-10-15 08:58:36,047 - trainer - INFO - loss : -6.6008088073947215
2020-10-15 08:58:36,047 - trainer - INFO - my_metric : 0.7052778764204546
2020-10-15 08:58:36,047 - trainer - INFO - my_metric2 : 0.9864045730744949
2020-10-15 08:58:36,047 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 08:58:36,047 - trainer - INFO - val_loss : 1.3966600179672242
2020-10-15 08:58:36,047 - trainer - INFO - val_my_metric : 0.6888000000000001
2020-10-15 08:58:36,047 - trainer - INFO - val_my_metric2 : 0.9846
2020-10-15 08:58:36,047 - trainer - INFO - test_loss : 1.314958643913269
2020-10-15 08:58:36,047 - trainer - INFO - test_my_metric : 0.7287
2020-10-15 08:58:36,047 - trainer - INFO - test_my_metric2: 0.9863
2020-10-15 08:59:27,760 - trainer - INFO - epoch : 15
2020-10-15 08:59:27,761 - trainer - INFO - loss : -7.259389040145007
2020-10-15 08:59:27,761 - trainer - INFO - my_metric : 0.7146218039772727
2020-10-15 08:59:27,761 - trainer - INFO - my_metric2 : 0.988384824810606
2020-10-15 08:59:27,761 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 08:59:27,761 - trainer - INFO - val_loss : 1.3244801998138427
2020-10-15 08:59:27,761 - trainer - INFO - val_my_metric : 0.7045999999999999
2020-10-15 08:59:27,761 - trainer - INFO - val_my_metric2 : 0.9874
2020-10-15 08:59:27,761 - trainer - INFO - test_loss : 1.2560596346855164
2020-10-15 08:59:27,762 - trainer - INFO - test_my_metric : 0.7299999999999999
2020-10-15 08:59:27,762 - trainer - INFO - test_my_metric2: 0.9885000000000002
2020-10-15 09:00:19,819 - trainer - INFO - epoch : 16
2020-10-15 09:00:19,819 - trainer - INFO - loss : -7.934793141755191
2020-10-15 09:00:19,819 - trainer - INFO - my_metric : 0.72500641177399
2020-10-15 09:00:19,820 - trainer - INFO - my_metric2 : 0.9908114346590909
2020-10-15 09:00:19,820 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 09:00:19,820 - trainer - INFO - val_loss : 1.325422191619873
2020-10-15 09:00:19,820 - trainer - INFO - val_my_metric : 0.705
2020-10-15 09:00:19,820 - trainer - INFO - val_my_metric2 : 0.9906
2020-10-15 09:00:19,820 - trainer - INFO - test_loss : 1.316207754611969
2020-10-15 09:00:19,820 - trainer - INFO - test_my_metric : 0.7345999999999999
2020-10-15 09:00:19,820 - trainer - INFO - test_my_metric2: 0.9898
2020-10-15 09:01:11,723 - trainer - INFO - epoch : 17
2020-10-15 09:01:11,723 - trainer - INFO - loss : -8.645218040455472
2020-10-15 09:01:11,723 - trainer - INFO - my_metric : 0.7348780776515151
2020-10-15 09:01:11,723 - trainer - INFO - my_metric2 : 0.9921702375315656
2020-10-15 09:01:11,723 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 09:01:11,723 - trainer - INFO - val_loss : 1.3465739250183106
2020-10-15 09:01:11,723 - trainer - INFO - val_my_metric : 0.7198
2020-10-15 09:01:11,723 - trainer - INFO - val_my_metric2 : 0.9898
2020-10-15 09:01:11,723 - trainer - INFO - test_loss : 1.1485675811767577
2020-10-15 09:01:11,723 - trainer - INFO - test_my_metric : 0.7661
2020-10-15 09:01:11,723 - trainer - INFO - test_my_metric2: 0.9903000000000001
2020-10-15 09:01:12,931 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:02:04,681 - trainer - INFO - epoch : 18
2020-10-15 09:02:04,681 - trainer - INFO - loss : -9.33871833438223
2020-10-15 09:02:04,681 - trainer - INFO - my_metric : 0.7422392874053031
2020-10-15 09:02:04,681 - trainer - INFO - my_metric2 : 0.9932133838383838
2020-10-15 09:02:04,682 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 09:02:04,682 - trainer - INFO - val_loss : 1.3394651651382445
2020-10-15 09:02:04,682 - trainer - INFO - val_my_metric : 0.7253999999999999
2020-10-15 09:02:04,682 - trainer - INFO - val_my_metric2 : 0.9932000000000001
2020-10-15 09:02:04,682 - trainer - INFO - test_loss : 1.1325106501579285
2020-10-15 09:02:04,682 - trainer - INFO - test_my_metric : 0.7704
2020-10-15 09:02:04,682 - trainer - INFO - test_my_metric2: 0.9908000000000001
2020-10-15 09:02:05,601 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:02:57,753 - trainer - INFO - epoch : 19
2020-10-15 09:02:57,754 - trainer - INFO - loss : -10.020291344685988
2020-10-15 09:02:57,754 - trainer - INFO - my_metric : 0.7517681699810606
2020-10-15 09:02:57,754 - trainer - INFO - my_metric2 : 0.994167751736111
2020-10-15 09:02:57,754 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 09:02:57,754 - trainer - INFO - val_loss : 1.3791209697723388
2020-10-15 09:02:57,754 - trainer - INFO - val_my_metric : 0.7274
2020-10-15 09:02:57,754 - trainer - INFO - val_my_metric2 : 0.9937999999999999
2020-10-15 09:02:57,754 - trainer - INFO - test_loss : 1.1689467787742616
2020-10-15 09:02:57,754 - trainer - INFO - test_my_metric : 0.7749000000000001
2020-10-15 09:02:57,754 - trainer - INFO - test_my_metric2: 0.9922000000000002
2020-10-15 09:02:59,330 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:03:51,110 - trainer - INFO - epoch : 20
2020-10-15 09:03:51,110 - trainer - INFO - loss : -10.672466698017987
2020-10-15 09:03:51,110 - trainer - INFO - my_metric : 0.7557163431186869
2020-10-15 09:03:51,111 - trainer - INFO - my_metric2 : 0.9947842684659091
2020-10-15 09:03:51,111 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 09:03:51,111 - trainer - INFO - val_loss : 1.426035714149475
2020-10-15 09:03:51,111 - trainer - INFO - val_my_metric : 0.733
2020-10-15 09:03:51,111 - trainer - INFO - val_my_metric2 : 0.9934000000000001
2020-10-15 09:03:51,111 - trainer - INFO - test_loss : 1.1965455770492555
2020-10-15 09:03:51,111 - trainer - INFO - test_my_metric : 0.7772
2020-10-15 09:03:51,111 - trainer - INFO - test_my_metric2: 0.9921
2020-10-15 09:03:51,987 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:04:43,919 - trainer - INFO - epoch : 21
2020-10-15 09:04:43,920 - trainer - INFO - loss : -9.50666829943657
2020-10-15 09:04:43,920 - trainer - INFO - my_metric : 0.6781462081755051
2020-10-15 09:04:43,920 - trainer - INFO - my_metric2 : 0.977886777935606
2020-10-15 09:04:43,920 - trainer - INFO - learning rate : [0.02]
2020-10-15 09:04:43,920 - trainer - INFO - val_loss : 1.9264426708221436
2020-10-15 09:04:43,920 - trainer - INFO - val_my_metric : 0.6568
2020-10-15 09:04:43,920 - trainer - INFO - val_my_metric2 : 0.9738
2020-10-15 09:04:43,920 - trainer - INFO - test_loss : 1.8147221684455872
2020-10-15 09:04:43,920 - trainer - INFO - test_my_metric : 0.6835000000000002
2020-10-15 09:04:43,920 - trainer - INFO - test_my_metric2: 0.9713999999999998
2020-10-15 09:05:35,635 - trainer - INFO - epoch : 22
2020-10-15 09:05:35,635 - trainer - INFO - loss : -9.99212063442577
2020-10-15 09:05:35,635 - trainer - INFO - my_metric : 0.7006761955492424
2020-10-15 09:05:35,635 - trainer - INFO - my_metric2 : 0.9835365372474747
2020-10-15 09:05:35,636 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 09:05:35,636 - trainer - INFO - val_loss : 1.8099754095077514
2020-10-15 09:05:35,636 - trainer - INFO - val_my_metric : 0.6934000000000001
2020-10-15 09:05:35,636 - trainer - INFO - val_my_metric2 : 0.9843999999999999
2020-10-15 09:05:35,636 - trainer - INFO - test_loss : 1.6010972261428833
2020-10-15 09:05:35,636 - trainer - INFO - test_my_metric : 0.7362
2020-10-15 09:05:35,636 - trainer - INFO - test_my_metric2: 0.9843
2020-10-15 09:06:27,340 - trainer - INFO - epoch : 23
2020-10-15 09:06:27,340 - trainer - INFO - loss : -10.418463357470252
2020-10-15 09:06:27,341 - trainer - INFO - my_metric : 0.7145206952335859
2020-10-15 09:06:27,341 - trainer - INFO - my_metric2 : 0.986843532986111
2020-10-15 09:06:27,341 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 09:06:27,341 - trainer - INFO - val_loss : 1.8116185903549193
2020-10-15 09:06:27,341 - trainer - INFO - val_my_metric : 0.6714
2020-10-15 09:06:27,341 - trainer - INFO - val_my_metric2 : 0.9762000000000001
2020-10-15 09:06:27,341 - trainer - INFO - test_loss : 1.5286578059196472
2020-10-15 09:06:27,341 - trainer - INFO - test_my_metric : 0.7265999999999998
2020-10-15 09:06:27,341 - trainer - INFO - test_my_metric2: 0.9748999999999999
2020-10-15 09:07:18,986 - trainer - INFO - epoch : 24
2020-10-15 09:07:18,987 - trainer - INFO - loss : -10.814186518842524
2020-10-15 09:07:18,987 - trainer - INFO - my_metric : 0.723516907354798
2020-10-15 09:07:18,987 - trainer - INFO - my_metric2 : 0.9889125631313131
2020-10-15 09:07:18,987 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 09:07:18,987 - trainer - INFO - val_loss : 1.7642005920410155
2020-10-15 09:07:18,988 - trainer - INFO - val_my_metric : 0.6984
2020-10-15 09:07:18,988 - trainer - INFO - val_my_metric2 : 0.9869999999999999
2020-10-15 09:07:18,988 - trainer - INFO - test_loss : 1.6441813468933106
2020-10-15 09:07:18,988 - trainer - INFO - test_my_metric : 0.7294000000000002
2020-10-15 09:07:18,988 - trainer - INFO - test_my_metric2: 0.9864999999999998
2020-10-15 09:08:10,657 - trainer - INFO - epoch : 25
2020-10-15 09:08:10,657 - trainer - INFO - loss : -11.252584666013718
2020-10-15 09:08:10,657 - trainer - INFO - my_metric : 0.7328509706439394
2020-10-15 09:08:10,657 - trainer - INFO - my_metric2 : 0.9904390585542928
2020-10-15 09:08:10,658 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 09:08:10,658 - trainer - INFO - val_loss : 1.6746700286865235
2020-10-15 09:08:10,658 - trainer - INFO - val_my_metric : 0.711
2020-10-15 09:08:10,658 - trainer - INFO - val_my_metric2 : 0.9882
2020-10-15 09:08:10,658 - trainer - INFO - test_loss : 1.4550020337104796
2020-10-15 09:08:10,658 - trainer - INFO - test_my_metric : 0.7561
2020-10-15 09:08:10,658 - trainer - INFO - test_my_metric2: 0.9856
2020-10-15 09:09:02,209 - trainer - INFO - epoch : 26
2020-10-15 09:09:02,209 - trainer - INFO - loss : -11.71348962187767
2020-10-15 09:09:02,209 - trainer - INFO - my_metric : 0.7428607362689394
2020-10-15 09:09:02,210 - trainer - INFO - my_metric2 : 0.992431640625
2020-10-15 09:09:02,210 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 09:09:02,210 - trainer - INFO - val_loss : 1.5761718034744263
2020-10-15 09:09:02,210 - trainer - INFO - val_my_metric : 0.7266
2020-10-15 09:09:02,210 - trainer - INFO - val_my_metric2 : 0.9917999999999999
2020-10-15 09:09:02,210 - trainer - INFO - test_loss : 1.2924328804016114
2020-10-15 09:09:02,210 - trainer - INFO - test_my_metric : 0.7772
2020-10-15 09:09:02,210 - trainer - INFO - test_my_metric2: 0.9917999999999999
2020-10-15 09:09:53,642 - trainer - INFO - epoch : 27
2020-10-15 09:09:53,643 - trainer - INFO - loss : -12.138518051667647
2020-10-15 09:09:53,643 - trainer - INFO - my_metric : 0.7489667179608586
2020-10-15 09:09:53,643 - trainer - INFO - my_metric2 : 0.993524108270202
2020-10-15 09:09:53,643 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 09:09:53,643 - trainer - INFO - val_loss : 1.6144617557525636
2020-10-15 09:09:53,643 - trainer - INFO - val_my_metric : 0.7242
2020-10-15 09:09:53,643 - trainer - INFO - val_my_metric2 : 0.9917999999999999
2020-10-15 09:09:53,643 - trainer - INFO - test_loss : 1.3117577314376831
2020-10-15 09:09:53,643 - trainer - INFO - test_my_metric : 0.7763
2020-10-15 09:09:53,643 - trainer - INFO - test_my_metric2: 0.9914
2020-10-15 09:10:45,096 - trainer - INFO - epoch : 28
2020-10-15 09:10:45,096 - trainer - INFO - loss : -12.576450494202701
2020-10-15 09:10:45,096 - trainer - INFO - my_metric : 0.7578519570707072
2020-10-15 09:10:45,096 - trainer - INFO - my_metric2 : 0.9942787247474747
2020-10-15 09:10:45,096 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 09:10:45,096 - trainer - INFO - val_loss : 1.614862060546875
2020-10-15 09:10:45,096 - trainer - INFO - val_my_metric : 0.7356
2020-10-15 09:10:45,097 - trainer - INFO - val_my_metric2 : 0.9940000000000001
2020-10-15 09:10:45,097 - trainer - INFO - test_loss : 1.3138698220252991
2020-10-15 09:10:45,097 - trainer - INFO - test_my_metric : 0.7883000000000001
2020-10-15 09:10:45,097 - trainer - INFO - test_my_metric2: 0.9931000000000001
2020-10-15 09:10:46,771 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:11:38,197 - trainer - INFO - epoch : 29
2020-10-15 09:11:38,198 - trainer - INFO - loss : -12.990165431391109
2020-10-15 09:11:38,198 - trainer - INFO - my_metric : 0.761447482638889
2020-10-15 09:11:38,198 - trainer - INFO - my_metric2 : 0.994988952020202
2020-10-15 09:11:38,198 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 09:11:38,198 - trainer - INFO - val_loss : 1.6084392786026
2020-10-15 09:11:38,198 - trainer - INFO - val_my_metric : 0.7402
2020-10-15 09:11:38,198 - trainer - INFO - val_my_metric2 : 0.9944000000000001
2020-10-15 09:11:38,199 - trainer - INFO - test_loss : 1.2873205184936523
2020-10-15 09:11:38,199 - trainer - INFO - test_my_metric : 0.7906000000000001
2020-10-15 09:11:38,199 - trainer - INFO - test_my_metric2: 0.9929999999999998
2020-10-15 09:11:39,534 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:12:31,367 - trainer - INFO - epoch : 30
2020-10-15 09:12:31,368 - trainer - INFO - loss : -13.388513074679809
2020-10-15 09:12:31,368 - trainer - INFO - my_metric : 0.7674301609848485
2020-10-15 09:12:31,368 - trainer - INFO - my_metric2 : 0.995849609375
2020-10-15 09:12:31,368 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 09:12:31,368 - trainer - INFO - val_loss : 1.6258297920227052
2020-10-15 09:12:31,368 - trainer - INFO - val_my_metric : 0.7398
2020-10-15 09:12:31,368 - trainer - INFO - val_my_metric2 : 0.9945999999999999
2020-10-15 09:12:31,368 - trainer - INFO - test_loss : 1.2952921986579895
2020-10-15 09:12:31,368 - trainer - INFO - test_my_metric : 0.7945
2020-10-15 09:12:31,368 - trainer - INFO - test_my_metric2: 0.9933
2020-10-15 09:13:22,948 - trainer - INFO - epoch : 31
2020-10-15 09:13:22,948 - trainer - INFO - loss : -11.835183950987728
2020-10-15 09:13:22,948 - trainer - INFO - my_metric : 0.6928020438762627
2020-10-15 09:13:22,948 - trainer - INFO - my_metric2 : 0.9801629577020201
2020-10-15 09:13:22,948 - trainer - INFO - learning rate : [0.02]
2020-10-15 09:13:22,948 - trainer - INFO - val_loss : 3.4382235527038576
2020-10-15 09:13:22,948 - trainer - INFO - val_my_metric : 0.5622
2020-10-15 09:13:22,949 - trainer - INFO - val_my_metric2 : 0.9332
2020-10-15 09:13:22,949 - trainer - INFO - test_loss : 3.279822492599487
2020-10-15 09:13:22,949 - trainer - INFO - test_my_metric : 0.5901
2020-10-15 09:13:22,949 - trainer - INFO - test_my_metric2: 0.9268000000000003
2020-10-15 09:14:14,296 - trainer - INFO - epoch : 32
2020-10-15 09:14:14,296 - trainer - INFO - loss : -11.880360028960489
2020-10-15 09:14:14,296 - trainer - INFO - my_metric : 0.7045701152146464
2020-10-15 09:14:14,297 - trainer - INFO - my_metric2 : 0.9851789378156565
2020-10-15 09:14:14,297 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 09:14:14,297 - trainer - INFO - val_loss : 2.4986016750335693
2020-10-15 09:14:14,297 - trainer - INFO - val_my_metric : 0.65
2020-10-15 09:14:14,297 - trainer - INFO - val_my_metric2 : 0.9757999999999999
2020-10-15 09:14:14,297 - trainer - INFO - test_loss : 2.10113183259964
2020-10-15 09:14:14,297 - trainer - INFO - test_my_metric : 0.7046
2020-10-15 09:14:14,297 - trainer - INFO - test_my_metric2: 0.9766
2020-10-15 09:15:05,975 - trainer - INFO - epoch : 33
2020-10-15 09:15:05,976 - trainer - INFO - loss : -12.145039276643233
2020-10-15 09:15:05,976 - trainer - INFO - my_metric : 0.7237832425820707
2020-10-15 09:15:05,976 - trainer - INFO - my_metric2 : 0.9880469736426768
2020-10-15 09:15:05,976 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 09:15:05,977 - trainer - INFO - val_loss : 1.92933509349823
2020-10-15 09:15:05,977 - trainer - INFO - val_my_metric : 0.701
2020-10-15 09:15:05,977 - trainer - INFO - val_my_metric2 : 0.9876000000000001
2020-10-15 09:15:05,977 - trainer - INFO - test_loss : 1.5425511360168458
2020-10-15 09:15:05,977 - trainer - INFO - test_my_metric : 0.7593000000000001
2020-10-15 09:15:05,977 - trainer - INFO - test_my_metric2: 0.9865000000000002
2020-10-15 09:15:57,517 - trainer - INFO - epoch : 34
2020-10-15 09:15:57,517 - trainer - INFO - loss : -12.351038008928299
2020-10-15 09:15:57,518 - trainer - INFO - my_metric : 0.7332110164141414
2020-10-15 09:15:57,518 - trainer - INFO - my_metric2 : 0.989990234375
2020-10-15 09:15:57,518 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 09:15:57,518 - trainer - INFO - val_loss : 1.9126577138900758
2020-10-15 09:15:57,518 - trainer - INFO - val_my_metric : 0.7144
2020-10-15 09:15:57,518 - trainer - INFO - val_my_metric2 : 0.9902
2020-10-15 09:15:57,518 - trainer - INFO - test_loss : 1.5088931322097778
2020-10-15 09:15:57,518 - trainer - INFO - test_my_metric : 0.7694
2020-10-15 09:15:57,518 - trainer - INFO - test_my_metric2: 0.9883
2020-10-15 09:16:49,148 - trainer - INFO - epoch : 35
2020-10-15 09:16:49,149 - trainer - INFO - loss : -12.63537536426024
2020-10-15 09:16:49,149 - trainer - INFO - my_metric : 0.7415685172032828
2020-10-15 09:16:49,149 - trainer - INFO - my_metric2 : 0.9917929292929292
2020-10-15 09:16:49,149 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 09:16:49,149 - trainer - INFO - val_loss : 1.83176908493042
2020-10-15 09:16:49,149 - trainer - INFO - val_my_metric : 0.7228
2020-10-15 09:16:49,149 - trainer - INFO - val_my_metric2 : 0.9918000000000001
2020-10-15 09:16:49,149 - trainer - INFO - test_loss : 1.461145830154419
2020-10-15 09:16:49,149 - trainer - INFO - test_my_metric : 0.7765000000000001
2020-10-15 09:16:49,149 - trainer - INFO - test_my_metric2: 0.9897
2020-10-15 09:17:41,133 - trainer - INFO - epoch : 36
2020-10-15 09:17:41,134 - trainer - INFO - loss : -12.939930084076794
2020-10-15 09:17:41,134 - trainer - INFO - my_metric : 0.7497040719696969
2020-10-15 09:17:41,134 - trainer - INFO - my_metric2 : 0.9929519807449495
2020-10-15 09:17:41,134 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 09:17:41,134 - trainer - INFO - val_loss : 1.788953995704651
2020-10-15 09:17:41,134 - trainer - INFO - val_my_metric : 0.7236
2020-10-15 09:17:41,134 - trainer - INFO - val_my_metric2 : 0.9895999999999999
2020-10-15 09:17:41,134 - trainer - INFO - test_loss : 1.3359179615974426
2020-10-15 09:17:41,135 - trainer - INFO - test_my_metric : 0.7925000000000001
2020-10-15 09:17:41,135 - trainer - INFO - test_my_metric2: 0.9899999999999999
2020-10-15 09:18:32,649 - trainer - INFO - epoch : 37
2020-10-15 09:18:32,649 - trainer - INFO - loss : -13.278339849276977
2020-10-15 09:18:32,649 - trainer - INFO - my_metric : 0.7589444247159091
2020-10-15 09:18:32,649 - trainer - INFO - my_metric2 : 0.9946067116477273
2020-10-15 09:18:32,649 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 09:18:32,650 - trainer - INFO - val_loss : 1.6958820104599
2020-10-15 09:18:32,650 - trainer - INFO - val_my_metric : 0.7375999999999999
2020-10-15 09:18:32,650 - trainer - INFO - val_my_metric2 : 0.9922000000000001
2020-10-15 09:18:32,650 - trainer - INFO - test_loss : 1.266778838634491
2020-10-15 09:18:32,650 - trainer - INFO - test_my_metric : 0.8025
2020-10-15 09:18:32,650 - trainer - INFO - test_my_metric2: 0.9929
2020-10-15 09:19:24,430 - trainer - INFO - epoch : 38
2020-10-15 09:19:24,430 - trainer - INFO - loss : -13.61678710308942
2020-10-15 09:19:24,431 - trainer - INFO - my_metric : 0.7652501578282828
2020-10-15 09:19:24,431 - trainer - INFO - my_metric2 : 0.9955832741477273
2020-10-15 09:19:24,431 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 09:19:24,431 - trainer - INFO - val_loss : 1.6990442752838135
2020-10-15 09:19:24,431 - trainer - INFO - val_my_metric : 0.7364
2020-10-15 09:19:24,431 - trainer - INFO - val_my_metric2 : 0.9936
2020-10-15 09:19:24,431 - trainer - INFO - test_loss : 1.2790016770362853
2020-10-15 09:19:24,431 - trainer - INFO - test_my_metric : 0.8023
2020-10-15 09:19:24,431 - trainer - INFO - test_my_metric2: 0.9943
2020-10-15 09:20:15,929 - trainer - INFO - epoch : 39
2020-10-15 09:20:15,930 - trainer - INFO - loss : -13.941012577577071
2020-10-15 09:20:15,930 - trainer - INFO - my_metric : 0.7699899384469696
2020-10-15 09:20:15,930 - trainer - INFO - my_metric2 : 0.9959383877840909
2020-10-15 09:20:15,930 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 09:20:15,930 - trainer - INFO - val_loss : 1.7512467622756958
2020-10-15 09:20:15,931 - trainer - INFO - val_my_metric : 0.7395999999999999
2020-10-15 09:20:15,931 - trainer - INFO - val_my_metric2 : 0.9944
2020-10-15 09:20:15,931 - trainer - INFO - test_loss : 1.3019333243370057
2020-10-15 09:20:15,931 - trainer - INFO - test_my_metric : 0.8039000000000002
2020-10-15 09:20:15,931 - trainer - INFO - test_my_metric2: 0.9946999999999999
2020-10-15 09:21:07,564 - trainer - INFO - epoch : 40
2020-10-15 09:21:07,565 - trainer - INFO - loss : -14.246378568085758
2020-10-15 09:21:07,565 - trainer - INFO - my_metric : 0.7734029750631314
2020-10-15 09:21:07,565 - trainer - INFO - my_metric2 : 0.99609375
2020-10-15 09:21:07,565 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 09:21:07,565 - trainer - INFO - val_loss : 1.7104885816574096
2020-10-15 09:21:07,565 - trainer - INFO - val_my_metric : 0.7434
2020-10-15 09:21:07,565 - trainer - INFO - val_my_metric2 : 0.9945999999999999
2020-10-15 09:21:07,565 - trainer - INFO - test_loss : 1.2636656045913697
2020-10-15 09:21:07,565 - trainer - INFO - test_my_metric : 0.8084
2020-10-15 09:21:07,565 - trainer - INFO - test_my_metric2: 0.9949999999999999
2020-10-15 09:21:08,635 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:22:00,203 - trainer - INFO - epoch : 41
2020-10-15 09:22:00,204 - trainer - INFO - loss : -12.640275711363012
2020-10-15 09:22:00,204 - trainer - INFO - my_metric : 0.7033790048926768
2020-10-15 09:22:00,204 - trainer - INFO - my_metric2 : 0.9832480074179292
2020-10-15 09:22:00,204 - trainer - INFO - learning rate : [0.02]
2020-10-15 09:22:00,204 - trainer - INFO - val_loss : 2.6343740463256835
2020-10-15 09:22:00,205 - trainer - INFO - val_my_metric : 0.6315999999999999
2020-10-15 09:22:00,205 - trainer - INFO - val_my_metric2 : 0.9696
2020-10-15 09:22:00,205 - trainer - INFO - test_loss : 2.1429754972457884
2020-10-15 09:22:00,205 - trainer - INFO - test_my_metric : 0.6971
2020-10-15 09:22:00,205 - trainer - INFO - test_my_metric2: 0.9701000000000001
2020-10-15 09:22:51,787 - trainer - INFO - epoch : 42
2020-10-15 09:22:51,787 - trainer - INFO - loss : -12.517819225788116
2020-10-15 09:22:51,788 - trainer - INFO - my_metric : 0.7112383601641414
2020-10-15 09:22:51,788 - trainer - INFO - my_metric2 : 0.9856622869318182
2020-10-15 09:22:51,788 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 09:22:51,788 - trainer - INFO - val_loss : 2.132343578338623
2020-10-15 09:22:51,788 - trainer - INFO - val_my_metric : 0.7049999999999998
2020-10-15 09:22:51,788 - trainer - INFO - val_my_metric2 : 0.9853999999999999
2020-10-15 09:22:51,788 - trainer - INFO - test_loss : 1.7185420036315917
2020-10-15 09:22:51,788 - trainer - INFO - test_my_metric : 0.7674
2020-10-15 09:22:51,788 - trainer - INFO - test_my_metric2: 0.9863
2020-10-15 09:23:43,151 - trainer - INFO - epoch : 43
2020-10-15 09:23:43,152 - trainer - INFO - loss : -12.669029100374742
2020-10-15 09:23:43,152 - trainer - INFO - my_metric : 0.7264638573232323
2020-10-15 09:23:43,152 - trainer - INFO - my_metric2 : 0.9887843276515151
2020-10-15 09:23:43,152 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 09:23:43,152 - trainer - INFO - val_loss : 2.162450575828552
2020-10-15 09:23:43,152 - trainer - INFO - val_my_metric : 0.6858
2020-10-15 09:23:43,152 - trainer - INFO - val_my_metric2 : 0.9832000000000001
2020-10-15 09:23:43,152 - trainer - INFO - test_loss : 1.7482520818710328
2020-10-15 09:23:43,153 - trainer - INFO - test_my_metric : 0.7513
2020-10-15 09:23:43,153 - trainer - INFO - test_my_metric2: 0.9842000000000001
2020-10-15 09:24:34,471 - trainer - INFO - epoch : 44
2020-10-15 09:24:34,471 - trainer - INFO - loss : -12.875037412751805
2020-10-15 09:24:34,471 - trainer - INFO - my_metric : 0.738037109375
2020-10-15 09:24:34,471 - trainer - INFO - my_metric2 : 0.9909544665404041
2020-10-15 09:24:34,472 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 09:24:34,472 - trainer - INFO - val_loss : 1.9893471240997314
2020-10-15 09:24:34,472 - trainer - INFO - val_my_metric : 0.7103999999999999
2020-10-15 09:24:34,472 - trainer - INFO - val_my_metric2 : 0.9868
2020-10-15 09:24:34,472 - trainer - INFO - test_loss : 1.5750317215919494
2020-10-15 09:24:34,472 - trainer - INFO - test_my_metric : 0.7682
2020-10-15 09:24:34,472 - trainer - INFO - test_my_metric2: 0.9875999999999999
2020-10-15 09:25:26,341 - trainer - INFO - epoch : 45
2020-10-15 09:25:26,342 - trainer - INFO - loss : -13.112442111427134
2020-10-15 09:25:26,342 - trainer - INFO - my_metric : 0.7462491122159091
2020-10-15 09:25:26,342 - trainer - INFO - my_metric2 : 0.9927966185290404
2020-10-15 09:25:26,342 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 09:25:26,342 - trainer - INFO - val_loss : 1.941673493385315
2020-10-15 09:25:26,342 - trainer - INFO - val_my_metric : 0.7222
2020-10-15 09:25:26,342 - trainer - INFO - val_my_metric2 : 0.992
2020-10-15 09:25:26,343 - trainer - INFO - test_loss : 1.3966124415397645
2020-10-15 09:25:26,343 - trainer - INFO - test_my_metric : 0.7928
2020-10-15 09:25:26,343 - trainer - INFO - test_my_metric2: 0.9914999999999999
2020-10-15 09:26:18,074 - trainer - INFO - epoch : 46
2020-10-15 09:26:18,075 - trainer - INFO - loss : -13.409103615717454
2020-10-15 09:26:18,075 - trainer - INFO - my_metric : 0.7558717053345959
2020-10-15 09:26:18,075 - trainer - INFO - my_metric2 : 0.9933687460542928
2020-10-15 09:26:18,075 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 09:26:18,075 - trainer - INFO - val_loss : 1.7037278413772583
2020-10-15 09:26:18,075 - trainer - INFO - val_my_metric : 0.7316
2020-10-15 09:26:18,075 - trainer - INFO - val_my_metric2 : 0.9928000000000001
2020-10-15 09:26:18,075 - trainer - INFO - test_loss : 1.2959621906280518
2020-10-15 09:26:18,075 - trainer - INFO - test_my_metric : 0.8027
2020-10-15 09:26:18,075 - trainer - INFO - test_my_metric2: 0.9923
2020-10-15 09:27:09,584 - trainer - INFO - epoch : 47
2020-10-15 09:27:09,585 - trainer - INFO - loss : -13.697737604379654
2020-10-15 09:27:09,585 - trainer - INFO - my_metric : 0.7630528922032828
2020-10-15 09:27:09,585 - trainer - INFO - my_metric2 : 0.9945401278409091
2020-10-15 09:27:09,585 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 09:27:09,585 - trainer - INFO - val_loss : 1.8090957164764405
2020-10-15 09:27:09,585 - trainer - INFO - val_my_metric : 0.7358
2020-10-15 09:27:09,585 - trainer - INFO - val_my_metric2 : 0.9948
2020-10-15 09:27:09,586 - trainer - INFO - test_loss : 1.2457063436508178
2020-10-15 09:27:09,586 - trainer - INFO - test_my_metric : 0.8168999999999998
2020-10-15 09:27:09,586 - trainer - INFO - test_my_metric2: 0.9936999999999999
2020-10-15 09:28:01,456 - trainer - INFO - epoch : 48
2020-10-15 09:28:01,456 - trainer - INFO - loss : -14.018685243346475
2020-10-15 09:28:01,456 - trainer - INFO - my_metric : 0.7689985795454546
2020-10-15 09:28:01,457 - trainer - INFO - my_metric2 : 0.9961159446022727
2020-10-15 09:28:01,457 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 09:28:01,457 - trainer - INFO - val_loss : 1.7866284847259521
2020-10-15 09:28:01,457 - trainer - INFO - val_my_metric : 0.7452
2020-10-15 09:28:01,457 - trainer - INFO - val_my_metric2 : 0.994
2020-10-15 09:28:01,457 - trainer - INFO - test_loss : 1.2461126685142516
2020-10-15 09:28:01,457 - trainer - INFO - test_my_metric : 0.8161999999999999
2020-10-15 09:28:01,457 - trainer - INFO - test_my_metric2: 0.9947000000000001
2020-10-15 09:28:03,011 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:28:54,759 - trainer - INFO - epoch : 49
2020-10-15 09:28:54,760 - trainer - INFO - loss : -14.328060003844174
2020-10-15 09:28:54,760 - trainer - INFO - my_metric : 0.7734375
2020-10-15 09:28:54,760 - trainer - INFO - my_metric2 : 0.9962491122159091
2020-10-15 09:28:54,760 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 09:28:54,760 - trainer - INFO - val_loss : 1.7404865980148316
2020-10-15 09:28:54,760 - trainer - INFO - val_my_metric : 0.7451999999999999
2020-10-15 09:28:54,760 - trainer - INFO - val_my_metric2 : 0.9944000000000001
2020-10-15 09:28:54,760 - trainer - INFO - test_loss : 1.1640562057495116
2020-10-15 09:28:54,760 - trainer - INFO - test_my_metric : 0.8206999999999999
2020-10-15 09:28:54,760 - trainer - INFO - test_my_metric2: 0.9949
2020-10-15 09:29:46,229 - trainer - INFO - epoch : 50
2020-10-15 09:29:46,229 - trainer - INFO - loss : -14.612492840398442
2020-10-15 09:29:46,229 - trainer - INFO - my_metric : 0.7774497908775253
2020-10-15 09:29:46,229 - trainer - INFO - my_metric2 : 0.9963206281565656
2020-10-15 09:29:46,229 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 09:29:46,230 - trainer - INFO - val_loss : 1.7660479545593262
2020-10-15 09:29:46,230 - trainer - INFO - val_my_metric : 0.7454
2020-10-15 09:29:46,230 - trainer - INFO - val_my_metric2 : 0.9952
2020-10-15 09:29:46,230 - trainer - INFO - test_loss : 1.2121267914772034
2020-10-15 09:29:46,230 - trainer - INFO - test_my_metric : 0.8197000000000001
2020-10-15 09:29:46,230 - trainer - INFO - test_my_metric2: 0.9954000000000001
2020-10-15 09:29:46,820 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:30:38,298 - trainer - INFO - epoch : 51
2020-10-15 09:30:38,299 - trainer - INFO - loss : -12.941691935062408
2020-10-15 09:30:38,299 - trainer - INFO - my_metric : 0.7082420888573232
2020-10-15 09:30:38,299 - trainer - INFO - my_metric2 : 0.9835587318497474
2020-10-15 09:30:38,299 - trainer - INFO - learning rate : [0.02]
2020-10-15 09:30:38,299 - trainer - INFO - val_loss : 2.679944610595703
2020-10-15 09:30:38,299 - trainer - INFO - val_my_metric : 0.6604000000000001
2020-10-15 09:30:38,299 - trainer - INFO - val_my_metric2 : 0.9742
2020-10-15 09:30:38,299 - trainer - INFO - test_loss : 2.3570656299591066
2020-10-15 09:30:38,299 - trainer - INFO - test_my_metric : 0.7114999999999999
2020-10-15 09:30:38,299 - trainer - INFO - test_my_metric2: 0.9728999999999999
2020-10-15 09:31:29,921 - trainer - INFO - epoch : 52
2020-10-15 09:31:29,921 - trainer - INFO - loss : -12.814456351778723
2020-10-15 09:31:29,921 - trainer - INFO - my_metric : 0.7169078480113636
2020-10-15 09:31:29,921 - trainer - INFO - my_metric2 : 0.9861283735795454
2020-10-15 09:31:29,921 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 09:31:29,921 - trainer - INFO - val_loss : 2.3968521118164063
2020-10-15 09:31:29,921 - trainer - INFO - val_my_metric : 0.6698000000000001
2020-10-15 09:31:29,922 - trainer - INFO - val_my_metric2 : 0.9798
2020-10-15 09:31:29,922 - trainer - INFO - test_loss : 1.882361400127411
2020-10-15 09:31:29,922 - trainer - INFO - test_my_metric : 0.7375999999999999
2020-10-15 09:31:29,922 - trainer - INFO - test_my_metric2: 0.9797
2020-10-15 09:32:21,400 - trainer - INFO - epoch : 53
2020-10-15 09:32:21,400 - trainer - INFO - loss : -12.942627137357539
2020-10-15 09:32:21,401 - trainer - INFO - my_metric : 0.7312085700757577
2020-10-15 09:32:21,401 - trainer - INFO - my_metric2 : 0.98876953125
2020-10-15 09:32:21,401 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 09:32:21,401 - trainer - INFO - val_loss : 2.0422773122787476
2020-10-15 09:32:21,401 - trainer - INFO - val_my_metric : 0.7118
2020-10-15 09:32:21,401 - trainer - INFO - val_my_metric2 : 0.9902
2020-10-15 09:32:21,401 - trainer - INFO - test_loss : 1.5278717756271363
2020-10-15 09:32:21,401 - trainer - INFO - test_my_metric : 0.7796000000000001
2020-10-15 09:32:21,401 - trainer - INFO - test_my_metric2: 0.9911
2020-10-15 09:33:12,835 - trainer - INFO - epoch : 54
2020-10-15 09:33:12,835 - trainer - INFO - loss : -13.152947821400382
2020-10-15 09:33:12,835 - trainer - INFO - my_metric : 0.7434131352588383
2020-10-15 09:33:12,836 - trainer - INFO - my_metric2 : 0.9919211647727273
2020-10-15 09:33:12,836 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 09:33:12,836 - trainer - INFO - val_loss : 1.9067674160003663
2020-10-15 09:33:12,836 - trainer - INFO - val_my_metric : 0.7154
2020-10-15 09:33:12,836 - trainer - INFO - val_my_metric2 : 0.9870000000000001
2020-10-15 09:33:12,836 - trainer - INFO - test_loss : 1.4970640301704408
2020-10-15 09:33:12,836 - trainer - INFO - test_my_metric : 0.7765000000000001
2020-10-15 09:33:12,836 - trainer - INFO - test_my_metric2: 0.9898
2020-10-15 09:34:04,082 - trainer - INFO - epoch : 55
2020-10-15 09:34:04,083 - trainer - INFO - loss : -13.379109155048024
2020-10-15 09:34:04,083 - trainer - INFO - my_metric : 0.7521775370896464
2020-10-15 09:34:04,083 - trainer - INFO - my_metric2 : 0.9932528409090909
2020-10-15 09:34:04,083 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 09:34:04,083 - trainer - INFO - val_loss : 1.9737794876098633
2020-10-15 09:34:04,083 - trainer - INFO - val_my_metric : 0.724
2020-10-15 09:34:04,083 - trainer - INFO - val_my_metric2 : 0.99
2020-10-15 09:34:04,083 - trainer - INFO - test_loss : 1.422409451007843
2020-10-15 09:34:04,083 - trainer - INFO - test_my_metric : 0.8009000000000001
2020-10-15 09:34:04,083 - trainer - INFO - test_my_metric2: 0.992
2020-10-15 09:34:55,353 - trainer - INFO - epoch : 56
2020-10-15 09:34:55,353 - trainer - INFO - loss : -13.6724913418293
2020-10-15 09:34:55,353 - trainer - INFO - my_metric : 0.7602070509785354
2020-10-15 09:34:55,354 - trainer - INFO - my_metric2 : 0.9943403764204546
2020-10-15 09:34:55,354 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 09:34:55,354 - trainer - INFO - val_loss : 1.974674129486084
2020-10-15 09:34:55,354 - trainer - INFO - val_my_metric : 0.7287999999999999
2020-10-15 09:34:55,354 - trainer - INFO - val_my_metric2 : 0.992
2020-10-15 09:34:55,354 - trainer - INFO - test_loss : 1.4211949706077576
2020-10-15 09:34:55,354 - trainer - INFO - test_my_metric : 0.8017999999999998
2020-10-15 09:34:55,354 - trainer - INFO - test_my_metric2: 0.9918000000000001
2020-10-15 09:35:47,179 - trainer - INFO - epoch : 57
2020-10-15 09:35:47,179 - trainer - INFO - loss : -13.935123833743008
2020-10-15 09:35:47,179 - trainer - INFO - my_metric : 0.7658839370265151
2020-10-15 09:35:47,180 - trainer - INFO - my_metric2 : 0.9953662602588383
2020-10-15 09:35:47,180 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 09:35:47,180 - trainer - INFO - val_loss : 1.8254554748535157
2020-10-15 09:35:47,180 - trainer - INFO - val_my_metric : 0.7392
2020-10-15 09:35:47,180 - trainer - INFO - val_my_metric2 : 0.9924
2020-10-15 09:35:47,180 - trainer - INFO - test_loss : 1.3470670223236083
2020-10-15 09:35:47,180 - trainer - INFO - test_my_metric : 0.8087
2020-10-15 09:35:47,180 - trainer - INFO - test_my_metric2: 0.9936
2020-10-15 09:36:38,707 - trainer - INFO - epoch : 58
2020-10-15 09:36:38,708 - trainer - INFO - loss : -14.247029773213647
2020-10-15 09:36:38,708 - trainer - INFO - my_metric : 0.7722661182133838
2020-10-15 09:36:38,708 - trainer - INFO - my_metric2 : 0.9963156960227273
2020-10-15 09:36:38,708 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 09:36:38,708 - trainer - INFO - val_loss : 1.7155279874801637
2020-10-15 09:36:38,709 - trainer - INFO - val_my_metric : 0.7462
2020-10-15 09:36:38,709 - trainer - INFO - val_my_metric2 : 0.9938
2020-10-15 09:36:38,709 - trainer - INFO - test_loss : 1.1823547244071961
2020-10-15 09:36:38,709 - trainer - INFO - test_my_metric : 0.8177999999999999
2020-10-15 09:36:38,709 - trainer - INFO - test_my_metric2: 0.9943
2020-10-15 09:36:39,601 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:37:30,806 - trainer - INFO - epoch : 59
2020-10-15 09:37:30,807 - trainer - INFO - loss : -14.544539421796799
2020-10-15 09:37:30,807 - trainer - INFO - my_metric : 0.7765151515151515
2020-10-15 09:37:30,807 - trainer - INFO - my_metric2 : 0.9971368963068182
2020-10-15 09:37:30,807 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 09:37:30,807 - trainer - INFO - val_loss : 1.7588823080062865
2020-10-15 09:37:30,807 - trainer - INFO - val_my_metric : 0.7476
2020-10-15 09:37:30,807 - trainer - INFO - val_my_metric2 : 0.9949999999999999
2020-10-15 09:37:30,807 - trainer - INFO - test_loss : 1.20677011013031
2020-10-15 09:37:30,807 - trainer - INFO - test_my_metric : 0.8225999999999999
2020-10-15 09:37:30,807 - trainer - INFO - test_my_metric2: 0.9945
2020-10-15 09:37:31,390 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:38:23,516 - trainer - INFO - epoch : 60
2020-10-15 09:38:23,516 - trainer - INFO - loss : -14.826462420550259
2020-10-15 09:38:23,516 - trainer - INFO - my_metric : 0.7787642045454546
2020-10-15 09:38:23,516 - trainer - INFO - my_metric2 : 0.9972749960542928
2020-10-15 09:38:23,516 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 09:38:23,516 - trainer - INFO - val_loss : 1.763417625427246
2020-10-15 09:38:23,516 - trainer - INFO - val_my_metric : 0.7512
2020-10-15 09:38:23,516 - trainer - INFO - val_my_metric2 : 0.9947999999999999
2020-10-15 09:38:23,516 - trainer - INFO - test_loss : 1.1904496431350708
2020-10-15 09:38:23,516 - trainer - INFO - test_my_metric : 0.8267
2020-10-15 09:38:23,516 - trainer - INFO - test_my_metric2: 0.9953
2020-10-15 09:38:24,847 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:39:17,131 - trainer - INFO - epoch : 61
2020-10-15 09:39:17,131 - trainer - INFO - loss : -13.277633133259686
2020-10-15 09:39:17,132 - trainer - INFO - my_metric : 0.7141285905934344
2020-10-15 09:39:17,132 - trainer - INFO - my_metric2 : 0.9853959517045454
2020-10-15 09:39:17,132 - trainer - INFO - learning rate : [0.02]
2020-10-15 09:39:17,132 - trainer - INFO - val_loss : 2.861416292190552
2020-10-15 09:39:17,132 - trainer - INFO - val_my_metric : 0.6224000000000001
2020-10-15 09:39:17,132 - trainer - INFO - val_my_metric2 : 0.9715999999999999
2020-10-15 09:39:17,132 - trainer - INFO - test_loss : 2.208770775794983
2020-10-15 09:39:17,132 - trainer - INFO - test_my_metric : 0.7032
2020-10-15 09:39:17,132 - trainer - INFO - test_my_metric2: 0.9690999999999999
2020-10-15 09:40:09,169 - trainer - INFO - epoch : 62
2020-10-15 09:40:09,169 - trainer - INFO - loss : -12.959757812998511
2020-10-15 09:40:09,169 - trainer - INFO - my_metric : 0.7152013297032828
2020-10-15 09:40:09,169 - trainer - INFO - my_metric2 : 0.9862048216540404
2020-10-15 09:40:09,169 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 09:40:09,169 - trainer - INFO - val_loss : 2.1083473920822144
2020-10-15 09:40:09,169 - trainer - INFO - val_my_metric : 0.7106
2020-10-15 09:40:09,169 - trainer - INFO - val_my_metric2 : 0.9843999999999999
2020-10-15 09:40:09,169 - trainer - INFO - test_loss : 1.7211556434631348
2020-10-15 09:40:09,170 - trainer - INFO - test_my_metric : 0.769
2020-10-15 09:40:09,170 - trainer - INFO - test_my_metric2: 0.9833000000000001
2020-10-15 09:41:01,559 - trainer - INFO - epoch : 63
2020-10-15 09:41:01,559 - trainer - INFO - loss : -13.147498090158809
2020-10-15 09:41:01,559 - trainer - INFO - my_metric : 0.7358990293560606
2020-10-15 09:41:01,560 - trainer - INFO - my_metric2 : 0.989501953125
2020-10-15 09:41:01,560 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 09:41:01,560 - trainer - INFO - val_loss : 2.054829239845276
2020-10-15 09:41:01,560 - trainer - INFO - val_my_metric : 0.7138
2020-10-15 09:41:01,560 - trainer - INFO - val_my_metric2 : 0.9848000000000001
2020-10-15 09:41:01,560 - trainer - INFO - test_loss : 1.5213267087936402
2020-10-15 09:41:01,560 - trainer - INFO - test_my_metric : 0.7901000000000001
2020-10-15 09:41:01,560 - trainer - INFO - test_my_metric2: 0.9863000000000002
2020-10-15 09:41:53,534 - trainer - INFO - epoch : 64
2020-10-15 09:41:53,535 - trainer - INFO - loss : -13.277229143814607
2020-10-15 09:41:53,535 - trainer - INFO - my_metric : 0.7428188131313131
2020-10-15 09:41:53,535 - trainer - INFO - my_metric2 : 0.9912109375
2020-10-15 09:41:53,535 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 09:41:53,535 - trainer - INFO - val_loss : 1.911435031890869
2020-10-15 09:41:53,535 - trainer - INFO - val_my_metric : 0.726
2020-10-15 09:41:53,535 - trainer - INFO - val_my_metric2 : 0.9902
2020-10-15 09:41:53,535 - trainer - INFO - test_loss : 1.3295318126678466
2020-10-15 09:41:53,535 - trainer - INFO - test_my_metric : 0.7977
2020-10-15 09:41:53,535 - trainer - INFO - test_my_metric2: 0.9903000000000001
2020-10-15 09:42:45,983 - trainer - INFO - epoch : 65
2020-10-15 09:42:45,983 - trainer - INFO - loss : -13.522729724645615
2020-10-15 09:42:45,983 - trainer - INFO - my_metric : 0.752133147885101
2020-10-15 09:42:45,983 - trainer - INFO - my_metric2 : 0.9933416193181818
2020-10-15 09:42:45,983 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 09:42:45,984 - trainer - INFO - val_loss : 1.8582378387451173
2020-10-15 09:42:45,984 - trainer - INFO - val_my_metric : 0.7228
2020-10-15 09:42:45,984 - trainer - INFO - val_my_metric2 : 0.9928000000000001
2020-10-15 09:42:45,984 - trainer - INFO - test_loss : 1.3203251242637635
2020-10-15 09:42:45,984 - trainer - INFO - test_my_metric : 0.8026
2020-10-15 09:42:45,984 - trainer - INFO - test_my_metric2: 0.9888999999999999
2020-10-15 09:43:38,572 - trainer - INFO - epoch : 66
2020-10-15 09:43:38,572 - trainer - INFO - loss : -13.81418952074918
2020-10-15 09:43:38,572 - trainer - INFO - my_metric : 0.7627051767676768
2020-10-15 09:43:38,572 - trainer - INFO - my_metric2 : 0.9945401278409091
2020-10-15 09:43:38,572 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 09:43:38,572 - trainer - INFO - val_loss : 1.871768879890442
2020-10-15 09:43:38,573 - trainer - INFO - val_my_metric : 0.738
2020-10-15 09:43:38,573 - trainer - INFO - val_my_metric2 : 0.9927999999999999
2020-10-15 09:43:38,573 - trainer - INFO - test_loss : 1.301648163795471
2020-10-15 09:43:38,573 - trainer - INFO - test_my_metric : 0.8118999999999998
2020-10-15 09:43:38,573 - trainer - INFO - test_my_metric2: 0.9923000000000002
2020-10-15 09:44:31,061 - trainer - INFO - epoch : 67
2020-10-15 09:44:31,062 - trainer - INFO - loss : -14.112311850894582
2020-10-15 09:44:31,062 - trainer - INFO - my_metric : 0.7692353219696969
2020-10-15 09:44:31,062 - trainer - INFO - my_metric2 : 0.9956547900883838
2020-10-15 09:44:31,062 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 09:44:31,062 - trainer - INFO - val_loss : 1.764278244972229
2020-10-15 09:44:31,062 - trainer - INFO - val_my_metric : 0.7454000000000001
2020-10-15 09:44:31,062 - trainer - INFO - val_my_metric2 : 0.9948
2020-10-15 09:44:31,062 - trainer - INFO - test_loss : 1.2675804138183593
2020-10-15 09:44:31,062 - trainer - INFO - test_my_metric : 0.8159000000000001
2020-10-15 09:44:31,062 - trainer - INFO - test_my_metric2: 0.9945999999999999
2020-10-15 09:45:23,097 - trainer - INFO - epoch : 68
2020-10-15 09:45:23,097 - trainer - INFO - loss : -14.417251719669862
2020-10-15 09:45:23,097 - trainer - INFO - my_metric : 0.7752475931186869
2020-10-15 09:45:23,097 - trainer - INFO - my_metric2 : 0.9967595880681818
2020-10-15 09:45:23,098 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 09:45:23,098 - trainer - INFO - val_loss : 1.7384860515594482
2020-10-15 09:45:23,098 - trainer - INFO - val_my_metric : 0.7494
2020-10-15 09:45:23,098 - trainer - INFO - val_my_metric2 : 0.9955999999999999
2020-10-15 09:45:23,098 - trainer - INFO - test_loss : 1.1788957595825196
2020-10-15 09:45:23,098 - trainer - INFO - test_my_metric : 0.8272
2020-10-15 09:45:23,098 - trainer - INFO - test_my_metric2: 0.9946999999999999
2020-10-15 09:46:14,622 - trainer - INFO - epoch : 69
2020-10-15 09:46:14,622 - trainer - INFO - loss : -14.708591677925803
2020-10-15 09:46:14,622 - trainer - INFO - my_metric : 0.7796371922348485
2020-10-15 09:46:14,622 - trainer - INFO - my_metric2 : 0.9971590909090909
2020-10-15 09:46:14,622 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 09:46:14,623 - trainer - INFO - val_loss : 1.7452043056488038
2020-10-15 09:46:14,623 - trainer - INFO - val_my_metric : 0.7522
2020-10-15 09:46:14,623 - trainer - INFO - val_my_metric2 : 0.9958
2020-10-15 09:46:14,623 - trainer - INFO - test_loss : 1.184942626953125
2020-10-15 09:46:14,623 - trainer - INFO - test_my_metric : 0.828
2020-10-15 09:46:14,623 - trainer - INFO - test_my_metric2: 0.9949
2020-10-15 09:46:15,205 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:47:06,602 - trainer - INFO - epoch : 70
2020-10-15 09:47:06,603 - trainer - INFO - loss : -14.982128728519786
2020-10-15 09:47:06,603 - trainer - INFO - my_metric : 0.7815261994949495
2020-10-15 09:47:06,603 - trainer - INFO - my_metric2 : 0.9972922585227273
2020-10-15 09:47:06,603 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 09:47:06,603 - trainer - INFO - val_loss : 1.738564133644104
2020-10-15 09:47:06,603 - trainer - INFO - val_my_metric : 0.7538
2020-10-15 09:47:06,604 - trainer - INFO - val_my_metric2 : 0.9962
2020-10-15 09:47:06,604 - trainer - INFO - test_loss : 1.175653052330017
2020-10-15 09:47:06,604 - trainer - INFO - test_my_metric : 0.8291000000000001
2020-10-15 09:47:06,604 - trainer - INFO - test_my_metric2: 0.9948000000000002
2020-10-15 09:47:07,544 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 09:47:58,755 - trainer - INFO - epoch : 71
2020-10-15 09:47:58,755 - trainer - INFO - loss : -13.301636825908314
2020-10-15 09:47:58,755 - trainer - INFO - my_metric : 0.7128437697285354
2020-10-15 09:47:58,756 - trainer - INFO - my_metric2 : 0.9844736426767677
2020-10-15 09:47:58,756 - trainer - INFO - learning rate : [0.02]
2020-10-15 09:47:58,756 - trainer - INFO - val_loss : 2.655558395385742
2020-10-15 09:47:58,756 - trainer - INFO - val_my_metric : 0.6530000000000001
2020-10-15 09:47:58,756 - trainer - INFO - val_my_metric2 : 0.9698
2020-10-15 09:47:58,756 - trainer - INFO - test_loss : 2.1988442182540893
2020-10-15 09:47:58,756 - trainer - INFO - test_my_metric : 0.7189000000000001
2020-10-15 09:47:58,757 - trainer - INFO - test_my_metric2: 0.9713999999999998
2020-10-15 09:48:50,327 - trainer - INFO - epoch : 72
2020-10-15 09:48:50,328 - trainer - INFO - loss : -13.034158224409277
2020-10-15 09:48:50,328 - trainer - INFO - my_metric : 0.7192234848484849
2020-10-15 09:48:50,328 - trainer - INFO - my_metric2 : 0.9865377406881314
2020-10-15 09:48:50,328 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 09:48:50,328 - trainer - INFO - val_loss : 2.487614107131958
2020-10-15 09:48:50,329 - trainer - INFO - val_my_metric : 0.6712
2020-10-15 09:48:50,329 - trainer - INFO - val_my_metric2 : 0.9730000000000001
2020-10-15 09:48:50,329 - trainer - INFO - test_loss : 1.8737500071525575
2020-10-15 09:48:50,329 - trainer - INFO - test_my_metric : 0.7446
2020-10-15 09:48:50,329 - trainer - INFO - test_my_metric2: 0.9766999999999999
2020-10-15 09:49:41,710 - trainer - INFO - epoch : 73
2020-10-15 09:49:41,710 - trainer - INFO - loss : -13.194225273349069
2020-10-15 09:49:41,710 - trainer - INFO - my_metric : 0.7355611781881314
2020-10-15 09:49:41,710 - trainer - INFO - my_metric2 : 0.9896351207386364
2020-10-15 09:49:41,710 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 09:49:41,710 - trainer - INFO - val_loss : 2.0737242698669434
2020-10-15 09:49:41,710 - trainer - INFO - val_my_metric : 0.7169999999999999
2020-10-15 09:49:41,710 - trainer - INFO - val_my_metric2 : 0.9890000000000001
2020-10-15 09:49:41,710 - trainer - INFO - test_loss : 1.7347183346748352
2020-10-15 09:49:41,710 - trainer - INFO - test_my_metric : 0.7681
2020-10-15 09:49:41,710 - trainer - INFO - test_my_metric2: 0.9871000000000001
2020-10-15 09:50:33,132 - trainer - INFO - epoch : 74
2020-10-15 09:50:33,133 - trainer - INFO - loss : -13.418850809335709
2020-10-15 09:50:33,133 - trainer - INFO - my_metric : 0.7482786852904041
2020-10-15 09:50:33,133 - trainer - INFO - my_metric2 : 0.9928755326704546
2020-10-15 09:50:33,133 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 09:50:33,133 - trainer - INFO - val_loss : 2.0110319375991823
2020-10-15 09:50:33,133 - trainer - INFO - val_my_metric : 0.7178000000000001
2020-10-15 09:50:33,133 - trainer - INFO - val_my_metric2 : 0.9911999999999999
2020-10-15 09:50:33,134 - trainer - INFO - test_loss : 1.6056284070014955
2020-10-15 09:50:33,134 - trainer - INFO - test_my_metric : 0.7727
2020-10-15 09:50:33,134 - trainer - INFO - test_my_metric2: 0.9875999999999999
2020-10-15 09:51:24,640 - trainer - INFO - epoch : 75
2020-10-15 09:51:24,640 - trainer - INFO - loss : -13.60735536705364
2020-10-15 09:51:24,641 - trainer - INFO - my_metric : 0.753970367739899
2020-10-15 09:51:24,641 - trainer - INFO - my_metric2 : 0.9936128866792928
2020-10-15 09:51:24,641 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 09:51:24,641 - trainer - INFO - val_loss : 1.8742431640625
2020-10-15 09:51:24,641 - trainer - INFO - val_my_metric : 0.7327999999999999
2020-10-15 09:51:24,641 - trainer - INFO - val_my_metric2 : 0.9934
2020-10-15 09:51:24,641 - trainer - INFO - test_loss : 1.29093896150589
2020-10-15 09:51:24,641 - trainer - INFO - test_my_metric : 0.8086
2020-10-15 09:51:24,641 - trainer - INFO - test_my_metric2: 0.9916
2020-10-15 09:52:16,073 - trainer - INFO - epoch : 76
2020-10-15 09:52:16,073 - trainer - INFO - loss : -13.908148849552328
2020-10-15 09:52:16,074 - trainer - INFO - my_metric : 0.7634992503156565
2020-10-15 09:52:16,074 - trainer - INFO - my_metric2 : 0.995233092645202
2020-10-15 09:52:16,074 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 09:52:16,074 - trainer - INFO - val_loss : 1.8853659629821777
2020-10-15 09:52:16,074 - trainer - INFO - val_my_metric : 0.7382
2020-10-15 09:52:16,074 - trainer - INFO - val_my_metric2 : 0.994
2020-10-15 09:52:16,074 - trainer - INFO - test_loss : 1.3538872122764587
2020-10-15 09:52:16,074 - trainer - INFO - test_my_metric : 0.8104000000000001
2020-10-15 09:52:16,074 - trainer - INFO - test_my_metric2: 0.9944
2020-10-15 09:53:07,759 - trainer - INFO - epoch : 77
2020-10-15 09:53:07,759 - trainer - INFO - loss : -14.205832307988947
2020-10-15 09:53:07,759 - trainer - INFO - my_metric : 0.7716496014835859
2020-10-15 09:53:07,759 - trainer - INFO - my_metric2 : 0.9962935014204546
2020-10-15 09:53:07,760 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 09:53:07,760 - trainer - INFO - val_loss : 1.8215967416763306
2020-10-15 09:53:07,760 - trainer - INFO - val_my_metric : 0.7407999999999999
2020-10-15 09:53:07,760 - trainer - INFO - val_my_metric2 : 0.9950000000000001
2020-10-15 09:53:07,760 - trainer - INFO - test_loss : 1.240986943244934
2020-10-15 09:53:07,760 - trainer - INFO - test_my_metric : 0.821
2020-10-15 09:53:07,760 - trainer - INFO - test_my_metric2: 0.9938999999999998
2020-10-15 09:53:59,144 - trainer - INFO - epoch : 78
2020-10-15 09:53:59,145 - trainer - INFO - loss : -14.501150816679
2020-10-15 09:53:59,145 - trainer - INFO - my_metric : 0.7763548571654041
2020-10-15 09:53:59,145 - trainer - INFO - my_metric2 : 0.9966264204545454
2020-10-15 09:53:59,145 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 09:53:59,145 - trainer - INFO - val_loss : 1.8381134510040282
2020-10-15 09:53:59,145 - trainer - INFO - val_my_metric : 0.7456
2020-10-15 09:53:59,146 - trainer - INFO - val_my_metric2 : 0.9944000000000001
2020-10-15 09:53:59,146 - trainer - INFO - test_loss : 1.1943592190742494
2020-10-15 09:53:59,146 - trainer - INFO - test_my_metric : 0.8287999999999999
2020-10-15 09:53:59,146 - trainer - INFO - test_my_metric2: 0.9948
2020-10-15 09:54:51,116 - trainer - INFO - epoch : 79
2020-10-15 09:54:51,117 - trainer - INFO - loss : -14.796423996036703
2020-10-15 09:54:51,117 - trainer - INFO - my_metric : 0.7801230074179292
2020-10-15 09:54:51,117 - trainer - INFO - my_metric2 : 0.9970481178977273
2020-10-15 09:54:51,117 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 09:54:51,117 - trainer - INFO - val_loss : 1.757742738723755
2020-10-15 09:54:51,117 - trainer - INFO - val_my_metric : 0.7504000000000001
2020-10-15 09:54:51,117 - trainer - INFO - val_my_metric2 : 0.9964000000000001
2020-10-15 09:54:51,117 - trainer - INFO - test_loss : 1.170112919807434
2020-10-15 09:54:51,118 - trainer - INFO - test_my_metric : 0.8287999999999999
2020-10-15 09:54:51,118 - trainer - INFO - test_my_metric2: 0.9955999999999999
2020-10-15 09:55:42,992 - trainer - INFO - epoch : 80
2020-10-15 09:55:42,992 - trainer - INFO - loss : -15.074645974419333
2020-10-15 09:55:42,992 - trainer - INFO - my_metric : 0.7834028764204546
2020-10-15 09:55:42,992 - trainer - INFO - my_metric2 : 0.9974525528724747
2020-10-15 09:55:42,992 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 09:55:42,992 - trainer - INFO - val_loss : 1.7687467336654663
2020-10-15 09:55:42,993 - trainer - INFO - val_my_metric : 0.7535999999999999
2020-10-15 09:55:42,993 - trainer - INFO - val_my_metric2 : 0.9965999999999999
2020-10-15 09:55:42,993 - trainer - INFO - test_loss : 1.1455476999282836
2020-10-15 09:55:42,993 - trainer - INFO - test_my_metric : 0.8331
2020-10-15 09:55:42,993 - trainer - INFO - test_my_metric2: 0.9955999999999999
2020-10-15 09:56:34,724 - trainer - INFO - epoch : 81
2020-10-15 09:56:34,724 - trainer - INFO - loss : -13.588590380820362
2020-10-15 09:56:34,724 - trainer - INFO - my_metric : 0.7202321062184344
2020-10-15 09:56:34,724 - trainer - INFO - my_metric2 : 0.9859064275568182
2020-10-15 09:56:34,724 - trainer - INFO - learning rate : [0.02]
2020-10-15 09:56:34,724 - trainer - INFO - val_loss : 2.6449524402618407
2020-10-15 09:56:34,724 - trainer - INFO - val_my_metric : 0.6638
2020-10-15 09:56:34,724 - trainer - INFO - val_my_metric2 : 0.9672000000000001
2020-10-15 09:56:34,724 - trainer - INFO - test_loss : 2.0647732734680178
2020-10-15 09:56:34,724 - trainer - INFO - test_my_metric : 0.7249000000000001
2020-10-15 09:56:34,725 - trainer - INFO - test_my_metric2: 0.9724999999999998
2020-10-15 09:57:26,416 - trainer - INFO - epoch : 82
2020-10-15 09:57:26,416 - trainer - INFO - loss : -13.194540600885045
2020-10-15 09:57:26,416 - trainer - INFO - my_metric : 0.7193319917929293
2020-10-15 09:57:26,416 - trainer - INFO - my_metric2 : 0.9862220841224747
2020-10-15 09:57:26,416 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 09:57:26,416 - trainer - INFO - val_loss : 2.454403591156006
2020-10-15 09:57:26,416 - trainer - INFO - val_my_metric : 0.6839999999999999
2020-10-15 09:57:26,416 - trainer - INFO - val_my_metric2 : 0.982
2020-10-15 09:57:26,416 - trainer - INFO - test_loss : 2.063061308860779
2020-10-15 09:57:26,416 - trainer - INFO - test_my_metric : 0.745
2020-10-15 09:57:26,417 - trainer - INFO - test_my_metric2: 0.9812000000000001
2020-10-15 09:58:18,234 - trainer - INFO - epoch : 83
2020-10-15 09:58:18,234 - trainer - INFO - loss : -13.251948275349356
2020-10-15 09:58:18,234 - trainer - INFO - my_metric : 0.7340174202967172
2020-10-15 09:58:18,234 - trainer - INFO - my_metric2 : 0.9897115688131314
2020-10-15 09:58:18,234 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 09:58:18,234 - trainer - INFO - val_loss : 2.048752045631409
2020-10-15 09:58:18,234 - trainer - INFO - val_my_metric : 0.7213999999999998
2020-10-15 09:58:18,234 - trainer - INFO - val_my_metric2 : 0.9899999999999999
2020-10-15 09:58:18,234 - trainer - INFO - test_loss : 1.440290665626526
2020-10-15 09:58:18,234 - trainer - INFO - test_my_metric : 0.8024000000000001
2020-10-15 09:58:18,234 - trainer - INFO - test_my_metric2: 0.9898999999999999
2020-10-15 09:59:10,534 - trainer - INFO - epoch : 84
2020-10-15 09:59:10,534 - trainer - INFO - loss : -13.44857144355774
2020-10-15 09:59:10,535 - trainer - INFO - my_metric : 0.744732481060606
2020-10-15 09:59:10,535 - trainer - INFO - my_metric2 : 0.9920987215909091
2020-10-15 09:59:10,535 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 09:59:10,535 - trainer - INFO - val_loss : 2.099819374084473
2020-10-15 09:59:10,535 - trainer - INFO - val_my_metric : 0.7247999999999999
2020-10-15 09:59:10,535 - trainer - INFO - val_my_metric2 : 0.9927999999999999
2020-10-15 09:59:10,535 - trainer - INFO - test_loss : 1.4831977844238282
2020-10-15 09:59:10,536 - trainer - INFO - test_my_metric : 0.7978
2020-10-15 09:59:10,536 - trainer - INFO - test_my_metric2: 0.9919
2020-10-15 10:00:02,881 - trainer - INFO - epoch : 85
2020-10-15 10:00:02,881 - trainer - INFO - loss : -13.717093272642655
2020-10-15 10:00:02,881 - trainer - INFO - my_metric : 0.7583895596590909
2020-10-15 10:00:02,881 - trainer - INFO - my_metric2 : 0.9939729324494949
2020-10-15 10:00:02,881 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 10:00:02,882 - trainer - INFO - val_loss : 1.9060609340667725
2020-10-15 10:00:02,882 - trainer - INFO - val_my_metric : 0.7276
2020-10-15 10:00:02,882 - trainer - INFO - val_my_metric2 : 0.9895999999999999
2020-10-15 10:00:02,882 - trainer - INFO - test_loss : 1.4879005551338196
2020-10-15 10:00:02,882 - trainer - INFO - test_my_metric : 0.7884
2020-10-15 10:00:02,882 - trainer - INFO - test_my_metric2: 0.9871000000000001
2020-10-15 10:00:55,352 - trainer - INFO - epoch : 86
2020-10-15 10:00:55,353 - trainer - INFO - loss : -13.979982909831135
2020-10-15 10:00:55,353 - trainer - INFO - my_metric : 0.7648136639835859
2020-10-15 10:00:55,354 - trainer - INFO - my_metric2 : 0.9949174360795454
2020-10-15 10:00:55,354 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 10:00:55,354 - trainer - INFO - val_loss : 1.8100011110305787
2020-10-15 10:00:55,354 - trainer - INFO - val_my_metric : 0.7452
2020-10-15 10:00:55,354 - trainer - INFO - val_my_metric2 : 0.9949999999999999
2020-10-15 10:00:55,354 - trainer - INFO - test_loss : 1.175388765335083
2020-10-15 10:00:55,354 - trainer - INFO - test_my_metric : 0.8267
2020-10-15 10:00:55,354 - trainer - INFO - test_my_metric2: 0.9928000000000001
2020-10-15 10:01:47,838 - trainer - INFO - epoch : 87
2020-10-15 10:01:47,839 - trainer - INFO - loss : -14.283207259394906
2020-10-15 10:01:47,839 - trainer - INFO - my_metric : 0.7727174084595959
2020-10-15 10:01:47,839 - trainer - INFO - my_metric2 : 0.9960715553977273
2020-10-15 10:01:47,839 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 10:01:47,840 - trainer - INFO - val_loss : 1.7270427465438842
2020-10-15 10:01:47,840 - trainer - INFO - val_my_metric : 0.7492000000000001
2020-10-15 10:01:47,840 - trainer - INFO - val_my_metric2 : 0.9945999999999999
2020-10-15 10:01:47,840 - trainer - INFO - test_loss : 1.1440973997116088
2020-10-15 10:01:47,840 - trainer - INFO - test_my_metric : 0.8252999999999998
2020-10-15 10:01:47,840 - trainer - INFO - test_my_metric2: 0.9939
2020-10-15 10:02:39,881 - trainer - INFO - epoch : 88
2020-10-15 10:02:39,882 - trainer - INFO - loss : -14.574187381701035
2020-10-15 10:02:39,882 - trainer - INFO - my_metric : 0.7769812381628788
2020-10-15 10:02:39,882 - trainer - INFO - my_metric2 : 0.9970530500315656
2020-10-15 10:02:39,882 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 10:02:39,882 - trainer - INFO - val_loss : 1.7773988246917725
2020-10-15 10:02:39,882 - trainer - INFO - val_my_metric : 0.7522
2020-10-15 10:02:39,882 - trainer - INFO - val_my_metric2 : 0.9952
2020-10-15 10:02:39,882 - trainer - INFO - test_loss : 1.1599371790885926
2020-10-15 10:02:39,882 - trainer - INFO - test_my_metric : 0.8340000000000002
2020-10-15 10:02:39,883 - trainer - INFO - test_my_metric2: 0.9952
2020-10-15 10:03:32,017 - trainer - INFO - epoch : 89
2020-10-15 10:03:32,018 - trainer - INFO - loss : -14.871470543471249
2020-10-15 10:03:32,018 - trainer - INFO - my_metric : 0.7814645478219696
2020-10-15 10:03:32,018 - trainer - INFO - my_metric2 : 0.9973588423295454
2020-10-15 10:03:32,018 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 10:03:32,019 - trainer - INFO - val_loss : 1.7507810831069945
2020-10-15 10:03:32,019 - trainer - INFO - val_my_metric : 0.752
2020-10-15 10:03:32,019 - trainer - INFO - val_my_metric2 : 0.9955999999999999
2020-10-15 10:03:32,019 - trainer - INFO - test_loss : 1.1293124914169312
2020-10-15 10:03:32,019 - trainer - INFO - test_my_metric : 0.834
2020-10-15 10:03:32,019 - trainer - INFO - test_my_metric2: 0.9949
2020-10-15 10:04:24,484 - trainer - INFO - epoch : 90
2020-10-15 10:04:24,484 - trainer - INFO - loss : -15.148727850480514
2020-10-15 10:04:24,484 - trainer - INFO - my_metric : 0.7842783301767677
2020-10-15 10:04:24,484 - trainer - INFO - my_metric2 : 0.9976251775568182
2020-10-15 10:04:24,485 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 10:04:24,485 - trainer - INFO - val_loss : 1.752157998085022
2020-10-15 10:04:24,485 - trainer - INFO - val_my_metric : 0.7574
2020-10-15 10:04:24,485 - trainer - INFO - val_my_metric2 : 0.9952
2020-10-15 10:04:24,485 - trainer - INFO - test_loss : 1.126637351512909
2020-10-15 10:04:24,485 - trainer - INFO - test_my_metric : 0.8358000000000001
2020-10-15 10:04:24,485 - trainer - INFO - test_my_metric2: 0.9955
2020-10-15 10:04:25,840 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 10:05:17,928 - trainer - INFO - epoch : 91
2020-10-15 10:05:17,928 - trainer - INFO - loss : -13.815551270138133
2020-10-15 10:05:17,928 - trainer - INFO - my_metric : 0.7263997395833334
2020-10-15 10:05:17,928 - trainer - INFO - my_metric2 : 0.9884415443497474
2020-10-15 10:05:17,928 - trainer - INFO - learning rate : [0.02]
2020-10-15 10:05:17,928 - trainer - INFO - val_loss : 3.8253111362457277
2020-10-15 10:05:17,928 - trainer - INFO - val_my_metric : 0.5828
2020-10-15 10:05:17,928 - trainer - INFO - val_my_metric2 : 0.9559999999999998
2020-10-15 10:05:17,928 - trainer - INFO - test_loss : 3.440125751495361
2020-10-15 10:05:17,928 - trainer - INFO - test_my_metric : 0.6247999999999999
2020-10-15 10:05:17,928 - trainer - INFO - test_my_metric2: 0.959
2020-10-15 10:06:09,943 - trainer - INFO - epoch : 92
2020-10-15 10:06:09,944 - trainer - INFO - loss : -13.431652535091747
2020-10-15 10:06:09,944 - trainer - INFO - my_metric : 0.7234478574810607
2020-10-15 10:06:09,944 - trainer - INFO - my_metric2 : 0.987575954861111
2020-10-15 10:06:09,944 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 10:06:09,944 - trainer - INFO - val_loss : 2.7942946910858155
2020-10-15 10:06:09,944 - trainer - INFO - val_my_metric : 0.6508
2020-10-15 10:06:09,944 - trainer - INFO - val_my_metric2 : 0.9585999999999999
2020-10-15 10:06:09,944 - trainer - INFO - test_loss : 2.296464705467224
2020-10-15 10:06:09,944 - trainer - INFO - test_my_metric : 0.7055
2020-10-15 10:06:09,944 - trainer - INFO - test_my_metric2: 0.9607000000000001
2020-10-15 10:07:02,393 - trainer - INFO - epoch : 93
2020-10-15 10:07:02,393 - trainer - INFO - loss : -13.515972451730208
2020-10-15 10:07:02,393 - trainer - INFO - my_metric : 0.7370457504734849
2020-10-15 10:07:02,393 - trainer - INFO - my_metric2 : 0.9898348721590909
2020-10-15 10:07:02,393 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 10:07:02,393 - trainer - INFO - val_loss : 2.031300449371338
2020-10-15 10:07:02,394 - trainer - INFO - val_my_metric : 0.7156
2020-10-15 10:07:02,394 - trainer - INFO - val_my_metric2 : 0.986
2020-10-15 10:07:02,394 - trainer - INFO - test_loss : 1.465934407711029
2020-10-15 10:07:02,394 - trainer - INFO - test_my_metric : 0.7882999999999999
2020-10-15 10:07:02,394 - trainer - INFO - test_my_metric2: 0.9865999999999999
2020-10-15 10:07:54,369 - trainer - INFO - epoch : 94
2020-10-15 10:07:54,369 - trainer - INFO - loss : -13.588458096439188
2020-10-15 10:07:54,370 - trainer - INFO - my_metric : 0.7447127525252526
2020-10-15 10:07:54,370 - trainer - INFO - my_metric2 : 0.9921875
2020-10-15 10:07:54,370 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 10:07:54,370 - trainer - INFO - val_loss : 2.137264919281006
2020-10-15 10:07:54,370 - trainer - INFO - val_my_metric : 0.7152000000000001
2020-10-15 10:07:54,370 - trainer - INFO - val_my_metric2 : 0.9884000000000001
2020-10-15 10:07:54,370 - trainer - INFO - test_loss : 1.5475112557411195
2020-10-15 10:07:54,370 - trainer - INFO - test_my_metric : 0.7910000000000001
2020-10-15 10:07:54,370 - trainer - INFO - test_my_metric2: 0.9879000000000001
2020-10-15 10:08:46,603 - trainer - INFO - epoch : 95
2020-10-15 10:08:46,603 - trainer - INFO - loss : -13.835305433381688
2020-10-15 10:08:46,603 - trainer - INFO - my_metric : 0.756771819760101
2020-10-15 10:08:46,603 - trainer - INFO - my_metric2 : 0.994256530145202
2020-10-15 10:08:46,603 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 10:08:46,603 - trainer - INFO - val_loss : 1.9815806150436401
2020-10-15 10:08:46,604 - trainer - INFO - val_my_metric : 0.7343999999999999
2020-10-15 10:08:46,604 - trainer - INFO - val_my_metric2 : 0.992
2020-10-15 10:08:46,604 - trainer - INFO - test_loss : 1.4339151263237
2020-10-15 10:08:46,604 - trainer - INFO - test_my_metric : 0.8105
2020-10-15 10:08:46,604 - trainer - INFO - test_my_metric2: 0.9909000000000001
2020-10-15 10:09:38,576 - trainer - INFO - epoch : 96
2020-10-15 10:09:38,576 - trainer - INFO - loss : -14.115875260396438
2020-10-15 10:09:38,576 - trainer - INFO - my_metric : 0.7660269689078283
2020-10-15 10:09:38,576 - trainer - INFO - my_metric2 : 0.9951615767045454
2020-10-15 10:09:38,576 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 10:09:38,576 - trainer - INFO - val_loss : 1.8344703435897827
2020-10-15 10:09:38,576 - trainer - INFO - val_my_metric : 0.7388
2020-10-15 10:09:38,576 - trainer - INFO - val_my_metric2 : 0.9945999999999999
2020-10-15 10:09:38,576 - trainer - INFO - test_loss : 1.208450436592102
2020-10-15 10:09:38,576 - trainer - INFO - test_my_metric : 0.8272999999999999
2020-10-15 10:09:38,576 - trainer - INFO - test_my_metric2: 0.9937999999999999
2020-10-15 10:10:30,632 - trainer - INFO - epoch : 97
2020-10-15 10:10:30,633 - trainer - INFO - loss : -14.412060886621475
2020-10-15 10:10:30,633 - trainer - INFO - my_metric : 0.7734498303345959
2020-10-15 10:10:30,633 - trainer - INFO - my_metric2 : 0.9964044744318182
2020-10-15 10:10:30,633 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 10:10:30,633 - trainer - INFO - val_loss : 1.8313885450363159
2020-10-15 10:10:30,633 - trainer - INFO - val_my_metric : 0.7468
2020-10-15 10:10:30,633 - trainer - INFO - val_my_metric2 : 0.9936
2020-10-15 10:10:30,633 - trainer - INFO - test_loss : 1.1839718341827392
2020-10-15 10:10:30,633 - trainer - INFO - test_my_metric : 0.8286000000000001
2020-10-15 10:10:30,633 - trainer - INFO - test_my_metric2: 0.9940000000000001
2020-10-15 10:11:22,870 - trainer - INFO - epoch : 98
2020-10-15 10:11:22,871 - trainer - INFO - loss : -14.71229214830832
2020-10-15 10:11:22,871 - trainer - INFO - my_metric : 0.7786187065972222
2020-10-15 10:11:22,871 - trainer - INFO - my_metric2 : 0.9968705610795454
2020-10-15 10:11:22,871 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 10:11:22,872 - trainer - INFO - val_loss : 1.754736590385437
2020-10-15 10:11:22,872 - trainer - INFO - val_my_metric : 0.7514000000000001
2020-10-15 10:11:22,872 - trainer - INFO - val_my_metric2 : 0.9948
2020-10-15 10:11:22,872 - trainer - INFO - test_loss : 1.1227729797363282
2020-10-15 10:11:22,872 - trainer - INFO - test_my_metric : 0.8337999999999999
2020-10-15 10:11:22,872 - trainer - INFO - test_my_metric2: 0.9945000000000002
2020-10-15 10:15:16,199 - trainer - INFO - epoch : 99
2020-10-15 10:15:16,200 - trainer - INFO - loss : -14.992217305031689
2020-10-15 10:15:16,200 - trainer - INFO - my_metric : 0.782367128314394
2020-10-15 10:15:16,200 - trainer - INFO - my_metric2 : 0.9973588423295454
2020-10-15 10:15:16,200 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 10:15:16,200 - trainer - INFO - val_loss : 1.7558622121810914
2020-10-15 10:15:16,200 - trainer - INFO - val_my_metric : 0.7542
2020-10-15 10:15:16,200 - trainer - INFO - val_my_metric2 : 0.9952
2020-10-15 10:15:16,200 - trainer - INFO - test_loss : 1.1260664939880372
2020-10-15 10:15:16,200 - trainer - INFO - test_my_metric : 0.8379999999999999
2020-10-15 10:15:16,200 - trainer - INFO - test_my_metric2: 0.9950999999999999
2020-10-15 10:16:08,178 - trainer - INFO - epoch : 100
2020-10-15 10:16:08,178 - trainer - INFO - loss : -15.256326063112779
2020-10-15 10:16:08,178 - trainer - INFO - my_metric : 0.784206814236111
2020-10-15 10:16:08,178 - trainer - INFO - my_metric2 : 0.9976029829545454
2020-10-15 10:16:08,179 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 10:16:08,179 - trainer - INFO - val_loss : 1.7366930007934571
2020-10-15 10:16:08,179 - trainer - INFO - val_my_metric : 0.7556
2020-10-15 10:16:08,179 - trainer - INFO - val_my_metric2 : 0.9950000000000001
2020-10-15 10:16:08,179 - trainer - INFO - test_loss : 1.106641960144043
2020-10-15 10:16:08,179 - trainer - INFO - test_my_metric : 0.8355
2020-10-15 10:16:08,179 - trainer - INFO - test_my_metric2: 0.9950000000000001
2020-10-15 10:17:00,484 - trainer - INFO - epoch : 101
2020-10-15 10:17:00,485 - trainer - INFO - loss : -13.691108977252787
2020-10-15 10:17:00,485 - trainer - INFO - my_metric : 0.7194084398674243
2020-10-15 10:17:00,485 - trainer - INFO - my_metric2 : 0.9858053188131314
2020-10-15 10:17:00,485 - trainer - INFO - learning rate : [0.02]
2020-10-15 10:17:00,485 - trainer - INFO - val_loss : 2.6285719871520996
2020-10-15 10:17:00,485 - trainer - INFO - val_my_metric : 0.6594
2020-10-15 10:17:00,485 - trainer - INFO - val_my_metric2 : 0.961
2020-10-15 10:17:00,485 - trainer - INFO - test_loss : 2.143393266201019
2020-10-15 10:17:00,485 - trainer - INFO - test_my_metric : 0.7162
2020-10-15 10:17:00,485 - trainer - INFO - test_my_metric2: 0.9591
2020-10-15 10:17:53,045 - trainer - INFO - epoch : 102
2020-10-15 10:17:53,046 - trainer - INFO - loss : -13.395796594294636
2020-10-15 10:17:53,046 - trainer - INFO - my_metric : 0.7236944641729798
2020-10-15 10:17:53,046 - trainer - INFO - my_metric2 : 0.987176452020202
2020-10-15 10:17:53,046 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 10:17:53,046 - trainer - INFO - val_loss : 2.422326946258545
2020-10-15 10:17:53,046 - trainer - INFO - val_my_metric : 0.6786000000000001
2020-10-15 10:17:53,046 - trainer - INFO - val_my_metric2 : 0.9726000000000001
2020-10-15 10:17:53,047 - trainer - INFO - test_loss : 1.9190498113632202
2020-10-15 10:17:53,047 - trainer - INFO - test_my_metric : 0.7452000000000001
2020-10-15 10:17:53,047 - trainer - INFO - test_my_metric2: 0.9687000000000001
2020-10-15 10:18:45,391 - trainer - INFO - epoch : 103
2020-10-15 10:18:45,392 - trainer - INFO - loss : -13.454544592987407
2020-10-15 10:18:45,392 - trainer - INFO - my_metric : 0.7371172664141414
2020-10-15 10:18:45,392 - trainer - INFO - my_metric2 : 0.9892134232954546
2020-10-15 10:18:45,392 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 10:18:45,392 - trainer - INFO - val_loss : 2.056082010269165
2020-10-15 10:18:45,392 - trainer - INFO - val_my_metric : 0.7198
2020-10-15 10:18:45,392 - trainer - INFO - val_my_metric2 : 0.9898
2020-10-15 10:18:45,392 - trainer - INFO - test_loss : 1.497710382938385
2020-10-15 10:18:45,392 - trainer - INFO - test_my_metric : 0.7938000000000002
2020-10-15 10:18:45,392 - trainer - INFO - test_my_metric2: 0.9907
2020-10-15 10:19:37,640 - trainer - INFO - epoch : 104
2020-10-15 10:19:37,641 - trainer - INFO - loss : -13.708647272803567
2020-10-15 10:19:37,641 - trainer - INFO - my_metric : 0.7517311789772727
2020-10-15 10:19:37,641 - trainer - INFO - my_metric2 : 0.9930752840909091
2020-10-15 10:19:37,641 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 10:19:37,641 - trainer - INFO - val_loss : 2.0106250286102294
2020-10-15 10:19:37,641 - trainer - INFO - val_my_metric : 0.732
2020-10-15 10:19:37,641 - trainer - INFO - val_my_metric2 : 0.9915999999999998
2020-10-15 10:19:37,641 - trainer - INFO - test_loss : 1.3193235516548156
2020-10-15 10:19:37,641 - trainer - INFO - test_my_metric : 0.8183
2020-10-15 10:19:37,641 - trainer - INFO - test_my_metric2: 0.9917999999999999
2020-10-15 10:20:29,105 - trainer - INFO - epoch : 105
2020-10-15 10:20:29,105 - trainer - INFO - loss : -13.917469081553547
2020-10-15 10:20:29,105 - trainer - INFO - my_metric : 0.7591565064709596
2020-10-15 10:20:29,105 - trainer - INFO - my_metric2 : 0.9940789733270201
2020-10-15 10:20:29,105 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 10:20:29,105 - trainer - INFO - val_loss : 1.9460663795471191
2020-10-15 10:20:29,106 - trainer - INFO - val_my_metric : 0.731
2020-10-15 10:20:29,106 - trainer - INFO - val_my_metric2 : 0.9898
2020-10-15 10:20:29,106 - trainer - INFO - test_loss : 1.3208194136619569
2020-10-15 10:20:29,106 - trainer - INFO - test_my_metric : 0.8118000000000001
2020-10-15 10:20:29,106 - trainer - INFO - test_my_metric2: 0.9932000000000001
2020-10-15 10:21:20,507 - trainer - INFO - epoch : 106
2020-10-15 10:21:20,507 - trainer - INFO - loss : -14.171870337291198
2020-10-15 10:21:20,508 - trainer - INFO - my_metric : 0.7662341185290404
2020-10-15 10:21:20,508 - trainer - INFO - my_metric2 : 0.9952059659090909
2020-10-15 10:21:20,508 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 10:21:20,508 - trainer - INFO - val_loss : 1.7864646434783935
2020-10-15 10:21:20,508 - trainer - INFO - val_my_metric : 0.747
2020-10-15 10:21:20,508 - trainer - INFO - val_my_metric2 : 0.9944
2020-10-15 10:21:20,508 - trainer - INFO - test_loss : 1.1344958782196044
2020-10-15 10:21:20,508 - trainer - INFO - test_my_metric : 0.8286
2020-10-15 10:21:20,508 - trainer - INFO - test_my_metric2: 0.9929
2020-10-15 10:22:12,191 - trainer - INFO - epoch : 107
2020-10-15 10:22:12,191 - trainer - INFO - loss : -14.461172970858486
2020-10-15 10:22:12,191 - trainer - INFO - my_metric : 0.7739381115845959
2020-10-15 10:22:12,192 - trainer - INFO - my_metric2 : 0.9962047230113636
2020-10-15 10:22:12,192 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 10:22:12,192 - trainer - INFO - val_loss : 1.722902202606201
2020-10-15 10:22:12,192 - trainer - INFO - val_my_metric : 0.7514
2020-10-15 10:22:12,192 - trainer - INFO - val_my_metric2 : 0.9936
2020-10-15 10:22:12,192 - trainer - INFO - test_loss : 1.0895165741443633
2020-10-15 10:22:12,192 - trainer - INFO - test_my_metric : 0.8327
2020-10-15 10:22:12,192 - trainer - INFO - test_my_metric2: 0.9946999999999999
2020-10-15 10:23:04,474 - trainer - INFO - epoch : 108
2020-10-15 10:23:04,474 - trainer - INFO - loss : -14.75578533248468
2020-10-15 10:23:04,474 - trainer - INFO - my_metric : 0.7798196811868686
2020-10-15 10:23:04,474 - trainer - INFO - my_metric2 : 0.9969149502840909
2020-10-15 10:23:04,474 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 10:23:04,474 - trainer - INFO - val_loss : 1.735348153114319
2020-10-15 10:23:04,475 - trainer - INFO - val_my_metric : 0.7534
2020-10-15 10:23:04,475 - trainer - INFO - val_my_metric2 : 0.9962
2020-10-15 10:23:04,475 - trainer - INFO - test_loss : 1.1013210654258727
2020-10-15 10:23:04,475 - trainer - INFO - test_my_metric : 0.8339000000000001
2020-10-15 10:23:04,475 - trainer - INFO - test_my_metric2: 0.9939
2020-10-15 10:23:55,721 - trainer - INFO - epoch : 109
2020-10-15 10:23:55,721 - trainer - INFO - loss : -15.033756499940699
2020-10-15 10:23:55,721 - trainer - INFO - my_metric : 0.783023102114899
2020-10-15 10:23:55,721 - trainer - INFO - my_metric2 : 0.9977583451704546
2020-10-15 10:23:55,721 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 10:23:55,721 - trainer - INFO - val_loss : 1.7001092195510865
2020-10-15 10:23:55,721 - trainer - INFO - val_my_metric : 0.7564
2020-10-15 10:23:55,721 - trainer - INFO - val_my_metric2 : 0.9955999999999999
2020-10-15 10:23:55,721 - trainer - INFO - test_loss : 1.096005392074585
2020-10-15 10:23:55,721 - trainer - INFO - test_my_metric : 0.8384
2020-10-15 10:23:55,721 - trainer - INFO - test_my_metric2: 0.9941999999999999
2020-10-15 10:24:46,974 - trainer - INFO - epoch : 110
2020-10-15 10:24:46,974 - trainer - INFO - loss : -15.305082055655392
2020-10-15 10:24:46,974 - trainer - INFO - my_metric : 0.7860884232954546
2020-10-15 10:24:46,975 - trainer - INFO - my_metric2 : 0.9977805397727273
2020-10-15 10:24:46,975 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 10:24:46,975 - trainer - INFO - val_loss : 1.7634986162185669
2020-10-15 10:24:46,975 - trainer - INFO - val_my_metric : 0.7554
2020-10-15 10:24:46,975 - trainer - INFO - val_my_metric2 : 0.9959999999999999
2020-10-15 10:24:46,975 - trainer - INFO - test_loss : 1.1176159739494325
2020-10-15 10:24:46,975 - trainer - INFO - test_my_metric : 0.8381000000000001
2020-10-15 10:24:46,975 - trainer - INFO - test_my_metric2: 0.9939
2020-10-15 10:25:38,054 - trainer - INFO - epoch : 111
2020-10-15 10:25:38,054 - trainer - INFO - loss : -13.832441695711829
2020-10-15 10:25:38,054 - trainer - INFO - my_metric : 0.7231765901199495
2020-10-15 10:25:38,054 - trainer - INFO - my_metric2 : 0.9870038273358586
2020-10-15 10:25:38,054 - trainer - INFO - learning rate : [0.02]
2020-10-15 10:25:38,054 - trainer - INFO - val_loss : 2.5184019565582276
2020-10-15 10:25:38,054 - trainer - INFO - val_my_metric : 0.6636
2020-10-15 10:25:38,054 - trainer - INFO - val_my_metric2 : 0.9703999999999999
2020-10-15 10:25:38,054 - trainer - INFO - test_loss : 2.1237754344940187
2020-10-15 10:25:38,054 - trainer - INFO - test_my_metric : 0.718
2020-10-15 10:25:38,054 - trainer - INFO - test_my_metric2: 0.9692000000000001
2020-10-15 10:26:29,732 - trainer - INFO - epoch : 112
2020-10-15 10:26:29,733 - trainer - INFO - loss : -13.346005493944341
2020-10-15 10:26:29,733 - trainer - INFO - my_metric : 0.7202937578914141
2020-10-15 10:26:29,733 - trainer - INFO - my_metric2 : 0.9864390980113636
2020-10-15 10:26:29,733 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 10:26:29,733 - trainer - INFO - val_loss : 2.287790632247925
2020-10-15 10:26:29,733 - trainer - INFO - val_my_metric : 0.6922
2020-10-15 10:26:29,733 - trainer - INFO - val_my_metric2 : 0.9847999999999999
2020-10-15 10:26:29,733 - trainer - INFO - test_loss : 1.831368911266327
2020-10-15 10:26:29,733 - trainer - INFO - test_my_metric : 0.7558
2020-10-15 10:26:29,733 - trainer - INFO - test_my_metric2: 0.9871000000000001
2020-10-15 10:27:21,608 - trainer - INFO - epoch : 113
2020-10-15 10:27:21,609 - trainer - INFO - loss : -13.420157462358475
2020-10-15 10:27:21,609 - trainer - INFO - my_metric : 0.7345328282828283
2020-10-15 10:27:21,609 - trainer - INFO - my_metric2 : 0.9898274739583333
2020-10-15 10:27:21,609 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 10:27:21,609 - trainer - INFO - val_loss : 2.048072171211243
2020-10-15 10:27:21,609 - trainer - INFO - val_my_metric : 0.7198
2020-10-15 10:27:21,609 - trainer - INFO - val_my_metric2 : 0.99
2020-10-15 10:27:21,609 - trainer - INFO - test_loss : 1.4277540802955628
2020-10-15 10:27:21,609 - trainer - INFO - test_my_metric : 0.7951
2020-10-15 10:27:21,609 - trainer - INFO - test_my_metric2: 0.9902
2020-10-15 10:28:13,169 - trainer - INFO - epoch : 114
2020-10-15 10:28:13,169 - trainer - INFO - loss : -13.630004473707892
2020-10-15 10:28:13,169 - trainer - INFO - my_metric : 0.7495906328914141
2020-10-15 10:28:13,169 - trainer - INFO - my_metric2 : 0.992947048611111
2020-10-15 10:28:13,170 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 10:28:13,170 - trainer - INFO - val_loss : 2.2104327201843263
2020-10-15 10:28:13,170 - trainer - INFO - val_my_metric : 0.7142
2020-10-15 10:28:13,170 - trainer - INFO - val_my_metric2 : 0.9869999999999999
2020-10-15 10:28:13,170 - trainer - INFO - test_loss : 1.5393923759460448
2020-10-15 10:28:13,170 - trainer - INFO - test_my_metric : 0.7966000000000001
2020-10-15 10:28:13,170 - trainer - INFO - test_my_metric2: 0.9892000000000001
2020-10-15 10:29:04,526 - trainer - INFO - epoch : 115
2020-10-15 10:29:04,526 - trainer - INFO - loss : -13.887669934467835
2020-10-15 10:29:04,526 - trainer - INFO - my_metric : 0.7595338147095959
2020-10-15 10:29:04,526 - trainer - INFO - my_metric2 : 0.9944069602272727
2020-10-15 10:29:04,526 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 10:29:04,526 - trainer - INFO - val_loss : 1.921481990814209
2020-10-15 10:29:04,526 - trainer - INFO - val_my_metric : 0.7378
2020-10-15 10:29:04,526 - trainer - INFO - val_my_metric2 : 0.9918000000000001
2020-10-15 10:29:04,526 - trainer - INFO - test_loss : 1.317124843597412
2020-10-15 10:29:04,526 - trainer - INFO - test_my_metric : 0.8160000000000001
2020-10-15 10:29:04,526 - trainer - INFO - test_my_metric2: 0.9918000000000001
2020-10-15 10:29:55,771 - trainer - INFO - epoch : 116
2020-10-15 10:29:55,772 - trainer - INFO - loss : -14.167183168909766
2020-10-15 10:29:55,772 - trainer - INFO - my_metric : 0.7676718355429292
2020-10-15 10:29:55,772 - trainer - INFO - my_metric2 : 0.995361328125
2020-10-15 10:29:55,772 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 10:29:55,773 - trainer - INFO - val_loss : 1.9555039405822754
2020-10-15 10:29:55,773 - trainer - INFO - val_my_metric : 0.744
2020-10-15 10:29:55,773 - trainer - INFO - val_my_metric2 : 0.9936
2020-10-15 10:29:55,773 - trainer - INFO - test_loss : 1.4158629655838013
2020-10-15 10:29:55,773 - trainer - INFO - test_my_metric : 0.8133999999999999
2020-10-15 10:29:55,773 - trainer - INFO - test_my_metric2: 0.9924
2020-10-15 10:30:47,095 - trainer - INFO - epoch : 117
2020-10-15 10:30:47,095 - trainer - INFO - loss : -14.46873253312978
2020-10-15 10:30:47,095 - trainer - INFO - my_metric : 0.7746606691919191
2020-10-15 10:30:47,095 - trainer - INFO - my_metric2 : 0.9964488636363636
2020-10-15 10:30:47,095 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 10:30:47,096 - trainer - INFO - val_loss : 1.7665897846221923
2020-10-15 10:30:47,096 - trainer - INFO - val_my_metric : 0.7498000000000001
2020-10-15 10:30:47,096 - trainer - INFO - val_my_metric2 : 0.9955999999999999
2020-10-15 10:30:47,096 - trainer - INFO - test_loss : 1.103460329771042
2020-10-15 10:30:47,096 - trainer - INFO - test_my_metric : 0.8356999999999999
2020-10-15 10:30:47,096 - trainer - INFO - test_my_metric2: 0.9937999999999999
2020-10-15 10:31:39,123 - trainer - INFO - epoch : 118
2020-10-15 10:31:39,123 - trainer - INFO - loss : -14.75600342317061
2020-10-15 10:31:39,123 - trainer - INFO - my_metric : 0.7803326231060606
2020-10-15 10:31:39,123 - trainer - INFO - my_metric2 : 0.9972922585227273
2020-10-15 10:31:39,123 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 10:31:39,123 - trainer - INFO - val_loss : 1.7473124980926513
2020-10-15 10:31:39,123 - trainer - INFO - val_my_metric : 0.7506
2020-10-15 10:31:39,123 - trainer - INFO - val_my_metric2 : 0.9944000000000001
2020-10-15 10:31:39,123 - trainer - INFO - test_loss : 1.0832304239273072
2020-10-15 10:31:39,123 - trainer - INFO - test_my_metric : 0.8402000000000001
2020-10-15 10:31:39,123 - trainer - INFO - test_my_metric2: 0.9948
2020-10-15 10:32:30,903 - trainer - INFO - epoch : 119
2020-10-15 10:32:30,903 - trainer - INFO - loss : -15.0475662865422
2020-10-15 10:32:30,903 - trainer - INFO - my_metric : 0.7832771070075758
2020-10-15 10:32:30,903 - trainer - INFO - my_metric2 : 0.9976251775568182
2020-10-15 10:32:30,903 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 10:32:30,904 - trainer - INFO - val_loss : 1.7572609186172485
2020-10-15 10:32:30,904 - trainer - INFO - val_my_metric : 0.7540000000000001
2020-10-15 10:32:30,904 - trainer - INFO - val_my_metric2 : 0.9960000000000001
2020-10-15 10:32:30,904 - trainer - INFO - test_loss : 1.1269363641738892
2020-10-15 10:32:30,904 - trainer - INFO - test_my_metric : 0.8405999999999999
2020-10-15 10:32:30,904 - trainer - INFO - test_my_metric2: 0.9955999999999999
2020-10-15 10:33:22,659 - trainer - INFO - epoch : 120
2020-10-15 10:33:22,659 - trainer - INFO - loss : -15.308790683746338
2020-10-15 10:33:22,659 - trainer - INFO - my_metric : 0.7851143268623737
2020-10-15 10:33:22,659 - trainer - INFO - my_metric2 : 0.9978471235795454
2020-10-15 10:33:22,659 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 10:33:22,659 - trainer - INFO - val_loss : 1.7383572101593017
2020-10-15 10:33:22,659 - trainer - INFO - val_my_metric : 0.7545999999999999
2020-10-15 10:33:22,659 - trainer - INFO - val_my_metric2 : 0.9965999999999999
2020-10-15 10:33:22,660 - trainer - INFO - test_loss : 1.102964162826538
2020-10-15 10:33:22,660 - trainer - INFO - test_my_metric : 0.8422999999999998
2020-10-15 10:33:22,660 - trainer - INFO - test_my_metric2: 0.9963
2020-10-15 10:34:14,479 - trainer - INFO - epoch : 121
2020-10-15 10:34:14,480 - trainer - INFO - loss : -13.7856617055156
2020-10-15 10:34:14,480 - trainer - INFO - my_metric : 0.7215687144886364
2020-10-15 10:34:14,480 - trainer - INFO - my_metric2 : 0.9871197324810606
2020-10-15 10:34:14,480 - trainer - INFO - learning rate : [0.02]
2020-10-15 10:34:14,480 - trainer - INFO - val_loss : 2.463099241256714
2020-10-15 10:34:14,480 - trainer - INFO - val_my_metric : 0.6849999999999999
2020-10-15 10:34:14,480 - trainer - INFO - val_my_metric2 : 0.9776
2020-10-15 10:34:14,480 - trainer - INFO - test_loss : 1.9316005110740662
2020-10-15 10:34:14,480 - trainer - INFO - test_my_metric : 0.7465
2020-10-15 10:34:14,480 - trainer - INFO - test_my_metric2: 0.9794
2020-10-15 10:35:05,821 - trainer - INFO - epoch : 122
2020-10-15 10:35:05,822 - trainer - INFO - loss : -13.437751014124263
2020-10-15 10:35:05,822 - trainer - INFO - my_metric : 0.7240076546717172
2020-10-15 10:35:05,822 - trainer - INFO - my_metric2 : 0.9867498224431818
2020-10-15 10:35:05,822 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 10:35:05,822 - trainer - INFO - val_loss : 2.079263472557068
2020-10-15 10:35:05,822 - trainer - INFO - val_my_metric : 0.7078
2020-10-15 10:35:05,822 - trainer - INFO - val_my_metric2 : 0.9846
2020-10-15 10:35:05,823 - trainer - INFO - test_loss : 1.5372314453125
2020-10-15 10:35:05,823 - trainer - INFO - test_my_metric : 0.7778
2020-10-15 10:35:05,823 - trainer - INFO - test_my_metric2: 0.9832000000000001
2020-10-15 10:35:57,068 - trainer - INFO - epoch : 123
2020-10-15 10:35:57,068 - trainer - INFO - loss : -13.55749379775741
2020-10-15 10:35:57,068 - trainer - INFO - my_metric : 0.7390161379419191
2020-10-15 10:35:57,069 - trainer - INFO - my_metric2 : 0.9906388099747474
2020-10-15 10:35:57,069 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 10:35:57,069 - trainer - INFO - val_loss : 2.0436156511306764
2020-10-15 10:35:57,069 - trainer - INFO - val_my_metric : 0.7209999999999999
2020-10-15 10:35:57,069 - trainer - INFO - val_my_metric2 : 0.9847999999999999
2020-10-15 10:35:57,069 - trainer - INFO - test_loss : 1.5452903389930726
2020-10-15 10:35:57,069 - trainer - INFO - test_my_metric : 0.7929
2020-10-15 10:35:57,069 - trainer - INFO - test_my_metric2: 0.9860999999999999
2020-10-15 10:36:48,594 - trainer - INFO - epoch : 124
2020-10-15 10:36:48,594 - trainer - INFO - loss : -13.753334923224015
2020-10-15 10:36:48,594 - trainer - INFO - my_metric : 0.7511541193181818
2020-10-15 10:36:48,595 - trainer - INFO - my_metric2 : 0.993035827020202
2020-10-15 10:36:48,595 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 10:36:48,595 - trainer - INFO - val_loss : 2.016369867324829
2020-10-15 10:36:48,595 - trainer - INFO - val_my_metric : 0.7348
2020-10-15 10:36:48,595 - trainer - INFO - val_my_metric2 : 0.9934
2020-10-15 10:36:48,595 - trainer - INFO - test_loss : 1.4416287660598754
2020-10-15 10:36:48,596 - trainer - INFO - test_my_metric : 0.8107
2020-10-15 10:36:48,596 - trainer - INFO - test_my_metric2: 0.9926999999999999
2020-10-15 10:37:40,162 - trainer - INFO - epoch : 125
2020-10-15 10:37:40,163 - trainer - INFO - loss : -13.97637385671789
2020-10-15 10:37:40,163 - trainer - INFO - my_metric : 0.7604832504734849
2020-10-15 10:37:40,163 - trainer - INFO - my_metric2 : 0.9947842684659091
2020-10-15 10:37:40,163 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 10:37:40,163 - trainer - INFO - val_loss : 1.8582889795303346
2020-10-15 10:37:40,163 - trainer - INFO - val_my_metric : 0.7394000000000001
2020-10-15 10:37:40,163 - trainer - INFO - val_my_metric2 : 0.9911999999999999
2020-10-15 10:37:40,163 - trainer - INFO - test_loss : 1.1542283296585083
2020-10-15 10:37:40,163 - trainer - INFO - test_my_metric : 0.8231000000000002
2020-10-15 10:37:40,163 - trainer - INFO - test_my_metric2: 0.9911999999999999
2020-10-15 10:38:31,786 - trainer - INFO - epoch : 126
2020-10-15 10:38:31,786 - trainer - INFO - loss : -14.264421208338304
2020-10-15 10:38:31,786 - trainer - INFO - my_metric : 0.7689171993371212
2020-10-15 10:38:31,786 - trainer - INFO - my_metric2 : 0.9956498579545454
2020-10-15 10:38:31,786 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 10:38:31,786 - trainer - INFO - val_loss : 1.797965407371521
2020-10-15 10:38:31,786 - trainer - INFO - val_my_metric : 0.7500000000000001
2020-10-15 10:38:31,786 - trainer - INFO - val_my_metric2 : 0.9944
2020-10-15 10:38:31,786 - trainer - INFO - test_loss : 1.2102895975112915
2020-10-15 10:38:31,786 - trainer - INFO - test_my_metric : 0.8277000000000001
2020-10-15 10:38:31,786 - trainer - INFO - test_my_metric2: 0.9939
2020-10-15 10:39:23,949 - trainer - INFO - epoch : 127
2020-10-15 10:39:23,949 - trainer - INFO - loss : -14.559723230925472
2020-10-15 10:39:23,949 - trainer - INFO - my_metric : 0.7752056699810606
2020-10-15 10:39:23,950 - trainer - INFO - my_metric2 : 0.9966486150568182
2020-10-15 10:39:23,950 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 10:39:23,950 - trainer - INFO - val_loss : 1.7757566928863526
2020-10-15 10:39:23,950 - trainer - INFO - val_my_metric : 0.7512
2020-10-15 10:39:23,950 - trainer - INFO - val_my_metric2 : 0.9952
2020-10-15 10:39:23,950 - trainer - INFO - test_loss : 1.1589480996131898
2020-10-15 10:39:23,950 - trainer - INFO - test_my_metric : 0.8362999999999999
2020-10-15 10:39:23,950 - trainer - INFO - test_my_metric2: 0.9951000000000001
2020-10-15 10:43:15,109 - trainer - INFO - epoch : 128
2020-10-15 10:43:15,110 - trainer - INFO - loss : -14.838554506952113
2020-10-15 10:43:15,110 - trainer - INFO - my_metric : 0.7801723287563131
2020-10-15 10:43:15,110 - trainer - INFO - my_metric2 : 0.9973193852588383
2020-10-15 10:43:15,110 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 10:43:15,110 - trainer - INFO - val_loss : 1.7428131580352784
2020-10-15 10:43:15,111 - trainer - INFO - val_my_metric : 0.7545999999999999
2020-10-15 10:43:15,111 - trainer - INFO - val_my_metric2 : 0.9964000000000001
2020-10-15 10:43:15,111 - trainer - INFO - test_loss : 1.113836145401001
2020-10-15 10:43:15,111 - trainer - INFO - test_my_metric : 0.8389999999999999
2020-10-15 10:43:15,111 - trainer - INFO - test_my_metric2: 0.9949999999999998
2020-10-15 10:44:06,817 - trainer - INFO - epoch : 129
2020-10-15 10:44:06,817 - trainer - INFO - loss : -15.12063752250238
2020-10-15 10:44:06,817 - trainer - INFO - my_metric : 0.7841229679608586
2020-10-15 10:44:06,817 - trainer - INFO - my_metric2 : 0.9976473721590909
2020-10-15 10:44:06,817 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 10:44:06,817 - trainer - INFO - val_loss : 1.766580057144165
2020-10-15 10:44:06,817 - trainer - INFO - val_my_metric : 0.7554000000000001
2020-10-15 10:44:06,817 - trainer - INFO - val_my_metric2 : 0.9970000000000001
2020-10-15 10:44:06,817 - trainer - INFO - test_loss : 1.1135542273521424
2020-10-15 10:44:06,817 - trainer - INFO - test_my_metric : 0.8415999999999999
2020-10-15 10:44:06,818 - trainer - INFO - test_my_metric2: 0.9959
2020-10-15 10:44:58,645 - trainer - INFO - epoch : 130
2020-10-15 10:44:58,646 - trainer - INFO - loss : -15.392644202167338
2020-10-15 10:44:58,646 - trainer - INFO - my_metric : 0.7864312065972222
2020-10-15 10:44:58,646 - trainer - INFO - my_metric2 : 0.9980912642045454
2020-10-15 10:44:58,646 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 10:44:58,646 - trainer - INFO - val_loss : 1.7575722455978393
2020-10-15 10:44:58,646 - trainer - INFO - val_my_metric : 0.7558
2020-10-15 10:44:58,646 - trainer - INFO - val_my_metric2 : 0.9968
2020-10-15 10:44:58,646 - trainer - INFO - test_loss : 1.1066377401351928
2020-10-15 10:44:58,646 - trainer - INFO - test_my_metric : 0.8430000000000002
2020-10-15 10:44:58,646 - trainer - INFO - test_my_metric2: 0.9953
2020-10-15 10:45:50,550 - trainer - INFO - epoch : 131
2020-10-15 10:45:50,550 - trainer - INFO - loss : -13.777333454652267
2020-10-15 10:45:50,551 - trainer - INFO - my_metric : 0.7207573784722222
2020-10-15 10:45:50,551 - trainer - INFO - my_metric2 : 0.9862492108585859
2020-10-15 10:45:50,551 - trainer - INFO - learning rate : [0.02]
2020-10-15 10:45:50,551 - trainer - INFO - val_loss : 2.576897716522217
2020-10-15 10:45:50,551 - trainer - INFO - val_my_metric : 0.6756
2020-10-15 10:45:50,551 - trainer - INFO - val_my_metric2 : 0.9752000000000001
2020-10-15 10:45:50,551 - trainer - INFO - test_loss : 2.015344202518463
2020-10-15 10:45:50,551 - trainer - INFO - test_my_metric : 0.7451000000000001
2020-10-15 10:45:50,551 - trainer - INFO - test_my_metric2: 0.9686
2020-10-15 10:46:42,298 - trainer - INFO - epoch : 132
2020-10-15 10:46:42,299 - trainer - INFO - loss : -13.477007871324366
2020-10-15 10:46:42,299 - trainer - INFO - my_metric : 0.7242863202335859
2020-10-15 10:46:42,299 - trainer - INFO - my_metric2 : 0.9879705255681818
2020-10-15 10:46:42,299 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 10:46:42,299 - trainer - INFO - val_loss : 2.181722545623779
2020-10-15 10:46:42,299 - trainer - INFO - val_my_metric : 0.7041999999999999
2020-10-15 10:46:42,299 - trainer - INFO - val_my_metric2 : 0.9872
2020-10-15 10:46:42,299 - trainer - INFO - test_loss : 1.6460330128669738
2020-10-15 10:46:42,299 - trainer - INFO - test_my_metric : 0.7733000000000001
2020-10-15 10:46:42,299 - trainer - INFO - test_my_metric2: 0.986
2020-10-15 10:47:33,980 - trainer - INFO - epoch : 133
2020-10-15 10:47:33,981 - trainer - INFO - loss : -13.61893719163808
2020-10-15 10:47:33,981 - trainer - INFO - my_metric : 0.7408360953282828
2020-10-15 10:47:33,981 - trainer - INFO - my_metric2 : 0.9906560724431818
2020-10-15 10:47:33,981 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 10:47:33,981 - trainer - INFO - val_loss : 2.166035461425781
2020-10-15 10:47:33,981 - trainer - INFO - val_my_metric : 0.7153999999999999
2020-10-15 10:47:33,981 - trainer - INFO - val_my_metric2 : 0.9882
2020-10-15 10:47:33,981 - trainer - INFO - test_loss : 1.556290590763092
2020-10-15 10:47:33,982 - trainer - INFO - test_my_metric : 0.7946
2020-10-15 10:47:33,982 - trainer - INFO - test_my_metric2: 0.9861000000000001
2020-10-15 10:48:25,332 - trainer - INFO - epoch : 134
2020-10-15 10:48:25,332 - trainer - INFO - loss : -13.769276204434307
2020-10-15 10:48:25,332 - trainer - INFO - my_metric : 0.7504044349747474
2020-10-15 10:48:25,332 - trainer - INFO - my_metric2 : 0.9932306463068182
2020-10-15 10:48:25,332 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 10:48:25,333 - trainer - INFO - val_loss : 1.9989370822906494
2020-10-15 10:48:25,333 - trainer - INFO - val_my_metric : 0.726
2020-10-15 10:48:25,333 - trainer - INFO - val_my_metric2 : 0.9898
2020-10-15 10:48:25,333 - trainer - INFO - test_loss : 1.3930357813835144
2020-10-15 10:48:25,333 - trainer - INFO - test_my_metric : 0.8075000000000001
2020-10-15 10:48:25,333 - trainer - INFO - test_my_metric2: 0.9899999999999999
2020-10-15 10:49:17,146 - trainer - INFO - epoch : 135
2020-10-15 10:49:17,147 - trainer - INFO - loss : -14.02891040390188
2020-10-15 10:49:17,147 - trainer - INFO - my_metric : 0.7615263967803031
2020-10-15 10:49:17,147 - trainer - INFO - my_metric2 : 0.994988952020202
2020-10-15 10:49:17,147 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 10:49:17,147 - trainer - INFO - val_loss : 1.9866557598114014
2020-10-15 10:49:17,147 - trainer - INFO - val_my_metric : 0.7332
2020-10-15 10:49:17,147 - trainer - INFO - val_my_metric2 : 0.9921999999999999
2020-10-15 10:49:17,147 - trainer - INFO - test_loss : 1.3875739336013795
2020-10-15 10:49:17,147 - trainer - INFO - test_my_metric : 0.8111
2020-10-15 10:49:17,147 - trainer - INFO - test_my_metric2: 0.9899000000000001
2020-10-15 10:50:08,533 - trainer - INFO - epoch : 136
2020-10-15 10:50:08,534 - trainer - INFO - loss : -14.286740322004665
2020-10-15 10:50:08,534 - trainer - INFO - my_metric : 0.7680442116477273
2020-10-15 10:50:08,534 - trainer - INFO - my_metric2 : 0.9956942471590909
2020-10-15 10:50:08,534 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 10:50:08,534 - trainer - INFO - val_loss : 1.8253413438796997
2020-10-15 10:50:08,534 - trainer - INFO - val_my_metric : 0.744
2020-10-15 10:50:08,535 - trainer - INFO - val_my_metric2 : 0.9934000000000001
2020-10-15 10:50:08,535 - trainer - INFO - test_loss : 1.195759403705597
2020-10-15 10:50:08,535 - trainer - INFO - test_my_metric : 0.8273999999999999
2020-10-15 10:50:08,535 - trainer - INFO - test_my_metric2: 0.9940999999999999
2020-10-15 10:50:59,606 - trainer - INFO - epoch : 137
2020-10-15 10:50:59,607 - trainer - INFO - loss : -14.578205141154202
2020-10-15 10:50:59,607 - trainer - INFO - my_metric : 0.7758098563762627
2020-10-15 10:50:59,607 - trainer - INFO - my_metric2 : 0.996826171875
2020-10-15 10:50:59,607 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 10:50:59,608 - trainer - INFO - val_loss : 1.7792859315872191
2020-10-15 10:50:59,608 - trainer - INFO - val_my_metric : 0.7518
2020-10-15 10:50:59,608 - trainer - INFO - val_my_metric2 : 0.9949999999999999
2020-10-15 10:50:59,608 - trainer - INFO - test_loss : 1.1642956614494324
2020-10-15 10:50:59,608 - trainer - INFO - test_my_metric : 0.833
2020-10-15 10:50:59,608 - trainer - INFO - test_my_metric2: 0.9950999999999999
2020-10-15 10:51:51,321 - trainer - INFO - epoch : 138
2020-10-15 10:51:51,321 - trainer - INFO - loss : -14.868685825304551
2020-10-15 10:51:51,321 - trainer - INFO - my_metric : 0.780389342645202
2020-10-15 10:51:51,321 - trainer - INFO - my_metric2 : 0.9976695667613636
2020-10-15 10:51:51,322 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 10:51:51,322 - trainer - INFO - val_loss : 1.7788955450057984
2020-10-15 10:51:51,322 - trainer - INFO - val_my_metric : 0.7540000000000001
2020-10-15 10:51:51,322 - trainer - INFO - val_my_metric2 : 0.9945999999999999
2020-10-15 10:51:51,322 - trainer - INFO - test_loss : 1.140706217288971
2020-10-15 10:51:51,322 - trainer - INFO - test_my_metric : 0.8353999999999999
2020-10-15 10:51:51,322 - trainer - INFO - test_my_metric2: 0.9949
2020-10-15 10:52:42,621 - trainer - INFO - epoch : 139
2020-10-15 10:52:42,621 - trainer - INFO - loss : -15.141585943373768
2020-10-15 10:52:42,621 - trainer - INFO - my_metric : 0.7834127406881314
2020-10-15 10:52:42,622 - trainer - INFO - my_metric2 : 0.9978471235795454
2020-10-15 10:52:42,622 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 10:52:42,622 - trainer - INFO - val_loss : 1.76551411151886
2020-10-15 10:52:42,622 - trainer - INFO - val_my_metric : 0.7538
2020-10-15 10:52:42,622 - trainer - INFO - val_my_metric2 : 0.9960000000000001
2020-10-15 10:52:42,622 - trainer - INFO - test_loss : 1.1275670647621154
2020-10-15 10:52:42,622 - trainer - INFO - test_my_metric : 0.8392
2020-10-15 10:52:42,622 - trainer - INFO - test_my_metric2: 0.9945999999999999
2020-10-15 10:53:34,591 - trainer - INFO - epoch : 140
2020-10-15 10:53:34,592 - trainer - INFO - loss : -15.411264273253353
2020-10-15 10:53:34,592 - trainer - INFO - my_metric : 0.7873066603535354
2020-10-15 10:53:34,592 - trainer - INFO - my_metric2 : 0.9981578480113636
2020-10-15 10:53:34,592 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 10:53:34,593 - trainer - INFO - val_loss : 1.7604850292205811
2020-10-15 10:53:34,593 - trainer - INFO - val_my_metric : 0.7574000000000001
2020-10-15 10:53:34,593 - trainer - INFO - val_my_metric2 : 0.9964000000000001
2020-10-15 10:53:34,593 - trainer - INFO - test_loss : 1.1122530221939086
2020-10-15 10:53:34,593 - trainer - INFO - test_my_metric : 0.8398
2020-10-15 10:53:34,593 - trainer - INFO - test_my_metric2: 0.9949999999999999
2020-10-15 10:53:35,220 - trainer - INFO - Saving current best: model_best.pth at: saved/models/cifar10_resnet34_cosine_asym_40/1015_084616/model_best.pth ...
2020-10-15 10:54:27,351 - trainer - INFO - epoch : 141
2020-10-15 10:54:27,352 - trainer - INFO - loss : -13.762200488285584
2020-10-15 10:54:27,352 - trainer - INFO - my_metric : 0.7200471511994949
2020-10-15 10:54:27,352 - trainer - INFO - my_metric2 : 0.9851123540088383
2020-10-15 10:54:27,352 - trainer - INFO - learning rate : [0.02]
2020-10-15 10:54:27,352 - trainer - INFO - val_loss : 2.4250460624694825
2020-10-15 10:54:27,352 - trainer - INFO - val_my_metric : 0.6758
2020-10-15 10:54:27,352 - trainer - INFO - val_my_metric2 : 0.9788
2020-10-15 10:54:27,352 - trainer - INFO - test_loss : 2.04660986661911
2020-10-15 10:54:27,352 - trainer - INFO - test_my_metric : 0.7365999999999999
2020-10-15 10:54:27,352 - trainer - INFO - test_my_metric2: 0.9793999999999998
2020-10-15 10:55:19,207 - trainer - INFO - epoch : 142
2020-10-15 10:55:19,208 - trainer - INFO - loss : -13.430753325874155
2020-10-15 10:55:19,208 - trainer - INFO - my_metric : 0.7226809106691919
2020-10-15 10:55:19,208 - trainer - INFO - my_metric2 : 0.98779296875
2020-10-15 10:55:19,208 - trainer - INFO - learning rate : [0.01953503690480396]
2020-10-15 10:55:19,208 - trainer - INFO - val_loss : 2.2143885135650634
2020-10-15 10:55:19,208 - trainer - INFO - val_my_metric : 0.703
2020-10-15 10:55:19,208 - trainer - INFO - val_my_metric2 : 0.9856
2020-10-15 10:55:19,208 - trainer - INFO - test_loss : 1.678022527694702
2020-10-15 10:55:19,208 - trainer - INFO - test_my_metric : 0.768
2020-10-15 10:55:19,208 - trainer - INFO - test_my_metric2: 0.9812
2020-10-15 10:56:10,911 - trainer - INFO - epoch : 143
2020-10-15 10:56:10,912 - trainer - INFO - loss : -13.602829608050259
2020-10-15 10:56:10,912 - trainer - INFO - my_metric : 0.7421702375315656
2020-10-15 10:56:10,912 - trainer - INFO - my_metric2 : 0.990966796875
2020-10-15 10:56:10,912 - trainer - INFO - learning rate : [0.018185661446562]
2020-10-15 10:56:10,912 - trainer - INFO - val_loss : 2.1507800340652468
2020-10-15 10:56:10,913 - trainer - INFO - val_my_metric : 0.7162
2020-10-15 10:56:10,913 - trainer - INFO - val_my_metric2 : 0.9914
2020-10-15 10:56:10,913 - trainer - INFO - test_loss : 1.4886463284492493
2020-10-15 10:56:10,913 - trainer - INFO - test_my_metric : 0.8019000000000001
2020-10-15 10:56:10,913 - trainer - INFO - test_my_metric2: 0.9901
2020-10-15 10:57:02,212 - trainer - INFO - epoch : 144
2020-10-15 10:57:02,212 - trainer - INFO - loss : -13.809318526224656
2020-10-15 10:57:02,212 - trainer - INFO - my_metric : 0.7532848011363636
2020-10-15 10:57:02,212 - trainer - INFO - my_metric2 : 0.9933416193181818
2020-10-15 10:57:02,213 - trainer - INFO - learning rate : [0.016083959896778494]
2020-10-15 10:57:02,213 - trainer - INFO - val_loss : 1.9323777914047242
2020-10-15 10:57:02,213 - trainer - INFO - val_my_metric : 0.7322
2020-10-15 10:57:02,213 - trainer - INFO - val_my_metric2 : 0.9892
2020-10-15 10:57:02,213 - trainer - INFO - test_loss : 1.2930457711219787
2020-10-15 10:57:02,213 - trainer - INFO - test_my_metric : 0.8099999999999999
2020-10-15 10:57:02,213 - trainer - INFO - test_my_metric2: 0.9904999999999999
2020-10-15 10:57:53,712 - trainer - INFO - epoch : 145
2020-10-15 10:57:53,712 - trainer - INFO - loss : -14.053029759363694
2020-10-15 10:57:53,712 - trainer - INFO - my_metric : 0.7625029592803031
2020-10-15 10:57:53,712 - trainer - INFO - my_metric2 : 0.9952552872474747
2020-10-15 10:57:53,712 - trainer - INFO - learning rate : [0.013435661446562]
2020-10-15 10:57:53,712 - trainer - INFO - val_loss : 1.943193221092224
2020-10-15 10:57:53,712 - trainer - INFO - val_my_metric : 0.7367999999999999
2020-10-15 10:57:53,712 - trainer - INFO - val_my_metric2 : 0.9922000000000001
2020-10-15 10:57:53,712 - trainer - INFO - test_loss : 1.2904562115669251
2020-10-15 10:57:53,712 - trainer - INFO - test_my_metric : 0.8199
2020-10-15 10:57:53,712 - trainer - INFO - test_my_metric2: 0.9924
2020-10-15 10:58:45,006 - trainer - INFO - epoch : 146
2020-10-15 10:58:45,007 - trainer - INFO - loss : -14.296240709044717
2020-10-15 10:58:45,007 - trainer - INFO - my_metric : 0.7692920415088383
2020-10-15 10:58:45,007 - trainer - INFO - my_metric2 : 0.9954723011363636
2020-10-15 10:58:45,007 - trainer - INFO - learning rate : [0.010499999999999999]
2020-10-15 10:58:45,007 - trainer - INFO - val_loss : 1.775312328338623
2020-10-15 10:58:45,007 - trainer - INFO - val_my_metric : 0.7484
2020-10-15 10:58:45,007 - trainer - INFO - val_my_metric2 : 0.9936
2020-10-15 10:58:45,007 - trainer - INFO - test_loss : 1.0838894844055176
2020-10-15 10:58:45,007 - trainer - INFO - test_my_metric : 0.8352999999999999
2020-10-15 10:58:45,008 - trainer - INFO - test_my_metric2: 0.9940000000000001
2020-10-15 10:59:36,773 - trainer - INFO - epoch : 147
2020-10-15 10:59:36,773 - trainer - INFO - loss : -14.59655018828132
2020-10-15 10:59:36,773 - trainer - INFO - my_metric : 0.7756964172979799
2020-10-15 10:59:36,773 - trainer - INFO - my_metric2 : 0.9965918955176768
2020-10-15 10:59:36,773 - trainer - INFO - learning rate : [0.007564338553438]
2020-10-15 10:59:36,773 - trainer - INFO - val_loss : 1.8364390134811401
2020-10-15 10:59:36,773 - trainer - INFO - val_my_metric : 0.7474000000000001
2020-10-15 10:59:36,773 - trainer - INFO - val_my_metric2 : 0.9942
2020-10-15 10:59:36,774 - trainer - INFO - test_loss : 1.2150317311286927
2020-10-15 10:59:36,774 - trainer - INFO - test_my_metric : 0.8318
2020-10-15 10:59:36,774 - trainer - INFO - test_my_metric2: 0.9942
2020-10-15 11:00:28,622 - trainer - INFO - epoch : 148
2020-10-15 11:00:28,622 - trainer - INFO - loss : -14.875312041152608
2020-10-15 11:00:28,622 - trainer - INFO - my_metric : 0.7806852706755051
2020-10-15 11:00:28,622 - trainer - INFO - my_metric2 : 0.9971368963068182
2020-10-15 11:00:28,622 - trainer - INFO - learning rate : [0.004916040103221506]
2020-10-15 11:00:28,623 - trainer - INFO - val_loss : 1.77607102394104
2020-10-15 11:00:28,623 - trainer - INFO - val_my_metric : 0.7525999999999999
2020-10-15 11:00:28,623 - trainer - INFO - val_my_metric2 : 0.9954000000000001
2020-10-15 11:00:28,623 - trainer - INFO - test_loss : 1.1858563780784608
2020-10-15 11:00:28,623 - trainer - INFO - test_my_metric : 0.8328
2020-10-15 11:00:28,623 - trainer - INFO - test_my_metric2: 0.9949
2020-10-15 11:01:20,185 - trainer - INFO - epoch : 149
2020-10-15 11:01:20,185 - trainer - INFO - loss : -15.161081942644985
2020-10-15 11:01:20,185 - trainer - INFO - my_metric : 0.784206814236111
2020-10-15 11:01:20,186 - trainer - INFO - my_metric2 : 0.9977139559659091
2020-10-15 11:01:20,186 - trainer - INFO - learning rate : [0.0028143385534380003]
2020-10-15 11:01:20,186 - trainer - INFO - val_loss : 1.7621858835220336
2020-10-15 11:01:20,186 - trainer - INFO - val_my_metric : 0.7546
2020-10-15 11:01:20,186 - trainer - INFO - val_my_metric2 : 0.9947999999999999
2020-10-15 11:01:20,186 - trainer - INFO - test_loss : 1.1344384908676148
2020-10-15 11:01:20,186 - trainer - INFO - test_my_metric : 0.8392
2020-10-15 11:01:20,186 - trainer - INFO - test_my_metric2: 0.9953
2020-10-15 11:02:12,412 - trainer - INFO - epoch : 150
2020-10-15 11:02:12,412 - trainer - INFO - loss : -15.424039740454067
2020-10-15 11:02:12,412 - trainer - INFO - my_metric : 0.7865446456755051
2020-10-15 11:02:12,412 - trainer - INFO - my_metric2 : 0.9979359019886364
2020-10-15 11:02:12,412 - trainer - INFO - learning rate : [0.0014649630951960415]
2020-10-15 11:02:12,412 - trainer - INFO - val_loss : 1.7636088848114013
2020-10-15 11:02:12,412 - trainer - INFO - val_my_metric : 0.7554000000000001
2020-10-15 11:02:12,412 - trainer - INFO - val_my_metric2 : 0.9960000000000001
2020-10-15 11:02:12,412 - trainer - INFO - test_loss : 1.0888733506202697
2020-10-15 11:02:12,412 - trainer - INFO - test_my_metric : 0.843
2020-10-15 11:02:12,412 - trainer - INFO - test_my_metric2: 0.9959999999999999

@shengliu66
Copy link
Owner

Thanks for your attention to our work. I did not test the code of ELR yet, I will do it today.

@shengliu66
Copy link
Owner

shengliu66 commented Oct 17, 2020

Hi, the hyperparameter settings for asymmetric noise on CIFAR-10 will be different from the config file. Please try alpha = 0.9 and lambda = 1. You should be able to reproduce the results. And you can also try multi step learning rate scheduler.
"lr_scheduler": {
"type": "MultiStepLR",
"args": {
"milestones": [40,80],
"gamma": 0.01
}
},

it will result in similar results as well. Please let me know if you have further questions.

@qinwei-hfut
Copy link
Author

Hi, thanks for your reply. With lambda = 1 and the above MultiStepLR,ELR(not ELR+ or ELR*) achieves 90.08%(average over 3 runs) when the asym noisy rate = 0.4. This performance is much better. Thank you for this elegant work. And I don't know what the alpha you mentioned means? Does the alpha mean mixup alpha for ELR+?

Besides, is there better hyper-parameters to help the model to achieve better performance when asym noisy rate = 0.4? Here are the hyper-parameters I used:
OrderedDict([('name', 'cifar10_resnet34_cosine'), ('n_gpu', 1), ('seed', 123), ('arch', OrderedDict([('type', 'resnet34'), ('args', OrderedDict([('num_classes', 10)]))])), ('num_classes', 10), ('data_loader', OrderedDict([('type', 'CIFAR10DataLoader'), ('args', OrderedDict([('data_dir', '/BS/sun_project_multimodal/nobackup/weiqin/project_code/cifar/data'), ('batch_size', 128), ('shuffle', True), ('num_batches', 0), ('validation_split', 0), ('num_workers', 8), ('pin_memory', True)]))])), ('optimizer', OrderedDict([('type', 'SGD'), ('args', OrderedDict([('lr', 0.02), ('momentum', 0.9), ('weight_decay', 0.001)]))])), ('train_loss', OrderedDict([('type', 'elr_loss'), ('args', OrderedDict([('beta', 0.7), ('lambda', 1)]))])), ('val_loss', 'cross_entropy'), ('metrics', ['my_metric', 'my_metric2']), ('lr_scheduler', OrderedDict([('type', 'MultiStepLR'), ('args', OrderedDict([('milestones', [40, 80]), ('gamma', 0.01)]))])), ('trainer', OrderedDict([('epochs', 150), ('warmup', 0), ('save_dir', 'saved/'), ('save_period', 1), ('verbosity', 2), ('label_dir', 'saved/'), ('monitor', 'max val_my_metric'), ('early_stop', 2000), ('tensorboard', False), ('mlflow', True), ('_percent', 'Percentage of noise'), ('percent', 0.4), ('_begin', 'When to begin updating labels'), ('begin', 0), ('_asym', 'symmetric noise if false'), ('asym', True)]))])

@shengliu66
Copy link
Owner

shengliu66 commented Oct 18, 2020

Sorry for the confusions, I mean beta = 0.9, but the method is generally insensitive to beta, so if beta = 0.7 works then it is fine. There are multiple things you could potentially tune to make ELR works better, such as adding mixup, tying different betta and lambda, etc. but the aim of the ELR method is showing its simpleness and effectiveness on label noise, rather than showing its state of the art performance, so we did not tune it exhaustively. For better results please refer to ELR+, and for ELR+ we also did not try to combine heavily with other methods, in the camera-ready version, we will show a simple example of combining other simple semi-supervised technique, resulting in better results (improve 1~4%) than DivideMix.

@qinwei-hfut
Copy link
Author

Got it. Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants