2020-08-08 19:58:36,599 ----------------------------------------------------------------------------------------------------
2020-08-08 19:58:36,599 Model: "SequenceTagger(
  (embeddings): StackedEmbeddings(
    (list_embedding_0): WordEmbeddings('pubmed_pmc_wiki_sg_1M.gensim')
    (list_embedding_1): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
    (list_embedding_2): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
  )
  (word_dropout): WordDropout(p=0.05)
  (locked_dropout): LockedDropout(p=0.5)
  (embedding2nn): Linear(in_features=4296, out_features=4296, bias=True)
  (rnn): LSTM(4296, 256, batch_first=True, bidirectional=True)
  (linear): Linear(in_features=512, out_features=8, bias=True)
  (beta): 1.0
  (weights): None
  (weight_tensor) None
)"
2020-08-08 19:58:36,599 ----------------------------------------------------------------------------------------------------
2020-08-08 19:58:36,599 Corpus: "Corpus: 3593 train + 1781 dev + 623 test sentences
Corpus: 1261 train + 427 dev + 516 test sentences
Corpus: 8000 train + 1237 dev + 3967 test sentences
Corpus: 19657 train + 1975 dev + 5895 test sentences
Corpus: 10654 train + 1806 dev + 5320 test sentences
Corpus: 570 train + 85 dev + 290 test sentences
Corpus: 1485 train + 204 dev + 767 test sentences
Corpus: 3879 train + 602 dev + 1891 test sentences
Corpus: 4151 train + 594 dev + 1438 test sentences"
2020-08-08 19:58:36,599 ----------------------------------------------------------------------------------------------------
2020-08-08 19:58:36,599 Parameters:
2020-08-08 19:58:36,599  - learning_rate: "0.1"
2020-08-08 19:58:36,599  - mini_batch_size: "32"
2020-08-08 19:58:36,599  - patience: "3"
2020-08-08 19:58:36,599  - anneal_factor: "0.5"
2020-08-08 19:58:36,599  - max_epochs: "200"
2020-08-08 19:58:36,600  - shuffle: "True"
2020-08-08 19:58:36,600  - train_with_dev: "False"
2020-08-08 19:58:36,600  - batch_growth_annealing: "False"
2020-08-08 19:58:36,600 ----------------------------------------------------------------------------------------------------
2020-08-08 19:58:36,600 Model training base path: "new_models/huner-species"
2020-08-08 19:58:36,600 ----------------------------------------------------------------------------------------------------
2020-08-08 19:58:36,600 Device: cuda:0
2020-08-08 19:58:36,600 ----------------------------------------------------------------------------------------------------
2020-08-08 19:58:36,600 Embeddings storage mode: cpu
2020-08-08 19:58:36,625 ----------------------------------------------------------------------------------------------------
2020-08-08 20:00:18,987 epoch 1 - iter 231/2312 - loss 1.77056406 - samples/sec: 72.24
2020-08-08 20:01:59,451 epoch 1 - iter 462/2312 - loss 1.24213477 - samples/sec: 74.96
2020-08-08 20:03:39,622 epoch 1 - iter 693/2312 - loss 1.02082669 - samples/sec: 74.63
2020-08-08 20:05:27,463 epoch 1 - iter 924/2312 - loss 0.87804340 - samples/sec: 69.10
2020-08-08 20:07:02,975 epoch 1 - iter 1155/2312 - loss 0.80019554 - samples/sec: 78.01
2020-08-08 20:08:39,774 epoch 1 - iter 1386/2312 - loss 0.74964783 - samples/sec: 76.97
2020-08-08 20:10:24,575 epoch 1 - iter 1617/2312 - loss 0.70773053 - samples/sec: 71.08
2020-08-08 20:12:14,275 epoch 1 - iter 1848/2312 - loss 0.67821470 - samples/sec: 67.79
2020-08-08 20:13:55,683 epoch 1 - iter 2079/2312 - loss 0.65013035 - samples/sec: 73.56
2020-08-08 20:15:36,917 epoch 1 - iter 2310/2312 - loss 0.62601950 - samples/sec: 73.70
2020-08-08 20:15:38,418 ----------------------------------------------------------------------------------------------------
2020-08-08 20:15:38,418 EPOCH 1 done: loss 0.6273 - lr 0.1000000
2020-08-08 20:17:09,382 DEV : loss 0.31346651911735535 - score 0.8118
2020-08-08 20:17:10,721 BAD EPOCHS (no improvement): 0
2020-08-08 20:17:36,297 ----------------------------------------------------------------------------------------------------
2020-08-08 20:18:33,690 epoch 2 - iter 231/2312 - loss 0.41817889 - samples/sec: 128.88
2020-08-08 20:19:28,003 epoch 2 - iter 462/2312 - loss 0.40454933 - samples/sec: 139.36
2020-08-08 20:20:20,804 epoch 2 - iter 693/2312 - loss 0.39489287 - samples/sec: 142.18
2020-08-08 20:21:16,402 epoch 2 - iter 924/2312 - loss 0.38197588 - samples/sec: 135.12
2020-08-08 20:22:10,467 epoch 2 - iter 1155/2312 - loss 0.38553034 - samples/sec: 138.41
2020-08-08 20:23:17,981 epoch 2 - iter 1386/2312 - loss 0.37814862 - samples/sec: 110.82
2020-08-08 20:24:11,852 epoch 2 - iter 1617/2312 - loss 0.37782217 - samples/sec: 139.12
2020-08-08 20:25:05,552 epoch 2 - iter 1848/2312 - loss 0.37483463 - samples/sec: 139.44
2020-08-08 20:25:58,525 epoch 2 - iter 2079/2312 - loss 0.37424999 - samples/sec: 141.38
2020-08-08 20:26:51,343 epoch 2 - iter 2310/2312 - loss 0.37438727 - samples/sec: 142.02
2020-08-08 20:26:52,324 ----------------------------------------------------------------------------------------------------
2020-08-08 20:26:52,325 EPOCH 2 done: loss 0.3743 - lr 0.1000000
2020-08-08 20:27:26,869 DEV : loss 0.2811776101589203 - score 0.8199
2020-08-08 20:27:28,214 BAD EPOCHS (no improvement): 0
2020-08-08 20:27:51,897 ----------------------------------------------------------------------------------------------------
2020-08-08 20:28:45,717 epoch 3 - iter 231/2312 - loss 0.33332017 - samples/sec: 137.44
2020-08-08 20:29:41,127 epoch 3 - iter 462/2312 - loss 0.33562225 - samples/sec: 135.46
2020-08-08 20:30:36,657 epoch 3 - iter 693/2312 - loss 0.33127754 - samples/sec: 135.74
2020-08-08 20:31:31,539 epoch 3 - iter 924/2312 - loss 0.33799270 - samples/sec: 136.69
2020-08-08 20:32:24,628 epoch 3 - iter 1155/2312 - loss 0.33678034 - samples/sec: 141.65
2020-08-08 20:33:19,370 epoch 3 - iter 1386/2312 - loss 0.34014774 - samples/sec: 136.92
2020-08-08 20:34:15,392 epoch 3 - iter 1617/2312 - loss 0.33812865 - samples/sec: 133.60
2020-08-08 20:35:08,648 epoch 3 - iter 1848/2312 - loss 0.33295846 - samples/sec: 140.94
2020-08-08 20:36:04,003 epoch 3 - iter 2079/2312 - loss 0.33079652 - samples/sec: 135.28
2020-08-08 20:36:59,327 epoch 3 - iter 2310/2312 - loss 0.33226027 - samples/sec: 135.41
2020-08-08 20:37:00,302 ----------------------------------------------------------------------------------------------------
2020-08-08 20:37:00,302 EPOCH 3 done: loss 0.3322 - lr 0.1000000
2020-08-08 20:37:34,953 DEV : loss 0.268485963344574 - score 0.8347
2020-08-08 20:37:36,296 BAD EPOCHS (no improvement): 0
2020-08-08 20:37:57,862 ----------------------------------------------------------------------------------------------------
2020-08-08 20:38:51,906 epoch 4 - iter 231/2312 - loss 0.28657199 - samples/sec: 136.87
2020-08-08 20:39:45,957 epoch 4 - iter 462/2312 - loss 0.29845203 - samples/sec: 138.70
2020-08-08 20:40:46,356 epoch 4 - iter 693/2312 - loss 0.31014578 - samples/sec: 123.94
2020-08-08 20:41:39,172 epoch 4 - iter 924/2312 - loss 0.30722053 - samples/sec: 142.17
2020-08-08 20:42:39,039 epoch 4 - iter 1155/2312 - loss 0.30589501 - samples/sec: 125.19
2020-08-08 20:43:44,944 epoch 4 - iter 1386/2312 - loss 0.30327432 - samples/sec: 113.60
2020-08-08 20:44:37,959 epoch 4 - iter 1617/2312 - loss 0.30950687 - samples/sec: 141.35
2020-08-08 20:45:32,859 epoch 4 - iter 1848/2312 - loss 0.30815488 - samples/sec: 136.83
2020-08-08 20:46:25,672 epoch 4 - iter 2079/2312 - loss 0.30813374 - samples/sec: 141.96
2020-08-08 20:47:19,548 epoch 4 - iter 2310/2312 - loss 0.30914268 - samples/sec: 139.32
2020-08-08 20:47:20,562 ----------------------------------------------------------------------------------------------------
2020-08-08 20:47:20,563 EPOCH 4 done: loss 0.3090 - lr 0.1000000
2020-08-08 20:47:54,121 DEV : loss 0.2476532757282257 - score 0.8277
2020-08-08 20:47:55,424 BAD EPOCHS (no improvement): 1
2020-08-08 20:47:55,456 ----------------------------------------------------------------------------------------------------
2020-08-08 20:48:47,299 epoch 5 - iter 231/2312 - loss 0.31722266 - samples/sec: 142.68
2020-08-08 20:49:40,037 epoch 5 - iter 462/2312 - loss 0.30752263 - samples/sec: 142.52
2020-08-08 20:50:34,093 epoch 5 - iter 693/2312 - loss 0.29525785 - samples/sec: 138.64
2020-08-08 20:51:31,419 epoch 5 - iter 924/2312 - loss 0.29550178 - samples/sec: 130.77
2020-08-08 20:52:25,607 epoch 5 - iter 1155/2312 - loss 0.29218794 - samples/sec: 138.18
2020-08-08 20:53:20,674 epoch 5 - iter 1386/2312 - loss 0.29053073 - samples/sec: 136.20
2020-08-08 20:54:12,841 epoch 5 - iter 1617/2312 - loss 0.29100873 - samples/sec: 143.84
2020-08-08 20:55:07,358 epoch 5 - iter 1848/2312 - loss 0.29298916 - samples/sec: 137.40
2020-08-08 20:56:02,357 epoch 5 - iter 2079/2312 - loss 0.29206503 - samples/sec: 136.37
2020-08-08 20:57:08,924 epoch 5 - iter 2310/2312 - loss 0.29094997 - samples/sec: 112.54
2020-08-08 20:57:10,045 ----------------------------------------------------------------------------------------------------
2020-08-08 20:57:10,046 EPOCH 5 done: loss 0.2910 - lr 0.1000000
2020-08-08 20:57:44,797 DEV : loss 0.26251962780952454 - score 0.844
2020-08-08 20:57:46,150 BAD EPOCHS (no improvement): 0
2020-08-08 20:58:02,662 ----------------------------------------------------------------------------------------------------
2020-08-08 20:58:57,351 epoch 6 - iter 231/2312 - loss 0.28882857 - samples/sec: 135.26
2020-08-08 20:59:51,394 epoch 6 - iter 462/2312 - loss 0.29838241 - samples/sec: 138.83
2020-08-08 21:00:45,800 epoch 6 - iter 693/2312 - loss 0.29371932 - samples/sec: 137.99
2020-08-08 21:01:40,380 epoch 6 - iter 924/2312 - loss 0.28547962 - samples/sec: 139.57
2020-08-08 21:02:36,659 epoch 6 - iter 1155/2312 - loss 0.28293886 - samples/sec: 134.33
2020-08-08 21:03:30,626 epoch 6 - iter 1386/2312 - loss 0.28341458 - samples/sec: 139.55
2020-08-08 21:04:27,828 epoch 6 - iter 1617/2312 - loss 0.28383932 - samples/sec: 131.00
2020-08-08 21:05:23,455 epoch 6 - iter 1848/2312 - loss 0.28126437 - samples/sec: 134.80
2020-08-08 21:06:17,749 epoch 6 - iter 2079/2312 - loss 0.27913099 - samples/sec: 138.68
2020-08-08 21:07:11,319 epoch 6 - iter 2310/2312 - loss 0.27980125 - samples/sec: 140.26
2020-08-08 21:07:12,385 ----------------------------------------------------------------------------------------------------
2020-08-08 21:07:12,385 EPOCH 6 done: loss 0.2798 - lr 0.1000000
2020-08-08 21:07:47,343 DEV : loss 0.24595703184604645 - score 0.8344
2020-08-08 21:07:48,687 BAD EPOCHS (no improvement): 1
2020-08-08 21:07:48,737 ----------------------------------------------------------------------------------------------------
2020-08-08 21:08:43,616 epoch 7 - iter 231/2312 - loss 0.25193040 - samples/sec: 134.79
2020-08-08 21:09:38,193 epoch 7 - iter 462/2312 - loss 0.26328864 - samples/sec: 137.35
2020-08-08 21:10:36,233 epoch 7 - iter 693/2312 - loss 0.26003461 - samples/sec: 129.22
2020-08-08 21:11:33,452 epoch 7 - iter 924/2312 - loss 0.26899456 - samples/sec: 130.98
2020-08-08 21:12:27,966 epoch 7 - iter 1155/2312 - loss 0.26689145 - samples/sec: 137.86
2020-08-08 21:13:21,417 epoch 7 - iter 1386/2312 - loss 0.26960354 - samples/sec: 140.55
2020-08-08 21:14:15,529 epoch 7 - iter 1617/2312 - loss 0.27013898 - samples/sec: 138.94
2020-08-08 21:15:08,995 epoch 7 - iter 1848/2312 - loss 0.27078225 - samples/sec: 141.49
2020-08-08 21:16:02,309 epoch 7 - iter 2079/2312 - loss 0.26965500 - samples/sec: 140.85
2020-08-08 21:16:56,683 epoch 7 - iter 2310/2312 - loss 0.26947571 - samples/sec: 138.50
2020-08-08 21:16:57,840 ----------------------------------------------------------------------------------------------------
2020-08-08 21:16:57,840 EPOCH 7 done: loss 0.2694 - lr 0.1000000
2020-08-08 21:17:32,149 DEV : loss 0.24109643697738647 - score 0.8355
2020-08-08 21:17:33,475 BAD EPOCHS (no improvement): 2
2020-08-08 21:17:33,496 ----------------------------------------------------------------------------------------------------
2020-08-08 21:18:25,958 epoch 8 - iter 231/2312 - loss 0.26796770 - samples/sec: 140.99
2020-08-08 21:19:18,483 epoch 8 - iter 462/2312 - loss 0.26157584 - samples/sec: 142.83
2020-08-08 21:20:19,163 epoch 8 - iter 693/2312 - loss 0.26535799 - samples/sec: 124.13
2020-08-08 21:21:15,076 epoch 8 - iter 924/2312 - loss 0.26337759 - samples/sec: 134.05
2020-08-08 21:22:11,151 epoch 8 - iter 1155/2312 - loss 0.25798528 - samples/sec: 133.60
2020-08-08 21:23:05,713 epoch 8 - iter 1386/2312 - loss 0.25770050 - samples/sec: 137.58
2020-08-08 21:23:59,918 epoch 8 - iter 1617/2312 - loss 0.25819659 - samples/sec: 138.25
2020-08-08 21:24:55,420 epoch 8 - iter 1848/2312 - loss 0.25907785 - samples/sec: 134.89
2020-08-08 21:25:49,534 epoch 8 - iter 2079/2312 - loss 0.26050206 - samples/sec: 138.39
2020-08-08 21:26:41,710 epoch 8 - iter 2310/2312 - loss 0.26109364 - samples/sec: 143.22
2020-08-08 21:26:42,822 ----------------------------------------------------------------------------------------------------
2020-08-08 21:26:42,822 EPOCH 8 done: loss 0.2610 - lr 0.1000000
2020-08-08 21:27:29,182 DEV : loss 0.23916523158550262 - score 0.8354
2020-08-08 21:27:30,531 BAD EPOCHS (no improvement): 3
2020-08-08 21:27:30,537 ----------------------------------------------------------------------------------------------------
2020-08-08 21:28:26,407 epoch 9 - iter 231/2312 - loss 0.25723356 - samples/sec: 132.40
2020-08-08 21:29:21,396 epoch 9 - iter 462/2312 - loss 0.25463342 - samples/sec: 136.09
2020-08-08 21:30:15,611 epoch 9 - iter 693/2312 - loss 0.25437054 - samples/sec: 139.04
2020-08-08 21:31:07,489 epoch 9 - iter 924/2312 - loss 0.25055795 - samples/sec: 144.63
2020-08-08 21:32:04,963 epoch 9 - iter 1155/2312 - loss 0.25229759 - samples/sec: 130.21
2020-08-08 21:33:06,934 epoch 9 - iter 1386/2312 - loss 0.25015024 - samples/sec: 120.85
2020-08-08 21:34:07,297 epoch 9 - iter 1617/2312 - loss 0.24894300 - samples/sec: 124.25
2020-08-08 21:35:01,381 epoch 9 - iter 1848/2312 - loss 0.25038760 - samples/sec: 138.72
2020-08-08 21:35:56,878 epoch 9 - iter 2079/2312 - loss 0.25112127 - samples/sec: 135.17
2020-08-08 21:36:57,724 epoch 9 - iter 2310/2312 - loss 0.25243080 - samples/sec: 122.93
2020-08-08 21:36:58,690 ----------------------------------------------------------------------------------------------------
2020-08-08 21:36:58,690 EPOCH 9 done: loss 0.2523 - lr 0.1000000
2020-08-08 21:37:33,173 DEV : loss 0.2400355339050293 - score 0.8331
2020-08-08 21:37:34,518 BAD EPOCHS (no improvement): 4
2020-08-08 21:37:34,560 ----------------------------------------------------------------------------------------------------
2020-08-08 21:38:29,640 epoch 10 - iter 231/2312 - loss 0.22923621 - samples/sec: 134.29
2020-08-08 21:39:22,848 epoch 10 - iter 462/2312 - loss 0.23005162 - samples/sec: 140.67
2020-08-08 21:40:17,703 epoch 10 - iter 693/2312 - loss 0.23493122 - samples/sec: 136.61
2020-08-08 21:41:13,753 epoch 10 - iter 924/2312 - loss 0.23942572 - samples/sec: 133.61
2020-08-08 21:42:08,245 epoch 10 - iter 1155/2312 - loss 0.23723944 - samples/sec: 137.29
2020-08-08 21:43:02,107 epoch 10 - iter 1386/2312 - loss 0.23589574 - samples/sec: 139.00
2020-08-08 21:43:55,916 epoch 10 - iter 1617/2312 - loss 0.23263637 - samples/sec: 139.39
2020-08-08 21:44:51,257 epoch 10 - iter 1848/2312 - loss 0.23341864 - samples/sec: 135.37
2020-08-08 21:45:48,025 epoch 10 - iter 2079/2312 - loss 0.23488089 - samples/sec: 131.94
2020-08-08 21:46:42,103 epoch 10 - iter 2310/2312 - loss 0.23480094 - samples/sec: 138.21
2020-08-08 21:46:43,015 ----------------------------------------------------------------------------------------------------
2020-08-08 21:46:43,016 EPOCH 10 done: loss 0.2348 - lr 0.0500000
2020-08-08 21:47:17,685 DEV : loss 0.22969140112400055 - score 0.8402
2020-08-08 21:47:19,028 BAD EPOCHS (no improvement): 1
2020-08-08 21:47:19,032 ----------------------------------------------------------------------------------------------------
2020-08-08 21:48:10,714 epoch 11 - iter 231/2312 - loss 0.22423632 - samples/sec: 143.13
2020-08-08 21:49:04,805 epoch 11 - iter 462/2312 - loss 0.22240792 - samples/sec: 138.35
2020-08-08 21:49:58,803 epoch 11 - iter 693/2312 - loss 0.21775836 - samples/sec: 138.63
2020-08-08 21:50:52,605 epoch 11 - iter 924/2312 - loss 0.21799652 - samples/sec: 139.19
2020-08-08 21:51:49,433 epoch 11 - iter 1155/2312 - loss 0.21953956 - samples/sec: 131.96
2020-08-08 21:52:44,498 epoch 11 - iter 1386/2312 - loss 0.22481494 - samples/sec: 135.85
2020-08-08 21:53:38,045 epoch 11 - iter 1617/2312 - loss 0.22625828 - samples/sec: 139.98
2020-08-08 21:54:34,479 epoch 11 - iter 1848/2312 - loss 0.22580827 - samples/sec: 132.78
2020-08-08 21:55:28,542 epoch 11 - iter 2079/2312 - loss 0.22600193 - samples/sec: 139.24
2020-08-08 21:56:23,888 epoch 11 - iter 2310/2312 - loss 0.22594215 - samples/sec: 135.32
2020-08-08 21:56:25,310 ----------------------------------------------------------------------------------------------------
2020-08-08 21:56:25,310 EPOCH 11 done: loss 0.2259 - lr 0.0500000
2020-08-08 21:57:04,041 DEV : loss 0.24086809158325195 - score 0.8332
2020-08-08 21:57:05,935 BAD EPOCHS (no improvement): 2
2020-08-08 21:57:05,943 ----------------------------------------------------------------------------------------------------
2020-08-08 21:58:05,539 epoch 12 - iter 231/2312 - loss 0.23714734 - samples/sec: 124.11
2020-08-08 21:59:05,901 epoch 12 - iter 462/2312 - loss 0.22847908 - samples/sec: 123.97
2020-08-08 22:00:23,752 epoch 12 - iter 693/2312 - loss 0.22796078 - samples/sec: 95.79
2020-08-08 22:01:18,515 epoch 12 - iter 924/2312 - loss 0.22871575 - samples/sec: 138.66
2020-08-08 22:02:17,647 epoch 12 - iter 1155/2312 - loss 0.22781335 - samples/sec: 127.48
2020-08-08 22:03:14,400 epoch 12 - iter 1386/2312 - loss 0.22934295 - samples/sec: 132.40
2020-08-08 22:04:11,824 epoch 12 - iter 1617/2312 - loss 0.22853774 - samples/sec: 130.82
2020-08-08 22:05:12,617 epoch 12 - iter 1848/2312 - loss 0.22537816 - samples/sec: 123.41
2020-08-08 22:06:10,501 epoch 12 - iter 2079/2312 - loss 0.22597442 - samples/sec: 129.82
2020-08-08 22:07:08,630 epoch 12 - iter 2310/2312 - loss 0.22551322 - samples/sec: 128.80
2020-08-08 22:07:09,783 ----------------------------------------------------------------------------------------------------
2020-08-08 22:07:09,783 EPOCH 12 done: loss 0.2255 - lr 0.0500000
2020-08-08 22:07:51,258 DEV : loss 0.24418777227401733 - score 0.8359
2020-08-08 22:07:53,119 BAD EPOCHS (no improvement): 3
2020-08-08 22:07:53,124 ----------------------------------------------------------------------------------------------------
2020-08-08 22:08:51,805 epoch 13 - iter 231/2312 - loss 0.20046043 - samples/sec: 126.04
2020-08-08 22:09:51,484 epoch 13 - iter 462/2312 - loss 0.20056463 - samples/sec: 125.53
2020-08-08 22:10:50,481 epoch 13 - iter 693/2312 - loss 0.19856465 - samples/sec: 127.15
2020-08-08 22:11:51,118 epoch 13 - iter 924/2312 - loss 0.20251100 - samples/sec: 123.51
2020-08-08 22:12:46,976 epoch 13 - iter 1155/2312 - loss 0.21060479 - samples/sec: 134.40
2020-08-08 22:13:41,098 epoch 13 - iter 1386/2312 - loss 0.21508904 - samples/sec: 138.99
2020-08-08 22:14:35,883 epoch 13 - iter 1617/2312 - loss 0.21693493 - samples/sec: 137.18
2020-08-08 22:15:32,476 epoch 13 - iter 1848/2312 - loss 0.21683507 - samples/sec: 132.65
2020-08-08 22:16:30,609 epoch 13 - iter 2079/2312 - loss 0.21739414 - samples/sec: 129.38
2020-08-08 22:17:25,417 epoch 13 - iter 2310/2312 - loss 0.21790869 - samples/sec: 136.91
2020-08-08 22:17:26,567 ----------------------------------------------------------------------------------------------------
2020-08-08 22:17:26,568 EPOCH 13 done: loss 0.2178 - lr 0.0500000
2020-08-08 22:18:01,094 DEV : loss 0.23334172368049622 - score 0.845
2020-08-08 22:18:02,439 BAD EPOCHS (no improvement): 0
2020-08-08 22:18:30,525 ----------------------------------------------------------------------------------------------------
2020-08-08 22:19:25,538 epoch 14 - iter 231/2312 - loss 0.21135867 - samples/sec: 134.46
2020-08-08 22:20:18,739 epoch 14 - iter 462/2312 - loss 0.21387015 - samples/sec: 141.52
2020-08-08 22:21:16,296 epoch 14 - iter 693/2312 - loss 0.21720965 - samples/sec: 130.40
2020-08-08 22:22:09,240 epoch 14 - iter 924/2312 - loss 0.21501248 - samples/sec: 142.40
2020-08-08 22:23:08,854 epoch 14 - iter 1155/2312 - loss 0.21514265 - samples/sec: 125.92
2020-08-08 22:24:08,393 epoch 14 - iter 1386/2312 - loss 0.21409180 - samples/sec: 125.59
2020-08-08 22:25:11,186 epoch 14 - iter 1617/2312 - loss 0.21609875 - samples/sec: 119.13
2020-08-08 22:26:11,519 epoch 14 - iter 1848/2312 - loss 0.21719427 - samples/sec: 124.09
2020-08-08 22:27:03,776 epoch 14 - iter 2079/2312 - loss 0.21640031 - samples/sec: 143.42
2020-08-08 22:27:58,469 epoch 14 - iter 2310/2312 - loss 0.21648181 - samples/sec: 136.86
2020-08-08 22:27:59,467 ----------------------------------------------------------------------------------------------------
2020-08-08 22:27:59,467 EPOCH 14 done: loss 0.2164 - lr 0.0500000
2020-08-08 22:28:33,074 DEV : loss 0.23554165661334991 - score 0.8478
2020-08-08 22:28:34,375 BAD EPOCHS (no improvement): 0
2020-08-08 22:28:52,775 ----------------------------------------------------------------------------------------------------
2020-08-08 22:29:45,842 epoch 15 - iter 231/2312 - loss 0.22186010 - samples/sec: 139.39
2020-08-08 22:30:42,333 epoch 15 - iter 462/2312 - loss 0.20522127 - samples/sec: 133.56
2020-08-08 22:31:37,286 epoch 15 - iter 693/2312 - loss 0.20283242 - samples/sec: 136.71
2020-08-08 22:32:32,261 epoch 15 - iter 924/2312 - loss 0.20505306 - samples/sec: 136.55
2020-08-08 22:33:25,079 epoch 15 - iter 1155/2312 - loss 0.20615008 - samples/sec: 141.66
2020-08-08 22:34:18,469 epoch 15 - iter 1386/2312 - loss 0.20864795 - samples/sec: 140.35
2020-08-08 22:35:23,306 epoch 15 - iter 1617/2312 - loss 0.20854918 - samples/sec: 115.44
2020-08-08 22:36:17,315 epoch 15 - iter 1848/2312 - loss 0.20960257 - samples/sec: 139.17
2020-08-08 22:37:14,530 epoch 15 - iter 2079/2312 - loss 0.21142207 - samples/sec: 130.82
2020-08-08 22:38:18,731 epoch 15 - iter 2310/2312 - loss 0.20996563 - samples/sec: 116.88
2020-08-08 22:38:20,070 ----------------------------------------------------------------------------------------------------
2020-08-08 22:38:20,070 EPOCH 15 done: loss 0.2098 - lr 0.0500000
2020-08-08 22:39:01,211 DEV : loss 0.2421220988035202 - score 0.8382
2020-08-08 22:39:03,070 BAD EPOCHS (no improvement): 1
2020-08-08 22:39:03,075 ----------------------------------------------------------------------------------------------------
2020-08-08 22:39:56,569 epoch 16 - iter 231/2312 - loss 0.20491840 - samples/sec: 138.27
2020-08-08 22:41:01,469 epoch 16 - iter 462/2312 - loss 0.20868456 - samples/sec: 115.16
2020-08-08 22:41:57,673 epoch 16 - iter 693/2312 - loss 0.21091463 - samples/sec: 133.16
2020-08-08 22:42:53,493 epoch 16 - iter 924/2312 - loss 0.21100565 - samples/sec: 134.04
2020-08-08 22:43:49,041 epoch 16 - iter 1155/2312 - loss 0.21109479 - samples/sec: 135.46
2020-08-08 22:44:43,750 epoch 16 - iter 1386/2312 - loss 0.21124386 - samples/sec: 137.10
2020-08-08 22:45:35,282 epoch 16 - iter 1617/2312 - loss 0.21015901 - samples/sec: 145.75
2020-08-08 22:46:30,736 epoch 16 - iter 1848/2312 - loss 0.20965735 - samples/sec: 135.36
2020-08-08 22:47:24,459 epoch 16 - iter 2079/2312 - loss 0.20847755 - samples/sec: 139.88
2020-08-08 22:48:21,528 epoch 16 - iter 2310/2312 - loss 0.20921518 - samples/sec: 131.55
2020-08-08 22:48:22,741 ----------------------------------------------------------------------------------------------------
2020-08-08 22:48:22,741 EPOCH 16 done: loss 0.2091 - lr 0.0500000
2020-08-08 22:48:57,936 DEV : loss 0.24303831160068512 - score 0.849
2020-08-08 22:48:59,278 BAD EPOCHS (no improvement): 0
2020-08-08 22:49:21,551 ----------------------------------------------------------------------------------------------------
2020-08-08 22:50:16,161 epoch 17 - iter 231/2312 - loss 0.19948304 - samples/sec: 135.45
2020-08-08 22:51:12,207 epoch 17 - iter 462/2312 - loss 0.19497474 - samples/sec: 133.87
2020-08-08 22:52:06,687 epoch 17 - iter 693/2312 - loss 0.19587541 - samples/sec: 137.49
2020-08-08 22:53:00,811 epoch 17 - iter 924/2312 - loss 0.19680108 - samples/sec: 138.58
2020-08-08 22:53:55,222 epoch 17 - iter 1155/2312 - loss 0.20129587 - samples/sec: 137.87
2020-08-08 22:54:50,038 epoch 17 - iter 1386/2312 - loss 0.20281434 - samples/sec: 136.56
2020-08-08 22:55:45,119 epoch 17 - iter 1617/2312 - loss 0.20142149 - samples/sec: 135.84
2020-08-08 22:56:40,305 epoch 17 - iter 1848/2312 - loss 0.20267051 - samples/sec: 135.66
2020-08-08 22:57:43,689 epoch 17 - iter 2079/2312 - loss 0.20510073 - samples/sec: 117.88
2020-08-08 22:58:43,406 epoch 17 - iter 2310/2312 - loss 0.20397883 - samples/sec: 125.34
2020-08-08 22:58:44,537 ----------------------------------------------------------------------------------------------------
2020-08-08 22:58:44,538 EPOCH 17 done: loss 0.2039 - lr 0.0500000
2020-08-08 22:59:26,224 DEV : loss 0.24071583151817322 - score 0.8484
2020-08-08 22:59:28,076 BAD EPOCHS (no improvement): 1
2020-08-08 22:59:28,082 ----------------------------------------------------------------------------------------------------
2020-08-08 23:00:21,049 epoch 18 - iter 231/2312 - loss 0.18802373 - samples/sec: 139.65
2020-08-08 23:01:20,690 epoch 18 - iter 462/2312 - loss 0.19196623 - samples/sec: 127.29
2020-08-08 23:02:15,433 epoch 18 - iter 693/2312 - loss 0.19601217 - samples/sec: 137.67
2020-08-08 23:03:07,445 epoch 18 - iter 924/2312 - loss 0.19699916 - samples/sec: 145.16
2020-08-08 23:03:59,194 epoch 18 - iter 1155/2312 - loss 0.19748002 - samples/sec: 145.25
2020-08-08 23:04:51,718 epoch 18 - iter 1386/2312 - loss 0.19971295 - samples/sec: 142.87
2020-08-08 23:05:44,628 epoch 18 - iter 1617/2312 - loss 0.19949677 - samples/sec: 142.04
2020-08-08 23:06:44,332 epoch 18 - iter 1848/2312 - loss 0.20024601 - samples/sec: 125.40
2020-08-08 23:07:40,979 epoch 18 - iter 2079/2312 - loss 0.20069361 - samples/sec: 132.49
2020-08-08 23:08:32,780 epoch 18 - iter 2310/2312 - loss 0.19999955 - samples/sec: 144.93
2020-08-08 23:08:33,799 ----------------------------------------------------------------------------------------------------
2020-08-08 23:08:33,799 EPOCH 18 done: loss 0.1999 - lr 0.0500000
2020-08-08 23:09:19,743 DEV : loss 0.24037687480449677 - score 0.8474
2020-08-08 23:09:21,047 BAD EPOCHS (no improvement): 2
2020-08-08 23:09:21,072 ----------------------------------------------------------------------------------------------------
2020-08-08 23:10:16,596 epoch 19 - iter 231/2312 - loss 0.20166666 - samples/sec: 133.21
2020-08-08 23:11:13,888 epoch 19 - iter 462/2312 - loss 0.20175550 - samples/sec: 131.06
2020-08-08 23:12:15,962 epoch 19 - iter 693/2312 - loss 0.20078491 - samples/sec: 120.71
2020-08-08 23:13:09,640 epoch 19 - iter 924/2312 - loss 0.20230275 - samples/sec: 140.07
2020-08-08 23:14:05,232 epoch 19 - iter 1155/2312 - loss 0.19954120 - samples/sec: 135.21
2020-08-08 23:14:59,111 epoch 19 - iter 1386/2312 - loss 0.20119337 - samples/sec: 139.21
2020-08-08 23:15:52,980 epoch 19 - iter 1617/2312 - loss 0.20193030 - samples/sec: 139.31
2020-08-08 23:16:47,282 epoch 19 - iter 1848/2312 - loss 0.20067930 - samples/sec: 138.30
2020-08-08 23:17:42,250 epoch 19 - iter 2079/2312 - loss 0.20068095 - samples/sec: 136.57
2020-08-08 23:18:36,218 epoch 19 - iter 2310/2312 - loss 0.19784987 - samples/sec: 139.77
2020-08-08 23:18:37,523 ----------------------------------------------------------------------------------------------------
2020-08-08 23:18:37,524 EPOCH 19 done: loss 0.1977 - lr 0.0500000
2020-08-08 23:19:12,252 DEV : loss 0.23910941183567047 - score 0.8457
2020-08-08 23:19:13,597 BAD EPOCHS (no improvement): 3
2020-08-08 23:19:13,643 ----------------------------------------------------------------------------------------------------
2020-08-08 23:20:08,217 epoch 20 - iter 231/2312 - loss 0.18696218 - samples/sec: 135.54
2020-08-08 23:21:04,964 epoch 20 - iter 462/2312 - loss 0.18760548 - samples/sec: 132.65
2020-08-08 23:21:59,085 epoch 20 - iter 693/2312 - loss 0.18986242 - samples/sec: 138.79
2020-08-08 23:22:55,137 epoch 20 - iter 924/2312 - loss 0.18854259 - samples/sec: 134.05
2020-08-08 23:23:51,159 epoch 20 - iter 1155/2312 - loss 0.19156839 - samples/sec: 133.95
2020-08-08 23:24:44,456 epoch 20 - iter 1386/2312 - loss 0.19142150 - samples/sec: 141.53
2020-08-08 23:25:38,977 epoch 20 - iter 1617/2312 - loss 0.19089564 - samples/sec: 137.59
2020-08-08 23:26:32,197 epoch 20 - iter 1848/2312 - loss 0.19207797 - samples/sec: 141.42
2020-08-08 23:27:27,546 epoch 20 - iter 2079/2312 - loss 0.19279962 - samples/sec: 135.42
2020-08-08 23:28:19,671 epoch 20 - iter 2310/2312 - loss 0.19259938 - samples/sec: 144.04
2020-08-08 23:28:20,852 ----------------------------------------------------------------------------------------------------
2020-08-08 23:28:20,853 EPOCH 20 done: loss 0.1925 - lr 0.0500000
2020-08-08 23:28:54,760 DEV : loss 0.24275383353233337 - score 0.8447
2020-08-08 23:28:56,066 BAD EPOCHS (no improvement): 4
2020-08-08 23:28:56,072 ----------------------------------------------------------------------------------------------------
2020-08-08 23:29:47,982 epoch 21 - iter 231/2312 - loss 0.19269361 - samples/sec: 142.49
2020-08-08 23:30:47,951 epoch 21 - iter 462/2312 - loss 0.18939392 - samples/sec: 125.04
2020-08-08 23:31:41,024 epoch 21 - iter 693/2312 - loss 0.18734158 - samples/sec: 141.62
2020-08-08 23:32:36,682 epoch 21 - iter 924/2312 - loss 0.18381333 - samples/sec: 135.07
2020-08-08 23:33:31,352 epoch 21 - iter 1155/2312 - loss 0.18348149 - samples/sec: 137.64
2020-08-08 23:34:26,282 epoch 21 - iter 1386/2312 - loss 0.18433519 - samples/sec: 136.83
2020-08-08 23:35:20,371 epoch 21 - iter 1617/2312 - loss 0.18390928 - samples/sec: 138.99
2020-08-08 23:36:14,956 epoch 21 - iter 1848/2312 - loss 0.18488836 - samples/sec: 137.66
2020-08-08 23:37:13,764 epoch 21 - iter 2079/2312 - loss 0.18411807 - samples/sec: 127.64
2020-08-08 23:38:07,367 epoch 21 - iter 2310/2312 - loss 0.18540281 - samples/sec: 140.34
2020-08-08 23:38:08,658 ----------------------------------------------------------------------------------------------------
2020-08-08 23:38:08,659 EPOCH 21 done: loss 0.1854 - lr 0.0250000
2020-08-08 23:38:56,218 DEV : loss 0.2322157770395279 - score 0.8501
2020-08-08 23:38:57,567 BAD EPOCHS (no improvement): 0
2020-08-08 23:39:24,881 ----------------------------------------------------------------------------------------------------
2020-08-08 23:40:20,500 epoch 22 - iter 231/2312 - loss 0.16789996 - samples/sec: 132.99
2020-08-08 23:41:15,788 epoch 22 - iter 462/2312 - loss 0.17656488 - samples/sec: 136.06
2020-08-08 23:42:08,189 epoch 22 - iter 693/2312 - loss 0.17780295 - samples/sec: 143.43
2020-08-08 23:43:02,570 epoch 22 - iter 924/2312 - loss 0.18087077 - samples/sec: 137.81
2020-08-08 23:43:56,608 epoch 22 - iter 1155/2312 - loss 0.18016149 - samples/sec: 138.67
2020-08-08 23:44:50,602 epoch 22 - iter 1386/2312 - loss 0.18446407 - samples/sec: 138.91
2020-08-08 23:45:45,375 epoch 22 - iter 1617/2312 - loss 0.18398496 - samples/sec: 136.86
2020-08-08 23:46:42,183 epoch 22 - iter 1848/2312 - loss 0.18428625 - samples/sec: 131.83
2020-08-08 23:47:35,750 epoch 22 - iter 2079/2312 - loss 0.18295055 - samples/sec: 139.87
2020-08-08 23:48:29,770 epoch 22 - iter 2310/2312 - loss 0.18318592 - samples/sec: 138.63
2020-08-08 23:48:30,800 ----------------------------------------------------------------------------------------------------
2020-08-08 23:48:30,801 EPOCH 22 done: loss 0.1831 - lr 0.0250000
2020-08-08 23:49:05,928 DEV : loss 0.24014967679977417 - score 0.8491
2020-08-08 23:49:07,277 BAD EPOCHS (no improvement): 1
2020-08-08 23:49:07,283 ----------------------------------------------------------------------------------------------------
2020-08-08 23:50:03,394 epoch 23 - iter 231/2312 - loss 0.17831334 - samples/sec: 131.83
2020-08-08 23:50:57,446 epoch 23 - iter 462/2312 - loss 0.17741690 - samples/sec: 138.56
2020-08-08 23:51:55,022 epoch 23 - iter 693/2312 - loss 0.17824001 - samples/sec: 130.12
2020-08-08 23:52:49,023 epoch 23 - iter 924/2312 - loss 0.17864669 - samples/sec: 139.08
2020-08-08 23:53:44,204 epoch 23 - iter 1155/2312 - loss 0.18075637 - samples/sec: 135.82
2020-08-08 23:54:38,362 epoch 23 - iter 1386/2312 - loss 0.18085140 - samples/sec: 138.61
2020-08-08 23:55:34,580 epoch 23 - iter 1617/2312 - loss 0.18019925 - samples/sec: 133.27
2020-08-08 23:56:31,361 epoch 23 - iter 1848/2312 - loss 0.18061839 - samples/sec: 132.13
2020-08-08 23:57:24,974 epoch 23 - iter 2079/2312 - loss 0.18043283 - samples/sec: 140.04
2020-08-08 23:58:18,682 epoch 23 - iter 2310/2312 - loss 0.18085041 - samples/sec: 139.76
2020-08-08 23:58:19,695 ----------------------------------------------------------------------------------------------------
2020-08-08 23:58:19,695 EPOCH 23 done: loss 0.1809 - lr 0.0250000
2020-08-08 23:58:54,518 DEV : loss 0.23773570358753204 - score 0.851
2020-08-08 23:58:55,865 BAD EPOCHS (no improvement): 0
2020-08-08 23:59:19,113 ----------------------------------------------------------------------------------------------------
2020-08-09 00:00:10,074 epoch 24 - iter 231/2312 - loss 0.20066455 - samples/sec: 145.15
2020-08-09 00:01:04,607 epoch 24 - iter 462/2312 - loss 0.18322757 - samples/sec: 138.31
2020-08-09 00:01:58,696 epoch 24 - iter 693/2312 - loss 0.18126278 - samples/sec: 140.27
2020-08-09 00:02:50,480 epoch 24 - iter 924/2312 - loss 0.17833432 - samples/sec: 145.60
2020-08-09 00:03:42,459 epoch 24 - iter 1155/2312 - loss 0.17607495 - samples/sec: 145.06
2020-08-09 00:04:37,729 epoch 24 - iter 1386/2312 - loss 0.17791719 - samples/sec: 135.98
2020-08-09 00:05:30,911 epoch 24 - iter 1617/2312 - loss 0.17704062 - samples/sec: 141.04
2020-08-09 00:06:28,385 epoch 24 - iter 1848/2312 - loss 0.17779499 - samples/sec: 130.36
2020-08-09 00:07:22,693 epoch 24 - iter 2079/2312 - loss 0.17732995 - samples/sec: 138.68
2020-08-09 00:08:16,746 epoch 24 - iter 2310/2312 - loss 0.17661573 - samples/sec: 139.66
2020-08-09 00:08:17,927 ----------------------------------------------------------------------------------------------------
2020-08-09 00:08:17,928 EPOCH 24 done: loss 0.1767 - lr 0.0250000
2020-08-09 00:08:52,861 DEV : loss 0.23984307050704956 - score 0.8491
2020-08-09 00:08:54,213 BAD EPOCHS (no improvement): 1
2020-08-09 00:08:54,219 ----------------------------------------------------------------------------------------------------
2020-08-09 00:09:47,689 epoch 25 - iter 231/2312 - loss 0.15884211 - samples/sec: 138.34
2020-08-09 00:10:44,299 epoch 25 - iter 462/2312 - loss 0.16731101 - samples/sec: 132.42
2020-08-09 00:11:38,000 epoch 25 - iter 693/2312 - loss 0.16884594 - samples/sec: 139.95
2020-08-09 00:12:44,513 epoch 25 - iter 924/2312 - loss 0.16795893 - samples/sec: 112.46
2020-08-09 00:13:39,711 epoch 25 - iter 1155/2312 - loss 0.17176205 - samples/sec: 136.03
2020-08-09 00:14:37,806 epoch 25 - iter 1386/2312 - loss 0.17365194 - samples/sec: 129.30
2020-08-09 00:15:31,538 epoch 25 - iter 1617/2312 - loss 0.17371486 - samples/sec: 140.78
2020-08-09 00:16:26,591 epoch 25 - iter 1848/2312 - loss 0.17331062 - samples/sec: 136.51
2020-08-09 00:17:21,118 epoch 25 - iter 2079/2312 - loss 0.17364137 - samples/sec: 137.97
2020-08-09 00:18:17,899 epoch 25 - iter 2310/2312 - loss 0.17471899 - samples/sec: 132.05
2020-08-09 00:18:19,044 ----------------------------------------------------------------------------------------------------
2020-08-09 00:18:19,045 EPOCH 25 done: loss 0.1747 - lr 0.0250000
2020-08-09 00:18:52,666 DEV : loss 0.23671463131904602 - score 0.8523
2020-08-09 00:18:53,961 BAD EPOCHS (no improvement): 0
2020-08-09 00:19:15,577 ----------------------------------------------------------------------------------------------------
2020-08-09 00:20:07,928 epoch 26 - iter 231/2312 - loss 0.16757001 - samples/sec: 141.29
2020-08-09 00:21:02,179 epoch 26 - iter 462/2312 - loss 0.16858335 - samples/sec: 139.01
2020-08-09 00:21:57,037 epoch 26 - iter 693/2312 - loss 0.16894808 - samples/sec: 136.73
2020-08-09 00:22:51,382 epoch 26 - iter 924/2312 - loss 0.17298153 - samples/sec: 138.35
2020-08-09 00:23:47,106 epoch 26 - iter 1155/2312 - loss 0.16996066 - samples/sec: 134.75
2020-08-09 00:24:42,235 epoch 26 - iter 1386/2312 - loss 0.16794343 - samples/sec: 136.28
2020-08-09 00:25:36,094 epoch 26 - iter 1617/2312 - loss 0.17182238 - samples/sec: 138.96
2020-08-09 00:26:29,072 epoch 26 - iter 1848/2312 - loss 0.17157283 - samples/sec: 141.48
2020-08-09 00:27:26,084 epoch 26 - iter 2079/2312 - loss 0.17301915 - samples/sec: 131.36
2020-08-09 00:28:20,503 epoch 26 - iter 2310/2312 - loss 0.17395668 - samples/sec: 137.65
2020-08-09 00:28:21,724 ----------------------------------------------------------------------------------------------------
2020-08-09 00:28:21,724 EPOCH 26 done: loss 0.1739 - lr 0.0250000
2020-08-09 00:28:56,950 DEV : loss 0.23880508542060852 - score 0.8484
2020-08-09 00:28:58,298 BAD EPOCHS (no improvement): 1
2020-08-09 00:28:58,306 ----------------------------------------------------------------------------------------------------
2020-08-09 00:29:52,031 epoch 27 - iter 231/2312 - loss 0.17294824 - samples/sec: 137.69
2020-08-09 00:30:46,350 epoch 27 - iter 462/2312 - loss 0.17631896 - samples/sec: 138.34
2020-08-09 00:31:40,332 epoch 27 - iter 693/2312 - loss 0.17468661 - samples/sec: 139.84
2020-08-09 00:32:35,802 epoch 27 - iter 924/2312 - loss 0.17394702 - samples/sec: 135.61
2020-08-09 00:33:29,920 epoch 27 - iter 1155/2312 - loss 0.17528992 - samples/sec: 138.71
2020-08-09 00:34:24,967 epoch 27 - iter 1386/2312 - loss 0.17195438 - samples/sec: 136.36
2020-08-09 00:35:23,315 epoch 27 - iter 1617/2312 - loss 0.17414662 - samples/sec: 128.34
2020-08-09 00:36:16,782 epoch 27 - iter 1848/2312 - loss 0.17241002 - samples/sec: 140.21
2020-08-09 00:37:12,943 epoch 27 - iter 2079/2312 - loss 0.17416928 - samples/sec: 133.58
2020-08-09 00:38:06,048 epoch 27 - iter 2310/2312 - loss 0.17327948 - samples/sec: 141.41
2020-08-09 00:38:07,157 ----------------------------------------------------------------------------------------------------
2020-08-09 00:38:07,157 EPOCH 27 done: loss 0.1733 - lr 0.0250000
2020-08-09 00:38:42,000 DEV : loss 0.24536795914173126 - score 0.8505
2020-08-09 00:38:43,352 BAD EPOCHS (no improvement): 2
2020-08-09 00:38:43,356 ----------------------------------------------------------------------------------------------------
2020-08-09 00:39:39,458 epoch 28 - iter 231/2312 - loss 0.17943277 - samples/sec: 131.85
2020-08-09 00:40:31,369 epoch 28 - iter 462/2312 - loss 0.17635789 - samples/sec: 144.47
2020-08-09 00:41:28,702 epoch 28 - iter 693/2312 - loss 0.17411662 - samples/sec: 130.77
2020-08-09 00:42:28,607 epoch 28 - iter 924/2312 - loss 0.17562742 - samples/sec: 124.90
2020-08-09 00:43:28,885 epoch 28 - iter 1155/2312 - loss 0.17695063 - samples/sec: 124.45
2020-08-09 00:44:29,605 epoch 28 - iter 1386/2312 - loss 0.17501129 - samples/sec: 123.84
2020-08-09 00:45:30,293 epoch 28 - iter 1617/2312 - loss 0.17380649 - samples/sec: 123.65
2020-08-09 00:46:22,875 epoch 28 - iter 1848/2312 - loss 0.17320145 - samples/sec: 142.44
2020-08-09 00:47:29,413 epoch 28 - iter 2079/2312 - loss 0.17267077 - samples/sec: 112.24
2020-08-09 00:48:22,774 epoch 28 - iter 2310/2312 - loss 0.17184010 - samples/sec: 140.67
2020-08-09 00:48:23,722 ----------------------------------------------------------------------------------------------------
2020-08-09 00:48:23,722 EPOCH 28 done: loss 0.1717 - lr 0.0250000
2020-08-09 00:48:57,379 DEV : loss 0.24180807173252106 - score 0.8526
2020-08-09 00:48:58,680 BAD EPOCHS (no improvement): 0
2020-08-09 00:49:19,098 ----------------------------------------------------------------------------------------------------
2020-08-09 00:50:11,796 epoch 29 - iter 231/2312 - loss 0.17055076 - samples/sec: 140.35
2020-08-09 00:51:10,394 epoch 29 - iter 462/2312 - loss 0.16579384 - samples/sec: 127.60
2020-08-09 00:52:09,706 epoch 29 - iter 693/2312 - loss 0.16883377 - samples/sec: 126.21
2020-08-09 00:53:01,115 epoch 29 - iter 924/2312 - loss 0.17032414 - samples/sec: 146.05
2020-08-09 00:53:57,951 epoch 29 - iter 1155/2312 - loss 0.16798644 - samples/sec: 131.70
2020-08-09 00:54:52,072 epoch 29 - iter 1386/2312 - loss 0.16779749 - samples/sec: 138.23
2020-08-09 00:55:52,631 epoch 29 - iter 1617/2312 - loss 0.16784286 - samples/sec: 123.42
2020-08-09 00:56:49,532 epoch 29 - iter 1848/2312 - loss 0.16919266 - samples/sec: 131.73
2020-08-09 00:57:44,636 epoch 29 - iter 2079/2312 - loss 0.16996666 - samples/sec: 135.76
2020-08-09 00:58:38,378 epoch 29 - iter 2310/2312 - loss 0.17062662 - samples/sec: 139.67
2020-08-09 00:58:39,395 ----------------------------------------------------------------------------------------------------
2020-08-09 00:58:39,395 EPOCH 29 done: loss 0.1707 - lr 0.0250000
2020-08-09 00:59:14,120 DEV : loss 0.23492425680160522 - score 0.8477
2020-08-09 00:59:15,464 BAD EPOCHS (no improvement): 1
2020-08-09 00:59:15,470 ----------------------------------------------------------------------------------------------------
2020-08-09 01:00:09,902 epoch 30 - iter 231/2312 - loss 0.17186310 - samples/sec: 135.90
2020-08-09 01:01:04,123 epoch 30 - iter 462/2312 - loss 0.17067717 - samples/sec: 139.35
2020-08-09 01:01:59,365 epoch 30 - iter 693/2312 - loss 0.16891067 - samples/sec: 137.63
2020-08-09 01:02:52,968 epoch 30 - iter 924/2312 - loss 0.16935406 - samples/sec: 140.71
2020-08-09 01:03:48,933 epoch 30 - iter 1155/2312 - loss 0.17092859 - samples/sec: 134.80
2020-08-09 01:04:46,125 epoch 30 - iter 1386/2312 - loss 0.16988778 - samples/sec: 132.39
2020-08-09 01:05:45,205 epoch 30 - iter 1617/2312 - loss 0.16945339 - samples/sec: 128.10
2020-08-09 01:06:41,195 epoch 30 - iter 1848/2312 - loss 0.16861097 - samples/sec: 135.32
2020-08-09 01:07:33,989 epoch 30 - iter 2079/2312 - loss 0.16832842 - samples/sec: 142.44
2020-08-09 01:08:25,644 epoch 30 - iter 2310/2312 - loss 0.16781537 - samples/sec: 145.18
2020-08-09 01:08:26,752 ----------------------------------------------------------------------------------------------------
2020-08-09 01:08:26,752 EPOCH 30 done: loss 0.1681 - lr 0.0250000
2020-08-09 01:09:00,287 DEV : loss 0.24102595448493958 - score 0.8492
2020-08-09 01:09:01,597 BAD EPOCHS (no improvement): 2
2020-08-09 01:09:01,603 ----------------------------------------------------------------------------------------------------
2020-08-09 01:09:59,499 epoch 31 - iter 231/2312 - loss 0.15445322 - samples/sec: 127.75
2020-08-09 01:10:53,269 epoch 31 - iter 462/2312 - loss 0.15904029 - samples/sec: 140.74
2020-08-09 01:11:52,233 epoch 31 - iter 693/2312 - loss 0.16162886 - samples/sec: 127.46
2020-08-09 01:12:45,248 epoch 31 - iter 924/2312 - loss 0.16354258 - samples/sec: 141.69
2020-08-09 01:13:42,053 epoch 31 - iter 1155/2312 - loss 0.16160712 - samples/sec: 133.51
2020-08-09 01:14:34,324 epoch 31 - iter 1386/2312 - loss 0.16164698 - samples/sec: 143.52
2020-08-09 01:15:29,420 epoch 31 - iter 1617/2312 - loss 0.16204250 - samples/sec: 136.43
2020-08-09 01:16:27,800 epoch 31 - iter 1848/2312 - loss 0.16189030 - samples/sec: 128.73
2020-08-09 01:17:23,729 epoch 31 - iter 2079/2312 - loss 0.16283275 - samples/sec: 133.93
2020-08-09 01:18:18,012 epoch 31 - iter 2310/2312 - loss 0.16378671 - samples/sec: 138.18
2020-08-09 01:18:19,571 ----------------------------------------------------------------------------------------------------
2020-08-09 01:18:19,571 EPOCH 31 done: loss 0.1637 - lr 0.0250000
2020-08-09 01:19:05,447 DEV : loss 0.2452034056186676 - score 0.8488
2020-08-09 01:19:06,752 BAD EPOCHS (no improvement): 3
2020-08-09 01:19:06,757 ----------------------------------------------------------------------------------------------------
2020-08-09 01:20:01,507 epoch 32 - iter 231/2312 - loss 0.16730790 - samples/sec: 135.10
2020-08-09 01:20:56,406 epoch 32 - iter 462/2312 - loss 0.16777608 - samples/sec: 136.52
2020-08-09 01:21:48,279 epoch 32 - iter 693/2312 - loss 0.16763254 - samples/sec: 144.98
2020-08-09 01:22:40,332 epoch 32 - iter 924/2312 - loss 0.16803518 - samples/sec: 144.22
2020-08-09 01:23:34,515 epoch 32 - iter 1155/2312 - loss 0.16748902 - samples/sec: 139.24
2020-08-09 01:24:33,134 epoch 32 - iter 1386/2312 - loss 0.16690944 - samples/sec: 128.45
2020-08-09 01:25:30,956 epoch 32 - iter 1617/2312 - loss 0.16587160 - samples/sec: 129.73
2020-08-09 01:26:29,329 epoch 32 - iter 1848/2312 - loss 0.16686999 - samples/sec: 128.62
2020-08-09 01:27:26,671 epoch 32 - iter 2079/2312 - loss 0.16691717 - samples/sec: 131.21
2020-08-09 01:28:18,272 epoch 32 - iter 2310/2312 - loss 0.16549964 - samples/sec: 145.73
2020-08-09 01:28:19,663 ----------------------------------------------------------------------------------------------------
2020-08-09 01:28:19,663 EPOCH 32 done: loss 0.1658 - lr 0.0250000
2020-08-09 01:28:52,637 DEV : loss 0.24134396016597748 - score 0.8545
2020-08-09 01:28:53,936 BAD EPOCHS (no improvement): 0
2020-08-09 01:29:16,669 ----------------------------------------------------------------------------------------------------
2020-08-09 01:30:08,385 epoch 33 - iter 231/2312 - loss 0.16784366 - samples/sec: 143.02
2020-08-09 01:31:03,995 epoch 33 - iter 462/2312 - loss 0.16670039 - samples/sec: 135.91
2020-08-09 01:31:58,879 epoch 33 - iter 693/2312 - loss 0.16658760 - samples/sec: 136.61
2020-08-09 01:32:50,559 epoch 33 - iter 924/2312 - loss 0.16492345 - samples/sec: 144.99
2020-08-09 01:33:44,544 epoch 33 - iter 1155/2312 - loss 0.16092100 - samples/sec: 139.01
2020-08-09 01:34:40,624 epoch 33 - iter 1386/2312 - loss 0.16253740 - samples/sec: 133.78
2020-08-09 01:35:34,234 epoch 33 - iter 1617/2312 - loss 0.16387686 - samples/sec: 140.08
2020-08-09 01:36:30,134 epoch 33 - iter 1848/2312 - loss 0.16381255 - samples/sec: 134.69
2020-08-09 01:37:24,426 epoch 33 - iter 2079/2312 - loss 0.16369655 - samples/sec: 138.82
2020-08-09 01:38:17,745 epoch 33 - iter 2310/2312 - loss 0.16344485 - samples/sec: 140.92
2020-08-09 01:38:18,814 ----------------------------------------------------------------------------------------------------
2020-08-09 01:38:18,814 EPOCH 33 done: loss 0.1634 - lr 0.0250000
2020-08-09 01:38:53,496 DEV : loss 0.24839290976524353 - score 0.8503
2020-08-09 01:38:54,841 BAD EPOCHS (no improvement): 1
2020-08-09 01:38:54,851 ----------------------------------------------------------------------------------------------------
2020-08-09 01:39:50,013 epoch 34 - iter 231/2312 - loss 0.16442318 - samples/sec: 134.09
2020-08-09 01:40:44,748 epoch 34 - iter 462/2312 - loss 0.16322083 - samples/sec: 137.05
2020-08-09 01:41:37,516 epoch 34 - iter 693/2312 - loss 0.16030963 - samples/sec: 142.24
2020-08-09 01:42:36,673 epoch 34 - iter 924/2312 - loss 0.15855071 - samples/sec: 126.59
2020-08-09 01:43:34,257 epoch 34 - iter 1155/2312 - loss 0.16040895 - samples/sec: 130.46
2020-08-09 01:44:29,320 epoch 34 - iter 1386/2312 - loss 0.16187013 - samples/sec: 136.57
2020-08-09 01:45:28,842 epoch 34 - iter 1617/2312 - loss 0.16159784 - samples/sec: 126.07
2020-08-09 01:46:23,050 epoch 34 - iter 1848/2312 - loss 0.16147042 - samples/sec: 138.45
2020-08-09 01:47:17,368 epoch 34 - iter 2079/2312 - loss 0.16015545 - samples/sec: 137.94
2020-08-09 01:48:11,969 epoch 34 - iter 2310/2312 - loss 0.16174846 - samples/sec: 137.14
2020-08-09 01:48:13,715 ----------------------------------------------------------------------------------------------------
2020-08-09 01:48:13,715 EPOCH 34 done: loss 0.1616 - lr 0.0250000
2020-08-09 01:48:48,585 DEV : loss 0.24207079410552979 - score 0.85
2020-08-09 01:48:49,929 BAD EPOCHS (no improvement): 2
2020-08-09 01:48:49,935 ----------------------------------------------------------------------------------------------------
2020-08-09 01:49:44,870 epoch 35 - iter 231/2312 - loss 0.16327712 - samples/sec: 134.65
2020-08-09 01:50:52,570 epoch 35 - iter 462/2312 - loss 0.15717224 - samples/sec: 110.43
2020-08-09 01:51:46,581 epoch 35 - iter 693/2312 - loss 0.15714706 - samples/sec: 138.63
2020-08-09 01:52:45,140 epoch 35 - iter 924/2312 - loss 0.15855586 - samples/sec: 127.89
2020-08-09 01:53:38,949 epoch 35 - iter 1155/2312 - loss 0.15686964 - samples/sec: 139.45
2020-08-09 01:54:40,622 epoch 35 - iter 1386/2312 - loss 0.15594969 - samples/sec: 121.68
2020-08-09 01:55:37,893 epoch 35 - iter 1617/2312 - loss 0.15710745 - samples/sec: 131.43
2020-08-09 01:56:31,688 epoch 35 - iter 1848/2312 - loss 0.15796101 - samples/sec: 139.33
2020-08-09 01:57:24,446 epoch 35 - iter 2079/2312 - loss 0.15748786 - samples/sec: 142.26
2020-08-09 01:58:17,843 epoch 35 - iter 2310/2312 - loss 0.15893952 - samples/sec: 140.80
2020-08-09 01:58:18,963 ----------------------------------------------------------------------------------------------------
2020-08-09 01:58:18,963 EPOCH 35 done: loss 0.1589 - lr 0.0250000
2020-08-09 01:58:53,669 DEV : loss 0.23834320902824402 - score 0.8508
2020-08-09 01:58:55,018 BAD EPOCHS (no improvement): 3
2020-08-09 01:58:55,022 ----------------------------------------------------------------------------------------------------
2020-08-09 01:59:48,711 epoch 36 - iter 231/2312 - loss 0.15456441 - samples/sec: 137.78
2020-08-09 02:00:46,620 epoch 36 - iter 462/2312 - loss 0.15570783 - samples/sec: 129.73
2020-08-09 02:01:46,044 epoch 36 - iter 693/2312 - loss 0.15304504 - samples/sec: 127.70
2020-08-09 02:02:40,815 epoch 36 - iter 924/2312 - loss 0.15769043 - samples/sec: 138.09
2020-08-09 02:03:32,548 epoch 36 - iter 1155/2312 - loss 0.15602840 - samples/sec: 145.98
2020-08-09 02:04:24,435 epoch 36 - iter 1386/2312 - loss 0.15569966 - samples/sec: 145.14
2020-08-09 02:05:18,228 epoch 36 - iter 1617/2312 - loss 0.15771882 - samples/sec: 140.50
2020-08-09 02:06:15,188 epoch 36 - iter 1848/2312 - loss 0.15819488 - samples/sec: 132.95
2020-08-09 02:07:10,047 epoch 36 - iter 2079/2312 - loss 0.15738217 - samples/sec: 137.94
2020-08-09 02:08:05,497 epoch 36 - iter 2310/2312 - loss 0.15799656 - samples/sec: 137.22
2020-08-09 02:08:07,033 ----------------------------------------------------------------------------------------------------
2020-08-09 02:08:07,033 EPOCH 36 done: loss 0.1579 - lr 0.0250000
2020-08-09 02:08:41,986 DEV : loss 0.25006619095802307 - score 0.852
2020-08-09 02:08:43,330 BAD EPOCHS (no improvement): 4
2020-08-09 02:08:43,362 ----------------------------------------------------------------------------------------------------
2020-08-09 02:09:37,827 epoch 37 - iter 231/2312 - loss 0.15990292 - samples/sec: 135.81
2020-08-09 02:10:33,844 epoch 37 - iter 462/2312 - loss 0.16375717 - samples/sec: 134.72
2020-08-09 02:11:27,580 epoch 37 - iter 693/2312 - loss 0.16244824 - samples/sec: 140.08
2020-08-09 02:12:23,510 epoch 37 - iter 924/2312 - loss 0.15694065 - samples/sec: 134.38
2020-08-09 02:13:18,558 epoch 37 - iter 1155/2312 - loss 0.15529923 - samples/sec: 136.81
2020-08-09 02:14:13,019 epoch 37 - iter 1386/2312 - loss 0.15382621 - samples/sec: 138.31
2020-08-09 02:15:09,756 epoch 37 - iter 1617/2312 - loss 0.15393738 - samples/sec: 132.67
2020-08-09 02:16:02,663 epoch 37 - iter 1848/2312 - loss 0.15483904 - samples/sec: 142.08
2020-08-09 02:16:59,865 epoch 37 - iter 2079/2312 - loss 0.15330694 - samples/sec: 131.16
2020-08-09 02:17:56,046 epoch 37 - iter 2310/2312 - loss 0.15379606 - samples/sec: 133.63
2020-08-09 02:17:57,160 ----------------------------------------------------------------------------------------------------
2020-08-09 02:17:57,161 EPOCH 37 done: loss 0.1538 - lr 0.0125000
2020-08-09 02:18:31,376 DEV : loss 0.2432437390089035 - score 0.8518
2020-08-09 02:18:32,697 BAD EPOCHS (no improvement): 1
2020-08-09 02:18:32,742 ----------------------------------------------------------------------------------------------------
2020-08-09 02:19:25,893 epoch 38 - iter 231/2312 - loss 0.13950927 - samples/sec: 139.17
2020-08-09 02:20:21,904 epoch 38 - iter 462/2312 - loss 0.14403357 - samples/sec: 133.71
2020-08-09 02:21:17,708 epoch 38 - iter 693/2312 - loss 0.14599294 - samples/sec: 134.88
2020-08-09 02:22:11,942 epoch 38 - iter 924/2312 - loss 0.15111401 - samples/sec: 139.01
2020-08-09 02:23:03,561 epoch 38 - iter 1155/2312 - loss 0.15075647 - samples/sec: 145.35
2020-08-09 02:24:09,848 epoch 38 - iter 1386/2312 - loss 0.15134095 - samples/sec: 113.95
2020-08-09 02:25:02,954 epoch 38 - iter 1617/2312 - loss 0.15040715 - samples/sec: 141.29
2020-08-09 02:25:57,694 epoch 38 - iter 1848/2312 - loss 0.14953425 - samples/sec: 137.05
2020-08-09 02:26:59,432 epoch 38 - iter 2079/2312 - loss 0.15043627 - samples/sec: 121.60
2020-08-09 02:27:52,498 epoch 38 - iter 2310/2312 - loss 0.15071235 - samples/sec: 141.91
2020-08-09 02:27:53,563 ----------------------------------------------------------------------------------------------------
2020-08-09 02:27:53,564 EPOCH 38 done: loss 0.1507 - lr 0.0125000
2020-08-09 02:28:31,669 DEV : loss 0.24185806512832642 - score 0.8531
2020-08-09 02:28:33,544 BAD EPOCHS (no improvement): 2
2020-08-09 02:28:33,555 ----------------------------------------------------------------------------------------------------
2020-08-09 02:29:28,342 epoch 39 - iter 231/2312 - loss 0.15562122 - samples/sec: 135.00
2020-08-09 02:30:20,404 epoch 39 - iter 462/2312 - loss 0.15114582 - samples/sec: 143.94
2020-08-09 02:31:17,146 epoch 39 - iter 693/2312 - loss 0.15049325 - samples/sec: 131.83
2020-08-09 02:32:19,869 epoch 39 - iter 924/2312 - loss 0.14978607 - samples/sec: 119.22
2020-08-09 02:33:24,096 epoch 39 - iter 1155/2312 - loss 0.15135481 - samples/sec: 116.43
2020-08-09 02:34:19,100 epoch 39 - iter 1386/2312 - loss 0.14978906 - samples/sec: 136.04
2020-08-09 02:35:18,263 epoch 39 - iter 1617/2312 - loss 0.14964301 - samples/sec: 126.45
2020-08-09 02:36:17,487 epoch 39 - iter 1848/2312 - loss 0.14896308 - samples/sec: 126.70
2020-08-09 02:37:11,961 epoch 39 - iter 2079/2312 - loss 0.15017905 - samples/sec: 137.99
2020-08-09 02:38:07,233 epoch 39 - iter 2310/2312 - loss 0.15124581 - samples/sec: 136.17
2020-08-09 02:38:08,486 ----------------------------------------------------------------------------------------------------
2020-08-09 02:38:08,486 EPOCH 39 done: loss 0.1513 - lr 0.0125000
2020-08-09 02:38:43,312 DEV : loss 0.2395601123571396 - score 0.8526
2020-08-09 02:38:44,654 BAD EPOCHS (no improvement): 3
2020-08-09 02:38:44,659 ----------------------------------------------------------------------------------------------------
2020-08-09 02:39:39,718 epoch 40 - iter 231/2312 - loss 0.15310214 - samples/sec: 134.33
2020-08-09 02:40:33,840 epoch 40 - iter 462/2312 - loss 0.16003700 - samples/sec: 138.58
2020-08-09 02:41:33,631 epoch 40 - iter 693/2312 - loss 0.15880209 - samples/sec: 125.19
2020-08-09 02:42:34,807 epoch 40 - iter 924/2312 - loss 0.15471130 - samples/sec: 122.41
2020-08-09 02:43:29,109 epoch 40 - iter 1155/2312 - loss 0.15489020 - samples/sec: 138.12
2020-08-09 02:44:25,321 epoch 40 - iter 1386/2312 - loss 0.15400205 - samples/sec: 133.20
2020-08-09 02:45:19,386 epoch 40 - iter 1617/2312 - loss 0.15281205 - samples/sec: 138.66
2020-08-09 02:46:11,424 epoch 40 - iter 1848/2312 - loss 0.15254032 - samples/sec: 144.06
2020-08-09 02:47:05,956 epoch 40 - iter 2079/2312 - loss 0.15115948 - samples/sec: 137.70
2020-08-09 02:48:00,553 epoch 40 - iter 2310/2312 - loss 0.15156041 - samples/sec: 137.28
2020-08-09 02:48:01,873 ----------------------------------------------------------------------------------------------------
2020-08-09 02:48:01,873 EPOCH 40 done: loss 0.1514 - lr 0.0125000
2020-08-09 02:48:35,324 DEV : loss 0.24694141745567322 - score 0.8476
2020-08-09 02:48:36,625 BAD EPOCHS (no improvement): 4
2020-08-09 02:48:36,657 ----------------------------------------------------------------------------------------------------
2020-08-09 02:49:30,479 epoch 41 - iter 231/2312 - loss 0.14676839 - samples/sec: 137.42
2020-08-09 02:50:33,394 epoch 41 - iter 462/2312 - loss 0.14749086 - samples/sec: 119.29
2020-08-09 02:51:27,941 epoch 41 - iter 693/2312 - loss 0.14726505 - samples/sec: 138.21
2020-08-09 02:52:23,281 epoch 41 - iter 924/2312 - loss 0.14639309 - samples/sec: 136.50
2020-08-09 02:53:18,939 epoch 41 - iter 1155/2312 - loss 0.14509332 - samples/sec: 135.85
2020-08-09 02:54:14,334 epoch 41 - iter 1386/2312 - loss 0.14697110 - samples/sec: 135.44
2020-08-09 02:55:10,292 epoch 41 - iter 1617/2312 - loss 0.14588046 - samples/sec: 133.74
2020-08-09 02:56:04,948 epoch 41 - iter 1848/2312 - loss 0.14585382 - samples/sec: 137.54
2020-08-09 02:56:59,915 epoch 41 - iter 2079/2312 - loss 0.14608503 - samples/sec: 136.35
2020-08-09 02:58:06,793 epoch 41 - iter 2310/2312 - loss 0.14711424 - samples/sec: 111.61
2020-08-09 02:58:07,759 ----------------------------------------------------------------------------------------------------
2020-08-09 02:58:07,759 EPOCH 41 done: loss 0.1470 - lr 0.0062500
2020-08-09 02:58:42,379 DEV : loss 0.2478862702846527 - score 0.8523
2020-08-09 02:58:43,725 BAD EPOCHS (no improvement): 1
2020-08-09 02:58:43,746 ----------------------------------------------------------------------------------------------------
2020-08-09 02:59:39,581 epoch 42 - iter 231/2312 - loss 0.15193983 - samples/sec: 132.48
2020-08-09 03:00:37,469 epoch 42 - iter 462/2312 - loss 0.14629283 - samples/sec: 129.27
2020-08-09 03:01:31,334 epoch 42 - iter 693/2312 - loss 0.14673139 - samples/sec: 141.12
2020-08-09 03:02:27,226 epoch 42 - iter 924/2312 - loss 0.14505428 - samples/sec: 136.66
2020-08-09 03:03:19,200 epoch 42 - iter 1155/2312 - loss 0.14716781 - samples/sec: 145.69
2020-08-09 03:04:12,086 epoch 42 - iter 1386/2312 - loss 0.14459273 - samples/sec: 141.77
2020-08-09 03:05:07,668 epoch 42 - iter 1617/2312 - loss 0.14544233 - samples/sec: 135.15
2020-08-09 03:06:04,163 epoch 42 - iter 1848/2312 - loss 0.14663453 - samples/sec: 133.15
2020-08-09 03:07:00,207 epoch 42 - iter 2079/2312 - loss 0.14621106 - samples/sec: 133.48
2020-08-09 03:07:56,487 epoch 42 - iter 2310/2312 - loss 0.14649559 - samples/sec: 133.23
2020-08-09 03:07:57,611 ----------------------------------------------------------------------------------------------------
2020-08-09 03:07:57,611 EPOCH 42 done: loss 0.1464 - lr 0.0062500
2020-08-09 03:08:39,409 DEV : loss 0.2456652820110321 - score 0.8524
2020-08-09 03:08:41,268 BAD EPOCHS (no improvement): 2
2020-08-09 03:08:41,274 ----------------------------------------------------------------------------------------------------
2020-08-09 03:09:34,940 epoch 43 - iter 231/2312 - loss 0.15418155 - samples/sec: 137.82
2020-08-09 03:10:26,916 epoch 43 - iter 462/2312 - loss 0.15263392 - samples/sec: 144.13
2020-08-09 03:11:19,929 epoch 43 - iter 693/2312 - loss 0.15137035 - samples/sec: 141.96
2020-08-09 03:12:14,682 epoch 43 - iter 924/2312 - loss 0.14943081 - samples/sec: 137.30
2020-08-09 03:13:07,518 epoch 43 - iter 1155/2312 - loss 0.14866619 - samples/sec: 141.82
2020-08-09 03:13:59,921 epoch 43 - iter 1386/2312 - loss 0.14695533 - samples/sec: 143.10
2020-08-09 03:14:53,471 epoch 43 - iter 1617/2312 - loss 0.14659168 - samples/sec: 140.40
2020-08-09 03:15:46,320 epoch 43 - iter 1848/2312 - loss 0.14611345 - samples/sec: 141.98
2020-08-09 03:16:42,031 epoch 43 - iter 2079/2312 - loss 0.14629096 - samples/sec: 137.06
2020-08-09 03:17:37,094 epoch 43 - iter 2310/2312 - loss 0.14634211 - samples/sec: 138.10
2020-08-09 03:17:38,660 ----------------------------------------------------------------------------------------------------
2020-08-09 03:17:38,660 EPOCH 43 done: loss 0.1464 - lr 0.0062500
2020-08-09 03:18:14,528 DEV : loss 0.24576693773269653 - score 0.8506
2020-08-09 03:18:16,458 BAD EPOCHS (no improvement): 3
2020-08-09 03:18:16,464 ----------------------------------------------------------------------------------------------------
2020-08-09 03:19:09,865 epoch 44 - iter 231/2312 - loss 0.14304752 - samples/sec: 138.51
2020-08-09 03:20:03,808 epoch 44 - iter 462/2312 - loss 0.14448841 - samples/sec: 140.88
2020-08-09 03:20:59,919 epoch 44 - iter 693/2312 - loss 0.14027659 - samples/sec: 134.38
2020-08-09 03:21:54,449 epoch 44 - iter 924/2312 - loss 0.13994087 - samples/sec: 137.92
2020-08-09 03:22:50,280 epoch 44 - iter 1155/2312 - loss 0.14177207 - samples/sec: 135.21
2020-08-09 03:23:45,253 epoch 44 - iter 1386/2312 - loss 0.14127013 - samples/sec: 136.65
2020-08-09 03:24:39,954 epoch 44 - iter 1617/2312 - loss 0.14304032 - samples/sec: 137.47
2020-08-09 03:25:33,458 epoch 44 - iter 1848/2312 - loss 0.14351454 - samples/sec: 141.03
2020-08-09 03:26:26,737 epoch 44 - iter 2079/2312 - loss 0.14429971 - samples/sec: 141.24
2020-08-09 03:27:21,463 epoch 44 - iter 2310/2312 - loss 0.14396357 - samples/sec: 137.65
2020-08-09 03:27:22,881 ----------------------------------------------------------------------------------------------------
2020-08-09 03:27:22,881 EPOCH 44 done: loss 0.1438 - lr 0.0062500
2020-08-09 03:28:10,642 DEV : loss 0.24571605026721954 - score 0.8516
2020-08-09 03:28:11,999 BAD EPOCHS (no improvement): 4
2020-08-09 03:28:12,006 ----------------------------------------------------------------------------------------------------
2020-08-09 03:29:05,681 epoch 45 - iter 231/2312 - loss 0.15552156 - samples/sec: 137.81
2020-08-09 03:30:01,208 epoch 45 - iter 462/2312 - loss 0.14663090 - samples/sec: 135.23
2020-08-09 03:30:55,381 epoch 45 - iter 693/2312 - loss 0.14509133 - samples/sec: 139.06
2020-08-09 03:31:50,509 epoch 45 - iter 924/2312 - loss 0.14774279 - samples/sec: 136.17
2020-08-09 03:32:44,195 epoch 45 - iter 1155/2312 - loss 0.14465998 - samples/sec: 140.84
2020-08-09 03:33:38,836 epoch 45 - iter 1386/2312 - loss 0.14414962 - samples/sec: 137.77
2020-08-09 03:34:35,556 epoch 45 - iter 1617/2312 - loss 0.14303081 - samples/sec: 133.37
2020-08-09 03:35:33,474 epoch 45 - iter 1848/2312 - loss 0.14456272 - samples/sec: 130.31
2020-08-09 03:36:29,599 epoch 45 - iter 2079/2312 - loss 0.14564166 - samples/sec: 133.83
2020-08-09 03:37:28,043 epoch 45 - iter 2310/2312 - loss 0.14507274 - samples/sec: 128.60
2020-08-09 03:37:29,521 ----------------------------------------------------------------------------------------------------
2020-08-09 03:37:29,522 EPOCH 45 done: loss 0.1450 - lr 0.0031250
2020-08-09 03:38:04,448 DEV : loss 0.24436290562152863 - score 0.851
2020-08-09 03:38:05,800 BAD EPOCHS (no improvement): 1
2020-08-09 03:38:05,842 ----------------------------------------------------------------------------------------------------
2020-08-09 03:39:00,010 epoch 46 - iter 231/2312 - loss 0.14920133 - samples/sec: 136.56
2020-08-09 03:39:56,039 epoch 46 - iter 462/2312 - loss 0.14975816 - samples/sec: 133.70
2020-08-09 03:40:52,167 epoch 46 - iter 693/2312 - loss 0.14431739 - samples/sec: 134.41
2020-08-09 03:41:45,455 epoch 46 - iter 924/2312 - loss 0.14536236 - samples/sec: 141.05
2020-08-09 03:42:37,529 epoch 46 - iter 1155/2312 - loss 0.14349514 - samples/sec: 146.36
2020-08-09 03:43:30,766 epoch 46 - iter 1386/2312 - loss 0.14418647 - samples/sec: 142.87
2020-08-09 03:44:24,004 epoch 46 - iter 1617/2312 - loss 0.14457743 - samples/sec: 142.47
2020-08-09 03:45:18,159 epoch 46 - iter 1848/2312 - loss 0.14419269 - samples/sec: 139.80
2020-08-09 03:46:19,004 epoch 46 - iter 2079/2312 - loss 0.14441391 - samples/sec: 123.39
2020-08-09 03:47:20,008 epoch 46 - iter 2310/2312 - loss 0.14379007 - samples/sec: 123.27
2020-08-09 03:47:21,935 ----------------------------------------------------------------------------------------------------
2020-08-09 03:47:21,935 EPOCH 46 done: loss 0.1437 - lr 0.0031250
2020-08-09 03:47:57,171 DEV : loss 0.24742981791496277 - score 0.8514
2020-08-09 03:47:58,476 BAD EPOCHS (no improvement): 2
2020-08-09 03:47:58,482 ----------------------------------------------------------------------------------------------------
2020-08-09 03:48:53,281 epoch 47 - iter 231/2312 - loss 0.15306898 - samples/sec: 134.97
2020-08-09 03:49:49,066 epoch 47 - iter 462/2312 - loss 0.14580390 - samples/sec: 136.08
2020-08-09 03:50:42,766 epoch 47 - iter 693/2312 - loss 0.14847154 - samples/sec: 141.15
2020-08-09 03:51:35,352 epoch 47 - iter 924/2312 - loss 0.14787104 - samples/sec: 143.83
2020-08-09 03:52:29,555 epoch 47 - iter 1155/2312 - loss 0.14475905 - samples/sec: 139.59
2020-08-09 03:53:24,432 epoch 47 - iter 1386/2312 - loss 0.14414010 - samples/sec: 137.77
2020-08-09 03:54:20,055 epoch 47 - iter 1617/2312 - loss 0.14380850 - samples/sec: 136.40
2020-08-09 03:55:14,933 epoch 47 - iter 1848/2312 - loss 0.14247062 - samples/sec: 138.08
2020-08-09 03:56:09,229 epoch 47 - iter 2079/2312 - loss 0.14261696 - samples/sec: 139.55
2020-08-09 03:57:05,735 epoch 47 - iter 2310/2312 - loss 0.14263450 - samples/sec: 134.16
2020-08-09 03:57:07,208 ----------------------------------------------------------------------------------------------------
2020-08-09 03:57:07,208 EPOCH 47 done: loss 0.1426 - lr 0.0031250
2020-08-09 03:57:41,962 DEV : loss 0.24743004143238068 - score 0.8513
2020-08-09 03:57:43,304 BAD EPOCHS (no improvement): 3
2020-08-09 03:57:43,311 ----------------------------------------------------------------------------------------------------
2020-08-09 03:58:37,204 epoch 48 - iter 231/2312 - loss 0.15222252 - samples/sec: 137.26
2020-08-09 03:59:32,079 epoch 48 - iter 462/2312 - loss 0.14063165 - samples/sec: 138.32
2020-08-09 04:00:40,948 epoch 48 - iter 693/2312 - loss 0.14249655 - samples/sec: 109.84
2020-08-09 04:01:38,251 epoch 48 - iter 924/2312 - loss 0.14082942 - samples/sec: 132.54
2020-08-09 04:02:31,010 epoch 48 - iter 1155/2312 - loss 0.13956815 - samples/sec: 143.50
2020-08-09 04:03:25,472 epoch 48 - iter 1386/2312 - loss 0.14208276 - samples/sec: 139.05
2020-08-09 04:04:18,776 epoch 48 - iter 1617/2312 - loss 0.14122083 - samples/sec: 142.09
2020-08-09 04:05:13,613 epoch 48 - iter 1848/2312 - loss 0.14263144 - samples/sec: 137.44
2020-08-09 04:06:09,141 epoch 48 - iter 2079/2312 - loss 0.14204048 - samples/sec: 134.74
2020-08-09 04:07:06,643 epoch 48 - iter 2310/2312 - loss 0.14233184 - samples/sec: 130.28
2020-08-09 04:07:08,028 ----------------------------------------------------------------------------------------------------
2020-08-09 04:07:08,028 EPOCH 48 done: loss 0.1422 - lr 0.0031250
2020-08-09 04:07:49,896 DEV : loss 0.24767249822616577 - score 0.8529
2020-08-09 04:07:51,753 BAD EPOCHS (no improvement): 4
2020-08-09 04:07:51,775 ----------------------------------------------------------------------------------------------------
2020-08-09 04:08:54,154 epoch 49 - iter 231/2312 - loss 0.13034037 - samples/sec: 118.57
2020-08-09 04:09:52,991 epoch 49 - iter 462/2312 - loss 0.13434827 - samples/sec: 127.36
2020-08-09 04:10:50,713 epoch 49 - iter 693/2312 - loss 0.13882726 - samples/sec: 130.01
2020-08-09 04:11:45,750 epoch 49 - iter 924/2312 - loss 0.14089033 - samples/sec: 136.53
2020-08-09 04:12:39,239 epoch 49 - iter 1155/2312 - loss 0.14065609 - samples/sec: 140.51
2020-08-09 04:13:31,675 epoch 49 - iter 1386/2312 - loss 0.13983815 - samples/sec: 144.36
2020-08-09 04:14:26,771 epoch 49 - iter 1617/2312 - loss 0.14171060 - samples/sec: 137.10
2020-08-09 04:15:23,874 epoch 49 - iter 1848/2312 - loss 0.14234653 - samples/sec: 132.79
2020-08-09 04:16:19,604 epoch 49 - iter 2079/2312 - loss 0.14333239 - samples/sec: 136.02
2020-08-09 04:17:16,524 epoch 49 - iter 2310/2312 - loss 0.14340207 - samples/sec: 133.69
2020-08-09 04:17:18,966 ----------------------------------------------------------------------------------------------------
2020-08-09 04:17:18,967 EPOCH 49 done: loss 0.1433 - lr 0.0015625
2020-08-09 04:17:53,988 DEV : loss 0.2468198835849762 - score 0.8536
2020-08-09 04:17:55,340 BAD EPOCHS (no improvement): 1
2020-08-09 04:17:55,376 ----------------------------------------------------------------------------------------------------
2020-08-09 04:18:48,146 epoch 50 - iter 231/2312 - loss 0.13730313 - samples/sec: 140.18
2020-08-09 04:19:44,783 epoch 50 - iter 462/2312 - loss 0.14278336 - samples/sec: 133.60
2020-08-09 04:20:41,085 epoch 50 - iter 693/2312 - loss 0.14067417 - samples/sec: 135.44
2020-08-09 04:21:41,339 epoch 50 - iter 924/2312 - loss 0.14411599 - samples/sec: 124.87
2020-08-09 04:22:38,332 epoch 50 - iter 1155/2312 - loss 0.14538688 - samples/sec: 132.02
2020-08-09 04:23:35,099 epoch 50 - iter 1386/2312 - loss 0.14583037 - samples/sec: 132.97
2020-08-09 04:24:34,473 epoch 50 - iter 1617/2312 - loss 0.14458996 - samples/sec: 126.21
2020-08-09 04:25:28,475 epoch 50 - iter 1848/2312 - loss 0.14513445 - samples/sec: 139.85
2020-08-09 04:26:22,428 epoch 50 - iter 2079/2312 - loss 0.14171182 - samples/sec: 139.26
2020-08-09 04:27:17,208 epoch 50 - iter 2310/2312 - loss 0.14171392 - samples/sec: 136.87
2020-08-09 04:27:18,215 ----------------------------------------------------------------------------------------------------
2020-08-09 04:27:18,216 EPOCH 50 done: loss 0.1416 - lr 0.0015625
2020-08-09 04:27:53,248 DEV : loss 0.2474118173122406 - score 0.8509
2020-08-09 04:27:54,595 BAD EPOCHS (no improvement): 2
2020-08-09 04:27:54,602 ----------------------------------------------------------------------------------------------------
2020-08-09 04:28:47,721 epoch 51 - iter 231/2312 - loss 0.13315830 - samples/sec: 139.25
2020-08-09 04:29:41,455 epoch 51 - iter 462/2312 - loss 0.14104186 - samples/sec: 141.90
2020-08-09 04:30:34,507 epoch 51 - iter 693/2312 - loss 0.14457010 - samples/sec: 141.15
2020-08-09 04:31:26,812 epoch 51 - iter 924/2312 - loss 0.14404808 - samples/sec: 144.67
2020-08-09 04:32:21,086 epoch 51 - iter 1155/2312 - loss 0.14409508 - samples/sec: 138.47
2020-08-09 04:33:12,591 epoch 51 - iter 1386/2312 - loss 0.14333291 - samples/sec: 145.49
2020-08-09 04:34:20,819 epoch 51 - iter 1617/2312 - loss 0.14125298 - samples/sec: 110.55
2020-08-09 04:35:12,883 epoch 51 - iter 1848/2312 - loss 0.14125404 - samples/sec: 144.21
2020-08-09 04:36:05,225 epoch 51 - iter 2079/2312 - loss 0.14121925 - samples/sec: 144.00
2020-08-09 04:37:00,508 epoch 51 - iter 2310/2312 - loss 0.14255527 - samples/sec: 135.55
2020-08-09 04:37:01,507 ----------------------------------------------------------------------------------------------------
2020-08-09 04:37:01,507 EPOCH 51 done: loss 0.1425 - lr 0.0015625
2020-08-09 04:37:36,522 DEV : loss 0.2477222979068756 - score 0.852
2020-08-09 04:37:37,866 BAD EPOCHS (no improvement): 3
2020-08-09 04:37:37,872 ----------------------------------------------------------------------------------------------------
2020-08-09 04:38:32,577 epoch 52 - iter 231/2312 - loss 0.13664465 - samples/sec: 135.22
2020-08-09 04:39:26,298 epoch 52 - iter 462/2312 - loss 0.13562089 - samples/sec: 139.37
2020-08-09 04:40:24,225 epoch 52 - iter 693/2312 - loss 0.13597965 - samples/sec: 131.04
2020-08-09 04:41:22,669 epoch 52 - iter 924/2312 - loss 0.13723986 - samples/sec: 131.27
2020-08-09 04:42:30,197 epoch 52 - iter 1155/2312 - loss 0.13696198 - samples/sec: 113.92
2020-08-09 04:43:34,629 epoch 52 - iter 1386/2312 - loss 0.13744349 - samples/sec: 116.35
2020-08-09 04:44:37,169 epoch 52 - iter 1617/2312 - loss 0.13896408 - samples/sec: 119.59
2020-08-09 04:45:31,524 epoch 52 - iter 1848/2312 - loss 0.14069187 - samples/sec: 137.86
2020-08-09 04:46:27,791 epoch 52 - iter 2079/2312 - loss 0.14144069 - samples/sec: 133.00
2020-08-09 04:47:22,104 epoch 52 - iter 2310/2312 - loss 0.14131521 - samples/sec: 138.41
2020-08-09 04:47:23,315 ----------------------------------------------------------------------------------------------------
2020-08-09 04:47:23,315 EPOCH 52 done: loss 0.1413 - lr 0.0015625
2020-08-09 04:47:57,078 DEV : loss 0.24746547639369965 - score 0.852
2020-08-09 04:47:58,379 BAD EPOCHS (no improvement): 4
2020-08-09 04:47:58,386 ----------------------------------------------------------------------------------------------------
2020-08-09 04:48:50,930 epoch 53 - iter 231/2312 - loss 0.14893308 - samples/sec: 140.77
2020-08-09 04:49:45,983 epoch 53 - iter 462/2312 - loss 0.14271514 - samples/sec: 136.20
2020-08-09 04:50:41,647 epoch 53 - iter 693/2312 - loss 0.14452351 - samples/sec: 134.88
2020-08-09 04:51:37,988 epoch 53 - iter 924/2312 - loss 0.14361157 - samples/sec: 133.20
2020-08-09 04:52:32,263 epoch 53 - iter 1155/2312 - loss 0.14337197 - samples/sec: 138.20
2020-08-09 04:53:24,928 epoch 53 - iter 1386/2312 - loss 0.14302500 - samples/sec: 142.55
2020-08-09 04:54:19,861 epoch 53 - iter 1617/2312 - loss 0.14215888 - samples/sec: 136.17
2020-08-09 04:55:14,364 epoch 53 - iter 1848/2312 - loss 0.14261535 - samples/sec: 137.33
2020-08-09 04:56:10,469 epoch 53 - iter 2079/2312 - loss 0.14213528 - samples/sec: 133.37
2020-08-09 04:57:05,355 epoch 53 - iter 2310/2312 - loss 0.14085367 - samples/sec: 136.34
2020-08-09 04:57:06,680 ----------------------------------------------------------------------------------------------------
2020-08-09 04:57:06,681 EPOCH 53 done: loss 0.1408 - lr 0.0007813
2020-08-09 04:57:41,492 DEV : loss 0.24769380688667297 - score 0.8525
2020-08-09 04:57:42,838 BAD EPOCHS (no improvement): 1
2020-08-09 04:57:42,844 ----------------------------------------------------------------------------------------------------
2020-08-09 04:58:37,087 epoch 54 - iter 231/2312 - loss 0.15310741 - samples/sec: 136.37
2020-08-09 04:59:30,736 epoch 54 - iter 462/2312 - loss 0.15374206 - samples/sec: 139.90
2020-08-09 05:00:25,151 epoch 54 - iter 693/2312 - loss 0.14719065 - samples/sec: 138.01
2020-08-09 05:01:20,362 epoch 54 - iter 924/2312 - loss 0.14629073 - samples/sec: 138.31
2020-08-09 05:02:19,494 epoch 54 - iter 1155/2312 - loss 0.14616193 - samples/sec: 127.63
2020-08-09 05:03:21,470 epoch 54 - iter 1386/2312 - loss 0.14534199 - samples/sec: 122.14
2020-08-09 05:04:20,697 epoch 54 - iter 1617/2312 - loss 0.14420616 - samples/sec: 127.02
2020-08-09 05:05:20,827 epoch 54 - iter 1848/2312 - loss 0.14269677 - samples/sec: 125.01
2020-08-09 05:06:20,714 epoch 54 - iter 2079/2312 - loss 0.14348158 - samples/sec: 126.03
2020-08-09 05:07:17,686 epoch 54 - iter 2310/2312 - loss 0.14309231 - samples/sec: 132.18
2020-08-09 05:07:19,202 ----------------------------------------------------------------------------------------------------
2020-08-09 05:07:19,202 EPOCH 54 done: loss 0.1431 - lr 0.0007813
2020-08-09 05:08:05,685 DEV : loss 0.24853847920894623 - score 0.8525
2020-08-09 05:08:06,987 BAD EPOCHS (no improvement): 2
2020-08-09 05:08:07,013 ----------------------------------------------------------------------------------------------------
2020-08-09 05:09:01,904 epoch 55 - iter 231/2312 - loss 0.13345455 - samples/sec: 134.76
2020-08-09 05:09:54,625 epoch 55 - iter 462/2312 - loss 0.13083731 - samples/sec: 143.33
2020-08-09 05:10:48,154 epoch 55 - iter 693/2312 - loss 0.13607189 - samples/sec: 140.55
2020-08-09 05:11:46,729 epoch 55 - iter 924/2312 - loss 0.13613547 - samples/sec: 128.53
2020-08-09 05:12:39,443 epoch 55 - iter 1155/2312 - loss 0.13755669 - samples/sec: 143.11
2020-08-09 05:13:35,493 epoch 55 - iter 1386/2312 - loss 0.13681892 - samples/sec: 137.11
2020-08-09 05:14:30,592 epoch 55 - iter 1617/2312 - loss 0.13666996 - samples/sec: 136.43
2020-08-09 05:15:26,965 epoch 55 - iter 1848/2312 - loss 0.13556332 - samples/sec: 133.21
2020-08-09 05:16:22,144 epoch 55 - iter 2079/2312 - loss 0.13754932 - samples/sec: 136.96
2020-08-09 05:17:15,458 epoch 55 - iter 2310/2312 - loss 0.13914072 - samples/sec: 141.37
2020-08-09 05:17:16,647 ----------------------------------------------------------------------------------------------------
2020-08-09 05:17:16,648 EPOCH 55 done: loss 0.1391 - lr 0.0007813
2020-08-09 05:17:51,424 DEV : loss 0.24829474091529846 - score 0.8511
2020-08-09 05:17:52,771 BAD EPOCHS (no improvement): 3
2020-08-09 05:17:52,804 ----------------------------------------------------------------------------------------------------
2020-08-09 05:18:45,680 epoch 56 - iter 231/2312 - loss 0.15392565 - samples/sec: 139.90
2020-08-09 05:19:42,593 epoch 56 - iter 462/2312 - loss 0.14406433 - samples/sec: 131.80
2020-08-09 05:20:37,096 epoch 56 - iter 693/2312 - loss 0.14148399 - samples/sec: 137.39
2020-08-09 05:21:32,380 epoch 56 - iter 924/2312 - loss 0.14218611 - samples/sec: 135.78
2020-08-09 05:22:26,533 epoch 56 - iter 1155/2312 - loss 0.14366126 - samples/sec: 138.76
2020-08-09 05:23:21,238 epoch 56 - iter 1386/2312 - loss 0.14117462 - samples/sec: 137.97
2020-08-09 05:24:16,169 epoch 56 - iter 1617/2312 - loss 0.14068610 - samples/sec: 136.30
2020-08-09 05:25:11,798 epoch 56 - iter 1848/2312 - loss 0.14067616 - samples/sec: 134.66
2020-08-09 05:26:05,922 epoch 56 - iter 2079/2312 - loss 0.14120276 - samples/sec: 138.59
2020-08-09 05:26:59,481 epoch 56 - iter 2310/2312 - loss 0.14072429 - samples/sec: 140.10
2020-08-09 05:27:00,622 ----------------------------------------------------------------------------------------------------
2020-08-09 05:27:00,622 EPOCH 56 done: loss 0.1408 - lr 0.0007813
2020-08-09 05:27:36,086 DEV : loss 0.24732980132102966 - score 0.8531
2020-08-09 05:27:37,431 BAD EPOCHS (no improvement): 4
2020-08-09 05:27:37,466 ----------------------------------------------------------------------------------------------------
2020-08-09 05:28:32,237 epoch 57 - iter 231/2312 - loss 0.13925057 - samples/sec: 135.05
2020-08-09 05:29:26,809 epoch 57 - iter 462/2312 - loss 0.13548900 - samples/sec: 137.53
2020-08-09 05:30:20,235 epoch 57 - iter 693/2312 - loss 0.13134217 - samples/sec: 140.49
2020-08-09 05:31:14,395 epoch 57 - iter 924/2312 - loss 0.13321794 - samples/sec: 138.62
2020-08-09 05:32:08,797 epoch 57 - iter 1155/2312 - loss 0.13514182 - samples/sec: 137.82
2020-08-09 05:33:02,466 epoch 57 - iter 1386/2312 - loss 0.13797825 - samples/sec: 139.99
2020-08-09 05:33:57,507 epoch 57 - iter 1617/2312 - loss 0.13940971 - samples/sec: 136.27
2020-08-09 05:34:52,316 epoch 57 - iter 1848/2312 - loss 0.14062516 - samples/sec: 137.02
2020-08-09 05:35:46,902 epoch 57 - iter 2079/2312 - loss 0.14060588 - samples/sec: 137.44
2020-08-09 05:36:42,214 epoch 57 - iter 2310/2312 - loss 0.14118206 - samples/sec: 136.01
2020-08-09 05:36:43,375 ----------------------------------------------------------------------------------------------------
2020-08-09 05:36:43,375 EPOCH 57 done: loss 0.1411 - lr 0.0003906
2020-08-09 05:37:30,738 DEV : loss 0.24793939292430878 - score 0.8514
2020-08-09 05:37:32,084 BAD EPOCHS (no improvement): 1
2020-08-09 05:37:32,126 ----------------------------------------------------------------------------------------------------
2020-08-09 05:38:24,695 epoch 58 - iter 231/2312 - loss 0.14019502 - samples/sec: 140.71
2020-08-09 05:39:18,529 epoch 58 - iter 462/2312 - loss 0.14348966 - samples/sec: 139.03
2020-08-09 05:40:13,261 epoch 58 - iter 693/2312 - loss 0.14165050 - samples/sec: 136.88
2020-08-09 05:41:09,151 epoch 58 - iter 924/2312 - loss 0.14124375 - samples/sec: 134.09
2020-08-09 05:42:06,194 epoch 58 - iter 1155/2312 - loss 0.14174807 - samples/sec: 131.24
2020-08-09 05:43:00,303 epoch 58 - iter 1386/2312 - loss 0.13999968 - samples/sec: 138.53
2020-08-09 05:43:54,187 epoch 58 - iter 1617/2312 - loss 0.14071788 - samples/sec: 139.07
2020-08-09 05:44:48,760 epoch 58 - iter 1848/2312 - loss 0.14066501 - samples/sec: 137.09
2020-08-09 05:45:43,350 epoch 58 - iter 2079/2312 - loss 0.14079361 - samples/sec: 137.13
2020-08-09 05:46:37,384 epoch 58 - iter 2310/2312 - loss 0.14086222 - samples/sec: 138.93
2020-08-09 05:46:38,431 ----------------------------------------------------------------------------------------------------
2020-08-09 05:46:38,431 EPOCH 58 done: loss 0.1408 - lr 0.0003906
2020-08-09 05:47:13,429 DEV : loss 0.24827949702739716 - score 0.8512
2020-08-09 05:47:14,792 BAD EPOCHS (no improvement): 2
2020-08-09 05:47:14,808 ----------------------------------------------------------------------------------------------------
2020-08-09 05:48:08,509 epoch 59 - iter 231/2312 - loss 0.13833509 - samples/sec: 137.75
2020-08-09 05:49:08,289 epoch 59 - iter 462/2312 - loss 0.13988377 - samples/sec: 125.21
2020-08-09 05:50:12,923 epoch 59 - iter 693/2312 - loss 0.13877480 - samples/sec: 115.68
2020-08-09 05:51:12,203 epoch 59 - iter 924/2312 - loss 0.14008040 - samples/sec: 126.31
2020-08-09 05:52:06,577 epoch 59 - iter 1155/2312 - loss 0.14058730 - samples/sec: 137.69
2020-08-09 05:53:01,999 epoch 59 - iter 1386/2312 - loss 0.13913588 - samples/sec: 135.32
2020-08-09 05:53:57,119 epoch 59 - iter 1617/2312 - loss 0.14074314 - samples/sec: 135.91
2020-08-09 05:54:48,887 epoch 59 - iter 1848/2312 - loss 0.14155079 - samples/sec: 144.71
2020-08-09 05:55:43,486 epoch 59 - iter 2079/2312 - loss 0.14260234 - samples/sec: 137.27
2020-08-09 05:56:40,021 epoch 59 - iter 2310/2312 - loss 0.14209575 - samples/sec: 133.06
2020-08-09 05:56:41,134 ----------------------------------------------------------------------------------------------------
2020-08-09 05:56:41,134 EPOCH 59 done: loss 0.1420 - lr 0.0003906
2020-08-09 05:57:14,992 DEV : loss 0.24843651056289673 - score 0.8512
2020-08-09 05:57:16,299 BAD EPOCHS (no improvement): 3
2020-08-09 05:57:16,305 ----------------------------------------------------------------------------------------------------
2020-08-09 05:58:07,591 epoch 60 - iter 231/2312 - loss 0.14108015 - samples/sec: 144.22
2020-08-09 05:59:02,190 epoch 60 - iter 462/2312 - loss 0.13616990 - samples/sec: 137.42
2020-08-09 05:59:56,157 epoch 60 - iter 693/2312 - loss 0.13795023 - samples/sec: 138.76
2020-08-09 06:00:48,251 epoch 60 - iter 924/2312 - loss 0.14241573 - samples/sec: 144.00
2020-08-09 06:01:44,282 epoch 60 - iter 1155/2312 - loss 0.14324853 - samples/sec: 136.23
2020-08-09 06:02:38,094 epoch 60 - iter 1386/2312 - loss 0.14195040 - samples/sec: 141.09
2020-08-09 06:03:29,611 epoch 60 - iter 1617/2312 - loss 0.14162766 - samples/sec: 147.12
2020-08-09 06:04:22,057 epoch 60 - iter 1848/2312 - loss 0.13891636 - samples/sec: 143.21
2020-08-09 06:05:18,030 epoch 60 - iter 2079/2312 - loss 0.13928809 - samples/sec: 134.26
2020-08-09 06:06:11,462 epoch 60 - iter 2310/2312 - loss 0.14125642 - samples/sec: 141.65
2020-08-09 06:06:12,497 ----------------------------------------------------------------------------------------------------
2020-08-09 06:06:12,498 EPOCH 60 done: loss 0.1412 - lr 0.0003906
2020-08-09 06:06:45,658 DEV : loss 0.24755670130252838 - score 0.8514
2020-08-09 06:06:46,959 BAD EPOCHS (no improvement): 4
2020-08-09 06:06:46,991 ----------------------------------------------------------------------------------------------------
2020-08-09 06:07:38,024 epoch 61 - iter 231/2312 - loss 0.13530596 - samples/sec: 144.94
2020-08-09 06:08:30,343 epoch 61 - iter 462/2312 - loss 0.13687589 - samples/sec: 143.61
2020-08-09 06:09:23,461 epoch 61 - iter 693/2312 - loss 0.13619531 - samples/sec: 141.63
2020-08-09 06:10:16,309 epoch 61 - iter 924/2312 - loss 0.13519620 - samples/sec: 142.71
2020-08-09 06:11:21,991 epoch 61 - iter 1155/2312 - loss 0.13919410 - samples/sec: 113.96
2020-08-09 06:12:18,545 epoch 61 - iter 1386/2312 - loss 0.14015718 - samples/sec: 132.87
2020-08-09 06:13:11,886 epoch 61 - iter 1617/2312 - loss 0.14113679 - samples/sec: 140.66
2020-08-09 06:14:04,721 epoch 61 - iter 1848/2312 - loss 0.14066971 - samples/sec: 141.66
2020-08-09 06:14:56,143 epoch 61 - iter 2079/2312 - loss 0.14096783 - samples/sec: 145.73
2020-08-09 06:15:50,196 epoch 61 - iter 2310/2312 - loss 0.14051664 - samples/sec: 138.61
2020-08-09 06:15:51,333 ----------------------------------------------------------------------------------------------------
2020-08-09 06:15:51,333 EPOCH 61 done: loss 0.1404 - lr 0.0001953
2020-08-09 06:16:26,352 DEV : loss 0.2472342550754547 - score 0.852
2020-08-09 06:16:27,700 BAD EPOCHS (no improvement): 1
2020-08-09 06:16:27,745 ----------------------------------------------------------------------------------------------------
2020-08-09 06:17:19,767 epoch 62 - iter 231/2312 - loss 0.13900988 - samples/sec: 142.19
2020-08-09 06:18:14,685 epoch 62 - iter 462/2312 - loss 0.13624260 - samples/sec: 136.58
2020-08-09 06:19:17,564 epoch 62 - iter 693/2312 - loss 0.13641660 - samples/sec: 119.07
2020-08-09 06:20:09,656 epoch 62 - iter 924/2312 - loss 0.13871846 - samples/sec: 145.23
2020-08-09 06:21:10,058 epoch 62 - iter 1155/2312 - loss 0.14266811 - samples/sec: 123.84
2020-08-09 06:22:12,204 epoch 62 - iter 1386/2312 - loss 0.14272764 - samples/sec: 120.58
2020-08-09 06:23:05,371 epoch 62 - iter 1617/2312 - loss 0.14405924 - samples/sec: 141.20
2020-08-09 06:23:58,339 epoch 62 - iter 1848/2312 - loss 0.14164070 - samples/sec: 141.62
2020-08-09 06:24:56,696 epoch 62 - iter 2079/2312 - loss 0.14234394 - samples/sec: 128.41
2020-08-09 06:25:52,690 epoch 62 - iter 2310/2312 - loss 0.14351287 - samples/sec: 133.74
2020-08-09 06:25:53,842 ----------------------------------------------------------------------------------------------------
2020-08-09 06:25:53,842 EPOCH 62 done: loss 0.1434 - lr 0.0001953
2020-08-09 06:26:29,161 DEV : loss 0.2474447339773178 - score 0.8522
2020-08-09 06:26:30,509 BAD EPOCHS (no improvement): 2
2020-08-09 06:26:30,512 ----------------------------------------------------------------------------------------------------
2020-08-09 06:27:25,038 epoch 63 - iter 231/2312 - loss 0.14495055 - samples/sec: 135.66
2020-08-09 06:28:20,843 epoch 63 - iter 462/2312 - loss 0.14593226 - samples/sec: 134.17
2020-08-09 06:29:17,734 epoch 63 - iter 693/2312 - loss 0.14135100 - samples/sec: 131.57
2020-08-09 06:30:11,046 epoch 63 - iter 924/2312 - loss 0.14099638 - samples/sec: 140.92
2020-08-09 06:31:06,023 epoch 63 - iter 1155/2312 - loss 0.13928901 - samples/sec: 137.43
2020-08-09 06:32:00,291 epoch 63 - iter 1386/2312 - loss 0.13925823 - samples/sec: 138.24
2020-08-09 06:32:55,066 epoch 63 - iter 1617/2312 - loss 0.13927019 - samples/sec: 136.67
2020-08-09 06:33:50,349 epoch 63 - iter 1848/2312 - loss 0.14047089 - samples/sec: 136.16
2020-08-09 06:34:44,462 epoch 63 - iter 2079/2312 - loss 0.14038490 - samples/sec: 138.39
2020-08-09 06:35:38,221 epoch 63 - iter 2310/2312 - loss 0.14068043 - samples/sec: 139.59
2020-08-09 06:35:40,168 ----------------------------------------------------------------------------------------------------
2020-08-09 06:35:40,169 EPOCH 63 done: loss 0.1406 - lr 0.0001953
2020-08-09 06:36:15,051 DEV : loss 0.24776850640773773 - score 0.8517
2020-08-09 06:36:16,395 BAD EPOCHS (no improvement): 3
2020-08-09 06:36:16,425 ----------------------------------------------------------------------------------------------------
2020-08-09 06:37:10,633 epoch 64 - iter 231/2312 - loss 0.15094020 - samples/sec: 136.46
2020-08-09 06:38:03,723 epoch 64 - iter 462/2312 - loss 0.14347527 - samples/sec: 141.44
2020-08-09 06:38:56,431 epoch 64 - iter 693/2312 - loss 0.14464103 - samples/sec: 142.33
2020-08-09 06:39:51,056 epoch 64 - iter 924/2312 - loss 0.14314914 - samples/sec: 137.41
2020-08-09 06:40:44,456 epoch 64 - iter 1155/2312 - loss 0.14329662 - samples/sec: 140.61
2020-08-09 06:41:37,849 epoch 64 - iter 1386/2312 - loss 0.14125143 - samples/sec: 141.61
2020-08-09 06:42:31,599 epoch 64 - iter 1617/2312 - loss 0.14267589 - samples/sec: 139.82
2020-08-09 06:43:29,648 epoch 64 - iter 1848/2312 - loss 0.14299440 - samples/sec: 129.11
2020-08-09 06:44:28,617 epoch 64 - iter 2079/2312 - loss 0.14183402 - samples/sec: 126.89
2020-08-09 06:45:42,169 epoch 64 - iter 2310/2312 - loss 0.14131021 - samples/sec: 101.56
2020-08-09 06:45:43,253 ----------------------------------------------------------------------------------------------------
2020-08-09 06:45:43,254 EPOCH 64 done: loss 0.1413 - lr 0.0001953
2020-08-09 06:46:18,397 DEV : loss 0.24811413884162903 - score 0.852
2020-08-09 06:46:19,744 BAD EPOCHS (no improvement): 4
2020-08-09 06:46:19,747 ----------------------------------------------------------------------------------------------------
2020-08-09 06:46:19,747 ----------------------------------------------------------------------------------------------------
2020-08-09 06:46:19,747 learning rate too small - quitting training!
2020-08-09 06:46:19,747 ----------------------------------------------------------------------------------------------------
2020-08-09 06:46:41,826 ----------------------------------------------------------------------------------------------------
2020-08-09 06:46:41,826 Testing using best model ...
2020-08-09 06:46:41,827 loading file new_models/huner-species/best-model.pt
2020-08-09 06:48:16,072 0.9199	0.9491	0.9343
2020-08-09 06:48:16,072 
Results:
- F1-score (micro) 0.9343
- F1-score (macro) 0.9343

By class:
Species    tp: 6119 - fp: 533 - fn: 328 - precision: 0.9199 - recall: 0.9491 - f1-score: 0.9343
2020-08-09 06:48:16,072 ----------------------------------------------------------------------------------------------------