2020-08-05 14:08:04,593 ----------------------------------------------------------------------------------------------------
2020-08-05 14:08:04,593 Model: "SequenceTagger(
  (embeddings): StackedEmbeddings(
    (list_embedding_0): WordEmbeddings('pubmed_pmc_wiki_sg_1M.gensim')
    (list_embedding_1): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
    (list_embedding_2): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
  )
  (word_dropout): WordDropout(p=0.05)
  (locked_dropout): LockedDropout(p=0.5)
  (embedding2nn): Linear(in_features=4296, out_features=4296, bias=True)
  (rnn): LSTM(4296, 256, batch_first=True, bidirectional=True)
  (linear): Linear(in_features=512, out_features=8, bias=True)
  (beta): 1.0
  (weights): None
  (weight_tensor) None
)"
2020-08-05 14:08:04,594 ----------------------------------------------------------------------------------------------------
2020-08-05 14:08:04,594 Corpus: "Corpus: 3593 train + 1781 dev + 623 test sentences
Corpus: 8602 train + 1395 dev + 4493 test sentences
Corpus: 29261 train + 4788 dev + 14753 test sentences
Corpus: 8000 train + 1237 dev + 3967 test sentences
Corpus: 52614 train + 8684 dev + 26280 test sentences
Corpus: 19657 train + 1975 dev + 5895 test sentences
Corpus: 560 train + 97 dev + 273 test sentences"
2020-08-05 14:08:04,594 ----------------------------------------------------------------------------------------------------
2020-08-05 14:08:04,594 Parameters:
2020-08-05 14:08:04,594  - learning_rate: "0.1"
2020-08-05 14:08:04,594  - mini_batch_size: "32"
2020-08-05 14:08:04,594  - patience: "3"
2020-08-05 14:08:04,594  - anneal_factor: "0.5"
2020-08-05 14:08:04,594  - max_epochs: "200"
2020-08-05 14:08:04,594  - shuffle: "True"
2020-08-05 14:08:04,595  - train_with_dev: "False"
2020-08-05 14:08:04,595  - batch_growth_annealing: "False"
2020-08-05 14:08:04,595 ----------------------------------------------------------------------------------------------------
2020-08-05 14:08:04,595 Model training base path: "new_models/huner-chemical"
2020-08-05 14:08:04,595 ----------------------------------------------------------------------------------------------------
2020-08-05 14:08:04,595 Device: cuda:0
2020-08-05 14:08:04,595 ----------------------------------------------------------------------------------------------------
2020-08-05 14:08:04,595 Embeddings storage mode: cpu
2020-08-05 14:08:04,604 ----------------------------------------------------------------------------------------------------
2020-08-05 14:12:02,022 epoch 1 - iter 558/5581 - loss 3.01029729 - samples/sec: 75.24
2020-08-05 14:16:04,146 epoch 1 - iter 1116/5581 - loss 2.30953040 - samples/sec: 74.05
2020-08-05 14:20:17,192 epoch 1 - iter 1674/5581 - loss 1.99346515 - samples/sec: 70.86
2020-08-05 14:24:23,796 epoch 1 - iter 2232/5581 - loss 1.81911271 - samples/sec: 72.69
2020-08-05 14:28:24,587 epoch 1 - iter 2790/5581 - loss 1.69503966 - samples/sec: 74.44
2020-08-05 14:32:33,249 epoch 1 - iter 3348/5581 - loss 1.60671498 - samples/sec: 72.17
2020-08-05 14:36:55,943 epoch 1 - iter 3906/5581 - loss 1.54433203 - samples/sec: 68.25
2020-08-05 14:41:05,153 epoch 1 - iter 4464/5581 - loss 1.48944633 - samples/sec: 71.91
2020-08-05 14:45:12,278 epoch 1 - iter 5022/5581 - loss 1.44708855 - samples/sec: 72.51
2020-08-05 14:49:23,982 epoch 1 - iter 5580/5581 - loss 1.41579771 - samples/sec: 71.17
2020-08-05 14:49:25,131 ----------------------------------------------------------------------------------------------------
2020-08-05 14:49:25,132 EPOCH 1 done: loss 1.4158 - lr 0.1000000
2020-08-05 14:53:05,144 DEV : loss 0.8676663041114807 - score 0.8189
2020-08-05 14:53:07,756 BAD EPOCHS (no improvement): 0
2020-08-05 14:53:27,058 ----------------------------------------------------------------------------------------------------
2020-08-05 14:55:39,495 epoch 2 - iter 558/5581 - loss 1.09752413 - samples/sec: 134.94
2020-08-05 14:57:49,546 epoch 2 - iter 1116/5581 - loss 1.06114460 - samples/sec: 138.30
2020-08-05 14:59:56,688 epoch 2 - iter 1674/5581 - loss 1.04314304 - samples/sec: 141.65
2020-08-05 15:02:08,444 epoch 2 - iter 2232/5581 - loss 1.03437022 - samples/sec: 136.50
2020-08-05 15:04:16,797 epoch 2 - iter 2790/5581 - loss 1.03065064 - samples/sec: 140.31
2020-08-05 15:06:28,877 epoch 2 - iter 3348/5581 - loss 1.03215194 - samples/sec: 136.27
2020-08-05 15:08:37,368 epoch 2 - iter 3906/5581 - loss 1.02123819 - samples/sec: 139.86
2020-08-05 15:10:57,817 epoch 2 - iter 4464/5581 - loss 1.01782228 - samples/sec: 128.26
2020-08-05 15:13:24,515 epoch 2 - iter 5022/5581 - loss 1.01170939 - samples/sec: 122.51
2020-08-05 15:15:55,207 epoch 2 - iter 5580/5581 - loss 1.00609835 - samples/sec: 119.24
2020-08-05 15:15:56,131 ----------------------------------------------------------------------------------------------------
2020-08-05 15:15:56,131 EPOCH 2 done: loss 1.0061 - lr 0.1000000
2020-08-05 15:17:24,746 DEV : loss 0.7661800980567932 - score 0.8396
2020-08-05 15:17:27,734 BAD EPOCHS (no improvement): 0
2020-08-05 15:17:46,503 ----------------------------------------------------------------------------------------------------
2020-08-05 15:20:10,137 epoch 3 - iter 558/5581 - loss 0.95724957 - samples/sec: 124.42
2020-08-05 15:22:26,218 epoch 3 - iter 1116/5581 - loss 0.94406973 - samples/sec: 132.12
2020-08-05 15:24:36,413 epoch 3 - iter 1674/5581 - loss 0.94440341 - samples/sec: 138.13
2020-08-05 15:26:45,905 epoch 3 - iter 2232/5581 - loss 0.94189658 - samples/sec: 138.92
2020-08-05 15:28:56,532 epoch 3 - iter 2790/5581 - loss 0.94237969 - samples/sec: 137.57
2020-08-05 15:31:06,229 epoch 3 - iter 3348/5581 - loss 0.94093050 - samples/sec: 138.49
2020-08-05 15:33:16,753 epoch 3 - iter 3906/5581 - loss 0.93718897 - samples/sec: 137.60
2020-08-05 15:35:27,331 epoch 3 - iter 4464/5581 - loss 0.93304583 - samples/sec: 137.73
2020-08-05 15:37:38,441 epoch 3 - iter 5022/5581 - loss 0.93089335 - samples/sec: 136.95
2020-08-05 15:39:49,245 epoch 3 - iter 5580/5581 - loss 0.92673063 - samples/sec: 137.33
2020-08-05 15:39:50,271 ----------------------------------------------------------------------------------------------------
2020-08-05 15:39:50,271 EPOCH 3 done: loss 0.9267 - lr 0.1000000
2020-08-05 15:40:58,700 DEV : loss 0.7327264547348022 - score 0.8489
2020-08-05 15:41:01,321 BAD EPOCHS (no improvement): 0
2020-08-05 15:41:20,852 ----------------------------------------------------------------------------------------------------
2020-08-05 15:43:30,068 epoch 4 - iter 558/5581 - loss 0.89430381 - samples/sec: 138.31
2020-08-05 15:45:43,707 epoch 4 - iter 1116/5581 - loss 0.91528392 - samples/sec: 134.41
2020-08-05 15:48:06,182 epoch 4 - iter 1674/5581 - loss 0.91060127 - samples/sec: 126.12
2020-08-05 15:50:29,899 epoch 4 - iter 2232/5581 - loss 0.90171497 - samples/sec: 124.97
2020-08-05 15:52:43,944 epoch 4 - iter 2790/5581 - loss 0.90566793 - samples/sec: 134.02
2020-08-05 15:54:53,132 epoch 4 - iter 3348/5581 - loss 0.89686180 - samples/sec: 139.13
2020-08-05 15:57:01,299 epoch 4 - iter 3906/5581 - loss 0.88997787 - samples/sec: 140.28
2020-08-05 15:59:31,420 epoch 4 - iter 4464/5581 - loss 0.88573831 - samples/sec: 119.70
2020-08-05 16:01:40,174 epoch 4 - iter 5022/5581 - loss 0.88379774 - samples/sec: 139.62
2020-08-05 16:03:51,952 epoch 4 - iter 5580/5581 - loss 0.88596080 - samples/sec: 136.57
2020-08-05 16:03:53,184 ----------------------------------------------------------------------------------------------------
2020-08-05 16:03:53,185 EPOCH 4 done: loss 0.8858 - lr 0.1000000
2020-08-05 16:05:00,800 DEV : loss 0.7218348979949951 - score 0.852
2020-08-05 16:05:03,232 BAD EPOCHS (no improvement): 0
2020-08-05 16:05:22,453 ----------------------------------------------------------------------------------------------------
2020-08-05 16:07:29,479 epoch 5 - iter 558/5581 - loss 0.80601896 - samples/sec: 140.71
2020-08-05 16:09:36,699 epoch 5 - iter 1116/5581 - loss 0.82797124 - samples/sec: 141.31
2020-08-05 16:11:52,517 epoch 5 - iter 1674/5581 - loss 0.82351330 - samples/sec: 132.31
2020-08-05 16:14:15,798 epoch 5 - iter 2232/5581 - loss 0.84842077 - samples/sec: 125.30
2020-08-05 16:16:40,401 epoch 5 - iter 2790/5581 - loss 0.84600318 - samples/sec: 124.24
2020-08-05 16:19:07,015 epoch 5 - iter 3348/5581 - loss 0.84937305 - samples/sec: 122.51
2020-08-05 16:21:30,057 epoch 5 - iter 3906/5581 - loss 0.84554935 - samples/sec: 125.55
2020-08-05 16:23:39,913 epoch 5 - iter 4464/5581 - loss 0.84862229 - samples/sec: 138.28
2020-08-05 16:25:50,777 epoch 5 - iter 5022/5581 - loss 0.85109412 - samples/sec: 137.20
2020-08-05 16:28:00,189 epoch 5 - iter 5580/5581 - loss 0.85208820 - samples/sec: 138.80
2020-08-05 16:28:01,397 ----------------------------------------------------------------------------------------------------
2020-08-05 16:28:01,397 EPOCH 5 done: loss 0.8520 - lr 0.1000000
2020-08-05 16:29:08,598 DEV : loss 0.7029607892036438 - score 0.8565
2020-08-05 16:29:11,086 BAD EPOCHS (no improvement): 0
2020-08-05 16:29:29,728 ----------------------------------------------------------------------------------------------------
2020-08-05 16:31:39,073 epoch 6 - iter 558/5581 - loss 0.81288875 - samples/sec: 138.17
2020-08-05 16:33:44,148 epoch 6 - iter 1116/5581 - loss 0.82308993 - samples/sec: 143.81
2020-08-05 16:35:53,038 epoch 6 - iter 1674/5581 - loss 0.82386436 - samples/sec: 139.53
2020-08-05 16:38:03,508 epoch 6 - iter 2232/5581 - loss 0.82901964 - samples/sec: 138.26
2020-08-05 16:40:13,925 epoch 6 - iter 2790/5581 - loss 0.82237099 - samples/sec: 137.84
2020-08-05 16:42:23,175 epoch 6 - iter 3348/5581 - loss 0.82540310 - samples/sec: 139.23
2020-08-05 16:44:31,450 epoch 6 - iter 3906/5581 - loss 0.82391841 - samples/sec: 140.29
2020-08-05 16:46:36,193 epoch 6 - iter 4464/5581 - loss 0.81994306 - samples/sec: 144.35
2020-08-05 16:48:43,350 epoch 6 - iter 5022/5581 - loss 0.82265430 - samples/sec: 142.06
2020-08-05 16:50:49,140 epoch 6 - iter 5580/5581 - loss 0.82167360 - samples/sec: 143.61
2020-08-05 16:50:50,536 ----------------------------------------------------------------------------------------------------
2020-08-05 16:50:50,536 EPOCH 6 done: loss 0.8216 - lr 0.1000000
2020-08-05 16:51:58,398 DEV : loss 0.6875287890434265 - score 0.8589
2020-08-05 16:52:00,853 BAD EPOCHS (no improvement): 0
2020-08-05 16:52:21,580 ----------------------------------------------------------------------------------------------------
2020-08-05 16:54:29,006 epoch 7 - iter 558/5581 - loss 0.80728795 - samples/sec: 140.25
2020-08-05 16:56:33,412 epoch 7 - iter 1116/5581 - loss 0.78349097 - samples/sec: 145.37
2020-08-05 16:58:43,569 epoch 7 - iter 1674/5581 - loss 0.79521579 - samples/sec: 138.76
2020-08-05 17:00:49,581 epoch 7 - iter 2232/5581 - loss 0.79979590 - samples/sec: 143.76
2020-08-05 17:02:59,472 epoch 7 - iter 2790/5581 - loss 0.80166624 - samples/sec: 139.51
2020-08-05 17:05:07,555 epoch 7 - iter 3348/5581 - loss 0.79931234 - samples/sec: 141.74
2020-08-05 17:07:15,167 epoch 7 - iter 3906/5581 - loss 0.80156048 - samples/sec: 141.47
2020-08-05 17:09:26,711 epoch 7 - iter 4464/5581 - loss 0.79778922 - samples/sec: 137.45
2020-08-05 17:12:38,592 epoch 7 - iter 5022/5581 - loss 0.80001716 - samples/sec: 93.87
2020-08-05 17:15:47,817 epoch 7 - iter 5580/5581 - loss 0.80228168 - samples/sec: 95.15
2020-08-05 17:15:49,377 ----------------------------------------------------------------------------------------------------
2020-08-05 17:15:49,377 EPOCH 7 done: loss 0.8024 - lr 0.1000000
2020-08-05 17:17:46,593 DEV : loss 0.695162296295166 - score 0.8564
2020-08-05 17:17:49,083 BAD EPOCHS (no improvement): 1
2020-08-05 17:17:49,092 ----------------------------------------------------------------------------------------------------
2020-08-05 17:22:03,342 epoch 8 - iter 558/5581 - loss 0.78858292 - samples/sec: 70.28
2020-08-05 17:25:10,458 epoch 8 - iter 1116/5581 - loss 0.77951295 - samples/sec: 96.45
2020-08-05 17:27:16,772 epoch 8 - iter 1674/5581 - loss 0.77531796 - samples/sec: 143.82
2020-08-05 17:30:26,810 epoch 8 - iter 2232/5581 - loss 0.77429318 - samples/sec: 94.49
2020-08-05 17:32:32,804 epoch 8 - iter 2790/5581 - loss 0.77386434 - samples/sec: 143.29
2020-08-05 17:34:40,920 epoch 8 - iter 3348/5581 - loss 0.77497047 - samples/sec: 140.28
2020-08-05 17:37:00,615 epoch 8 - iter 3906/5581 - loss 0.77981446 - samples/sec: 128.59
2020-08-05 17:39:17,517 epoch 8 - iter 4464/5581 - loss 0.77461347 - samples/sec: 131.26
2020-08-05 17:41:36,090 epoch 8 - iter 5022/5581 - loss 0.77953120 - samples/sec: 129.61
2020-08-05 17:43:58,563 epoch 8 - iter 5580/5581 - loss 0.78058404 - samples/sec: 126.22
2020-08-05 17:43:59,420 ----------------------------------------------------------------------------------------------------
2020-08-05 17:43:59,420 EPOCH 8 done: loss 0.7805 - lr 0.1000000
2020-08-05 17:45:10,656 DEV : loss 0.6850762367248535 - score 0.8595
2020-08-05 17:45:13,196 BAD EPOCHS (no improvement): 0
2020-08-05 17:45:32,802 ----------------------------------------------------------------------------------------------------
2020-08-05 17:47:56,178 epoch 9 - iter 558/5581 - loss 0.78644884 - samples/sec: 124.67
2020-08-05 17:50:21,406 epoch 9 - iter 1116/5581 - loss 0.77739240 - samples/sec: 123.66
2020-08-05 17:52:38,104 epoch 9 - iter 1674/5581 - loss 0.77570746 - samples/sec: 131.38
2020-08-05 17:54:51,787 epoch 9 - iter 2232/5581 - loss 0.77514095 - samples/sec: 134.63
2020-08-05 17:57:04,171 epoch 9 - iter 2790/5581 - loss 0.76927358 - samples/sec: 135.77
2020-08-05 17:59:19,457 epoch 9 - iter 3348/5581 - loss 0.77296131 - samples/sec: 132.84
2020-08-05 18:01:31,142 epoch 9 - iter 3906/5581 - loss 0.76992212 - samples/sec: 136.42
2020-08-05 18:03:40,470 epoch 9 - iter 4464/5581 - loss 0.76760725 - samples/sec: 139.30
2020-08-05 18:05:54,895 epoch 9 - iter 5022/5581 - loss 0.76656272 - samples/sec: 134.81
2020-08-05 18:08:08,114 epoch 9 - iter 5580/5581 - loss 0.76688432 - samples/sec: 135.18
2020-08-05 18:08:08,942 ----------------------------------------------------------------------------------------------------
2020-08-05 18:08:08,943 EPOCH 9 done: loss 0.7670 - lr 0.1000000
2020-08-05 18:09:18,817 DEV : loss 0.6680812239646912 - score 0.8598
2020-08-05 18:09:22,502 BAD EPOCHS (no improvement): 0
2020-08-05 18:09:41,427 ----------------------------------------------------------------------------------------------------
2020-08-05 18:11:51,835 epoch 10 - iter 558/5581 - loss 0.74341192 - samples/sec: 137.07
2020-08-05 18:14:05,249 epoch 10 - iter 1116/5581 - loss 0.72785052 - samples/sec: 134.85
2020-08-05 18:16:18,950 epoch 10 - iter 1674/5581 - loss 0.74447616 - samples/sec: 134.32
2020-08-05 18:18:34,232 epoch 10 - iter 2232/5581 - loss 0.74189461 - samples/sec: 133.15
2020-08-05 18:20:46,182 epoch 10 - iter 2790/5581 - loss 0.74459182 - samples/sec: 136.16
2020-08-05 18:23:03,988 epoch 10 - iter 3348/5581 - loss 0.74827288 - samples/sec: 130.39
2020-08-05 18:25:21,296 epoch 10 - iter 3906/5581 - loss 0.74943701 - samples/sec: 131.55
2020-08-05 18:27:34,615 epoch 10 - iter 4464/5581 - loss 0.74754173 - samples/sec: 135.23
2020-08-05 18:29:52,699 epoch 10 - iter 5022/5581 - loss 0.74868200 - samples/sec: 136.21
2020-08-05 18:32:02,675 epoch 10 - iter 5580/5581 - loss 0.75131906 - samples/sec: 138.84
2020-08-05 18:32:03,616 ----------------------------------------------------------------------------------------------------
2020-08-05 18:32:03,617 EPOCH 10 done: loss 0.7512 - lr 0.1000000
2020-08-05 18:33:33,759 DEV : loss 0.7179234623908997 - score 0.8567
2020-08-05 18:33:36,355 BAD EPOCHS (no improvement): 1
2020-08-05 18:33:36,391 ----------------------------------------------------------------------------------------------------
2020-08-05 18:35:48,394 epoch 11 - iter 558/5581 - loss 0.72640663 - samples/sec: 135.40
2020-08-05 18:38:05,071 epoch 11 - iter 1116/5581 - loss 0.74561167 - samples/sec: 133.05
2020-08-05 18:40:19,092 epoch 11 - iter 1674/5581 - loss 0.75255070 - samples/sec: 134.01
2020-08-05 18:42:34,453 epoch 11 - iter 2232/5581 - loss 0.75500809 - samples/sec: 132.65
2020-08-05 18:44:41,447 epoch 11 - iter 2790/5581 - loss 0.74853955 - samples/sec: 141.59
2020-08-05 18:46:53,213 epoch 11 - iter 3348/5581 - loss 0.74134791 - samples/sec: 136.47
2020-08-05 18:49:08,791 epoch 11 - iter 3906/5581 - loss 0.74096098 - samples/sec: 132.78
2020-08-05 18:51:18,707 epoch 11 - iter 4464/5581 - loss 0.74191816 - samples/sec: 138.77
2020-08-05 18:53:35,408 epoch 11 - iter 5022/5581 - loss 0.74029231 - samples/sec: 131.34
2020-08-05 18:55:58,234 epoch 11 - iter 5580/5581 - loss 0.74185253 - samples/sec: 125.94
2020-08-05 18:55:59,143 ----------------------------------------------------------------------------------------------------
2020-08-05 18:55:59,144 EPOCH 11 done: loss 0.7418 - lr 0.1000000
2020-08-05 18:57:06,610 DEV : loss 0.6638013124465942 - score 0.8638
2020-08-05 18:57:09,124 BAD EPOCHS (no improvement): 0
2020-08-05 18:57:27,812 ----------------------------------------------------------------------------------------------------
2020-08-05 18:59:30,777 epoch 12 - iter 558/5581 - loss 0.73476681 - samples/sec: 145.36
2020-08-05 19:01:40,270 epoch 12 - iter 1116/5581 - loss 0.72809903 - samples/sec: 139.00
2020-08-05 19:03:47,678 epoch 12 - iter 1674/5581 - loss 0.72530134 - samples/sec: 143.06
2020-08-05 19:05:52,399 epoch 12 - iter 2232/5581 - loss 0.71930432 - samples/sec: 144.23
2020-08-05 19:08:00,876 epoch 12 - iter 2790/5581 - loss 0.72213585 - samples/sec: 140.07
2020-08-05 19:10:07,626 epoch 12 - iter 3348/5581 - loss 0.72520587 - samples/sec: 142.35
2020-08-05 19:12:24,640 epoch 12 - iter 3906/5581 - loss 0.72998678 - samples/sec: 132.11
2020-08-05 19:14:35,909 epoch 12 - iter 4464/5581 - loss 0.72859343 - samples/sec: 137.01
2020-08-05 19:16:41,695 epoch 12 - iter 5022/5581 - loss 0.72472630 - samples/sec: 142.97
2020-08-05 19:18:53,402 epoch 12 - iter 5580/5581 - loss 0.72864775 - samples/sec: 136.56
2020-08-05 19:18:54,370 ----------------------------------------------------------------------------------------------------
2020-08-05 19:18:54,371 EPOCH 12 done: loss 0.7288 - lr 0.1000000
2020-08-05 19:20:01,010 DEV : loss 0.6803184747695923 - score 0.8621
2020-08-05 19:20:03,632 BAD EPOCHS (no improvement): 1
2020-08-05 19:20:03,636 ----------------------------------------------------------------------------------------------------
2020-08-05 19:22:13,223 epoch 13 - iter 558/5581 - loss 0.70065642 - samples/sec: 137.92
2020-08-05 19:24:26,163 epoch 13 - iter 1116/5581 - loss 0.71678533 - samples/sec: 135.27
2020-08-05 19:26:36,932 epoch 13 - iter 1674/5581 - loss 0.70761420 - samples/sec: 137.38
2020-08-05 19:28:46,350 epoch 13 - iter 2232/5581 - loss 0.70822765 - samples/sec: 138.83
2020-08-05 19:30:53,170 epoch 13 - iter 2790/5581 - loss 0.70836539 - samples/sec: 141.84
2020-08-05 19:33:03,661 epoch 13 - iter 3348/5581 - loss 0.71027663 - samples/sec: 138.03
2020-08-05 19:35:11,860 epoch 13 - iter 3906/5581 - loss 0.71198112 - samples/sec: 140.30
2020-08-05 19:37:21,523 epoch 13 - iter 4464/5581 - loss 0.71570257 - samples/sec: 138.84
2020-08-05 19:39:31,790 epoch 13 - iter 5022/5581 - loss 0.71859188 - samples/sec: 138.77
2020-08-05 19:41:40,238 epoch 13 - iter 5580/5581 - loss 0.71959873 - samples/sec: 140.31
2020-08-05 19:41:41,284 ----------------------------------------------------------------------------------------------------
2020-08-05 19:41:41,284 EPOCH 13 done: loss 0.7198 - lr 0.1000000
2020-08-05 19:42:52,586 DEV : loss 0.6561909914016724 - score 0.867
2020-08-05 19:42:55,494 BAD EPOCHS (no improvement): 0
2020-08-05 19:43:16,772 ----------------------------------------------------------------------------------------------------
2020-08-05 19:45:32,672 epoch 14 - iter 558/5581 - loss 0.73982940 - samples/sec: 131.52
2020-08-05 19:47:46,604 epoch 14 - iter 1116/5581 - loss 0.71832199 - samples/sec: 134.43
2020-08-05 19:50:14,440 epoch 14 - iter 1674/5581 - loss 0.70933881 - samples/sec: 122.06
2020-08-05 19:52:23,323 epoch 14 - iter 2232/5581 - loss 0.70952575 - samples/sec: 139.65
2020-08-05 19:54:28,821 epoch 14 - iter 2790/5581 - loss 0.70836716 - samples/sec: 143.39
2020-08-05 19:56:35,504 epoch 14 - iter 3348/5581 - loss 0.70816453 - samples/sec: 142.12
2020-08-05 19:58:42,111 epoch 14 - iter 3906/5581 - loss 0.71258378 - samples/sec: 141.98
2020-08-05 20:00:50,279 epoch 14 - iter 4464/5581 - loss 0.70864761 - samples/sec: 140.34
2020-08-05 20:02:56,412 epoch 14 - iter 5022/5581 - loss 0.71200353 - samples/sec: 143.05
2020-08-05 20:05:04,429 epoch 14 - iter 5580/5581 - loss 0.71063779 - samples/sec: 140.90
2020-08-05 20:05:05,864 ----------------------------------------------------------------------------------------------------
2020-08-05 20:05:05,865 EPOCH 14 done: loss 0.7107 - lr 0.1000000
2020-08-05 20:06:15,336 DEV : loss 0.702426016330719 - score 0.8588
2020-08-05 20:06:17,473 BAD EPOCHS (no improvement): 1
2020-08-05 20:06:17,488 ----------------------------------------------------------------------------------------------------
2020-08-05 20:08:19,223 epoch 15 - iter 558/5581 - loss 0.70430692 - samples/sec: 146.83
2020-08-05 20:10:23,844 epoch 15 - iter 1116/5581 - loss 0.70151178 - samples/sec: 144.25
2020-08-05 20:12:27,673 epoch 15 - iter 1674/5581 - loss 0.69936814 - samples/sec: 145.15
2020-08-05 20:14:31,257 epoch 15 - iter 2232/5581 - loss 0.70806880 - samples/sec: 145.81
2020-08-05 20:16:33,350 epoch 15 - iter 2790/5581 - loss 0.70766509 - samples/sec: 147.52
2020-08-05 20:18:38,148 epoch 15 - iter 3348/5581 - loss 0.70986494 - samples/sec: 144.31
2020-08-05 20:20:46,618 epoch 15 - iter 3906/5581 - loss 0.71366519 - samples/sec: 140.44
2020-08-05 20:22:44,256 epoch 15 - iter 4464/5581 - loss 0.71005037 - samples/sec: 152.88
2020-08-05 20:24:45,297 epoch 15 - iter 5022/5581 - loss 0.70773276 - samples/sec: 148.84
2020-08-05 20:26:47,863 epoch 15 - iter 5580/5581 - loss 0.70619752 - samples/sec: 147.09
2020-08-05 20:26:48,893 ----------------------------------------------------------------------------------------------------
2020-08-05 20:26:48,893 EPOCH 15 done: loss 0.7063 - lr 0.1000000
2020-08-05 20:27:56,539 DEV : loss 0.6558449268341064 - score 0.865
2020-08-05 20:27:58,586 BAD EPOCHS (no improvement): 2
2020-08-05 20:27:58,591 ----------------------------------------------------------------------------------------------------
2020-08-05 20:30:04,716 epoch 16 - iter 558/5581 - loss 0.72532198 - samples/sec: 141.72
2020-08-05 20:32:09,320 epoch 16 - iter 1116/5581 - loss 0.69656791 - samples/sec: 144.37
2020-08-05 20:34:14,118 epoch 16 - iter 1674/5581 - loss 0.69499894 - samples/sec: 144.04
2020-08-05 20:36:23,479 epoch 16 - iter 2232/5581 - loss 0.69063660 - samples/sec: 139.14
2020-08-05 20:38:33,087 epoch 16 - iter 2790/5581 - loss 0.69374744 - samples/sec: 138.90
2020-08-05 20:40:40,580 epoch 16 - iter 3348/5581 - loss 0.69277584 - samples/sec: 141.12
2020-08-05 20:42:45,188 epoch 16 - iter 3906/5581 - loss 0.69666534 - samples/sec: 144.27
2020-08-05 20:44:54,073 epoch 16 - iter 4464/5581 - loss 0.69670986 - samples/sec: 139.56
2020-08-05 20:47:00,308 epoch 16 - iter 5022/5581 - loss 0.69716539 - samples/sec: 142.30
2020-08-05 20:49:11,755 epoch 16 - iter 5580/5581 - loss 0.69770192 - samples/sec: 136.67
2020-08-05 20:49:12,646 ----------------------------------------------------------------------------------------------------
2020-08-05 20:49:12,646 EPOCH 16 done: loss 0.6978 - lr 0.1000000
2020-08-05 20:50:23,712 DEV : loss 0.6563155055046082 - score 0.8686
2020-08-05 20:50:25,818 BAD EPOCHS (no improvement): 0
2020-08-05 20:50:46,290 ----------------------------------------------------------------------------------------------------
2020-08-05 20:52:40,823 epoch 17 - iter 558/5581 - loss 0.67882517 - samples/sec: 156.05
2020-08-05 20:54:36,770 epoch 17 - iter 1116/5581 - loss 0.68976497 - samples/sec: 155.07
2020-08-05 20:56:34,255 epoch 17 - iter 1674/5581 - loss 0.68467955 - samples/sec: 153.22
2020-08-05 20:58:47,094 epoch 17 - iter 2232/5581 - loss 0.68648944 - samples/sec: 135.67
2020-08-05 21:00:59,255 epoch 17 - iter 2790/5581 - loss 0.68875684 - samples/sec: 136.08
2020-08-05 21:03:11,444 epoch 17 - iter 3348/5581 - loss 0.68741433 - samples/sec: 136.91
2020-08-05 21:05:39,924 epoch 17 - iter 3906/5581 - loss 0.68677474 - samples/sec: 121.12
2020-08-05 21:07:52,731 epoch 17 - iter 4464/5581 - loss 0.68855362 - samples/sec: 135.37
2020-08-05 21:10:01,732 epoch 17 - iter 5022/5581 - loss 0.68974452 - samples/sec: 139.30
2020-08-05 21:12:15,133 epoch 17 - iter 5580/5581 - loss 0.68953951 - samples/sec: 134.88
2020-08-05 21:12:15,890 ----------------------------------------------------------------------------------------------------
2020-08-05 21:12:15,890 EPOCH 17 done: loss 0.6896 - lr 0.1000000
2020-08-05 21:13:26,371 DEV : loss 0.6391600370407104 - score 0.8674
2020-08-05 21:13:28,425 BAD EPOCHS (no improvement): 1
2020-08-05 21:13:28,431 ----------------------------------------------------------------------------------------------------
2020-08-05 21:15:38,376 epoch 18 - iter 558/5581 - loss 0.66906516 - samples/sec: 137.56
2020-08-05 21:17:49,390 epoch 18 - iter 1116/5581 - loss 0.66950521 - samples/sec: 137.11
2020-08-05 21:19:55,975 epoch 18 - iter 1674/5581 - loss 0.67267837 - samples/sec: 143.97
2020-08-05 21:22:07,236 epoch 18 - iter 2232/5581 - loss 0.67870016 - samples/sec: 136.83
2020-08-05 21:24:14,309 epoch 18 - iter 2790/5581 - loss 0.67735761 - samples/sec: 141.44
2020-08-05 21:26:22,781 epoch 18 - iter 3348/5581 - loss 0.67625600 - samples/sec: 139.87
2020-08-05 21:28:34,649 epoch 18 - iter 3906/5581 - loss 0.68128668 - samples/sec: 136.54
2020-08-05 21:30:39,133 epoch 18 - iter 4464/5581 - loss 0.67884088 - samples/sec: 144.64
2020-08-05 21:32:43,671 epoch 18 - iter 5022/5581 - loss 0.68188132 - samples/sec: 144.45
2020-08-05 21:34:48,061 epoch 18 - iter 5580/5581 - loss 0.68092044 - samples/sec: 144.52
2020-08-05 21:34:48,807 ----------------------------------------------------------------------------------------------------
2020-08-05 21:34:48,807 EPOCH 18 done: loss 0.6809 - lr 0.1000000
2020-08-05 21:35:55,933 DEV : loss 0.6770896911621094 - score 0.8645
2020-08-05 21:35:57,958 BAD EPOCHS (no improvement): 2
2020-08-05 21:35:58,008 ----------------------------------------------------------------------------------------------------
2020-08-05 21:38:00,511 epoch 19 - iter 558/5581 - loss 0.68215393 - samples/sec: 145.92
2020-08-05 21:40:00,972 epoch 19 - iter 1116/5581 - loss 0.66672905 - samples/sec: 149.27
2020-08-05 21:42:08,015 epoch 19 - iter 1674/5581 - loss 0.66005172 - samples/sec: 141.51
2020-08-05 21:44:17,818 epoch 19 - iter 2232/5581 - loss 0.66905770 - samples/sec: 138.37
2020-08-05 21:46:28,128 epoch 19 - iter 2790/5581 - loss 0.66913402 - samples/sec: 138.20
2020-08-05 21:48:33,913 epoch 19 - iter 3348/5581 - loss 0.67180721 - samples/sec: 142.91
2020-08-05 21:50:39,489 epoch 19 - iter 3906/5581 - loss 0.67365202 - samples/sec: 143.19
2020-08-05 21:52:47,178 epoch 19 - iter 4464/5581 - loss 0.67067895 - samples/sec: 140.78
2020-08-05 21:54:56,255 epoch 19 - iter 5022/5581 - loss 0.67146502 - samples/sec: 139.27
2020-08-05 21:57:06,050 epoch 19 - iter 5580/5581 - loss 0.67485174 - samples/sec: 138.51
2020-08-05 21:57:07,025 ----------------------------------------------------------------------------------------------------
2020-08-05 21:57:07,025 EPOCH 19 done: loss 0.6753 - lr 0.1000000
2020-08-05 21:58:16,386 DEV : loss 0.6483046412467957 - score 0.8673
2020-08-05 21:58:18,418 BAD EPOCHS (no improvement): 3
2020-08-05 21:58:18,424 ----------------------------------------------------------------------------------------------------
2020-08-05 22:00:25,475 epoch 20 - iter 558/5581 - loss 0.63408725 - samples/sec: 140.67
2020-08-05 22:02:31,437 epoch 20 - iter 1116/5581 - loss 0.66852439 - samples/sec: 143.41
2020-08-05 22:04:37,951 epoch 20 - iter 1674/5581 - loss 0.66746477 - samples/sec: 142.54
2020-08-05 22:06:50,042 epoch 20 - iter 2232/5581 - loss 0.67220695 - samples/sec: 136.21
2020-08-05 22:08:53,398 epoch 20 - iter 2790/5581 - loss 0.66801624 - samples/sec: 145.81
2020-08-05 22:10:47,789 epoch 20 - iter 3348/5581 - loss 0.67029897 - samples/sec: 157.30
2020-08-05 22:12:52,503 epoch 20 - iter 3906/5581 - loss 0.66866901 - samples/sec: 144.24
2020-08-05 22:14:58,605 epoch 20 - iter 4464/5581 - loss 0.67043867 - samples/sec: 142.59
2020-08-05 22:17:02,400 epoch 20 - iter 5022/5581 - loss 0.66936206 - samples/sec: 145.20
2020-08-05 22:19:25,457 epoch 20 - iter 5580/5581 - loss 0.67151764 - samples/sec: 125.55
2020-08-05 22:19:26,373 ----------------------------------------------------------------------------------------------------
2020-08-05 22:19:26,374 EPOCH 20 done: loss 0.6716 - lr 0.1000000
2020-08-05 22:20:35,128 DEV : loss 0.6529793739318848 - score 0.8672
2020-08-05 22:20:37,112 BAD EPOCHS (no improvement): 4
2020-08-05 22:20:37,117 ----------------------------------------------------------------------------------------------------
2020-08-05 22:22:41,063 epoch 21 - iter 558/5581 - loss 0.62040619 - samples/sec: 144.19
2020-08-05 22:24:44,456 epoch 21 - iter 1116/5581 - loss 0.64119800 - samples/sec: 145.70
2020-08-05 22:26:48,793 epoch 21 - iter 1674/5581 - loss 0.64116799 - samples/sec: 144.49
2020-08-05 22:28:56,953 epoch 21 - iter 2232/5581 - loss 0.63774198 - samples/sec: 140.12
2020-08-05 22:31:00,213 epoch 21 - iter 2790/5581 - loss 0.63831527 - samples/sec: 145.76
2020-08-05 22:33:10,935 epoch 21 - iter 3348/5581 - loss 0.63683244 - samples/sec: 137.56
2020-08-05 22:35:15,269 epoch 21 - iter 3906/5581 - loss 0.63543253 - samples/sec: 144.66
2020-08-05 22:37:22,518 epoch 21 - iter 4464/5581 - loss 0.63616766 - samples/sec: 141.47
2020-08-05 22:39:29,310 epoch 21 - iter 5022/5581 - loss 0.63424366 - samples/sec: 141.66
2020-08-05 22:41:40,617 epoch 21 - iter 5580/5581 - loss 0.63529714 - samples/sec: 136.99
2020-08-05 22:41:41,500 ----------------------------------------------------------------------------------------------------
2020-08-05 22:41:41,500 EPOCH 21 done: loss 0.6353 - lr 0.0500000
2020-08-05 22:42:50,916 DEV : loss 0.6335277557373047 - score 0.8705
2020-08-05 22:42:52,883 BAD EPOCHS (no improvement): 0
2020-08-05 22:43:12,493 ----------------------------------------------------------------------------------------------------
2020-08-05 22:45:20,933 epoch 22 - iter 558/5581 - loss 0.64763290 - samples/sec: 139.15
2020-08-05 22:47:26,438 epoch 22 - iter 1116/5581 - loss 0.62392401 - samples/sec: 143.28
2020-08-05 22:49:31,943 epoch 22 - iter 1674/5581 - loss 0.61593263 - samples/sec: 143.44
2020-08-05 22:51:37,998 epoch 22 - iter 2232/5581 - loss 0.61077993 - samples/sec: 142.59
2020-08-05 22:53:42,530 epoch 22 - iter 2790/5581 - loss 0.61073145 - samples/sec: 144.75
2020-08-05 22:55:47,696 epoch 22 - iter 3348/5581 - loss 0.61212723 - samples/sec: 143.55
2020-08-05 22:57:43,613 epoch 22 - iter 3906/5581 - loss 0.61868960 - samples/sec: 155.13
2020-08-05 22:59:38,369 epoch 22 - iter 4464/5581 - loss 0.62089892 - samples/sec: 156.59
2020-08-05 23:01:30,552 epoch 22 - iter 5022/5581 - loss 0.61825509 - samples/sec: 160.61
2020-08-05 23:03:24,958 epoch 22 - iter 5580/5581 - loss 0.61739257 - samples/sec: 157.56
2020-08-05 23:03:25,890 ----------------------------------------------------------------------------------------------------
2020-08-05 23:03:25,890 EPOCH 22 done: loss 0.6173 - lr 0.0500000
2020-08-05 23:04:33,121 DEV : loss 0.6288149952888489 - score 0.8707
2020-08-05 23:04:35,073 BAD EPOCHS (no improvement): 0
2020-08-05 23:04:57,205 ----------------------------------------------------------------------------------------------------
2020-08-05 23:06:54,610 epoch 23 - iter 558/5581 - loss 0.62862801 - samples/sec: 152.21
2020-08-05 23:08:57,581 epoch 23 - iter 1116/5581 - loss 0.62058218 - samples/sec: 146.46
2020-08-05 23:11:02,057 epoch 23 - iter 1674/5581 - loss 0.61860682 - samples/sec: 144.26
2020-08-05 23:13:02,764 epoch 23 - iter 2232/5581 - loss 0.61628183 - samples/sec: 149.01
2020-08-05 23:15:01,836 epoch 23 - iter 2790/5581 - loss 0.61026707 - samples/sec: 151.16
2020-08-05 23:17:04,333 epoch 23 - iter 3348/5581 - loss 0.61037352 - samples/sec: 146.83
2020-08-05 23:19:04,909 epoch 23 - iter 3906/5581 - loss 0.61008539 - samples/sec: 149.07
2020-08-05 23:21:05,643 epoch 23 - iter 4464/5581 - loss 0.60933115 - samples/sec: 148.84
2020-08-05 23:23:09,549 epoch 23 - iter 5022/5581 - loss 0.61252296 - samples/sec: 145.31
2020-08-05 23:25:11,310 epoch 23 - iter 5580/5581 - loss 0.61276842 - samples/sec: 147.64
2020-08-05 23:25:12,350 ----------------------------------------------------------------------------------------------------
2020-08-05 23:25:12,350 EPOCH 23 done: loss 0.6128 - lr 0.0500000
2020-08-05 23:26:30,509 DEV : loss 0.6351126432418823 - score 0.8696
2020-08-05 23:26:32,422 BAD EPOCHS (no improvement): 1
2020-08-05 23:26:32,427 ----------------------------------------------------------------------------------------------------
2020-08-05 23:28:32,234 epoch 24 - iter 558/5581 - loss 0.63241349 - samples/sec: 149.15
2020-08-05 23:30:36,137 epoch 24 - iter 1116/5581 - loss 0.61616927 - samples/sec: 145.26
2020-08-05 23:32:37,358 epoch 24 - iter 1674/5581 - loss 0.60955740 - samples/sec: 148.36
2020-08-05 23:34:36,816 epoch 24 - iter 2232/5581 - loss 0.60909124 - samples/sec: 150.37
2020-08-05 23:36:37,329 epoch 24 - iter 2790/5581 - loss 0.61377240 - samples/sec: 149.11
2020-08-05 23:38:40,632 epoch 24 - iter 3348/5581 - loss 0.60993602 - samples/sec: 145.65
2020-08-05 23:40:43,220 epoch 24 - iter 3906/5581 - loss 0.61060187 - samples/sec: 146.68
2020-08-05 23:42:45,167 epoch 24 - iter 4464/5581 - loss 0.60953704 - samples/sec: 147.40
2020-08-05 23:44:47,531 epoch 24 - iter 5022/5581 - loss 0.60668941 - samples/sec: 147.10
2020-08-05 23:46:48,392 epoch 24 - iter 5580/5581 - loss 0.60596772 - samples/sec: 148.74
2020-08-05 23:46:49,308 ----------------------------------------------------------------------------------------------------
2020-08-05 23:46:49,309 EPOCH 24 done: loss 0.6060 - lr 0.0500000
2020-08-05 23:47:54,549 DEV : loss 0.640611469745636 - score 0.8692
2020-08-05 23:47:56,451 BAD EPOCHS (no improvement): 2
2020-08-05 23:47:56,463 ----------------------------------------------------------------------------------------------------
2020-08-05 23:49:55,495 epoch 25 - iter 558/5581 - loss 0.59625878 - samples/sec: 150.14
2020-08-05 23:51:52,603 epoch 25 - iter 1116/5581 - loss 0.60515431 - samples/sec: 153.40
2020-08-05 23:53:53,493 epoch 25 - iter 1674/5581 - loss 0.59795047 - samples/sec: 148.75
2020-08-05 23:55:55,924 epoch 25 - iter 2232/5581 - loss 0.60149468 - samples/sec: 146.74
2020-08-05 23:57:57,416 epoch 25 - iter 2790/5581 - loss 0.60152248 - samples/sec: 147.92
2020-08-06 00:00:01,794 epoch 25 - iter 3348/5581 - loss 0.60152528 - samples/sec: 144.37
2020-08-06 00:02:02,069 epoch 25 - iter 3906/5581 - loss 0.60116137 - samples/sec: 149.79
2020-08-06 00:04:04,998 epoch 25 - iter 4464/5581 - loss 0.60346848 - samples/sec: 147.30
2020-08-06 00:06:06,018 epoch 25 - iter 5022/5581 - loss 0.60109976 - samples/sec: 148.59
2020-08-06 00:08:09,759 epoch 25 - iter 5580/5581 - loss 0.60160256 - samples/sec: 145.15
2020-08-06 00:08:10,891 ----------------------------------------------------------------------------------------------------
2020-08-06 00:08:10,891 EPOCH 25 done: loss 0.6018 - lr 0.0500000
2020-08-06 00:09:15,673 DEV : loss 0.6407551765441895 - score 0.8699
2020-08-06 00:09:17,585 BAD EPOCHS (no improvement): 3
2020-08-06 00:09:17,591 ----------------------------------------------------------------------------------------------------
2020-08-06 00:11:20,377 epoch 26 - iter 558/5581 - loss 0.58164592 - samples/sec: 145.53
2020-08-06 00:13:20,979 epoch 26 - iter 1116/5581 - loss 0.57952438 - samples/sec: 149.26
2020-08-06 00:15:20,804 epoch 26 - iter 1674/5581 - loss 0.58713096 - samples/sec: 150.28
2020-08-06 00:17:22,937 epoch 26 - iter 2232/5581 - loss 0.59208997 - samples/sec: 147.15
2020-08-06 00:19:22,053 epoch 26 - iter 2790/5581 - loss 0.58832871 - samples/sec: 150.86
2020-08-06 00:21:22,514 epoch 26 - iter 3348/5581 - loss 0.59054412 - samples/sec: 149.72
2020-08-06 00:23:22,942 epoch 26 - iter 3906/5581 - loss 0.58841528 - samples/sec: 149.28
2020-08-06 00:25:24,772 epoch 26 - iter 4464/5581 - loss 0.59121933 - samples/sec: 147.88
2020-08-06 00:27:27,646 epoch 26 - iter 5022/5581 - loss 0.59209349 - samples/sec: 146.32
2020-08-06 00:29:32,204 epoch 26 - iter 5580/5581 - loss 0.59449901 - samples/sec: 144.26
2020-08-06 00:29:32,992 ----------------------------------------------------------------------------------------------------
2020-08-06 00:29:32,992 EPOCH 26 done: loss 0.5945 - lr 0.0500000
2020-08-06 00:30:38,066 DEV : loss 0.6366616487503052 - score 0.8713
2020-08-06 00:30:39,968 BAD EPOCHS (no improvement): 0
2020-08-06 00:31:00,135 ----------------------------------------------------------------------------------------------------
2020-08-06 00:33:11,623 epoch 27 - iter 558/5581 - loss 0.58697864 - samples/sec: 135.89
2020-08-06 00:35:01,357 epoch 27 - iter 1116/5581 - loss 0.58552920 - samples/sec: 163.74
2020-08-06 00:36:49,509 epoch 27 - iter 1674/5581 - loss 0.58298932 - samples/sec: 166.24
2020-08-06 00:38:40,909 epoch 27 - iter 2232/5581 - loss 0.59846079 - samples/sec: 161.36
2020-08-06 00:40:31,238 epoch 27 - iter 2790/5581 - loss 0.59468586 - samples/sec: 162.92
2020-08-06 00:42:19,255 epoch 27 - iter 3348/5581 - loss 0.59337121 - samples/sec: 166.56
2020-08-06 00:44:05,839 epoch 27 - iter 3906/5581 - loss 0.59096137 - samples/sec: 169.14
2020-08-06 00:45:54,222 epoch 27 - iter 4464/5581 - loss 0.58996251 - samples/sec: 165.88
2020-08-06 00:47:42,324 epoch 27 - iter 5022/5581 - loss 0.58703331 - samples/sec: 166.36
2020-08-06 00:49:31,828 epoch 27 - iter 5580/5581 - loss 0.59055831 - samples/sec: 164.18
2020-08-06 00:49:32,540 ----------------------------------------------------------------------------------------------------
2020-08-06 00:49:32,540 EPOCH 27 done: loss 0.5906 - lr 0.0500000
2020-08-06 00:50:36,794 DEV : loss 0.6295278668403625 - score 0.8726
2020-08-06 00:50:38,697 BAD EPOCHS (no improvement): 0
2020-08-06 00:50:57,579 ----------------------------------------------------------------------------------------------------
2020-08-06 00:52:44,835 epoch 28 - iter 558/5581 - loss 0.55842890 - samples/sec: 166.59
2020-08-06 00:54:34,655 epoch 28 - iter 1116/5581 - loss 0.57839473 - samples/sec: 163.65
2020-08-06 00:56:27,045 epoch 28 - iter 1674/5581 - loss 0.57834648 - samples/sec: 159.93
2020-08-06 00:58:23,953 epoch 28 - iter 2232/5581 - loss 0.57922399 - samples/sec: 153.78
2020-08-06 01:00:10,040 epoch 28 - iter 2790/5581 - loss 0.57800907 - samples/sec: 169.83
2020-08-06 01:01:59,876 epoch 28 - iter 3348/5581 - loss 0.58155195 - samples/sec: 164.15
2020-08-06 01:04:01,499 epoch 28 - iter 3906/5581 - loss 0.58302723 - samples/sec: 147.94
2020-08-06 01:06:03,941 epoch 28 - iter 4464/5581 - loss 0.58419142 - samples/sec: 147.06
2020-08-06 01:08:02,949 epoch 28 - iter 5022/5581 - loss 0.58307363 - samples/sec: 151.31
2020-08-06 01:10:05,054 epoch 28 - iter 5580/5581 - loss 0.58596047 - samples/sec: 147.37
2020-08-06 01:10:06,002 ----------------------------------------------------------------------------------------------------
2020-08-06 01:10:06,002 EPOCH 28 done: loss 0.5860 - lr 0.0500000
2020-08-06 01:11:09,816 DEV : loss 0.6359518766403198 - score 0.8706
2020-08-06 01:11:11,721 BAD EPOCHS (no improvement): 1
2020-08-06 01:11:11,731 ----------------------------------------------------------------------------------------------------
2020-08-06 01:13:15,209 epoch 29 - iter 558/5581 - loss 0.56503625 - samples/sec: 144.72
2020-08-06 01:15:15,172 epoch 29 - iter 1116/5581 - loss 0.57322139 - samples/sec: 150.09
2020-08-06 01:17:15,280 epoch 29 - iter 1674/5581 - loss 0.57677959 - samples/sec: 149.66
2020-08-06 01:19:15,463 epoch 29 - iter 2232/5581 - loss 0.57679329 - samples/sec: 149.55
2020-08-06 01:21:17,176 epoch 29 - iter 2790/5581 - loss 0.57945776 - samples/sec: 147.89
2020-08-06 01:23:18,436 epoch 29 - iter 3348/5581 - loss 0.57694956 - samples/sec: 148.44
2020-08-06 01:25:22,245 epoch 29 - iter 3906/5581 - loss 0.57508814 - samples/sec: 145.32
2020-08-06 01:27:23,819 epoch 29 - iter 4464/5581 - loss 0.57824024 - samples/sec: 148.07
2020-08-06 01:29:26,902 epoch 29 - iter 5022/5581 - loss 0.58060439 - samples/sec: 146.05
2020-08-06 01:31:27,335 epoch 29 - iter 5580/5581 - loss 0.58118735 - samples/sec: 149.45
2020-08-06 01:31:28,336 ----------------------------------------------------------------------------------------------------
2020-08-06 01:31:28,336 EPOCH 29 done: loss 0.5811 - lr 0.0500000
2020-08-06 01:32:33,578 DEV : loss 0.6309512257575989 - score 0.8727
2020-08-06 01:32:35,477 BAD EPOCHS (no improvement): 0
2020-08-06 01:32:57,216 ----------------------------------------------------------------------------------------------------
2020-08-06 01:35:01,176 epoch 30 - iter 558/5581 - loss 0.59697466 - samples/sec: 144.17
2020-08-06 01:37:03,814 epoch 30 - iter 1116/5581 - loss 0.59266582 - samples/sec: 146.91
2020-08-06 01:39:04,659 epoch 30 - iter 1674/5581 - loss 0.59203052 - samples/sec: 148.83
2020-08-06 01:41:21,879 epoch 30 - iter 2232/5581 - loss 0.58958216 - samples/sec: 131.29
2020-08-06 01:43:24,974 epoch 30 - iter 2790/5581 - loss 0.58602787 - samples/sec: 146.16
2020-08-06 01:45:23,957 epoch 30 - iter 3348/5581 - loss 0.58398079 - samples/sec: 151.17
2020-08-06 01:47:29,929 epoch 30 - iter 3906/5581 - loss 0.58519432 - samples/sec: 144.55
2020-08-06 01:49:29,555 epoch 30 - iter 4464/5581 - loss 0.58571516 - samples/sec: 150.21
2020-08-06 01:51:31,836 epoch 30 - iter 5022/5581 - loss 0.58283602 - samples/sec: 147.25
2020-08-06 01:53:31,956 epoch 30 - iter 5580/5581 - loss 0.58274026 - samples/sec: 149.81
2020-08-06 01:53:33,076 ----------------------------------------------------------------------------------------------------
2020-08-06 01:53:33,076 EPOCH 30 done: loss 0.5827 - lr 0.0500000
2020-08-06 01:54:38,480 DEV : loss 0.635391891002655 - score 0.8723
2020-08-06 01:54:40,386 BAD EPOCHS (no improvement): 1
2020-08-06 01:54:40,394 ----------------------------------------------------------------------------------------------------
2020-08-06 01:56:39,762 epoch 31 - iter 558/5581 - loss 0.54622400 - samples/sec: 149.71
2020-08-06 01:58:41,604 epoch 31 - iter 1116/5581 - loss 0.56244361 - samples/sec: 147.62
2020-08-06 02:00:42,825 epoch 31 - iter 1674/5581 - loss 0.56258950 - samples/sec: 148.39
2020-08-06 02:02:47,190 epoch 31 - iter 2232/5581 - loss 0.56151236 - samples/sec: 145.82
2020-08-06 02:04:45,819 epoch 31 - iter 2790/5581 - loss 0.56188804 - samples/sec: 151.98
2020-08-06 02:06:45,997 epoch 31 - iter 3348/5581 - loss 0.56478535 - samples/sec: 149.71
2020-08-06 02:08:46,616 epoch 31 - iter 3906/5581 - loss 0.56899553 - samples/sec: 149.67
2020-08-06 02:10:49,176 epoch 31 - iter 4464/5581 - loss 0.56724927 - samples/sec: 146.89
2020-08-06 02:12:53,692 epoch 31 - iter 5022/5581 - loss 0.57033703 - samples/sec: 144.72
2020-08-06 02:14:57,571 epoch 31 - iter 5580/5581 - loss 0.57359121 - samples/sec: 145.48
2020-08-06 02:14:58,618 ----------------------------------------------------------------------------------------------------
2020-08-06 02:14:58,618 EPOCH 31 done: loss 0.5735 - lr 0.0500000
2020-08-06 02:16:02,450 DEV : loss 0.6253291368484497 - score 0.8706
2020-08-06 02:16:04,350 BAD EPOCHS (no improvement): 2
2020-08-06 02:16:04,362 ----------------------------------------------------------------------------------------------------
2020-08-06 02:18:02,858 epoch 32 - iter 558/5581 - loss 0.56504917 - samples/sec: 150.82
2020-08-06 02:20:07,673 epoch 32 - iter 1116/5581 - loss 0.56575668 - samples/sec: 144.04
2020-08-06 02:22:08,370 epoch 32 - iter 1674/5581 - loss 0.56624958 - samples/sec: 149.02
2020-08-06 02:24:12,533 epoch 32 - iter 2232/5581 - loss 0.56977057 - samples/sec: 144.95
2020-08-06 02:26:15,765 epoch 32 - iter 2790/5581 - loss 0.57289465 - samples/sec: 146.18
2020-08-06 02:28:13,576 epoch 32 - iter 3348/5581 - loss 0.56917964 - samples/sec: 152.96
2020-08-06 02:30:12,704 epoch 32 - iter 3906/5581 - loss 0.56509313 - samples/sec: 150.98
2020-08-06 02:32:11,550 epoch 32 - iter 4464/5581 - loss 0.56679236 - samples/sec: 151.35
2020-08-06 02:34:05,422 epoch 32 - iter 5022/5581 - loss 0.56705895 - samples/sec: 158.00
2020-08-06 02:35:51,941 epoch 32 - iter 5580/5581 - loss 0.56951338 - samples/sec: 168.96
2020-08-06 02:35:52,906 ----------------------------------------------------------------------------------------------------
2020-08-06 02:35:52,907 EPOCH 32 done: loss 0.5695 - lr 0.0500000
2020-08-06 02:36:56,858 DEV : loss 0.6364200115203857 - score 0.8718
2020-08-06 02:36:58,751 BAD EPOCHS (no improvement): 3
2020-08-06 02:36:58,758 ----------------------------------------------------------------------------------------------------
2020-08-06 02:38:45,074 epoch 33 - iter 558/5581 - loss 0.56221856 - samples/sec: 168.04
2020-08-06 02:40:29,425 epoch 33 - iter 1116/5581 - loss 0.55948793 - samples/sec: 172.48
2020-08-06 02:42:30,185 epoch 33 - iter 1674/5581 - loss 0.56498799 - samples/sec: 148.88
2020-08-06 02:44:31,791 epoch 33 - iter 2232/5581 - loss 0.56781193 - samples/sec: 147.76
2020-08-06 02:46:29,549 epoch 33 - iter 2790/5581 - loss 0.57462458 - samples/sec: 152.87
2020-08-06 02:48:30,637 epoch 33 - iter 3348/5581 - loss 0.57053525 - samples/sec: 148.37
2020-08-06 02:50:44,283 epoch 33 - iter 3906/5581 - loss 0.57124879 - samples/sec: 134.37
2020-08-06 02:52:42,698 epoch 33 - iter 4464/5581 - loss 0.57002076 - samples/sec: 151.76
2020-08-06 02:54:43,103 epoch 33 - iter 5022/5581 - loss 0.56930868 - samples/sec: 149.19
2020-08-06 02:56:42,015 epoch 33 - iter 5580/5581 - loss 0.56895574 - samples/sec: 151.25
2020-08-06 02:56:42,969 ----------------------------------------------------------------------------------------------------
2020-08-06 02:56:42,969 EPOCH 33 done: loss 0.5690 - lr 0.0500000
2020-08-06 02:57:47,033 DEV : loss 0.6421177983283997 - score 0.8696
2020-08-06 02:57:48,945 BAD EPOCHS (no improvement): 4
2020-08-06 02:57:48,951 ----------------------------------------------------------------------------------------------------
2020-08-06 02:59:47,004 epoch 34 - iter 558/5581 - loss 0.54681951 - samples/sec: 151.36
2020-08-06 03:01:48,580 epoch 34 - iter 1116/5581 - loss 0.54925082 - samples/sec: 148.42
2020-08-06 03:03:48,828 epoch 34 - iter 1674/5581 - loss 0.54556829 - samples/sec: 150.06
2020-08-06 03:05:46,412 epoch 34 - iter 2232/5581 - loss 0.54645761 - samples/sec: 153.11
2020-08-06 03:07:45,399 epoch 34 - iter 2790/5581 - loss 0.54879617 - samples/sec: 151.19
2020-08-06 03:09:45,849 epoch 34 - iter 3348/5581 - loss 0.54862767 - samples/sec: 149.37
2020-08-06 03:11:47,198 epoch 34 - iter 3906/5581 - loss 0.54872866 - samples/sec: 148.29
2020-08-06 03:13:45,723 epoch 34 - iter 4464/5581 - loss 0.54811594 - samples/sec: 151.74
2020-08-06 03:15:46,335 epoch 34 - iter 5022/5581 - loss 0.54951629 - samples/sec: 149.25
2020-08-06 03:17:47,244 epoch 34 - iter 5580/5581 - loss 0.55248732 - samples/sec: 148.79
2020-08-06 03:17:48,246 ----------------------------------------------------------------------------------------------------
2020-08-06 03:17:48,247 EPOCH 34 done: loss 0.5525 - lr 0.0250000
2020-08-06 03:18:52,074 DEV : loss 0.622012734413147 - score 0.8732
2020-08-06 03:18:53,977 BAD EPOCHS (no improvement): 0
2020-08-06 03:19:15,846 ----------------------------------------------------------------------------------------------------
2020-08-06 03:21:13,304 epoch 35 - iter 558/5581 - loss 0.54223953 - samples/sec: 152.14
2020-08-06 03:23:13,761 epoch 35 - iter 1116/5581 - loss 0.54089466 - samples/sec: 149.42
2020-08-06 03:25:15,518 epoch 35 - iter 1674/5581 - loss 0.54022265 - samples/sec: 147.72
2020-08-06 03:27:13,910 epoch 35 - iter 2232/5581 - loss 0.53802567 - samples/sec: 151.94
2020-08-06 03:29:12,318 epoch 35 - iter 2790/5581 - loss 0.54360031 - samples/sec: 151.75
2020-08-06 03:31:11,709 epoch 35 - iter 3348/5581 - loss 0.54313443 - samples/sec: 150.54
2020-08-06 03:33:13,358 epoch 35 - iter 3906/5581 - loss 0.54424948 - samples/sec: 147.88
2020-08-06 03:35:13,734 epoch 35 - iter 4464/5581 - loss 0.54743815 - samples/sec: 149.44
2020-08-06 03:37:11,713 epoch 35 - iter 5022/5581 - loss 0.54656457 - samples/sec: 152.34
2020-08-06 03:39:10,884 epoch 35 - iter 5580/5581 - loss 0.54501839 - samples/sec: 150.95
2020-08-06 03:39:11,694 ----------------------------------------------------------------------------------------------------
2020-08-06 03:39:11,694 EPOCH 35 done: loss 0.5452 - lr 0.0250000
2020-08-06 03:40:15,628 DEV : loss 0.6299528479576111 - score 0.8709
2020-08-06 03:40:17,534 BAD EPOCHS (no improvement): 1
2020-08-06 03:40:17,549 ----------------------------------------------------------------------------------------------------
2020-08-06 03:42:16,769 epoch 36 - iter 558/5581 - loss 0.55023936 - samples/sec: 149.89
2020-08-06 03:44:16,966 epoch 36 - iter 1116/5581 - loss 0.55358592 - samples/sec: 149.56
2020-08-06 03:46:19,155 epoch 36 - iter 1674/5581 - loss 0.55317098 - samples/sec: 147.24
2020-08-06 03:48:17,306 epoch 36 - iter 2232/5581 - loss 0.54626026 - samples/sec: 152.11
2020-08-06 03:50:16,603 epoch 36 - iter 2790/5581 - loss 0.54231514 - samples/sec: 150.62
2020-08-06 03:52:16,051 epoch 36 - iter 3348/5581 - loss 0.53873222 - samples/sec: 150.46
2020-08-06 03:54:14,415 epoch 36 - iter 3906/5581 - loss 0.53877416 - samples/sec: 151.83
2020-08-06 03:56:14,896 epoch 36 - iter 4464/5581 - loss 0.54027028 - samples/sec: 149.35
2020-08-06 03:58:13,266 epoch 36 - iter 5022/5581 - loss 0.54145073 - samples/sec: 151.75
2020-08-06 04:00:11,273 epoch 36 - iter 5580/5581 - loss 0.54398900 - samples/sec: 152.25
2020-08-06 04:00:12,282 ----------------------------------------------------------------------------------------------------
2020-08-06 04:00:12,283 EPOCH 36 done: loss 0.5439 - lr 0.0250000
2020-08-06 04:01:29,558 DEV : loss 0.6184678077697754 - score 0.8721
2020-08-06 04:01:31,455 BAD EPOCHS (no improvement): 2
2020-08-06 04:01:31,468 ----------------------------------------------------------------------------------------------------
2020-08-06 04:03:32,347 epoch 37 - iter 558/5581 - loss 0.56213882 - samples/sec: 147.83
2020-08-06 04:05:31,677 epoch 37 - iter 1116/5581 - loss 0.54694672 - samples/sec: 151.11
2020-08-06 04:07:29,198 epoch 37 - iter 1674/5581 - loss 0.54702364 - samples/sec: 153.35
2020-08-06 04:09:32,269 epoch 37 - iter 2232/5581 - loss 0.54302285 - samples/sec: 146.51
2020-08-06 04:11:32,217 epoch 37 - iter 2790/5581 - loss 0.53747291 - samples/sec: 150.27
2020-08-06 04:13:30,799 epoch 37 - iter 3348/5581 - loss 0.53470270 - samples/sec: 151.70
2020-08-06 04:15:30,352 epoch 37 - iter 3906/5581 - loss 0.53346976 - samples/sec: 150.44
2020-08-06 04:17:29,433 epoch 37 - iter 4464/5581 - loss 0.53639625 - samples/sec: 151.01
2020-08-06 04:19:30,766 epoch 37 - iter 5022/5581 - loss 0.53787770 - samples/sec: 148.25
2020-08-06 04:21:28,596 epoch 37 - iter 5580/5581 - loss 0.53840929 - samples/sec: 153.05
2020-08-06 04:21:29,523 ----------------------------------------------------------------------------------------------------
2020-08-06 04:21:29,523 EPOCH 37 done: loss 0.5383 - lr 0.0250000
2020-08-06 04:22:33,416 DEV : loss 0.6289875507354736 - score 0.8731
2020-08-06 04:22:35,311 BAD EPOCHS (no improvement): 3
2020-08-06 04:22:35,318 ----------------------------------------------------------------------------------------------------
2020-08-06 04:24:33,002 epoch 38 - iter 558/5581 - loss 0.53766024 - samples/sec: 151.84
2020-08-06 04:26:34,728 epoch 38 - iter 1116/5581 - loss 0.54538495 - samples/sec: 149.00
2020-08-06 04:28:35,550 epoch 38 - iter 1674/5581 - loss 0.54040816 - samples/sec: 149.61
2020-08-06 04:30:33,432 epoch 38 - iter 2232/5581 - loss 0.53873229 - samples/sec: 152.49
2020-08-06 04:32:31,934 epoch 38 - iter 2790/5581 - loss 0.53735266 - samples/sec: 151.67
2020-08-06 04:34:32,332 epoch 38 - iter 3348/5581 - loss 0.53617399 - samples/sec: 150.81
2020-08-06 04:36:31,582 epoch 38 - iter 3906/5581 - loss 0.53590696 - samples/sec: 150.71
2020-08-06 04:38:29,786 epoch 38 - iter 4464/5581 - loss 0.53347087 - samples/sec: 152.01
2020-08-06 04:40:31,374 epoch 38 - iter 5022/5581 - loss 0.53548931 - samples/sec: 150.26
2020-08-06 04:42:31,260 epoch 38 - iter 5580/5581 - loss 0.53359392 - samples/sec: 149.84
2020-08-06 04:42:32,039 ----------------------------------------------------------------------------------------------------
2020-08-06 04:42:32,039 EPOCH 38 done: loss 0.5336 - lr 0.0250000
2020-08-06 04:43:35,809 DEV : loss 0.622111439704895 - score 0.8742
2020-08-06 04:43:37,715 BAD EPOCHS (no improvement): 0
2020-08-06 04:43:58,486 ----------------------------------------------------------------------------------------------------
2020-08-06 04:45:57,949 epoch 39 - iter 558/5581 - loss 0.52977973 - samples/sec: 149.57
2020-08-06 04:47:58,051 epoch 39 - iter 1116/5581 - loss 0.53912872 - samples/sec: 150.16
2020-08-06 04:49:57,611 epoch 39 - iter 1674/5581 - loss 0.53199637 - samples/sec: 150.51
2020-08-06 04:51:54,670 epoch 39 - iter 2232/5581 - loss 0.53111328 - samples/sec: 153.70
2020-08-06 04:53:52,126 epoch 39 - iter 2790/5581 - loss 0.52970992 - samples/sec: 152.99
2020-08-06 04:55:50,297 epoch 39 - iter 3348/5581 - loss 0.52862552 - samples/sec: 152.06
2020-08-06 04:57:48,253 epoch 39 - iter 3906/5581 - loss 0.52392112 - samples/sec: 152.36
2020-08-06 04:59:50,563 epoch 39 - iter 4464/5581 - loss 0.52867545 - samples/sec: 147.63
2020-08-06 05:01:48,917 epoch 39 - iter 5022/5581 - loss 0.53013016 - samples/sec: 151.78
2020-08-06 05:03:51,171 epoch 39 - iter 5580/5581 - loss 0.53279046 - samples/sec: 147.81
2020-08-06 05:03:52,398 ----------------------------------------------------------------------------------------------------
2020-08-06 05:03:52,398 EPOCH 39 done: loss 0.5327 - lr 0.0250000
2020-08-06 05:05:09,316 DEV : loss 0.6181052327156067 - score 0.8726
2020-08-06 05:05:11,212 BAD EPOCHS (no improvement): 1
2020-08-06 05:05:11,219 ----------------------------------------------------------------------------------------------------
2020-08-06 05:07:08,172 epoch 40 - iter 558/5581 - loss 0.51535398 - samples/sec: 152.79
2020-08-06 05:09:05,695 epoch 40 - iter 1116/5581 - loss 0.51956441 - samples/sec: 153.05
2020-08-06 05:11:06,266 epoch 40 - iter 1674/5581 - loss 0.52726043 - samples/sec: 149.67
2020-08-06 05:13:08,701 epoch 40 - iter 2232/5581 - loss 0.52970570 - samples/sec: 146.86
2020-08-06 05:15:08,501 epoch 40 - iter 2790/5581 - loss 0.52875756 - samples/sec: 150.23
2020-08-06 05:17:09,294 epoch 40 - iter 3348/5581 - loss 0.53054044 - samples/sec: 148.94
2020-08-06 05:19:07,576 epoch 40 - iter 3906/5581 - loss 0.52986617 - samples/sec: 152.23
2020-08-06 05:21:06,922 epoch 40 - iter 4464/5581 - loss 0.53215571 - samples/sec: 151.44
2020-08-06 05:23:05,725 epoch 40 - iter 5022/5581 - loss 0.53195241 - samples/sec: 151.31
2020-08-06 05:25:06,525 epoch 40 - iter 5580/5581 - loss 0.53190328 - samples/sec: 148.83
2020-08-06 05:25:07,340 ----------------------------------------------------------------------------------------------------
2020-08-06 05:25:07,340 EPOCH 40 done: loss 0.5319 - lr 0.0250000
2020-08-06 05:26:11,238 DEV : loss 0.6337159276008606 - score 0.8727
2020-08-06 05:26:13,135 BAD EPOCHS (no improvement): 2
2020-08-06 05:26:13,140 ----------------------------------------------------------------------------------------------------
2020-08-06 05:28:10,238 epoch 41 - iter 558/5581 - loss 0.52325802 - samples/sec: 152.59
2020-08-06 05:30:10,970 epoch 41 - iter 1116/5581 - loss 0.52359846 - samples/sec: 148.89
2020-08-06 05:32:11,412 epoch 41 - iter 1674/5581 - loss 0.52690490 - samples/sec: 149.35
2020-08-06 05:34:11,458 epoch 41 - iter 2232/5581 - loss 0.53107563 - samples/sec: 149.96
2020-08-06 05:36:09,924 epoch 41 - iter 2790/5581 - loss 0.53061571 - samples/sec: 151.88
2020-08-06 05:38:07,610 epoch 41 - iter 3348/5581 - loss 0.53154832 - samples/sec: 152.81
2020-08-06 05:40:06,463 epoch 41 - iter 3906/5581 - loss 0.52913738 - samples/sec: 151.14
2020-08-06 05:42:05,653 epoch 41 - iter 4464/5581 - loss 0.52785328 - samples/sec: 150.82
2020-08-06 05:44:06,053 epoch 41 - iter 5022/5581 - loss 0.52616136 - samples/sec: 149.67
2020-08-06 05:46:06,488 epoch 41 - iter 5580/5581 - loss 0.52629106 - samples/sec: 149.32
2020-08-06 05:46:07,470 ----------------------------------------------------------------------------------------------------
2020-08-06 05:46:07,470 EPOCH 41 done: loss 0.5266 - lr 0.0250000
2020-08-06 05:47:11,256 DEV : loss 0.6279857754707336 - score 0.8727
2020-08-06 05:47:13,161 BAD EPOCHS (no improvement): 3
2020-08-06 05:47:13,195 ----------------------------------------------------------------------------------------------------
2020-08-06 05:49:11,726 epoch 42 - iter 558/5581 - loss 0.52510977 - samples/sec: 150.75
2020-08-06 05:51:10,222 epoch 42 - iter 1116/5581 - loss 0.51882276 - samples/sec: 151.68
2020-08-06 05:53:10,675 epoch 42 - iter 1674/5581 - loss 0.52744529 - samples/sec: 149.10
2020-08-06 05:55:09,814 epoch 42 - iter 2232/5581 - loss 0.52040760 - samples/sec: 150.85
2020-08-06 05:57:11,837 epoch 42 - iter 2790/5581 - loss 0.52199404 - samples/sec: 147.30
2020-08-06 05:59:14,590 epoch 42 - iter 3348/5581 - loss 0.52472050 - samples/sec: 146.36
2020-08-06 06:01:12,403 epoch 42 - iter 3906/5581 - loss 0.52254160 - samples/sec: 152.62
2020-08-06 06:03:11,311 epoch 42 - iter 4464/5581 - loss 0.52353056 - samples/sec: 152.19
2020-08-06 06:05:10,096 epoch 42 - iter 5022/5581 - loss 0.52317483 - samples/sec: 151.64
2020-08-06 06:07:09,199 epoch 42 - iter 5580/5581 - loss 0.52475750 - samples/sec: 151.20
2020-08-06 06:07:10,714 ----------------------------------------------------------------------------------------------------
2020-08-06 06:07:10,715 EPOCH 42 done: loss 0.5248 - lr 0.0250000
2020-08-06 06:08:14,836 DEV : loss 0.6266222596168518 - score 0.8734
2020-08-06 06:08:16,733 BAD EPOCHS (no improvement): 4
2020-08-06 06:08:16,740 ----------------------------------------------------------------------------------------------------
2020-08-06 06:10:18,364 epoch 43 - iter 558/5581 - loss 0.51136336 - samples/sec: 146.91
2020-08-06 06:12:31,455 epoch 43 - iter 1116/5581 - loss 0.51902758 - samples/sec: 135.24
2020-08-06 06:14:31,315 epoch 43 - iter 1674/5581 - loss 0.51503727 - samples/sec: 150.41
2020-08-06 06:16:31,413 epoch 43 - iter 2232/5581 - loss 0.51643650 - samples/sec: 150.09
2020-08-06 06:18:29,863 epoch 43 - iter 2790/5581 - loss 0.51428290 - samples/sec: 151.92
2020-08-06 06:20:25,831 epoch 43 - iter 3348/5581 - loss 0.51148503 - samples/sec: 155.02
2020-08-06 06:22:25,076 epoch 43 - iter 3906/5581 - loss 0.51139587 - samples/sec: 151.03
2020-08-06 06:24:26,408 epoch 43 - iter 4464/5581 - loss 0.51314585 - samples/sec: 148.08
2020-08-06 06:26:28,175 epoch 43 - iter 5022/5581 - loss 0.51644769 - samples/sec: 147.66
2020-08-06 06:28:27,326 epoch 43 - iter 5580/5581 - loss 0.51818924 - samples/sec: 151.00
2020-08-06 06:28:28,347 ----------------------------------------------------------------------------------------------------
2020-08-06 06:28:28,347 EPOCH 43 done: loss 0.5181 - lr 0.0125000
2020-08-06 06:29:32,095 DEV : loss 0.6245996952056885 - score 0.8741
2020-08-06 06:29:33,990 BAD EPOCHS (no improvement): 1
2020-08-06 06:29:34,000 ----------------------------------------------------------------------------------------------------
2020-08-06 06:31:33,196 epoch 44 - iter 558/5581 - loss 0.51768459 - samples/sec: 149.91
2020-08-06 06:33:33,002 epoch 44 - iter 1116/5581 - loss 0.52751665 - samples/sec: 150.12
2020-08-06 06:35:31,094 epoch 44 - iter 1674/5581 - loss 0.51658858 - samples/sec: 152.25
2020-08-06 06:37:29,090 epoch 44 - iter 2232/5581 - loss 0.51929010 - samples/sec: 152.28
2020-08-06 06:39:27,833 epoch 44 - iter 2790/5581 - loss 0.52375996 - samples/sec: 151.33
2020-08-06 06:41:28,228 epoch 44 - iter 3348/5581 - loss 0.52127450 - samples/sec: 149.23
2020-08-06 06:43:29,355 epoch 44 - iter 3906/5581 - loss 0.51991372 - samples/sec: 148.30
2020-08-06 06:45:30,046 epoch 44 - iter 4464/5581 - loss 0.52046851 - samples/sec: 148.83
2020-08-06 06:47:29,503 epoch 44 - iter 5022/5581 - loss 0.51982207 - samples/sec: 150.40
2020-08-06 06:49:28,195 epoch 44 - iter 5580/5581 - loss 0.51900970 - samples/sec: 151.51
2020-08-06 06:49:28,929 ----------------------------------------------------------------------------------------------------
2020-08-06 06:49:28,930 EPOCH 44 done: loss 0.5189 - lr 0.0125000
2020-08-06 06:50:32,359 DEV : loss 0.6272505521774292 - score 0.8728
2020-08-06 06:50:34,252 BAD EPOCHS (no improvement): 2
2020-08-06 06:50:34,258 ----------------------------------------------------------------------------------------------------
2020-08-06 06:52:33,325 epoch 45 - iter 558/5581 - loss 0.50769596 - samples/sec: 150.07
2020-08-06 06:54:32,335 epoch 45 - iter 1116/5581 - loss 0.52511917 - samples/sec: 150.96
2020-08-06 06:56:31,206 epoch 45 - iter 1674/5581 - loss 0.51878902 - samples/sec: 151.30
2020-08-06 06:58:29,233 epoch 45 - iter 2232/5581 - loss 0.51347241 - samples/sec: 152.24
2020-08-06 07:00:26,901 epoch 45 - iter 2790/5581 - loss 0.51282474 - samples/sec: 152.79
2020-08-06 07:02:28,591 epoch 45 - iter 3348/5581 - loss 0.51264508 - samples/sec: 148.52
2020-08-06 07:04:27,445 epoch 45 - iter 3906/5581 - loss 0.51014184 - samples/sec: 151.39
2020-08-06 07:06:28,694 epoch 45 - iter 4464/5581 - loss 0.51194293 - samples/sec: 148.43
2020-08-06 07:08:30,415 epoch 45 - iter 5022/5581 - loss 0.51267375 - samples/sec: 147.81
2020-08-06 07:10:31,002 epoch 45 - iter 5580/5581 - loss 0.51196765 - samples/sec: 149.27
2020-08-06 07:10:32,241 ----------------------------------------------------------------------------------------------------
2020-08-06 07:10:32,242 EPOCH 45 done: loss 0.5120 - lr 0.0125000
2020-08-06 07:11:36,347 DEV : loss 0.6236979961395264 - score 0.8726
2020-08-06 07:11:38,245 BAD EPOCHS (no improvement): 3
2020-08-06 07:11:38,257 ----------------------------------------------------------------------------------------------------
2020-08-06 07:13:38,905 epoch 46 - iter 558/5581 - loss 0.51837768 - samples/sec: 148.11
2020-08-06 07:15:39,679 epoch 46 - iter 1116/5581 - loss 0.50270179 - samples/sec: 149.02
2020-08-06 07:17:40,458 epoch 46 - iter 1674/5581 - loss 0.50552139 - samples/sec: 149.15
2020-08-06 07:19:38,427 epoch 46 - iter 2232/5581 - loss 0.50687447 - samples/sec: 152.35
2020-08-06 07:21:53,649 epoch 46 - iter 2790/5581 - loss 0.50647705 - samples/sec: 132.94
2020-08-06 07:23:52,139 epoch 46 - iter 3348/5581 - loss 0.50725312 - samples/sec: 151.94
2020-08-06 07:25:50,493 epoch 46 - iter 3906/5581 - loss 0.50626831 - samples/sec: 152.02
2020-08-06 07:27:48,872 epoch 46 - iter 4464/5581 - loss 0.50587402 - samples/sec: 151.92
2020-08-06 07:29:48,837 epoch 46 - iter 5022/5581 - loss 0.51083841 - samples/sec: 149.76
2020-08-06 07:31:50,818 epoch 46 - iter 5580/5581 - loss 0.51216965 - samples/sec: 147.48
2020-08-06 07:31:51,803 ----------------------------------------------------------------------------------------------------
2020-08-06 07:31:51,803 EPOCH 46 done: loss 0.5123 - lr 0.0125000
2020-08-06 07:32:55,713 DEV : loss 0.6253641843795776 - score 0.8736
2020-08-06 07:32:57,616 BAD EPOCHS (no improvement): 4
2020-08-06 07:32:57,623 ----------------------------------------------------------------------------------------------------
2020-08-06 07:34:57,522 epoch 47 - iter 558/5581 - loss 0.50353852 - samples/sec: 149.03
2020-08-06 07:36:57,254 epoch 47 - iter 1116/5581 - loss 0.50687429 - samples/sec: 150.24
2020-08-06 07:38:55,535 epoch 47 - iter 1674/5581 - loss 0.50237174 - samples/sec: 152.03
2020-08-06 07:40:56,735 epoch 47 - iter 2232/5581 - loss 0.50273477 - samples/sec: 148.35
2020-08-06 07:42:54,279 epoch 47 - iter 2790/5581 - loss 0.50583693 - samples/sec: 153.06
2020-08-06 07:44:56,842 epoch 47 - iter 3348/5581 - loss 0.50980179 - samples/sec: 146.79
2020-08-06 07:46:56,915 epoch 47 - iter 3906/5581 - loss 0.50937764 - samples/sec: 149.75
2020-08-06 07:48:57,368 epoch 47 - iter 4464/5581 - loss 0.51127356 - samples/sec: 149.37
2020-08-06 07:50:55,317 epoch 47 - iter 5022/5581 - loss 0.51057296 - samples/sec: 152.46
2020-08-06 07:52:54,126 epoch 47 - iter 5580/5581 - loss 0.50888000 - samples/sec: 151.73
2020-08-06 07:52:55,169 ----------------------------------------------------------------------------------------------------
2020-08-06 07:52:55,169 EPOCH 47 done: loss 0.5088 - lr 0.0062500
2020-08-06 07:53:58,735 DEV : loss 0.62977534532547 - score 0.873
2020-08-06 07:54:00,636 BAD EPOCHS (no improvement): 1
2020-08-06 07:54:00,668 ----------------------------------------------------------------------------------------------------
2020-08-06 07:56:01,612 epoch 48 - iter 558/5581 - loss 0.49203223 - samples/sec: 147.75
2020-08-06 07:58:00,565 epoch 48 - iter 1116/5581 - loss 0.49239586 - samples/sec: 151.26
2020-08-06 07:59:59,361 epoch 48 - iter 1674/5581 - loss 0.49518191 - samples/sec: 151.45
2020-08-06 08:01:59,337 epoch 48 - iter 2232/5581 - loss 0.49666001 - samples/sec: 149.72
2020-08-06 08:04:00,434 epoch 48 - iter 2790/5581 - loss 0.49927478 - samples/sec: 149.29
2020-08-06 08:06:02,812 epoch 48 - iter 3348/5581 - loss 0.50442273 - samples/sec: 147.03
2020-08-06 08:08:03,815 epoch 48 - iter 3906/5581 - loss 0.50627157 - samples/sec: 149.05
2020-08-06 08:10:02,737 epoch 48 - iter 4464/5581 - loss 0.50703859 - samples/sec: 151.18
2020-08-06 08:12:02,207 epoch 48 - iter 5022/5581 - loss 0.50632255 - samples/sec: 150.71
2020-08-06 08:14:00,969 epoch 48 - iter 5580/5581 - loss 0.50666738 - samples/sec: 151.38
2020-08-06 08:14:02,088 ----------------------------------------------------------------------------------------------------
2020-08-06 08:14:02,088 EPOCH 48 done: loss 0.5066 - lr 0.0062500
2020-08-06 08:15:05,837 DEV : loss 0.6248084306716919 - score 0.8736
2020-08-06 08:15:07,732 BAD EPOCHS (no improvement): 2
2020-08-06 08:15:07,739 ----------------------------------------------------------------------------------------------------
2020-08-06 08:17:07,972 epoch 49 - iter 558/5581 - loss 0.49717195 - samples/sec: 148.61
2020-08-06 08:19:10,186 epoch 49 - iter 1116/5581 - loss 0.50682312 - samples/sec: 147.35
2020-08-06 08:21:09,940 epoch 49 - iter 1674/5581 - loss 0.50274729 - samples/sec: 150.37
2020-08-06 08:23:10,836 epoch 49 - iter 2232/5581 - loss 0.51210155 - samples/sec: 148.92
2020-08-06 08:25:07,632 epoch 49 - iter 2790/5581 - loss 0.51134701 - samples/sec: 154.07
2020-08-06 08:27:08,512 epoch 49 - iter 3348/5581 - loss 0.50992843 - samples/sec: 148.97
2020-08-06 08:29:08,187 epoch 49 - iter 3906/5581 - loss 0.51084752 - samples/sec: 150.44
2020-08-06 08:31:09,580 epoch 49 - iter 4464/5581 - loss 0.50759040 - samples/sec: 148.13
2020-08-06 08:33:19,456 epoch 49 - iter 5022/5581 - loss 0.50533087 - samples/sec: 138.40
2020-08-06 08:35:18,242 epoch 49 - iter 5580/5581 - loss 0.50492343 - samples/sec: 151.51
2020-08-06 08:35:19,090 ----------------------------------------------------------------------------------------------------
2020-08-06 08:35:19,090 EPOCH 49 done: loss 0.5049 - lr 0.0062500
2020-08-06 08:36:22,823 DEV : loss 0.6279003620147705 - score 0.8742
2020-08-06 08:36:24,716 BAD EPOCHS (no improvement): 0
2020-08-06 08:36:44,604 ----------------------------------------------------------------------------------------------------
2020-08-06 08:38:43,703 epoch 50 - iter 558/5581 - loss 0.49887543 - samples/sec: 150.03
2020-08-06 08:40:42,727 epoch 50 - iter 1116/5581 - loss 0.49770689 - samples/sec: 151.12
2020-08-06 08:42:42,695 epoch 50 - iter 1674/5581 - loss 0.50218048 - samples/sec: 149.87
2020-08-06 08:44:43,759 epoch 50 - iter 2232/5581 - loss 0.50532495 - samples/sec: 148.97
2020-08-06 08:46:42,790 epoch 50 - iter 2790/5581 - loss 0.50386192 - samples/sec: 151.20
2020-08-06 08:48:43,249 epoch 50 - iter 3348/5581 - loss 0.50412022 - samples/sec: 149.27
2020-08-06 08:50:41,416 epoch 50 - iter 3906/5581 - loss 0.50242799 - samples/sec: 152.11
2020-08-06 08:52:41,291 epoch 50 - iter 4464/5581 - loss 0.50017766 - samples/sec: 150.41
2020-08-06 08:54:41,990 epoch 50 - iter 5022/5581 - loss 0.50277488 - samples/sec: 149.19
2020-08-06 08:56:40,731 epoch 50 - iter 5580/5581 - loss 0.50163737 - samples/sec: 151.34
2020-08-06 08:56:41,668 ----------------------------------------------------------------------------------------------------
2020-08-06 08:56:41,668 EPOCH 50 done: loss 0.5018 - lr 0.0062500
2020-08-06 08:57:45,520 DEV : loss 0.6260096430778503 - score 0.8738
2020-08-06 08:57:47,421 BAD EPOCHS (no improvement): 1
2020-08-06 08:57:47,434 ----------------------------------------------------------------------------------------------------
2020-08-06 08:59:48,874 epoch 51 - iter 558/5581 - loss 0.52224220 - samples/sec: 147.15
2020-08-06 09:01:46,773 epoch 51 - iter 1116/5581 - loss 0.50287285 - samples/sec: 152.45
2020-08-06 09:03:44,051 epoch 51 - iter 1674/5581 - loss 0.49905330 - samples/sec: 153.87
2020-08-06 09:05:42,460 epoch 51 - iter 2232/5581 - loss 0.49733220 - samples/sec: 152.28
2020-08-06 09:07:45,310 epoch 51 - iter 2790/5581 - loss 0.50207625 - samples/sec: 147.17
2020-08-06 09:09:51,937 epoch 51 - iter 3348/5581 - loss 0.50571456 - samples/sec: 142.49
2020-08-06 09:11:53,889 epoch 51 - iter 3906/5581 - loss 0.50658779 - samples/sec: 148.63
2020-08-06 09:13:59,260 epoch 51 - iter 4464/5581 - loss 0.50736050 - samples/sec: 144.55
2020-08-06 09:16:01,679 epoch 51 - iter 5022/5581 - loss 0.50633189 - samples/sec: 147.08
2020-08-06 09:18:05,496 epoch 51 - iter 5580/5581 - loss 0.50377550 - samples/sec: 146.23
2020-08-06 09:18:07,419 ----------------------------------------------------------------------------------------------------
2020-08-06 09:18:07,419 EPOCH 51 done: loss 0.5038 - lr 0.0062500
2020-08-06 09:19:12,402 DEV : loss 0.6305728554725647 - score 0.874
2020-08-06 09:19:14,298 BAD EPOCHS (no improvement): 2
2020-08-06 09:19:14,303 ----------------------------------------------------------------------------------------------------
2020-08-06 09:21:02,672 epoch 52 - iter 558/5581 - loss 0.50287097 - samples/sec: 164.85
2020-08-06 09:22:48,567 epoch 52 - iter 1116/5581 - loss 0.49282103 - samples/sec: 169.74
2020-08-06 09:24:33,687 epoch 52 - iter 1674/5581 - loss 0.49889237 - samples/sec: 171.35
2020-08-06 09:26:19,696 epoch 52 - iter 2232/5581 - loss 0.50502548 - samples/sec: 169.86
2020-08-06 09:28:04,822 epoch 52 - iter 2790/5581 - loss 0.50434170 - samples/sec: 171.25
2020-08-06 09:29:50,732 epoch 52 - iter 3348/5581 - loss 0.50334672 - samples/sec: 170.13
2020-08-06 09:31:39,348 epoch 52 - iter 3906/5581 - loss 0.50364396 - samples/sec: 167.58
2020-08-06 09:33:25,802 epoch 52 - iter 4464/5581 - loss 0.50318967 - samples/sec: 169.19
2020-08-06 09:35:12,171 epoch 52 - iter 5022/5581 - loss 0.50078395 - samples/sec: 169.06
2020-08-06 09:36:58,839 epoch 52 - iter 5580/5581 - loss 0.50031704 - samples/sec: 169.07
2020-08-06 09:36:59,977 ----------------------------------------------------------------------------------------------------
2020-08-06 09:36:59,977 EPOCH 52 done: loss 0.5003 - lr 0.0062500
2020-08-06 09:38:17,521 DEV : loss 0.6280994415283203 - score 0.8735
2020-08-06 09:38:19,435 BAD EPOCHS (no improvement): 3
2020-08-06 09:38:19,444 ----------------------------------------------------------------------------------------------------
2020-08-06 09:40:06,011 epoch 53 - iter 558/5581 - loss 0.50214398 - samples/sec: 167.65
2020-08-06 09:41:54,068 epoch 53 - iter 1116/5581 - loss 0.50847117 - samples/sec: 166.47
2020-08-06 09:43:40,669 epoch 53 - iter 1674/5581 - loss 0.50871711 - samples/sec: 169.02
2020-08-06 09:45:27,607 epoch 53 - iter 2232/5581 - loss 0.50896728 - samples/sec: 168.29
2020-08-06 09:47:13,971 epoch 53 - iter 2790/5581 - loss 0.50380764 - samples/sec: 169.16
2020-08-06 09:49:01,266 epoch 53 - iter 3348/5581 - loss 0.50142160 - samples/sec: 167.89
2020-08-06 09:50:45,177 epoch 53 - iter 3906/5581 - loss 0.50236383 - samples/sec: 173.01
2020-08-06 09:52:30,930 epoch 53 - iter 4464/5581 - loss 0.50138478 - samples/sec: 170.06
2020-08-06 09:54:29,163 epoch 53 - iter 5022/5581 - loss 0.50113276 - samples/sec: 151.98
2020-08-06 09:56:25,233 epoch 53 - iter 5580/5581 - loss 0.49869153 - samples/sec: 154.89
2020-08-06 09:56:26,044 ----------------------------------------------------------------------------------------------------
2020-08-06 09:56:26,045 EPOCH 53 done: loss 0.4986 - lr 0.0062500
2020-08-06 09:57:29,606 DEV : loss 0.6303023099899292 - score 0.8748
2020-08-06 09:57:31,507 BAD EPOCHS (no improvement): 0
2020-08-06 09:57:48,670 ----------------------------------------------------------------------------------------------------
2020-08-06 09:59:45,760 epoch 54 - iter 558/5581 - loss 0.49469658 - samples/sec: 152.61
2020-08-06 10:01:44,531 epoch 54 - iter 1116/5581 - loss 0.49365034 - samples/sec: 151.56
2020-08-06 10:03:43,455 epoch 54 - iter 1674/5581 - loss 0.49323397 - samples/sec: 151.71
2020-08-06 10:05:42,974 epoch 54 - iter 2232/5581 - loss 0.49098355 - samples/sec: 150.70
2020-08-06 10:07:44,219 epoch 54 - iter 2790/5581 - loss 0.49206675 - samples/sec: 148.51
2020-08-06 10:09:51,371 epoch 54 - iter 3348/5581 - loss 0.49186616 - samples/sec: 141.63
2020-08-06 10:11:57,306 epoch 54 - iter 3906/5581 - loss 0.49744408 - samples/sec: 142.91
2020-08-06 10:14:03,697 epoch 54 - iter 4464/5581 - loss 0.49858190 - samples/sec: 142.54
2020-08-06 10:16:09,342 epoch 54 - iter 5022/5581 - loss 0.49794397 - samples/sec: 143.63
2020-08-06 10:18:13,200 epoch 54 - iter 5580/5581 - loss 0.49871261 - samples/sec: 145.28
2020-08-06 10:18:14,097 ----------------------------------------------------------------------------------------------------
2020-08-06 10:18:14,098 EPOCH 54 done: loss 0.4986 - lr 0.0062500
2020-08-06 10:19:21,487 DEV : loss 0.631725549697876 - score 0.8738
2020-08-06 10:19:23,425 BAD EPOCHS (no improvement): 1
2020-08-06 10:19:23,430 ----------------------------------------------------------------------------------------------------
2020-08-06 10:21:26,891 epoch 55 - iter 558/5581 - loss 0.47273634 - samples/sec: 144.74
2020-08-06 10:23:31,941 epoch 55 - iter 1116/5581 - loss 0.48316083 - samples/sec: 144.10
2020-08-06 10:25:37,032 epoch 55 - iter 1674/5581 - loss 0.50024866 - samples/sec: 143.95
2020-08-06 10:28:21,425 epoch 55 - iter 2232/5581 - loss 0.49820491 - samples/sec: 109.84
2020-08-06 10:30:53,349 epoch 55 - iter 2790/5581 - loss 0.49666700 - samples/sec: 119.22
2020-08-06 10:33:19,878 epoch 55 - iter 3348/5581 - loss 0.49854433 - samples/sec: 123.68
2020-08-06 10:35:40,503 epoch 55 - iter 3906/5581 - loss 0.49746640 - samples/sec: 128.70
2020-08-06 10:37:59,196 epoch 55 - iter 4464/5581 - loss 0.49879357 - samples/sec: 130.22
2020-08-06 10:40:09,253 epoch 55 - iter 5022/5581 - loss 0.49855502 - samples/sec: 138.72
2020-08-06 10:42:21,987 epoch 55 - iter 5580/5581 - loss 0.49866400 - samples/sec: 135.88
2020-08-06 10:42:22,912 ----------------------------------------------------------------------------------------------------
2020-08-06 10:42:22,912 EPOCH 55 done: loss 0.4988 - lr 0.0062500
2020-08-06 10:44:14,653 DEV : loss 0.6294503211975098 - score 0.8741
2020-08-06 10:44:16,755 BAD EPOCHS (no improvement): 2
2020-08-06 10:44:16,760 ----------------------------------------------------------------------------------------------------
2020-08-06 10:46:26,594 epoch 56 - iter 558/5581 - loss 0.49278067 - samples/sec: 137.66
2020-08-06 10:48:34,054 epoch 56 - iter 1116/5581 - loss 0.49729579 - samples/sec: 141.08
2020-08-06 10:50:45,843 epoch 56 - iter 1674/5581 - loss 0.50058536 - samples/sec: 136.34
2020-08-06 10:52:54,835 epoch 56 - iter 2232/5581 - loss 0.50350414 - samples/sec: 139.67
2020-08-06 10:55:05,694 epoch 56 - iter 2790/5581 - loss 0.50164610 - samples/sec: 137.34
2020-08-06 10:57:13,223 epoch 56 - iter 3348/5581 - loss 0.49862033 - samples/sec: 141.05
2020-08-06 10:59:17,418 epoch 56 - iter 3906/5581 - loss 0.49563045 - samples/sec: 144.76
2020-08-06 11:01:24,496 epoch 56 - iter 4464/5581 - loss 0.49763975 - samples/sec: 141.49
2020-08-06 11:03:33,681 epoch 56 - iter 5022/5581 - loss 0.50194550 - samples/sec: 139.87
2020-08-06 11:05:40,928 epoch 56 - iter 5580/5581 - loss 0.49882800 - samples/sec: 141.62
2020-08-06 11:05:41,844 ----------------------------------------------------------------------------------------------------
2020-08-06 11:05:41,845 EPOCH 56 done: loss 0.4990 - lr 0.0062500
2020-08-06 11:06:49,985 DEV : loss 0.6318565607070923 - score 0.8733
2020-08-06 11:06:52,074 BAD EPOCHS (no improvement): 3
2020-08-06 11:06:52,080 ----------------------------------------------------------------------------------------------------
2020-08-06 11:08:56,636 epoch 57 - iter 558/5581 - loss 0.49169320 - samples/sec: 143.49
2020-08-06 11:11:06,197 epoch 57 - iter 1116/5581 - loss 0.49207338 - samples/sec: 138.96
2020-08-06 11:13:15,118 epoch 57 - iter 1674/5581 - loss 0.50048994 - samples/sec: 139.83
2020-08-06 11:15:20,598 epoch 57 - iter 2232/5581 - loss 0.49442682 - samples/sec: 143.41
2020-08-06 11:17:28,326 epoch 57 - iter 2790/5581 - loss 0.49477099 - samples/sec: 141.60
2020-08-06 11:19:35,980 epoch 57 - iter 3348/5581 - loss 0.49716350 - samples/sec: 141.19
2020-08-06 11:21:46,176 epoch 57 - iter 3906/5581 - loss 0.49780144 - samples/sec: 138.02
2020-08-06 11:23:53,440 epoch 57 - iter 4464/5581 - loss 0.49672452 - samples/sec: 141.28
2020-08-06 11:26:00,950 epoch 57 - iter 5022/5581 - loss 0.49627103 - samples/sec: 140.99
2020-08-06 11:28:13,780 epoch 57 - iter 5580/5581 - loss 0.49658225 - samples/sec: 135.29
2020-08-06 11:28:14,571 ----------------------------------------------------------------------------------------------------
2020-08-06 11:28:14,571 EPOCH 57 done: loss 0.4965 - lr 0.0062500
2020-08-06 11:29:23,309 DEV : loss 0.6290298700332642 - score 0.8741
2020-08-06 11:29:25,397 BAD EPOCHS (no improvement): 4
2020-08-06 11:29:25,407 ----------------------------------------------------------------------------------------------------
2020-08-06 11:31:37,532 epoch 58 - iter 558/5581 - loss 0.48717729 - samples/sec: 135.26
2020-08-06 11:34:35,452 epoch 58 - iter 1116/5581 - loss 0.49001539 - samples/sec: 100.89
2020-08-06 11:36:44,956 epoch 58 - iter 1674/5581 - loss 0.49727427 - samples/sec: 138.89
2020-08-06 11:38:55,445 epoch 58 - iter 2232/5581 - loss 0.49461032 - samples/sec: 137.68
2020-08-06 11:41:07,277 epoch 58 - iter 2790/5581 - loss 0.49662823 - samples/sec: 136.34
2020-08-06 11:43:16,978 epoch 58 - iter 3348/5581 - loss 0.49557778 - samples/sec: 138.74
2020-08-06 11:45:24,910 epoch 58 - iter 3906/5581 - loss 0.49659416 - samples/sec: 140.36
2020-08-06 11:47:32,882 epoch 58 - iter 4464/5581 - loss 0.49515006 - samples/sec: 140.33
2020-08-06 11:49:44,913 epoch 58 - iter 5022/5581 - loss 0.49597311 - samples/sec: 135.93
2020-08-06 11:51:55,554 epoch 58 - iter 5580/5581 - loss 0.49596687 - samples/sec: 137.82
2020-08-06 11:51:56,417 ----------------------------------------------------------------------------------------------------
2020-08-06 11:51:56,417 EPOCH 58 done: loss 0.4960 - lr 0.0031250
2020-08-06 11:54:16,788 DEV : loss 0.6266892552375793 - score 0.8739
2020-08-06 11:54:18,903 BAD EPOCHS (no improvement): 1
2020-08-06 11:54:18,982 ----------------------------------------------------------------------------------------------------
2020-08-06 11:56:40,912 epoch 59 - iter 558/5581 - loss 0.50375348 - samples/sec: 125.92
2020-08-06 11:58:48,904 epoch 59 - iter 1116/5581 - loss 0.49590303 - samples/sec: 140.36
2020-08-06 12:01:17,452 epoch 59 - iter 1674/5581 - loss 0.49068093 - samples/sec: 120.94
2020-08-06 12:03:23,690 epoch 59 - iter 2232/5581 - loss 0.49247184 - samples/sec: 142.48
2020-08-06 12:05:29,159 epoch 59 - iter 2790/5581 - loss 0.49144121 - samples/sec: 143.30
2020-08-06 12:07:37,990 epoch 59 - iter 3348/5581 - loss 0.49285032 - samples/sec: 139.59
2020-08-06 12:09:47,564 epoch 59 - iter 3906/5581 - loss 0.49356432 - samples/sec: 139.18
2020-08-06 12:11:54,389 epoch 59 - iter 4464/5581 - loss 0.49361364 - samples/sec: 141.67
2020-08-06 12:14:00,561 epoch 59 - iter 5022/5581 - loss 0.49368903 - samples/sec: 142.78
2020-08-06 12:16:12,566 epoch 59 - iter 5580/5581 - loss 0.49428850 - samples/sec: 136.33
2020-08-06 12:16:13,372 ----------------------------------------------------------------------------------------------------
2020-08-06 12:16:13,373 EPOCH 59 done: loss 0.4942 - lr 0.0031250
2020-08-06 12:17:22,210 DEV : loss 0.6277196407318115 - score 0.8741
2020-08-06 12:17:24,305 BAD EPOCHS (no improvement): 2
2020-08-06 12:17:24,309 ----------------------------------------------------------------------------------------------------
2020-08-06 12:19:31,417 epoch 60 - iter 558/5581 - loss 0.51111710 - samples/sec: 140.60
2020-08-06 12:21:41,320 epoch 60 - iter 1116/5581 - loss 0.49821205 - samples/sec: 138.42
2020-08-06 12:23:47,031 epoch 60 - iter 1674/5581 - loss 0.49103330 - samples/sec: 143.05
2020-08-06 12:25:52,778 epoch 60 - iter 2232/5581 - loss 0.49733179 - samples/sec: 142.94
2020-08-06 12:27:59,254 epoch 60 - iter 2790/5581 - loss 0.49556275 - samples/sec: 142.06
2020-08-06 12:30:04,628 epoch 60 - iter 3348/5581 - loss 0.49363061 - samples/sec: 143.30
2020-08-06 12:32:09,118 epoch 60 - iter 3906/5581 - loss 0.49479822 - samples/sec: 144.94
2020-08-06 12:34:13,472 epoch 60 - iter 4464/5581 - loss 0.49671177 - samples/sec: 145.12
2020-08-06 12:36:22,423 epoch 60 - iter 5022/5581 - loss 0.49765038 - samples/sec: 139.84
2020-08-06 12:38:28,212 epoch 60 - iter 5580/5581 - loss 0.49682768 - samples/sec: 143.14
2020-08-06 12:38:29,164 ----------------------------------------------------------------------------------------------------
2020-08-06 12:38:29,164 EPOCH 60 done: loss 0.4968 - lr 0.0031250
2020-08-06 12:39:40,949 DEV : loss 0.6320286393165588 - score 0.8737
2020-08-06 12:39:43,060 BAD EPOCHS (no improvement): 3
2020-08-06 12:39:43,087 ----------------------------------------------------------------------------------------------------
2020-08-06 12:42:53,473 epoch 61 - iter 558/5581 - loss 0.49093117 - samples/sec: 93.84
2020-08-06 12:44:51,030 epoch 61 - iter 1116/5581 - loss 0.49284800 - samples/sec: 152.97
2020-08-06 12:46:44,040 epoch 61 - iter 1674/5581 - loss 0.49472861 - samples/sec: 158.99
2020-08-06 12:48:48,551 epoch 61 - iter 2232/5581 - loss 0.49661817 - samples/sec: 144.21
2020-08-06 12:50:57,948 epoch 61 - iter 2790/5581 - loss 0.49737725 - samples/sec: 138.83
2020-08-06 12:53:06,158 epoch 61 - iter 3348/5581 - loss 0.49687836 - samples/sec: 140.31
2020-08-06 12:55:09,158 epoch 61 - iter 3906/5581 - loss 0.49719428 - samples/sec: 146.44
2020-08-06 12:57:18,337 epoch 61 - iter 4464/5581 - loss 0.49740126 - samples/sec: 139.16
2020-08-06 12:59:23,140 epoch 61 - iter 5022/5581 - loss 0.49617284 - samples/sec: 144.06
2020-08-06 13:01:57,413 epoch 61 - iter 5580/5581 - loss 0.49627575 - samples/sec: 116.55
2020-08-06 13:01:59,477 ----------------------------------------------------------------------------------------------------
2020-08-06 13:01:59,477 EPOCH 61 done: loss 0.4964 - lr 0.0031250
2020-08-06 13:03:38,800 DEV : loss 0.6291696429252625 - score 0.8734
2020-08-06 13:03:40,872 BAD EPOCHS (no improvement): 4
2020-08-06 13:03:40,882 ----------------------------------------------------------------------------------------------------
2020-08-06 13:05:46,173 epoch 62 - iter 558/5581 - loss 0.50485282 - samples/sec: 142.64
2020-08-06 13:07:52,186 epoch 62 - iter 1116/5581 - loss 0.49794420 - samples/sec: 142.72
2020-08-06 13:10:40,984 epoch 62 - iter 1674/5581 - loss 0.49858589 - samples/sec: 106.46
2020-08-06 13:12:45,685 epoch 62 - iter 2232/5581 - loss 0.49698344 - samples/sec: 144.22
2020-08-06 13:14:51,598 epoch 62 - iter 2790/5581 - loss 0.49227658 - samples/sec: 142.79
2020-08-06 13:16:56,434 epoch 62 - iter 3348/5581 - loss 0.49434599 - samples/sec: 144.06
2020-08-06 13:19:15,922 epoch 62 - iter 3906/5581 - loss 0.50071136 - samples/sec: 129.04
2020-08-06 13:21:21,474 epoch 62 - iter 4464/5581 - loss 0.50020123 - samples/sec: 143.30
2020-08-06 13:23:29,534 epoch 62 - iter 5022/5581 - loss 0.49944732 - samples/sec: 140.72
2020-08-06 13:25:35,444 epoch 62 - iter 5580/5581 - loss 0.49686164 - samples/sec: 142.80
2020-08-06 13:25:36,187 ----------------------------------------------------------------------------------------------------
2020-08-06 13:25:36,187 EPOCH 62 done: loss 0.4969 - lr 0.0015625
2020-08-06 13:26:43,378 DEV : loss 0.6293777227401733 - score 0.8732
2020-08-06 13:26:45,468 BAD EPOCHS (no improvement): 1
2020-08-06 13:26:45,474 ----------------------------------------------------------------------------------------------------
2020-08-06 13:28:53,101 epoch 63 - iter 558/5581 - loss 0.49904239 - samples/sec: 140.03
2020-08-06 13:31:16,031 epoch 63 - iter 1116/5581 - loss 0.50095897 - samples/sec: 125.64
2020-08-06 13:33:25,143 epoch 63 - iter 1674/5581 - loss 0.50029639 - samples/sec: 139.19
2020-08-06 13:35:28,968 epoch 63 - iter 2232/5581 - loss 0.49470156 - samples/sec: 145.15
2020-08-06 13:37:34,074 epoch 63 - iter 2790/5581 - loss 0.49531292 - samples/sec: 143.61
2020-08-06 13:39:37,997 epoch 63 - iter 3348/5581 - loss 0.49656667 - samples/sec: 145.53
2020-08-06 13:41:30,968 epoch 63 - iter 3906/5581 - loss 0.49687262 - samples/sec: 159.23
2020-08-06 13:43:24,882 epoch 63 - iter 4464/5581 - loss 0.49555913 - samples/sec: 157.96
2020-08-06 13:45:21,375 epoch 63 - iter 5022/5581 - loss 0.49668437 - samples/sec: 158.65
2020-08-06 13:47:22,773 epoch 63 - iter 5580/5581 - loss 0.49366615 - samples/sec: 149.22
2020-08-06 13:47:23,940 ----------------------------------------------------------------------------------------------------
2020-08-06 13:47:23,940 EPOCH 63 done: loss 0.4937 - lr 0.0015625
2020-08-06 13:48:32,116 DEV : loss 0.6290709376335144 - score 0.8739
2020-08-06 13:48:34,200 BAD EPOCHS (no improvement): 2
2020-08-06 13:48:34,204 ----------------------------------------------------------------------------------------------------
2020-08-06 13:50:38,371 epoch 64 - iter 558/5581 - loss 0.49508114 - samples/sec: 143.94
2020-08-06 13:52:41,692 epoch 64 - iter 1116/5581 - loss 0.49283101 - samples/sec: 145.71
2020-08-06 13:54:53,447 epoch 64 - iter 1674/5581 - loss 0.49244342 - samples/sec: 137.18
2020-08-06 13:56:59,045 epoch 64 - iter 2232/5581 - loss 0.49293817 - samples/sec: 143.06
2020-08-06 13:59:04,630 epoch 64 - iter 2790/5581 - loss 0.49153054 - samples/sec: 143.24
2020-08-06 14:01:13,228 epoch 64 - iter 3348/5581 - loss 0.49826323 - samples/sec: 140.78
2020-08-06 14:03:17,653 epoch 64 - iter 3906/5581 - loss 0.49862480 - samples/sec: 145.11
2020-08-06 14:05:21,221 epoch 64 - iter 4464/5581 - loss 0.49513474 - samples/sec: 146.64
2020-08-06 14:07:28,932 epoch 64 - iter 5022/5581 - loss 0.49395388 - samples/sec: 140.80
2020-08-06 14:09:36,618 epoch 64 - iter 5580/5581 - loss 0.49517618 - samples/sec: 141.55
2020-08-06 14:09:38,473 ----------------------------------------------------------------------------------------------------
2020-08-06 14:09:38,473 EPOCH 64 done: loss 0.4951 - lr 0.0015625
2020-08-06 14:10:45,343 DEV : loss 0.629976749420166 - score 0.8737
2020-08-06 14:10:47,431 BAD EPOCHS (no improvement): 3
2020-08-06 14:10:47,439 ----------------------------------------------------------------------------------------------------
2020-08-06 14:12:50,655 epoch 65 - iter 558/5581 - loss 0.49808914 - samples/sec: 145.05
2020-08-06 14:14:53,218 epoch 65 - iter 1116/5581 - loss 0.49901796 - samples/sec: 146.92
2020-08-06 14:16:54,307 epoch 65 - iter 1674/5581 - loss 0.49111559 - samples/sec: 148.66
2020-08-06 14:19:00,296 epoch 65 - iter 2232/5581 - loss 0.48557064 - samples/sec: 143.37
2020-08-06 14:21:09,662 epoch 65 - iter 2790/5581 - loss 0.49038739 - samples/sec: 139.62
2020-08-06 14:23:14,086 epoch 65 - iter 3348/5581 - loss 0.49127503 - samples/sec: 144.73
2020-08-06 14:25:18,925 epoch 65 - iter 3906/5581 - loss 0.49039934 - samples/sec: 144.10
2020-08-06 14:27:24,201 epoch 65 - iter 4464/5581 - loss 0.49124490 - samples/sec: 143.64
2020-08-06 14:29:32,865 epoch 65 - iter 5022/5581 - loss 0.49238795 - samples/sec: 139.84
2020-08-06 14:31:56,175 epoch 65 - iter 5580/5581 - loss 0.49211916 - samples/sec: 126.14
2020-08-06 14:31:57,440 ----------------------------------------------------------------------------------------------------
2020-08-06 14:31:57,440 EPOCH 65 done: loss 0.4923 - lr 0.0015625
2020-08-06 14:33:05,426 DEV : loss 0.6287750005722046 - score 0.8734
2020-08-06 14:33:07,522 BAD EPOCHS (no improvement): 4
2020-08-06 14:33:07,544 ----------------------------------------------------------------------------------------------------
2020-08-06 14:35:15,624 epoch 66 - iter 558/5581 - loss 0.49874003 - samples/sec: 139.53
2020-08-06 14:37:18,590 epoch 66 - iter 1116/5581 - loss 0.48914576 - samples/sec: 146.50
2020-08-06 14:39:22,864 epoch 66 - iter 1674/5581 - loss 0.49090028 - samples/sec: 144.71
2020-08-06 14:41:33,264 epoch 66 - iter 2232/5581 - loss 0.48878895 - samples/sec: 138.15
2020-08-06 14:43:42,100 epoch 66 - iter 2790/5581 - loss 0.49168729 - samples/sec: 139.61
2020-08-06 14:45:34,275 epoch 66 - iter 3348/5581 - loss 0.49439734 - samples/sec: 160.66
2020-08-06 14:47:43,898 epoch 66 - iter 3906/5581 - loss 0.49578618 - samples/sec: 139.22
2020-08-06 14:49:55,265 epoch 66 - iter 4464/5581 - loss 0.49443525 - samples/sec: 136.86
2020-08-06 14:52:06,542 epoch 66 - iter 5022/5581 - loss 0.49378963 - samples/sec: 136.87
2020-08-06 14:54:16,737 epoch 66 - iter 5580/5581 - loss 0.49357253 - samples/sec: 138.03
2020-08-06 14:54:17,589 ----------------------------------------------------------------------------------------------------
2020-08-06 14:54:17,589 EPOCH 66 done: loss 0.4937 - lr 0.0007813
2020-08-06 14:55:28,451 DEV : loss 0.6291069388389587 - score 0.8736
2020-08-06 14:55:30,564 BAD EPOCHS (no improvement): 1
2020-08-06 14:55:30,600 ----------------------------------------------------------------------------------------------------
2020-08-06 14:57:37,847 epoch 67 - iter 558/5581 - loss 0.46908199 - samples/sec: 140.46
2020-08-06 14:59:49,566 epoch 67 - iter 1116/5581 - loss 0.48378177 - samples/sec: 136.36
2020-08-06 15:01:59,636 epoch 67 - iter 1674/5581 - loss 0.48612060 - samples/sec: 138.53
2020-08-06 15:04:10,661 epoch 67 - iter 2232/5581 - loss 0.48476636 - samples/sec: 138.09
2020-08-06 15:06:23,421 epoch 67 - iter 2790/5581 - loss 0.49325934 - samples/sec: 135.74
2020-08-06 15:08:33,343 epoch 67 - iter 3348/5581 - loss 0.49121113 - samples/sec: 138.88
2020-08-06 15:10:41,882 epoch 67 - iter 3906/5581 - loss 0.48816476 - samples/sec: 139.92
2020-08-06 15:12:51,898 epoch 67 - iter 4464/5581 - loss 0.48800750 - samples/sec: 138.20
2020-08-06 15:15:02,021 epoch 67 - iter 5022/5581 - loss 0.49090655 - samples/sec: 138.22
2020-08-06 15:17:14,531 epoch 67 - iter 5580/5581 - loss 0.49103717 - samples/sec: 135.69
2020-08-06 15:17:15,359 ----------------------------------------------------------------------------------------------------
2020-08-06 15:17:15,361 EPOCH 67 done: loss 0.4911 - lr 0.0007813
2020-08-06 15:18:26,076 DEV : loss 0.6290508508682251 - score 0.8743
2020-08-06 15:18:28,163 BAD EPOCHS (no improvement): 2
2020-08-06 15:18:28,174 ----------------------------------------------------------------------------------------------------
2020-08-06 15:20:40,416 epoch 68 - iter 558/5581 - loss 0.51056371 - samples/sec: 135.15
2020-08-06 15:22:50,705 epoch 68 - iter 1116/5581 - loss 0.49702363 - samples/sec: 138.13
2020-08-06 15:25:03,613 epoch 68 - iter 1674/5581 - loss 0.50002886 - samples/sec: 135.30
2020-08-06 15:27:13,156 epoch 68 - iter 2232/5581 - loss 0.49978655 - samples/sec: 138.94
2020-08-06 15:29:22,585 epoch 68 - iter 2790/5581 - loss 0.49972477 - samples/sec: 138.93
2020-08-06 15:31:31,672 epoch 68 - iter 3348/5581 - loss 0.50061992 - samples/sec: 139.27
2020-08-06 15:33:39,408 epoch 68 - iter 3906/5581 - loss 0.49843670 - samples/sec: 140.89
2020-08-06 15:35:45,477 epoch 68 - iter 4464/5581 - loss 0.49702006 - samples/sec: 142.63
2020-08-06 15:37:53,603 epoch 68 - iter 5022/5581 - loss 0.49419304 - samples/sec: 140.27
2020-08-06 15:40:02,223 epoch 68 - iter 5580/5581 - loss 0.49294925 - samples/sec: 139.93
2020-08-06 15:40:03,594 ----------------------------------------------------------------------------------------------------
2020-08-06 15:40:03,594 EPOCH 68 done: loss 0.4932 - lr 0.0007813
2020-08-06 15:41:30,185 DEV : loss 0.6288003325462341 - score 0.8741
2020-08-06 15:41:32,268 BAD EPOCHS (no improvement): 3
2020-08-06 15:41:32,290 ----------------------------------------------------------------------------------------------------
2020-08-06 15:43:38,673 epoch 69 - iter 558/5581 - loss 0.48699219 - samples/sec: 141.42
2020-08-06 15:45:47,089 epoch 69 - iter 1116/5581 - loss 0.48405959 - samples/sec: 139.93
2020-08-06 15:48:02,841 epoch 69 - iter 1674/5581 - loss 0.48686126 - samples/sec: 132.46
2020-08-06 15:50:20,943 epoch 69 - iter 2232/5581 - loss 0.48511702 - samples/sec: 130.09
2020-08-06 15:52:34,653 epoch 69 - iter 2790/5581 - loss 0.49403476 - samples/sec: 134.54
2020-08-06 15:54:45,337 epoch 69 - iter 3348/5581 - loss 0.49435823 - samples/sec: 137.49
2020-08-06 15:56:52,103 epoch 69 - iter 3906/5581 - loss 0.49509271 - samples/sec: 141.95
2020-08-06 15:58:56,970 epoch 69 - iter 4464/5581 - loss 0.49546360 - samples/sec: 143.92
2020-08-06 16:01:03,645 epoch 69 - iter 5022/5581 - loss 0.49598458 - samples/sec: 141.91
2020-08-06 16:03:13,926 epoch 69 - iter 5580/5581 - loss 0.49734525 - samples/sec: 138.39
2020-08-06 16:03:15,163 ----------------------------------------------------------------------------------------------------
2020-08-06 16:03:15,163 EPOCH 69 done: loss 0.4973 - lr 0.0007813
2020-08-06 16:04:24,535 DEV : loss 0.6287738680839539 - score 0.8737
2020-08-06 16:04:26,614 BAD EPOCHS (no improvement): 4
2020-08-06 16:04:26,620 ----------------------------------------------------------------------------------------------------
2020-08-06 16:06:55,830 epoch 70 - iter 558/5581 - loss 0.50799738 - samples/sec: 119.79
2020-08-06 16:09:23,432 epoch 70 - iter 1116/5581 - loss 0.49058888 - samples/sec: 121.76
2020-08-06 16:11:38,173 epoch 70 - iter 1674/5581 - loss 0.48892194 - samples/sec: 133.45
2020-08-06 16:13:45,225 epoch 70 - iter 2232/5581 - loss 0.49032827 - samples/sec: 141.70
2020-08-06 16:15:51,826 epoch 70 - iter 2790/5581 - loss 0.48998575 - samples/sec: 142.05
2020-08-06 16:18:01,398 epoch 70 - iter 3348/5581 - loss 0.48825658 - samples/sec: 138.79
2020-08-06 16:20:09,688 epoch 70 - iter 3906/5581 - loss 0.49028590 - samples/sec: 140.16
2020-08-06 16:22:19,312 epoch 70 - iter 4464/5581 - loss 0.49092643 - samples/sec: 138.86
2020-08-06 16:24:24,941 epoch 70 - iter 5022/5581 - loss 0.48993113 - samples/sec: 143.07
2020-08-06 16:26:33,865 epoch 70 - iter 5580/5581 - loss 0.49053793 - samples/sec: 139.69
2020-08-06 16:26:34,768 ----------------------------------------------------------------------------------------------------
2020-08-06 16:26:34,768 EPOCH 70 done: loss 0.4905 - lr 0.0003906
2020-08-06 16:27:42,846 DEV : loss 0.6293092370033264 - score 0.8733
2020-08-06 16:27:44,971 BAD EPOCHS (no improvement): 1
2020-08-06 16:27:44,980 ----------------------------------------------------------------------------------------------------
2020-08-06 16:29:46,048 epoch 71 - iter 558/5581 - loss 0.48976722 - samples/sec: 147.64
2020-08-06 16:31:51,876 epoch 71 - iter 1116/5581 - loss 0.47171077 - samples/sec: 142.84
2020-08-06 16:34:00,020 epoch 71 - iter 1674/5581 - loss 0.48284707 - samples/sec: 140.28
2020-08-06 16:36:08,114 epoch 71 - iter 2232/5581 - loss 0.48814431 - samples/sec: 140.30
2020-08-06 16:38:16,676 epoch 71 - iter 2790/5581 - loss 0.48370528 - samples/sec: 139.84
2020-08-06 16:40:25,606 epoch 71 - iter 3348/5581 - loss 0.48339963 - samples/sec: 139.55
2020-08-06 16:42:33,844 epoch 71 - iter 3906/5581 - loss 0.48235915 - samples/sec: 140.07
2020-08-06 16:44:44,656 epoch 71 - iter 4464/5581 - loss 0.48491333 - samples/sec: 137.38
2020-08-06 16:46:54,708 epoch 71 - iter 5022/5581 - loss 0.48671720 - samples/sec: 138.19
2020-08-06 16:49:01,279 epoch 71 - iter 5580/5581 - loss 0.48949978 - samples/sec: 141.90
2020-08-06 16:49:02,172 ----------------------------------------------------------------------------------------------------
2020-08-06 16:49:02,173 EPOCH 71 done: loss 0.4895 - lr 0.0003906
2020-08-06 16:50:10,022 DEV : loss 0.6288748979568481 - score 0.874
2020-08-06 16:50:12,033 BAD EPOCHS (no improvement): 2
2020-08-06 16:50:12,040 ----------------------------------------------------------------------------------------------------
2020-08-06 16:52:34,832 epoch 72 - iter 558/5581 - loss 0.50871888 - samples/sec: 125.14
2020-08-06 16:54:39,275 epoch 72 - iter 1116/5581 - loss 0.51171020 - samples/sec: 144.79
2020-08-06 16:56:44,702 epoch 72 - iter 1674/5581 - loss 0.50231495 - samples/sec: 143.67
2020-08-06 16:58:51,189 epoch 72 - iter 2232/5581 - loss 0.49858842 - samples/sec: 142.10
2020-08-06 17:00:54,939 epoch 72 - iter 2790/5581 - loss 0.49655322 - samples/sec: 145.25
2020-08-06 17:03:00,521 epoch 72 - iter 3348/5581 - loss 0.49013850 - samples/sec: 143.77
2020-08-06 17:05:06,787 epoch 72 - iter 3906/5581 - loss 0.48994965 - samples/sec: 143.06
2020-08-06 17:07:09,711 epoch 72 - iter 4464/5581 - loss 0.48906491 - samples/sec: 146.28
2020-08-06 17:09:15,668 epoch 72 - iter 5022/5581 - loss 0.49102086 - samples/sec: 142.94
2020-08-06 17:11:26,212 epoch 72 - iter 5580/5581 - loss 0.49157933 - samples/sec: 137.68
2020-08-06 17:11:27,159 ----------------------------------------------------------------------------------------------------
2020-08-06 17:11:27,159 EPOCH 72 done: loss 0.4915 - lr 0.0003906
2020-08-06 17:12:35,457 DEV : loss 0.6290246248245239 - score 0.8741
2020-08-06 17:12:37,461 BAD EPOCHS (no improvement): 3
2020-08-06 17:12:37,465 ----------------------------------------------------------------------------------------------------
2020-08-06 17:14:43,522 epoch 73 - iter 558/5581 - loss 0.49214682 - samples/sec: 141.77
2020-08-06 17:16:48,112 epoch 73 - iter 1116/5581 - loss 0.48462672 - samples/sec: 144.17
2020-08-06 17:18:53,358 epoch 73 - iter 1674/5581 - loss 0.48517931 - samples/sec: 144.00
2020-08-06 17:20:58,470 epoch 73 - iter 2232/5581 - loss 0.48906558 - samples/sec: 144.06
2020-08-06 17:23:02,167 epoch 73 - iter 2790/5581 - loss 0.48861897 - samples/sec: 145.23
2020-08-06 17:25:08,816 epoch 73 - iter 3348/5581 - loss 0.49161423 - samples/sec: 141.96
2020-08-06 17:27:11,555 epoch 73 - iter 3906/5581 - loss 0.49103094 - samples/sec: 146.44
2020-08-06 17:29:15,790 epoch 73 - iter 4464/5581 - loss 0.49388988 - samples/sec: 144.61
2020-08-06 17:31:21,970 epoch 73 - iter 5022/5581 - loss 0.49164245 - samples/sec: 142.73
2020-08-06 17:33:29,343 epoch 73 - iter 5580/5581 - loss 0.49128463 - samples/sec: 141.04
2020-08-06 17:33:30,224 ----------------------------------------------------------------------------------------------------
2020-08-06 17:33:30,224 EPOCH 73 done: loss 0.4912 - lr 0.0003906
2020-08-06 17:34:37,402 DEV : loss 0.6279956102371216 - score 0.8743
2020-08-06 17:34:39,379 BAD EPOCHS (no improvement): 4
2020-08-06 17:34:39,389 ----------------------------------------------------------------------------------------------------
2020-08-06 17:36:43,146 epoch 74 - iter 558/5581 - loss 0.48443053 - samples/sec: 144.40
2020-08-06 17:38:51,008 epoch 74 - iter 1116/5581 - loss 0.48909242 - samples/sec: 140.67
2020-08-06 17:40:55,034 epoch 74 - iter 1674/5581 - loss 0.49056391 - samples/sec: 145.09
2020-08-06 17:43:00,662 epoch 74 - iter 2232/5581 - loss 0.49516107 - samples/sec: 143.02
2020-08-06 17:45:07,205 epoch 74 - iter 2790/5581 - loss 0.49108753 - samples/sec: 142.38
2020-08-06 17:47:12,551 epoch 74 - iter 3348/5581 - loss 0.49272517 - samples/sec: 143.43
2020-08-06 17:49:17,437 epoch 74 - iter 3906/5581 - loss 0.49091354 - samples/sec: 143.86
2020-08-06 17:51:22,694 epoch 74 - iter 4464/5581 - loss 0.49082743 - samples/sec: 143.46
2020-08-06 17:53:27,835 epoch 74 - iter 5022/5581 - loss 0.48920701 - samples/sec: 143.60
2020-08-06 17:55:32,009 epoch 74 - iter 5580/5581 - loss 0.48806623 - samples/sec: 144.69
2020-08-06 17:55:32,789 ----------------------------------------------------------------------------------------------------
2020-08-06 17:55:32,790 EPOCH 74 done: loss 0.4880 - lr 0.0001953
2020-08-06 17:56:41,375 DEV : loss 0.6288357973098755 - score 0.8741
2020-08-06 17:56:43,336 BAD EPOCHS (no improvement): 1
2020-08-06 17:56:43,343 ----------------------------------------------------------------------------------------------------
2020-08-06 17:58:46,337 epoch 75 - iter 558/5581 - loss 0.48607375 - samples/sec: 145.30
2020-08-06 18:00:51,142 epoch 75 - iter 1116/5581 - loss 0.49556456 - samples/sec: 143.89
2020-08-06 18:02:56,035 epoch 75 - iter 1674/5581 - loss 0.49078201 - samples/sec: 144.39
2020-08-06 18:05:17,118 epoch 75 - iter 2232/5581 - loss 0.48988405 - samples/sec: 127.67
2020-08-06 18:07:24,461 epoch 75 - iter 2790/5581 - loss 0.48654716 - samples/sec: 141.72
2020-08-06 18:09:29,737 epoch 75 - iter 3348/5581 - loss 0.48430264 - samples/sec: 143.81
2020-08-06 18:11:35,456 epoch 75 - iter 3906/5581 - loss 0.48539476 - samples/sec: 143.22
2020-08-06 18:13:40,347 epoch 75 - iter 4464/5581 - loss 0.48595632 - samples/sec: 144.81
2020-08-06 18:15:49,707 epoch 75 - iter 5022/5581 - loss 0.48733382 - samples/sec: 139.20
2020-08-06 18:17:56,252 epoch 75 - iter 5580/5581 - loss 0.48706119 - samples/sec: 141.95
2020-08-06 18:17:57,221 ----------------------------------------------------------------------------------------------------
2020-08-06 18:17:57,221 EPOCH 75 done: loss 0.4870 - lr 0.0001953
2020-08-06 18:19:04,949 DEV : loss 0.6287584900856018 - score 0.8743
2020-08-06 18:19:06,881 BAD EPOCHS (no improvement): 2
2020-08-06 18:19:06,888 ----------------------------------------------------------------------------------------------------
2020-08-06 18:21:09,650 epoch 76 - iter 558/5581 - loss 0.47790989 - samples/sec: 145.57
2020-08-06 18:23:19,253 epoch 76 - iter 1116/5581 - loss 0.49409890 - samples/sec: 138.81
2020-08-06 18:25:25,329 epoch 76 - iter 1674/5581 - loss 0.49541270 - samples/sec: 142.66
2020-08-06 18:27:30,591 epoch 76 - iter 2232/5581 - loss 0.49159851 - samples/sec: 143.42
2020-08-06 18:29:36,969 epoch 76 - iter 2790/5581 - loss 0.48991386 - samples/sec: 142.43
2020-08-06 18:31:42,379 epoch 76 - iter 3348/5581 - loss 0.48589460 - samples/sec: 143.32
2020-08-06 18:33:49,079 epoch 76 - iter 3906/5581 - loss 0.49127889 - samples/sec: 141.77
2020-08-06 18:35:52,261 epoch 76 - iter 4464/5581 - loss 0.49160274 - samples/sec: 145.93
2020-08-06 18:37:58,897 epoch 76 - iter 5022/5581 - loss 0.49047396 - samples/sec: 141.90
2020-08-06 18:40:01,585 epoch 76 - iter 5580/5581 - loss 0.49048288 - samples/sec: 146.44
2020-08-06 18:40:02,336 ----------------------------------------------------------------------------------------------------
2020-08-06 18:40:02,337 EPOCH 76 done: loss 0.4904 - lr 0.0001953
2020-08-06 18:41:10,335 DEV : loss 0.628635823726654 - score 0.8744
2020-08-06 18:41:12,265 BAD EPOCHS (no improvement): 3
2020-08-06 18:41:12,298 ----------------------------------------------------------------------------------------------------
2020-08-06 18:43:18,025 epoch 77 - iter 558/5581 - loss 0.49008863 - samples/sec: 142.14
2020-08-06 18:45:20,843 epoch 77 - iter 1116/5581 - loss 0.48524555 - samples/sec: 146.40
2020-08-06 18:47:27,940 epoch 77 - iter 1674/5581 - loss 0.48495199 - samples/sec: 141.40
2020-08-06 18:49:30,426 epoch 77 - iter 2232/5581 - loss 0.48015324 - samples/sec: 147.01
2020-08-06 18:51:36,860 epoch 77 - iter 2790/5581 - loss 0.48704686 - samples/sec: 142.18
2020-08-06 18:53:43,963 epoch 77 - iter 3348/5581 - loss 0.48772028 - samples/sec: 141.46
2020-08-06 18:55:48,118 epoch 77 - iter 3906/5581 - loss 0.48935595 - samples/sec: 144.82
2020-08-06 18:57:51,306 epoch 77 - iter 4464/5581 - loss 0.48825269 - samples/sec: 145.98
2020-08-06 18:59:59,539 epoch 77 - iter 5022/5581 - loss 0.48808780 - samples/sec: 140.03
2020-08-06 19:02:06,526 epoch 77 - iter 5580/5581 - loss 0.48826670 - samples/sec: 141.51
2020-08-06 19:02:08,258 ----------------------------------------------------------------------------------------------------
2020-08-06 19:02:08,259 EPOCH 77 done: loss 0.4882 - lr 0.0001953
2020-08-06 19:03:16,458 DEV : loss 0.6286206245422363 - score 0.8744
2020-08-06 19:03:18,393 BAD EPOCHS (no improvement): 4
2020-08-06 19:03:18,404 ----------------------------------------------------------------------------------------------------
2020-08-06 19:03:18,404 ----------------------------------------------------------------------------------------------------
2020-08-06 19:03:18,404 learning rate too small - quitting training!
2020-08-06 19:03:18,405 ----------------------------------------------------------------------------------------------------
2020-08-06 19:03:38,186 ----------------------------------------------------------------------------------------------------
2020-08-06 19:03:38,186 Testing using best model ...
2020-08-06 19:03:38,188 loading file new_models/huner-chemical/best-model.pt
2020-08-06 19:07:30,872 0.9311	0.9559	0.9434
2020-08-06 19:07:30,873 
Results:
- F1-score (micro) 0.9434
- F1-score (macro) 0.9434

By class:
Chemical   tp: 55503 - fp: 4104 - fn: 2560 - precision: 0.9311 - recall: 0.9559 - f1-score: 0.9434
2020-08-06 19:07:30,873 ----------------------------------------------------------------------------------------------------