2020-06-19 16:52:17,290 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:17,291 Model: "SequenceTagger(
  (embeddings): StackedEmbeddings(
    (list_embedding_0): WordEmbeddings('pubmed_pmc_wiki_sg_1M.gensim')
    (list_embedding_1): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
    (list_embedding_2): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
  )
  (word_dropout): WordDropout(p=0.05)
  (locked_dropout): LockedDropout(p=0.5)
  (embedding2nn): Linear(in_features=4296, out_features=4296, bias=True)
  (rnn): LSTM(4296, 256, batch_first=True, bidirectional=True)
  (linear): Linear(in_features=512, out_features=8, bias=True)
  (beta): 1.0
  (weights): None
  (weight_tensor) None
)"
2020-06-19 16:52:17,291 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:17,291 Corpus: "Corpus: 2042 train + 168 dev + 613 test sentences
Corpus: 180 train + 21 dev + 60 test sentences
Corpus: 10530 train + 1279 dev + 3380 test sentences
Corpus: 16702 train + 1833 dev + 5536 test sentences"
2020-06-19 16:52:17,291 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:17,291 Parameters:
2020-06-19 16:52:17,291  - learning_rate: "0.1"
2020-06-19 16:52:17,291  - mini_batch_size: "32"
2020-06-19 16:52:17,291  - patience: "3"
2020-06-19 16:52:17,291  - anneal_factor: "0.5"
2020-06-19 16:52:17,291  - max_epochs: "200"
2020-06-19 16:52:17,291  - shuffle: "True"
2020-06-19 16:52:17,291  - train_with_dev: "False"
2020-06-19 16:52:17,291  - batch_growth_annealing: "False"
2020-06-19 16:52:17,291 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:17,291 Model training base path: "/home/tmp/hunflair_small/cellline"
2020-06-19 16:52:17,291 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:17,291 Device: cuda:0
2020-06-19 16:52:17,291 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:17,291 Embeddings storage mode: cpu
2020-06-19 16:52:17,292 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:50,178 epoch 1 - iter 92/921 - loss 4.27994937 - samples/sec: 89.55
2020-06-19 16:53:29,718 epoch 1 - iter 184/921 - loss 2.77490780 - samples/sec: 74.51
2020-06-19 16:54:06,191 epoch 1 - iter 276/921 - loss 2.13166141 - samples/sec: 80.77
2020-06-19 16:54:41,101 epoch 1 - iter 368/921 - loss 1.79203874 - samples/sec: 84.39
2020-06-19 16:55:19,361 epoch 1 - iter 460/921 - loss 1.57664113 - samples/sec: 76.99
2020-06-19 16:55:59,210 epoch 1 - iter 552/921 - loss 1.42273998 - samples/sec: 73.93
2020-06-19 16:56:41,800 epoch 1 - iter 644/921 - loss 1.30512364 - samples/sec: 69.16
2020-06-19 16:57:21,223 epoch 1 - iter 736/921 - loss 1.21882866 - samples/sec: 74.73
2020-06-19 16:58:02,354 epoch 1 - iter 828/921 - loss 1.14660466 - samples/sec: 71.62
2020-06-19 16:58:45,897 epoch 1 - iter 920/921 - loss 1.08364702 - samples/sec: 67.65
2020-06-19 16:58:46,169 ----------------------------------------------------------------------------------------------------
2020-06-19 16:58:46,169 EPOCH 1 done: loss 1.0833 - lr 0.1000000
2020-06-19 16:59:29,486 DEV : loss 0.8940739035606384 - score 0.4399
2020-06-19 16:59:30,122 BAD EPOCHS (no improvement): 0
2020-06-19 16:59:42,400 ----------------------------------------------------------------------------------------------------
2020-06-19 17:00:04,673 epoch 2 - iter 92/921 - loss 0.48065994 - samples/sec: 132.26
2020-06-19 17:00:27,968 epoch 2 - iter 184/921 - loss 0.45346730 - samples/sec: 126.53
2020-06-19 17:00:51,819 epoch 2 - iter 276/921 - loss 0.44508574 - samples/sec: 123.59
2020-06-19 17:01:12,970 epoch 2 - iter 368/921 - loss 0.44738939 - samples/sec: 139.44
2020-06-19 17:01:32,281 epoch 2 - iter 460/921 - loss 0.45705385 - samples/sec: 152.63
2020-06-19 17:01:56,435 epoch 2 - iter 552/921 - loss 0.45313595 - samples/sec: 122.05
2020-06-19 17:02:16,767 epoch 2 - iter 644/921 - loss 0.44769793 - samples/sec: 145.01
2020-06-19 17:02:35,517 epoch 2 - iter 736/921 - loss 0.44419704 - samples/sec: 157.26
2020-06-19 17:02:59,682 epoch 2 - iter 828/921 - loss 0.43878275 - samples/sec: 121.96
2020-06-19 17:03:18,661 epoch 2 - iter 920/921 - loss 0.43051885 - samples/sec: 155.31
2020-06-19 17:03:18,875 ----------------------------------------------------------------------------------------------------
2020-06-19 17:03:18,876 EPOCH 2 done: loss 0.4303 - lr 0.1000000
2020-06-19 17:03:32,357 DEV : loss 0.30792614817619324 - score 0.6081
2020-06-19 17:03:33,058 BAD EPOCHS (no improvement): 0
2020-06-19 17:03:41,949 ----------------------------------------------------------------------------------------------------
2020-06-19 17:04:07,062 epoch 3 - iter 92/921 - loss 0.33661636 - samples/sec: 117.31
2020-06-19 17:04:26,756 epoch 3 - iter 184/921 - loss 0.37107645 - samples/sec: 149.68
2020-06-19 17:04:45,186 epoch 3 - iter 276/921 - loss 0.36495777 - samples/sec: 159.93
2020-06-19 17:05:04,106 epoch 3 - iter 368/921 - loss 0.37446375 - samples/sec: 155.78
2020-06-19 17:05:26,413 epoch 3 - iter 460/921 - loss 0.37423401 - samples/sec: 132.12
2020-06-19 17:05:48,031 epoch 3 - iter 552/921 - loss 0.36544945 - samples/sec: 136.33
2020-06-19 17:06:09,013 epoch 3 - iter 644/921 - loss 0.36199405 - samples/sec: 140.46
2020-06-19 17:06:28,436 epoch 3 - iter 736/921 - loss 0.35597658 - samples/sec: 151.77
2020-06-19 17:06:46,992 epoch 3 - iter 828/921 - loss 0.35272806 - samples/sec: 158.84
2020-06-19 17:07:05,654 epoch 3 - iter 920/921 - loss 0.35225788 - samples/sec: 157.96
2020-06-19 17:07:05,798 ----------------------------------------------------------------------------------------------------
2020-06-19 17:07:05,798 EPOCH 3 done: loss 0.3519 - lr 0.1000000
2020-06-19 17:07:18,866 DEV : loss 0.2981041371822357 - score 0.622
2020-06-19 17:07:19,567 BAD EPOCHS (no improvement): 0
2020-06-19 17:07:28,315 ----------------------------------------------------------------------------------------------------
2020-06-19 17:07:50,921 epoch 4 - iter 92/921 - loss 0.39206786 - samples/sec: 130.30
2020-06-19 17:08:12,673 epoch 4 - iter 184/921 - loss 0.37409281 - samples/sec: 135.49
2020-06-19 17:08:33,167 epoch 4 - iter 276/921 - loss 0.34762325 - samples/sec: 143.83
2020-06-19 17:08:55,154 epoch 4 - iter 368/921 - loss 0.33456802 - samples/sec: 134.04
2020-06-19 17:09:15,293 epoch 4 - iter 460/921 - loss 0.32806257 - samples/sec: 146.36
2020-06-19 17:09:33,762 epoch 4 - iter 552/921 - loss 0.32240830 - samples/sec: 159.60
2020-06-19 17:09:53,270 epoch 4 - iter 644/921 - loss 0.31828741 - samples/sec: 151.08
2020-06-19 17:10:13,000 epoch 4 - iter 736/921 - loss 0.30977635 - samples/sec: 149.41
2020-06-19 17:10:31,282 epoch 4 - iter 828/921 - loss 0.31196688 - samples/sec: 161.22
2020-06-19 17:10:51,557 epoch 4 - iter 920/921 - loss 0.31554632 - samples/sec: 145.37
2020-06-19 17:10:51,718 ----------------------------------------------------------------------------------------------------
2020-06-19 17:10:51,718 EPOCH 4 done: loss 0.3162 - lr 0.1000000
2020-06-19 17:11:07,848 DEV : loss 0.3984070420265198 - score 0.6359
2020-06-19 17:11:08,546 BAD EPOCHS (no improvement): 0
2020-06-19 17:11:19,598 ----------------------------------------------------------------------------------------------------
2020-06-19 17:11:39,669 epoch 5 - iter 92/921 - loss 0.30263488 - samples/sec: 146.77
2020-06-19 17:11:58,344 epoch 5 - iter 184/921 - loss 0.29685336 - samples/sec: 157.82
2020-06-19 17:12:17,419 epoch 5 - iter 276/921 - loss 0.28786259 - samples/sec: 154.51
2020-06-19 17:12:46,688 epoch 5 - iter 368/921 - loss 0.29320436 - samples/sec: 100.67
2020-06-19 17:13:10,512 epoch 5 - iter 460/921 - loss 0.30130276 - samples/sec: 123.73
2020-06-19 17:13:33,459 epoch 5 - iter 552/921 - loss 0.29931549 - samples/sec: 128.43
2020-06-19 17:13:55,034 epoch 5 - iter 644/921 - loss 0.30119206 - samples/sec: 136.61
2020-06-19 17:14:17,626 epoch 5 - iter 736/921 - loss 0.30980955 - samples/sec: 130.45
2020-06-19 17:14:41,523 epoch 5 - iter 828/921 - loss 0.30528711 - samples/sec: 123.32
2020-06-19 17:15:04,034 epoch 5 - iter 920/921 - loss 0.30396210 - samples/sec: 130.93
2020-06-19 17:15:04,167 ----------------------------------------------------------------------------------------------------
2020-06-19 17:15:04,168 EPOCH 5 done: loss 0.3037 - lr 0.1000000
2020-06-19 17:15:16,914 DEV : loss 0.25101232528686523 - score 0.6727
2020-06-19 17:15:17,666 BAD EPOCHS (no improvement): 0
2020-06-19 17:15:26,386 ----------------------------------------------------------------------------------------------------
2020-06-19 17:15:45,373 epoch 6 - iter 92/921 - loss 0.33389341 - samples/sec: 155.15
2020-06-19 17:16:03,509 epoch 6 - iter 184/921 - loss 0.35331747 - samples/sec: 162.52
2020-06-19 17:16:22,342 epoch 6 - iter 276/921 - loss 0.32972765 - samples/sec: 156.51
2020-06-19 17:16:41,420 epoch 6 - iter 368/921 - loss 0.31593994 - samples/sec: 154.49
2020-06-19 17:17:03,740 epoch 6 - iter 460/921 - loss 0.30593690 - samples/sec: 132.04
2020-06-19 17:17:27,243 epoch 6 - iter 552/921 - loss 0.29930323 - samples/sec: 125.40
2020-06-19 17:17:49,191 epoch 6 - iter 644/921 - loss 0.29766254 - samples/sec: 134.29
2020-06-19 17:18:12,864 epoch 6 - iter 736/921 - loss 0.29462434 - samples/sec: 124.49
2020-06-19 17:18:34,626 epoch 6 - iter 828/921 - loss 0.29125407 - samples/sec: 135.45
2020-06-19 17:18:54,455 epoch 6 - iter 920/921 - loss 0.28703488 - samples/sec: 149.15
2020-06-19 17:18:54,611 ----------------------------------------------------------------------------------------------------
2020-06-19 17:18:54,612 EPOCH 6 done: loss 0.2877 - lr 0.1000000
2020-06-19 17:19:08,119 DEV : loss 0.3116731345653534 - score 0.6181
2020-06-19 17:19:08,811 BAD EPOCHS (no improvement): 1
2020-06-19 17:19:08,812 ----------------------------------------------------------------------------------------------------
2020-06-19 17:19:27,557 epoch 7 - iter 92/921 - loss 0.29102604 - samples/sec: 157.15
2020-06-19 17:19:45,914 epoch 7 - iter 184/921 - loss 0.28576206 - samples/sec: 160.56
2020-06-19 17:20:04,354 epoch 7 - iter 276/921 - loss 0.27955530 - samples/sec: 159.84
2020-06-19 17:20:26,062 epoch 7 - iter 368/921 - loss 0.27297481 - samples/sec: 135.77
2020-06-19 17:20:47,335 epoch 7 - iter 460/921 - loss 0.26990485 - samples/sec: 138.54
2020-06-19 17:21:07,758 epoch 7 - iter 552/921 - loss 0.27229252 - samples/sec: 144.32
2020-06-19 17:21:26,506 epoch 7 - iter 644/921 - loss 0.26816807 - samples/sec: 157.21
2020-06-19 17:21:44,825 epoch 7 - iter 736/921 - loss 0.26949940 - samples/sec: 160.90
2020-06-19 17:22:03,276 epoch 7 - iter 828/921 - loss 0.26857356 - samples/sec: 159.75
2020-06-19 17:22:22,279 epoch 7 - iter 920/921 - loss 0.27212829 - samples/sec: 155.10
2020-06-19 17:22:22,420 ----------------------------------------------------------------------------------------------------
2020-06-19 17:22:22,420 EPOCH 7 done: loss 0.2725 - lr 0.1000000
2020-06-19 17:22:34,601 DEV : loss 0.3192862868309021 - score 0.6039
2020-06-19 17:22:35,103 BAD EPOCHS (no improvement): 2
2020-06-19 17:22:35,103 ----------------------------------------------------------------------------------------------------
2020-06-19 17:22:54,026 epoch 8 - iter 92/921 - loss 0.23823419 - samples/sec: 155.68
2020-06-19 17:23:18,434 epoch 8 - iter 184/921 - loss 0.23228316 - samples/sec: 120.76
2020-06-19 17:23:39,692 epoch 8 - iter 276/921 - loss 0.24634789 - samples/sec: 138.65
2020-06-19 17:23:59,376 epoch 8 - iter 368/921 - loss 0.25973922 - samples/sec: 149.73
2020-06-19 17:24:17,724 epoch 8 - iter 460/921 - loss 0.25843283 - samples/sec: 160.64
2020-06-19 17:24:36,720 epoch 8 - iter 552/921 - loss 0.25351692 - samples/sec: 155.17
2020-06-19 17:24:55,661 epoch 8 - iter 644/921 - loss 0.25136380 - samples/sec: 155.61
2020-06-19 17:25:19,824 epoch 8 - iter 736/921 - loss 0.25396674 - samples/sec: 121.98
2020-06-19 17:25:42,011 epoch 8 - iter 828/921 - loss 0.25368869 - samples/sec: 132.85
2020-06-19 17:26:03,302 epoch 8 - iter 920/921 - loss 0.25471561 - samples/sec: 138.43
2020-06-19 17:26:03,440 ----------------------------------------------------------------------------------------------------
2020-06-19 17:26:03,440 EPOCH 8 done: loss 0.2545 - lr 0.1000000
2020-06-19 17:26:18,963 DEV : loss 0.22590447962284088 - score 0.721
2020-06-19 17:26:19,469 BAD EPOCHS (no improvement): 0
2020-06-19 17:26:29,226 ----------------------------------------------------------------------------------------------------
2020-06-19 17:26:52,827 epoch 9 - iter 92/921 - loss 0.28522874 - samples/sec: 124.82
2020-06-19 17:27:14,322 epoch 9 - iter 184/921 - loss 0.25911514 - samples/sec: 137.13
2020-06-19 17:27:35,017 epoch 9 - iter 276/921 - loss 0.25364392 - samples/sec: 142.42
2020-06-19 17:27:54,087 epoch 9 - iter 368/921 - loss 0.25206535 - samples/sec: 154.57
2020-06-19 17:28:12,663 epoch 9 - iter 460/921 - loss 0.24114241 - samples/sec: 158.67
2020-06-19 17:28:31,191 epoch 9 - iter 552/921 - loss 0.24658069 - samples/sec: 159.08
2020-06-19 17:28:49,632 epoch 9 - iter 644/921 - loss 0.24638190 - samples/sec: 159.83
2020-06-19 17:29:09,244 epoch 9 - iter 736/921 - loss 0.24835582 - samples/sec: 150.36
2020-06-19 17:29:28,421 epoch 9 - iter 828/921 - loss 0.24862049 - samples/sec: 153.69
2020-06-19 17:29:49,098 epoch 9 - iter 920/921 - loss 0.25143278 - samples/sec: 142.54
2020-06-19 17:29:49,259 ----------------------------------------------------------------------------------------------------
2020-06-19 17:29:49,259 EPOCH 9 done: loss 0.2512 - lr 0.1000000
2020-06-19 17:30:04,155 DEV : loss 0.22558684647083282 - score 0.7191
2020-06-19 17:30:04,852 BAD EPOCHS (no improvement): 1
2020-06-19 17:30:04,853 ----------------------------------------------------------------------------------------------------
2020-06-19 17:30:23,629 epoch 10 - iter 92/921 - loss 0.26668928 - samples/sec: 156.89
2020-06-19 17:30:41,331 epoch 10 - iter 184/921 - loss 0.23754088 - samples/sec: 166.51
2020-06-19 17:31:02,354 epoch 10 - iter 276/921 - loss 0.24093258 - samples/sec: 140.18
2020-06-19 17:31:23,300 epoch 10 - iter 368/921 - loss 0.24191135 - samples/sec: 140.72
2020-06-19 17:31:41,601 epoch 10 - iter 460/921 - loss 0.24483190 - samples/sec: 161.09
2020-06-19 17:31:59,166 epoch 10 - iter 552/921 - loss 0.24596133 - samples/sec: 167.81
2020-06-19 17:32:22,587 epoch 10 - iter 644/921 - loss 0.24291742 - samples/sec: 125.81
2020-06-19 17:32:40,037 epoch 10 - iter 736/921 - loss 0.24626613 - samples/sec: 168.92
2020-06-19 17:32:58,369 epoch 10 - iter 828/921 - loss 0.24359946 - samples/sec: 160.78
2020-06-19 17:33:15,796 epoch 10 - iter 920/921 - loss 0.24328474 - samples/sec: 169.14
2020-06-19 17:33:15,896 ----------------------------------------------------------------------------------------------------
2020-06-19 17:33:15,896 EPOCH 10 done: loss 0.2431 - lr 0.1000000
2020-06-19 17:33:27,590 DEV : loss 0.24585679173469543 - score 0.7069
2020-06-19 17:33:28,094 BAD EPOCHS (no improvement): 2
2020-06-19 17:33:28,095 ----------------------------------------------------------------------------------------------------
2020-06-19 17:33:46,427 epoch 11 - iter 92/921 - loss 0.20893463 - samples/sec: 160.69
2020-06-19 17:34:05,972 epoch 11 - iter 184/921 - loss 0.21911070 - samples/sec: 150.80
2020-06-19 17:34:25,214 epoch 11 - iter 276/921 - loss 0.21008885 - samples/sec: 153.19
2020-06-19 17:34:42,675 epoch 11 - iter 368/921 - loss 0.22920707 - samples/sec: 168.82
2020-06-19 17:35:00,149 epoch 11 - iter 460/921 - loss 0.22948446 - samples/sec: 168.68
2020-06-19 17:35:18,364 epoch 11 - iter 552/921 - loss 0.23140877 - samples/sec: 161.83
2020-06-19 17:35:37,742 epoch 11 - iter 644/921 - loss 0.23408316 - samples/sec: 152.11
2020-06-19 17:35:56,679 epoch 11 - iter 736/921 - loss 0.23582875 - samples/sec: 155.64
2020-06-19 17:36:14,512 epoch 11 - iter 828/921 - loss 0.23491137 - samples/sec: 165.29
2020-06-19 17:36:32,936 epoch 11 - iter 920/921 - loss 0.23649837 - samples/sec: 159.98
2020-06-19 17:36:33,074 ----------------------------------------------------------------------------------------------------
2020-06-19 17:36:33,074 EPOCH 11 done: loss 0.2363 - lr 0.1000000
2020-06-19 17:36:45,002 DEV : loss 0.22123628854751587 - score 0.7291
2020-06-19 17:36:45,505 BAD EPOCHS (no improvement): 0
2020-06-19 17:36:54,890 ----------------------------------------------------------------------------------------------------
2020-06-19 17:37:14,492 epoch 12 - iter 92/921 - loss 0.24723026 - samples/sec: 150.29
2020-06-19 17:37:33,304 epoch 12 - iter 184/921 - loss 0.21636667 - samples/sec: 156.68
2020-06-19 17:37:52,886 epoch 12 - iter 276/921 - loss 0.21198274 - samples/sec: 150.51
2020-06-19 17:38:11,211 epoch 12 - iter 368/921 - loss 0.22040447 - samples/sec: 160.85
2020-06-19 17:38:29,756 epoch 12 - iter 460/921 - loss 0.22425065 - samples/sec: 158.94
2020-06-19 17:38:51,969 epoch 12 - iter 552/921 - loss 0.22491206 - samples/sec: 132.69
2020-06-19 17:39:11,744 epoch 12 - iter 644/921 - loss 0.22891343 - samples/sec: 149.04
2020-06-19 17:39:35,121 epoch 12 - iter 736/921 - loss 0.22901301 - samples/sec: 126.08
2020-06-19 17:39:56,976 epoch 12 - iter 828/921 - loss 0.22661390 - samples/sec: 134.86
2020-06-19 17:40:15,428 epoch 12 - iter 920/921 - loss 0.22443833 - samples/sec: 159.76
2020-06-19 17:40:15,562 ----------------------------------------------------------------------------------------------------
2020-06-19 17:40:15,562 EPOCH 12 done: loss 0.2242 - lr 0.1000000
2020-06-19 17:40:33,668 DEV : loss 0.2885938584804535 - score 0.6729
2020-06-19 17:40:34,211 BAD EPOCHS (no improvement): 1
2020-06-19 17:40:34,212 ----------------------------------------------------------------------------------------------------
2020-06-19 17:40:54,591 epoch 13 - iter 92/921 - loss 0.23140071 - samples/sec: 144.55
2020-06-19 17:41:13,558 epoch 13 - iter 184/921 - loss 0.22928417 - samples/sec: 155.40
2020-06-19 17:41:31,447 epoch 13 - iter 276/921 - loss 0.22410729 - samples/sec: 164.77
2020-06-19 17:41:49,532 epoch 13 - iter 368/921 - loss 0.22320251 - samples/sec: 162.99
2020-06-19 17:42:07,650 epoch 13 - iter 460/921 - loss 0.22255928 - samples/sec: 162.69
2020-06-19 17:42:26,467 epoch 13 - iter 552/921 - loss 0.22191539 - samples/sec: 156.66
2020-06-19 17:42:44,582 epoch 13 - iter 644/921 - loss 0.22305524 - samples/sec: 162.71
2020-06-19 17:43:02,640 epoch 13 - iter 736/921 - loss 0.22126812 - samples/sec: 163.22
2020-06-19 17:43:21,209 epoch 13 - iter 828/921 - loss 0.21766263 - samples/sec: 158.74
2020-06-19 17:43:40,842 epoch 13 - iter 920/921 - loss 0.22095148 - samples/sec: 150.12
2020-06-19 17:43:41,004 ----------------------------------------------------------------------------------------------------
2020-06-19 17:43:41,004 EPOCH 13 done: loss 0.2212 - lr 0.1000000
2020-06-19 17:43:53,642 DEV : loss 0.21988293528556824 - score 0.7329
2020-06-19 17:43:54,149 BAD EPOCHS (no improvement): 0
2020-06-19 17:44:04,026 ----------------------------------------------------------------------------------------------------
2020-06-19 17:44:22,684 epoch 14 - iter 92/921 - loss 0.22025353 - samples/sec: 157.89
2020-06-19 17:44:43,982 epoch 14 - iter 184/921 - loss 0.21131893 - samples/sec: 138.39
2020-06-19 17:45:06,390 epoch 14 - iter 276/921 - loss 0.20129300 - samples/sec: 131.53
2020-06-19 17:45:27,186 epoch 14 - iter 368/921 - loss 0.20639743 - samples/sec: 141.73
2020-06-19 17:45:46,599 epoch 14 - iter 460/921 - loss 0.20943064 - samples/sec: 151.82
2020-06-19 17:46:04,077 epoch 14 - iter 552/921 - loss 0.21330626 - samples/sec: 168.65
2020-06-19 17:46:24,089 epoch 14 - iter 644/921 - loss 0.21337722 - samples/sec: 147.28
2020-06-19 17:46:43,118 epoch 14 - iter 736/921 - loss 0.21243055 - samples/sec: 154.89
2020-06-19 17:47:02,372 epoch 14 - iter 828/921 - loss 0.21503905 - samples/sec: 153.08
2020-06-19 17:47:20,904 epoch 14 - iter 920/921 - loss 0.21395922 - samples/sec: 159.05
2020-06-19 17:47:21,031 ----------------------------------------------------------------------------------------------------
2020-06-19 17:47:21,032 EPOCH 14 done: loss 0.2137 - lr 0.1000000
2020-06-19 17:47:33,240 DEV : loss 0.21231965720653534 - score 0.7317
2020-06-19 17:47:33,743 BAD EPOCHS (no improvement): 1
2020-06-19 17:47:33,743 ----------------------------------------------------------------------------------------------------
2020-06-19 17:47:52,629 epoch 15 - iter 92/921 - loss 0.20665731 - samples/sec: 155.98
2020-06-19 17:48:11,380 epoch 15 - iter 184/921 - loss 0.20331534 - samples/sec: 157.19
2020-06-19 17:48:29,991 epoch 15 - iter 276/921 - loss 0.20437048 - samples/sec: 158.37
2020-06-19 17:48:49,166 epoch 15 - iter 368/921 - loss 0.21579667 - samples/sec: 153.71
2020-06-19 17:49:07,959 epoch 15 - iter 460/921 - loss 0.21456718 - samples/sec: 156.86
2020-06-19 17:49:26,620 epoch 15 - iter 552/921 - loss 0.21667570 - samples/sec: 157.95
2020-06-19 17:49:44,645 epoch 15 - iter 644/921 - loss 0.21585577 - samples/sec: 163.52
2020-06-19 17:50:03,061 epoch 15 - iter 736/921 - loss 0.21296482 - samples/sec: 160.05
2020-06-19 17:50:23,712 epoch 15 - iter 828/921 - loss 0.21244390 - samples/sec: 142.71
2020-06-19 17:50:42,291 epoch 15 - iter 920/921 - loss 0.21339291 - samples/sec: 158.65
2020-06-19 17:50:42,407 ----------------------------------------------------------------------------------------------------
2020-06-19 17:50:42,408 EPOCH 15 done: loss 0.2132 - lr 0.1000000
2020-06-19 17:50:54,617 DEV : loss 0.22340448200702667 - score 0.7409
2020-06-19 17:50:55,122 BAD EPOCHS (no improvement): 0
2020-06-19 17:51:04,627 ----------------------------------------------------------------------------------------------------
2020-06-19 17:51:22,496 epoch 16 - iter 92/921 - loss 0.18361077 - samples/sec: 164.86
2020-06-19 17:51:40,761 epoch 16 - iter 184/921 - loss 0.19748736 - samples/sec: 161.38
2020-06-19 17:52:00,789 epoch 16 - iter 276/921 - loss 0.20734413 - samples/sec: 147.16
2020-06-19 17:52:21,042 epoch 16 - iter 368/921 - loss 0.21065758 - samples/sec: 145.53
2020-06-19 17:52:40,001 epoch 16 - iter 460/921 - loss 0.21029066 - samples/sec: 155.46
2020-06-19 17:53:02,737 epoch 16 - iter 552/921 - loss 0.21184525 - samples/sec: 129.61
2020-06-19 17:53:21,331 epoch 16 - iter 644/921 - loss 0.21443763 - samples/sec: 158.51
2020-06-19 17:53:39,968 epoch 16 - iter 736/921 - loss 0.21152162 - samples/sec: 158.16
2020-06-19 17:53:58,204 epoch 16 - iter 828/921 - loss 0.21479127 - samples/sec: 161.63
2020-06-19 17:54:15,874 epoch 16 - iter 920/921 - loss 0.21272895 - samples/sec: 166.84
2020-06-19 17:54:16,023 ----------------------------------------------------------------------------------------------------
2020-06-19 17:54:16,023 EPOCH 16 done: loss 0.2126 - lr 0.1000000
2020-06-19 17:54:27,974 DEV : loss 0.21699459850788116 - score 0.7428
2020-06-19 17:54:28,472 BAD EPOCHS (no improvement): 0
2020-06-19 17:54:36,901 ----------------------------------------------------------------------------------------------------
2020-06-19 17:54:55,943 epoch 17 - iter 92/921 - loss 0.20915127 - samples/sec: 154.71
2020-06-19 17:55:14,029 epoch 17 - iter 184/921 - loss 0.21151849 - samples/sec: 162.97
2020-06-19 17:55:35,886 epoch 17 - iter 276/921 - loss 0.20765254 - samples/sec: 134.84
2020-06-19 17:55:58,217 epoch 17 - iter 368/921 - loss 0.20833652 - samples/sec: 131.98
2020-06-19 17:56:18,715 epoch 17 - iter 460/921 - loss 0.20656738 - samples/sec: 143.79
2020-06-19 17:56:36,974 epoch 17 - iter 552/921 - loss 0.20601395 - samples/sec: 161.44
2020-06-19 17:56:54,674 epoch 17 - iter 644/921 - loss 0.20870587 - samples/sec: 166.53
2020-06-19 17:57:12,492 epoch 17 - iter 736/921 - loss 0.20758544 - samples/sec: 165.43
2020-06-19 17:57:34,559 epoch 17 - iter 828/921 - loss 0.20537399 - samples/sec: 133.54
2020-06-19 17:57:56,631 epoch 17 - iter 920/921 - loss 0.20469144 - samples/sec: 133.52
2020-06-19 17:57:56,791 ----------------------------------------------------------------------------------------------------
2020-06-19 17:57:56,792 EPOCH 17 done: loss 0.2046 - lr 0.1000000
2020-06-19 17:58:11,613 DEV : loss 0.21993818879127502 - score 0.7296
2020-06-19 17:58:12,301 BAD EPOCHS (no improvement): 1
2020-06-19 17:58:12,301 ----------------------------------------------------------------------------------------------------
2020-06-19 17:58:33,814 epoch 18 - iter 92/921 - loss 0.18763549 - samples/sec: 136.93
2020-06-19 17:58:52,563 epoch 18 - iter 184/921 - loss 0.19917223 - samples/sec: 157.20
2020-06-19 17:59:10,142 epoch 18 - iter 276/921 - loss 0.19085255 - samples/sec: 167.67
2020-06-19 17:59:28,545 epoch 18 - iter 368/921 - loss 0.19846051 - samples/sec: 160.17
2020-06-19 17:59:47,406 epoch 18 - iter 460/921 - loss 0.19505428 - samples/sec: 156.27
2020-06-19 18:00:06,355 epoch 18 - iter 552/921 - loss 0.19772975 - samples/sec: 155.55
2020-06-19 18:00:24,928 epoch 18 - iter 644/921 - loss 0.19581126 - samples/sec: 158.69
2020-06-19 18:00:43,769 epoch 18 - iter 736/921 - loss 0.20055548 - samples/sec: 156.44
2020-06-19 18:01:02,244 epoch 18 - iter 828/921 - loss 0.19784841 - samples/sec: 159.54
2020-06-19 18:01:20,829 epoch 18 - iter 920/921 - loss 0.19618449 - samples/sec: 158.60
2020-06-19 18:01:20,946 ----------------------------------------------------------------------------------------------------
2020-06-19 18:01:20,947 EPOCH 18 done: loss 0.1961 - lr 0.1000000
2020-06-19 18:01:33,252 DEV : loss 0.213890939950943 - score 0.7471
2020-06-19 18:01:33,759 BAD EPOCHS (no improvement): 0
2020-06-19 18:01:42,655 ----------------------------------------------------------------------------------------------------
2020-06-19 18:02:01,682 epoch 19 - iter 92/921 - loss 0.16683840 - samples/sec: 154.82
2020-06-19 18:02:21,212 epoch 19 - iter 184/921 - loss 0.18627848 - samples/sec: 150.91
2020-06-19 18:02:39,792 epoch 19 - iter 276/921 - loss 0.18625702 - samples/sec: 158.64
2020-06-19 18:02:58,470 epoch 19 - iter 368/921 - loss 0.18986216 - samples/sec: 157.80
2020-06-19 18:03:17,429 epoch 19 - iter 460/921 - loss 0.18764231 - samples/sec: 155.46
2020-06-19 18:03:36,302 epoch 19 - iter 552/921 - loss 0.19022618 - samples/sec: 156.17
2020-06-19 18:03:55,449 epoch 19 - iter 644/921 - loss 0.18444839 - samples/sec: 153.94
2020-06-19 18:04:14,337 epoch 19 - iter 736/921 - loss 0.18591654 - samples/sec: 156.05
2020-06-19 18:04:33,291 epoch 19 - iter 828/921 - loss 0.18789167 - samples/sec: 155.50
2020-06-19 18:04:51,734 epoch 19 - iter 920/921 - loss 0.18641941 - samples/sec: 159.82
2020-06-19 18:04:51,875 ----------------------------------------------------------------------------------------------------
2020-06-19 18:04:51,876 EPOCH 19 done: loss 0.1864 - lr 0.1000000
2020-06-19 18:05:09,574 DEV : loss 0.21273623406887054 - score 0.7389
2020-06-19 18:05:10,098 BAD EPOCHS (no improvement): 1
2020-06-19 18:05:10,099 ----------------------------------------------------------------------------------------------------
2020-06-19 18:05:28,451 epoch 20 - iter 92/921 - loss 0.18587405 - samples/sec: 160.52
2020-06-19 18:05:46,580 epoch 20 - iter 184/921 - loss 0.19369363 - samples/sec: 162.59
2020-06-19 18:06:04,915 epoch 20 - iter 276/921 - loss 0.18096117 - samples/sec: 160.76
2020-06-19 18:06:28,329 epoch 20 - iter 368/921 - loss 0.18273366 - samples/sec: 125.86
2020-06-19 18:06:50,365 epoch 20 - iter 460/921 - loss 0.18487409 - samples/sec: 133.75
2020-06-19 18:07:12,013 epoch 20 - iter 552/921 - loss 0.18646135 - samples/sec: 136.15
2020-06-19 18:07:30,836 epoch 20 - iter 644/921 - loss 0.18862123 - samples/sec: 156.58
2020-06-19 18:07:48,486 epoch 20 - iter 736/921 - loss 0.18993866 - samples/sec: 167.00
2020-06-19 18:08:06,568 epoch 20 - iter 828/921 - loss 0.18925010 - samples/sec: 163.01
2020-06-19 18:08:24,405 epoch 20 - iter 920/921 - loss 0.18914026 - samples/sec: 165.25
2020-06-19 18:08:24,559 ----------------------------------------------------------------------------------------------------
2020-06-19 18:08:24,560 EPOCH 20 done: loss 0.1889 - lr 0.1000000
2020-06-19 18:08:36,330 DEV : loss 0.2425525039434433 - score 0.7164
2020-06-19 18:08:36,831 BAD EPOCHS (no improvement): 2
2020-06-19 18:08:36,832 ----------------------------------------------------------------------------------------------------
2020-06-19 18:08:55,131 epoch 21 - iter 92/921 - loss 0.14820682 - samples/sec: 160.98
2020-06-19 18:09:12,999 epoch 21 - iter 184/921 - loss 0.17247493 - samples/sec: 164.97
2020-06-19 18:09:33,680 epoch 21 - iter 276/921 - loss 0.17262939 - samples/sec: 142.50
2020-06-19 18:09:54,504 epoch 21 - iter 368/921 - loss 0.18089944 - samples/sec: 141.54
2020-06-19 18:10:12,207 epoch 21 - iter 460/921 - loss 0.17831552 - samples/sec: 166.50
2020-06-19 18:10:30,413 epoch 21 - iter 552/921 - loss 0.18217008 - samples/sec: 161.90
2020-06-19 18:10:49,443 epoch 21 - iter 644/921 - loss 0.18159613 - samples/sec: 154.88
2020-06-19 18:11:11,347 epoch 21 - iter 736/921 - loss 0.18196465 - samples/sec: 134.55
2020-06-19 18:11:34,801 epoch 21 - iter 828/921 - loss 0.18238846 - samples/sec: 125.66
2020-06-19 18:11:55,923 epoch 21 - iter 920/921 - loss 0.18287588 - samples/sec: 139.54
2020-06-19 18:11:56,053 ----------------------------------------------------------------------------------------------------
2020-06-19 18:11:56,053 EPOCH 21 done: loss 0.1827 - lr 0.1000000
2020-06-19 18:12:10,734 DEV : loss 0.23425965011119843 - score 0.7035
2020-06-19 18:12:11,422 BAD EPOCHS (no improvement): 3
2020-06-19 18:12:11,422 ----------------------------------------------------------------------------------------------------
2020-06-19 18:12:31,906 epoch 22 - iter 92/921 - loss 0.14498236 - samples/sec: 143.80
2020-06-19 18:12:51,536 epoch 22 - iter 184/921 - loss 0.17190375 - samples/sec: 150.17
2020-06-19 18:13:10,093 epoch 22 - iter 276/921 - loss 0.17197151 - samples/sec: 158.84
2020-06-19 18:13:29,122 epoch 22 - iter 368/921 - loss 0.17183398 - samples/sec: 154.89
2020-06-19 18:13:48,097 epoch 22 - iter 460/921 - loss 0.16922419 - samples/sec: 155.35
2020-06-19 18:14:06,551 epoch 22 - iter 552/921 - loss 0.16822547 - samples/sec: 159.72
2020-06-19 18:14:25,013 epoch 22 - iter 644/921 - loss 0.17406878 - samples/sec: 159.65
2020-06-19 18:14:44,333 epoch 22 - iter 736/921 - loss 0.18029367 - samples/sec: 152.56
2020-06-19 18:15:02,824 epoch 22 - iter 828/921 - loss 0.18173905 - samples/sec: 159.40
2020-06-19 18:15:21,855 epoch 22 - iter 920/921 - loss 0.18220223 - samples/sec: 154.88
2020-06-19 18:15:21,972 ----------------------------------------------------------------------------------------------------
2020-06-19 18:15:21,973 EPOCH 22 done: loss 0.1823 - lr 0.1000000
2020-06-19 18:15:33,840 DEV : loss 0.2255493402481079 - score 0.7368
2020-06-19 18:15:34,350 BAD EPOCHS (no improvement): 4
2020-06-19 18:15:34,350 ----------------------------------------------------------------------------------------------------
2020-06-19 18:15:54,677 epoch 23 - iter 92/921 - loss 0.19329060 - samples/sec: 144.91
2020-06-19 18:16:13,460 epoch 23 - iter 184/921 - loss 0.16581714 - samples/sec: 156.92
2020-06-19 18:16:31,847 epoch 23 - iter 276/921 - loss 0.16376447 - samples/sec: 160.31
2020-06-19 18:16:50,313 epoch 23 - iter 368/921 - loss 0.16261122 - samples/sec: 159.61
2020-06-19 18:17:09,791 epoch 23 - iter 460/921 - loss 0.15832020 - samples/sec: 151.31
2020-06-19 18:17:29,994 epoch 23 - iter 552/921 - loss 0.15780678 - samples/sec: 145.90
2020-06-19 18:17:49,977 epoch 23 - iter 644/921 - loss 0.16403641 - samples/sec: 147.49
2020-06-19 18:18:07,573 epoch 23 - iter 736/921 - loss 0.16356372 - samples/sec: 167.52
2020-06-19 18:18:25,039 epoch 23 - iter 828/921 - loss 0.16293838 - samples/sec: 168.76
2020-06-19 18:18:43,364 epoch 23 - iter 920/921 - loss 0.16221983 - samples/sec: 160.84
2020-06-19 18:18:43,506 ----------------------------------------------------------------------------------------------------
2020-06-19 18:18:43,506 EPOCH 23 done: loss 0.1623 - lr 0.0500000
2020-06-19 18:19:00,676 DEV : loss 0.21829476952552795 - score 0.7458
2020-06-19 18:19:01,190 BAD EPOCHS (no improvement): 1
2020-06-19 18:19:01,191 ----------------------------------------------------------------------------------------------------
2020-06-19 18:19:19,243 epoch 24 - iter 92/921 - loss 0.16761468 - samples/sec: 163.19
2020-06-19 18:19:37,372 epoch 24 - iter 184/921 - loss 0.16253691 - samples/sec: 162.59
2020-06-19 18:19:55,636 epoch 24 - iter 276/921 - loss 0.15234806 - samples/sec: 161.38
2020-06-19 18:20:14,353 epoch 24 - iter 368/921 - loss 0.15601093 - samples/sec: 157.48
2020-06-19 18:20:33,112 epoch 24 - iter 460/921 - loss 0.16059026 - samples/sec: 157.12
2020-06-19 18:20:52,392 epoch 24 - iter 552/921 - loss 0.16078179 - samples/sec: 152.87
2020-06-19 18:21:10,365 epoch 24 - iter 644/921 - loss 0.15972027 - samples/sec: 164.00
2020-06-19 18:21:28,717 epoch 24 - iter 736/921 - loss 0.15938454 - samples/sec: 160.60
2020-06-19 18:21:47,640 epoch 24 - iter 828/921 - loss 0.15944191 - samples/sec: 155.77
2020-06-19 18:22:05,831 epoch 24 - iter 920/921 - loss 0.15826971 - samples/sec: 162.03
2020-06-19 18:22:05,971 ----------------------------------------------------------------------------------------------------
2020-06-19 18:22:05,971 EPOCH 24 done: loss 0.1584 - lr 0.0500000
2020-06-19 18:22:17,896 DEV : loss 0.24249009788036346 - score 0.7182
2020-06-19 18:22:18,398 BAD EPOCHS (no improvement): 2
2020-06-19 18:22:18,399 ----------------------------------------------------------------------------------------------------
2020-06-19 18:22:37,066 epoch 25 - iter 92/921 - loss 0.15341956 - samples/sec: 157.81
2020-06-19 18:22:55,795 epoch 25 - iter 184/921 - loss 0.14968445 - samples/sec: 157.37
2020-06-19 18:23:14,670 epoch 25 - iter 276/921 - loss 0.15391028 - samples/sec: 156.16
2020-06-19 18:23:33,307 epoch 25 - iter 368/921 - loss 0.15783792 - samples/sec: 158.15
2020-06-19 18:23:51,909 epoch 25 - iter 460/921 - loss 0.16252059 - samples/sec: 158.45
2020-06-19 18:24:10,160 epoch 25 - iter 552/921 - loss 0.16018056 - samples/sec: 161.50
2020-06-19 18:24:28,558 epoch 25 - iter 644/921 - loss 0.16225843 - samples/sec: 160.20
2020-06-19 18:24:47,337 epoch 25 - iter 736/921 - loss 0.15863405 - samples/sec: 156.97
2020-06-19 18:25:05,815 epoch 25 - iter 828/921 - loss 0.15555858 - samples/sec: 159.51
2020-06-19 18:25:25,171 epoch 25 - iter 920/921 - loss 0.15559188 - samples/sec: 152.28
2020-06-19 18:25:25,307 ----------------------------------------------------------------------------------------------------
2020-06-19 18:25:25,307 EPOCH 25 done: loss 0.1557 - lr 0.0500000
2020-06-19 18:25:37,325 DEV : loss 0.2215476781129837 - score 0.7331
2020-06-19 18:25:37,838 BAD EPOCHS (no improvement): 3
2020-06-19 18:25:37,839 ----------------------------------------------------------------------------------------------------
2020-06-19 18:25:57,186 epoch 26 - iter 92/921 - loss 0.15825035 - samples/sec: 152.26
2020-06-19 18:26:16,405 epoch 26 - iter 184/921 - loss 0.15551381 - samples/sec: 153.35
2020-06-19 18:26:35,533 epoch 26 - iter 276/921 - loss 0.16056665 - samples/sec: 154.09
2020-06-19 18:26:53,647 epoch 26 - iter 368/921 - loss 0.15066176 - samples/sec: 162.72
2020-06-19 18:27:12,211 epoch 26 - iter 460/921 - loss 0.15122209 - samples/sec: 158.78
2020-06-19 18:27:30,757 epoch 26 - iter 552/921 - loss 0.15184745 - samples/sec: 158.92
2020-06-19 18:27:49,482 epoch 26 - iter 644/921 - loss 0.15208340 - samples/sec: 157.40
2020-06-19 18:28:07,527 epoch 26 - iter 736/921 - loss 0.15156127 - samples/sec: 163.34
2020-06-19 18:28:26,202 epoch 26 - iter 828/921 - loss 0.15401953 - samples/sec: 157.83
2020-06-19 18:28:45,230 epoch 26 - iter 920/921 - loss 0.15098811 - samples/sec: 154.92
2020-06-19 18:28:45,344 ----------------------------------------------------------------------------------------------------
2020-06-19 18:28:45,344 EPOCH 26 done: loss 0.1510 - lr 0.0500000
2020-06-19 18:28:57,110 DEV : loss 0.226248636841774 - score 0.7403
2020-06-19 18:28:57,614 BAD EPOCHS (no improvement): 4
2020-06-19 18:28:57,615 ----------------------------------------------------------------------------------------------------
2020-06-19 18:29:15,597 epoch 27 - iter 92/921 - loss 0.13102427 - samples/sec: 163.82
2020-06-19 18:29:34,324 epoch 27 - iter 184/921 - loss 0.13699509 - samples/sec: 157.39
2020-06-19 18:29:52,937 epoch 27 - iter 276/921 - loss 0.13883146 - samples/sec: 158.35
2020-06-19 18:30:11,942 epoch 27 - iter 368/921 - loss 0.13917761 - samples/sec: 155.08
2020-06-19 18:30:30,965 epoch 27 - iter 460/921 - loss 0.13947612 - samples/sec: 154.93
2020-06-19 18:30:49,571 epoch 27 - iter 552/921 - loss 0.13894434 - samples/sec: 158.42
2020-06-19 18:31:11,308 epoch 27 - iter 644/921 - loss 0.13999088 - samples/sec: 135.57
2020-06-19 18:31:30,095 epoch 27 - iter 736/921 - loss 0.14554686 - samples/sec: 156.89
2020-06-19 18:31:48,465 epoch 27 - iter 828/921 - loss 0.14538470 - samples/sec: 160.45
2020-06-19 18:32:07,075 epoch 27 - iter 920/921 - loss 0.14581254 - samples/sec: 158.38
2020-06-19 18:32:07,206 ----------------------------------------------------------------------------------------------------
2020-06-19 18:32:07,206 EPOCH 27 done: loss 0.1459 - lr 0.0250000
2020-06-19 18:32:19,338 DEV : loss 0.21907785534858704 - score 0.7626
2020-06-19 18:32:19,841 BAD EPOCHS (no improvement): 0
2020-06-19 18:32:28,661 ----------------------------------------------------------------------------------------------------
2020-06-19 18:32:47,331 epoch 28 - iter 92/921 - loss 0.14068327 - samples/sec: 157.78
2020-06-19 18:33:06,202 epoch 28 - iter 184/921 - loss 0.14716018 - samples/sec: 156.18
2020-06-19 18:33:25,906 epoch 28 - iter 276/921 - loss 0.15164821 - samples/sec: 149.57
2020-06-19 18:33:44,066 epoch 28 - iter 368/921 - loss 0.15196385 - samples/sec: 162.30
2020-06-19 18:34:02,942 epoch 28 - iter 460/921 - loss 0.14531739 - samples/sec: 156.16
2020-06-19 18:34:22,143 epoch 28 - iter 552/921 - loss 0.14611380 - samples/sec: 153.50
2020-06-19 18:34:41,335 epoch 28 - iter 644/921 - loss 0.14375833 - samples/sec: 153.57
2020-06-19 18:34:59,700 epoch 28 - iter 736/921 - loss 0.14379235 - samples/sec: 160.50
2020-06-19 18:35:17,827 epoch 28 - iter 828/921 - loss 0.14507409 - samples/sec: 162.60
2020-06-19 18:35:35,250 epoch 28 - iter 920/921 - loss 0.14298768 - samples/sec: 169.18
2020-06-19 18:35:35,386 ----------------------------------------------------------------------------------------------------
2020-06-19 18:35:35,387 EPOCH 28 done: loss 0.1430 - lr 0.0250000
2020-06-19 18:35:47,847 DEV : loss 0.2208137959241867 - score 0.7484
2020-06-19 18:35:48,359 BAD EPOCHS (no improvement): 1
2020-06-19 18:35:48,360 ----------------------------------------------------------------------------------------------------
2020-06-19 18:36:06,412 epoch 29 - iter 92/921 - loss 0.12628473 - samples/sec: 163.18
2020-06-19 18:36:24,420 epoch 29 - iter 184/921 - loss 0.12255078 - samples/sec: 163.68
2020-06-19 18:36:42,550 epoch 29 - iter 276/921 - loss 0.13203068 - samples/sec: 162.57
2020-06-19 18:37:00,614 epoch 29 - iter 368/921 - loss 0.13788329 - samples/sec: 163.17
2020-06-19 18:37:18,767 epoch 29 - iter 460/921 - loss 0.13598131 - samples/sec: 162.37
2020-06-19 18:37:38,196 epoch 29 - iter 552/921 - loss 0.13443553 - samples/sec: 151.69
2020-06-19 18:37:56,255 epoch 29 - iter 644/921 - loss 0.13545811 - samples/sec: 163.22
2020-06-19 18:38:14,360 epoch 29 - iter 736/921 - loss 0.13525840 - samples/sec: 162.80
2020-06-19 18:38:32,758 epoch 29 - iter 828/921 - loss 0.13782525 - samples/sec: 160.21
2020-06-19 18:38:51,997 epoch 29 - iter 920/921 - loss 0.14087679 - samples/sec: 153.20
2020-06-19 18:38:52,132 ----------------------------------------------------------------------------------------------------
2020-06-19 18:38:52,132 EPOCH 29 done: loss 0.1409 - lr 0.0250000
2020-06-19 18:39:04,219 DEV : loss 0.22152985632419586 - score 0.74
2020-06-19 18:39:04,723 BAD EPOCHS (no improvement): 2
2020-06-19 18:39:04,723 ----------------------------------------------------------------------------------------------------
2020-06-19 18:39:23,034 epoch 30 - iter 92/921 - loss 0.12449806 - samples/sec: 160.87
2020-06-19 18:39:41,159 epoch 30 - iter 184/921 - loss 0.13764044 - samples/sec: 162.62
2020-06-19 18:39:59,521 epoch 30 - iter 276/921 - loss 0.13771567 - samples/sec: 160.52
2020-06-19 18:40:17,961 epoch 30 - iter 368/921 - loss 0.14555358 - samples/sec: 159.84
2020-06-19 18:40:36,539 epoch 30 - iter 460/921 - loss 0.14358773 - samples/sec: 158.65
2020-06-19 18:40:55,579 epoch 30 - iter 552/921 - loss 0.14319739 - samples/sec: 154.79
2020-06-19 18:41:13,448 epoch 30 - iter 644/921 - loss 0.14348403 - samples/sec: 164.95
2020-06-19 18:41:32,256 epoch 30 - iter 736/921 - loss 0.14445372 - samples/sec: 156.71
2020-06-19 18:41:51,344 epoch 30 - iter 828/921 - loss 0.14341996 - samples/sec: 154.41
2020-06-19 18:42:09,119 epoch 30 - iter 920/921 - loss 0.14317151 - samples/sec: 165.83
2020-06-19 18:42:09,237 ----------------------------------------------------------------------------------------------------
2020-06-19 18:42:09,237 EPOCH 30 done: loss 0.1430 - lr 0.0250000
2020-06-19 18:42:21,228 DEV : loss 0.2244810163974762 - score 0.7419
2020-06-19 18:42:21,729 BAD EPOCHS (no improvement): 3
2020-06-19 18:42:21,729 ----------------------------------------------------------------------------------------------------
2020-06-19 18:42:43,512 epoch 31 - iter 92/921 - loss 0.15782516 - samples/sec: 135.23
2020-06-19 18:43:02,072 epoch 31 - iter 184/921 - loss 0.15022895 - samples/sec: 158.80
2020-06-19 18:43:21,895 epoch 31 - iter 276/921 - loss 0.13984820 - samples/sec: 148.68
2020-06-19 18:43:40,721 epoch 31 - iter 368/921 - loss 0.13625519 - samples/sec: 156.56
2020-06-19 18:43:59,578 epoch 31 - iter 460/921 - loss 0.13813330 - samples/sec: 156.30
2020-06-19 18:44:18,417 epoch 31 - iter 552/921 - loss 0.13734255 - samples/sec: 156.46
2020-06-19 18:44:36,579 epoch 31 - iter 644/921 - loss 0.13550953 - samples/sec: 162.29
2020-06-19 18:44:56,139 epoch 31 - iter 736/921 - loss 0.13715064 - samples/sec: 150.68
2020-06-19 18:45:18,206 epoch 31 - iter 828/921 - loss 0.13800741 - samples/sec: 133.56
2020-06-19 18:45:36,815 epoch 31 - iter 920/921 - loss 0.13867155 - samples/sec: 158.38
2020-06-19 18:45:36,937 ----------------------------------------------------------------------------------------------------
2020-06-19 18:45:36,937 EPOCH 31 done: loss 0.1386 - lr 0.0250000
2020-06-19 18:45:49,095 DEV : loss 0.21857215464115143 - score 0.7537
2020-06-19 18:45:49,603 BAD EPOCHS (no improvement): 4
2020-06-19 18:45:49,603 ----------------------------------------------------------------------------------------------------
2020-06-19 18:46:07,397 epoch 32 - iter 92/921 - loss 0.13322505 - samples/sec: 165.56
2020-06-19 18:46:25,869 epoch 32 - iter 184/921 - loss 0.13091724 - samples/sec: 159.57
2020-06-19 18:46:46,770 epoch 32 - iter 276/921 - loss 0.13172994 - samples/sec: 141.00
2020-06-19 18:47:06,688 epoch 32 - iter 368/921 - loss 0.13028550 - samples/sec: 147.99
2020-06-19 18:47:25,265 epoch 32 - iter 460/921 - loss 0.13045030 - samples/sec: 158.66
2020-06-19 18:47:43,767 epoch 32 - iter 552/921 - loss 0.13232911 - samples/sec: 159.31
2020-06-19 18:48:02,278 epoch 32 - iter 644/921 - loss 0.13308993 - samples/sec: 159.23
2020-06-19 18:48:20,901 epoch 32 - iter 736/921 - loss 0.13531347 - samples/sec: 158.27
2020-06-19 18:48:38,909 epoch 32 - iter 828/921 - loss 0.13358518 - samples/sec: 163.68
2020-06-19 18:48:57,372 epoch 32 - iter 920/921 - loss 0.13396758 - samples/sec: 159.65
2020-06-19 18:48:57,498 ----------------------------------------------------------------------------------------------------
2020-06-19 18:48:57,498 EPOCH 32 done: loss 0.1340 - lr 0.0125000
2020-06-19 18:49:09,966 DEV : loss 0.21901550889015198 - score 0.7595
2020-06-19 18:49:10,621 BAD EPOCHS (no improvement): 1
2020-06-19 18:49:10,621 ----------------------------------------------------------------------------------------------------
2020-06-19 18:49:29,386 epoch 33 - iter 92/921 - loss 0.14905364 - samples/sec: 156.98
2020-06-19 18:49:48,004 epoch 33 - iter 184/921 - loss 0.14106798 - samples/sec: 158.31
2020-06-19 18:50:06,001 epoch 33 - iter 276/921 - loss 0.13584030 - samples/sec: 163.79
2020-06-19 18:50:24,341 epoch 33 - iter 368/921 - loss 0.13128224 - samples/sec: 160.72
2020-06-19 18:50:42,438 epoch 33 - iter 460/921 - loss 0.13004208 - samples/sec: 162.87
2020-06-19 18:51:01,926 epoch 33 - iter 552/921 - loss 0.13088602 - samples/sec: 151.24
2020-06-19 18:51:20,745 epoch 33 - iter 644/921 - loss 0.13326203 - samples/sec: 156.62
2020-06-19 18:51:39,481 epoch 33 - iter 736/921 - loss 0.13443414 - samples/sec: 157.31
2020-06-19 18:51:57,334 epoch 33 - iter 828/921 - loss 0.13591436 - samples/sec: 165.11
2020-06-19 18:52:15,323 epoch 33 - iter 920/921 - loss 0.13503850 - samples/sec: 163.89
2020-06-19 18:52:15,511 ----------------------------------------------------------------------------------------------------
2020-06-19 18:52:15,511 EPOCH 33 done: loss 0.1351 - lr 0.0125000
2020-06-19 18:52:27,408 DEV : loss 0.21897192299365997 - score 0.7652
2020-06-19 18:52:27,910 BAD EPOCHS (no improvement): 0
2020-06-19 18:52:37,799 ----------------------------------------------------------------------------------------------------
2020-06-19 18:52:56,633 epoch 34 - iter 92/921 - loss 0.11560938 - samples/sec: 156.41
2020-06-19 18:53:14,572 epoch 34 - iter 184/921 - loss 0.12434888 - samples/sec: 164.31
2020-06-19 18:53:33,156 epoch 34 - iter 276/921 - loss 0.12764627 - samples/sec: 158.60
2020-06-19 18:53:52,009 epoch 34 - iter 368/921 - loss 0.12453694 - samples/sec: 156.33
2020-06-19 18:54:11,954 epoch 34 - iter 460/921 - loss 0.12532205 - samples/sec: 147.77
2020-06-19 18:54:31,415 epoch 34 - iter 552/921 - loss 0.12612398 - samples/sec: 151.45
2020-06-19 18:54:49,182 epoch 34 - iter 644/921 - loss 0.12938272 - samples/sec: 165.90
2020-06-19 18:55:06,985 epoch 34 - iter 736/921 - loss 0.13164536 - samples/sec: 165.57
2020-06-19 18:55:26,558 epoch 34 - iter 828/921 - loss 0.13164961 - samples/sec: 150.57
2020-06-19 18:55:44,747 epoch 34 - iter 920/921 - loss 0.13208990 - samples/sec: 162.04
2020-06-19 18:55:44,896 ----------------------------------------------------------------------------------------------------
2020-06-19 18:55:44,896 EPOCH 34 done: loss 0.1321 - lr 0.0125000
2020-06-19 18:56:01,215 DEV : loss 0.22124038636684418 - score 0.7547
2020-06-19 18:56:01,731 BAD EPOCHS (no improvement): 1
2020-06-19 18:56:01,731 ----------------------------------------------------------------------------------------------------
2020-06-19 18:56:19,016 epoch 35 - iter 92/921 - loss 0.11651641 - samples/sec: 170.43
2020-06-19 18:56:37,424 epoch 35 - iter 184/921 - loss 0.12389496 - samples/sec: 160.12
2020-06-19 18:56:58,550 epoch 35 - iter 276/921 - loss 0.12321134 - samples/sec: 139.49
2020-06-19 18:57:21,298 epoch 35 - iter 368/921 - loss 0.12560198 - samples/sec: 129.56
2020-06-19 18:57:43,631 epoch 35 - iter 460/921 - loss 0.13040092 - samples/sec: 131.96
2020-06-19 18:58:03,545 epoch 35 - iter 552/921 - loss 0.12984800 - samples/sec: 148.03
2020-06-19 18:58:22,611 epoch 35 - iter 644/921 - loss 0.12893085 - samples/sec: 154.58
2020-06-19 18:58:40,237 epoch 35 - iter 736/921 - loss 0.12858901 - samples/sec: 167.23
2020-06-19 18:58:57,932 epoch 35 - iter 828/921 - loss 0.12720974 - samples/sec: 166.58
2020-06-19 18:59:15,981 epoch 35 - iter 920/921 - loss 0.12711969 - samples/sec: 163.31
2020-06-19 18:59:16,131 ----------------------------------------------------------------------------------------------------
2020-06-19 18:59:16,131 EPOCH 35 done: loss 0.1270 - lr 0.0125000
2020-06-19 18:59:27,815 DEV : loss 0.2196003794670105 - score 0.7543
2020-06-19 18:59:28,323 BAD EPOCHS (no improvement): 2
2020-06-19 18:59:28,324 ----------------------------------------------------------------------------------------------------
2020-06-19 18:59:47,288 epoch 36 - iter 92/921 - loss 0.12901444 - samples/sec: 155.33
2020-06-19 19:00:05,647 epoch 36 - iter 184/921 - loss 0.12798345 - samples/sec: 160.56
2020-06-19 19:00:24,462 epoch 36 - iter 276/921 - loss 0.12658351 - samples/sec: 156.65
2020-06-19 19:00:42,944 epoch 36 - iter 368/921 - loss 0.12858132 - samples/sec: 159.48
2020-06-19 19:01:01,472 epoch 36 - iter 460/921 - loss 0.13356993 - samples/sec: 159.08
2020-06-19 19:01:19,270 epoch 36 - iter 552/921 - loss 0.13177473 - samples/sec: 165.62
2020-06-19 19:01:37,903 epoch 36 - iter 644/921 - loss 0.13302241 - samples/sec: 158.18
2020-06-19 19:01:55,946 epoch 36 - iter 736/921 - loss 0.13123591 - samples/sec: 163.37
2020-06-19 19:02:14,381 epoch 36 - iter 828/921 - loss 0.13139778 - samples/sec: 159.88
2020-06-19 19:02:33,104 epoch 36 - iter 920/921 - loss 0.13169704 - samples/sec: 157.42
2020-06-19 19:02:33,215 ----------------------------------------------------------------------------------------------------
2020-06-19 19:02:33,215 EPOCH 36 done: loss 0.1317 - lr 0.0125000
2020-06-19 19:02:45,230 DEV : loss 0.22187848389148712 - score 0.7612
2020-06-19 19:02:45,735 BAD EPOCHS (no improvement): 3
2020-06-19 19:02:45,736 ----------------------------------------------------------------------------------------------------
2020-06-19 19:03:04,157 epoch 37 - iter 92/921 - loss 0.13643361 - samples/sec: 159.91
2020-06-19 19:03:22,578 epoch 37 - iter 184/921 - loss 0.12900436 - samples/sec: 160.01
2020-06-19 19:03:40,408 epoch 37 - iter 276/921 - loss 0.12496729 - samples/sec: 165.32
2020-06-19 19:03:59,408 epoch 37 - iter 368/921 - loss 0.12705644 - samples/sec: 155.12
2020-06-19 19:04:18,048 epoch 37 - iter 460/921 - loss 0.12438247 - samples/sec: 158.13
2020-06-19 19:04:36,545 epoch 37 - iter 552/921 - loss 0.12810324 - samples/sec: 159.35
2020-06-19 19:04:56,831 epoch 37 - iter 644/921 - loss 0.12622550 - samples/sec: 145.28
2020-06-19 19:05:16,550 epoch 37 - iter 736/921 - loss 0.12712398 - samples/sec: 149.47
2020-06-19 19:05:37,035 epoch 37 - iter 828/921 - loss 0.12795412 - samples/sec: 143.87
2020-06-19 19:05:54,761 epoch 37 - iter 920/921 - loss 0.12720784 - samples/sec: 166.28
2020-06-19 19:05:54,853 ----------------------------------------------------------------------------------------------------
2020-06-19 19:05:54,854 EPOCH 37 done: loss 0.1271 - lr 0.0125000
2020-06-19 19:06:06,742 DEV : loss 0.22184792160987854 - score 0.7584
2020-06-19 19:06:07,248 BAD EPOCHS (no improvement): 4
2020-06-19 19:06:07,249 ----------------------------------------------------------------------------------------------------
2020-06-19 19:06:24,656 epoch 38 - iter 92/921 - loss 0.11091118 - samples/sec: 169.24
2020-06-19 19:06:42,302 epoch 38 - iter 184/921 - loss 0.11888298 - samples/sec: 167.04
2020-06-19 19:07:00,931 epoch 38 - iter 276/921 - loss 0.12040937 - samples/sec: 158.22
2020-06-19 19:07:18,399 epoch 38 - iter 368/921 - loss 0.12587852 - samples/sec: 168.75
2020-06-19 19:07:36,823 epoch 38 - iter 460/921 - loss 0.12674966 - samples/sec: 159.98
2020-06-19 19:07:59,261 epoch 38 - iter 552/921 - loss 0.12382912 - samples/sec: 131.33
2020-06-19 19:08:16,867 epoch 38 - iter 644/921 - loss 0.12573870 - samples/sec: 167.42
2020-06-19 19:08:34,362 epoch 38 - iter 736/921 - loss 0.12487266 - samples/sec: 168.48
2020-06-19 19:08:53,008 epoch 38 - iter 828/921 - loss 0.12610815 - samples/sec: 158.07
2020-06-19 19:09:12,392 epoch 38 - iter 920/921 - loss 0.12782359 - samples/sec: 152.05
2020-06-19 19:09:12,510 ----------------------------------------------------------------------------------------------------
2020-06-19 19:09:12,510 EPOCH 38 done: loss 0.1277 - lr 0.0062500
2020-06-19 19:09:26,843 DEV : loss 0.2217479795217514 - score 0.7556
2020-06-19 19:09:27,347 BAD EPOCHS (no improvement): 1
2020-06-19 19:09:27,348 ----------------------------------------------------------------------------------------------------
2020-06-19 19:09:47,402 epoch 39 - iter 92/921 - loss 0.13044295 - samples/sec: 146.88
2020-06-19 19:10:06,857 epoch 39 - iter 184/921 - loss 0.13191755 - samples/sec: 151.51
2020-06-19 19:10:26,001 epoch 39 - iter 276/921 - loss 0.12844157 - samples/sec: 153.97
2020-06-19 19:10:44,694 epoch 39 - iter 368/921 - loss 0.13170187 - samples/sec: 157.68
2020-06-19 19:11:02,893 epoch 39 - iter 460/921 - loss 0.13383496 - samples/sec: 161.96
2020-06-19 19:11:21,352 epoch 39 - iter 552/921 - loss 0.13240914 - samples/sec: 159.67
2020-06-19 19:11:40,020 epoch 39 - iter 644/921 - loss 0.12808825 - samples/sec: 157.89
2020-06-19 19:11:58,139 epoch 39 - iter 736/921 - loss 0.12926796 - samples/sec: 162.68
2020-06-19 19:12:16,274 epoch 39 - iter 828/921 - loss 0.12649557 - samples/sec: 162.53
2020-06-19 19:12:34,861 epoch 39 - iter 920/921 - loss 0.12876313 - samples/sec: 158.57
2020-06-19 19:12:34,973 ----------------------------------------------------------------------------------------------------
2020-06-19 19:12:34,973 EPOCH 39 done: loss 0.1287 - lr 0.0062500
2020-06-19 19:12:46,962 DEV : loss 0.22090354561805725 - score 0.7587
2020-06-19 19:12:47,465 BAD EPOCHS (no improvement): 2
2020-06-19 19:12:47,465 ----------------------------------------------------------------------------------------------------
2020-06-19 19:13:05,553 epoch 40 - iter 92/921 - loss 0.12671709 - samples/sec: 162.86
2020-06-19 19:13:23,963 epoch 40 - iter 184/921 - loss 0.12406927 - samples/sec: 160.10
2020-06-19 19:13:42,329 epoch 40 - iter 276/921 - loss 0.12115843 - samples/sec: 160.49
2020-06-19 19:14:00,991 epoch 40 - iter 368/921 - loss 0.12241758 - samples/sec: 157.94
2020-06-19 19:14:21,578 epoch 40 - iter 460/921 - loss 0.12365402 - samples/sec: 143.16
2020-06-19 19:14:41,782 epoch 40 - iter 552/921 - loss 0.12702801 - samples/sec: 145.87
2020-06-19 19:15:03,008 epoch 40 - iter 644/921 - loss 0.12867429 - samples/sec: 138.84
2020-06-19 19:15:23,521 epoch 40 - iter 736/921 - loss 0.12835884 - samples/sec: 143.69
2020-06-19 19:15:42,083 epoch 40 - iter 828/921 - loss 0.12785880 - samples/sec: 158.78
2020-06-19 19:16:00,451 epoch 40 - iter 920/921 - loss 0.12664274 - samples/sec: 160.47
2020-06-19 19:16:00,551 ----------------------------------------------------------------------------------------------------
2020-06-19 19:16:00,552 EPOCH 40 done: loss 0.1266 - lr 0.0062500
2020-06-19 19:16:12,701 DEV : loss 0.22112777829170227 - score 0.757
2020-06-19 19:16:13,200 BAD EPOCHS (no improvement): 3
2020-06-19 19:16:13,201 ----------------------------------------------------------------------------------------------------
2020-06-19 19:16:31,980 epoch 41 - iter 92/921 - loss 0.13407295 - samples/sec: 156.87
2020-06-19 19:16:51,171 epoch 41 - iter 184/921 - loss 0.13554739 - samples/sec: 153.57
2020-06-19 19:17:09,592 epoch 41 - iter 276/921 - loss 0.13693306 - samples/sec: 160.01
2020-06-19 19:17:28,071 epoch 41 - iter 368/921 - loss 0.13576461 - samples/sec: 159.51
2020-06-19 19:17:46,490 epoch 41 - iter 460/921 - loss 0.13445355 - samples/sec: 160.02
2020-06-19 19:18:05,008 epoch 41 - iter 552/921 - loss 0.13359852 - samples/sec: 159.17
2020-06-19 19:18:23,851 epoch 41 - iter 644/921 - loss 0.13141030 - samples/sec: 156.42
2020-06-19 19:18:42,552 epoch 41 - iter 736/921 - loss 0.13170781 - samples/sec: 157.61
2020-06-19 19:19:00,700 epoch 41 - iter 828/921 - loss 0.13002873 - samples/sec: 162.41
2020-06-19 19:19:19,069 epoch 41 - iter 920/921 - loss 0.12959326 - samples/sec: 160.47
2020-06-19 19:19:19,185 ----------------------------------------------------------------------------------------------------
2020-06-19 19:19:19,185 EPOCH 41 done: loss 0.1295 - lr 0.0062500
2020-06-19 19:19:31,353 DEV : loss 0.22153900563716888 - score 0.7591
2020-06-19 19:19:31,962 BAD EPOCHS (no improvement): 4
2020-06-19 19:19:31,963 ----------------------------------------------------------------------------------------------------
2020-06-19 19:19:55,874 epoch 42 - iter 92/921 - loss 0.12162780 - samples/sec: 123.18
2020-06-19 19:20:14,105 epoch 42 - iter 184/921 - loss 0.12258432 - samples/sec: 161.67
2020-06-19 19:20:33,822 epoch 42 - iter 276/921 - loss 0.12334217 - samples/sec: 149.48
2020-06-19 19:20:52,655 epoch 42 - iter 368/921 - loss 0.12241274 - samples/sec: 156.50
2020-06-19 19:21:10,910 epoch 42 - iter 460/921 - loss 0.12511586 - samples/sec: 161.47
2020-06-19 19:21:29,354 epoch 42 - iter 552/921 - loss 0.12258832 - samples/sec: 159.80
2020-06-19 19:21:47,819 epoch 42 - iter 644/921 - loss 0.12281460 - samples/sec: 159.62
2020-06-19 19:22:06,439 epoch 42 - iter 736/921 - loss 0.12573713 - samples/sec: 158.29
2020-06-19 19:22:24,934 epoch 42 - iter 828/921 - loss 0.12643037 - samples/sec: 159.37
2020-06-19 19:22:43,645 epoch 42 - iter 920/921 - loss 0.12582809 - samples/sec: 157.52
2020-06-19 19:22:43,792 ----------------------------------------------------------------------------------------------------
2020-06-19 19:22:43,792 EPOCH 42 done: loss 0.1258 - lr 0.0031250
2020-06-19 19:22:58,803 DEV : loss 0.2214355170726776 - score 0.7626
2020-06-19 19:22:59,500 BAD EPOCHS (no improvement): 1
2020-06-19 19:22:59,500 ----------------------------------------------------------------------------------------------------
2020-06-19 19:23:20,109 epoch 43 - iter 92/921 - loss 0.13379576 - samples/sec: 142.94
2020-06-19 19:23:39,879 epoch 43 - iter 184/921 - loss 0.12940693 - samples/sec: 149.09
2020-06-19 19:24:01,404 epoch 43 - iter 276/921 - loss 0.12946302 - samples/sec: 136.93
2020-06-19 19:24:19,875 epoch 43 - iter 368/921 - loss 0.12732634 - samples/sec: 159.58
2020-06-19 19:24:38,432 epoch 43 - iter 460/921 - loss 0.12926736 - samples/sec: 158.83
2020-06-19 19:24:56,345 epoch 43 - iter 552/921 - loss 0.12702688 - samples/sec: 164.55
2020-06-19 19:25:15,088 epoch 43 - iter 644/921 - loss 0.12612737 - samples/sec: 157.25
2020-06-19 19:25:33,862 epoch 43 - iter 736/921 - loss 0.12777200 - samples/sec: 157.00
2020-06-19 19:25:54,047 epoch 43 - iter 828/921 - loss 0.12921799 - samples/sec: 146.01
2020-06-19 19:26:11,931 epoch 43 - iter 920/921 - loss 0.12910395 - samples/sec: 164.82
2020-06-19 19:26:12,058 ----------------------------------------------------------------------------------------------------
2020-06-19 19:26:12,058 EPOCH 43 done: loss 0.1292 - lr 0.0031250
2020-06-19 19:26:24,061 DEV : loss 0.22193847596645355 - score 0.76
2020-06-19 19:26:24,566 BAD EPOCHS (no improvement): 2
2020-06-19 19:26:24,566 ----------------------------------------------------------------------------------------------------
2020-06-19 19:26:42,806 epoch 44 - iter 92/921 - loss 0.14046591 - samples/sec: 161.51
2020-06-19 19:27:01,432 epoch 44 - iter 184/921 - loss 0.13399898 - samples/sec: 158.24
2020-06-19 19:27:20,457 epoch 44 - iter 276/921 - loss 0.13355236 - samples/sec: 154.93
2020-06-19 19:27:38,414 epoch 44 - iter 368/921 - loss 0.13001964 - samples/sec: 164.14
2020-06-19 19:27:57,103 epoch 44 - iter 460/921 - loss 0.12855295 - samples/sec: 157.72
2020-06-19 19:28:15,339 epoch 44 - iter 552/921 - loss 0.12815918 - samples/sec: 161.63
2020-06-19 19:28:34,519 epoch 44 - iter 644/921 - loss 0.12860689 - samples/sec: 153.67
2020-06-19 19:28:53,482 epoch 44 - iter 736/921 - loss 0.12865857 - samples/sec: 155.43
2020-06-19 19:29:12,143 epoch 44 - iter 828/921 - loss 0.12801903 - samples/sec: 157.95
2020-06-19 19:29:30,412 epoch 44 - iter 920/921 - loss 0.12835924 - samples/sec: 161.34
2020-06-19 19:29:30,512 ----------------------------------------------------------------------------------------------------
2020-06-19 19:29:30,512 EPOCH 44 done: loss 0.1284 - lr 0.0031250
2020-06-19 19:29:42,652 DEV : loss 0.22218644618988037 - score 0.7598
2020-06-19 19:29:43,163 BAD EPOCHS (no improvement): 3
2020-06-19 19:29:43,163 ----------------------------------------------------------------------------------------------------
2020-06-19 19:30:01,358 epoch 45 - iter 92/921 - loss 0.13180700 - samples/sec: 161.90
2020-06-19 19:30:19,419 epoch 45 - iter 184/921 - loss 0.12133310 - samples/sec: 163.20
2020-06-19 19:30:38,548 epoch 45 - iter 276/921 - loss 0.12142483 - samples/sec: 154.08
2020-06-19 19:30:57,958 epoch 45 - iter 368/921 - loss 0.12377813 - samples/sec: 151.84
2020-06-19 19:31:16,513 epoch 45 - iter 460/921 - loss 0.12497589 - samples/sec: 158.86
2020-06-19 19:31:34,874 epoch 45 - iter 552/921 - loss 0.12540872 - samples/sec: 160.52
2020-06-19 19:31:55,317 epoch 45 - iter 644/921 - loss 0.12558934 - samples/sec: 144.17
2020-06-19 19:32:14,741 epoch 45 - iter 736/921 - loss 0.12532680 - samples/sec: 151.76
2020-06-19 19:32:36,316 epoch 45 - iter 828/921 - loss 0.12415990 - samples/sec: 136.61
2020-06-19 19:32:59,995 epoch 45 - iter 920/921 - loss 0.12572437 - samples/sec: 124.47
2020-06-19 19:33:00,144 ----------------------------------------------------------------------------------------------------
2020-06-19 19:33:00,144 EPOCH 45 done: loss 0.1256 - lr 0.0031250
2020-06-19 19:33:19,561 DEV : loss 0.22259385883808136 - score 0.758
2020-06-19 19:33:20,253 BAD EPOCHS (no improvement): 4
2020-06-19 19:33:20,254 ----------------------------------------------------------------------------------------------------
2020-06-19 19:33:43,648 epoch 46 - iter 92/921 - loss 0.11661344 - samples/sec: 125.91
2020-06-19 19:34:05,545 epoch 46 - iter 184/921 - loss 0.12440930 - samples/sec: 134.60
2020-06-19 19:34:24,355 epoch 46 - iter 276/921 - loss 0.12939925 - samples/sec: 156.69
2020-06-19 19:34:42,532 epoch 46 - iter 368/921 - loss 0.12429652 - samples/sec: 162.16
2020-06-19 19:35:01,460 epoch 46 - iter 460/921 - loss 0.12399710 - samples/sec: 155.72
2020-06-19 19:35:19,487 epoch 46 - iter 552/921 - loss 0.12662427 - samples/sec: 163.51
2020-06-19 19:35:37,514 epoch 46 - iter 644/921 - loss 0.12423739 - samples/sec: 163.50
2020-06-19 19:35:54,896 epoch 46 - iter 736/921 - loss 0.12510470 - samples/sec: 169.59
2020-06-19 19:36:12,263 epoch 46 - iter 828/921 - loss 0.12639271 - samples/sec: 169.73
2020-06-19 19:36:30,040 epoch 46 - iter 920/921 - loss 0.12661197 - samples/sec: 165.81
2020-06-19 19:36:30,159 ----------------------------------------------------------------------------------------------------
2020-06-19 19:36:30,159 EPOCH 46 done: loss 0.1267 - lr 0.0015625
2020-06-19 19:36:41,903 DEV : loss 0.22215069830417633 - score 0.7591
2020-06-19 19:36:42,406 BAD EPOCHS (no improvement): 1
2020-06-19 19:36:42,406 ----------------------------------------------------------------------------------------------------
2020-06-19 19:37:00,183 epoch 47 - iter 92/921 - loss 0.11306277 - samples/sec: 165.71
2020-06-19 19:37:18,650 epoch 47 - iter 184/921 - loss 0.12380765 - samples/sec: 159.61
2020-06-19 19:37:38,991 epoch 47 - iter 276/921 - loss 0.13068798 - samples/sec: 144.91
2020-06-19 19:37:58,957 epoch 47 - iter 368/921 - loss 0.12936189 - samples/sec: 147.63
2020-06-19 19:38:17,765 epoch 47 - iter 460/921 - loss 0.12610541 - samples/sec: 156.71
2020-06-19 19:38:35,970 epoch 47 - iter 552/921 - loss 0.12533565 - samples/sec: 161.91
2020-06-19 19:38:53,628 epoch 47 - iter 644/921 - loss 0.12535722 - samples/sec: 166.94
2020-06-19 19:39:12,628 epoch 47 - iter 736/921 - loss 0.12469788 - samples/sec: 155.13
2020-06-19 19:39:31,150 epoch 47 - iter 828/921 - loss 0.12456955 - samples/sec: 159.13
2020-06-19 19:39:50,086 epoch 47 - iter 920/921 - loss 0.12570592 - samples/sec: 155.65
2020-06-19 19:39:50,224 ----------------------------------------------------------------------------------------------------
2020-06-19 19:39:50,225 EPOCH 47 done: loss 0.1258 - lr 0.0015625
2020-06-19 19:40:02,661 DEV : loss 0.22171030938625336 - score 0.7584
2020-06-19 19:40:03,166 BAD EPOCHS (no improvement): 2
2020-06-19 19:40:03,167 ----------------------------------------------------------------------------------------------------
2020-06-19 19:40:23,861 epoch 48 - iter 92/921 - loss 0.12884783 - samples/sec: 142.34
2020-06-19 19:40:43,738 epoch 48 - iter 184/921 - loss 0.12906205 - samples/sec: 148.29
2020-06-19 19:41:02,760 epoch 48 - iter 276/921 - loss 0.12699792 - samples/sec: 154.94
2020-06-19 19:41:20,961 epoch 48 - iter 368/921 - loss 0.12470566 - samples/sec: 161.94
2020-06-19 19:41:38,265 epoch 48 - iter 460/921 - loss 0.12292399 - samples/sec: 170.35
2020-06-19 19:41:57,201 epoch 48 - iter 552/921 - loss 0.12464356 - samples/sec: 155.66
2020-06-19 19:42:15,518 epoch 48 - iter 644/921 - loss 0.12369407 - samples/sec: 160.92
2020-06-19 19:42:35,023 epoch 48 - iter 736/921 - loss 0.12548023 - samples/sec: 151.11
2020-06-19 19:42:53,578 epoch 48 - iter 828/921 - loss 0.12510728 - samples/sec: 158.85
2020-06-19 19:43:12,106 epoch 48 - iter 920/921 - loss 0.12493297 - samples/sec: 159.08
2020-06-19 19:43:12,231 ----------------------------------------------------------------------------------------------------
2020-06-19 19:43:12,232 EPOCH 48 done: loss 0.1255 - lr 0.0015625
2020-06-19 19:43:23,975 DEV : loss 0.22166259586811066 - score 0.7573
2020-06-19 19:43:24,481 BAD EPOCHS (no improvement): 3
2020-06-19 19:43:24,481 ----------------------------------------------------------------------------------------------------
2020-06-19 19:43:43,512 epoch 49 - iter 92/921 - loss 0.13926975 - samples/sec: 154.79
2020-06-19 19:44:02,838 epoch 49 - iter 184/921 - loss 0.13233647 - samples/sec: 152.51
2020-06-19 19:44:21,556 epoch 49 - iter 276/921 - loss 0.13285183 - samples/sec: 157.47
2020-06-19 19:44:40,082 epoch 49 - iter 368/921 - loss 0.13226186 - samples/sec: 159.10
2020-06-19 19:45:03,110 epoch 49 - iter 460/921 - loss 0.13233024 - samples/sec: 127.96
2020-06-19 19:45:21,456 epoch 49 - iter 552/921 - loss 0.13191745 - samples/sec: 160.66
2020-06-19 19:45:40,536 epoch 49 - iter 644/921 - loss 0.13213673 - samples/sec: 154.47
2020-06-19 19:45:59,467 epoch 49 - iter 736/921 - loss 0.12957944 - samples/sec: 155.70
2020-06-19 19:46:20,863 epoch 49 - iter 828/921 - loss 0.12858108 - samples/sec: 137.75
2020-06-19 19:46:40,059 epoch 49 - iter 920/921 - loss 0.12645118 - samples/sec: 153.54
2020-06-19 19:46:40,180 ----------------------------------------------------------------------------------------------------
2020-06-19 19:46:40,180 EPOCH 49 done: loss 0.1263 - lr 0.0015625
2020-06-19 19:46:52,183 DEV : loss 0.22137664258480072 - score 0.7589
2020-06-19 19:46:52,686 BAD EPOCHS (no improvement): 4
2020-06-19 19:46:52,687 ----------------------------------------------------------------------------------------------------
2020-06-19 19:47:11,188 epoch 50 - iter 92/921 - loss 0.12388285 - samples/sec: 159.23
2020-06-19 19:47:29,399 epoch 50 - iter 184/921 - loss 0.12759744 - samples/sec: 161.85
2020-06-19 19:47:47,300 epoch 50 - iter 276/921 - loss 0.12714612 - samples/sec: 164.65
2020-06-19 19:48:05,701 epoch 50 - iter 368/921 - loss 0.12562925 - samples/sec: 160.19
2020-06-19 19:48:24,573 epoch 50 - iter 460/921 - loss 0.12689694 - samples/sec: 156.18
2020-06-19 19:48:43,411 epoch 50 - iter 552/921 - loss 0.12470214 - samples/sec: 156.47
2020-06-19 19:49:02,837 epoch 50 - iter 644/921 - loss 0.12772355 - samples/sec: 151.72
2020-06-19 19:49:21,123 epoch 50 - iter 736/921 - loss 0.12631748 - samples/sec: 161.19
2020-06-19 19:49:40,272 epoch 50 - iter 828/921 - loss 0.12499115 - samples/sec: 153.92
2020-06-19 19:49:59,005 epoch 50 - iter 920/921 - loss 0.12538303 - samples/sec: 157.33
2020-06-19 19:49:59,121 ----------------------------------------------------------------------------------------------------
2020-06-19 19:49:59,121 EPOCH 50 done: loss 0.1253 - lr 0.0007813
2020-06-19 19:50:11,377 DEV : loss 0.22204726934432983 - score 0.7596
2020-06-19 19:50:11,882 BAD EPOCHS (no improvement): 1
2020-06-19 19:50:11,883 ----------------------------------------------------------------------------------------------------
2020-06-19 19:50:30,506 epoch 51 - iter 92/921 - loss 0.14778244 - samples/sec: 158.18
2020-06-19 19:50:49,631 epoch 51 - iter 184/921 - loss 0.14795116 - samples/sec: 154.11
2020-06-19 19:51:08,816 epoch 51 - iter 276/921 - loss 0.14009725 - samples/sec: 153.64
2020-06-19 19:51:27,550 epoch 51 - iter 368/921 - loss 0.13519427 - samples/sec: 157.33
2020-06-19 19:51:46,685 epoch 51 - iter 460/921 - loss 0.13027055 - samples/sec: 154.02
2020-06-19 19:52:05,209 epoch 51 - iter 552/921 - loss 0.12560215 - samples/sec: 159.12
2020-06-19 19:52:23,502 epoch 51 - iter 644/921 - loss 0.12658759 - samples/sec: 161.13
2020-06-19 19:52:41,878 epoch 51 - iter 736/921 - loss 0.12565733 - samples/sec: 160.39
2020-06-19 19:53:00,574 epoch 51 - iter 828/921 - loss 0.12250854 - samples/sec: 157.65
2020-06-19 19:53:19,389 epoch 51 - iter 920/921 - loss 0.12288833 - samples/sec: 156.65
2020-06-19 19:53:19,500 ----------------------------------------------------------------------------------------------------
2020-06-19 19:53:19,500 EPOCH 51 done: loss 0.1228 - lr 0.0007813
2020-06-19 19:53:31,644 DEV : loss 0.22238753736019135 - score 0.7591
2020-06-19 19:53:32,152 BAD EPOCHS (no improvement): 2
2020-06-19 19:53:32,152 ----------------------------------------------------------------------------------------------------
2020-06-19 19:53:50,691 epoch 52 - iter 92/921 - loss 0.11298749 - samples/sec: 158.90
2020-06-19 19:54:09,696 epoch 52 - iter 184/921 - loss 0.12939313 - samples/sec: 155.08
2020-06-19 19:54:28,942 epoch 52 - iter 276/921 - loss 0.13206217 - samples/sec: 153.13
2020-06-19 19:54:47,729 epoch 52 - iter 368/921 - loss 0.12972464 - samples/sec: 156.88
2020-06-19 19:55:06,204 epoch 52 - iter 460/921 - loss 0.12909259 - samples/sec: 159.54
2020-06-19 19:55:24,694 epoch 52 - iter 552/921 - loss 0.12692039 - samples/sec: 159.41
2020-06-19 19:55:43,032 epoch 52 - iter 644/921 - loss 0.12497516 - samples/sec: 160.73
2020-06-19 19:56:01,894 epoch 52 - iter 736/921 - loss 0.12475264 - samples/sec: 156.25
2020-06-19 19:56:20,356 epoch 52 - iter 828/921 - loss 0.12345905 - samples/sec: 159.65
2020-06-19 19:56:38,403 epoch 52 - iter 920/921 - loss 0.12581709 - samples/sec: 163.33
2020-06-19 19:56:38,513 ----------------------------------------------------------------------------------------------------
2020-06-19 19:56:38,513 EPOCH 52 done: loss 0.1258 - lr 0.0007813
2020-06-19 19:56:54,038 DEV : loss 0.22243522107601166 - score 0.7591
2020-06-19 19:56:54,551 BAD EPOCHS (no improvement): 3
2020-06-19 19:56:54,551 ----------------------------------------------------------------------------------------------------
2020-06-19 19:57:13,165 epoch 53 - iter 92/921 - loss 0.11867155 - samples/sec: 158.25
2020-06-19 19:57:31,908 epoch 53 - iter 184/921 - loss 0.11565173 - samples/sec: 157.26
2020-06-19 19:57:49,708 epoch 53 - iter 276/921 - loss 0.12031623 - samples/sec: 165.59
2020-06-19 19:58:07,776 epoch 53 - iter 368/921 - loss 0.12623387 - samples/sec: 163.13
2020-06-19 19:58:26,388 epoch 53 - iter 460/921 - loss 0.12845781 - samples/sec: 158.36
2020-06-19 19:58:44,717 epoch 53 - iter 552/921 - loss 0.12715571 - samples/sec: 160.81
2020-06-19 19:59:03,227 epoch 53 - iter 644/921 - loss 0.12794776 - samples/sec: 159.23
2020-06-19 19:59:21,014 epoch 53 - iter 736/921 - loss 0.12705886 - samples/sec: 165.72
2020-06-19 19:59:38,965 epoch 53 - iter 828/921 - loss 0.12624188 - samples/sec: 164.20
2020-06-19 19:59:58,157 epoch 53 - iter 920/921 - loss 0.12446313 - samples/sec: 153.57
2020-06-19 19:59:58,330 ----------------------------------------------------------------------------------------------------
2020-06-19 19:59:58,330 EPOCH 53 done: loss 0.1244 - lr 0.0007813
2020-06-19 20:00:11,266 DEV : loss 0.2224540114402771 - score 0.7589
2020-06-19 20:00:11,776 BAD EPOCHS (no improvement): 4
2020-06-19 20:00:11,777 ----------------------------------------------------------------------------------------------------
2020-06-19 20:00:29,691 epoch 54 - iter 92/921 - loss 0.13094562 - samples/sec: 164.44
2020-06-19 20:00:47,689 epoch 54 - iter 184/921 - loss 0.12262727 - samples/sec: 163.77
2020-06-19 20:01:05,663 epoch 54 - iter 276/921 - loss 0.11755094 - samples/sec: 163.99
2020-06-19 20:01:23,975 epoch 54 - iter 368/921 - loss 0.11489089 - samples/sec: 160.96
2020-06-19 20:01:42,531 epoch 54 - iter 460/921 - loss 0.11816097 - samples/sec: 158.84
2020-06-19 20:02:01,226 epoch 54 - iter 552/921 - loss 0.12091129 - samples/sec: 157.66
2020-06-19 20:02:20,362 epoch 54 - iter 644/921 - loss 0.12197889 - samples/sec: 154.02
2020-06-19 20:02:40,301 epoch 54 - iter 736/921 - loss 0.12154772 - samples/sec: 147.81
2020-06-19 20:02:59,190 epoch 54 - iter 828/921 - loss 0.12259073 - samples/sec: 156.04
2020-06-19 20:03:16,994 epoch 54 - iter 920/921 - loss 0.12212641 - samples/sec: 165.56
2020-06-19 20:03:17,109 ----------------------------------------------------------------------------------------------------
2020-06-19 20:03:17,109 EPOCH 54 done: loss 0.1223 - lr 0.0003906
2020-06-19 20:03:29,375 DEV : loss 0.2225446105003357 - score 0.7589
2020-06-19 20:03:30,086 BAD EPOCHS (no improvement): 1
2020-06-19 20:03:30,086 ----------------------------------------------------------------------------------------------------
2020-06-19 20:03:50,782 epoch 55 - iter 92/921 - loss 0.11662072 - samples/sec: 142.33
2020-06-19 20:04:08,796 epoch 55 - iter 184/921 - loss 0.11949519 - samples/sec: 163.63
2020-06-19 20:04:27,217 epoch 55 - iter 276/921 - loss 0.12332443 - samples/sec: 160.01
2020-06-19 20:04:45,036 epoch 55 - iter 368/921 - loss 0.12055230 - samples/sec: 165.42
2020-06-19 20:05:04,569 epoch 55 - iter 460/921 - loss 0.12063923 - samples/sec: 150.88
2020-06-19 20:05:22,823 epoch 55 - iter 552/921 - loss 0.12036625 - samples/sec: 161.48
2020-06-19 20:05:40,024 epoch 55 - iter 644/921 - loss 0.12253011 - samples/sec: 171.36
2020-06-19 20:05:58,662 epoch 55 - iter 736/921 - loss 0.12048978 - samples/sec: 158.15
2020-06-19 20:06:16,534 epoch 55 - iter 828/921 - loss 0.12113995 - samples/sec: 164.93
2020-06-19 20:06:36,892 epoch 55 - iter 920/921 - loss 0.12177205 - samples/sec: 144.78
2020-06-19 20:06:37,057 ----------------------------------------------------------------------------------------------------
2020-06-19 20:06:37,058 EPOCH 55 done: loss 0.1217 - lr 0.0003906
2020-06-19 20:06:49,121 DEV : loss 0.22243456542491913 - score 0.7591
2020-06-19 20:06:49,633 BAD EPOCHS (no improvement): 2
2020-06-19 20:06:49,634 ----------------------------------------------------------------------------------------------------
2020-06-19 20:07:07,822 epoch 56 - iter 92/921 - loss 0.10894393 - samples/sec: 161.97
2020-06-19 20:07:27,428 epoch 56 - iter 184/921 - loss 0.11059758 - samples/sec: 150.33
2020-06-19 20:07:45,236 epoch 56 - iter 276/921 - loss 0.11708699 - samples/sec: 165.51
2020-06-19 20:08:02,906 epoch 56 - iter 368/921 - loss 0.12254915 - samples/sec: 166.82
2020-06-19 20:08:20,920 epoch 56 - iter 460/921 - loss 0.12218820 - samples/sec: 163.63
2020-06-19 20:08:39,630 epoch 56 - iter 552/921 - loss 0.12174435 - samples/sec: 157.54
2020-06-19 20:08:57,773 epoch 56 - iter 644/921 - loss 0.12340557 - samples/sec: 162.46
2020-06-19 20:09:18,253 epoch 56 - iter 736/921 - loss 0.12202586 - samples/sec: 143.90
2020-06-19 20:09:45,239 epoch 56 - iter 828/921 - loss 0.12278205 - samples/sec: 109.19
2020-06-19 20:10:04,002 epoch 56 - iter 920/921 - loss 0.12510960 - samples/sec: 157.09
2020-06-19 20:10:04,185 ----------------------------------------------------------------------------------------------------
2020-06-19 20:10:04,185 EPOCH 56 done: loss 0.1251 - lr 0.0003906
2020-06-19 20:10:16,408 DEV : loss 0.22257767617702484 - score 0.7591
2020-06-19 20:10:16,914 BAD EPOCHS (no improvement): 3
2020-06-19 20:10:16,914 ----------------------------------------------------------------------------------------------------
2020-06-19 20:10:35,299 epoch 57 - iter 92/921 - loss 0.11936485 - samples/sec: 160.23
2020-06-19 20:10:53,549 epoch 57 - iter 184/921 - loss 0.12093500 - samples/sec: 161.51
2020-06-19 20:11:11,874 epoch 57 - iter 276/921 - loss 0.11664366 - samples/sec: 160.85
2020-06-19 20:11:29,885 epoch 57 - iter 368/921 - loss 0.11868473 - samples/sec: 163.65
2020-06-19 20:11:48,434 epoch 57 - iter 460/921 - loss 0.11978830 - samples/sec: 158.90
2020-06-19 20:12:07,567 epoch 57 - iter 552/921 - loss 0.11982631 - samples/sec: 154.05
2020-06-19 20:12:25,986 epoch 57 - iter 644/921 - loss 0.12316989 - samples/sec: 160.02
2020-06-19 20:12:45,107 epoch 57 - iter 736/921 - loss 0.12432529 - samples/sec: 154.14
2020-06-19 20:13:03,828 epoch 57 - iter 828/921 - loss 0.12473022 - samples/sec: 157.44
2020-06-19 20:13:23,756 epoch 57 - iter 920/921 - loss 0.12401556 - samples/sec: 147.92
2020-06-19 20:13:23,952 ----------------------------------------------------------------------------------------------------
2020-06-19 20:13:23,952 EPOCH 57 done: loss 0.1243 - lr 0.0003906
2020-06-19 20:13:38,418 DEV : loss 0.22280342876911163 - score 0.7591
2020-06-19 20:13:38,920 BAD EPOCHS (no improvement): 4
2020-06-19 20:13:38,921 ----------------------------------------------------------------------------------------------------
2020-06-19 20:13:56,651 epoch 58 - iter 92/921 - loss 0.10509227 - samples/sec: 166.15
2020-06-19 20:14:14,414 epoch 58 - iter 184/921 - loss 0.11467133 - samples/sec: 165.94
2020-06-19 20:14:33,181 epoch 58 - iter 276/921 - loss 0.11303710 - samples/sec: 157.05
2020-06-19 20:14:51,878 epoch 58 - iter 368/921 - loss 0.11564924 - samples/sec: 157.63
2020-06-19 20:15:11,686 epoch 58 - iter 460/921 - loss 0.11636718 - samples/sec: 148.82
2020-06-19 20:15:29,923 epoch 58 - iter 552/921 - loss 0.11791910 - samples/sec: 161.63
2020-06-19 20:15:48,611 epoch 58 - iter 644/921 - loss 0.11796386 - samples/sec: 157.72
2020-06-19 20:16:07,430 epoch 58 - iter 736/921 - loss 0.11905535 - samples/sec: 156.62
2020-06-19 20:16:25,552 epoch 58 - iter 828/921 - loss 0.12192888 - samples/sec: 162.65
2020-06-19 20:16:44,502 epoch 58 - iter 920/921 - loss 0.12395674 - samples/sec: 155.53
2020-06-19 20:16:44,631 ----------------------------------------------------------------------------------------------------
2020-06-19 20:16:44,632 EPOCH 58 done: loss 0.1238 - lr 0.0001953
2020-06-19 20:16:56,728 DEV : loss 0.22268925607204437 - score 0.7573
2020-06-19 20:16:57,236 BAD EPOCHS (no improvement): 1
2020-06-19 20:16:57,237 ----------------------------------------------------------------------------------------------------
2020-06-19 20:17:15,817 epoch 59 - iter 92/921 - loss 0.11927950 - samples/sec: 158.54
2020-06-19 20:17:34,590 epoch 59 - iter 184/921 - loss 0.12131123 - samples/sec: 157.01
2020-06-19 20:17:53,328 epoch 59 - iter 276/921 - loss 0.12318702 - samples/sec: 157.30
2020-06-19 20:18:11,948 epoch 59 - iter 368/921 - loss 0.12642408 - samples/sec: 158.29
2020-06-19 20:18:32,612 epoch 59 - iter 460/921 - loss 0.12627942 - samples/sec: 142.62
2020-06-19 20:18:51,430 epoch 59 - iter 552/921 - loss 0.12471361 - samples/sec: 156.63
2020-06-19 20:19:10,494 epoch 59 - iter 644/921 - loss 0.12462158 - samples/sec: 154.61
2020-06-19 20:19:30,426 epoch 59 - iter 736/921 - loss 0.12496608 - samples/sec: 147.86
2020-06-19 20:19:48,429 epoch 59 - iter 828/921 - loss 0.12148562 - samples/sec: 163.72
2020-06-19 20:20:07,005 epoch 59 - iter 920/921 - loss 0.12036536 - samples/sec: 158.67
2020-06-19 20:20:07,119 ----------------------------------------------------------------------------------------------------
2020-06-19 20:20:07,119 EPOCH 59 done: loss 0.1203 - lr 0.0001953
2020-06-19 20:20:19,376 DEV : loss 0.2228633165359497 - score 0.7591
2020-06-19 20:20:19,885 BAD EPOCHS (no improvement): 2
2020-06-19 20:20:19,885 ----------------------------------------------------------------------------------------------------
2020-06-19 20:20:39,639 epoch 60 - iter 92/921 - loss 0.11694499 - samples/sec: 149.12
2020-06-19 20:20:58,506 epoch 60 - iter 184/921 - loss 0.11958391 - samples/sec: 156.22
2020-06-19 20:21:21,292 epoch 60 - iter 276/921 - loss 0.12100972 - samples/sec: 129.33
2020-06-19 20:21:39,369 epoch 60 - iter 368/921 - loss 0.12314880 - samples/sec: 163.05
2020-06-19 20:21:57,727 epoch 60 - iter 460/921 - loss 0.12035904 - samples/sec: 160.56
2020-06-19 20:22:16,925 epoch 60 - iter 552/921 - loss 0.12244273 - samples/sec: 153.53
2020-06-19 20:22:35,139 epoch 60 - iter 644/921 - loss 0.12359785 - samples/sec: 161.83
2020-06-19 20:22:53,759 epoch 60 - iter 736/921 - loss 0.12362698 - samples/sec: 158.30
2020-06-19 20:23:12,478 epoch 60 - iter 828/921 - loss 0.12387833 - samples/sec: 157.46
2020-06-19 20:23:31,277 epoch 60 - iter 920/921 - loss 0.12459220 - samples/sec: 156.78
2020-06-19 20:23:31,418 ----------------------------------------------------------------------------------------------------
2020-06-19 20:23:31,418 EPOCH 60 done: loss 0.1248 - lr 0.0001953
2020-06-19 20:23:43,522 DEV : loss 0.22277012467384338 - score 0.7591
2020-06-19 20:23:44,055 BAD EPOCHS (no improvement): 3
2020-06-19 20:23:44,055 ----------------------------------------------------------------------------------------------------
2020-06-19 20:24:03,086 epoch 61 - iter 92/921 - loss 0.11528240 - samples/sec: 154.79
2020-06-19 20:24:21,353 epoch 61 - iter 184/921 - loss 0.11056107 - samples/sec: 161.35
2020-06-19 20:24:39,339 epoch 61 - iter 276/921 - loss 0.12654190 - samples/sec: 163.88
2020-06-19 20:24:56,932 epoch 61 - iter 368/921 - loss 0.12778508 - samples/sec: 167.54
2020-06-19 20:25:14,575 epoch 61 - iter 460/921 - loss 0.13038907 - samples/sec: 167.07
2020-06-19 20:25:32,235 epoch 61 - iter 552/921 - loss 0.12686414 - samples/sec: 166.91
2020-06-19 20:25:49,952 epoch 61 - iter 644/921 - loss 0.12361360 - samples/sec: 166.36
2020-06-19 20:26:07,592 epoch 61 - iter 736/921 - loss 0.12337596 - samples/sec: 167.10
2020-06-19 20:26:26,911 epoch 61 - iter 828/921 - loss 0.12580740 - samples/sec: 152.56
2020-06-19 20:26:45,526 epoch 61 - iter 920/921 - loss 0.12599616 - samples/sec: 158.33
2020-06-19 20:26:45,694 ----------------------------------------------------------------------------------------------------
2020-06-19 20:26:45,694 EPOCH 61 done: loss 0.1259 - lr 0.0001953
2020-06-19 20:26:57,515 DEV : loss 0.22268053889274597 - score 0.7573
2020-06-19 20:26:58,021 BAD EPOCHS (no improvement): 4
2020-06-19 20:26:58,021 ----------------------------------------------------------------------------------------------------
2020-06-19 20:26:58,021 ----------------------------------------------------------------------------------------------------
2020-06-19 20:26:58,021 learning rate too small - quitting training!
2020-06-19 20:26:58,021 ----------------------------------------------------------------------------------------------------
2020-06-19 20:27:06,104 ----------------------------------------------------------------------------------------------------
2020-06-19 20:27:06,105 Testing using best model ...
2020-06-19 20:27:06,105 loading file /home/tmp/hunflair_small/cellline/best-model.pt
2020-06-19 20:27:51,092 0.9144	0.9033	0.9088
2020-06-19 20:27:51,092 
Results:
- F1-score (micro) 0.9088
- F1-score (macro) 0.9088

By class:
CellLine   tp: 1420 - fp: 133 - fn: 152 - precision: 0.9144 - recall: 0.9033 - f1-score: 0.9088
2020-06-19 20:27:51,092 ----------------------------------------------------------------------------------------------------
2020-06-19 20:27:51,092 ----------------------------------------------------------------------------------------------------
2020-06-19 20:27:56,143 ----------------------------------------------------------------------------------------------------
2020-06-19 20:27:56,541 ----------------------------------------------------------------------------------------------------
2020-06-19 20:28:15,028 ----------------------------------------------------------------------------------------------------