2020-06-19 16:52:36,331 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:36,332 Model: "SequenceTagger(
  (embeddings): StackedEmbeddings(
    (list_embedding_0): WordEmbeddings('pubmed_pmc_wiki_sg_1M.gensim')
    (list_embedding_1): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
    (list_embedding_2): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
  )
  (word_dropout): WordDropout(p=0.05)
  (locked_dropout): LockedDropout(p=0.5)
  (embedding2nn): Linear(in_features=4296, out_features=4296, bias=True)
  (rnn): LSTM(4296, 256, batch_first=True, bidirectional=True)
  (linear): Linear(in_features=512, out_features=8, bias=True)
  (beta): 1.0
  (weights): None
  (weight_tensor) None
)"
2020-06-19 16:52:36,332 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:36,332 Corpus: "Corpus: 13061 train + 1403 dev + 4481 test sentences
Corpus: 2252 train + 204 dev + 767 test sentences
Corpus: 6582 train + 726 dev + 2202 test sentences
Corpus: 3896 train + 455 dev + 1353 test sentences
Corpus: 5569 train + 586 dev + 1436 test sentences"
2020-06-19 16:52:36,332 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:36,332 Parameters:
2020-06-19 16:52:36,332  - learning_rate: "0.1"
2020-06-19 16:52:36,332  - mini_batch_size: "32"
2020-06-19 16:52:36,332  - patience: "3"
2020-06-19 16:52:36,332  - anneal_factor: "0.5"
2020-06-19 16:52:36,332  - max_epochs: "200"
2020-06-19 16:52:36,332  - shuffle: "True"
2020-06-19 16:52:36,332  - train_with_dev: "False"
2020-06-19 16:52:36,332  - batch_growth_annealing: "False"
2020-06-19 16:52:36,332 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:36,332 Model training base path: "/home/tmp/hunflair_small/disease"
2020-06-19 16:52:36,332 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:36,332 Device: cuda:0
2020-06-19 16:52:36,332 ----------------------------------------------------------------------------------------------------
2020-06-19 16:52:36,333 Embeddings storage mode: cpu
2020-06-19 16:52:36,333 ----------------------------------------------------------------------------------------------------
2020-06-19 16:53:09,403 epoch 1 - iter 98/980 - loss 4.85402163 - samples/sec: 94.86
2020-06-19 16:53:42,732 epoch 1 - iter 196/980 - loss 3.47943958 - samples/sec: 94.17
2020-06-19 16:54:17,709 epoch 1 - iter 294/980 - loss 2.89405330 - samples/sec: 89.72
2020-06-19 16:54:59,059 epoch 1 - iter 392/980 - loss 2.53984964 - samples/sec: 75.88
2020-06-19 16:55:35,650 epoch 1 - iter 490/980 - loss 2.33037475 - samples/sec: 85.76
2020-06-19 16:56:11,032 epoch 1 - iter 588/980 - loss 2.16656981 - samples/sec: 88.69
2020-06-19 16:56:46,687 epoch 1 - iter 686/980 - loss 2.04270266 - samples/sec: 88.01
2020-06-19 16:57:30,585 epoch 1 - iter 784/980 - loss 1.94092304 - samples/sec: 71.48
2020-06-19 16:58:09,492 epoch 1 - iter 882/980 - loss 1.85840646 - samples/sec: 80.66
2020-06-19 16:58:49,601 epoch 1 - iter 980/980 - loss 1.78932836 - samples/sec: 78.23
2020-06-19 16:58:49,616 ----------------------------------------------------------------------------------------------------
2020-06-19 16:58:49,616 EPOCH 1 done: loss 1.7893 - lr 0.1000000
2020-06-19 16:59:24,973 DEV : loss 0.8494623303413391 - score 0.7864
2020-06-19 16:59:25,413 BAD EPOCHS (no improvement): 0
2020-06-19 16:59:35,581 ----------------------------------------------------------------------------------------------------
2020-06-19 16:59:58,100 epoch 2 - iter 98/980 - loss 1.10040827 - samples/sec: 139.35
2020-06-19 17:00:18,839 epoch 2 - iter 196/980 - loss 1.08774135 - samples/sec: 151.39
2020-06-19 17:00:40,990 epoch 2 - iter 294/980 - loss 1.08252175 - samples/sec: 141.75
2020-06-19 17:01:03,488 epoch 2 - iter 392/980 - loss 1.06977831 - samples/sec: 139.57
2020-06-19 17:01:23,601 epoch 2 - iter 490/980 - loss 1.06572907 - samples/sec: 156.13
2020-06-19 17:01:43,146 epoch 2 - iter 588/980 - loss 1.05253779 - samples/sec: 160.65
2020-06-19 17:02:04,373 epoch 2 - iter 686/980 - loss 1.03782528 - samples/sec: 147.93
2020-06-19 17:02:23,856 epoch 2 - iter 784/980 - loss 1.03110306 - samples/sec: 161.20
2020-06-19 17:02:43,025 epoch 2 - iter 882/980 - loss 1.02627405 - samples/sec: 163.80
2020-06-19 17:03:05,720 epoch 2 - iter 980/980 - loss 1.01715957 - samples/sec: 138.33
2020-06-19 17:03:05,732 ----------------------------------------------------------------------------------------------------
2020-06-19 17:03:05,732 EPOCH 2 done: loss 1.0172 - lr 0.1000000
2020-06-19 17:03:20,889 DEV : loss 0.7931898236274719 - score 0.7908
2020-06-19 17:03:21,337 BAD EPOCHS (no improvement): 0
2020-06-19 17:03:30,380 ----------------------------------------------------------------------------------------------------
2020-06-19 17:03:49,723 epoch 3 - iter 98/980 - loss 0.90057886 - samples/sec: 162.23
2020-06-19 17:04:10,846 epoch 3 - iter 196/980 - loss 0.90837205 - samples/sec: 148.64
2020-06-19 17:04:30,114 epoch 3 - iter 294/980 - loss 0.89899225 - samples/sec: 162.96
2020-06-19 17:04:48,073 epoch 3 - iter 392/980 - loss 0.89711802 - samples/sec: 174.82
2020-06-19 17:05:06,494 epoch 3 - iter 490/980 - loss 0.90540910 - samples/sec: 170.45
2020-06-19 17:05:29,670 epoch 3 - iter 588/980 - loss 0.91317921 - samples/sec: 135.47
2020-06-19 17:05:51,525 epoch 3 - iter 686/980 - loss 0.90764413 - samples/sec: 143.66
2020-06-19 17:06:12,982 epoch 3 - iter 784/980 - loss 0.89839234 - samples/sec: 146.33
2020-06-19 17:06:32,724 epoch 3 - iter 882/980 - loss 0.90186338 - samples/sec: 159.04
2020-06-19 17:06:51,064 epoch 3 - iter 980/980 - loss 0.90072664 - samples/sec: 171.19
2020-06-19 17:06:51,076 ----------------------------------------------------------------------------------------------------
2020-06-19 17:06:51,076 EPOCH 3 done: loss 0.9007 - lr 0.1000000
2020-06-19 17:07:03,411 DEV : loss 0.7147209644317627 - score 0.8183
2020-06-19 17:07:03,863 BAD EPOCHS (no improvement): 0
2020-06-19 17:07:12,526 ----------------------------------------------------------------------------------------------------
2020-06-19 17:07:30,191 epoch 4 - iter 98/980 - loss 0.89952710 - samples/sec: 177.64
2020-06-19 17:07:47,713 epoch 4 - iter 196/980 - loss 0.82267775 - samples/sec: 179.19
2020-06-19 17:08:06,104 epoch 4 - iter 294/980 - loss 0.83652351 - samples/sec: 170.72
2020-06-19 17:08:25,536 epoch 4 - iter 392/980 - loss 0.83933622 - samples/sec: 161.57
2020-06-19 17:08:49,035 epoch 4 - iter 490/980 - loss 0.82865997 - samples/sec: 133.60
2020-06-19 17:09:10,212 epoch 4 - iter 588/980 - loss 0.82597062 - samples/sec: 148.28
2020-06-19 17:09:28,342 epoch 4 - iter 686/980 - loss 0.82824085 - samples/sec: 173.17
2020-06-19 17:09:46,702 epoch 4 - iter 784/980 - loss 0.83088771 - samples/sec: 171.02
2020-06-19 17:10:05,043 epoch 4 - iter 882/980 - loss 0.82781697 - samples/sec: 171.18
2020-06-19 17:10:23,936 epoch 4 - iter 980/980 - loss 0.83099537 - samples/sec: 166.21
2020-06-19 17:10:23,952 ----------------------------------------------------------------------------------------------------
2020-06-19 17:10:23,952 EPOCH 4 done: loss 0.8310 - lr 0.1000000
2020-06-19 17:10:36,212 DEV : loss 0.665212869644165 - score 0.824
2020-06-19 17:10:36,684 BAD EPOCHS (no improvement): 0
2020-06-19 17:10:46,380 ----------------------------------------------------------------------------------------------------
2020-06-19 17:11:07,926 epoch 5 - iter 98/980 - loss 0.74490044 - samples/sec: 145.64
2020-06-19 17:11:29,280 epoch 5 - iter 196/980 - loss 0.81199388 - samples/sec: 147.06
2020-06-19 17:11:47,793 epoch 5 - iter 294/980 - loss 0.79502570 - samples/sec: 169.59
2020-06-19 17:12:06,167 epoch 5 - iter 392/980 - loss 0.79453117 - samples/sec: 170.88
2020-06-19 17:12:25,252 epoch 5 - iter 490/980 - loss 0.79163629 - samples/sec: 164.50
2020-06-19 17:12:47,647 epoch 5 - iter 588/980 - loss 0.79006151 - samples/sec: 140.18
2020-06-19 17:13:07,649 epoch 5 - iter 686/980 - loss 0.78169188 - samples/sec: 156.97
2020-06-19 17:13:25,788 epoch 5 - iter 784/980 - loss 0.77771255 - samples/sec: 173.09
2020-06-19 17:13:43,515 epoch 5 - iter 882/980 - loss 0.78298054 - samples/sec: 177.12
2020-06-19 17:14:01,629 epoch 5 - iter 980/980 - loss 0.78388866 - samples/sec: 173.33
2020-06-19 17:14:01,641 ----------------------------------------------------------------------------------------------------
2020-06-19 17:14:01,641 EPOCH 5 done: loss 0.7839 - lr 0.1000000
2020-06-19 17:14:13,092 DEV : loss 0.6702693104743958 - score 0.8246
2020-06-19 17:14:13,536 BAD EPOCHS (no improvement): 0
2020-06-19 17:14:22,490 ----------------------------------------------------------------------------------------------------
2020-06-19 17:14:44,930 epoch 6 - iter 98/980 - loss 0.69136930 - samples/sec: 139.83
2020-06-19 17:15:05,693 epoch 6 - iter 196/980 - loss 0.71964145 - samples/sec: 151.21
2020-06-19 17:15:27,847 epoch 6 - iter 294/980 - loss 0.71969454 - samples/sec: 141.71
2020-06-19 17:15:46,210 epoch 6 - iter 392/980 - loss 0.73250635 - samples/sec: 170.99
2020-06-19 17:16:03,810 epoch 6 - iter 490/980 - loss 0.74371055 - samples/sec: 178.41
2020-06-19 17:16:21,532 epoch 6 - iter 588/980 - loss 0.75569454 - samples/sec: 177.16
2020-06-19 17:16:40,756 epoch 6 - iter 686/980 - loss 0.75991788 - samples/sec: 163.32
2020-06-19 17:17:01,791 epoch 6 - iter 784/980 - loss 0.76090918 - samples/sec: 149.25
2020-06-19 17:17:20,673 epoch 6 - iter 882/980 - loss 0.75740948 - samples/sec: 166.28
2020-06-19 17:17:39,502 epoch 6 - iter 980/980 - loss 0.75451552 - samples/sec: 166.75
2020-06-19 17:17:39,515 ----------------------------------------------------------------------------------------------------
2020-06-19 17:17:39,516 EPOCH 6 done: loss 0.7545 - lr 0.1000000
2020-06-19 17:17:54,929 DEV : loss 0.6628915667533875 - score 0.8311
2020-06-19 17:17:55,381 BAD EPOCHS (no improvement): 0
2020-06-19 17:18:03,995 ----------------------------------------------------------------------------------------------------
2020-06-19 17:18:25,949 epoch 7 - iter 98/980 - loss 0.73223723 - samples/sec: 142.94
2020-06-19 17:18:46,738 epoch 7 - iter 196/980 - loss 0.72662016 - samples/sec: 151.02
2020-06-19 17:19:07,285 epoch 7 - iter 294/980 - loss 0.71423311 - samples/sec: 152.82
2020-06-19 17:19:27,374 epoch 7 - iter 392/980 - loss 0.71216075 - samples/sec: 156.28
2020-06-19 17:19:46,193 epoch 7 - iter 490/980 - loss 0.70515048 - samples/sec: 166.83
2020-06-19 17:20:04,088 epoch 7 - iter 588/980 - loss 0.71030300 - samples/sec: 175.46
2020-06-19 17:20:25,928 epoch 7 - iter 686/980 - loss 0.71866722 - samples/sec: 143.77
2020-06-19 17:20:46,623 epoch 7 - iter 784/980 - loss 0.71766181 - samples/sec: 151.73
2020-06-19 17:21:05,723 epoch 7 - iter 882/980 - loss 0.71926912 - samples/sec: 164.38
2020-06-19 17:21:23,224 epoch 7 - iter 980/980 - loss 0.72154610 - samples/sec: 179.41
2020-06-19 17:21:23,237 ----------------------------------------------------------------------------------------------------
2020-06-19 17:21:23,237 EPOCH 7 done: loss 0.7215 - lr 0.1000000
2020-06-19 17:21:34,624 DEV : loss 0.6674202084541321 - score 0.8187
2020-06-19 17:21:35,076 BAD EPOCHS (no improvement): 1
2020-06-19 17:21:35,076 ----------------------------------------------------------------------------------------------------
2020-06-19 17:21:53,015 epoch 8 - iter 98/980 - loss 0.68249413 - samples/sec: 174.93
2020-06-19 17:22:12,442 epoch 8 - iter 196/980 - loss 0.69119560 - samples/sec: 161.60
2020-06-19 17:22:30,345 epoch 8 - iter 294/980 - loss 0.69147154 - samples/sec: 175.38
2020-06-19 17:22:48,606 epoch 8 - iter 392/980 - loss 0.67696906 - samples/sec: 171.94
2020-06-19 17:23:09,964 epoch 8 - iter 490/980 - loss 0.68326533 - samples/sec: 147.00
2020-06-19 17:23:31,180 epoch 8 - iter 588/980 - loss 0.68115563 - samples/sec: 147.98
2020-06-19 17:23:51,062 epoch 8 - iter 686/980 - loss 0.68335511 - samples/sec: 157.92
2020-06-19 17:24:09,266 epoch 8 - iter 784/980 - loss 0.68478890 - samples/sec: 172.47
2020-06-19 17:24:27,644 epoch 8 - iter 882/980 - loss 0.68968071 - samples/sec: 170.85
2020-06-19 17:24:45,647 epoch 8 - iter 980/980 - loss 0.69426386 - samples/sec: 174.40
2020-06-19 17:24:45,660 ----------------------------------------------------------------------------------------------------
2020-06-19 17:24:45,660 EPOCH 8 done: loss 0.6943 - lr 0.1000000
2020-06-19 17:24:57,328 DEV : loss 0.619840145111084 - score 0.8387
2020-06-19 17:24:57,897 BAD EPOCHS (no improvement): 0
2020-06-19 17:25:08,243 ----------------------------------------------------------------------------------------------------
2020-06-19 17:25:29,451 epoch 9 - iter 98/980 - loss 0.67542216 - samples/sec: 147.97
2020-06-19 17:25:50,643 epoch 9 - iter 196/980 - loss 0.65606194 - samples/sec: 148.15
2020-06-19 17:26:09,897 epoch 9 - iter 294/980 - loss 0.65743101 - samples/sec: 163.07
2020-06-19 17:26:29,904 epoch 9 - iter 392/980 - loss 0.65869422 - samples/sec: 156.93
2020-06-19 17:26:55,835 epoch 9 - iter 490/980 - loss 0.66084249 - samples/sec: 121.07
2020-06-19 17:27:19,234 epoch 9 - iter 588/980 - loss 0.66851511 - samples/sec: 134.18
2020-06-19 17:27:42,619 epoch 9 - iter 686/980 - loss 0.67232197 - samples/sec: 134.25
2020-06-19 17:28:02,831 epoch 9 - iter 784/980 - loss 0.67353691 - samples/sec: 155.36
2020-06-19 17:28:21,715 epoch 9 - iter 882/980 - loss 0.66967092 - samples/sec: 166.27
2020-06-19 17:28:41,034 epoch 9 - iter 980/980 - loss 0.67076497 - samples/sec: 162.52
2020-06-19 17:28:41,049 ----------------------------------------------------------------------------------------------------
2020-06-19 17:28:41,049 EPOCH 9 done: loss 0.6708 - lr 0.1000000
2020-06-19 17:28:54,757 DEV : loss 0.6268985867500305 - score 0.8359
2020-06-19 17:28:55,317 BAD EPOCHS (no improvement): 1
2020-06-19 17:28:55,321 ----------------------------------------------------------------------------------------------------
2020-06-19 17:29:14,251 epoch 10 - iter 98/980 - loss 0.65824882 - samples/sec: 165.76
2020-06-19 17:29:34,048 epoch 10 - iter 196/980 - loss 0.62524112 - samples/sec: 158.58
2020-06-19 17:29:55,058 epoch 10 - iter 294/980 - loss 0.64547610 - samples/sec: 149.42
2020-06-19 17:30:13,240 epoch 10 - iter 392/980 - loss 0.64269041 - samples/sec: 172.68
2020-06-19 17:30:32,518 epoch 10 - iter 490/980 - loss 0.64305929 - samples/sec: 162.86
2020-06-19 17:30:49,841 epoch 10 - iter 588/980 - loss 0.64334058 - samples/sec: 181.25
2020-06-19 17:31:07,956 epoch 10 - iter 686/980 - loss 0.64700383 - samples/sec: 173.33
2020-06-19 17:31:28,534 epoch 10 - iter 784/980 - loss 0.64582828 - samples/sec: 152.58
2020-06-19 17:31:47,393 epoch 10 - iter 882/980 - loss 0.64433706 - samples/sec: 166.48
2020-06-19 17:32:05,618 epoch 10 - iter 980/980 - loss 0.64709726 - samples/sec: 172.28
2020-06-19 17:32:05,630 ----------------------------------------------------------------------------------------------------
2020-06-19 17:32:05,630 EPOCH 10 done: loss 0.6471 - lr 0.1000000
2020-06-19 17:32:23,169 DEV : loss 0.6108165383338928 - score 0.8355
2020-06-19 17:32:23,620 BAD EPOCHS (no improvement): 2
2020-06-19 17:32:23,624 ----------------------------------------------------------------------------------------------------
2020-06-19 17:32:42,136 epoch 11 - iter 98/980 - loss 0.57557384 - samples/sec: 169.86
2020-06-19 17:33:01,420 epoch 11 - iter 196/980 - loss 0.61551832 - samples/sec: 162.80
2020-06-19 17:33:20,321 epoch 11 - iter 294/980 - loss 0.62690915 - samples/sec: 166.12
2020-06-19 17:33:37,930 epoch 11 - iter 392/980 - loss 0.62770694 - samples/sec: 178.31
2020-06-19 17:33:56,625 epoch 11 - iter 490/980 - loss 0.63499679 - samples/sec: 167.94
2020-06-19 17:34:14,997 epoch 11 - iter 588/980 - loss 0.63114542 - samples/sec: 170.89
2020-06-19 17:34:32,918 epoch 11 - iter 686/980 - loss 0.63560897 - samples/sec: 175.20
2020-06-19 17:34:50,736 epoch 11 - iter 784/980 - loss 0.63348174 - samples/sec: 176.21
2020-06-19 17:35:09,189 epoch 11 - iter 882/980 - loss 0.63621548 - samples/sec: 170.15
2020-06-19 17:35:27,067 epoch 11 - iter 980/980 - loss 0.63340559 - samples/sec: 175.62
2020-06-19 17:35:27,080 ----------------------------------------------------------------------------------------------------
2020-06-19 17:35:27,080 EPOCH 11 done: loss 0.6334 - lr 0.1000000
2020-06-19 17:35:38,479 DEV : loss 0.6108089685440063 - score 0.8427
2020-06-19 17:35:38,928 BAD EPOCHS (no improvement): 0
2020-06-19 17:35:46,853 ----------------------------------------------------------------------------------------------------
2020-06-19 17:36:05,368 epoch 12 - iter 98/980 - loss 0.59180598 - samples/sec: 169.48
2020-06-19 17:36:22,952 epoch 12 - iter 196/980 - loss 0.61781128 - samples/sec: 178.56
2020-06-19 17:36:41,625 epoch 12 - iter 294/980 - loss 0.59955667 - samples/sec: 168.14
2020-06-19 17:36:59,439 epoch 12 - iter 392/980 - loss 0.59987434 - samples/sec: 176.27
2020-06-19 17:37:17,380 epoch 12 - iter 490/980 - loss 0.59422643 - samples/sec: 175.02
2020-06-19 17:37:36,501 epoch 12 - iter 588/980 - loss 0.59189801 - samples/sec: 164.22
2020-06-19 17:37:57,797 epoch 12 - iter 686/980 - loss 0.59999427 - samples/sec: 147.45
2020-06-19 17:38:16,830 epoch 12 - iter 784/980 - loss 0.60195712 - samples/sec: 164.96
2020-06-19 17:38:37,181 epoch 12 - iter 882/980 - loss 0.60626788 - samples/sec: 154.27
2020-06-19 17:38:57,096 epoch 12 - iter 980/980 - loss 0.61178579 - samples/sec: 157.66
2020-06-19 17:38:57,110 ----------------------------------------------------------------------------------------------------
2020-06-19 17:38:57,110 EPOCH 12 done: loss 0.6118 - lr 0.1000000
2020-06-19 17:39:11,693 DEV : loss 0.6215203404426575 - score 0.8396
2020-06-19 17:39:12,258 BAD EPOCHS (no improvement): 1
2020-06-19 17:39:12,258 ----------------------------------------------------------------------------------------------------
2020-06-19 17:39:32,303 epoch 13 - iter 98/980 - loss 0.62172741 - samples/sec: 156.56
2020-06-19 17:39:52,936 epoch 13 - iter 196/980 - loss 0.61923781 - samples/sec: 152.18
2020-06-19 17:40:11,198 epoch 13 - iter 294/980 - loss 0.60675545 - samples/sec: 171.93
2020-06-19 17:40:31,527 epoch 13 - iter 392/980 - loss 0.60045953 - samples/sec: 154.43
2020-06-19 17:40:53,726 epoch 13 - iter 490/980 - loss 0.60228118 - samples/sec: 141.45
2020-06-19 17:41:18,409 epoch 13 - iter 588/980 - loss 0.60135491 - samples/sec: 127.21
2020-06-19 17:41:39,460 epoch 13 - iter 686/980 - loss 0.59879277 - samples/sec: 149.13
2020-06-19 17:41:58,339 epoch 13 - iter 784/980 - loss 0.59764959 - samples/sec: 166.30
2020-06-19 17:42:15,884 epoch 13 - iter 882/980 - loss 0.59885089 - samples/sec: 178.96
2020-06-19 17:42:33,271 epoch 13 - iter 980/980 - loss 0.60291909 - samples/sec: 180.59
2020-06-19 17:42:33,283 ----------------------------------------------------------------------------------------------------
2020-06-19 17:42:33,284 EPOCH 13 done: loss 0.6029 - lr 0.1000000
2020-06-19 17:42:46,623 DEV : loss 0.611540675163269 - score 0.8385
2020-06-19 17:42:47,265 BAD EPOCHS (no improvement): 2
2020-06-19 17:42:47,265 ----------------------------------------------------------------------------------------------------
2020-06-19 17:43:10,071 epoch 14 - iter 98/980 - loss 0.55953746 - samples/sec: 137.59
2020-06-19 17:43:28,320 epoch 14 - iter 196/980 - loss 0.58186775 - samples/sec: 172.06
2020-06-19 17:43:46,040 epoch 14 - iter 294/980 - loss 0.58236057 - samples/sec: 177.18
2020-06-19 17:44:03,824 epoch 14 - iter 392/980 - loss 0.57824516 - samples/sec: 176.56
2020-06-19 17:44:22,038 epoch 14 - iter 490/980 - loss 0.58640585 - samples/sec: 172.38
2020-06-19 17:44:39,731 epoch 14 - iter 588/980 - loss 0.59248933 - samples/sec: 177.46
2020-06-19 17:44:57,011 epoch 14 - iter 686/980 - loss 0.59319344 - samples/sec: 181.71
2020-06-19 17:45:16,093 epoch 14 - iter 784/980 - loss 0.59323429 - samples/sec: 164.53
2020-06-19 17:45:34,333 epoch 14 - iter 882/980 - loss 0.59481023 - samples/sec: 172.13
2020-06-19 17:45:52,310 epoch 14 - iter 980/980 - loss 0.59340202 - samples/sec: 174.66
2020-06-19 17:45:52,322 ----------------------------------------------------------------------------------------------------
2020-06-19 17:45:52,322 EPOCH 14 done: loss 0.5934 - lr 0.1000000
2020-06-19 17:46:08,937 DEV : loss 0.6517409086227417 - score 0.8324
2020-06-19 17:46:09,401 BAD EPOCHS (no improvement): 3
2020-06-19 17:46:09,402 ----------------------------------------------------------------------------------------------------
2020-06-19 17:46:29,326 epoch 15 - iter 98/980 - loss 0.59120454 - samples/sec: 157.50
2020-06-19 17:46:47,459 epoch 15 - iter 196/980 - loss 0.57752586 - samples/sec: 173.15
2020-06-19 17:47:05,537 epoch 15 - iter 294/980 - loss 0.57843063 - samples/sec: 173.70
2020-06-19 17:47:24,761 epoch 15 - iter 392/980 - loss 0.57592023 - samples/sec: 163.34
2020-06-19 17:47:43,868 epoch 15 - iter 490/980 - loss 0.57889817 - samples/sec: 164.35
2020-06-19 17:48:02,691 epoch 15 - iter 588/980 - loss 0.57694461 - samples/sec: 166.81
2020-06-19 17:48:22,558 epoch 15 - iter 686/980 - loss 0.57510078 - samples/sec: 158.03
2020-06-19 17:48:41,171 epoch 15 - iter 784/980 - loss 0.57743764 - samples/sec: 168.72
2020-06-19 17:48:58,967 epoch 15 - iter 882/980 - loss 0.57745329 - samples/sec: 176.45
2020-06-19 17:49:18,287 epoch 15 - iter 980/980 - loss 0.57460242 - samples/sec: 162.52
2020-06-19 17:49:18,302 ----------------------------------------------------------------------------------------------------
2020-06-19 17:49:18,302 EPOCH 15 done: loss 0.5746 - lr 0.1000000
2020-06-19 17:49:32,225 DEV : loss 0.5903776288032532 - score 0.8459
2020-06-19 17:49:32,870 BAD EPOCHS (no improvement): 0
2020-06-19 17:49:42,462 ----------------------------------------------------------------------------------------------------
2020-06-19 17:50:04,196 epoch 16 - iter 98/980 - loss 0.58475786 - samples/sec: 144.38
2020-06-19 17:50:22,098 epoch 16 - iter 196/980 - loss 0.56878103 - samples/sec: 175.40
2020-06-19 17:50:40,122 epoch 16 - iter 294/980 - loss 0.55858228 - samples/sec: 174.19
2020-06-19 17:51:01,512 epoch 16 - iter 392/980 - loss 0.56134059 - samples/sec: 146.78
2020-06-19 17:51:22,243 epoch 16 - iter 490/980 - loss 0.55444844 - samples/sec: 151.47
2020-06-19 17:51:40,633 epoch 16 - iter 588/980 - loss 0.56002589 - samples/sec: 170.74
2020-06-19 17:51:59,710 epoch 16 - iter 686/980 - loss 0.56470101 - samples/sec: 164.59
2020-06-19 17:52:17,330 epoch 16 - iter 784/980 - loss 0.56433750 - samples/sec: 178.22
2020-06-19 17:52:35,451 epoch 16 - iter 882/980 - loss 0.56466679 - samples/sec: 173.28
2020-06-19 17:52:54,951 epoch 16 - iter 980/980 - loss 0.56611918 - samples/sec: 161.01
2020-06-19 17:52:54,963 ----------------------------------------------------------------------------------------------------
2020-06-19 17:52:54,963 EPOCH 16 done: loss 0.5661 - lr 0.1000000
2020-06-19 17:53:06,138 DEV : loss 0.5947380065917969 - score 0.8445
2020-06-19 17:53:06,587 BAD EPOCHS (no improvement): 1
2020-06-19 17:53:06,588 ----------------------------------------------------------------------------------------------------
2020-06-19 17:53:26,605 epoch 17 - iter 98/980 - loss 0.55690183 - samples/sec: 156.76
2020-06-19 17:53:46,720 epoch 17 - iter 196/980 - loss 0.53342631 - samples/sec: 156.09
2020-06-19 17:54:06,154 epoch 17 - iter 294/980 - loss 0.53884224 - samples/sec: 161.57
2020-06-19 17:54:25,029 epoch 17 - iter 392/980 - loss 0.54113907 - samples/sec: 166.38
2020-06-19 17:54:45,606 epoch 17 - iter 490/980 - loss 0.54472886 - samples/sec: 152.58
2020-06-19 17:55:04,038 epoch 17 - iter 588/980 - loss 0.55027498 - samples/sec: 170.37
2020-06-19 17:55:22,273 epoch 17 - iter 686/980 - loss 0.54897318 - samples/sec: 172.20
2020-06-19 17:55:39,839 epoch 17 - iter 784/980 - loss 0.54999677 - samples/sec: 178.76
2020-06-19 17:55:58,000 epoch 17 - iter 882/980 - loss 0.55224720 - samples/sec: 172.90
2020-06-19 17:56:16,138 epoch 17 - iter 980/980 - loss 0.55398013 - samples/sec: 173.12
2020-06-19 17:56:16,150 ----------------------------------------------------------------------------------------------------
2020-06-19 17:56:16,150 EPOCH 17 done: loss 0.5540 - lr 0.1000000
2020-06-19 17:56:27,541 DEV : loss 0.6291642785072327 - score 0.8431
2020-06-19 17:56:28,005 BAD EPOCHS (no improvement): 2
2020-06-19 17:56:28,005 ----------------------------------------------------------------------------------------------------
2020-06-19 17:56:46,812 epoch 18 - iter 98/980 - loss 0.52512583 - samples/sec: 166.87
2020-06-19 17:57:04,213 epoch 18 - iter 196/980 - loss 0.52433972 - samples/sec: 180.46
2020-06-19 17:57:23,575 epoch 18 - iter 294/980 - loss 0.52554310 - samples/sec: 162.16
2020-06-19 17:57:41,604 epoch 18 - iter 392/980 - loss 0.52512215 - samples/sec: 174.16
2020-06-19 17:58:00,867 epoch 18 - iter 490/980 - loss 0.52588426 - samples/sec: 162.98
2020-06-19 17:58:18,718 epoch 18 - iter 588/980 - loss 0.53236238 - samples/sec: 175.89
2020-06-19 17:58:36,893 epoch 18 - iter 686/980 - loss 0.53099759 - samples/sec: 172.75
2020-06-19 17:58:55,395 epoch 18 - iter 784/980 - loss 0.52966758 - samples/sec: 169.70
2020-06-19 17:59:14,918 epoch 18 - iter 882/980 - loss 0.53056681 - samples/sec: 160.80
2020-06-19 17:59:32,063 epoch 18 - iter 980/980 - loss 0.53243091 - samples/sec: 183.13
2020-06-19 17:59:32,075 ----------------------------------------------------------------------------------------------------
2020-06-19 17:59:32,076 EPOCH 18 done: loss 0.5324 - lr 0.1000000
2020-06-19 17:59:49,936 DEV : loss 0.6066592931747437 - score 0.8439
2020-06-19 17:59:50,596 BAD EPOCHS (no improvement): 3
2020-06-19 17:59:50,596 ----------------------------------------------------------------------------------------------------
2020-06-19 18:00:10,256 epoch 19 - iter 98/980 - loss 0.53732400 - samples/sec: 159.62
2020-06-19 18:00:27,717 epoch 19 - iter 196/980 - loss 0.51431935 - samples/sec: 179.85
2020-06-19 18:00:44,906 epoch 19 - iter 294/980 - loss 0.51351383 - samples/sec: 182.69
2020-06-19 18:01:03,638 epoch 19 - iter 392/980 - loss 0.51210223 - samples/sec: 167.62
2020-06-19 18:01:22,990 epoch 19 - iter 490/980 - loss 0.52162102 - samples/sec: 162.25
2020-06-19 18:01:41,245 epoch 19 - iter 588/980 - loss 0.52485628 - samples/sec: 172.01
2020-06-19 18:01:59,645 epoch 19 - iter 686/980 - loss 0.53045909 - samples/sec: 170.64
2020-06-19 18:02:19,018 epoch 19 - iter 784/980 - loss 0.53490950 - samples/sec: 162.07
2020-06-19 18:02:37,547 epoch 19 - iter 882/980 - loss 0.52990330 - samples/sec: 169.46
2020-06-19 18:03:00,299 epoch 19 - iter 980/980 - loss 0.52671602 - samples/sec: 137.99
2020-06-19 18:03:00,313 ----------------------------------------------------------------------------------------------------
2020-06-19 18:03:00,313 EPOCH 19 done: loss 0.5267 - lr 0.1000000
2020-06-19 18:03:14,152 DEV : loss 0.6183522939682007 - score 0.8405
2020-06-19 18:03:14,799 BAD EPOCHS (no improvement): 4
2020-06-19 18:03:14,799 ----------------------------------------------------------------------------------------------------
2020-06-19 18:03:35,272 epoch 20 - iter 98/980 - loss 0.53202376 - samples/sec: 153.28
2020-06-19 18:03:54,904 epoch 20 - iter 196/980 - loss 0.51838784 - samples/sec: 159.95
2020-06-19 18:04:12,942 epoch 20 - iter 294/980 - loss 0.50449383 - samples/sec: 174.08
2020-06-19 18:04:31,417 epoch 20 - iter 392/980 - loss 0.50447343 - samples/sec: 169.96
2020-06-19 18:04:51,246 epoch 20 - iter 490/980 - loss 0.49606680 - samples/sec: 158.34
2020-06-19 18:05:09,100 epoch 20 - iter 588/980 - loss 0.49712761 - samples/sec: 175.89
2020-06-19 18:05:27,950 epoch 20 - iter 686/980 - loss 0.49920766 - samples/sec: 166.57
2020-06-19 18:05:46,685 epoch 20 - iter 784/980 - loss 0.49903423 - samples/sec: 167.60
2020-06-19 18:06:03,910 epoch 20 - iter 882/980 - loss 0.49334830 - samples/sec: 182.30
2020-06-19 18:06:21,923 epoch 20 - iter 980/980 - loss 0.49445825 - samples/sec: 174.32
2020-06-19 18:06:21,935 ----------------------------------------------------------------------------------------------------
2020-06-19 18:06:21,935 EPOCH 20 done: loss 0.4945 - lr 0.0500000
2020-06-19 18:06:32,901 DEV : loss 0.6006750464439392 - score 0.8431
2020-06-19 18:06:33,369 BAD EPOCHS (no improvement): 1
2020-06-19 18:06:33,370 ----------------------------------------------------------------------------------------------------
2020-06-19 18:06:52,002 epoch 21 - iter 98/980 - loss 0.48985607 - samples/sec: 168.43
2020-06-19 18:07:09,341 epoch 21 - iter 196/980 - loss 0.47144939 - samples/sec: 181.11
2020-06-19 18:07:27,004 epoch 21 - iter 294/980 - loss 0.47681606 - samples/sec: 177.78
2020-06-19 18:07:45,060 epoch 21 - iter 392/980 - loss 0.48302520 - samples/sec: 173.90
2020-06-19 18:08:06,840 epoch 21 - iter 490/980 - loss 0.48648248 - samples/sec: 144.15
2020-06-19 18:08:29,597 epoch 21 - iter 588/980 - loss 0.48343759 - samples/sec: 137.96
2020-06-19 18:08:50,595 epoch 21 - iter 686/980 - loss 0.48200263 - samples/sec: 149.53
2020-06-19 18:09:11,540 epoch 21 - iter 784/980 - loss 0.47999927 - samples/sec: 149.92
2020-06-19 18:09:30,052 epoch 21 - iter 882/980 - loss 0.47950727 - samples/sec: 169.60
2020-06-19 18:09:49,102 epoch 21 - iter 980/980 - loss 0.47923580 - samples/sec: 164.80
2020-06-19 18:09:49,115 ----------------------------------------------------------------------------------------------------
2020-06-19 18:09:49,115 EPOCH 21 done: loss 0.4792 - lr 0.0500000
2020-06-19 18:10:00,395 DEV : loss 0.590452253818512 - score 0.8452
2020-06-19 18:10:00,844 BAD EPOCHS (no improvement): 2
2020-06-19 18:10:00,844 ----------------------------------------------------------------------------------------------------
2020-06-19 18:10:19,088 epoch 22 - iter 98/980 - loss 0.43620792 - samples/sec: 172.00
2020-06-19 18:10:37,290 epoch 22 - iter 196/980 - loss 0.44256415 - samples/sec: 172.49
2020-06-19 18:10:54,693 epoch 22 - iter 294/980 - loss 0.45277556 - samples/sec: 180.43
2020-06-19 18:11:13,443 epoch 22 - iter 392/980 - loss 0.46538196 - samples/sec: 167.44
2020-06-19 18:11:32,914 epoch 22 - iter 490/980 - loss 0.48063076 - samples/sec: 161.23
2020-06-19 18:11:51,587 epoch 22 - iter 588/980 - loss 0.47798353 - samples/sec: 168.14
2020-06-19 18:12:09,451 epoch 22 - iter 686/980 - loss 0.47607378 - samples/sec: 175.76
2020-06-19 18:12:27,452 epoch 22 - iter 784/980 - loss 0.47973433 - samples/sec: 174.43
2020-06-19 18:12:45,898 epoch 22 - iter 882/980 - loss 0.47842914 - samples/sec: 170.22
2020-06-19 18:13:08,016 epoch 22 - iter 980/980 - loss 0.47223805 - samples/sec: 141.95
2020-06-19 18:13:08,028 ----------------------------------------------------------------------------------------------------
2020-06-19 18:13:08,028 EPOCH 22 done: loss 0.4722 - lr 0.0500000
2020-06-19 18:13:25,029 DEV : loss 0.612695038318634 - score 0.8452
2020-06-19 18:13:25,682 BAD EPOCHS (no improvement): 3
2020-06-19 18:13:25,682 ----------------------------------------------------------------------------------------------------
2020-06-19 18:13:45,618 epoch 23 - iter 98/980 - loss 0.45737486 - samples/sec: 157.41
2020-06-19 18:14:03,629 epoch 23 - iter 196/980 - loss 0.43506259 - samples/sec: 174.35
2020-06-19 18:14:22,097 epoch 23 - iter 294/980 - loss 0.44414659 - samples/sec: 170.01
2020-06-19 18:14:40,269 epoch 23 - iter 392/980 - loss 0.44421590 - samples/sec: 172.77
2020-06-19 18:14:58,548 epoch 23 - iter 490/980 - loss 0.44599432 - samples/sec: 171.76
2020-06-19 18:15:16,659 epoch 23 - iter 588/980 - loss 0.44677749 - samples/sec: 173.37
2020-06-19 18:15:35,650 epoch 23 - iter 686/980 - loss 0.45479411 - samples/sec: 165.32
2020-06-19 18:15:53,128 epoch 23 - iter 784/980 - loss 0.45440092 - samples/sec: 179.65
2020-06-19 18:16:11,256 epoch 23 - iter 882/980 - loss 0.45387673 - samples/sec: 173.20
2020-06-19 18:16:29,890 epoch 23 - iter 980/980 - loss 0.45604011 - samples/sec: 168.49
2020-06-19 18:16:29,902 ----------------------------------------------------------------------------------------------------
2020-06-19 18:16:29,902 EPOCH 23 done: loss 0.4560 - lr 0.0500000
2020-06-19 18:16:41,152 DEV : loss 0.5917348265647888 - score 0.843
2020-06-19 18:16:41,602 BAD EPOCHS (no improvement): 4
2020-06-19 18:16:41,602 ----------------------------------------------------------------------------------------------------
2020-06-19 18:16:59,948 epoch 24 - iter 98/980 - loss 0.43667784 - samples/sec: 171.04
2020-06-19 18:17:17,798 epoch 24 - iter 196/980 - loss 0.43494530 - samples/sec: 175.90
2020-06-19 18:17:36,120 epoch 24 - iter 294/980 - loss 0.43621033 - samples/sec: 171.36
2020-06-19 18:17:55,469 epoch 24 - iter 392/980 - loss 0.44143211 - samples/sec: 162.27
2020-06-19 18:18:15,380 epoch 24 - iter 490/980 - loss 0.43685866 - samples/sec: 157.68
2020-06-19 18:18:33,640 epoch 24 - iter 588/980 - loss 0.44133227 - samples/sec: 171.94
2020-06-19 18:18:51,333 epoch 24 - iter 686/980 - loss 0.44078459 - samples/sec: 177.46
2020-06-19 18:19:09,850 epoch 24 - iter 784/980 - loss 0.43723768 - samples/sec: 169.56
2020-06-19 18:19:27,055 epoch 24 - iter 882/980 - loss 0.43240895 - samples/sec: 182.50
2020-06-19 18:19:45,715 epoch 24 - iter 980/980 - loss 0.43472033 - samples/sec: 168.26
2020-06-19 18:19:45,729 ----------------------------------------------------------------------------------------------------
2020-06-19 18:19:45,729 EPOCH 24 done: loss 0.4347 - lr 0.0250000
2020-06-19 18:19:58,815 DEV : loss 0.5943197011947632 - score 0.8479
2020-06-19 18:19:59,277 BAD EPOCHS (no improvement): 0
2020-06-19 18:20:07,814 ----------------------------------------------------------------------------------------------------
2020-06-19 18:20:25,752 epoch 25 - iter 98/980 - loss 0.42632081 - samples/sec: 174.96
2020-06-19 18:20:46,094 epoch 25 - iter 196/980 - loss 0.44114631 - samples/sec: 154.34
2020-06-19 18:21:05,113 epoch 25 - iter 294/980 - loss 0.43168023 - samples/sec: 165.11
2020-06-19 18:21:23,112 epoch 25 - iter 392/980 - loss 0.42798526 - samples/sec: 174.46
2020-06-19 18:21:41,487 epoch 25 - iter 490/980 - loss 0.42847718 - samples/sec: 170.89
2020-06-19 18:21:59,989 epoch 25 - iter 588/980 - loss 0.42778944 - samples/sec: 169.71
2020-06-19 18:22:21,651 epoch 25 - iter 686/980 - loss 0.42931619 - samples/sec: 144.93
2020-06-19 18:22:44,437 epoch 25 - iter 784/980 - loss 0.42482252 - samples/sec: 137.78
2020-06-19 18:23:03,980 epoch 25 - iter 882/980 - loss 0.42657321 - samples/sec: 160.68
2020-06-19 18:23:21,717 epoch 25 - iter 980/980 - loss 0.42848649 - samples/sec: 177.04
2020-06-19 18:23:21,729 ----------------------------------------------------------------------------------------------------
2020-06-19 18:23:21,729 EPOCH 25 done: loss 0.4285 - lr 0.0250000
2020-06-19 18:23:32,842 DEV : loss 0.5973049402236938 - score 0.8485
2020-06-19 18:23:33,309 BAD EPOCHS (no improvement): 0
2020-06-19 18:23:42,634 ----------------------------------------------------------------------------------------------------
2020-06-19 18:24:00,017 epoch 26 - iter 98/980 - loss 0.42021988 - samples/sec: 180.54
2020-06-19 18:24:20,339 epoch 26 - iter 196/980 - loss 0.40761940 - samples/sec: 154.51
2020-06-19 18:24:39,879 epoch 26 - iter 294/980 - loss 0.41164139 - samples/sec: 160.68
2020-06-19 18:25:02,174 epoch 26 - iter 392/980 - loss 0.40995754 - samples/sec: 140.83
2020-06-19 18:25:23,526 epoch 26 - iter 490/980 - loss 0.41494179 - samples/sec: 147.05
2020-06-19 18:25:42,035 epoch 26 - iter 588/980 - loss 0.41861290 - samples/sec: 169.64
2020-06-19 18:26:00,093 epoch 26 - iter 686/980 - loss 0.42386190 - samples/sec: 173.89
2020-06-19 18:26:17,485 epoch 26 - iter 784/980 - loss 0.42520018 - samples/sec: 180.56
2020-06-19 18:26:36,113 epoch 26 - iter 882/980 - loss 0.42756787 - samples/sec: 168.56
2020-06-19 18:26:55,593 epoch 26 - iter 980/980 - loss 0.42757743 - samples/sec: 161.18
2020-06-19 18:26:55,605 ----------------------------------------------------------------------------------------------------
2020-06-19 18:26:55,605 EPOCH 26 done: loss 0.4276 - lr 0.0250000
2020-06-19 18:27:12,487 DEV : loss 0.5971735715866089 - score 0.8502
2020-06-19 18:27:13,022 BAD EPOCHS (no improvement): 0
2020-06-19 18:27:22,514 ----------------------------------------------------------------------------------------------------
2020-06-19 18:27:42,450 epoch 27 - iter 98/980 - loss 0.43779829 - samples/sec: 157.41
2020-06-19 18:28:00,300 epoch 27 - iter 196/980 - loss 0.42696519 - samples/sec: 175.92
2020-06-19 18:28:18,211 epoch 27 - iter 294/980 - loss 0.42896822 - samples/sec: 175.32
2020-06-19 18:28:36,803 epoch 27 - iter 392/980 - loss 0.42536826 - samples/sec: 168.88
2020-06-19 18:28:58,720 epoch 27 - iter 490/980 - loss 0.42504762 - samples/sec: 143.24
2020-06-19 18:29:18,628 epoch 27 - iter 588/980 - loss 0.42464378 - samples/sec: 157.72
2020-06-19 18:29:38,550 epoch 27 - iter 686/980 - loss 0.42432461 - samples/sec: 157.60
2020-06-19 18:29:56,832 epoch 27 - iter 784/980 - loss 0.42349826 - samples/sec: 171.75
2020-06-19 18:30:16,128 epoch 27 - iter 882/980 - loss 0.42275029 - samples/sec: 162.72
2020-06-19 18:30:37,826 epoch 27 - iter 980/980 - loss 0.42240614 - samples/sec: 144.70
2020-06-19 18:30:37,839 ----------------------------------------------------------------------------------------------------
2020-06-19 18:30:37,839 EPOCH 27 done: loss 0.4224 - lr 0.0250000
2020-06-19 18:30:49,086 DEV : loss 0.6047316789627075 - score 0.8485
2020-06-19 18:30:49,539 BAD EPOCHS (no improvement): 1
2020-06-19 18:30:49,539 ----------------------------------------------------------------------------------------------------
2020-06-19 18:31:07,170 epoch 28 - iter 98/980 - loss 0.39843593 - samples/sec: 177.99
2020-06-19 18:31:25,183 epoch 28 - iter 196/980 - loss 0.40736368 - samples/sec: 174.31
2020-06-19 18:31:43,034 epoch 28 - iter 294/980 - loss 0.41653252 - samples/sec: 175.89
2020-06-19 18:32:01,745 epoch 28 - iter 392/980 - loss 0.42467663 - samples/sec: 167.79
2020-06-19 18:32:20,592 epoch 28 - iter 490/980 - loss 0.43010031 - samples/sec: 166.58
2020-06-19 18:32:39,596 epoch 28 - iter 588/980 - loss 0.42882806 - samples/sec: 165.20
2020-06-19 18:32:57,872 epoch 28 - iter 686/980 - loss 0.42651085 - samples/sec: 171.79
2020-06-19 18:33:16,056 epoch 28 - iter 784/980 - loss 0.42431031 - samples/sec: 172.67
2020-06-19 18:33:34,399 epoch 28 - iter 882/980 - loss 0.42526265 - samples/sec: 171.17
2020-06-19 18:33:52,366 epoch 28 - iter 980/980 - loss 0.42578484 - samples/sec: 174.74
2020-06-19 18:33:52,379 ----------------------------------------------------------------------------------------------------
2020-06-19 18:33:52,379 EPOCH 28 done: loss 0.4258 - lr 0.0250000
2020-06-19 18:34:03,625 DEV : loss 0.5966753363609314 - score 0.848
2020-06-19 18:34:04,073 BAD EPOCHS (no improvement): 2
2020-06-19 18:34:04,073 ----------------------------------------------------------------------------------------------------
2020-06-19 18:34:22,500 epoch 29 - iter 98/980 - loss 0.40601878 - samples/sec: 170.30
2020-06-19 18:34:41,035 epoch 29 - iter 196/980 - loss 0.41098164 - samples/sec: 169.39
2020-06-19 18:35:02,254 epoch 29 - iter 294/980 - loss 0.40593159 - samples/sec: 147.95
2020-06-19 18:35:22,171 epoch 29 - iter 392/980 - loss 0.40505850 - samples/sec: 157.64
2020-06-19 18:35:41,384 epoch 29 - iter 490/980 - loss 0.40347964 - samples/sec: 163.42
2020-06-19 18:35:59,691 epoch 29 - iter 588/980 - loss 0.40466946 - samples/sec: 171.51
2020-06-19 18:36:17,879 epoch 29 - iter 686/980 - loss 0.40740251 - samples/sec: 172.62
2020-06-19 18:36:35,372 epoch 29 - iter 784/980 - loss 0.40584210 - samples/sec: 179.49
2020-06-19 18:36:53,472 epoch 29 - iter 882/980 - loss 0.40996158 - samples/sec: 173.47
2020-06-19 18:37:11,412 epoch 29 - iter 980/980 - loss 0.41275641 - samples/sec: 175.02
2020-06-19 18:37:11,424 ----------------------------------------------------------------------------------------------------
2020-06-19 18:37:11,424 EPOCH 29 done: loss 0.4128 - lr 0.0250000
2020-06-19 18:37:22,665 DEV : loss 0.5994720458984375 - score 0.8458
2020-06-19 18:37:23,112 BAD EPOCHS (no improvement): 3
2020-06-19 18:37:23,112 ----------------------------------------------------------------------------------------------------
2020-06-19 18:37:40,995 epoch 30 - iter 98/980 - loss 0.43003098 - samples/sec: 175.47
2020-06-19 18:37:59,207 epoch 30 - iter 196/980 - loss 0.42341863 - samples/sec: 172.39
2020-06-19 18:38:17,061 epoch 30 - iter 294/980 - loss 0.42512869 - samples/sec: 175.87
2020-06-19 18:38:34,779 epoch 30 - iter 392/980 - loss 0.42403415 - samples/sec: 177.21
2020-06-19 18:38:53,317 epoch 30 - iter 490/980 - loss 0.41794523 - samples/sec: 169.42
2020-06-19 18:39:10,876 epoch 30 - iter 588/980 - loss 0.41655592 - samples/sec: 178.82
2020-06-19 18:39:28,467 epoch 30 - iter 686/980 - loss 0.41504680 - samples/sec: 178.49
2020-06-19 18:39:46,392 epoch 30 - iter 784/980 - loss 0.41288166 - samples/sec: 175.16
2020-06-19 18:40:04,412 epoch 30 - iter 882/980 - loss 0.41449096 - samples/sec: 174.23
2020-06-19 18:40:22,816 epoch 30 - iter 980/980 - loss 0.41497023 - samples/sec: 170.59
2020-06-19 18:40:22,828 ----------------------------------------------------------------------------------------------------
2020-06-19 18:40:22,828 EPOCH 30 done: loss 0.4150 - lr 0.0250000
2020-06-19 18:40:37,857 DEV : loss 0.6029118895530701 - score 0.848
2020-06-19 18:40:38,305 BAD EPOCHS (no improvement): 4
2020-06-19 18:40:38,305 ----------------------------------------------------------------------------------------------------
2020-06-19 18:40:55,727 epoch 31 - iter 98/980 - loss 0.42296353 - samples/sec: 180.12
2020-06-19 18:41:14,115 epoch 31 - iter 196/980 - loss 0.40196540 - samples/sec: 170.74
2020-06-19 18:41:32,156 epoch 31 - iter 294/980 - loss 0.40716427 - samples/sec: 174.03
2020-06-19 18:41:50,870 epoch 31 - iter 392/980 - loss 0.40746376 - samples/sec: 167.77
2020-06-19 18:42:08,397 epoch 31 - iter 490/980 - loss 0.40695395 - samples/sec: 179.15
2020-06-19 18:42:26,203 epoch 31 - iter 588/980 - loss 0.40478356 - samples/sec: 176.33
2020-06-19 18:42:43,513 epoch 31 - iter 686/980 - loss 0.40153308 - samples/sec: 181.39
2020-06-19 18:43:01,502 epoch 31 - iter 784/980 - loss 0.40384337 - samples/sec: 174.53
2020-06-19 18:43:19,848 epoch 31 - iter 882/980 - loss 0.40426216 - samples/sec: 171.14
2020-06-19 18:43:38,468 epoch 31 - iter 980/980 - loss 0.40411998 - samples/sec: 168.61
2020-06-19 18:43:38,480 ----------------------------------------------------------------------------------------------------
2020-06-19 18:43:38,480 EPOCH 31 done: loss 0.4041 - lr 0.0125000
2020-06-19 18:43:50,848 DEV : loss 0.6036775708198547 - score 0.8507
2020-06-19 18:43:51,296 BAD EPOCHS (no improvement): 0
2020-06-19 18:43:59,543 ----------------------------------------------------------------------------------------------------
2020-06-19 18:44:18,059 epoch 32 - iter 98/980 - loss 0.38013062 - samples/sec: 169.48
2020-06-19 18:44:36,943 epoch 32 - iter 196/980 - loss 0.39026837 - samples/sec: 166.25
2020-06-19 18:44:56,255 epoch 32 - iter 294/980 - loss 0.39033824 - samples/sec: 162.58
2020-06-19 18:45:13,446 epoch 32 - iter 392/980 - loss 0.39309580 - samples/sec: 182.64
2020-06-19 18:45:31,173 epoch 32 - iter 490/980 - loss 0.39492153 - samples/sec: 177.12
2020-06-19 18:45:49,599 epoch 32 - iter 588/980 - loss 0.39456232 - samples/sec: 170.39
2020-06-19 18:46:08,021 epoch 32 - iter 686/980 - loss 0.39298754 - samples/sec: 170.43
2020-06-19 18:46:25,981 epoch 32 - iter 784/980 - loss 0.39290420 - samples/sec: 174.85
2020-06-19 18:46:43,843 epoch 32 - iter 882/980 - loss 0.39330527 - samples/sec: 175.78
2020-06-19 18:47:02,295 epoch 32 - iter 980/980 - loss 0.39290400 - samples/sec: 170.16
2020-06-19 18:47:02,307 ----------------------------------------------------------------------------------------------------
2020-06-19 18:47:02,307 EPOCH 32 done: loss 0.3929 - lr 0.0125000
2020-06-19 18:47:13,577 DEV : loss 0.6057214140892029 - score 0.8524
2020-06-19 18:47:14,030 BAD EPOCHS (no improvement): 0
2020-06-19 18:47:22,149 ----------------------------------------------------------------------------------------------------
2020-06-19 18:47:40,517 epoch 33 - iter 98/980 - loss 0.37140571 - samples/sec: 170.84
2020-06-19 18:47:58,251 epoch 33 - iter 196/980 - loss 0.37301268 - samples/sec: 177.06
2020-06-19 18:48:16,750 epoch 33 - iter 294/980 - loss 0.37696075 - samples/sec: 169.73
2020-06-19 18:48:35,221 epoch 33 - iter 392/980 - loss 0.38496696 - samples/sec: 169.98
2020-06-19 18:48:52,954 epoch 33 - iter 490/980 - loss 0.38698847 - samples/sec: 177.05
2020-06-19 18:49:12,126 epoch 33 - iter 588/980 - loss 0.38528318 - samples/sec: 163.77
2020-06-19 18:49:34,379 epoch 33 - iter 686/980 - loss 0.38552881 - samples/sec: 141.07
2020-06-19 18:49:57,308 epoch 33 - iter 784/980 - loss 0.38771449 - samples/sec: 136.92
2020-06-19 18:50:20,103 epoch 33 - iter 882/980 - loss 0.39127649 - samples/sec: 137.73
2020-06-19 18:50:41,245 epoch 33 - iter 980/980 - loss 0.39269807 - samples/sec: 148.51
2020-06-19 18:50:41,258 ----------------------------------------------------------------------------------------------------
2020-06-19 18:50:41,258 EPOCH 33 done: loss 0.3927 - lr 0.0125000
2020-06-19 18:50:53,255 DEV : loss 0.6019819974899292 - score 0.8492
2020-06-19 18:50:53,720 BAD EPOCHS (no improvement): 1
2020-06-19 18:50:53,720 ----------------------------------------------------------------------------------------------------
2020-06-19 18:51:14,401 epoch 34 - iter 98/980 - loss 0.39714093 - samples/sec: 151.74
2020-06-19 18:51:32,503 epoch 34 - iter 196/980 - loss 0.38363909 - samples/sec: 173.47
2020-06-19 18:51:50,220 epoch 34 - iter 294/980 - loss 0.38630515 - samples/sec: 177.23
2020-06-19 18:52:10,680 epoch 34 - iter 392/980 - loss 0.38775875 - samples/sec: 153.45
2020-06-19 18:52:31,707 epoch 34 - iter 490/980 - loss 0.39334802 - samples/sec: 149.33
2020-06-19 18:52:49,863 epoch 34 - iter 588/980 - loss 0.38961392 - samples/sec: 172.94
2020-06-19 18:53:08,279 epoch 34 - iter 686/980 - loss 0.39383075 - samples/sec: 170.49
2020-06-19 18:53:26,258 epoch 34 - iter 784/980 - loss 0.39511911 - samples/sec: 174.63
2020-06-19 18:53:45,702 epoch 34 - iter 882/980 - loss 0.39669363 - samples/sec: 161.47
2020-06-19 18:54:03,976 epoch 34 - iter 980/980 - loss 0.39911453 - samples/sec: 171.81
2020-06-19 18:54:03,989 ----------------------------------------------------------------------------------------------------
2020-06-19 18:54:03,989 EPOCH 34 done: loss 0.3991 - lr 0.0125000
2020-06-19 18:54:19,558 DEV : loss 0.5971357822418213 - score 0.8471
2020-06-19 18:54:20,231 BAD EPOCHS (no improvement): 2
2020-06-19 18:54:20,231 ----------------------------------------------------------------------------------------------------
2020-06-19 18:54:38,738 epoch 35 - iter 98/980 - loss 0.42034276 - samples/sec: 169.56
2020-06-19 18:54:57,520 epoch 35 - iter 196/980 - loss 0.38569017 - samples/sec: 167.16
2020-06-19 18:55:15,638 epoch 35 - iter 294/980 - loss 0.39095930 - samples/sec: 173.30
2020-06-19 18:55:34,416 epoch 35 - iter 392/980 - loss 0.39469639 - samples/sec: 167.19
2020-06-19 18:55:51,837 epoch 35 - iter 490/980 - loss 0.39254494 - samples/sec: 180.23
2020-06-19 18:56:10,378 epoch 35 - iter 588/980 - loss 0.38788095 - samples/sec: 169.34
2020-06-19 18:56:28,178 epoch 35 - iter 686/980 - loss 0.38888390 - samples/sec: 176.39
2020-06-19 18:56:45,429 epoch 35 - iter 784/980 - loss 0.38857348 - samples/sec: 182.01
2020-06-19 18:57:03,356 epoch 35 - iter 882/980 - loss 0.39032548 - samples/sec: 175.14
2020-06-19 18:57:21,411 epoch 35 - iter 980/980 - loss 0.38911811 - samples/sec: 173.90
2020-06-19 18:57:21,422 ----------------------------------------------------------------------------------------------------
2020-06-19 18:57:21,423 EPOCH 35 done: loss 0.3891 - lr 0.0125000
2020-06-19 18:57:32,667 DEV : loss 0.6048620939254761 - score 0.8495
2020-06-19 18:57:33,116 BAD EPOCHS (no improvement): 3
2020-06-19 18:57:33,116 ----------------------------------------------------------------------------------------------------
2020-06-19 18:57:50,689 epoch 36 - iter 98/980 - loss 0.36411393 - samples/sec: 178.57
2020-06-19 18:58:11,819 epoch 36 - iter 196/980 - loss 0.36539745 - samples/sec: 148.58
2020-06-19 18:58:30,904 epoch 36 - iter 294/980 - loss 0.37065173 - samples/sec: 164.51
2020-06-19 18:58:48,678 epoch 36 - iter 392/980 - loss 0.37553305 - samples/sec: 176.64
2020-06-19 18:59:06,865 epoch 36 - iter 490/980 - loss 0.37735496 - samples/sec: 172.63
2020-06-19 18:59:24,700 epoch 36 - iter 588/980 - loss 0.37980647 - samples/sec: 176.05
2020-06-19 18:59:44,035 epoch 36 - iter 686/980 - loss 0.38489773 - samples/sec: 162.38
2020-06-19 19:00:00,965 epoch 36 - iter 784/980 - loss 0.38372139 - samples/sec: 185.46
2020-06-19 19:00:19,144 epoch 36 - iter 882/980 - loss 0.38187318 - samples/sec: 172.71
2020-06-19 19:00:37,699 epoch 36 - iter 980/980 - loss 0.38211012 - samples/sec: 169.20
2020-06-19 19:00:37,712 ----------------------------------------------------------------------------------------------------
2020-06-19 19:00:37,712 EPOCH 36 done: loss 0.3821 - lr 0.0125000
2020-06-19 19:00:48,867 DEV : loss 0.6066898703575134 - score 0.8494
2020-06-19 19:00:49,309 BAD EPOCHS (no improvement): 4
2020-06-19 19:00:49,310 ----------------------------------------------------------------------------------------------------
2020-06-19 19:01:06,695 epoch 37 - iter 98/980 - loss 0.38177655 - samples/sec: 180.49
2020-06-19 19:01:23,940 epoch 37 - iter 196/980 - loss 0.38494889 - samples/sec: 182.08
2020-06-19 19:01:41,465 epoch 37 - iter 294/980 - loss 0.37269005 - samples/sec: 179.16
2020-06-19 19:01:59,581 epoch 37 - iter 392/980 - loss 0.37883743 - samples/sec: 173.31
2020-06-19 19:02:17,593 epoch 37 - iter 490/980 - loss 0.38272521 - samples/sec: 174.31
2020-06-19 19:02:36,227 epoch 37 - iter 588/980 - loss 0.38218140 - samples/sec: 168.49
2020-06-19 19:02:54,322 epoch 37 - iter 686/980 - loss 0.38133986 - samples/sec: 173.51
2020-06-19 19:03:11,881 epoch 37 - iter 784/980 - loss 0.37971199 - samples/sec: 178.82
2020-06-19 19:03:30,011 epoch 37 - iter 882/980 - loss 0.38032778 - samples/sec: 173.18
2020-06-19 19:03:48,914 epoch 37 - iter 980/980 - loss 0.37839401 - samples/sec: 166.09
2020-06-19 19:03:48,926 ----------------------------------------------------------------------------------------------------
2020-06-19 19:03:48,926 EPOCH 37 done: loss 0.3784 - lr 0.0062500
2020-06-19 19:04:00,134 DEV : loss 0.604880690574646 - score 0.8494
2020-06-19 19:04:00,584 BAD EPOCHS (no improvement): 1
2020-06-19 19:04:00,584 ----------------------------------------------------------------------------------------------------
2020-06-19 19:04:19,140 epoch 38 - iter 98/980 - loss 0.37222093 - samples/sec: 169.11
2020-06-19 19:04:37,609 epoch 38 - iter 196/980 - loss 0.36451758 - samples/sec: 170.02
2020-06-19 19:04:55,971 epoch 38 - iter 294/980 - loss 0.37141149 - samples/sec: 171.00
2020-06-19 19:05:14,345 epoch 38 - iter 392/980 - loss 0.37750307 - samples/sec: 170.90
2020-06-19 19:05:33,025 epoch 38 - iter 490/980 - loss 0.38108321 - samples/sec: 168.09
2020-06-19 19:05:55,944 epoch 38 - iter 588/980 - loss 0.38047825 - samples/sec: 136.97
2020-06-19 19:06:18,586 epoch 38 - iter 686/980 - loss 0.37893719 - samples/sec: 138.67
2020-06-19 19:06:41,384 epoch 38 - iter 784/980 - loss 0.37948107 - samples/sec: 137.72
2020-06-19 19:07:02,387 epoch 38 - iter 882/980 - loss 0.37824576 - samples/sec: 149.50
2020-06-19 19:07:25,844 epoch 38 - iter 980/980 - loss 0.37656695 - samples/sec: 133.83
2020-06-19 19:07:25,856 ----------------------------------------------------------------------------------------------------
2020-06-19 19:07:25,856 EPOCH 38 done: loss 0.3766 - lr 0.0062500
2020-06-19 19:07:37,125 DEV : loss 0.6085389852523804 - score 0.85
2020-06-19 19:07:37,588 BAD EPOCHS (no improvement): 2
2020-06-19 19:07:37,588 ----------------------------------------------------------------------------------------------------
2020-06-19 19:07:57,431 epoch 39 - iter 98/980 - loss 0.37205331 - samples/sec: 158.15
2020-06-19 19:08:15,339 epoch 39 - iter 196/980 - loss 0.37581724 - samples/sec: 175.35
2020-06-19 19:08:32,958 epoch 39 - iter 294/980 - loss 0.37960269 - samples/sec: 178.22
2020-06-19 19:08:51,616 epoch 39 - iter 392/980 - loss 0.38491598 - samples/sec: 168.29
2020-06-19 19:09:09,242 epoch 39 - iter 490/980 - loss 0.38188246 - samples/sec: 178.15
2020-06-19 19:09:26,812 epoch 39 - iter 588/980 - loss 0.37800182 - samples/sec: 178.73
2020-06-19 19:09:43,947 epoch 39 - iter 686/980 - loss 0.37918035 - samples/sec: 183.27
2020-06-19 19:10:05,891 epoch 39 - iter 784/980 - loss 0.38051731 - samples/sec: 143.06
2020-06-19 19:10:24,253 epoch 39 - iter 882/980 - loss 0.38220745 - samples/sec: 171.00
2020-06-19 19:10:42,626 epoch 39 - iter 980/980 - loss 0.38101157 - samples/sec: 170.91
2020-06-19 19:10:42,638 ----------------------------------------------------------------------------------------------------
2020-06-19 19:10:42,639 EPOCH 39 done: loss 0.3810 - lr 0.0062500
2020-06-19 19:10:54,096 DEV : loss 0.6045126914978027 - score 0.8494
2020-06-19 19:10:54,743 BAD EPOCHS (no improvement): 3
2020-06-19 19:10:54,744 ----------------------------------------------------------------------------------------------------
2020-06-19 19:11:13,173 epoch 40 - iter 98/980 - loss 0.37846376 - samples/sec: 170.29
2020-06-19 19:11:30,586 epoch 40 - iter 196/980 - loss 0.37697346 - samples/sec: 180.34
2020-06-19 19:11:48,541 epoch 40 - iter 294/980 - loss 0.37049519 - samples/sec: 174.88
2020-06-19 19:12:07,108 epoch 40 - iter 392/980 - loss 0.37700469 - samples/sec: 169.12
2020-06-19 19:12:26,112 epoch 40 - iter 490/980 - loss 0.37620754 - samples/sec: 165.23
2020-06-19 19:12:45,686 epoch 40 - iter 588/980 - loss 0.37836478 - samples/sec: 160.42
2020-06-19 19:13:06,056 epoch 40 - iter 686/980 - loss 0.37912190 - samples/sec: 154.13
2020-06-19 19:13:25,417 epoch 40 - iter 784/980 - loss 0.37678215 - samples/sec: 162.17
2020-06-19 19:13:45,539 epoch 40 - iter 882/980 - loss 0.37930524 - samples/sec: 156.05
2020-06-19 19:14:04,688 epoch 40 - iter 980/980 - loss 0.37957291 - samples/sec: 163.96
2020-06-19 19:14:04,700 ----------------------------------------------------------------------------------------------------
2020-06-19 19:14:04,700 EPOCH 40 done: loss 0.3796 - lr 0.0062500
2020-06-19 19:14:16,003 DEV : loss 0.6062765121459961 - score 0.85
2020-06-19 19:14:16,448 BAD EPOCHS (no improvement): 4
2020-06-19 19:14:16,449 ----------------------------------------------------------------------------------------------------
2020-06-19 19:14:35,694 epoch 41 - iter 98/980 - loss 0.38278585 - samples/sec: 163.07
2020-06-19 19:14:53,944 epoch 41 - iter 196/980 - loss 0.38093371 - samples/sec: 172.05
2020-06-19 19:15:11,962 epoch 41 - iter 294/980 - loss 0.37597702 - samples/sec: 174.28
2020-06-19 19:15:30,566 epoch 41 - iter 392/980 - loss 0.37176354 - samples/sec: 168.77
2020-06-19 19:15:50,321 epoch 41 - iter 490/980 - loss 0.37133238 - samples/sec: 158.94
2020-06-19 19:16:11,918 epoch 41 - iter 588/980 - loss 0.36969387 - samples/sec: 145.38
2020-06-19 19:16:30,721 epoch 41 - iter 686/980 - loss 0.37268820 - samples/sec: 166.99
2020-06-19 19:16:50,378 epoch 41 - iter 784/980 - loss 0.37278254 - samples/sec: 159.72
2020-06-19 19:17:11,728 epoch 41 - iter 882/980 - loss 0.37087474 - samples/sec: 147.06
2020-06-19 19:17:30,401 epoch 41 - iter 980/980 - loss 0.37196762 - samples/sec: 168.16
2020-06-19 19:17:30,413 ----------------------------------------------------------------------------------------------------
2020-06-19 19:17:30,413 EPOCH 41 done: loss 0.3720 - lr 0.0031250
2020-06-19 19:17:41,837 DEV : loss 0.6094374656677246 - score 0.8485
2020-06-19 19:17:42,301 BAD EPOCHS (no improvement): 1
2020-06-19 19:17:42,302 ----------------------------------------------------------------------------------------------------
2020-06-19 19:18:04,690 epoch 42 - iter 98/980 - loss 0.39236678 - samples/sec: 140.16
2020-06-19 19:18:26,871 epoch 42 - iter 196/980 - loss 0.38286131 - samples/sec: 141.55
2020-06-19 19:18:46,557 epoch 42 - iter 294/980 - loss 0.38058197 - samples/sec: 159.51
2020-06-19 19:19:05,009 epoch 42 - iter 392/980 - loss 0.36993991 - samples/sec: 170.17
2020-06-19 19:19:24,426 epoch 42 - iter 490/980 - loss 0.37148381 - samples/sec: 161.71
2020-06-19 19:19:43,312 epoch 42 - iter 588/980 - loss 0.37734472 - samples/sec: 166.24
2020-06-19 19:20:01,067 epoch 42 - iter 686/980 - loss 0.37954816 - samples/sec: 176.84
2020-06-19 19:20:23,322 epoch 42 - iter 784/980 - loss 0.37898240 - samples/sec: 141.06
2020-06-19 19:20:41,145 epoch 42 - iter 882/980 - loss 0.37982167 - samples/sec: 176.19
2020-06-19 19:20:58,832 epoch 42 - iter 980/980 - loss 0.37396484 - samples/sec: 177.52
2020-06-19 19:20:58,844 ----------------------------------------------------------------------------------------------------
2020-06-19 19:20:58,844 EPOCH 42 done: loss 0.3740 - lr 0.0031250
2020-06-19 19:21:10,032 DEV : loss 0.6072869300842285 - score 0.8487
2020-06-19 19:21:10,480 BAD EPOCHS (no improvement): 2
2020-06-19 19:21:10,481 ----------------------------------------------------------------------------------------------------
2020-06-19 19:21:28,804 epoch 43 - iter 98/980 - loss 0.36506121 - samples/sec: 171.26
2020-06-19 19:21:47,368 epoch 43 - iter 196/980 - loss 0.36702111 - samples/sec: 169.12
2020-06-19 19:22:04,593 epoch 43 - iter 294/980 - loss 0.37593845 - samples/sec: 182.29
2020-06-19 19:22:21,993 epoch 43 - iter 392/980 - loss 0.37331558 - samples/sec: 180.45
2020-06-19 19:22:40,024 epoch 43 - iter 490/980 - loss 0.37791861 - samples/sec: 174.14
2020-06-19 19:22:58,806 epoch 43 - iter 588/980 - loss 0.37594140 - samples/sec: 167.17
2020-06-19 19:23:17,046 epoch 43 - iter 686/980 - loss 0.37632808 - samples/sec: 172.13
2020-06-19 19:23:34,995 epoch 43 - iter 784/980 - loss 0.37671165 - samples/sec: 174.92
2020-06-19 19:23:53,497 epoch 43 - iter 882/980 - loss 0.37570991 - samples/sec: 169.69
2020-06-19 19:24:11,289 epoch 43 - iter 980/980 - loss 0.37486076 - samples/sec: 176.48
2020-06-19 19:24:11,301 ----------------------------------------------------------------------------------------------------
2020-06-19 19:24:11,301 EPOCH 43 done: loss 0.3749 - lr 0.0031250
2020-06-19 19:24:22,746 DEV : loss 0.6087901592254639 - score 0.8489
2020-06-19 19:24:23,210 BAD EPOCHS (no improvement): 3
2020-06-19 19:24:23,210 ----------------------------------------------------------------------------------------------------
2020-06-19 19:24:42,501 epoch 44 - iter 98/980 - loss 0.36751516 - samples/sec: 162.68
2020-06-19 19:25:00,798 epoch 44 - iter 196/980 - loss 0.38013447 - samples/sec: 171.62
2020-06-19 19:25:20,035 epoch 44 - iter 294/980 - loss 0.37624269 - samples/sec: 163.22
2020-06-19 19:25:38,212 epoch 44 - iter 392/980 - loss 0.38093893 - samples/sec: 172.75
2020-06-19 19:25:56,245 epoch 44 - iter 490/980 - loss 0.37985921 - samples/sec: 174.13
2020-06-19 19:26:16,263 epoch 44 - iter 588/980 - loss 0.37943230 - samples/sec: 156.85
2020-06-19 19:26:38,487 epoch 44 - iter 686/980 - loss 0.38062909 - samples/sec: 141.27
2020-06-19 19:26:57,925 epoch 44 - iter 784/980 - loss 0.37605690 - samples/sec: 161.53
2020-06-19 19:27:16,944 epoch 44 - iter 882/980 - loss 0.37435067 - samples/sec: 165.09
2020-06-19 19:27:36,189 epoch 44 - iter 980/980 - loss 0.37422552 - samples/sec: 163.15
2020-06-19 19:27:36,202 ----------------------------------------------------------------------------------------------------
2020-06-19 19:27:36,202 EPOCH 44 done: loss 0.3742 - lr 0.0031250
2020-06-19 19:27:47,745 DEV : loss 0.6093899607658386 - score 0.849
2020-06-19 19:27:48,203 BAD EPOCHS (no improvement): 4
2020-06-19 19:27:48,203 ----------------------------------------------------------------------------------------------------
2020-06-19 19:28:07,007 epoch 45 - iter 98/980 - loss 0.34581188 - samples/sec: 166.88
2020-06-19 19:28:25,898 epoch 45 - iter 196/980 - loss 0.36260626 - samples/sec: 166.20
2020-06-19 19:28:44,412 epoch 45 - iter 294/980 - loss 0.37194900 - samples/sec: 169.59
2020-06-19 19:29:03,443 epoch 45 - iter 392/980 - loss 0.37523652 - samples/sec: 164.97
2020-06-19 19:29:21,529 epoch 45 - iter 490/980 - loss 0.37504196 - samples/sec: 173.60
2020-06-19 19:29:39,281 epoch 45 - iter 588/980 - loss 0.37366417 - samples/sec: 176.88
2020-06-19 19:29:57,241 epoch 45 - iter 686/980 - loss 0.36817919 - samples/sec: 174.81
2020-06-19 19:30:15,456 epoch 45 - iter 784/980 - loss 0.37055902 - samples/sec: 172.37
2020-06-19 19:30:33,562 epoch 45 - iter 882/980 - loss 0.36946366 - samples/sec: 173.47
2020-06-19 19:30:51,711 epoch 45 - iter 980/980 - loss 0.37258807 - samples/sec: 173.01
2020-06-19 19:30:51,723 ----------------------------------------------------------------------------------------------------
2020-06-19 19:30:51,723 EPOCH 45 done: loss 0.3726 - lr 0.0015625
2020-06-19 19:31:03,893 DEV : loss 0.6095829010009766 - score 0.8495
2020-06-19 19:31:04,352 BAD EPOCHS (no improvement): 1
2020-06-19 19:31:04,353 ----------------------------------------------------------------------------------------------------
2020-06-19 19:31:23,895 epoch 46 - iter 98/980 - loss 0.37462469 - samples/sec: 160.58
2020-06-19 19:31:42,171 epoch 46 - iter 196/980 - loss 0.36704878 - samples/sec: 171.82
2020-06-19 19:32:00,947 epoch 46 - iter 294/980 - loss 0.37314359 - samples/sec: 167.23
2020-06-19 19:32:18,473 epoch 46 - iter 392/980 - loss 0.37352239 - samples/sec: 179.17
2020-06-19 19:32:37,163 epoch 46 - iter 490/980 - loss 0.37102466 - samples/sec: 168.01
2020-06-19 19:32:55,758 epoch 46 - iter 588/980 - loss 0.37453562 - samples/sec: 168.86
2020-06-19 19:33:19,430 epoch 46 - iter 686/980 - loss 0.37289455 - samples/sec: 132.61
2020-06-19 19:33:37,225 epoch 46 - iter 784/980 - loss 0.37359563 - samples/sec: 176.46
2020-06-19 19:33:54,741 epoch 46 - iter 882/980 - loss 0.37263102 - samples/sec: 179.27
2020-06-19 19:34:14,304 epoch 46 - iter 980/980 - loss 0.37450384 - samples/sec: 160.50
2020-06-19 19:34:14,319 ----------------------------------------------------------------------------------------------------
2020-06-19 19:34:14,319 EPOCH 46 done: loss 0.3745 - lr 0.0015625
2020-06-19 19:34:28,217 DEV : loss 0.6089460849761963 - score 0.8495
2020-06-19 19:34:28,865 BAD EPOCHS (no improvement): 2
2020-06-19 19:34:28,865 ----------------------------------------------------------------------------------------------------
2020-06-19 19:34:51,563 epoch 47 - iter 98/980 - loss 0.35409831 - samples/sec: 138.25
2020-06-19 19:35:14,452 epoch 47 - iter 196/980 - loss 0.36302402 - samples/sec: 137.17
2020-06-19 19:35:34,080 epoch 47 - iter 294/980 - loss 0.35285562 - samples/sec: 159.99
2020-06-19 19:35:53,503 epoch 47 - iter 392/980 - loss 0.35200892 - samples/sec: 161.68
2020-06-19 19:36:12,055 epoch 47 - iter 490/980 - loss 0.36158689 - samples/sec: 169.25
2020-06-19 19:36:30,460 epoch 47 - iter 588/980 - loss 0.36649405 - samples/sec: 170.62
2020-06-19 19:36:48,621 epoch 47 - iter 686/980 - loss 0.36364362 - samples/sec: 172.88
2020-06-19 19:37:07,942 epoch 47 - iter 784/980 - loss 0.36676105 - samples/sec: 162.49
2020-06-19 19:37:25,954 epoch 47 - iter 882/980 - loss 0.36683989 - samples/sec: 174.32
2020-06-19 19:37:44,112 epoch 47 - iter 980/980 - loss 0.36620927 - samples/sec: 172.91
2020-06-19 19:37:44,124 ----------------------------------------------------------------------------------------------------
2020-06-19 19:37:44,125 EPOCH 47 done: loss 0.3662 - lr 0.0015625
2020-06-19 19:37:57,030 DEV : loss 0.6086469888687134 - score 0.8487
2020-06-19 19:37:57,690 BAD EPOCHS (no improvement): 3
2020-06-19 19:37:57,690 ----------------------------------------------------------------------------------------------------
2020-06-19 19:38:15,912 epoch 48 - iter 98/980 - loss 0.34765145 - samples/sec: 172.23
2020-06-19 19:38:33,592 epoch 48 - iter 196/980 - loss 0.36245308 - samples/sec: 177.59
2020-06-19 19:38:51,069 epoch 48 - iter 294/980 - loss 0.35855531 - samples/sec: 179.65
2020-06-19 19:39:08,585 epoch 48 - iter 392/980 - loss 0.36345642 - samples/sec: 179.25
2020-06-19 19:39:26,774 epoch 48 - iter 490/980 - loss 0.36470640 - samples/sec: 172.61
2020-06-19 19:39:45,342 epoch 48 - iter 588/980 - loss 0.36471887 - samples/sec: 169.08
2020-06-19 19:40:03,603 epoch 48 - iter 686/980 - loss 0.36547095 - samples/sec: 171.93
2020-06-19 19:40:22,917 epoch 48 - iter 784/980 - loss 0.36703060 - samples/sec: 162.55
2020-06-19 19:40:40,880 epoch 48 - iter 882/980 - loss 0.36805957 - samples/sec: 174.79
2020-06-19 19:40:59,817 epoch 48 - iter 980/980 - loss 0.36868400 - samples/sec: 165.80
2020-06-19 19:40:59,829 ----------------------------------------------------------------------------------------------------
2020-06-19 19:40:59,829 EPOCH 48 done: loss 0.3687 - lr 0.0015625
2020-06-19 19:41:11,156 DEV : loss 0.6099991202354431 - score 0.8489
2020-06-19 19:41:11,597 BAD EPOCHS (no improvement): 4
2020-06-19 19:41:11,597 ----------------------------------------------------------------------------------------------------
2020-06-19 19:41:30,704 epoch 49 - iter 98/980 - loss 0.37880193 - samples/sec: 164.23
2020-06-19 19:41:50,043 epoch 49 - iter 196/980 - loss 0.37933649 - samples/sec: 162.34
2020-06-19 19:42:08,560 epoch 49 - iter 294/980 - loss 0.37673107 - samples/sec: 169.59
2020-06-19 19:42:28,583 epoch 49 - iter 392/980 - loss 0.37112621 - samples/sec: 156.82
2020-06-19 19:42:46,559 epoch 49 - iter 490/980 - loss 0.37501471 - samples/sec: 174.68
2020-06-19 19:43:06,090 epoch 49 - iter 588/980 - loss 0.37333666 - samples/sec: 160.77
2020-06-19 19:43:25,021 epoch 49 - iter 686/980 - loss 0.37323907 - samples/sec: 165.85
2020-06-19 19:43:43,035 epoch 49 - iter 784/980 - loss 0.37035857 - samples/sec: 174.30
2020-06-19 19:44:01,254 epoch 49 - iter 882/980 - loss 0.37043764 - samples/sec: 172.35
2020-06-19 19:44:19,062 epoch 49 - iter 980/980 - loss 0.37193442 - samples/sec: 176.33
2020-06-19 19:44:19,075 ----------------------------------------------------------------------------------------------------
2020-06-19 19:44:19,075 EPOCH 49 done: loss 0.3719 - lr 0.0007813
2020-06-19 19:44:30,317 DEV : loss 0.60939621925354 - score 0.8487
2020-06-19 19:44:30,781 BAD EPOCHS (no improvement): 1
2020-06-19 19:44:30,781 ----------------------------------------------------------------------------------------------------
2020-06-19 19:44:48,465 epoch 50 - iter 98/980 - loss 0.38800395 - samples/sec: 177.47
2020-06-19 19:45:07,739 epoch 50 - iter 196/980 - loss 0.38095386 - samples/sec: 162.91
2020-06-19 19:45:26,591 epoch 50 - iter 294/980 - loss 0.37723481 - samples/sec: 166.54
2020-06-19 19:45:46,561 epoch 50 - iter 392/980 - loss 0.37119559 - samples/sec: 157.22
2020-06-19 19:46:05,592 epoch 50 - iter 490/980 - loss 0.36819568 - samples/sec: 165.00
2020-06-19 19:46:27,740 epoch 50 - iter 588/980 - loss 0.36943894 - samples/sec: 141.73
2020-06-19 19:46:46,113 epoch 50 - iter 686/980 - loss 0.37026742 - samples/sec: 170.88
2020-06-19 19:47:05,143 epoch 50 - iter 784/980 - loss 0.36948124 - samples/sec: 164.99
2020-06-19 19:47:23,373 epoch 50 - iter 882/980 - loss 0.37116339 - samples/sec: 172.25
2020-06-19 19:47:42,549 epoch 50 - iter 980/980 - loss 0.37236695 - samples/sec: 163.75
2020-06-19 19:47:42,562 ----------------------------------------------------------------------------------------------------
2020-06-19 19:47:42,562 EPOCH 50 done: loss 0.3724 - lr 0.0007813
2020-06-19 19:47:53,638 DEV : loss 0.609477698802948 - score 0.8493
2020-06-19 19:47:54,104 BAD EPOCHS (no improvement): 2
2020-06-19 19:47:54,104 ----------------------------------------------------------------------------------------------------
2020-06-19 19:48:12,411 epoch 51 - iter 98/980 - loss 0.34389070 - samples/sec: 171.43
2020-06-19 19:48:32,703 epoch 51 - iter 196/980 - loss 0.35736274 - samples/sec: 154.72
2020-06-19 19:48:52,354 epoch 51 - iter 294/980 - loss 0.36580260 - samples/sec: 159.78
2020-06-19 19:49:11,891 epoch 51 - iter 392/980 - loss 0.36262552 - samples/sec: 160.71
2020-06-19 19:49:30,150 epoch 51 - iter 490/980 - loss 0.36225120 - samples/sec: 171.98
2020-06-19 19:49:50,421 epoch 51 - iter 588/980 - loss 0.35695381 - samples/sec: 154.89
2020-06-19 19:50:12,017 epoch 51 - iter 686/980 - loss 0.36556206 - samples/sec: 145.38
2020-06-19 19:50:33,310 epoch 51 - iter 784/980 - loss 0.36472422 - samples/sec: 147.44
2020-06-19 19:50:52,410 epoch 51 - iter 882/980 - loss 0.36681143 - samples/sec: 164.41
2020-06-19 19:51:12,857 epoch 51 - iter 980/980 - loss 0.36767892 - samples/sec: 153.55
2020-06-19 19:51:12,869 ----------------------------------------------------------------------------------------------------
2020-06-19 19:51:12,869 EPOCH 51 done: loss 0.3677 - lr 0.0007813
2020-06-19 19:51:26,597 DEV : loss 0.6093611717224121 - score 0.8492
2020-06-19 19:51:27,245 BAD EPOCHS (no improvement): 3
2020-06-19 19:51:27,246 ----------------------------------------------------------------------------------------------------
2020-06-19 19:51:46,401 epoch 52 - iter 98/980 - loss 0.38796228 - samples/sec: 163.82
2020-06-19 19:52:04,961 epoch 52 - iter 196/980 - loss 0.38684400 - samples/sec: 169.16
2020-06-19 19:52:22,498 epoch 52 - iter 294/980 - loss 0.38512960 - samples/sec: 179.05
2020-06-19 19:52:41,263 epoch 52 - iter 392/980 - loss 0.37362698 - samples/sec: 167.31
2020-06-19 19:53:00,287 epoch 52 - iter 490/980 - loss 0.37017470 - samples/sec: 165.04
2020-06-19 19:53:18,095 epoch 52 - iter 588/980 - loss 0.37088686 - samples/sec: 176.32
2020-06-19 19:53:35,890 epoch 52 - iter 686/980 - loss 0.36747120 - samples/sec: 176.47
2020-06-19 19:53:54,081 epoch 52 - iter 784/980 - loss 0.37041001 - samples/sec: 172.61
2020-06-19 19:54:12,002 epoch 52 - iter 882/980 - loss 0.37027843 - samples/sec: 175.21
2020-06-19 19:54:29,722 epoch 52 - iter 980/980 - loss 0.36911884 - samples/sec: 177.21
2020-06-19 19:54:29,734 ----------------------------------------------------------------------------------------------------
2020-06-19 19:54:29,734 EPOCH 52 done: loss 0.3691 - lr 0.0007813
2020-06-19 19:54:40,784 DEV : loss 0.6095338463783264 - score 0.8492
2020-06-19 19:54:41,248 BAD EPOCHS (no improvement): 4
2020-06-19 19:54:41,248 ----------------------------------------------------------------------------------------------------
2020-06-19 19:55:01,428 epoch 53 - iter 98/980 - loss 0.36994821 - samples/sec: 155.51
2020-06-19 19:55:22,435 epoch 53 - iter 196/980 - loss 0.36501845 - samples/sec: 149.48
2020-06-19 19:55:43,419 epoch 53 - iter 294/980 - loss 0.37077695 - samples/sec: 149.64
2020-06-19 19:56:03,617 epoch 53 - iter 392/980 - loss 0.36528498 - samples/sec: 155.46
2020-06-19 19:56:23,034 epoch 53 - iter 490/980 - loss 0.36458944 - samples/sec: 161.71
2020-06-19 19:56:40,704 epoch 53 - iter 588/980 - loss 0.36876120 - samples/sec: 177.71
2020-06-19 19:56:58,889 epoch 53 - iter 686/980 - loss 0.36944660 - samples/sec: 172.68
2020-06-19 19:57:16,763 epoch 53 - iter 784/980 - loss 0.36956876 - samples/sec: 175.68
2020-06-19 19:57:34,985 epoch 53 - iter 882/980 - loss 0.37123322 - samples/sec: 172.32
2020-06-19 19:57:53,622 epoch 53 - iter 980/980 - loss 0.37013302 - samples/sec: 168.48
2020-06-19 19:57:53,635 ----------------------------------------------------------------------------------------------------
2020-06-19 19:57:53,635 EPOCH 53 done: loss 0.3701 - lr 0.0003906
2020-06-19 19:58:04,786 DEV : loss 0.6093892455101013 - score 0.8494
2020-06-19 19:58:05,252 BAD EPOCHS (no improvement): 1
2020-06-19 19:58:05,252 ----------------------------------------------------------------------------------------------------
2020-06-19 19:58:24,010 epoch 54 - iter 98/980 - loss 0.40387942 - samples/sec: 167.31
2020-06-19 19:58:42,279 epoch 54 - iter 196/980 - loss 0.38540290 - samples/sec: 171.88
2020-06-19 19:59:00,794 epoch 54 - iter 294/980 - loss 0.38182903 - samples/sec: 169.58
2020-06-19 19:59:18,464 epoch 54 - iter 392/980 - loss 0.37671197 - samples/sec: 177.69
2020-06-19 19:59:36,560 epoch 54 - iter 490/980 - loss 0.37096018 - samples/sec: 173.50
2020-06-19 19:59:55,836 epoch 54 - iter 588/980 - loss 0.37020232 - samples/sec: 162.88
2020-06-19 20:00:17,708 epoch 54 - iter 686/980 - loss 0.37224958 - samples/sec: 143.54
2020-06-19 20:00:35,878 epoch 54 - iter 784/980 - loss 0.36881638 - samples/sec: 172.79
2020-06-19 20:00:55,405 epoch 54 - iter 882/980 - loss 0.36962643 - samples/sec: 160.78
2020-06-19 20:01:14,688 epoch 54 - iter 980/980 - loss 0.37045987 - samples/sec: 162.83
2020-06-19 20:01:14,703 ----------------------------------------------------------------------------------------------------
2020-06-19 20:01:14,703 EPOCH 54 done: loss 0.3705 - lr 0.0003906
2020-06-19 20:01:27,178 DEV : loss 0.6095139980316162 - score 0.8499
2020-06-19 20:01:27,644 BAD EPOCHS (no improvement): 2
2020-06-19 20:01:27,644 ----------------------------------------------------------------------------------------------------
2020-06-19 20:01:46,082 epoch 55 - iter 98/980 - loss 0.35181297 - samples/sec: 170.21
2020-06-19 20:02:06,548 epoch 55 - iter 196/980 - loss 0.35897747 - samples/sec: 153.41
2020-06-19 20:02:26,778 epoch 55 - iter 294/980 - loss 0.36456246 - samples/sec: 155.19
2020-06-19 20:02:44,883 epoch 55 - iter 392/980 - loss 0.37277253 - samples/sec: 173.43
2020-06-19 20:03:02,856 epoch 55 - iter 490/980 - loss 0.36883933 - samples/sec: 174.73
2020-06-19 20:03:21,231 epoch 55 - iter 588/980 - loss 0.36750559 - samples/sec: 170.88
2020-06-19 20:03:39,807 epoch 55 - iter 686/980 - loss 0.37003701 - samples/sec: 169.02
2020-06-19 20:03:57,413 epoch 55 - iter 784/980 - loss 0.37222799 - samples/sec: 178.35
2020-06-19 20:04:15,595 epoch 55 - iter 882/980 - loss 0.37152491 - samples/sec: 172.68
2020-06-19 20:04:33,220 epoch 55 - iter 980/980 - loss 0.37169384 - samples/sec: 178.14
2020-06-19 20:04:33,233 ----------------------------------------------------------------------------------------------------
2020-06-19 20:04:33,233 EPOCH 55 done: loss 0.3717 - lr 0.0003906
2020-06-19 20:04:44,443 DEV : loss 0.6096738576889038 - score 0.8497
2020-06-19 20:04:44,890 BAD EPOCHS (no improvement): 3
2020-06-19 20:04:44,891 ----------------------------------------------------------------------------------------------------
2020-06-19 20:05:03,142 epoch 56 - iter 98/980 - loss 0.38091781 - samples/sec: 171.93
2020-06-19 20:05:21,055 epoch 56 - iter 196/980 - loss 0.37419445 - samples/sec: 175.27
2020-06-19 20:05:38,702 epoch 56 - iter 294/980 - loss 0.37334634 - samples/sec: 177.92
2020-06-19 20:05:58,118 epoch 56 - iter 392/980 - loss 0.37821179 - samples/sec: 161.70
2020-06-19 20:06:16,534 epoch 56 - iter 490/980 - loss 0.37455580 - samples/sec: 170.48
2020-06-19 20:06:33,889 epoch 56 - iter 588/980 - loss 0.37437573 - samples/sec: 180.92
2020-06-19 20:06:51,584 epoch 56 - iter 686/980 - loss 0.37623996 - samples/sec: 177.44
2020-06-19 20:07:09,666 epoch 56 - iter 784/980 - loss 0.37428061 - samples/sec: 173.64
2020-06-19 20:07:27,449 epoch 56 - iter 882/980 - loss 0.37360963 - samples/sec: 176.56
2020-06-19 20:07:45,376 epoch 56 - iter 980/980 - loss 0.37233458 - samples/sec: 175.15
2020-06-19 20:07:45,389 ----------------------------------------------------------------------------------------------------
2020-06-19 20:07:45,389 EPOCH 56 done: loss 0.3723 - lr 0.0003906
2020-06-19 20:07:56,673 DEV : loss 0.6098864674568176 - score 0.8496
2020-06-19 20:07:57,122 BAD EPOCHS (no improvement): 4
2020-06-19 20:07:57,122 ----------------------------------------------------------------------------------------------------
2020-06-19 20:08:14,874 epoch 57 - iter 98/980 - loss 0.36307802 - samples/sec: 176.78
2020-06-19 20:08:32,640 epoch 57 - iter 196/980 - loss 0.36019294 - samples/sec: 176.72
2020-06-19 20:08:51,048 epoch 57 - iter 294/980 - loss 0.37711852 - samples/sec: 170.56
2020-06-19 20:09:09,261 epoch 57 - iter 392/980 - loss 0.37431182 - samples/sec: 172.39
2020-06-19 20:09:28,326 epoch 57 - iter 490/980 - loss 0.38082642 - samples/sec: 164.69
2020-06-19 20:09:47,519 epoch 57 - iter 588/980 - loss 0.37689807 - samples/sec: 163.59
2020-06-19 20:10:05,717 epoch 57 - iter 686/980 - loss 0.37942064 - samples/sec: 172.55
2020-06-19 20:10:23,812 epoch 57 - iter 784/980 - loss 0.37280932 - samples/sec: 173.54
2020-06-19 20:10:41,689 epoch 57 - iter 882/980 - loss 0.37319069 - samples/sec: 175.65
2020-06-19 20:11:00,465 epoch 57 - iter 980/980 - loss 0.37111811 - samples/sec: 167.23
2020-06-19 20:11:00,478 ----------------------------------------------------------------------------------------------------
2020-06-19 20:11:00,478 EPOCH 57 done: loss 0.3711 - lr 0.0001953
2020-06-19 20:11:11,956 DEV : loss 0.6097879409790039 - score 0.85
2020-06-19 20:11:12,419 BAD EPOCHS (no improvement): 1
2020-06-19 20:11:12,419 ----------------------------------------------------------------------------------------------------
2020-06-19 20:11:33,261 epoch 58 - iter 98/980 - loss 0.36893618 - samples/sec: 150.57
2020-06-19 20:11:55,341 epoch 58 - iter 196/980 - loss 0.36519386 - samples/sec: 142.19
2020-06-19 20:12:13,883 epoch 58 - iter 294/980 - loss 0.36207203 - samples/sec: 169.34
2020-06-19 20:12:33,317 epoch 58 - iter 392/980 - loss 0.36171874 - samples/sec: 161.56
2020-06-19 20:12:53,448 epoch 58 - iter 490/980 - loss 0.36441555 - samples/sec: 155.98
2020-06-19 20:13:16,518 epoch 58 - iter 588/980 - loss 0.36746894 - samples/sec: 136.07
2020-06-19 20:13:35,460 epoch 58 - iter 686/980 - loss 0.36868065 - samples/sec: 165.77
2020-06-19 20:13:52,604 epoch 58 - iter 784/980 - loss 0.36776538 - samples/sec: 183.18
2020-06-19 20:14:12,255 epoch 58 - iter 882/980 - loss 0.36855130 - samples/sec: 159.77
2020-06-19 20:14:32,029 epoch 58 - iter 980/980 - loss 0.36902952 - samples/sec: 158.80
2020-06-19 20:14:32,042 ----------------------------------------------------------------------------------------------------
2020-06-19 20:14:32,042 EPOCH 58 done: loss 0.3690 - lr 0.0001953
2020-06-19 20:14:43,106 DEV : loss 0.6096630096435547 - score 0.8496
2020-06-19 20:14:43,569 BAD EPOCHS (no improvement): 2
2020-06-19 20:14:43,569 ----------------------------------------------------------------------------------------------------
2020-06-19 20:15:01,295 epoch 59 - iter 98/980 - loss 0.38046809 - samples/sec: 177.06
2020-06-19 20:15:19,919 epoch 59 - iter 196/980 - loss 0.38388641 - samples/sec: 168.59
2020-06-19 20:15:38,301 epoch 59 - iter 294/980 - loss 0.37973919 - samples/sec: 170.83
2020-06-19 20:15:56,096 epoch 59 - iter 392/980 - loss 0.37344036 - samples/sec: 176.47
2020-06-19 20:16:13,941 epoch 59 - iter 490/980 - loss 0.36992247 - samples/sec: 175.96
2020-06-19 20:16:37,766 epoch 59 - iter 588/980 - loss 0.37680952 - samples/sec: 131.76
2020-06-19 20:16:56,193 epoch 59 - iter 686/980 - loss 0.37284734 - samples/sec: 170.43
2020-06-19 20:17:14,211 epoch 59 - iter 784/980 - loss 0.37659414 - samples/sec: 174.28
2020-06-19 20:17:32,976 epoch 59 - iter 882/980 - loss 0.37572796 - samples/sec: 167.33
2020-06-19 20:17:50,504 epoch 59 - iter 980/980 - loss 0.37517613 - samples/sec: 179.15
2020-06-19 20:17:50,516 ----------------------------------------------------------------------------------------------------
2020-06-19 20:17:50,517 EPOCH 59 done: loss 0.3752 - lr 0.0001953
2020-06-19 20:18:01,470 DEV : loss 0.6096972227096558 - score 0.8492
2020-06-19 20:18:01,936 BAD EPOCHS (no improvement): 3
2020-06-19 20:18:01,936 ----------------------------------------------------------------------------------------------------
2020-06-19 20:18:20,048 epoch 60 - iter 98/980 - loss 0.35850182 - samples/sec: 173.27
2020-06-19 20:18:37,595 epoch 60 - iter 196/980 - loss 0.36315845 - samples/sec: 178.96
2020-06-19 20:18:56,224 epoch 60 - iter 294/980 - loss 0.36975905 - samples/sec: 168.55
2020-06-19 20:19:15,313 epoch 60 - iter 392/980 - loss 0.37169184 - samples/sec: 164.48
2020-06-19 20:19:32,620 epoch 60 - iter 490/980 - loss 0.37268831 - samples/sec: 181.44
2020-06-19 20:19:52,284 epoch 60 - iter 588/980 - loss 0.36740095 - samples/sec: 159.69
2020-06-19 20:20:10,115 epoch 60 - iter 686/980 - loss 0.36427303 - samples/sec: 176.10
2020-06-19 20:20:28,476 epoch 60 - iter 784/980 - loss 0.36451504 - samples/sec: 171.02
2020-06-19 20:20:46,979 epoch 60 - iter 882/980 - loss 0.36824506 - samples/sec: 169.69
2020-06-19 20:21:05,489 epoch 60 - iter 980/980 - loss 0.36678859 - samples/sec: 169.62
2020-06-19 20:21:05,502 ----------------------------------------------------------------------------------------------------
2020-06-19 20:21:05,502 EPOCH 60 done: loss 0.3668 - lr 0.0001953
2020-06-19 20:21:19,111 DEV : loss 0.6098257303237915 - score 0.8486
2020-06-19 20:21:19,758 BAD EPOCHS (no improvement): 4
2020-06-19 20:21:19,759 ----------------------------------------------------------------------------------------------------
2020-06-19 20:21:19,759 ----------------------------------------------------------------------------------------------------
2020-06-19 20:21:19,759 learning rate too small - quitting training!
2020-06-19 20:21:19,759 ----------------------------------------------------------------------------------------------------
2020-06-19 20:21:28,649 ----------------------------------------------------------------------------------------------------
2020-06-19 20:21:28,650 Testing using best model ...
2020-06-19 20:21:28,650 loading file /home/tmp/hunflair_small/disease/best-model.pt
2020-06-19 20:22:14,842 0.9388	0.9509	0.9448
2020-06-19 20:22:14,842 
Results:
- F1-score (micro) 0.9448
- F1-score (macro) 0.9448

By class:
Disease    tp: 8459 - fp: 551 - fn: 437 - precision: 0.9388 - recall: 0.9509 - f1-score: 0.9448
2020-06-19 20:22:14,842 ----------------------------------------------------------------------------------------------------
2020-06-19 20:22:14,842 ----------------------------------------------------------------------------------------------------
2020-06-19 20:22:37,651 ----------------------------------------------------------------------------------------------------
2020-06-19 20:22:41,839 ----------------------------------------------------------------------------------------------------
2020-06-19 20:22:52,872 ----------------------------------------------------------------------------------------------------
2020-06-19 20:23:00,116 ----------------------------------------------------------------------------------------------------