2020-06-19 16:53:06,683 ----------------------------------------------------------------------------------------------------
2020-06-19 16:53:06,684 Model: "SequenceTagger(
  (embeddings): StackedEmbeddings(
    (list_embedding_0): WordEmbeddings('pubmed_pmc_wiki_sg_1M.gensim')
    (list_embedding_1): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
    (list_embedding_2): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
  )
  (word_dropout): WordDropout(p=0.05)
  (locked_dropout): LockedDropout(p=0.5)
  (embedding2nn): Linear(in_features=4296, out_features=4296, bias=True)
  (rnn): LSTM(4296, 256, batch_first=True, bidirectional=True)
  (linear): Linear(in_features=512, out_features=8, bias=True)
  (beta): 1.0
  (weights): None
  (weight_tensor) None
)"
2020-06-19 16:53:06,684 ----------------------------------------------------------------------------------------------------
2020-06-19 16:53:06,684 Corpus: "Corpus: 1777 train + 434 dev + 521 test sentences
Corpus: 11851 train + 1237 dev + 3883 test sentences
Corpus: 15777 train + 1816 dev + 5250 test sentences
Corpus: 859 train + 86 dev + 289 test sentences
Corpus: 2393 train + 251 dev + 836 test sentences
Corpus: 5812 train + 609 dev + 1912 test sentences
Corpus: 5959 train + 632 dev + 1549 test sentences"
2020-06-19 16:53:06,684 ----------------------------------------------------------------------------------------------------
2020-06-19 16:53:06,684 Parameters:
2020-06-19 16:53:06,684  - learning_rate: "0.1"
2020-06-19 16:53:06,684  - mini_batch_size: "32"
2020-06-19 16:53:06,684  - patience: "3"
2020-06-19 16:53:06,684  - anneal_factor: "0.5"
2020-06-19 16:53:06,684  - max_epochs: "200"
2020-06-19 16:53:06,684  - shuffle: "True"
2020-06-19 16:53:06,684  - train_with_dev: "False"
2020-06-19 16:53:06,684  - batch_growth_annealing: "False"
2020-06-19 16:53:06,684 ----------------------------------------------------------------------------------------------------
2020-06-19 16:53:06,684 Model training base path: "/home/tmp/hunflair_small/species"
2020-06-19 16:53:06,684 ----------------------------------------------------------------------------------------------------
2020-06-19 16:53:06,684 Device: cuda:0
2020-06-19 16:53:06,684 ----------------------------------------------------------------------------------------------------
2020-06-19 16:53:06,684 Embeddings storage mode: cpu
2020-06-19 16:53:06,685 ----------------------------------------------------------------------------------------------------
2020-06-19 16:54:08,883 epoch 1 - iter 138/1389 - loss 2.25351053 - samples/sec: 71.02
2020-06-19 16:55:14,371 epoch 1 - iter 276/1389 - loss 1.49870968 - samples/sec: 67.47
2020-06-19 16:56:16,927 epoch 1 - iter 414/1389 - loss 1.23112494 - samples/sec: 70.63
2020-06-19 16:57:33,889 epoch 1 - iter 552/1389 - loss 1.07303351 - samples/sec: 57.40
2020-06-19 16:58:44,706 epoch 1 - iter 690/1389 - loss 0.97682477 - samples/sec: 62.39
2020-06-19 16:59:49,210 epoch 1 - iter 828/1389 - loss 0.89896163 - samples/sec: 68.49
2020-06-19 17:00:57,188 epoch 1 - iter 966/1389 - loss 0.84725242 - samples/sec: 65.00
2020-06-19 17:02:12,640 epoch 1 - iter 1104/1389 - loss 0.80675979 - samples/sec: 58.55
2020-06-19 17:03:13,435 epoch 1 - iter 1242/1389 - loss 0.78579527 - samples/sec: 72.67
2020-06-19 17:04:15,175 epoch 1 - iter 1380/1389 - loss 0.75362532 - samples/sec: 71.56
2020-06-19 17:04:18,827 ----------------------------------------------------------------------------------------------------
2020-06-19 17:04:18,827 EPOCH 1 done: loss 0.7516 - lr 0.1000000
2020-06-19 17:05:09,850 DEV : loss 0.2772071361541748 - score 0.797
2020-06-19 17:05:10,917 BAD EPOCHS (no improvement): 0
2020-06-19 17:05:22,598 ----------------------------------------------------------------------------------------------------
2020-06-19 17:05:59,470 epoch 2 - iter 138/1389 - loss 0.43956046 - samples/sec: 119.84
2020-06-19 17:06:36,352 epoch 2 - iter 276/1389 - loss 0.45203363 - samples/sec: 119.85
2020-06-19 17:07:09,355 epoch 2 - iter 414/1389 - loss 0.44975724 - samples/sec: 133.92
2020-06-19 17:07:43,844 epoch 2 - iter 552/1389 - loss 0.45290017 - samples/sec: 128.14
2020-06-19 17:08:15,899 epoch 2 - iter 690/1389 - loss 0.44188993 - samples/sec: 137.89
2020-06-19 17:08:55,694 epoch 2 - iter 828/1389 - loss 0.44529156 - samples/sec: 111.06
2020-06-19 17:09:31,285 epoch 2 - iter 966/1389 - loss 0.43786127 - samples/sec: 124.18
2020-06-19 17:10:12,293 epoch 2 - iter 1104/1389 - loss 0.43459309 - samples/sec: 107.76
2020-06-19 17:10:45,955 epoch 2 - iter 1242/1389 - loss 0.43324514 - samples/sec: 131.29
2020-06-19 17:11:27,361 epoch 2 - iter 1380/1389 - loss 0.42973605 - samples/sec: 106.75
2020-06-19 17:11:29,469 ----------------------------------------------------------------------------------------------------
2020-06-19 17:11:29,469 EPOCH 2 done: loss 0.4302 - lr 0.1000000
2020-06-19 17:11:52,004 DEV : loss 0.27865806221961975 - score 0.7972
2020-06-19 17:11:53,070 BAD EPOCHS (no improvement): 0
2020-06-19 17:12:01,789 ----------------------------------------------------------------------------------------------------
2020-06-19 17:12:38,748 epoch 3 - iter 138/1389 - loss 0.41431257 - samples/sec: 119.56
2020-06-19 17:13:13,540 epoch 3 - iter 276/1389 - loss 0.38909115 - samples/sec: 127.05
2020-06-19 17:13:45,302 epoch 3 - iter 414/1389 - loss 0.39128287 - samples/sec: 139.16
2020-06-19 17:14:19,773 epoch 3 - iter 552/1389 - loss 0.39231027 - samples/sec: 128.22
2020-06-19 17:15:00,564 epoch 3 - iter 690/1389 - loss 0.39798172 - samples/sec: 108.35
2020-06-19 17:15:40,103 epoch 3 - iter 828/1389 - loss 0.40116702 - samples/sec: 111.78
2020-06-19 17:16:11,513 epoch 3 - iter 966/1389 - loss 0.39753077 - samples/sec: 140.72
2020-06-19 17:16:43,576 epoch 3 - iter 1104/1389 - loss 0.39354142 - samples/sec: 137.85
2020-06-19 17:17:21,364 epoch 3 - iter 1242/1389 - loss 0.38750922 - samples/sec: 117.00
2020-06-19 17:17:54,822 epoch 3 - iter 1380/1389 - loss 0.38583885 - samples/sec: 132.10
2020-06-19 17:17:56,814 ----------------------------------------------------------------------------------------------------
2020-06-19 17:17:56,815 EPOCH 3 done: loss 0.3860 - lr 0.1000000
2020-06-19 17:18:20,262 DEV : loss 0.2577091455459595 - score 0.8057
2020-06-19 17:18:21,434 BAD EPOCHS (no improvement): 0
2020-06-19 17:18:32,878 ----------------------------------------------------------------------------------------------------
2020-06-19 17:19:10,532 epoch 4 - iter 138/1389 - loss 0.37314205 - samples/sec: 117.35
2020-06-19 17:19:43,509 epoch 4 - iter 276/1389 - loss 0.36537836 - samples/sec: 134.03
2020-06-19 17:20:19,158 epoch 4 - iter 414/1389 - loss 0.36736549 - samples/sec: 123.98
2020-06-19 17:20:58,704 epoch 4 - iter 552/1389 - loss 0.36317980 - samples/sec: 111.78
2020-06-19 17:21:33,564 epoch 4 - iter 690/1389 - loss 0.36601593 - samples/sec: 126.77
2020-06-19 17:22:10,056 epoch 4 - iter 828/1389 - loss 0.36244734 - samples/sec: 121.11
2020-06-19 17:22:46,650 epoch 4 - iter 966/1389 - loss 0.36151328 - samples/sec: 120.77
2020-06-19 17:23:20,263 epoch 4 - iter 1104/1389 - loss 0.36126500 - samples/sec: 131.49
2020-06-19 17:23:55,542 epoch 4 - iter 1242/1389 - loss 0.36010105 - samples/sec: 125.27
2020-06-19 17:24:26,879 epoch 4 - iter 1380/1389 - loss 0.35303532 - samples/sec: 141.04
2020-06-19 17:24:28,904 ----------------------------------------------------------------------------------------------------
2020-06-19 17:24:28,905 EPOCH 4 done: loss 0.3530 - lr 0.1000000
2020-06-19 17:24:47,137 DEV : loss 0.23177240788936615 - score 0.812
2020-06-19 17:24:47,865 BAD EPOCHS (no improvement): 0
2020-06-19 17:24:55,876 ----------------------------------------------------------------------------------------------------
2020-06-19 17:25:34,509 epoch 5 - iter 138/1389 - loss 0.32297238 - samples/sec: 114.38
2020-06-19 17:26:09,999 epoch 5 - iter 276/1389 - loss 0.32739985 - samples/sec: 124.55
2020-06-19 17:26:50,377 epoch 5 - iter 414/1389 - loss 0.32523103 - samples/sec: 109.45
2020-06-19 17:27:27,795 epoch 5 - iter 552/1389 - loss 0.32916275 - samples/sec: 118.13
2020-06-19 17:28:03,294 epoch 5 - iter 690/1389 - loss 0.33117079 - samples/sec: 124.56
2020-06-19 17:28:34,558 epoch 5 - iter 828/1389 - loss 0.33267696 - samples/sec: 141.39
2020-06-19 17:29:06,723 epoch 5 - iter 966/1389 - loss 0.33233496 - samples/sec: 137.41
2020-06-19 17:29:39,896 epoch 5 - iter 1104/1389 - loss 0.33331567 - samples/sec: 133.23
2020-06-19 17:30:12,360 epoch 5 - iter 1242/1389 - loss 0.33206641 - samples/sec: 136.16
2020-06-19 17:30:46,073 epoch 5 - iter 1380/1389 - loss 0.33498647 - samples/sec: 131.10
2020-06-19 17:30:48,011 ----------------------------------------------------------------------------------------------------
2020-06-19 17:30:48,011 EPOCH 5 done: loss 0.3354 - lr 0.1000000
2020-06-19 17:31:19,510 DEV : loss 0.22248129546642303 - score 0.811
2020-06-19 17:31:20,579 BAD EPOCHS (no improvement): 1
2020-06-19 17:31:20,579 ----------------------------------------------------------------------------------------------------
2020-06-19 17:31:54,406 epoch 6 - iter 138/1389 - loss 0.28108418 - samples/sec: 130.63
2020-06-19 17:32:27,223 epoch 6 - iter 276/1389 - loss 0.29313431 - samples/sec: 134.69
2020-06-19 17:33:00,078 epoch 6 - iter 414/1389 - loss 0.31936273 - samples/sec: 134.53
2020-06-19 17:33:35,500 epoch 6 - iter 552/1389 - loss 0.31881081 - samples/sec: 124.77
2020-06-19 17:34:09,592 epoch 6 - iter 690/1389 - loss 0.32142290 - samples/sec: 129.64
2020-06-19 17:34:43,404 epoch 6 - iter 828/1389 - loss 0.32341665 - samples/sec: 130.72
2020-06-19 17:35:17,466 epoch 6 - iter 966/1389 - loss 0.31839144 - samples/sec: 129.76
2020-06-19 17:35:49,375 epoch 6 - iter 1104/1389 - loss 0.31705952 - samples/sec: 138.52
2020-06-19 17:36:19,990 epoch 6 - iter 1242/1389 - loss 0.31782819 - samples/sec: 144.39
2020-06-19 17:36:51,168 epoch 6 - iter 1380/1389 - loss 0.31666919 - samples/sec: 141.77
2020-06-19 17:36:53,200 ----------------------------------------------------------------------------------------------------
2020-06-19 17:36:53,200 EPOCH 6 done: loss 0.3166 - lr 0.1000000
2020-06-19 17:37:13,495 DEV : loss 0.23335908353328705 - score 0.8144
2020-06-19 17:37:14,249 BAD EPOCHS (no improvement): 0
2020-06-19 17:37:24,039 ----------------------------------------------------------------------------------------------------
2020-06-19 17:37:58,174 epoch 7 - iter 138/1389 - loss 0.32035499 - samples/sec: 129.44
2020-06-19 17:38:31,547 epoch 7 - iter 276/1389 - loss 0.30147480 - samples/sec: 132.44
2020-06-19 17:39:06,528 epoch 7 - iter 414/1389 - loss 0.30778797 - samples/sec: 126.35
2020-06-19 17:39:38,955 epoch 7 - iter 552/1389 - loss 0.31487758 - samples/sec: 136.31
2020-06-19 17:40:11,690 epoch 7 - iter 690/1389 - loss 0.31315019 - samples/sec: 135.02
2020-06-19 17:40:46,674 epoch 7 - iter 828/1389 - loss 0.31506063 - samples/sec: 126.34
2020-06-19 17:41:19,209 epoch 7 - iter 966/1389 - loss 0.31424961 - samples/sec: 135.86
2020-06-19 17:41:54,092 epoch 7 - iter 1104/1389 - loss 0.31762811 - samples/sec: 126.70
2020-06-19 17:42:24,743 epoch 7 - iter 1242/1389 - loss 0.31491834 - samples/sec: 144.21
2020-06-19 17:42:57,027 epoch 7 - iter 1380/1389 - loss 0.31354259 - samples/sec: 136.91
2020-06-19 17:42:58,695 ----------------------------------------------------------------------------------------------------
2020-06-19 17:42:58,696 EPOCH 7 done: loss 0.3129 - lr 0.1000000
2020-06-19 17:43:17,853 DEV : loss 0.21986661851406097 - score 0.8226
2020-06-19 17:43:18,679 BAD EPOCHS (no improvement): 0
2020-06-19 17:43:27,272 ----------------------------------------------------------------------------------------------------
2020-06-19 17:43:59,186 epoch 8 - iter 138/1389 - loss 0.31517428 - samples/sec: 138.46
2020-06-19 17:44:31,382 epoch 8 - iter 276/1389 - loss 0.30513764 - samples/sec: 137.28
2020-06-19 17:45:01,303 epoch 8 - iter 414/1389 - loss 0.29679286 - samples/sec: 147.73
2020-06-19 17:45:35,102 epoch 8 - iter 552/1389 - loss 0.30012661 - samples/sec: 130.77
2020-06-19 17:46:07,969 epoch 8 - iter 690/1389 - loss 0.29474903 - samples/sec: 134.48
2020-06-19 17:46:41,544 epoch 8 - iter 828/1389 - loss 0.29683438 - samples/sec: 131.64
2020-06-19 17:47:11,794 epoch 8 - iter 966/1389 - loss 0.30076618 - samples/sec: 146.11
2020-06-19 17:47:41,491 epoch 8 - iter 1104/1389 - loss 0.30145463 - samples/sec: 148.83
2020-06-19 17:48:11,662 epoch 8 - iter 1242/1389 - loss 0.30000909 - samples/sec: 146.50
2020-06-19 17:48:44,020 epoch 8 - iter 1380/1389 - loss 0.30005195 - samples/sec: 136.58
2020-06-19 17:48:45,873 ----------------------------------------------------------------------------------------------------
2020-06-19 17:48:45,874 EPOCH 8 done: loss 0.2993 - lr 0.1000000
2020-06-19 17:49:04,242 DEV : loss 0.21887274086475372 - score 0.8197
2020-06-19 17:49:04,975 BAD EPOCHS (no improvement): 1
2020-06-19 17:49:04,976 ----------------------------------------------------------------------------------------------------
2020-06-19 17:49:34,236 epoch 9 - iter 138/1389 - loss 0.25861704 - samples/sec: 151.01
2020-06-19 17:50:05,172 epoch 9 - iter 276/1389 - loss 0.26267886 - samples/sec: 142.87
2020-06-19 17:50:46,439 epoch 9 - iter 414/1389 - loss 0.27698060 - samples/sec: 107.09
2020-06-19 17:51:21,031 epoch 9 - iter 552/1389 - loss 0.28397791 - samples/sec: 127.77
2020-06-19 17:51:51,853 epoch 9 - iter 690/1389 - loss 0.28868134 - samples/sec: 143.41
2020-06-19 17:52:24,457 epoch 9 - iter 828/1389 - loss 0.29009549 - samples/sec: 135.56
2020-06-19 17:52:57,713 epoch 9 - iter 966/1389 - loss 0.28866622 - samples/sec: 132.91
2020-06-19 17:53:29,639 epoch 9 - iter 1104/1389 - loss 0.28762007 - samples/sec: 138.44
2020-06-19 17:54:00,553 epoch 9 - iter 1242/1389 - loss 0.28667444 - samples/sec: 142.98
2020-06-19 17:54:31,997 epoch 9 - iter 1380/1389 - loss 0.28585716 - samples/sec: 140.57
2020-06-19 17:54:33,766 ----------------------------------------------------------------------------------------------------
2020-06-19 17:54:33,766 EPOCH 9 done: loss 0.2863 - lr 0.1000000
2020-06-19 17:54:52,813 DEV : loss 0.2208486944437027 - score 0.8131
2020-06-19 17:54:53,619 BAD EPOCHS (no improvement): 2
2020-06-19 17:54:53,620 ----------------------------------------------------------------------------------------------------
2020-06-19 17:55:25,032 epoch 10 - iter 138/1389 - loss 0.26062039 - samples/sec: 140.67
2020-06-19 17:55:57,284 epoch 10 - iter 276/1389 - loss 0.25766401 - samples/sec: 137.05
2020-06-19 17:56:29,878 epoch 10 - iter 414/1389 - loss 0.26122977 - samples/sec: 135.61
2020-06-19 17:57:01,462 epoch 10 - iter 552/1389 - loss 0.27085060 - samples/sec: 139.95
2020-06-19 17:57:33,279 epoch 10 - iter 690/1389 - loss 0.27181773 - samples/sec: 138.92
2020-06-19 17:58:07,745 epoch 10 - iter 828/1389 - loss 0.27252443 - samples/sec: 128.24
2020-06-19 17:58:40,892 epoch 10 - iter 966/1389 - loss 0.27548512 - samples/sec: 133.34
2020-06-19 17:59:14,757 epoch 10 - iter 1104/1389 - loss 0.27735346 - samples/sec: 130.51
2020-06-19 17:59:47,639 epoch 10 - iter 1242/1389 - loss 0.27682066 - samples/sec: 134.42
2020-06-19 18:00:19,258 epoch 10 - iter 1380/1389 - loss 0.27589398 - samples/sec: 139.79
2020-06-19 18:00:21,122 ----------------------------------------------------------------------------------------------------
2020-06-19 18:00:21,122 EPOCH 10 done: loss 0.2764 - lr 0.1000000
2020-06-19 18:00:39,293 DEV : loss 0.2051359862089157 - score 0.8201
2020-06-19 18:00:40,024 BAD EPOCHS (no improvement): 3
2020-06-19 18:00:40,024 ----------------------------------------------------------------------------------------------------
2020-06-19 18:01:10,234 epoch 11 - iter 138/1389 - loss 0.29386540 - samples/sec: 146.26
2020-06-19 18:01:45,178 epoch 11 - iter 276/1389 - loss 0.27470853 - samples/sec: 126.48
2020-06-19 18:02:15,453 epoch 11 - iter 414/1389 - loss 0.26821610 - samples/sec: 145.99
2020-06-19 18:02:49,788 epoch 11 - iter 552/1389 - loss 0.26471791 - samples/sec: 128.73
2020-06-19 18:03:25,454 epoch 11 - iter 690/1389 - loss 0.26959949 - samples/sec: 123.92
2020-06-19 18:03:56,704 epoch 11 - iter 828/1389 - loss 0.27399615 - samples/sec: 141.43
2020-06-19 18:04:29,083 epoch 11 - iter 966/1389 - loss 0.27357292 - samples/sec: 136.50
2020-06-19 18:05:01,709 epoch 11 - iter 1104/1389 - loss 0.27407492 - samples/sec: 135.46
2020-06-19 18:05:32,921 epoch 11 - iter 1242/1389 - loss 0.27434874 - samples/sec: 141.62
2020-06-19 18:06:03,778 epoch 11 - iter 1380/1389 - loss 0.27280067 - samples/sec: 143.25
2020-06-19 18:06:06,041 ----------------------------------------------------------------------------------------------------
2020-06-19 18:06:06,041 EPOCH 11 done: loss 0.2731 - lr 0.1000000
2020-06-19 18:06:25,438 DEV : loss 0.2146209478378296 - score 0.8193
2020-06-19 18:06:26,261 BAD EPOCHS (no improvement): 4
2020-06-19 18:06:26,261 ----------------------------------------------------------------------------------------------------
2020-06-19 18:06:58,553 epoch 12 - iter 138/1389 - loss 0.25105828 - samples/sec: 136.84
2020-06-19 18:07:31,574 epoch 12 - iter 276/1389 - loss 0.25339460 - samples/sec: 133.85
2020-06-19 18:08:03,544 epoch 12 - iter 414/1389 - loss 0.24722020 - samples/sec: 138.25
2020-06-19 18:08:36,754 epoch 12 - iter 552/1389 - loss 0.25313747 - samples/sec: 133.09
2020-06-19 18:09:08,796 epoch 12 - iter 690/1389 - loss 0.24575554 - samples/sec: 137.95
2020-06-19 18:09:40,879 epoch 12 - iter 828/1389 - loss 0.24435056 - samples/sec: 137.76
2020-06-19 18:10:15,033 epoch 12 - iter 966/1389 - loss 0.24325115 - samples/sec: 129.40
2020-06-19 18:10:47,532 epoch 12 - iter 1104/1389 - loss 0.24627319 - samples/sec: 136.00
2020-06-19 18:11:23,148 epoch 12 - iter 1242/1389 - loss 0.24562505 - samples/sec: 124.08
2020-06-19 18:11:53,663 epoch 12 - iter 1380/1389 - loss 0.24939681 - samples/sec: 144.84
2020-06-19 18:11:55,375 ----------------------------------------------------------------------------------------------------
2020-06-19 18:11:55,375 EPOCH 12 done: loss 0.2492 - lr 0.0500000
2020-06-19 18:12:13,597 DEV : loss 0.2039700299501419 - score 0.8208
2020-06-19 18:12:14,325 BAD EPOCHS (no improvement): 1
2020-06-19 18:12:14,325 ----------------------------------------------------------------------------------------------------
2020-06-19 18:12:45,508 epoch 13 - iter 138/1389 - loss 0.23634150 - samples/sec: 141.69
2020-06-19 18:13:15,631 epoch 13 - iter 276/1389 - loss 0.24351540 - samples/sec: 146.73
2020-06-19 18:13:46,625 epoch 13 - iter 414/1389 - loss 0.23714474 - samples/sec: 142.60
2020-06-19 18:14:19,825 epoch 13 - iter 552/1389 - loss 0.24390538 - samples/sec: 133.13
2020-06-19 18:14:58,944 epoch 13 - iter 690/1389 - loss 0.24775047 - samples/sec: 112.97
2020-06-19 18:15:29,724 epoch 13 - iter 828/1389 - loss 0.24563929 - samples/sec: 143.60
2020-06-19 18:16:00,838 epoch 13 - iter 966/1389 - loss 0.24479164 - samples/sec: 142.06
2020-06-19 18:16:31,827 epoch 13 - iter 1104/1389 - loss 0.24341783 - samples/sec: 142.63
2020-06-19 18:17:04,428 epoch 13 - iter 1242/1389 - loss 0.24397449 - samples/sec: 135.57
2020-06-19 18:17:37,411 epoch 13 - iter 1380/1389 - loss 0.24508835 - samples/sec: 134.00
2020-06-19 18:17:39,494 ----------------------------------------------------------------------------------------------------
2020-06-19 18:17:39,495 EPOCH 13 done: loss 0.2451 - lr 0.0500000
2020-06-19 18:17:58,577 DEV : loss 0.21072444319725037 - score 0.8222
2020-06-19 18:17:59,380 BAD EPOCHS (no improvement): 2
2020-06-19 18:17:59,381 ----------------------------------------------------------------------------------------------------
2020-06-19 18:18:32,174 epoch 14 - iter 138/1389 - loss 0.23782716 - samples/sec: 134.73
2020-06-19 18:19:04,890 epoch 14 - iter 276/1389 - loss 0.22911639 - samples/sec: 135.10
2020-06-19 18:19:43,789 epoch 14 - iter 414/1389 - loss 0.22578322 - samples/sec: 113.61
2020-06-19 18:20:17,912 epoch 14 - iter 552/1389 - loss 0.23195517 - samples/sec: 129.52
2020-06-19 18:20:51,405 epoch 14 - iter 690/1389 - loss 0.23500434 - samples/sec: 131.96
2020-06-19 18:21:21,461 epoch 14 - iter 828/1389 - loss 0.23182040 - samples/sec: 147.06
2020-06-19 18:21:54,372 epoch 14 - iter 966/1389 - loss 0.23177595 - samples/sec: 134.29
2020-06-19 18:22:25,398 epoch 14 - iter 1104/1389 - loss 0.23100803 - samples/sec: 142.47
2020-06-19 18:22:56,889 epoch 14 - iter 1242/1389 - loss 0.23170823 - samples/sec: 140.36
2020-06-19 18:23:28,900 epoch 14 - iter 1380/1389 - loss 0.23374495 - samples/sec: 138.07
2020-06-19 18:23:30,512 ----------------------------------------------------------------------------------------------------
2020-06-19 18:23:30,513 EPOCH 14 done: loss 0.2336 - lr 0.0500000
2020-06-19 18:23:48,829 DEV : loss 0.2101210057735443 - score 0.8206
2020-06-19 18:23:49,561 BAD EPOCHS (no improvement): 3
2020-06-19 18:23:49,561 ----------------------------------------------------------------------------------------------------
2020-06-19 18:24:22,172 epoch 15 - iter 138/1389 - loss 0.22430054 - samples/sec: 135.49
2020-06-19 18:24:55,088 epoch 15 - iter 276/1389 - loss 0.22443562 - samples/sec: 134.28
2020-06-19 18:25:26,691 epoch 15 - iter 414/1389 - loss 0.21984464 - samples/sec: 139.86
2020-06-19 18:26:01,514 epoch 15 - iter 552/1389 - loss 0.22101482 - samples/sec: 126.92
2020-06-19 18:26:33,698 epoch 15 - iter 690/1389 - loss 0.22474251 - samples/sec: 137.34
2020-06-19 18:27:05,926 epoch 15 - iter 828/1389 - loss 0.22574467 - samples/sec: 137.15
2020-06-19 18:27:37,917 epoch 15 - iter 966/1389 - loss 0.22812823 - samples/sec: 138.17
2020-06-19 18:28:13,677 epoch 15 - iter 1104/1389 - loss 0.23175549 - samples/sec: 123.59
2020-06-19 18:28:47,278 epoch 15 - iter 1242/1389 - loss 0.23237070 - samples/sec: 131.55
2020-06-19 18:29:19,690 epoch 15 - iter 1380/1389 - loss 0.23111018 - samples/sec: 136.37
2020-06-19 18:29:22,084 ----------------------------------------------------------------------------------------------------
2020-06-19 18:29:22,084 EPOCH 15 done: loss 0.2310 - lr 0.0500000
2020-06-19 18:29:50,327 DEV : loss 0.20868700742721558 - score 0.8273
2020-06-19 18:29:51,143 BAD EPOCHS (no improvement): 0
2020-06-19 18:29:59,967 ----------------------------------------------------------------------------------------------------
2020-06-19 18:30:34,804 epoch 16 - iter 138/1389 - loss 0.22830831 - samples/sec: 126.84
2020-06-19 18:31:04,739 epoch 16 - iter 276/1389 - loss 0.23235288 - samples/sec: 147.65
2020-06-19 18:31:45,002 epoch 16 - iter 414/1389 - loss 0.22769124 - samples/sec: 109.75
2020-06-19 18:32:21,282 epoch 16 - iter 552/1389 - loss 0.23239391 - samples/sec: 121.82
2020-06-19 18:32:58,279 epoch 16 - iter 690/1389 - loss 0.22927599 - samples/sec: 119.45
2020-06-19 18:33:30,599 epoch 16 - iter 828/1389 - loss 0.22536678 - samples/sec: 136.76
2020-06-19 18:34:01,878 epoch 16 - iter 966/1389 - loss 0.22663129 - samples/sec: 141.30
2020-06-19 18:34:38,439 epoch 16 - iter 1104/1389 - loss 0.22452148 - samples/sec: 120.87
2020-06-19 18:35:11,066 epoch 16 - iter 1242/1389 - loss 0.22499383 - samples/sec: 135.47
2020-06-19 18:35:41,248 epoch 16 - iter 1380/1389 - loss 0.22548365 - samples/sec: 146.44
2020-06-19 18:35:43,036 ----------------------------------------------------------------------------------------------------
2020-06-19 18:35:43,037 EPOCH 16 done: loss 0.2254 - lr 0.0500000
2020-06-19 18:36:01,604 DEV : loss 0.2045600414276123 - score 0.8249
2020-06-19 18:36:02,341 BAD EPOCHS (no improvement): 1
2020-06-19 18:36:02,342 ----------------------------------------------------------------------------------------------------
2020-06-19 18:36:35,377 epoch 17 - iter 138/1389 - loss 0.20664665 - samples/sec: 133.74
2020-06-19 18:37:06,449 epoch 17 - iter 276/1389 - loss 0.22201333 - samples/sec: 142.25
2020-06-19 18:37:38,920 epoch 17 - iter 414/1389 - loss 0.22218693 - samples/sec: 136.11
2020-06-19 18:38:09,164 epoch 17 - iter 552/1389 - loss 0.22050115 - samples/sec: 146.15
2020-06-19 18:38:40,345 epoch 17 - iter 690/1389 - loss 0.22909116 - samples/sec: 141.74
2020-06-19 18:39:13,300 epoch 17 - iter 828/1389 - loss 0.23026074 - samples/sec: 134.12
2020-06-19 18:39:44,632 epoch 17 - iter 966/1389 - loss 0.22822104 - samples/sec: 141.06
2020-06-19 18:40:14,928 epoch 17 - iter 1104/1389 - loss 0.22376791 - samples/sec: 145.89
2020-06-19 18:40:43,820 epoch 17 - iter 1242/1389 - loss 0.22337219 - samples/sec: 152.98
2020-06-19 18:41:13,012 epoch 17 - iter 1380/1389 - loss 0.22230548 - samples/sec: 151.41
2020-06-19 18:41:14,815 ----------------------------------------------------------------------------------------------------
2020-06-19 18:41:14,815 EPOCH 17 done: loss 0.2224 - lr 0.0500000
2020-06-19 18:41:33,690 DEV : loss 0.20746156573295593 - score 0.826
2020-06-19 18:41:34,770 BAD EPOCHS (no improvement): 2
2020-06-19 18:41:34,771 ----------------------------------------------------------------------------------------------------
2020-06-19 18:42:07,200 epoch 18 - iter 138/1389 - loss 0.21201872 - samples/sec: 136.25
2020-06-19 18:42:37,304 epoch 18 - iter 276/1389 - loss 0.22072040 - samples/sec: 146.82
2020-06-19 18:43:10,077 epoch 18 - iter 414/1389 - loss 0.21401782 - samples/sec: 134.85
2020-06-19 18:43:41,384 epoch 18 - iter 552/1389 - loss 0.21447724 - samples/sec: 141.17
2020-06-19 18:44:16,984 epoch 18 - iter 690/1389 - loss 0.21267732 - samples/sec: 124.15
2020-06-19 18:44:49,673 epoch 18 - iter 828/1389 - loss 0.21193681 - samples/sec: 135.21
2020-06-19 18:45:19,863 epoch 18 - iter 966/1389 - loss 0.21475935 - samples/sec: 146.40
2020-06-19 18:45:48,914 epoch 18 - iter 1104/1389 - loss 0.21538400 - samples/sec: 152.16
2020-06-19 18:46:21,293 epoch 18 - iter 1242/1389 - loss 0.21894814 - samples/sec: 136.50
2020-06-19 18:46:50,212 epoch 18 - iter 1380/1389 - loss 0.21924262 - samples/sec: 152.85
2020-06-19 18:46:52,612 ----------------------------------------------------------------------------------------------------
2020-06-19 18:46:52,612 EPOCH 18 done: loss 0.2201 - lr 0.0500000
2020-06-19 18:47:13,676 DEV : loss 0.21122901141643524 - score 0.8169
2020-06-19 18:47:14,741 BAD EPOCHS (no improvement): 3
2020-06-19 18:47:14,742 ----------------------------------------------------------------------------------------------------
2020-06-19 18:47:47,728 epoch 19 - iter 138/1389 - loss 0.20996582 - samples/sec: 133.95
2020-06-19 18:48:19,851 epoch 19 - iter 276/1389 - loss 0.20683580 - samples/sec: 137.59
2020-06-19 18:48:50,293 epoch 19 - iter 414/1389 - loss 0.20564939 - samples/sec: 145.20
2020-06-19 18:49:21,998 epoch 19 - iter 552/1389 - loss 0.21634985 - samples/sec: 139.40
2020-06-19 18:49:52,635 epoch 19 - iter 690/1389 - loss 0.21798827 - samples/sec: 144.27
2020-06-19 18:50:26,764 epoch 19 - iter 828/1389 - loss 0.21585644 - samples/sec: 129.49
2020-06-19 18:50:57,673 epoch 19 - iter 966/1389 - loss 0.21475545 - samples/sec: 142.99
2020-06-19 18:51:29,041 epoch 19 - iter 1104/1389 - loss 0.21471972 - samples/sec: 140.90
2020-06-19 18:52:01,136 epoch 19 - iter 1242/1389 - loss 0.21552128 - samples/sec: 137.72
2020-06-19 18:52:32,898 epoch 19 - iter 1380/1389 - loss 0.21553896 - samples/sec: 139.16
2020-06-19 18:52:34,707 ----------------------------------------------------------------------------------------------------
2020-06-19 18:52:34,707 EPOCH 19 done: loss 0.2149 - lr 0.0500000
2020-06-19 18:52:55,107 DEV : loss 0.2085421234369278 - score 0.8268
2020-06-19 18:52:55,847 BAD EPOCHS (no improvement): 4
2020-06-19 18:52:55,847 ----------------------------------------------------------------------------------------------------
2020-06-19 18:53:28,062 epoch 20 - iter 138/1389 - loss 0.18501376 - samples/sec: 137.16
2020-06-19 18:53:59,294 epoch 20 - iter 276/1389 - loss 0.18984561 - samples/sec: 141.51
2020-06-19 18:54:30,300 epoch 20 - iter 414/1389 - loss 0.19363433 - samples/sec: 142.56
2020-06-19 18:55:05,391 epoch 20 - iter 552/1389 - loss 0.19785633 - samples/sec: 125.94
2020-06-19 18:55:38,118 epoch 20 - iter 690/1389 - loss 0.19988317 - samples/sec: 135.06
2020-06-19 18:56:10,149 epoch 20 - iter 828/1389 - loss 0.20099276 - samples/sec: 137.99
2020-06-19 18:56:43,219 epoch 20 - iter 966/1389 - loss 0.20328190 - samples/sec: 133.65
2020-06-19 18:57:14,220 epoch 20 - iter 1104/1389 - loss 0.20519210 - samples/sec: 142.58
2020-06-19 18:57:46,031 epoch 20 - iter 1242/1389 - loss 0.20391076 - samples/sec: 138.95
2020-06-19 18:58:19,959 epoch 20 - iter 1380/1389 - loss 0.20464437 - samples/sec: 130.27
2020-06-19 18:58:22,365 ----------------------------------------------------------------------------------------------------
2020-06-19 18:58:22,365 EPOCH 20 done: loss 0.2049 - lr 0.0250000
2020-06-19 18:58:41,367 DEV : loss 0.2036011815071106 - score 0.8256
2020-06-19 18:58:42,176 BAD EPOCHS (no improvement): 1
2020-06-19 18:58:42,176 ----------------------------------------------------------------------------------------------------
2020-06-19 18:59:13,365 epoch 21 - iter 138/1389 - loss 0.19715513 - samples/sec: 141.68
2020-06-19 18:59:46,041 epoch 21 - iter 276/1389 - loss 0.20305617 - samples/sec: 135.26
2020-06-19 19:00:20,343 epoch 21 - iter 414/1389 - loss 0.20572607 - samples/sec: 128.85
2020-06-19 19:00:54,000 epoch 21 - iter 552/1389 - loss 0.20498103 - samples/sec: 131.32
2020-06-19 19:01:30,828 epoch 21 - iter 690/1389 - loss 0.20760466 - samples/sec: 120.01
2020-06-19 19:02:03,064 epoch 21 - iter 828/1389 - loss 0.20429818 - samples/sec: 137.11
2020-06-19 19:02:34,484 epoch 21 - iter 966/1389 - loss 0.20518517 - samples/sec: 140.66
2020-06-19 19:03:08,383 epoch 21 - iter 1104/1389 - loss 0.20580951 - samples/sec: 130.38
2020-06-19 19:03:43,111 epoch 21 - iter 1242/1389 - loss 0.20557649 - samples/sec: 127.25
2020-06-19 19:04:19,108 epoch 21 - iter 1380/1389 - loss 0.20517177 - samples/sec: 122.78
2020-06-19 19:04:21,137 ----------------------------------------------------------------------------------------------------
2020-06-19 19:04:21,137 EPOCH 21 done: loss 0.2055 - lr 0.0250000
2020-06-19 19:04:40,470 DEV : loss 0.20442578196525574 - score 0.8279
2020-06-19 19:04:41,277 BAD EPOCHS (no improvement): 0
2020-06-19 19:04:49,740 ----------------------------------------------------------------------------------------------------
2020-06-19 19:05:22,021 epoch 22 - iter 138/1389 - loss 0.21094433 - samples/sec: 136.88
2020-06-19 19:05:54,891 epoch 22 - iter 276/1389 - loss 0.20874841 - samples/sec: 134.46
2020-06-19 19:06:26,717 epoch 22 - iter 414/1389 - loss 0.20444402 - samples/sec: 138.88
2020-06-19 19:07:00,220 epoch 22 - iter 552/1389 - loss 0.20504825 - samples/sec: 131.93
2020-06-19 19:07:32,726 epoch 22 - iter 690/1389 - loss 0.20287181 - samples/sec: 135.97
2020-06-19 19:08:03,939 epoch 22 - iter 828/1389 - loss 0.20200361 - samples/sec: 141.61
2020-06-19 19:08:36,839 epoch 22 - iter 966/1389 - loss 0.20024843 - samples/sec: 134.35
2020-06-19 19:09:10,809 epoch 22 - iter 1104/1389 - loss 0.19910715 - samples/sec: 130.11
2020-06-19 19:09:42,518 epoch 22 - iter 1242/1389 - loss 0.19917256 - samples/sec: 139.40
2020-06-19 19:10:14,497 epoch 22 - iter 1380/1389 - loss 0.19667850 - samples/sec: 138.23
2020-06-19 19:10:16,315 ----------------------------------------------------------------------------------------------------
2020-06-19 19:10:16,316 EPOCH 22 done: loss 0.1967 - lr 0.0250000
2020-06-19 19:10:44,106 DEV : loss 0.21021071076393127 - score 0.8162
2020-06-19 19:10:44,917 BAD EPOCHS (no improvement): 1
2020-06-19 19:10:44,917 ----------------------------------------------------------------------------------------------------
2020-06-19 19:11:19,520 epoch 23 - iter 138/1389 - loss 0.18839906 - samples/sec: 127.69
2020-06-19 19:11:57,688 epoch 23 - iter 276/1389 - loss 0.19371988 - samples/sec: 115.79
2020-06-19 19:12:29,912 epoch 23 - iter 414/1389 - loss 0.19317381 - samples/sec: 137.16
2020-06-19 19:12:59,115 epoch 23 - iter 552/1389 - loss 0.19733897 - samples/sec: 151.35
2020-06-19 19:13:32,550 epoch 23 - iter 690/1389 - loss 0.19349747 - samples/sec: 132.18
2020-06-19 19:14:03,137 epoch 23 - iter 828/1389 - loss 0.19412145 - samples/sec: 144.50
2020-06-19 19:14:34,630 epoch 23 - iter 966/1389 - loss 0.19221980 - samples/sec: 140.35
2020-06-19 19:15:08,829 epoch 23 - iter 1104/1389 - loss 0.19253686 - samples/sec: 129.24
2020-06-19 19:15:41,462 epoch 23 - iter 1242/1389 - loss 0.19355267 - samples/sec: 135.44
2020-06-19 19:16:12,832 epoch 23 - iter 1380/1389 - loss 0.19564687 - samples/sec: 140.90
2020-06-19 19:16:14,681 ----------------------------------------------------------------------------------------------------
2020-06-19 19:16:14,681 EPOCH 23 done: loss 0.1956 - lr 0.0250000
2020-06-19 19:16:33,919 DEV : loss 0.20929549634456635 - score 0.823
2020-06-19 19:16:34,734 BAD EPOCHS (no improvement): 2
2020-06-19 19:16:34,734 ----------------------------------------------------------------------------------------------------
2020-06-19 19:17:06,189 epoch 24 - iter 138/1389 - loss 0.19766531 - samples/sec: 140.48
2020-06-19 19:17:38,390 epoch 24 - iter 276/1389 - loss 0.21518094 - samples/sec: 137.26
2020-06-19 19:18:09,011 epoch 24 - iter 414/1389 - loss 0.21471891 - samples/sec: 144.35
2020-06-19 19:18:39,916 epoch 24 - iter 552/1389 - loss 0.20668889 - samples/sec: 143.02
2020-06-19 19:19:13,811 epoch 24 - iter 690/1389 - loss 0.20205297 - samples/sec: 130.41
2020-06-19 19:19:45,017 epoch 24 - iter 828/1389 - loss 0.19816372 - samples/sec: 141.65
2020-06-19 19:20:17,748 epoch 24 - iter 966/1389 - loss 0.19863423 - samples/sec: 135.03
2020-06-19 19:20:51,243 epoch 24 - iter 1104/1389 - loss 0.19722739 - samples/sec: 131.95
2020-06-19 19:21:21,928 epoch 24 - iter 1242/1389 - loss 0.19642455 - samples/sec: 144.04
2020-06-19 19:21:51,621 epoch 24 - iter 1380/1389 - loss 0.19551814 - samples/sec: 148.86
2020-06-19 19:21:54,229 ----------------------------------------------------------------------------------------------------
2020-06-19 19:21:54,232 EPOCH 24 done: loss 0.1955 - lr 0.0250000
2020-06-19 19:22:16,118 DEV : loss 0.2043142020702362 - score 0.8275
2020-06-19 19:22:17,186 BAD EPOCHS (no improvement): 3
2020-06-19 19:22:17,186 ----------------------------------------------------------------------------------------------------
2020-06-19 19:22:50,880 epoch 25 - iter 138/1389 - loss 0.19251601 - samples/sec: 131.13
2020-06-19 19:23:25,226 epoch 25 - iter 276/1389 - loss 0.18553321 - samples/sec: 128.68
2020-06-19 19:23:56,420 epoch 25 - iter 414/1389 - loss 0.18787665 - samples/sec: 141.74
2020-06-19 19:24:28,550 epoch 25 - iter 552/1389 - loss 0.18609816 - samples/sec: 137.57
2020-06-19 19:25:00,041 epoch 25 - iter 690/1389 - loss 0.18744931 - samples/sec: 140.36
2020-06-19 19:25:32,619 epoch 25 - iter 828/1389 - loss 0.18467016 - samples/sec: 135.67
2020-06-19 19:26:04,556 epoch 25 - iter 966/1389 - loss 0.18812883 - samples/sec: 138.40
2020-06-19 19:26:36,162 epoch 25 - iter 1104/1389 - loss 0.19176091 - samples/sec: 139.85
2020-06-19 19:27:07,848 epoch 25 - iter 1242/1389 - loss 0.19053771 - samples/sec: 139.50
2020-06-19 19:27:40,805 epoch 25 - iter 1380/1389 - loss 0.19001496 - samples/sec: 134.11
2020-06-19 19:27:42,682 ----------------------------------------------------------------------------------------------------
2020-06-19 19:27:42,683 EPOCH 25 done: loss 0.1913 - lr 0.0250000
2020-06-19 19:28:03,680 DEV : loss 0.2045268416404724 - score 0.8278
2020-06-19 19:28:04,773 BAD EPOCHS (no improvement): 4
2020-06-19 19:28:04,774 ----------------------------------------------------------------------------------------------------
2020-06-19 19:28:36,958 epoch 26 - iter 138/1389 - loss 0.20102907 - samples/sec: 137.29
2020-06-19 19:29:08,151 epoch 26 - iter 276/1389 - loss 0.18424661 - samples/sec: 141.69
2020-06-19 19:29:52,405 epoch 26 - iter 414/1389 - loss 0.18180565 - samples/sec: 99.85
2020-06-19 19:30:28,000 epoch 26 - iter 552/1389 - loss 0.18710989 - samples/sec: 124.17
2020-06-19 19:31:02,018 epoch 26 - iter 690/1389 - loss 0.18778178 - samples/sec: 129.92
2020-06-19 19:31:37,542 epoch 26 - iter 828/1389 - loss 0.18941481 - samples/sec: 124.40
2020-06-19 19:32:07,489 epoch 26 - iter 966/1389 - loss 0.18938525 - samples/sec: 147.61
2020-06-19 19:32:38,141 epoch 26 - iter 1104/1389 - loss 0.18890085 - samples/sec: 144.20
2020-06-19 19:33:12,334 epoch 26 - iter 1242/1389 - loss 0.18782311 - samples/sec: 129.26
2020-06-19 19:33:42,676 epoch 26 - iter 1380/1389 - loss 0.18674787 - samples/sec: 145.68
2020-06-19 19:33:44,490 ----------------------------------------------------------------------------------------------------
2020-06-19 19:33:44,491 EPOCH 26 done: loss 0.1871 - lr 0.0125000
2020-06-19 19:34:04,073 DEV : loss 0.2088390737771988 - score 0.8234
2020-06-19 19:34:04,893 BAD EPOCHS (no improvement): 1
2020-06-19 19:34:04,894 ----------------------------------------------------------------------------------------------------
2020-06-19 19:34:36,506 epoch 27 - iter 138/1389 - loss 0.18927577 - samples/sec: 139.78
2020-06-19 19:35:08,577 epoch 27 - iter 276/1389 - loss 0.17947498 - samples/sec: 137.82
2020-06-19 19:35:40,906 epoch 27 - iter 414/1389 - loss 0.18427455 - samples/sec: 136.72
2020-06-19 19:36:12,563 epoch 27 - iter 552/1389 - loss 0.18527351 - samples/sec: 139.62
2020-06-19 19:36:43,404 epoch 27 - iter 690/1389 - loss 0.18462055 - samples/sec: 143.31
2020-06-19 19:37:15,468 epoch 27 - iter 828/1389 - loss 0.18305197 - samples/sec: 137.84
2020-06-19 19:37:45,562 epoch 27 - iter 966/1389 - loss 0.18186053 - samples/sec: 146.88
2020-06-19 19:38:18,357 epoch 27 - iter 1104/1389 - loss 0.18172180 - samples/sec: 134.77
2020-06-19 19:38:48,868 epoch 27 - iter 1242/1389 - loss 0.18392773 - samples/sec: 144.87
2020-06-19 19:39:21,206 epoch 27 - iter 1380/1389 - loss 0.18470925 - samples/sec: 136.68
2020-06-19 19:39:23,583 ----------------------------------------------------------------------------------------------------
2020-06-19 19:39:23,583 EPOCH 27 done: loss 0.1849 - lr 0.0125000
2020-06-19 19:39:42,506 DEV : loss 0.2067234069108963 - score 0.825
2020-06-19 19:39:43,303 BAD EPOCHS (no improvement): 2
2020-06-19 19:39:43,304 ----------------------------------------------------------------------------------------------------
2020-06-19 19:40:14,504 epoch 28 - iter 138/1389 - loss 0.19585191 - samples/sec: 141.63
2020-06-19 19:40:48,041 epoch 28 - iter 276/1389 - loss 0.18873417 - samples/sec: 131.79
2020-06-19 19:41:23,937 epoch 28 - iter 414/1389 - loss 0.18338516 - samples/sec: 123.12
2020-06-19 19:41:56,915 epoch 28 - iter 552/1389 - loss 0.18302929 - samples/sec: 134.03
2020-06-19 19:42:29,474 epoch 28 - iter 690/1389 - loss 0.18708043 - samples/sec: 135.75
2020-06-19 19:43:02,108 epoch 28 - iter 828/1389 - loss 0.18877808 - samples/sec: 135.43
2020-06-19 19:43:34,938 epoch 28 - iter 966/1389 - loss 0.18842422 - samples/sec: 134.62
2020-06-19 19:44:10,488 epoch 28 - iter 1104/1389 - loss 0.18967666 - samples/sec: 124.31
2020-06-19 19:44:49,037 epoch 28 - iter 1242/1389 - loss 0.18805790 - samples/sec: 114.64
2020-06-19 19:45:20,716 epoch 28 - iter 1380/1389 - loss 0.18765480 - samples/sec: 139.52
2020-06-19 19:45:22,726 ----------------------------------------------------------------------------------------------------
2020-06-19 19:45:22,727 EPOCH 28 done: loss 0.1877 - lr 0.0125000
2020-06-19 19:45:41,567 DEV : loss 0.2119482010602951 - score 0.8294
2020-06-19 19:45:42,365 BAD EPOCHS (no improvement): 0
2020-06-19 19:45:51,121 ----------------------------------------------------------------------------------------------------
2020-06-19 19:46:21,634 epoch 29 - iter 138/1389 - loss 0.18136824 - samples/sec: 144.81
2020-06-19 19:46:53,247 epoch 29 - iter 276/1389 - loss 0.17454731 - samples/sec: 139.80
2020-06-19 19:47:25,702 epoch 29 - iter 414/1389 - loss 0.17696447 - samples/sec: 136.19
2020-06-19 19:47:59,361 epoch 29 - iter 552/1389 - loss 0.18331089 - samples/sec: 131.31
2020-06-19 19:48:33,955 epoch 29 - iter 690/1389 - loss 0.18613688 - samples/sec: 127.76
2020-06-19 19:49:05,443 epoch 29 - iter 828/1389 - loss 0.18766257 - samples/sec: 140.37
2020-06-19 19:49:37,500 epoch 29 - iter 966/1389 - loss 0.18344997 - samples/sec: 137.88
2020-06-19 19:50:09,206 epoch 29 - iter 1104/1389 - loss 0.18433643 - samples/sec: 139.41
2020-06-19 19:50:51,331 epoch 29 - iter 1242/1389 - loss 0.18419928 - samples/sec: 104.90
2020-06-19 19:51:24,012 epoch 29 - iter 1380/1389 - loss 0.18400227 - samples/sec: 135.24
2020-06-19 19:51:25,704 ----------------------------------------------------------------------------------------------------
2020-06-19 19:51:25,704 EPOCH 29 done: loss 0.1844 - lr 0.0125000
2020-06-19 19:51:46,092 DEV : loss 0.20870336890220642 - score 0.8262
2020-06-19 19:51:47,176 BAD EPOCHS (no improvement): 1
2020-06-19 19:51:47,177 ----------------------------------------------------------------------------------------------------
2020-06-19 19:52:17,419 epoch 30 - iter 138/1389 - loss 0.16097004 - samples/sec: 146.11
2020-06-19 19:52:48,807 epoch 30 - iter 276/1389 - loss 0.16850728 - samples/sec: 140.81
2020-06-19 19:53:23,898 epoch 30 - iter 414/1389 - loss 0.17507976 - samples/sec: 125.94
2020-06-19 19:54:00,934 epoch 30 - iter 552/1389 - loss 0.17589878 - samples/sec: 119.33
2020-06-19 19:54:32,214 epoch 30 - iter 690/1389 - loss 0.17757512 - samples/sec: 141.30
2020-06-19 19:55:04,736 epoch 30 - iter 828/1389 - loss 0.17692342 - samples/sec: 135.90
2020-06-19 19:55:37,314 epoch 30 - iter 966/1389 - loss 0.17814020 - samples/sec: 135.66
2020-06-19 19:56:10,371 epoch 30 - iter 1104/1389 - loss 0.17894385 - samples/sec: 133.70
2020-06-19 19:56:38,744 epoch 30 - iter 1242/1389 - loss 0.17730948 - samples/sec: 155.78
2020-06-19 19:57:09,334 epoch 30 - iter 1380/1389 - loss 0.17887998 - samples/sec: 144.49
2020-06-19 19:57:12,030 ----------------------------------------------------------------------------------------------------
2020-06-19 19:57:12,030 EPOCH 30 done: loss 0.1797 - lr 0.0125000
2020-06-19 19:57:30,192 DEV : loss 0.2104576826095581 - score 0.8258
2020-06-19 19:57:30,927 BAD EPOCHS (no improvement): 2
2020-06-19 19:57:30,927 ----------------------------------------------------------------------------------------------------
2020-06-19 19:58:01,716 epoch 31 - iter 138/1389 - loss 0.18486793 - samples/sec: 143.51
2020-06-19 19:58:32,243 epoch 31 - iter 276/1389 - loss 0.18447618 - samples/sec: 144.78
2020-06-19 19:59:05,491 epoch 31 - iter 414/1389 - loss 0.18010210 - samples/sec: 132.93
2020-06-19 19:59:36,588 epoch 31 - iter 552/1389 - loss 0.17699361 - samples/sec: 142.13
2020-06-19 20:00:06,517 epoch 31 - iter 690/1389 - loss 0.17527247 - samples/sec: 147.68
2020-06-19 20:00:41,876 epoch 31 - iter 828/1389 - loss 0.17840713 - samples/sec: 124.98
2020-06-19 20:01:14,507 epoch 31 - iter 966/1389 - loss 0.17667630 - samples/sec: 135.46
2020-06-19 20:01:47,978 epoch 31 - iter 1104/1389 - loss 0.17762486 - samples/sec: 132.05
2020-06-19 20:02:19,848 epoch 31 - iter 1242/1389 - loss 0.17848622 - samples/sec: 138.69
2020-06-19 20:02:50,955 epoch 31 - iter 1380/1389 - loss 0.18181764 - samples/sec: 142.08
2020-06-19 20:02:52,766 ----------------------------------------------------------------------------------------------------
2020-06-19 20:02:52,767 EPOCH 31 done: loss 0.1820 - lr 0.0125000
2020-06-19 20:03:10,787 DEV : loss 0.2074415236711502 - score 0.8289
2020-06-19 20:03:11,516 BAD EPOCHS (no improvement): 3
2020-06-19 20:03:11,517 ----------------------------------------------------------------------------------------------------
2020-06-19 20:03:40,770 epoch 32 - iter 138/1389 - loss 0.16056477 - samples/sec: 151.04
2020-06-19 20:04:14,181 epoch 32 - iter 276/1389 - loss 0.17823380 - samples/sec: 132.28
2020-06-19 20:04:47,819 epoch 32 - iter 414/1389 - loss 0.17025766 - samples/sec: 131.39
2020-06-19 20:05:18,883 epoch 32 - iter 552/1389 - loss 0.17142201 - samples/sec: 142.28
2020-06-19 20:05:52,360 epoch 32 - iter 690/1389 - loss 0.17365343 - samples/sec: 132.03
2020-06-19 20:06:22,891 epoch 32 - iter 828/1389 - loss 0.17450259 - samples/sec: 144.76
2020-06-19 20:06:53,243 epoch 32 - iter 966/1389 - loss 0.17609109 - samples/sec: 145.62
2020-06-19 20:07:25,340 epoch 32 - iter 1104/1389 - loss 0.17656387 - samples/sec: 137.69
2020-06-19 20:07:54,978 epoch 32 - iter 1242/1389 - loss 0.17677082 - samples/sec: 149.14
2020-06-19 20:08:29,782 epoch 32 - iter 1380/1389 - loss 0.17840431 - samples/sec: 126.98
2020-06-19 20:08:31,791 ----------------------------------------------------------------------------------------------------
2020-06-19 20:08:31,791 EPOCH 32 done: loss 0.1784 - lr 0.0125000
2020-06-19 20:09:00,296 DEV : loss 0.206836998462677 - score 0.8307
2020-06-19 20:09:01,421 BAD EPOCHS (no improvement): 0
2020-06-19 20:09:10,239 ----------------------------------------------------------------------------------------------------
2020-06-19 20:09:42,052 epoch 33 - iter 138/1389 - loss 0.18833302 - samples/sec: 138.90
2020-06-19 20:10:13,341 epoch 33 - iter 276/1389 - loss 0.18169021 - samples/sec: 141.27
2020-06-19 20:10:44,485 epoch 33 - iter 414/1389 - loss 0.18212875 - samples/sec: 141.92
2020-06-19 20:11:14,909 epoch 33 - iter 552/1389 - loss 0.17544645 - samples/sec: 145.28
2020-06-19 20:11:45,674 epoch 33 - iter 690/1389 - loss 0.17689772 - samples/sec: 143.66
2020-06-19 20:12:19,898 epoch 33 - iter 828/1389 - loss 0.17428385 - samples/sec: 129.13
2020-06-19 20:12:51,684 epoch 33 - iter 966/1389 - loss 0.17972540 - samples/sec: 139.05
2020-06-19 20:13:22,369 epoch 33 - iter 1104/1389 - loss 0.18000189 - samples/sec: 144.05
2020-06-19 20:13:56,457 epoch 33 - iter 1242/1389 - loss 0.17978562 - samples/sec: 129.66
2020-06-19 20:14:28,266 epoch 33 - iter 1380/1389 - loss 0.17893508 - samples/sec: 138.96
2020-06-19 20:14:30,695 ----------------------------------------------------------------------------------------------------
2020-06-19 20:14:30,696 EPOCH 33 done: loss 0.1790 - lr 0.0125000
2020-06-19 20:14:50,011 DEV : loss 0.21111971139907837 - score 0.8312
2020-06-19 20:14:50,839 BAD EPOCHS (no improvement): 0
2020-06-19 20:14:59,506 ----------------------------------------------------------------------------------------------------
2020-06-19 20:15:30,535 epoch 34 - iter 138/1389 - loss 0.17316583 - samples/sec: 142.41
2020-06-19 20:16:02,542 epoch 34 - iter 276/1389 - loss 0.17072966 - samples/sec: 138.10
2020-06-19 20:16:36,526 epoch 34 - iter 414/1389 - loss 0.16957361 - samples/sec: 130.06
2020-06-19 20:17:07,901 epoch 34 - iter 552/1389 - loss 0.17001189 - samples/sec: 140.88
2020-06-19 20:17:40,229 epoch 34 - iter 690/1389 - loss 0.17426150 - samples/sec: 136.72
2020-06-19 20:18:14,670 epoch 34 - iter 828/1389 - loss 0.17753427 - samples/sec: 128.33
2020-06-19 20:18:46,978 epoch 34 - iter 966/1389 - loss 0.17700656 - samples/sec: 136.81
2020-06-19 20:19:19,724 epoch 34 - iter 1104/1389 - loss 0.17630538 - samples/sec: 134.98
2020-06-19 20:19:53,054 epoch 34 - iter 1242/1389 - loss 0.17497225 - samples/sec: 132.61
2020-06-19 20:20:25,218 epoch 34 - iter 1380/1389 - loss 0.17508404 - samples/sec: 137.42
2020-06-19 20:20:27,436 ----------------------------------------------------------------------------------------------------
2020-06-19 20:20:27,436 EPOCH 34 done: loss 0.1757 - lr 0.0125000
2020-06-19 20:20:50,202 DEV : loss 0.21149811148643494 - score 0.8278
2020-06-19 20:20:51,273 BAD EPOCHS (no improvement): 1
2020-06-19 20:20:51,274 ----------------------------------------------------------------------------------------------------
2020-06-19 20:21:26,822 epoch 35 - iter 138/1389 - loss 0.18503256 - samples/sec: 124.29
2020-06-19 20:21:58,988 epoch 35 - iter 276/1389 - loss 0.17574656 - samples/sec: 137.41
2020-06-19 20:22:30,874 epoch 35 - iter 414/1389 - loss 0.17931600 - samples/sec: 138.62
2020-06-19 20:23:00,293 epoch 35 - iter 552/1389 - loss 0.17988435 - samples/sec: 150.24
2020-06-19 20:23:30,372 epoch 35 - iter 690/1389 - loss 0.17915044 - samples/sec: 146.94
2020-06-19 20:24:01,540 epoch 35 - iter 828/1389 - loss 0.17927229 - samples/sec: 141.82
2020-06-19 20:24:33,621 epoch 35 - iter 966/1389 - loss 0.17919105 - samples/sec: 137.77
2020-06-19 20:25:06,045 epoch 35 - iter 1104/1389 - loss 0.17950964 - samples/sec: 136.31
2020-06-19 20:25:35,948 epoch 35 - iter 1242/1389 - loss 0.17801751 - samples/sec: 147.82
2020-06-19 20:26:11,108 epoch 35 - iter 1380/1389 - loss 0.17761016 - samples/sec: 125.70
2020-06-19 20:26:12,957 ----------------------------------------------------------------------------------------------------
2020-06-19 20:26:12,958 EPOCH 35 done: loss 0.1779 - lr 0.0125000
2020-06-19 20:26:32,034 DEV : loss 0.21096475422382355 - score 0.8274
2020-06-19 20:26:32,845 BAD EPOCHS (no improvement): 2
2020-06-19 20:26:32,845 ----------------------------------------------------------------------------------------------------
2020-06-19 20:27:05,954 epoch 36 - iter 138/1389 - loss 0.16297307 - samples/sec: 133.46
2020-06-19 20:27:38,127 epoch 36 - iter 276/1389 - loss 0.17000893 - samples/sec: 137.38
2020-06-19 20:28:10,633 epoch 36 - iter 414/1389 - loss 0.17216536 - samples/sec: 135.97
2020-06-19 20:28:50,654 epoch 36 - iter 552/1389 - loss 0.16926337 - samples/sec: 110.42
2020-06-19 20:29:22,495 epoch 36 - iter 690/1389 - loss 0.17276286 - samples/sec: 138.81
2020-06-19 20:29:53,342 epoch 36 - iter 828/1389 - loss 0.17153211 - samples/sec: 143.29
2020-06-19 20:30:25,322 epoch 36 - iter 966/1389 - loss 0.17185747 - samples/sec: 138.21
2020-06-19 20:30:57,782 epoch 36 - iter 1104/1389 - loss 0.17480163 - samples/sec: 136.17
2020-06-19 20:31:30,425 epoch 36 - iter 1242/1389 - loss 0.17512612 - samples/sec: 135.39
2020-06-19 20:32:01,106 epoch 36 - iter 1380/1389 - loss 0.17490323 - samples/sec: 144.05
2020-06-19 20:32:02,718 ----------------------------------------------------------------------------------------------------
2020-06-19 20:32:02,718 EPOCH 36 done: loss 0.1745 - lr 0.0125000
2020-06-19 20:32:22,281 DEV : loss 0.2089347094297409 - score 0.8248
2020-06-19 20:32:23,382 BAD EPOCHS (no improvement): 3
2020-06-19 20:32:23,382 ----------------------------------------------------------------------------------------------------
2020-06-19 20:32:55,143 epoch 37 - iter 138/1389 - loss 0.16385432 - samples/sec: 139.11
2020-06-19 20:33:26,561 epoch 37 - iter 276/1389 - loss 0.16633918 - samples/sec: 140.67
2020-06-19 20:33:56,350 epoch 37 - iter 414/1389 - loss 0.16101264 - samples/sec: 148.37
2020-06-19 20:34:29,572 epoch 37 - iter 552/1389 - loss 0.16175555 - samples/sec: 133.03
2020-06-19 20:35:02,633 epoch 37 - iter 690/1389 - loss 0.16392232 - samples/sec: 133.68
2020-06-19 20:35:32,199 epoch 37 - iter 828/1389 - loss 0.16900682 - samples/sec: 149.49
2020-06-19 20:36:05,115 epoch 37 - iter 966/1389 - loss 0.17278461 - samples/sec: 134.26
2020-06-19 20:36:38,421 epoch 37 - iter 1104/1389 - loss 0.17260791 - samples/sec: 132.70
2020-06-19 20:37:10,555 epoch 37 - iter 1242/1389 - loss 0.17392008 - samples/sec: 137.54
2020-06-19 20:37:41,131 epoch 37 - iter 1380/1389 - loss 0.17382408 - samples/sec: 144.56
2020-06-19 20:37:43,370 ----------------------------------------------------------------------------------------------------
2020-06-19 20:37:43,371 EPOCH 37 done: loss 0.1735 - lr 0.0125000
2020-06-19 20:38:02,490 DEV : loss 0.21221743524074554 - score 0.8308
2020-06-19 20:38:03,221 BAD EPOCHS (no improvement): 4
2020-06-19 20:38:03,221 ----------------------------------------------------------------------------------------------------
2020-06-19 20:38:34,461 epoch 38 - iter 138/1389 - loss 0.17124369 - samples/sec: 141.44
2020-06-19 20:39:07,110 epoch 38 - iter 276/1389 - loss 0.16683851 - samples/sec: 135.37
2020-06-19 20:39:37,930 epoch 38 - iter 414/1389 - loss 0.17848791 - samples/sec: 143.41
2020-06-19 20:40:08,285 epoch 38 - iter 552/1389 - loss 0.17781749 - samples/sec: 145.60
2020-06-19 20:40:39,339 epoch 38 - iter 690/1389 - loss 0.17354157 - samples/sec: 142.32
2020-06-19 20:41:11,915 epoch 38 - iter 828/1389 - loss 0.17489945 - samples/sec: 135.66
2020-06-19 20:41:46,385 epoch 38 - iter 966/1389 - loss 0.17463581 - samples/sec: 128.22
2020-06-19 20:42:16,913 epoch 38 - iter 1104/1389 - loss 0.17517197 - samples/sec: 144.78
2020-06-19 20:42:46,111 epoch 38 - iter 1242/1389 - loss 0.17290228 - samples/sec: 151.38
2020-06-19 20:43:18,034 epoch 38 - iter 1380/1389 - loss 0.17281061 - samples/sec: 138.44
2020-06-19 20:43:21,232 ----------------------------------------------------------------------------------------------------
2020-06-19 20:43:21,233 EPOCH 38 done: loss 0.1729 - lr 0.0062500
2020-06-19 20:43:38,826 DEV : loss 0.211284801363945 - score 0.8277
2020-06-19 20:43:39,560 BAD EPOCHS (no improvement): 1
2020-06-19 20:43:39,560 ----------------------------------------------------------------------------------------------------
2020-06-19 20:44:09,889 epoch 39 - iter 138/1389 - loss 0.18178863 - samples/sec: 145.68
2020-06-19 20:44:39,743 epoch 39 - iter 276/1389 - loss 0.17651621 - samples/sec: 148.05
2020-06-19 20:45:09,096 epoch 39 - iter 414/1389 - loss 0.16876950 - samples/sec: 150.57
2020-06-19 20:45:41,982 epoch 39 - iter 552/1389 - loss 0.16633446 - samples/sec: 134.39
2020-06-19 20:46:14,102 epoch 39 - iter 690/1389 - loss 0.16694128 - samples/sec: 137.60
2020-06-19 20:46:48,264 epoch 39 - iter 828/1389 - loss 0.16485596 - samples/sec: 129.37
2020-06-19 20:47:16,772 epoch 39 - iter 966/1389 - loss 0.16584669 - samples/sec: 155.04
2020-06-19 20:47:50,187 epoch 39 - iter 1104/1389 - loss 0.16597881 - samples/sec: 132.25
2020-06-19 20:48:22,727 epoch 39 - iter 1242/1389 - loss 0.16404525 - samples/sec: 135.82
2020-06-19 20:49:01,257 epoch 39 - iter 1380/1389 - loss 0.16629953 - samples/sec: 114.69
2020-06-19 20:49:03,375 ----------------------------------------------------------------------------------------------------
2020-06-19 20:49:03,376 EPOCH 39 done: loss 0.1671 - lr 0.0062500
2020-06-19 20:49:21,123 DEV : loss 0.21104982495307922 - score 0.8301
2020-06-19 20:49:21,854 BAD EPOCHS (no improvement): 2
2020-06-19 20:49:21,854 ----------------------------------------------------------------------------------------------------
2020-06-19 20:49:53,259 epoch 40 - iter 138/1389 - loss 0.16094828 - samples/sec: 140.70
2020-06-19 20:50:24,768 epoch 40 - iter 276/1389 - loss 0.17044432 - samples/sec: 140.28
2020-06-19 20:50:57,399 epoch 40 - iter 414/1389 - loss 0.16902038 - samples/sec: 135.45
2020-06-19 20:51:28,893 epoch 40 - iter 552/1389 - loss 0.16690320 - samples/sec: 140.34
2020-06-19 20:52:00,978 epoch 40 - iter 690/1389 - loss 0.16972208 - samples/sec: 137.75
2020-06-19 20:52:33,161 epoch 40 - iter 828/1389 - loss 0.16824782 - samples/sec: 137.34
2020-06-19 20:53:05,622 epoch 40 - iter 966/1389 - loss 0.16863489 - samples/sec: 136.15
2020-06-19 20:53:35,606 epoch 40 - iter 1104/1389 - loss 0.16957737 - samples/sec: 147.41
2020-06-19 20:54:07,567 epoch 40 - iter 1242/1389 - loss 0.16750978 - samples/sec: 138.29
2020-06-19 20:54:37,832 epoch 40 - iter 1380/1389 - loss 0.16808956 - samples/sec: 146.05
2020-06-19 20:54:39,664 ----------------------------------------------------------------------------------------------------
2020-06-19 20:54:39,664 EPOCH 40 done: loss 0.1681 - lr 0.0062500
2020-06-19 20:54:58,558 DEV : loss 0.21027308702468872 - score 0.8278
2020-06-19 20:54:59,364 BAD EPOCHS (no improvement): 3
2020-06-19 20:54:59,365 ----------------------------------------------------------------------------------------------------
2020-06-19 20:55:31,644 epoch 41 - iter 138/1389 - loss 0.17294514 - samples/sec: 136.88
2020-06-19 20:56:02,990 epoch 41 - iter 276/1389 - loss 0.16426322 - samples/sec: 141.00
2020-06-19 20:56:34,811 epoch 41 - iter 414/1389 - loss 0.16780479 - samples/sec: 138.89
2020-06-19 20:57:06,644 epoch 41 - iter 552/1389 - loss 0.16870890 - samples/sec: 138.84
2020-06-19 20:57:38,858 epoch 41 - iter 690/1389 - loss 0.16680027 - samples/sec: 137.19
2020-06-19 20:58:09,888 epoch 41 - iter 828/1389 - loss 0.16716979 - samples/sec: 142.44
2020-06-19 20:58:40,604 epoch 41 - iter 966/1389 - loss 0.16628582 - samples/sec: 143.90
2020-06-19 20:59:13,386 epoch 41 - iter 1104/1389 - loss 0.16694500 - samples/sec: 134.82
2020-06-19 20:59:51,457 epoch 41 - iter 1242/1389 - loss 0.16718705 - samples/sec: 116.08
2020-06-19 21:00:28,844 epoch 41 - iter 1380/1389 - loss 0.16711100 - samples/sec: 118.20
2020-06-19 21:00:31,274 ----------------------------------------------------------------------------------------------------
2020-06-19 21:00:31,274 EPOCH 41 done: loss 0.1671 - lr 0.0062500
2020-06-19 21:00:53,762 DEV : loss 0.2118149697780609 - score 0.8257
2020-06-19 21:00:54,822 BAD EPOCHS (no improvement): 4
2020-06-19 21:00:54,823 ----------------------------------------------------------------------------------------------------
2020-06-19 21:01:31,096 epoch 42 - iter 138/1389 - loss 0.17090029 - samples/sec: 121.80
2020-06-19 21:02:05,210 epoch 42 - iter 276/1389 - loss 0.17210863 - samples/sec: 129.56
2020-06-19 21:02:34,749 epoch 42 - iter 414/1389 - loss 0.16595250 - samples/sec: 149.63
2020-06-19 21:03:09,138 epoch 42 - iter 552/1389 - loss 0.16509134 - samples/sec: 128.51
2020-06-19 21:03:41,100 epoch 42 - iter 690/1389 - loss 0.16633805 - samples/sec: 138.28
2020-06-19 21:04:15,542 epoch 42 - iter 828/1389 - loss 0.16426600 - samples/sec: 128.31
2020-06-19 21:04:47,665 epoch 42 - iter 966/1389 - loss 0.16347970 - samples/sec: 137.59
2020-06-19 21:05:19,777 epoch 42 - iter 1104/1389 - loss 0.16303247 - samples/sec: 137.63
2020-06-19 21:05:50,481 epoch 42 - iter 1242/1389 - loss 0.16152381 - samples/sec: 143.95
2020-06-19 21:06:22,875 epoch 42 - iter 1380/1389 - loss 0.16317163 - samples/sec: 136.44
2020-06-19 21:06:24,652 ----------------------------------------------------------------------------------------------------
2020-06-19 21:06:24,652 EPOCH 42 done: loss 0.1633 - lr 0.0031250
2020-06-19 21:06:42,258 DEV : loss 0.21066080033779144 - score 0.8307
2020-06-19 21:06:42,994 BAD EPOCHS (no improvement): 1
2020-06-19 21:06:42,994 ----------------------------------------------------------------------------------------------------
2020-06-19 21:07:19,048 epoch 43 - iter 138/1389 - loss 0.15973761 - samples/sec: 122.54
2020-06-19 21:07:50,366 epoch 43 - iter 276/1389 - loss 0.15837610 - samples/sec: 141.12
2020-06-19 21:08:23,304 epoch 43 - iter 414/1389 - loss 0.15956976 - samples/sec: 134.18
2020-06-19 21:08:51,673 epoch 43 - iter 552/1389 - loss 0.16445488 - samples/sec: 155.81
2020-06-19 21:09:21,619 epoch 43 - iter 690/1389 - loss 0.16550297 - samples/sec: 147.59
2020-06-19 21:09:56,879 epoch 43 - iter 828/1389 - loss 0.16666913 - samples/sec: 125.34
2020-06-19 21:10:28,151 epoch 43 - iter 966/1389 - loss 0.16762771 - samples/sec: 141.33
2020-06-19 21:11:00,072 epoch 43 - iter 1104/1389 - loss 0.16793162 - samples/sec: 138.45
2020-06-19 21:11:30,105 epoch 43 - iter 1242/1389 - loss 0.16661002 - samples/sec: 147.18
2020-06-19 21:12:02,967 epoch 43 - iter 1380/1389 - loss 0.16744522 - samples/sec: 134.49
2020-06-19 21:12:05,689 ----------------------------------------------------------------------------------------------------
2020-06-19 21:12:05,689 EPOCH 43 done: loss 0.1676 - lr 0.0031250
2020-06-19 21:12:24,055 DEV : loss 0.21037109196186066 - score 0.8331
2020-06-19 21:12:24,812 BAD EPOCHS (no improvement): 0
2020-06-19 21:12:32,727 ----------------------------------------------------------------------------------------------------
2020-06-19 21:13:02,590 epoch 44 - iter 138/1389 - loss 0.17190048 - samples/sec: 147.96
2020-06-19 21:13:34,882 epoch 44 - iter 276/1389 - loss 0.16734119 - samples/sec: 136.86
2020-06-19 21:14:09,482 epoch 44 - iter 414/1389 - loss 0.16813276 - samples/sec: 127.74
2020-06-19 21:14:40,207 epoch 44 - iter 552/1389 - loss 0.16584593 - samples/sec: 143.86
2020-06-19 21:15:10,152 epoch 44 - iter 690/1389 - loss 0.16495816 - samples/sec: 147.59
2020-06-19 21:15:40,733 epoch 44 - iter 828/1389 - loss 0.16250696 - samples/sec: 144.52
2020-06-19 21:16:15,109 epoch 44 - iter 966/1389 - loss 0.16364948 - samples/sec: 128.56
2020-06-19 21:16:49,061 epoch 44 - iter 1104/1389 - loss 0.16300015 - samples/sec: 130.17
2020-06-19 21:17:24,422 epoch 44 - iter 1242/1389 - loss 0.16419245 - samples/sec: 124.97
2020-06-19 21:17:57,640 epoch 44 - iter 1380/1389 - loss 0.16448544 - samples/sec: 133.06
2020-06-19 21:17:59,664 ----------------------------------------------------------------------------------------------------
2020-06-19 21:17:59,664 EPOCH 44 done: loss 0.1643 - lr 0.0031250
2020-06-19 21:18:21,002 DEV : loss 0.2110329270362854 - score 0.8316
2020-06-19 21:18:22,064 BAD EPOCHS (no improvement): 1
2020-06-19 21:18:22,064 ----------------------------------------------------------------------------------------------------
2020-06-19 21:18:55,115 epoch 45 - iter 138/1389 - loss 0.14804375 - samples/sec: 133.68
2020-06-19 21:19:25,686 epoch 45 - iter 276/1389 - loss 0.16270152 - samples/sec: 144.58
2020-06-19 21:19:56,850 epoch 45 - iter 414/1389 - loss 0.17061673 - samples/sec: 141.82
2020-06-19 21:20:27,050 epoch 45 - iter 552/1389 - loss 0.16799268 - samples/sec: 146.34
2020-06-19 21:20:59,324 epoch 45 - iter 690/1389 - loss 0.16917185 - samples/sec: 136.94
2020-06-19 21:21:33,307 epoch 45 - iter 828/1389 - loss 0.17044201 - samples/sec: 130.05
2020-06-19 21:22:07,325 epoch 45 - iter 966/1389 - loss 0.17234748 - samples/sec: 129.92
2020-06-19 21:22:42,898 epoch 45 - iter 1104/1389 - loss 0.16915496 - samples/sec: 124.23
2020-06-19 21:23:18,752 epoch 45 - iter 1242/1389 - loss 0.16828140 - samples/sec: 123.26
2020-06-19 21:23:53,206 epoch 45 - iter 1380/1389 - loss 0.16692810 - samples/sec: 128.27
2020-06-19 21:23:55,027 ----------------------------------------------------------------------------------------------------
2020-06-19 21:23:55,027 EPOCH 45 done: loss 0.1666 - lr 0.0031250
2020-06-19 21:24:12,535 DEV : loss 0.21020574867725372 - score 0.8327
2020-06-19 21:24:13,267 BAD EPOCHS (no improvement): 2
2020-06-19 21:24:13,268 ----------------------------------------------------------------------------------------------------
2020-06-19 21:24:45,675 epoch 46 - iter 138/1389 - loss 0.17791813 - samples/sec: 136.34
2020-06-19 21:25:17,681 epoch 46 - iter 276/1389 - loss 0.17458643 - samples/sec: 138.10
2020-06-19 21:25:49,989 epoch 46 - iter 414/1389 - loss 0.16346488 - samples/sec: 136.79
2020-06-19 21:26:19,474 epoch 46 - iter 552/1389 - loss 0.16317366 - samples/sec: 149.89
2020-06-19 21:26:48,687 epoch 46 - iter 690/1389 - loss 0.16343341 - samples/sec: 151.29
2020-06-19 21:27:24,011 epoch 46 - iter 828/1389 - loss 0.16156405 - samples/sec: 125.10
2020-06-19 21:27:51,606 epoch 46 - iter 966/1389 - loss 0.16133480 - samples/sec: 160.17
2020-06-19 21:28:19,401 epoch 46 - iter 1104/1389 - loss 0.16376785 - samples/sec: 159.02
2020-06-19 21:28:50,818 epoch 46 - iter 1242/1389 - loss 0.16409668 - samples/sec: 140.68
2020-06-19 21:29:22,170 epoch 46 - iter 1380/1389 - loss 0.16492174 - samples/sec: 140.98
2020-06-19 21:29:23,990 ----------------------------------------------------------------------------------------------------
2020-06-19 21:29:23,990 EPOCH 46 done: loss 0.1653 - lr 0.0031250
2020-06-19 21:29:41,989 DEV : loss 0.21196232736110687 - score 0.8308
2020-06-19 21:29:42,734 BAD EPOCHS (no improvement): 3
2020-06-19 21:29:42,734 ----------------------------------------------------------------------------------------------------
2020-06-19 21:30:15,746 epoch 47 - iter 138/1389 - loss 0.18216055 - samples/sec: 133.84
2020-06-19 21:30:52,785 epoch 47 - iter 276/1389 - loss 0.16795549 - samples/sec: 119.31
2020-06-19 21:31:24,991 epoch 47 - iter 414/1389 - loss 0.16670530 - samples/sec: 137.24
2020-06-19 21:31:55,663 epoch 47 - iter 552/1389 - loss 0.16840201 - samples/sec: 144.11
2020-06-19 21:32:27,292 epoch 47 - iter 690/1389 - loss 0.16662892 - samples/sec: 139.73
2020-06-19 21:32:58,145 epoch 47 - iter 828/1389 - loss 0.16375373 - samples/sec: 143.25
2020-06-19 21:33:29,763 epoch 47 - iter 966/1389 - loss 0.16514846 - samples/sec: 139.78
2020-06-19 21:34:01,397 epoch 47 - iter 1104/1389 - loss 0.16552650 - samples/sec: 139.71
2020-06-19 21:34:33,606 epoch 47 - iter 1242/1389 - loss 0.16569347 - samples/sec: 137.23
2020-06-19 21:35:06,433 epoch 47 - iter 1380/1389 - loss 0.16617927 - samples/sec: 134.64
2020-06-19 21:35:08,505 ----------------------------------------------------------------------------------------------------
2020-06-19 21:35:08,505 EPOCH 47 done: loss 0.1659 - lr 0.0031250
2020-06-19 21:35:28,497 DEV : loss 0.21171347796916962 - score 0.8324
2020-06-19 21:35:29,232 BAD EPOCHS (no improvement): 4
2020-06-19 21:35:29,233 ----------------------------------------------------------------------------------------------------
2020-06-19 21:36:01,462 epoch 48 - iter 138/1389 - loss 0.16422331 - samples/sec: 137.09
2020-06-19 21:36:33,326 epoch 48 - iter 276/1389 - loss 0.16642421 - samples/sec: 138.71
2020-06-19 21:37:06,542 epoch 48 - iter 414/1389 - loss 0.17073677 - samples/sec: 133.06
2020-06-19 21:37:38,039 epoch 48 - iter 552/1389 - loss 0.17090896 - samples/sec: 140.33
2020-06-19 21:38:11,401 epoch 48 - iter 690/1389 - loss 0.17339336 - samples/sec: 132.48
2020-06-19 21:38:43,281 epoch 48 - iter 828/1389 - loss 0.17215856 - samples/sec: 138.63
2020-06-19 21:39:11,437 epoch 48 - iter 966/1389 - loss 0.16960196 - samples/sec: 156.98
2020-06-19 21:39:44,341 epoch 48 - iter 1104/1389 - loss 0.16809959 - samples/sec: 134.32
2020-06-19 21:40:16,131 epoch 48 - iter 1242/1389 - loss 0.16906730 - samples/sec: 139.04
2020-06-19 21:40:47,718 epoch 48 - iter 1380/1389 - loss 0.16989119 - samples/sec: 139.92
2020-06-19 21:40:49,354 ----------------------------------------------------------------------------------------------------
2020-06-19 21:40:49,354 EPOCH 48 done: loss 0.1697 - lr 0.0015625
2020-06-19 21:41:07,611 DEV : loss 0.21150164306163788 - score 0.8312
2020-06-19 21:41:08,410 BAD EPOCHS (no improvement): 1
2020-06-19 21:41:08,410 ----------------------------------------------------------------------------------------------------
2020-06-19 21:41:40,372 epoch 49 - iter 138/1389 - loss 0.15740429 - samples/sec: 138.24
2020-06-19 21:42:12,709 epoch 49 - iter 276/1389 - loss 0.16706916 - samples/sec: 136.68
2020-06-19 21:42:44,777 epoch 49 - iter 414/1389 - loss 0.16438528 - samples/sec: 137.83
2020-06-19 21:43:15,096 epoch 49 - iter 552/1389 - loss 0.16519858 - samples/sec: 145.78
2020-06-19 21:43:45,711 epoch 49 - iter 690/1389 - loss 0.16764992 - samples/sec: 144.37
2020-06-19 21:44:16,934 epoch 49 - iter 828/1389 - loss 0.16676062 - samples/sec: 141.56
2020-06-19 21:44:48,665 epoch 49 - iter 966/1389 - loss 0.16364216 - samples/sec: 139.29
2020-06-19 21:45:20,664 epoch 49 - iter 1104/1389 - loss 0.16534692 - samples/sec: 138.12
2020-06-19 21:45:53,430 epoch 49 - iter 1242/1389 - loss 0.16382303 - samples/sec: 134.89
2020-06-19 21:46:28,989 epoch 49 - iter 1380/1389 - loss 0.16484226 - samples/sec: 124.28
2020-06-19 21:46:31,323 ----------------------------------------------------------------------------------------------------
2020-06-19 21:46:31,323 EPOCH 49 done: loss 0.1653 - lr 0.0015625
2020-06-19 21:47:00,129 DEV : loss 0.21188999712467194 - score 0.8269
2020-06-19 21:47:01,199 BAD EPOCHS (no improvement): 2
2020-06-19 21:47:01,199 ----------------------------------------------------------------------------------------------------
2020-06-19 21:47:38,745 epoch 50 - iter 138/1389 - loss 0.18374879 - samples/sec: 117.67
2020-06-19 21:48:10,516 epoch 50 - iter 276/1389 - loss 0.17773731 - samples/sec: 139.11
2020-06-19 21:48:40,407 epoch 50 - iter 414/1389 - loss 0.17357161 - samples/sec: 147.88
2020-06-19 21:49:10,830 epoch 50 - iter 552/1389 - loss 0.16759768 - samples/sec: 145.28
2020-06-19 21:49:43,055 epoch 50 - iter 690/1389 - loss 0.16816709 - samples/sec: 137.15
2020-06-19 21:50:13,243 epoch 50 - iter 828/1389 - loss 0.16738762 - samples/sec: 146.41
2020-06-19 21:50:44,760 epoch 50 - iter 966/1389 - loss 0.16603613 - samples/sec: 140.24
2020-06-19 21:51:16,161 epoch 50 - iter 1104/1389 - loss 0.16386245 - samples/sec: 140.75
2020-06-19 21:51:47,939 epoch 50 - iter 1242/1389 - loss 0.16531192 - samples/sec: 139.08
2020-06-19 21:52:21,188 epoch 50 - iter 1380/1389 - loss 0.16377377 - samples/sec: 132.93
2020-06-19 21:52:23,173 ----------------------------------------------------------------------------------------------------
2020-06-19 21:52:23,173 EPOCH 50 done: loss 0.1635 - lr 0.0015625
2020-06-19 21:52:42,112 DEV : loss 0.2115195393562317 - score 0.8322
2020-06-19 21:52:42,921 BAD EPOCHS (no improvement): 3
2020-06-19 21:52:42,921 ----------------------------------------------------------------------------------------------------
2020-06-19 21:53:15,160 epoch 51 - iter 138/1389 - loss 0.15528439 - samples/sec: 137.06
2020-06-19 21:53:45,963 epoch 51 - iter 276/1389 - loss 0.16792582 - samples/sec: 143.49
2020-06-19 21:54:17,905 epoch 51 - iter 414/1389 - loss 0.17255840 - samples/sec: 138.37
2020-06-19 21:54:50,076 epoch 51 - iter 552/1389 - loss 0.17080950 - samples/sec: 137.38
2020-06-19 21:55:22,317 epoch 51 - iter 690/1389 - loss 0.16613298 - samples/sec: 137.09
2020-06-19 21:55:54,787 epoch 51 - iter 828/1389 - loss 0.16391803 - samples/sec: 136.12
2020-06-19 21:56:26,334 epoch 51 - iter 966/1389 - loss 0.16436681 - samples/sec: 140.10
2020-06-19 21:56:57,544 epoch 51 - iter 1104/1389 - loss 0.16568756 - samples/sec: 141.62
2020-06-19 21:57:29,029 epoch 51 - iter 1242/1389 - loss 0.16465781 - samples/sec: 140.38
2020-06-19 21:57:59,076 epoch 51 - iter 1380/1389 - loss 0.16622097 - samples/sec: 147.11
2020-06-19 21:58:01,377 ----------------------------------------------------------------------------------------------------
2020-06-19 21:58:01,378 EPOCH 51 done: loss 0.1661 - lr 0.0015625
2020-06-19 21:58:20,496 DEV : loss 0.21158474683761597 - score 0.8297
2020-06-19 21:58:21,302 BAD EPOCHS (no improvement): 4
2020-06-19 21:58:21,303 ----------------------------------------------------------------------------------------------------
2020-06-19 21:58:55,355 epoch 52 - iter 138/1389 - loss 0.16369267 - samples/sec: 129.75
2020-06-19 21:59:27,445 epoch 52 - iter 276/1389 - loss 0.15953000 - samples/sec: 137.73
2020-06-19 21:59:58,699 epoch 52 - iter 414/1389 - loss 0.16419227 - samples/sec: 141.41
2020-06-19 22:00:28,826 epoch 52 - iter 552/1389 - loss 0.16699150 - samples/sec: 146.71
2020-06-19 22:01:00,052 epoch 52 - iter 690/1389 - loss 0.16502114 - samples/sec: 141.55
2020-06-19 22:01:32,281 epoch 52 - iter 828/1389 - loss 0.16645249 - samples/sec: 137.14
2020-06-19 22:02:05,438 epoch 52 - iter 966/1389 - loss 0.16372446 - samples/sec: 133.31
2020-06-19 22:02:36,817 epoch 52 - iter 1104/1389 - loss 0.16223386 - samples/sec: 140.85
2020-06-19 22:03:07,294 epoch 52 - iter 1242/1389 - loss 0.16292984 - samples/sec: 145.01
2020-06-19 22:03:36,821 epoch 52 - iter 1380/1389 - loss 0.16361919 - samples/sec: 149.69
2020-06-19 22:03:38,743 ----------------------------------------------------------------------------------------------------
2020-06-19 22:03:38,744 EPOCH 52 done: loss 0.1640 - lr 0.0007813
2020-06-19 22:03:56,738 DEV : loss 0.21101169288158417 - score 0.8307
2020-06-19 22:03:57,469 BAD EPOCHS (no improvement): 1
2020-06-19 22:03:57,470 ----------------------------------------------------------------------------------------------------
2020-06-19 22:04:25,874 epoch 53 - iter 138/1389 - loss 0.17694009 - samples/sec: 155.56
2020-06-19 22:04:58,564 epoch 53 - iter 276/1389 - loss 0.16103747 - samples/sec: 135.19
2020-06-19 22:05:36,329 epoch 53 - iter 414/1389 - loss 0.16532181 - samples/sec: 117.01
2020-06-19 22:06:08,198 epoch 53 - iter 552/1389 - loss 0.16790818 - samples/sec: 138.70
2020-06-19 22:06:41,427 epoch 53 - iter 690/1389 - loss 0.17191845 - samples/sec: 133.01
2020-06-19 22:07:12,323 epoch 53 - iter 828/1389 - loss 0.17130570 - samples/sec: 143.06
2020-06-19 22:07:43,555 epoch 53 - iter 966/1389 - loss 0.16793854 - samples/sec: 141.53
2020-06-19 22:08:15,162 epoch 53 - iter 1104/1389 - loss 0.16815272 - samples/sec: 139.83
2020-06-19 22:08:43,977 epoch 53 - iter 1242/1389 - loss 0.16588541 - samples/sec: 153.39
2020-06-19 22:09:17,850 epoch 53 - iter 1380/1389 - loss 0.16481398 - samples/sec: 130.47
2020-06-19 22:09:20,388 ----------------------------------------------------------------------------------------------------
2020-06-19 22:09:20,388 EPOCH 53 done: loss 0.1652 - lr 0.0007813
2020-06-19 22:09:42,702 DEV : loss 0.21123246848583221 - score 0.8281
2020-06-19 22:09:43,760 BAD EPOCHS (no improvement): 2
2020-06-19 22:09:43,761 ----------------------------------------------------------------------------------------------------
2020-06-19 22:10:16,483 epoch 54 - iter 138/1389 - loss 0.15501070 - samples/sec: 135.03
2020-06-19 22:10:50,248 epoch 54 - iter 276/1389 - loss 0.15552167 - samples/sec: 130.89
2020-06-19 22:11:21,043 epoch 54 - iter 414/1389 - loss 0.16356423 - samples/sec: 143.53
2020-06-19 22:11:52,577 epoch 54 - iter 552/1389 - loss 0.16108508 - samples/sec: 140.16
2020-06-19 22:12:25,997 epoch 54 - iter 690/1389 - loss 0.15933577 - samples/sec: 132.24
2020-06-19 22:12:57,104 epoch 54 - iter 828/1389 - loss 0.16302606 - samples/sec: 142.08
2020-06-19 22:13:30,020 epoch 54 - iter 966/1389 - loss 0.16392105 - samples/sec: 134.27
2020-06-19 22:14:00,692 epoch 54 - iter 1104/1389 - loss 0.16483445 - samples/sec: 144.10
2020-06-19 22:14:28,873 epoch 54 - iter 1242/1389 - loss 0.16554134 - samples/sec: 156.84
2020-06-19 22:15:00,625 epoch 54 - iter 1380/1389 - loss 0.16465035 - samples/sec: 139.18
2020-06-19 22:15:03,534 ----------------------------------------------------------------------------------------------------
2020-06-19 22:15:03,534 EPOCH 54 done: loss 0.1650 - lr 0.0007813
2020-06-19 22:15:21,830 DEV : loss 0.2116529941558838 - score 0.828
2020-06-19 22:15:22,638 BAD EPOCHS (no improvement): 3
2020-06-19 22:15:22,638 ----------------------------------------------------------------------------------------------------
2020-06-19 22:15:54,486 epoch 55 - iter 138/1389 - loss 0.16566390 - samples/sec: 138.74
2020-06-19 22:16:24,550 epoch 55 - iter 276/1389 - loss 0.16190284 - samples/sec: 147.03
2020-06-19 22:16:57,441 epoch 55 - iter 414/1389 - loss 0.16503185 - samples/sec: 134.37
2020-06-19 22:17:28,133 epoch 55 - iter 552/1389 - loss 0.16513812 - samples/sec: 144.01
2020-06-19 22:17:58,525 epoch 55 - iter 690/1389 - loss 0.16165111 - samples/sec: 145.43
2020-06-19 22:18:30,141 epoch 55 - iter 828/1389 - loss 0.16181701 - samples/sec: 139.80
2020-06-19 22:19:01,249 epoch 55 - iter 966/1389 - loss 0.16310308 - samples/sec: 142.08
2020-06-19 22:19:35,640 epoch 55 - iter 1104/1389 - loss 0.16599820 - samples/sec: 128.50
2020-06-19 22:20:08,226 epoch 55 - iter 1242/1389 - loss 0.16588500 - samples/sec: 135.63
2020-06-19 22:20:41,257 epoch 55 - iter 1380/1389 - loss 0.16528001 - samples/sec: 133.80
2020-06-19 22:20:42,961 ----------------------------------------------------------------------------------------------------
2020-06-19 22:20:42,961 EPOCH 55 done: loss 0.1649 - lr 0.0007813
2020-06-19 22:21:04,648 DEV : loss 0.21153904497623444 - score 0.8294
2020-06-19 22:21:05,709 BAD EPOCHS (no improvement): 4
2020-06-19 22:21:05,709 ----------------------------------------------------------------------------------------------------
2020-06-19 22:21:41,052 epoch 56 - iter 138/1389 - loss 0.15102276 - samples/sec: 125.01
2020-06-19 22:22:19,812 epoch 56 - iter 276/1389 - loss 0.15625445 - samples/sec: 114.02
2020-06-19 22:22:58,833 epoch 56 - iter 414/1389 - loss 0.16182785 - samples/sec: 113.25
2020-06-19 22:23:31,040 epoch 56 - iter 552/1389 - loss 0.16786290 - samples/sec: 137.23
2020-06-19 22:24:04,434 epoch 56 - iter 690/1389 - loss 0.16837764 - samples/sec: 132.35
2020-06-19 22:24:37,759 epoch 56 - iter 828/1389 - loss 0.16502560 - samples/sec: 132.62
2020-06-19 22:25:10,665 epoch 56 - iter 966/1389 - loss 0.16250176 - samples/sec: 134.32
2020-06-19 22:25:41,819 epoch 56 - iter 1104/1389 - loss 0.16172816 - samples/sec: 141.87
2020-06-19 22:26:21,998 epoch 56 - iter 1242/1389 - loss 0.16061407 - samples/sec: 109.98
2020-06-19 22:26:53,483 epoch 56 - iter 1380/1389 - loss 0.16188221 - samples/sec: 140.37
2020-06-19 22:26:55,578 ----------------------------------------------------------------------------------------------------
2020-06-19 22:26:55,578 EPOCH 56 done: loss 0.1628 - lr 0.0003906
2020-06-19 22:27:16,902 DEV : loss 0.21165283024311066 - score 0.8301
2020-06-19 22:27:17,963 BAD EPOCHS (no improvement): 1
2020-06-19 22:27:17,963 ----------------------------------------------------------------------------------------------------
2020-06-19 22:27:52,606 epoch 57 - iter 138/1389 - loss 0.15092694 - samples/sec: 127.53
2020-06-19 22:28:31,356 epoch 57 - iter 276/1389 - loss 0.15369518 - samples/sec: 114.05
2020-06-19 22:29:02,350 epoch 57 - iter 414/1389 - loss 0.15710233 - samples/sec: 142.61
2020-06-19 22:29:36,509 epoch 57 - iter 552/1389 - loss 0.15646206 - samples/sec: 129.38
2020-06-19 22:30:07,783 epoch 57 - iter 690/1389 - loss 0.15905514 - samples/sec: 141.33
2020-06-19 22:30:38,531 epoch 57 - iter 828/1389 - loss 0.16291857 - samples/sec: 143.75
2020-06-19 22:31:09,901 epoch 57 - iter 966/1389 - loss 0.16521504 - samples/sec: 140.90
2020-06-19 22:31:40,538 epoch 57 - iter 1104/1389 - loss 0.16561117 - samples/sec: 144.26
2020-06-19 22:32:10,562 epoch 57 - iter 1242/1389 - loss 0.16524470 - samples/sec: 147.22
2020-06-19 22:32:41,167 epoch 57 - iter 1380/1389 - loss 0.16352617 - samples/sec: 144.42
2020-06-19 22:32:43,186 ----------------------------------------------------------------------------------------------------
2020-06-19 22:32:43,186 EPOCH 57 done: loss 0.1638 - lr 0.0003906
2020-06-19 22:33:01,545 DEV : loss 0.21169711649417877 - score 0.8307
2020-06-19 22:33:02,367 BAD EPOCHS (no improvement): 2
2020-06-19 22:33:02,367 ----------------------------------------------------------------------------------------------------
2020-06-19 22:33:33,759 epoch 58 - iter 138/1389 - loss 0.15922337 - samples/sec: 140.75
2020-06-19 22:34:04,734 epoch 58 - iter 276/1389 - loss 0.16155215 - samples/sec: 142.69
2020-06-19 22:34:35,889 epoch 58 - iter 414/1389 - loss 0.16404347 - samples/sec: 141.87
2020-06-19 22:35:07,773 epoch 58 - iter 552/1389 - loss 0.16287717 - samples/sec: 138.62
2020-06-19 22:35:39,180 epoch 58 - iter 690/1389 - loss 0.16387249 - samples/sec: 140.73
2020-06-19 22:36:09,025 epoch 58 - iter 828/1389 - loss 0.16559543 - samples/sec: 148.10
2020-06-19 22:36:39,960 epoch 58 - iter 966/1389 - loss 0.16607260 - samples/sec: 142.88
2020-06-19 22:37:11,134 epoch 58 - iter 1104/1389 - loss 0.16642720 - samples/sec: 141.78
2020-06-19 22:37:42,229 epoch 58 - iter 1242/1389 - loss 0.16292766 - samples/sec: 142.15
2020-06-19 22:38:13,624 epoch 58 - iter 1380/1389 - loss 0.16314895 - samples/sec: 140.78
2020-06-19 22:38:15,707 ----------------------------------------------------------------------------------------------------
2020-06-19 22:38:15,707 EPOCH 58 done: loss 0.1630 - lr 0.0003906
2020-06-19 22:38:34,232 DEV : loss 0.21176719665527344 - score 0.8305
2020-06-19 22:38:35,037 BAD EPOCHS (no improvement): 3
2020-06-19 22:38:35,038 ----------------------------------------------------------------------------------------------------
2020-06-19 22:39:05,389 epoch 59 - iter 138/1389 - loss 0.16663353 - samples/sec: 145.59
2020-06-19 22:39:37,243 epoch 59 - iter 276/1389 - loss 0.15681046 - samples/sec: 138.75
2020-06-19 22:40:07,352 epoch 59 - iter 414/1389 - loss 0.16229886 - samples/sec: 146.80
2020-06-19 22:40:38,134 epoch 59 - iter 552/1389 - loss 0.15634303 - samples/sec: 143.59
2020-06-19 22:41:09,544 epoch 59 - iter 690/1389 - loss 0.15925940 - samples/sec: 140.71
2020-06-19 22:41:40,129 epoch 59 - iter 828/1389 - loss 0.15670025 - samples/sec: 144.51
2020-06-19 22:42:10,078 epoch 59 - iter 966/1389 - loss 0.15624345 - samples/sec: 147.59
2020-06-19 22:42:40,736 epoch 59 - iter 1104/1389 - loss 0.15823142 - samples/sec: 144.17
2020-06-19 22:43:12,950 epoch 59 - iter 1242/1389 - loss 0.16018615 - samples/sec: 137.20
2020-06-19 22:43:46,761 epoch 59 - iter 1380/1389 - loss 0.16190464 - samples/sec: 130.71
2020-06-19 22:43:49,197 ----------------------------------------------------------------------------------------------------
2020-06-19 22:43:49,197 EPOCH 59 done: loss 0.1622 - lr 0.0003906
2020-06-19 22:44:14,826 DEV : loss 0.21176813542842865 - score 0.8297
2020-06-19 22:44:15,899 BAD EPOCHS (no improvement): 4
2020-06-19 22:44:15,899 ----------------------------------------------------------------------------------------------------
2020-06-19 22:44:48,546 epoch 60 - iter 138/1389 - loss 0.16652195 - samples/sec: 135.33
2020-06-19 22:45:26,857 epoch 60 - iter 276/1389 - loss 0.15817105 - samples/sec: 115.35
2020-06-19 22:45:57,463 epoch 60 - iter 414/1389 - loss 0.16023728 - samples/sec: 144.42
2020-06-19 22:46:27,641 epoch 60 - iter 552/1389 - loss 0.16117007 - samples/sec: 146.45
2020-06-19 22:47:06,134 epoch 60 - iter 690/1389 - loss 0.16155578 - samples/sec: 114.81
2020-06-19 22:47:42,717 epoch 60 - iter 828/1389 - loss 0.16191369 - samples/sec: 120.80
2020-06-19 22:48:15,252 epoch 60 - iter 966/1389 - loss 0.16085567 - samples/sec: 135.85
2020-06-19 22:48:47,466 epoch 60 - iter 1104/1389 - loss 0.16029273 - samples/sec: 137.20
2020-06-19 22:49:22,221 epoch 60 - iter 1242/1389 - loss 0.16199628 - samples/sec: 127.16
2020-06-19 22:49:54,206 epoch 60 - iter 1380/1389 - loss 0.16238514 - samples/sec: 138.18
2020-06-19 22:49:55,811 ----------------------------------------------------------------------------------------------------
2020-06-19 22:49:55,812 EPOCH 60 done: loss 0.1626 - lr 0.0001953
2020-06-19 22:50:14,320 DEV : loss 0.21175777912139893 - score 0.8297
2020-06-19 22:50:15,381 BAD EPOCHS (no improvement): 1
2020-06-19 22:50:15,382 ----------------------------------------------------------------------------------------------------
2020-06-19 22:50:45,837 epoch 61 - iter 138/1389 - loss 0.16406335 - samples/sec: 145.08
2020-06-19 22:51:22,462 epoch 61 - iter 276/1389 - loss 0.17344539 - samples/sec: 120.65
2020-06-19 22:51:53,690 epoch 61 - iter 414/1389 - loss 0.16797623 - samples/sec: 141.55
2020-06-19 22:52:25,319 epoch 61 - iter 552/1389 - loss 0.16337855 - samples/sec: 139.74
2020-06-19 22:52:57,841 epoch 61 - iter 690/1389 - loss 0.15886958 - samples/sec: 135.90
2020-06-19 22:53:27,571 epoch 61 - iter 828/1389 - loss 0.15841232 - samples/sec: 148.68
2020-06-19 22:53:58,334 epoch 61 - iter 966/1389 - loss 0.16120413 - samples/sec: 143.68
2020-06-19 22:54:29,845 epoch 61 - iter 1104/1389 - loss 0.16273371 - samples/sec: 140.26
2020-06-19 22:55:00,648 epoch 61 - iter 1242/1389 - loss 0.16344639 - samples/sec: 143.50
2020-06-19 22:55:32,387 epoch 61 - iter 1380/1389 - loss 0.16289976 - samples/sec: 139.26
2020-06-19 22:55:34,451 ----------------------------------------------------------------------------------------------------
2020-06-19 22:55:34,452 EPOCH 61 done: loss 0.1624 - lr 0.0001953
2020-06-19 22:55:53,355 DEV : loss 0.21182672679424286 - score 0.8297
2020-06-19 22:55:54,166 BAD EPOCHS (no improvement): 2
2020-06-19 22:55:54,167 ----------------------------------------------------------------------------------------------------
2020-06-19 22:56:27,611 epoch 62 - iter 138/1389 - loss 0.16758248 - samples/sec: 132.11
2020-06-19 22:56:58,978 epoch 62 - iter 276/1389 - loss 0.15671305 - samples/sec: 140.90
2020-06-19 22:57:31,407 epoch 62 - iter 414/1389 - loss 0.16192201 - samples/sec: 136.28
2020-06-19 22:58:06,641 epoch 62 - iter 552/1389 - loss 0.16330629 - samples/sec: 125.43
2020-06-19 22:58:42,994 epoch 62 - iter 690/1389 - loss 0.16393425 - samples/sec: 121.57
2020-06-19 22:59:17,208 epoch 62 - iter 828/1389 - loss 0.16334689 - samples/sec: 129.18
2020-06-19 22:59:48,275 epoch 62 - iter 966/1389 - loss 0.16305397 - samples/sec: 142.27
2020-06-19 23:00:18,712 epoch 62 - iter 1104/1389 - loss 0.16081429 - samples/sec: 145.22
2020-06-19 23:00:49,901 epoch 62 - iter 1242/1389 - loss 0.16305877 - samples/sec: 141.71
2020-06-19 23:01:20,004 epoch 62 - iter 1380/1389 - loss 0.16140671 - samples/sec: 146.83
2020-06-19 23:01:22,223 ----------------------------------------------------------------------------------------------------
2020-06-19 23:01:22,223 EPOCH 62 done: loss 0.1613 - lr 0.0001953
2020-06-19 23:01:44,889 DEV : loss 0.21188555657863617 - score 0.8305
2020-06-19 23:01:45,952 BAD EPOCHS (no improvement): 3
2020-06-19 23:01:45,953 ----------------------------------------------------------------------------------------------------
2020-06-19 23:02:18,612 epoch 63 - iter 138/1389 - loss 0.15768692 - samples/sec: 135.29
2020-06-19 23:02:50,187 epoch 63 - iter 276/1389 - loss 0.15118453 - samples/sec: 139.98
2020-06-19 23:03:19,840 epoch 63 - iter 414/1389 - loss 0.15173310 - samples/sec: 149.06
2020-06-19 23:03:52,135 epoch 63 - iter 552/1389 - loss 0.15902379 - samples/sec: 136.86
2020-06-19 23:04:23,487 epoch 63 - iter 690/1389 - loss 0.15968177 - samples/sec: 140.98
2020-06-19 23:05:03,870 epoch 63 - iter 828/1389 - loss 0.15912078 - samples/sec: 109.42
2020-06-19 23:05:36,072 epoch 63 - iter 966/1389 - loss 0.16270235 - samples/sec: 137.24
2020-06-19 23:06:08,472 epoch 63 - iter 1104/1389 - loss 0.16383952 - samples/sec: 136.42
2020-06-19 23:06:42,143 epoch 63 - iter 1242/1389 - loss 0.16769492 - samples/sec: 131.25
2020-06-19 23:07:13,398 epoch 63 - iter 1380/1389 - loss 0.16701959 - samples/sec: 141.40
2020-06-19 23:07:15,218 ----------------------------------------------------------------------------------------------------
2020-06-19 23:07:15,218 EPOCH 63 done: loss 0.1667 - lr 0.0001953
2020-06-19 23:07:32,859 DEV : loss 0.2118426263332367 - score 0.8297
2020-06-19 23:07:33,658 BAD EPOCHS (no improvement): 4
2020-06-19 23:07:33,658 ----------------------------------------------------------------------------------------------------
2020-06-19 23:07:33,658 ----------------------------------------------------------------------------------------------------
2020-06-19 23:07:33,658 learning rate too small - quitting training!
2020-06-19 23:07:33,658 ----------------------------------------------------------------------------------------------------
2020-06-19 23:07:41,810 ----------------------------------------------------------------------------------------------------
2020-06-19 23:07:41,811 Testing using best model ...
2020-06-19 23:07:41,811 loading file /home/tmp/hunflair_small/species/best-model.pt
2020-06-19 23:08:46,185 0.9349	0.9408	0.9379
2020-06-19 23:08:46,186 
Results:
- F1-score (micro) 0.9379
- F1-score (macro) 0.9379

By class:
Species    tp: 3547 - fp: 247 - fn: 223 - precision: 0.9349 - recall: 0.9408 - f1-score: 0.9379
2020-06-19 23:08:46,186 ----------------------------------------------------------------------------------------------------
2020-06-19 23:08:46,186 ----------------------------------------------------------------------------------------------------
2020-06-19 23:08:50,872 ----------------------------------------------------------------------------------------------------
2020-06-19 23:09:20,572 ----------------------------------------------------------------------------------------------------
2020-06-19 23:10:00,113 ----------------------------------------------------------------------------------------------------
2020-06-19 23:10:01,726 ----------------------------------------------------------------------------------------------------
2020-06-19 23:10:06,060 ----------------------------------------------------------------------------------------------------
2020-06-19 23:10:16,069 ----------------------------------------------------------------------------------------------------