2019-08-11 22:50:42,439 ----------------------------------------------------------------------------------------------------
2019-08-11 22:50:42,439 Model: "SequenceTagger(
  (embeddings): StackedEmbeddings(
    (list_embedding_0): WordEmbeddings('en-crawl')
    (list_embedding_1): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.25)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 1024)
        (decoder): Linear(in_features=1024, out_features=275, bias=True)
      )
    )
    (list_embedding_2): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.25)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 1024)
        (decoder): Linear(in_features=1024, out_features=275, bias=True)
      )
    )
  )
  (word_dropout): WordDropout(p=0.05)
  (locked_dropout): LockedDropout(p=0.5)
  (embedding2nn): Linear(in_features=2348, out_features=2348, bias=True)
  (rnn): LSTM(2348, 256, bidirectional=True)
  (linear): Linear(in_features=512, out_features=76, bias=True)
)"
2019-08-11 22:50:42,440 ----------------------------------------------------------------------------------------------------
2019-08-11 22:50:42,440 Corpus: "Corpus: 75187 train + 9603 dev + 9479 test sentences"
2019-08-11 22:50:42,440 ----------------------------------------------------------------------------------------------------
2019-08-11 22:50:42,440 Parameters:
2019-08-11 22:50:42,440  - learning_rate: "0.1"
2019-08-11 22:50:42,440  - mini_batch_size: "32"
2019-08-11 22:50:42,440  - patience: "3"
2019-08-11 22:50:42,440  - anneal_factor: "0.5"
2019-08-11 22:50:42,440  - max_epochs: "150"
2019-08-11 22:50:42,440  - shuffle: "True"
2019-08-11 22:50:42,440  - train_with_dev: "True"
2019-08-11 22:50:42,440 ----------------------------------------------------------------------------------------------------
2019-08-11 22:50:42,440 Model training base path: "resources/taggers/release-ner-ontonotes-fast-0"
2019-08-11 22:50:42,440 ----------------------------------------------------------------------------------------------------
2019-08-11 22:50:42,441 Device: cuda:0
2019-08-11 22:50:42,441 ----------------------------------------------------------------------------------------------------
2019-08-11 22:50:42,441 Embeddings storage mode: cpu
2019-08-11 22:50:42,441 ----------------------------------------------------------------------------------------------------
2019-08-11 22:50:42,867 epoch 1 - iter 0/2650 - loss 93.27885437 throughput (samples/sec): 20101.51
2019-08-11 22:52:39,048 epoch 1 - iter 265/2650 - loss 9.33639511 throughput (samples/sec): 73.01
2019-08-11 22:54:32,163 epoch 1 - iter 530/2650 - loss 6.71292823 throughput (samples/sec): 74.99
2019-08-11 22:56:24,298 epoch 1 - iter 795/2650 - loss 5.58255861 throughput (samples/sec): 75.65
2019-08-11 22:58:18,705 epoch 1 - iter 1060/2650 - loss 4.87150706 throughput (samples/sec): 74.15
2019-08-11 23:00:16,377 epoch 1 - iter 1325/2650 - loss 4.41063721 throughput (samples/sec): 72.09
2019-08-11 23:02:10,962 epoch 1 - iter 1590/2650 - loss 4.06807156 throughput (samples/sec): 74.03
2019-08-11 23:04:02,034 epoch 1 - iter 1855/2650 - loss 3.77364494 throughput (samples/sec): 76.37
2019-08-11 23:05:53,968 epoch 1 - iter 2120/2650 - loss 3.55703465 throughput (samples/sec): 75.78
2019-08-11 23:07:48,453 epoch 1 - iter 2385/2650 - loss 3.37042186 throughput (samples/sec): 74.09
2019-08-11 23:09:41,215 ----------------------------------------------------------------------------------------------------
2019-08-11 23:09:41,215 EPOCH 1 done: loss 3.2297 - lr 0.1000
2019-08-11 23:09:41,215 BAD EPOCHS (no improvement): 0
2019-08-11 23:09:41,215 ----------------------------------------------------------------------------------------------------
2019-08-11 23:09:41,406 epoch 2 - iter 0/2650 - loss 1.37723410 throughput (samples/sec): 45445.80
2019-08-11 23:10:58,178 epoch 2 - iter 265/2650 - loss 1.78319327 throughput (samples/sec): 110.51
2019-08-11 23:12:14,743 epoch 2 - iter 530/2650 - loss 1.76588508 throughput (samples/sec): 110.81
2019-08-11 23:13:32,474 epoch 2 - iter 795/2650 - loss 1.73996180 throughput (samples/sec): 109.14
2019-08-11 23:14:49,369 epoch 2 - iter 1060/2650 - loss 1.71648701 throughput (samples/sec): 110.33
2019-08-11 23:16:05,863 epoch 2 - iter 1325/2650 - loss 1.68820557 throughput (samples/sec): 110.91
2019-08-11 23:17:22,433 epoch 2 - iter 1590/2650 - loss 1.67023464 throughput (samples/sec): 110.80
2019-08-11 23:18:38,920 epoch 2 - iter 1855/2650 - loss 1.66059833 throughput (samples/sec): 110.92
2019-08-11 23:19:54,464 epoch 2 - iter 2120/2650 - loss 1.63236281 throughput (samples/sec): 112.31
2019-08-11 23:21:11,876 epoch 2 - iter 2385/2650 - loss 1.61103855 throughput (samples/sec): 109.60
2019-08-11 23:22:27,391 ----------------------------------------------------------------------------------------------------
2019-08-11 23:22:27,392 EPOCH 2 done: loss 1.5920 - lr 0.1000
2019-08-11 23:22:27,392 BAD EPOCHS (no improvement): 0
2019-08-11 23:22:27,392 ----------------------------------------------------------------------------------------------------
2019-08-11 23:22:27,668 epoch 3 - iter 0/2650 - loss 0.75175977 throughput (samples/sec): 31140.84
2019-08-11 23:23:43,526 epoch 3 - iter 265/2650 - loss 1.41298393 throughput (samples/sec): 111.84
2019-08-11 23:24:59,595 epoch 3 - iter 530/2650 - loss 1.39253083 throughput (samples/sec): 111.53
2019-08-11 23:26:16,804 epoch 3 - iter 795/2650 - loss 1.38012524 throughput (samples/sec): 109.88
2019-08-11 23:27:34,350 epoch 3 - iter 1060/2650 - loss 1.37410955 throughput (samples/sec): 109.41
2019-08-11 23:28:49,340 epoch 3 - iter 1325/2650 - loss 1.36384223 throughput (samples/sec): 113.14
2019-08-11 23:30:06,810 epoch 3 - iter 1590/2650 - loss 1.35529631 throughput (samples/sec): 109.51
2019-08-11 23:31:21,891 epoch 3 - iter 1855/2650 - loss 1.34216418 throughput (samples/sec): 113.00
2019-08-11 23:32:42,251 epoch 3 - iter 2120/2650 - loss 1.33768734 throughput (samples/sec): 105.57
2019-08-11 23:34:00,076 epoch 3 - iter 2385/2650 - loss 1.33305284 throughput (samples/sec): 109.01
2019-08-11 23:35:15,143 ----------------------------------------------------------------------------------------------------
2019-08-11 23:35:15,144 EPOCH 3 done: loss 1.3207 - lr 0.1000
2019-08-11 23:35:15,144 BAD EPOCHS (no improvement): 0
2019-08-11 23:35:15,144 ----------------------------------------------------------------------------------------------------
2019-08-11 23:35:15,447 epoch 4 - iter 0/2650 - loss 0.96366370 throughput (samples/sec): 28343.35
2019-08-11 23:36:33,626 epoch 4 - iter 265/2650 - loss 1.21046182 throughput (samples/sec): 108.52
2019-08-11 23:37:49,566 epoch 4 - iter 530/2650 - loss 1.20794103 throughput (samples/sec): 111.72
2019-08-11 23:39:05,447 epoch 4 - iter 795/2650 - loss 1.20008042 throughput (samples/sec): 111.81
2019-08-11 23:40:22,865 epoch 4 - iter 1060/2650 - loss 1.19491851 throughput (samples/sec): 109.59
2019-08-11 23:41:38,325 epoch 4 - iter 1325/2650 - loss 1.19520321 throughput (samples/sec): 112.43
2019-08-11 23:42:55,711 epoch 4 - iter 1590/2650 - loss 1.19189769 throughput (samples/sec): 109.63
2019-08-11 23:44:13,709 epoch 4 - iter 1855/2650 - loss 1.18637234 throughput (samples/sec): 108.77
2019-08-11 23:45:30,904 epoch 4 - iter 2120/2650 - loss 1.18345256 throughput (samples/sec): 109.90
2019-08-11 23:46:46,360 epoch 4 - iter 2385/2650 - loss 1.18640365 throughput (samples/sec): 112.44
2019-08-11 23:48:00,931 ----------------------------------------------------------------------------------------------------
2019-08-11 23:48:00,931 EPOCH 4 done: loss 1.1772 - lr 0.1000
2019-08-11 23:48:00,931 BAD EPOCHS (no improvement): 0
2019-08-11 23:48:00,931 ----------------------------------------------------------------------------------------------------
2019-08-11 23:48:01,160 epoch 5 - iter 0/2650 - loss 0.41031361 throughput (samples/sec): 37589.57
2019-08-11 23:49:17,403 epoch 5 - iter 265/2650 - loss 1.07821411 throughput (samples/sec): 111.28
2019-08-11 23:50:33,875 epoch 5 - iter 530/2650 - loss 1.11056713 throughput (samples/sec): 110.94
2019-08-11 23:51:54,549 epoch 5 - iter 795/2650 - loss 1.11387249 throughput (samples/sec): 105.16
2019-08-11 23:53:11,772 epoch 5 - iter 1060/2650 - loss 1.10014518 throughput (samples/sec): 109.86
2019-08-11 23:54:25,965 epoch 5 - iter 1325/2650 - loss 1.08861424 throughput (samples/sec): 114.35
2019-08-11 23:55:41,039 epoch 5 - iter 1590/2650 - loss 1.08507658 throughput (samples/sec): 113.01
2019-08-11 23:56:58,025 epoch 5 - iter 1855/2650 - loss 1.07763641 throughput (samples/sec): 110.20
2019-08-11 23:58:15,431 epoch 5 - iter 2120/2650 - loss 1.07716999 throughput (samples/sec): 109.60
2019-08-11 23:59:32,027 epoch 5 - iter 2385/2650 - loss 1.07708706 throughput (samples/sec): 110.76
2019-08-12 00:00:46,146 ----------------------------------------------------------------------------------------------------
2019-08-12 00:00:46,146 EPOCH 5 done: loss 1.0759 - lr 0.1000
2019-08-12 00:00:46,146 BAD EPOCHS (no improvement): 0
2019-08-12 00:00:46,146 ----------------------------------------------------------------------------------------------------
2019-08-12 00:00:46,478 epoch 6 - iter 0/2650 - loss 0.94811201 throughput (samples/sec): 25869.26
2019-08-12 00:02:02,380 epoch 6 - iter 265/2650 - loss 1.06108795 throughput (samples/sec): 111.78
2019-08-12 00:03:19,498 epoch 6 - iter 530/2650 - loss 1.05279705 throughput (samples/sec): 110.01
2019-08-12 00:04:37,267 epoch 6 - iter 795/2650 - loss 1.03652573 throughput (samples/sec): 109.09
2019-08-12 00:05:52,712 epoch 6 - iter 1060/2650 - loss 1.03950652 throughput (samples/sec): 112.45
2019-08-12 00:07:09,805 epoch 6 - iter 1325/2650 - loss 1.02886132 throughput (samples/sec): 110.05
2019-08-12 00:08:26,940 epoch 6 - iter 1590/2650 - loss 1.03066591 throughput (samples/sec): 109.99
2019-08-12 00:09:44,069 epoch 6 - iter 1855/2650 - loss 1.02265364 throughput (samples/sec): 110.00
2019-08-12 00:10:58,940 epoch 6 - iter 2120/2650 - loss 1.02099631 throughput (samples/sec): 113.32
2019-08-12 00:12:16,074 epoch 6 - iter 2385/2650 - loss 1.01675564 throughput (samples/sec): 109.99
2019-08-12 00:13:32,583 ----------------------------------------------------------------------------------------------------
2019-08-12 00:13:32,583 EPOCH 6 done: loss 1.0153 - lr 0.1000
2019-08-12 00:13:32,583 BAD EPOCHS (no improvement): 0
2019-08-12 00:13:32,583 ----------------------------------------------------------------------------------------------------
2019-08-12 00:13:32,890 epoch 7 - iter 0/2650 - loss 1.08583903 throughput (samples/sec): 27968.60
2019-08-12 00:14:49,553 epoch 7 - iter 265/2650 - loss 1.00285466 throughput (samples/sec): 110.67
2019-08-12 00:16:06,010 epoch 7 - iter 530/2650 - loss 0.96248372 throughput (samples/sec): 110.96
2019-08-12 00:17:22,274 epoch 7 - iter 795/2650 - loss 0.95122987 throughput (samples/sec): 111.25
2019-08-12 00:18:39,488 epoch 7 - iter 1060/2650 - loss 0.96320323 throughput (samples/sec): 109.88
2019-08-12 00:19:55,779 epoch 7 - iter 1325/2650 - loss 0.96225823 throughput (samples/sec): 111.21
2019-08-12 00:21:12,325 epoch 7 - iter 1590/2650 - loss 0.96980482 throughput (samples/sec): 110.84
2019-08-12 00:22:29,108 epoch 7 - iter 1855/2650 - loss 0.96775920 throughput (samples/sec): 110.49
2019-08-12 00:23:45,060 epoch 7 - iter 2120/2650 - loss 0.96006565 throughput (samples/sec): 111.70
2019-08-12 00:25:03,084 epoch 7 - iter 2385/2650 - loss 0.95977661 throughput (samples/sec): 108.74
2019-08-12 00:26:17,129 ----------------------------------------------------------------------------------------------------
2019-08-12 00:26:17,130 EPOCH 7 done: loss 0.9606 - lr 0.1000
2019-08-12 00:26:17,130 BAD EPOCHS (no improvement): 0
2019-08-12 00:26:17,130 ----------------------------------------------------------------------------------------------------
2019-08-12 00:26:17,419 epoch 8 - iter 0/2650 - loss 1.28664112 throughput (samples/sec): 29649.53
2019-08-12 00:27:34,875 epoch 8 - iter 265/2650 - loss 0.94392644 throughput (samples/sec): 109.53
2019-08-12 00:28:51,807 epoch 8 - iter 530/2650 - loss 0.92277775 throughput (samples/sec): 110.28
2019-08-12 00:30:07,827 epoch 8 - iter 795/2650 - loss 0.92422459 throughput (samples/sec): 111.60
2019-08-12 00:31:23,679 epoch 8 - iter 1060/2650 - loss 0.91987960 throughput (samples/sec): 111.85
2019-08-12 00:32:41,952 epoch 8 - iter 1325/2650 - loss 0.92418201 throughput (samples/sec): 108.39
2019-08-12 00:33:58,795 epoch 8 - iter 1590/2650 - loss 0.93260069 throughput (samples/sec): 110.41
2019-08-12 00:35:14,902 epoch 8 - iter 1855/2650 - loss 0.92498404 throughput (samples/sec): 111.48
2019-08-12 00:36:31,502 epoch 8 - iter 2120/2650 - loss 0.91770966 throughput (samples/sec): 110.76
2019-08-12 00:37:47,540 epoch 8 - iter 2385/2650 - loss 0.92156749 throughput (samples/sec): 111.58
2019-08-12 00:39:04,619 ----------------------------------------------------------------------------------------------------
2019-08-12 00:39:04,619 EPOCH 8 done: loss 0.9167 - lr 0.1000
2019-08-12 00:39:04,619 BAD EPOCHS (no improvement): 0
2019-08-12 00:39:04,619 ----------------------------------------------------------------------------------------------------
2019-08-12 00:39:04,879 epoch 9 - iter 0/2650 - loss 0.98737013 throughput (samples/sec): 33096.67
2019-08-12 00:40:22,067 epoch 9 - iter 265/2650 - loss 0.87544215 throughput (samples/sec): 109.91
2019-08-12 00:41:38,458 epoch 9 - iter 530/2650 - loss 0.86691461 throughput (samples/sec): 111.06
2019-08-12 00:42:54,810 epoch 9 - iter 795/2650 - loss 0.88371084 throughput (samples/sec): 111.12
2019-08-12 00:44:11,697 epoch 9 - iter 1060/2650 - loss 0.89462973 throughput (samples/sec): 110.34
2019-08-12 00:45:28,311 epoch 9 - iter 1325/2650 - loss 0.88763925 throughput (samples/sec): 110.74
2019-08-12 00:46:44,418 epoch 9 - iter 1590/2650 - loss 0.89151381 throughput (samples/sec): 111.48
2019-08-12 00:48:01,027 epoch 9 - iter 1855/2650 - loss 0.88853152 throughput (samples/sec): 110.74
2019-08-12 00:49:17,677 epoch 9 - iter 2120/2650 - loss 0.88791644 throughput (samples/sec): 110.69
2019-08-12 00:50:34,799 epoch 9 - iter 2385/2650 - loss 0.88532151 throughput (samples/sec): 110.01
2019-08-12 00:51:51,205 ----------------------------------------------------------------------------------------------------
2019-08-12 00:51:51,205 EPOCH 9 done: loss 0.8836 - lr 0.1000
2019-08-12 00:51:51,205 BAD EPOCHS (no improvement): 0
2019-08-12 00:51:51,205 ----------------------------------------------------------------------------------------------------
2019-08-12 00:51:51,470 epoch 10 - iter 0/2650 - loss 0.80510437 throughput (samples/sec): 32463.39
2019-08-12 00:53:08,755 epoch 10 - iter 265/2650 - loss 0.81880233 throughput (samples/sec): 109.77
2019-08-12 00:54:24,756 epoch 10 - iter 530/2650 - loss 0.82801767 throughput (samples/sec): 111.63
2019-08-12 00:55:41,232 epoch 10 - iter 795/2650 - loss 0.84813060 throughput (samples/sec): 110.94
2019-08-12 00:56:57,619 epoch 10 - iter 1060/2650 - loss 0.84968879 throughput (samples/sec): 111.07
2019-08-12 00:58:12,927 epoch 10 - iter 1325/2650 - loss 0.84818606 throughput (samples/sec): 112.66
2019-08-12 00:59:29,431 epoch 10 - iter 1590/2650 - loss 0.85199198 throughput (samples/sec): 110.90
2019-08-12 01:00:46,626 epoch 10 - iter 1855/2650 - loss 0.85178352 throughput (samples/sec): 109.90
2019-08-12 01:02:04,564 epoch 10 - iter 2120/2650 - loss 0.85723582 throughput (samples/sec): 108.85
2019-08-12 01:03:20,779 epoch 10 - iter 2385/2650 - loss 0.85852778 throughput (samples/sec): 111.32
2019-08-12 01:04:36,949 ----------------------------------------------------------------------------------------------------
2019-08-12 01:04:36,949 EPOCH 10 done: loss 0.8626 - lr 0.1000
2019-08-12 01:04:36,949 BAD EPOCHS (no improvement): 0
2019-08-12 01:04:36,949 ----------------------------------------------------------------------------------------------------
2019-08-12 01:04:37,406 epoch 11 - iter 0/2650 - loss 0.48991239 throughput (samples/sec): 18698.59
2019-08-12 01:05:53,965 epoch 11 - iter 265/2650 - loss 0.82822814 throughput (samples/sec): 110.82
2019-08-12 01:07:12,215 epoch 11 - iter 530/2650 - loss 0.85009571 throughput (samples/sec): 108.42
2019-08-12 01:08:30,214 epoch 11 - iter 795/2650 - loss 0.84995662 throughput (samples/sec): 108.77
2019-08-12 01:09:47,120 epoch 11 - iter 1060/2650 - loss 0.84243374 throughput (samples/sec): 110.32
2019-08-12 01:11:02,746 epoch 11 - iter 1325/2650 - loss 0.83710638 throughput (samples/sec): 112.19
2019-08-12 01:12:19,609 epoch 11 - iter 1590/2650 - loss 0.83233643 throughput (samples/sec): 110.38
2019-08-12 01:13:35,878 epoch 11 - iter 1855/2650 - loss 0.83037493 throughput (samples/sec): 111.24
2019-08-12 01:14:53,904 epoch 11 - iter 2120/2650 - loss 0.83093319 throughput (samples/sec): 108.73
2019-08-12 01:16:07,894 epoch 11 - iter 2385/2650 - loss 0.83466241 throughput (samples/sec): 114.67
2019-08-12 01:17:23,104 ----------------------------------------------------------------------------------------------------
2019-08-12 01:17:23,105 EPOCH 11 done: loss 0.8317 - lr 0.1000
2019-08-12 01:17:23,105 BAD EPOCHS (no improvement): 0
2019-08-12 01:17:23,105 ----------------------------------------------------------------------------------------------------
2019-08-12 01:17:23,765 epoch 12 - iter 0/2650 - loss 1.07251835 throughput (samples/sec): 12918.19
2019-08-12 01:18:39,660 epoch 12 - iter 265/2650 - loss 0.80020585 throughput (samples/sec): 111.79
2019-08-12 01:19:57,052 epoch 12 - iter 530/2650 - loss 0.79878397 throughput (samples/sec): 109.62
2019-08-12 01:21:13,689 epoch 12 - iter 795/2650 - loss 0.78448390 throughput (samples/sec): 110.70
2019-08-12 01:22:30,146 epoch 12 - iter 1060/2650 - loss 0.79549659 throughput (samples/sec): 110.96
2019-08-12 01:23:46,611 epoch 12 - iter 1325/2650 - loss 0.80444375 throughput (samples/sec): 110.95
2019-08-12 01:25:06,360 epoch 12 - iter 1590/2650 - loss 0.80667438 throughput (samples/sec): 106.38
2019-08-12 01:26:22,612 epoch 12 - iter 1855/2650 - loss 0.81011831 throughput (samples/sec): 111.26
2019-08-12 01:27:39,768 epoch 12 - iter 2120/2650 - loss 0.81006443 throughput (samples/sec): 109.96
2019-08-12 01:28:55,092 epoch 12 - iter 2385/2650 - loss 0.80899250 throughput (samples/sec): 112.63
2019-08-12 01:30:11,265 ----------------------------------------------------------------------------------------------------
2019-08-12 01:30:11,265 EPOCH 12 done: loss 0.8111 - lr 0.1000
2019-08-12 01:30:11,265 BAD EPOCHS (no improvement): 0
2019-08-12 01:30:11,265 ----------------------------------------------------------------------------------------------------
2019-08-12 01:30:11,550 epoch 13 - iter 0/2650 - loss 0.98823512 throughput (samples/sec): 30142.47
2019-08-12 01:31:26,928 epoch 13 - iter 265/2650 - loss 0.77096396 throughput (samples/sec): 112.55
2019-08-12 01:32:44,129 epoch 13 - iter 530/2650 - loss 0.78370884 throughput (samples/sec): 109.89
2019-08-12 01:33:59,613 epoch 13 - iter 795/2650 - loss 0.77658483 throughput (samples/sec): 112.40
2019-08-12 01:35:16,569 epoch 13 - iter 1060/2650 - loss 0.78300041 throughput (samples/sec): 110.24
2019-08-12 01:36:33,288 epoch 13 - iter 1325/2650 - loss 0.77843203 throughput (samples/sec): 110.59
2019-08-12 01:37:49,759 epoch 13 - iter 1590/2650 - loss 0.77669016 throughput (samples/sec): 110.95
2019-08-12 01:39:08,794 epoch 13 - iter 1855/2650 - loss 0.78466387 throughput (samples/sec): 107.34
2019-08-12 01:40:25,710 epoch 13 - iter 2120/2650 - loss 0.78882890 throughput (samples/sec): 110.30
2019-08-12 01:41:42,977 epoch 13 - iter 2385/2650 - loss 0.78930780 throughput (samples/sec): 109.80
2019-08-12 01:42:58,565 ----------------------------------------------------------------------------------------------------
2019-08-12 01:42:58,565 EPOCH 13 done: loss 0.7883 - lr 0.1000
2019-08-12 01:42:58,565 BAD EPOCHS (no improvement): 0
2019-08-12 01:42:58,565 ----------------------------------------------------------------------------------------------------
2019-08-12 01:42:58,854 epoch 14 - iter 0/2650 - loss 0.68582487 throughput (samples/sec): 29735.55
2019-08-12 01:44:17,162 epoch 14 - iter 265/2650 - loss 0.76559451 throughput (samples/sec): 108.34
2019-08-12 01:45:32,354 epoch 14 - iter 530/2650 - loss 0.75682626 throughput (samples/sec): 112.83
2019-08-12 01:46:50,680 epoch 14 - iter 795/2650 - loss 0.76159888 throughput (samples/sec): 108.32
2019-08-12 01:48:08,588 epoch 14 - iter 1060/2650 - loss 0.77503159 throughput (samples/sec): 108.90
2019-08-12 01:49:24,879 epoch 14 - iter 1325/2650 - loss 0.77284201 throughput (samples/sec): 111.21
2019-08-12 01:50:41,841 epoch 14 - iter 1590/2650 - loss 0.77691747 throughput (samples/sec): 110.24
2019-08-12 01:51:58,074 epoch 14 - iter 1855/2650 - loss 0.77279636 throughput (samples/sec): 111.29
2019-08-12 01:53:16,706 epoch 14 - iter 2120/2650 - loss 0.77415649 throughput (samples/sec): 107.89
2019-08-12 01:54:31,291 epoch 14 - iter 2385/2650 - loss 0.77696612 throughput (samples/sec): 113.75
2019-08-12 01:55:47,376 ----------------------------------------------------------------------------------------------------
2019-08-12 01:55:47,376 EPOCH 14 done: loss 0.7773 - lr 0.1000
2019-08-12 01:55:47,376 BAD EPOCHS (no improvement): 0
2019-08-12 01:55:47,376 ----------------------------------------------------------------------------------------------------
2019-08-12 01:55:47,645 epoch 15 - iter 0/2650 - loss 1.09253204 throughput (samples/sec): 31918.55
2019-08-12 01:57:03,255 epoch 15 - iter 265/2650 - loss 0.75811733 throughput (samples/sec): 112.21
2019-08-12 01:58:21,663 epoch 15 - iter 530/2650 - loss 0.75452357 throughput (samples/sec): 108.20
2019-08-12 01:59:37,165 epoch 15 - iter 795/2650 - loss 0.75306199 throughput (samples/sec): 112.37
2019-08-12 02:00:54,675 epoch 15 - iter 1060/2650 - loss 0.74821112 throughput (samples/sec): 109.46
2019-08-12 02:02:11,006 epoch 15 - iter 1325/2650 - loss 0.74880059 throughput (samples/sec): 111.15
2019-08-12 02:03:26,934 epoch 15 - iter 1590/2650 - loss 0.75379420 throughput (samples/sec): 111.74
2019-08-12 02:04:42,224 epoch 15 - iter 1855/2650 - loss 0.75674396 throughput (samples/sec): 112.69
2019-08-12 02:06:01,865 epoch 15 - iter 2120/2650 - loss 0.75684881 throughput (samples/sec): 106.53
2019-08-12 02:07:18,378 epoch 15 - iter 2385/2650 - loss 0.75572023 throughput (samples/sec): 110.88
2019-08-12 02:08:34,390 ----------------------------------------------------------------------------------------------------
2019-08-12 02:08:34,390 EPOCH 15 done: loss 0.7564 - lr 0.1000
2019-08-12 02:08:34,391 BAD EPOCHS (no improvement): 0
2019-08-12 02:08:34,391 ----------------------------------------------------------------------------------------------------
2019-08-12 02:08:34,761 epoch 16 - iter 0/2650 - loss 0.61237371 throughput (samples/sec): 23099.72
2019-08-12 02:09:52,499 epoch 16 - iter 265/2650 - loss 0.73508324 throughput (samples/sec): 109.14
2019-08-12 02:11:09,231 epoch 16 - iter 530/2650 - loss 0.72168798 throughput (samples/sec): 110.57
2019-08-12 02:12:25,196 epoch 16 - iter 795/2650 - loss 0.71463858 throughput (samples/sec): 111.68
2019-08-12 02:13:42,111 epoch 16 - iter 1060/2650 - loss 0.73281383 throughput (samples/sec): 110.30
2019-08-12 02:14:59,521 epoch 16 - iter 1325/2650 - loss 0.73787310 throughput (samples/sec): 109.60
2019-08-12 02:16:16,434 epoch 16 - iter 1590/2650 - loss 0.74670366 throughput (samples/sec): 110.31
2019-08-12 02:17:35,260 epoch 16 - iter 1855/2650 - loss 0.74841695 throughput (samples/sec): 107.63
2019-08-12 02:18:50,930 epoch 16 - iter 2120/2650 - loss 0.74279538 throughput (samples/sec): 112.12
2019-08-12 02:20:08,483 epoch 16 - iter 2385/2650 - loss 0.74529345 throughput (samples/sec): 109.40
2019-08-12 02:21:27,330 ----------------------------------------------------------------------------------------------------
2019-08-12 02:21:27,331 EPOCH 16 done: loss 0.7446 - lr 0.1000
2019-08-12 02:21:27,331 BAD EPOCHS (no improvement): 0
2019-08-12 02:21:27,331 ----------------------------------------------------------------------------------------------------
2019-08-12 02:21:27,599 epoch 17 - iter 0/2650 - loss 0.73334527 throughput (samples/sec): 32064.72
2019-08-12 02:22:46,605 epoch 17 - iter 265/2650 - loss 0.69476502 throughput (samples/sec): 107.38
2019-08-12 02:24:03,504 epoch 17 - iter 530/2650 - loss 0.70010207 throughput (samples/sec): 110.33
2019-08-12 02:25:21,013 epoch 17 - iter 795/2650 - loss 0.70983017 throughput (samples/sec): 109.46
2019-08-12 02:26:38,980 epoch 17 - iter 1060/2650 - loss 0.71338935 throughput (samples/sec): 108.82
2019-08-12 02:27:58,015 epoch 17 - iter 1325/2650 - loss 0.71495616 throughput (samples/sec): 107.35
2019-08-12 02:29:15,197 epoch 17 - iter 1590/2650 - loss 0.71608318 throughput (samples/sec): 109.92
2019-08-12 02:30:32,350 epoch 17 - iter 1855/2650 - loss 0.71569421 throughput (samples/sec): 109.97
2019-08-12 02:31:50,083 epoch 17 - iter 2120/2650 - loss 0.72267651 throughput (samples/sec): 109.15
2019-08-12 02:33:07,767 epoch 17 - iter 2385/2650 - loss 0.72727042 throughput (samples/sec): 109.21
2019-08-12 02:34:27,351 ----------------------------------------------------------------------------------------------------
2019-08-12 02:34:27,351 EPOCH 17 done: loss 0.7325 - lr 0.1000
2019-08-12 02:34:27,351 BAD EPOCHS (no improvement): 0
2019-08-12 02:34:27,351 ----------------------------------------------------------------------------------------------------
2019-08-12 02:34:27,753 epoch 18 - iter 0/2650 - loss 0.37045979 throughput (samples/sec): 21320.66
2019-08-12 02:35:48,717 epoch 18 - iter 265/2650 - loss 0.69166727 throughput (samples/sec): 104.78
2019-08-12 02:37:08,419 epoch 18 - iter 530/2650 - loss 0.67896350 throughput (samples/sec): 106.45
2019-08-12 02:38:26,206 epoch 18 - iter 795/2650 - loss 0.69849402 throughput (samples/sec): 109.07
2019-08-12 02:39:47,730 epoch 18 - iter 1060/2650 - loss 0.70679486 throughput (samples/sec): 104.06
2019-08-12 02:41:06,046 epoch 18 - iter 1325/2650 - loss 0.71040904 throughput (samples/sec): 108.33
2019-08-12 02:42:23,578 epoch 18 - iter 1590/2650 - loss 0.71104367 throughput (samples/sec): 109.43
2019-08-12 02:43:40,681 epoch 18 - iter 1855/2650 - loss 0.71460146 throughput (samples/sec): 110.04
2019-08-12 02:44:55,438 epoch 18 - iter 2120/2650 - loss 0.71320587 throughput (samples/sec): 113.49
2019-08-12 02:46:11,809 epoch 18 - iter 2385/2650 - loss 0.71301821 throughput (samples/sec): 111.09
2019-08-12 02:47:28,020 ----------------------------------------------------------------------------------------------------
2019-08-12 02:47:28,021 EPOCH 18 done: loss 0.7165 - lr 0.1000
2019-08-12 02:47:28,021 BAD EPOCHS (no improvement): 0
2019-08-12 02:47:28,021 ----------------------------------------------------------------------------------------------------
2019-08-12 02:47:28,306 epoch 19 - iter 0/2650 - loss 0.75679207 throughput (samples/sec): 30125.14
2019-08-12 02:48:43,991 epoch 19 - iter 265/2650 - loss 0.67044517 throughput (samples/sec): 112.10
2019-08-12 02:49:59,464 epoch 19 - iter 530/2650 - loss 0.67646530 throughput (samples/sec): 112.41
2019-08-12 02:51:15,356 epoch 19 - iter 795/2650 - loss 0.68708236 throughput (samples/sec): 111.79
2019-08-12 02:52:34,200 epoch 19 - iter 1060/2650 - loss 0.69272068 throughput (samples/sec): 107.60
2019-08-12 02:53:52,235 epoch 19 - iter 1325/2650 - loss 0.68857620 throughput (samples/sec): 108.72
2019-08-12 02:55:11,989 epoch 19 - iter 1590/2650 - loss 0.68403171 throughput (samples/sec): 106.38
2019-08-12 02:56:28,683 epoch 19 - iter 1855/2650 - loss 0.68613842 throughput (samples/sec): 110.62
2019-08-12 02:57:45,970 epoch 19 - iter 2120/2650 - loss 0.69010969 throughput (samples/sec): 109.77
2019-08-12 02:59:02,049 epoch 19 - iter 2385/2650 - loss 0.69089980 throughput (samples/sec): 111.52
2019-08-12 03:00:18,690 ----------------------------------------------------------------------------------------------------
2019-08-12 03:00:18,690 EPOCH 19 done: loss 0.6954 - lr 0.1000
2019-08-12 03:00:18,690 BAD EPOCHS (no improvement): 0
2019-08-12 03:00:18,690 ----------------------------------------------------------------------------------------------------
2019-08-12 03:00:18,967 epoch 20 - iter 0/2650 - loss 0.27869496 throughput (samples/sec): 31039.72
2019-08-12 03:01:35,599 epoch 20 - iter 265/2650 - loss 0.69068862 throughput (samples/sec): 110.71
2019-08-12 03:02:52,805 epoch 20 - iter 530/2650 - loss 0.68614536 throughput (samples/sec): 109.89
2019-08-12 03:04:09,152 epoch 20 - iter 795/2650 - loss 0.68798377 throughput (samples/sec): 111.12
2019-08-12 03:05:26,750 epoch 20 - iter 1060/2650 - loss 0.68916173 throughput (samples/sec): 109.33
2019-08-12 03:06:44,424 epoch 20 - iter 1325/2650 - loss 0.68841010 throughput (samples/sec): 109.22
2019-08-12 03:08:01,003 epoch 20 - iter 1590/2650 - loss 0.69173387 throughput (samples/sec): 110.79
2019-08-12 03:09:15,842 epoch 20 - iter 1855/2650 - loss 0.69659264 throughput (samples/sec): 113.36
2019-08-12 03:10:32,811 epoch 20 - iter 2120/2650 - loss 0.69925027 throughput (samples/sec): 110.23
2019-08-12 03:11:49,240 epoch 20 - iter 2385/2650 - loss 0.69687345 throughput (samples/sec): 111.01
2019-08-12 03:13:06,103 ----------------------------------------------------------------------------------------------------
2019-08-12 03:13:06,103 EPOCH 20 done: loss 0.6954 - lr 0.1000
2019-08-12 03:13:06,103 BAD EPOCHS (no improvement): 1
2019-08-12 03:13:06,103 ----------------------------------------------------------------------------------------------------
2019-08-12 03:13:06,358 epoch 21 - iter 0/2650 - loss 0.46437067 throughput (samples/sec): 33826.67
2019-08-12 03:14:22,890 epoch 21 - iter 265/2650 - loss 0.63522391 throughput (samples/sec): 110.86
2019-08-12 03:15:39,448 epoch 21 - iter 530/2650 - loss 0.68150335 throughput (samples/sec): 110.82
2019-08-12 03:16:57,322 epoch 21 - iter 795/2650 - loss 0.67400749 throughput (samples/sec): 108.95
2019-08-12 03:18:16,979 epoch 21 - iter 1060/2650 - loss 0.67448560 throughput (samples/sec): 106.51
2019-08-12 03:19:35,460 epoch 21 - iter 1325/2650 - loss 0.67398128 throughput (samples/sec): 108.10
2019-08-12 03:20:53,180 epoch 21 - iter 1590/2650 - loss 0.67555627 throughput (samples/sec): 109.16
2019-08-12 03:22:11,237 epoch 21 - iter 1855/2650 - loss 0.67539483 throughput (samples/sec): 108.69
2019-08-12 03:23:31,138 epoch 21 - iter 2120/2650 - loss 0.67660449 throughput (samples/sec): 106.18
2019-08-12 03:24:50,441 epoch 21 - iter 2385/2650 - loss 0.68477290 throughput (samples/sec): 106.98
2019-08-12 03:26:06,729 ----------------------------------------------------------------------------------------------------
2019-08-12 03:26:06,729 EPOCH 21 done: loss 0.6850 - lr 0.1000
2019-08-12 03:26:06,730 BAD EPOCHS (no improvement): 0
2019-08-12 03:26:06,730 ----------------------------------------------------------------------------------------------------
2019-08-12 03:26:07,031 epoch 22 - iter 0/2650 - loss 0.52252209 throughput (samples/sec): 28525.77
2019-08-12 03:27:25,217 epoch 22 - iter 265/2650 - loss 0.68314070 throughput (samples/sec): 108.51
2019-08-12 03:28:44,415 epoch 22 - iter 530/2650 - loss 0.68073458 throughput (samples/sec): 107.12
2019-08-12 03:30:02,139 epoch 22 - iter 795/2650 - loss 0.66882086 throughput (samples/sec): 109.16
2019-08-12 03:31:19,119 epoch 22 - iter 1060/2650 - loss 0.66415574 throughput (samples/sec): 110.21
2019-08-12 03:32:32,749 epoch 22 - iter 1325/2650 - loss 0.66434042 throughput (samples/sec): 115.23
2019-08-12 03:33:49,153 epoch 22 - iter 1590/2650 - loss 0.66958450 throughput (samples/sec): 111.04
2019-08-12 03:35:04,129 epoch 22 - iter 1855/2650 - loss 0.66624657 throughput (samples/sec): 113.16
2019-08-12 03:36:21,724 epoch 22 - iter 2120/2650 - loss 0.66951096 throughput (samples/sec): 109.34
2019-08-12 03:37:39,026 epoch 22 - iter 2385/2650 - loss 0.67091741 throughput (samples/sec): 109.75
2019-08-12 03:38:58,432 ----------------------------------------------------------------------------------------------------
2019-08-12 03:38:58,433 EPOCH 22 done: loss 0.6716 - lr 0.1000
2019-08-12 03:38:58,433 BAD EPOCHS (no improvement): 0
2019-08-12 03:38:58,433 ----------------------------------------------------------------------------------------------------
2019-08-12 03:38:59,165 epoch 23 - iter 0/2650 - loss 1.00838280 throughput (samples/sec): 11638.82
2019-08-12 03:40:18,718 epoch 23 - iter 265/2650 - loss 0.66554181 throughput (samples/sec): 106.64
2019-08-12 03:41:36,895 epoch 23 - iter 530/2650 - loss 0.66734723 throughput (samples/sec): 108.52
2019-08-12 03:42:54,161 epoch 23 - iter 795/2650 - loss 0.66318346 throughput (samples/sec): 109.80
2019-08-12 03:44:09,881 epoch 23 - iter 1060/2650 - loss 0.66933270 throughput (samples/sec): 112.05
2019-08-12 03:45:30,037 epoch 23 - iter 1325/2650 - loss 0.66125441 throughput (samples/sec): 105.84
2019-08-12 03:46:49,423 epoch 23 - iter 1590/2650 - loss 0.66007679 throughput (samples/sec): 106.87
2019-08-12 03:48:09,070 epoch 23 - iter 1855/2650 - loss 0.66163160 throughput (samples/sec): 106.52
2019-08-12 03:49:25,734 epoch 23 - iter 2120/2650 - loss 0.66040655 throughput (samples/sec): 110.66
2019-08-12 03:50:43,548 epoch 23 - iter 2385/2650 - loss 0.66390954 throughput (samples/sec): 109.03
2019-08-12 03:52:00,373 ----------------------------------------------------------------------------------------------------
2019-08-12 03:52:00,374 EPOCH 23 done: loss 0.6623 - lr 0.1000
2019-08-12 03:52:00,374 BAD EPOCHS (no improvement): 0
2019-08-12 03:52:00,374 ----------------------------------------------------------------------------------------------------
2019-08-12 03:52:00,658 epoch 24 - iter 0/2650 - loss 0.53226507 throughput (samples/sec): 30184.86
2019-08-12 03:53:18,573 epoch 24 - iter 265/2650 - loss 0.60383257 throughput (samples/sec): 108.89
2019-08-12 03:54:35,295 epoch 24 - iter 530/2650 - loss 0.64036452 throughput (samples/sec): 110.58
2019-08-12 03:55:51,372 epoch 24 - iter 795/2650 - loss 0.62981670 throughput (samples/sec): 111.52
2019-08-12 03:57:08,604 epoch 24 - iter 1060/2650 - loss 0.62925418 throughput (samples/sec): 109.85
2019-08-12 03:58:26,319 epoch 24 - iter 1325/2650 - loss 0.63957292 throughput (samples/sec): 109.17
2019-08-12 03:59:43,498 epoch 24 - iter 1590/2650 - loss 0.64320145 throughput (samples/sec): 109.93
2019-08-12 04:01:02,324 epoch 24 - iter 1855/2650 - loss 0.64628026 throughput (samples/sec): 107.63
2019-08-12 04:02:18,052 epoch 24 - iter 2120/2650 - loss 0.64599867 throughput (samples/sec): 112.03
2019-08-12 04:03:35,294 epoch 24 - iter 2385/2650 - loss 0.65241428 throughput (samples/sec): 109.84
2019-08-12 04:04:49,635 ----------------------------------------------------------------------------------------------------
2019-08-12 04:04:49,635 EPOCH 24 done: loss 0.6544 - lr 0.1000
2019-08-12 04:04:49,635 BAD EPOCHS (no improvement): 0
2019-08-12 04:04:49,635 ----------------------------------------------------------------------------------------------------
2019-08-12 04:04:49,897 epoch 25 - iter 0/2650 - loss 0.22208357 throughput (samples/sec): 32823.22
2019-08-12 04:06:06,436 epoch 25 - iter 265/2650 - loss 0.66138320 throughput (samples/sec): 110.85
2019-08-12 04:07:25,506 epoch 25 - iter 530/2650 - loss 0.65683351 throughput (samples/sec): 107.30
2019-08-12 04:08:44,264 epoch 25 - iter 795/2650 - loss 0.65811426 throughput (samples/sec): 107.72
2019-08-12 04:10:02,127 epoch 25 - iter 1060/2650 - loss 0.65884259 throughput (samples/sec): 108.96
2019-08-12 04:11:19,437 epoch 25 - iter 1325/2650 - loss 0.65386111 throughput (samples/sec): 109.74
2019-08-12 04:12:34,185 epoch 25 - iter 1590/2650 - loss 0.65144034 throughput (samples/sec): 113.51
2019-08-12 04:13:52,132 epoch 25 - iter 1855/2650 - loss 0.65416526 throughput (samples/sec): 108.85
2019-08-12 04:15:09,557 epoch 25 - iter 2120/2650 - loss 0.65251577 throughput (samples/sec): 109.58
2019-08-12 04:16:26,166 epoch 25 - iter 2385/2650 - loss 0.65184241 throughput (samples/sec): 110.75
2019-08-12 04:17:42,701 ----------------------------------------------------------------------------------------------------
2019-08-12 04:17:42,702 EPOCH 25 done: loss 0.6484 - lr 0.1000
2019-08-12 04:17:42,702 BAD EPOCHS (no improvement): 0
2019-08-12 04:17:42,702 ----------------------------------------------------------------------------------------------------
2019-08-12 04:17:43,033 epoch 26 - iter 0/2650 - loss 0.59666216 throughput (samples/sec): 25888.16
2019-08-12 04:18:59,967 epoch 26 - iter 265/2650 - loss 0.63041140 throughput (samples/sec): 110.28
2019-08-12 04:20:21,022 epoch 26 - iter 530/2650 - loss 0.63240479 throughput (samples/sec): 104.67
2019-08-12 04:21:37,677 epoch 26 - iter 795/2650 - loss 0.62931397 throughput (samples/sec): 110.68
2019-08-12 04:22:55,445 epoch 26 - iter 1060/2650 - loss 0.63001512 throughput (samples/sec): 109.10
2019-08-12 04:24:12,121 epoch 26 - iter 1325/2650 - loss 0.63308393 throughput (samples/sec): 110.65
2019-08-12 04:25:29,201 epoch 26 - iter 1590/2650 - loss 0.63038148 throughput (samples/sec): 110.07
2019-08-12 04:26:45,000 epoch 26 - iter 1855/2650 - loss 0.63635591 throughput (samples/sec): 111.93
2019-08-12 04:28:02,405 epoch 26 - iter 2120/2650 - loss 0.64074523 throughput (samples/sec): 109.61
2019-08-12 04:29:21,272 epoch 26 - iter 2385/2650 - loss 0.63878572 throughput (samples/sec): 107.58
2019-08-12 04:30:37,197 ----------------------------------------------------------------------------------------------------
2019-08-12 04:30:37,197 EPOCH 26 done: loss 0.6381 - lr 0.1000
2019-08-12 04:30:37,197 BAD EPOCHS (no improvement): 0
2019-08-12 04:30:37,197 ----------------------------------------------------------------------------------------------------
2019-08-12 04:30:37,643 epoch 27 - iter 0/2650 - loss 0.25866076 throughput (samples/sec): 19175.03
2019-08-12 04:31:54,839 epoch 27 - iter 265/2650 - loss 0.63250818 throughput (samples/sec): 109.91
2019-08-12 04:33:11,749 epoch 27 - iter 530/2650 - loss 0.63882405 throughput (samples/sec): 110.31
2019-08-12 04:34:31,248 epoch 27 - iter 795/2650 - loss 0.64379928 throughput (samples/sec): 106.72
2019-08-12 04:35:48,215 epoch 27 - iter 1060/2650 - loss 0.64036864 throughput (samples/sec): 110.23
2019-08-12 04:37:08,735 epoch 27 - iter 1325/2650 - loss 0.63686868 throughput (samples/sec): 105.36
2019-08-12 04:38:29,466 epoch 27 - iter 1590/2650 - loss 0.63938083 throughput (samples/sec): 105.09
2019-08-12 04:39:48,043 epoch 27 - iter 1855/2650 - loss 0.63930716 throughput (samples/sec): 107.97
2019-08-12 04:41:07,311 epoch 27 - iter 2120/2650 - loss 0.64061284 throughput (samples/sec): 107.03
2019-08-12 04:42:25,873 epoch 27 - iter 2385/2650 - loss 0.63976338 throughput (samples/sec): 107.99
2019-08-12 04:43:42,904 ----------------------------------------------------------------------------------------------------
2019-08-12 04:43:42,904 EPOCH 27 done: loss 0.6371 - lr 0.1000
2019-08-12 04:43:42,904 BAD EPOCHS (no improvement): 0
2019-08-12 04:43:42,904 ----------------------------------------------------------------------------------------------------
2019-08-12 04:43:43,285 epoch 28 - iter 0/2650 - loss 0.71471065 throughput (samples/sec): 22484.89
2019-08-12 04:45:02,634 epoch 28 - iter 265/2650 - loss 0.62536989 throughput (samples/sec): 106.92
2019-08-12 04:46:21,311 epoch 28 - iter 530/2650 - loss 0.62729618 throughput (samples/sec): 107.83
2019-08-12 04:47:42,243 epoch 28 - iter 795/2650 - loss 0.63701599 throughput (samples/sec): 104.83
2019-08-12 04:48:58,910 epoch 28 - iter 1060/2650 - loss 0.63194630 throughput (samples/sec): 110.66
2019-08-12 04:50:17,995 epoch 28 - iter 1325/2650 - loss 0.63121855 throughput (samples/sec): 107.28
2019-08-12 04:51:35,386 epoch 28 - iter 1590/2650 - loss 0.63325914 throughput (samples/sec): 109.62
2019-08-12 04:52:54,488 epoch 28 - iter 1855/2650 - loss 0.63139527 throughput (samples/sec): 107.25
2019-08-12 04:54:12,816 epoch 28 - iter 2120/2650 - loss 0.62914233 throughput (samples/sec): 108.31
2019-08-12 04:55:31,658 epoch 28 - iter 2385/2650 - loss 0.63196184 throughput (samples/sec): 107.61
2019-08-12 04:56:49,612 ----------------------------------------------------------------------------------------------------
2019-08-12 04:56:49,612 EPOCH 28 done: loss 0.6342 - lr 0.1000
2019-08-12 04:56:49,612 BAD EPOCHS (no improvement): 0
2019-08-12 04:56:49,612 ----------------------------------------------------------------------------------------------------
2019-08-12 04:56:49,903 epoch 29 - iter 0/2650 - loss 0.91499782 throughput (samples/sec): 29526.37
2019-08-12 04:58:07,490 epoch 29 - iter 265/2650 - loss 0.61586869 throughput (samples/sec): 109.35
2019-08-12 04:59:22,231 epoch 29 - iter 530/2650 - loss 0.61245731 throughput (samples/sec): 113.51
2019-08-12 05:00:38,799 epoch 29 - iter 795/2650 - loss 0.60600244 throughput (samples/sec): 110.80
2019-08-12 05:01:57,294 epoch 29 - iter 1060/2650 - loss 0.59832803 throughput (samples/sec): 108.09
2019-08-12 05:03:16,166 epoch 29 - iter 1325/2650 - loss 0.60232512 throughput (samples/sec): 107.57
2019-08-12 05:04:34,623 epoch 29 - iter 1590/2650 - loss 0.60189029 throughput (samples/sec): 108.14
2019-08-12 05:05:51,964 epoch 29 - iter 1855/2650 - loss 0.60994426 throughput (samples/sec): 109.70
2019-08-12 05:07:08,409 epoch 29 - iter 2120/2650 - loss 0.61059018 throughput (samples/sec): 110.99
2019-08-12 05:08:26,392 epoch 29 - iter 2385/2650 - loss 0.61231959 throughput (samples/sec): 108.79
2019-08-12 05:09:43,925 ----------------------------------------------------------------------------------------------------
2019-08-12 05:09:43,925 EPOCH 29 done: loss 0.6191 - lr 0.1000
2019-08-12 05:09:43,925 BAD EPOCHS (no improvement): 0
2019-08-12 05:09:43,925 ----------------------------------------------------------------------------------------------------
2019-08-12 05:09:44,231 epoch 30 - iter 0/2650 - loss 0.92529154 throughput (samples/sec): 28074.55
2019-08-12 05:11:01,324 epoch 30 - iter 265/2650 - loss 0.61342644 throughput (samples/sec): 110.05
2019-08-12 05:12:20,890 epoch 30 - iter 530/2650 - loss 0.61927028 throughput (samples/sec): 106.63
2019-08-12 05:13:39,788 epoch 30 - iter 795/2650 - loss 0.62328793 throughput (samples/sec): 107.53
2019-08-12 05:14:56,457 epoch 30 - iter 1060/2650 - loss 0.61628716 throughput (samples/sec): 110.66
2019-08-12 05:16:15,460 epoch 30 - iter 1325/2650 - loss 0.61380557 throughput (samples/sec): 107.39
2019-08-12 05:17:33,414 epoch 30 - iter 1590/2650 - loss 0.60991255 throughput (samples/sec): 108.84
2019-08-12 05:18:50,148 epoch 30 - iter 1855/2650 - loss 0.61103961 throughput (samples/sec): 110.57
2019-08-12 05:20:06,916 epoch 30 - iter 2120/2650 - loss 0.61445892 throughput (samples/sec): 110.52
2019-08-12 05:21:24,027 epoch 30 - iter 2385/2650 - loss 0.61427355 throughput (samples/sec): 110.03
2019-08-12 05:22:41,232 ----------------------------------------------------------------------------------------------------
2019-08-12 05:22:41,232 EPOCH 30 done: loss 0.6137 - lr 0.1000
2019-08-12 05:22:41,232 BAD EPOCHS (no improvement): 0
2019-08-12 05:22:41,233 ----------------------------------------------------------------------------------------------------
2019-08-12 05:22:41,484 epoch 31 - iter 0/2650 - loss 0.49137515 throughput (samples/sec): 34141.47
2019-08-12 05:23:59,074 epoch 31 - iter 265/2650 - loss 0.59875777 throughput (samples/sec): 109.35
2019-08-12 05:25:16,824 epoch 31 - iter 530/2650 - loss 0.60124782 throughput (samples/sec): 109.12
2019-08-12 05:26:33,101 epoch 31 - iter 795/2650 - loss 0.59754750 throughput (samples/sec): 111.23
2019-08-12 05:27:50,114 epoch 31 - iter 1060/2650 - loss 0.60560093 throughput (samples/sec): 110.17
2019-08-12 05:29:10,474 epoch 31 - iter 1325/2650 - loss 0.61152567 throughput (samples/sec): 105.57
2019-08-12 05:30:29,315 epoch 31 - iter 1590/2650 - loss 0.60912962 throughput (samples/sec): 107.61
2019-08-12 05:31:45,265 epoch 31 - iter 1855/2650 - loss 0.60551988 throughput (samples/sec): 111.71
2019-08-12 05:33:02,267 epoch 31 - iter 2120/2650 - loss 0.60556444 throughput (samples/sec): 110.18
2019-08-12 05:34:21,092 epoch 31 - iter 2385/2650 - loss 0.60777029 throughput (samples/sec): 107.63
2019-08-12 05:35:39,048 ----------------------------------------------------------------------------------------------------
2019-08-12 05:35:39,048 EPOCH 31 done: loss 0.6094 - lr 0.1000
2019-08-12 05:35:39,048 BAD EPOCHS (no improvement): 0
2019-08-12 05:35:39,048 ----------------------------------------------------------------------------------------------------
2019-08-12 05:35:39,296 epoch 32 - iter 0/2650 - loss 0.64008331 throughput (samples/sec): 34706.49
2019-08-12 05:36:57,947 epoch 32 - iter 265/2650 - loss 0.59088559 throughput (samples/sec): 107.87
2019-08-12 05:38:14,841 epoch 32 - iter 530/2650 - loss 0.57510413 throughput (samples/sec): 110.34
2019-08-12 05:39:34,039 epoch 32 - iter 795/2650 - loss 0.57107500 throughput (samples/sec): 107.12
2019-08-12 05:40:51,503 epoch 32 - iter 1060/2650 - loss 0.57582333 throughput (samples/sec): 109.52
2019-08-12 05:42:09,307 epoch 32 - iter 1325/2650 - loss 0.58366438 throughput (samples/sec): 109.05
2019-08-12 05:43:28,362 epoch 32 - iter 1590/2650 - loss 0.58703092 throughput (samples/sec): 107.32
2019-08-12 05:44:46,754 epoch 32 - iter 1855/2650 - loss 0.59358708 throughput (samples/sec): 108.23
2019-08-12 05:46:03,189 epoch 32 - iter 2120/2650 - loss 0.59655652 throughput (samples/sec): 111.00
2019-08-12 05:47:20,451 epoch 32 - iter 2385/2650 - loss 0.59797705 throughput (samples/sec): 109.81
2019-08-12 05:48:35,865 ----------------------------------------------------------------------------------------------------
2019-08-12 05:48:35,865 EPOCH 32 done: loss 0.6009 - lr 0.1000
2019-08-12 05:48:35,865 BAD EPOCHS (no improvement): 0
2019-08-12 05:48:35,866 ----------------------------------------------------------------------------------------------------
2019-08-12 05:48:36,165 epoch 33 - iter 0/2650 - loss 0.38083413 throughput (samples/sec): 28701.59
2019-08-12 05:49:55,853 epoch 33 - iter 265/2650 - loss 0.55628835 throughput (samples/sec): 106.47
2019-08-12 05:51:12,087 epoch 33 - iter 530/2650 - loss 0.57152242 throughput (samples/sec): 111.29
2019-08-12 05:52:32,307 epoch 33 - iter 795/2650 - loss 0.58623345 throughput (samples/sec): 105.76
2019-08-12 05:53:52,478 epoch 33 - iter 1060/2650 - loss 0.58479025 throughput (samples/sec): 105.82
2019-08-12 05:55:09,688 epoch 33 - iter 1325/2650 - loss 0.58941556 throughput (samples/sec): 109.88
2019-08-12 05:56:25,266 epoch 33 - iter 1590/2650 - loss 0.58860646 throughput (samples/sec): 112.26
2019-08-12 05:57:43,276 epoch 33 - iter 1855/2650 - loss 0.59216199 throughput (samples/sec): 108.76
2019-08-12 05:59:02,091 epoch 33 - iter 2120/2650 - loss 0.59982248 throughput (samples/sec): 107.65
2019-08-12 06:00:19,856 epoch 33 - iter 2385/2650 - loss 0.60427765 throughput (samples/sec): 109.10
2019-08-12 06:01:36,477 ----------------------------------------------------------------------------------------------------
2019-08-12 06:01:36,477 EPOCH 33 done: loss 0.6034 - lr 0.1000
2019-08-12 06:01:36,477 BAD EPOCHS (no improvement): 1
2019-08-12 06:01:36,478 ----------------------------------------------------------------------------------------------------
2019-08-12 06:01:36,750 epoch 34 - iter 0/2650 - loss 0.53113967 throughput (samples/sec): 31529.66
2019-08-12 06:02:53,401 epoch 34 - iter 265/2650 - loss 0.57023132 throughput (samples/sec): 110.69
2019-08-12 06:04:12,899 epoch 34 - iter 530/2650 - loss 0.58881935 throughput (samples/sec): 106.72
2019-08-12 06:05:32,746 epoch 34 - iter 795/2650 - loss 0.59337655 throughput (samples/sec): 106.25
2019-08-12 06:06:50,576 epoch 34 - iter 1060/2650 - loss 0.59231150 throughput (samples/sec): 109.01
2019-08-12 06:08:09,868 epoch 34 - iter 1325/2650 - loss 0.59755529 throughput (samples/sec): 107.00
2019-08-12 06:09:24,588 epoch 34 - iter 1590/2650 - loss 0.59832442 throughput (samples/sec): 113.55
2019-08-12 06:10:42,778 epoch 34 - iter 1855/2650 - loss 0.59782849 throughput (samples/sec): 108.50
2019-08-12 06:11:59,007 epoch 34 - iter 2120/2650 - loss 0.59657387 throughput (samples/sec): 111.30
2019-08-12 06:13:17,687 epoch 34 - iter 2385/2650 - loss 0.59657262 throughput (samples/sec): 107.83
2019-08-12 06:14:33,393 ----------------------------------------------------------------------------------------------------
2019-08-12 06:14:33,393 EPOCH 34 done: loss 0.5933 - lr 0.1000
2019-08-12 06:14:33,393 BAD EPOCHS (no improvement): 0
2019-08-12 06:14:33,393 ----------------------------------------------------------------------------------------------------
2019-08-12 06:14:33,658 epoch 35 - iter 0/2650 - loss 0.62350559 throughput (samples/sec): 32489.48
2019-08-12 06:15:50,229 epoch 35 - iter 265/2650 - loss 0.55669828 throughput (samples/sec): 110.80
2019-08-12 06:17:06,454 epoch 35 - iter 530/2650 - loss 0.56233662 throughput (samples/sec): 111.31
2019-08-12 06:18:24,323 epoch 35 - iter 795/2650 - loss 0.56368567 throughput (samples/sec): 108.95
2019-08-12 06:19:44,418 epoch 35 - iter 1060/2650 - loss 0.56947668 throughput (samples/sec): 105.93
2019-08-12 06:21:01,767 epoch 35 - iter 1325/2650 - loss 0.57282042 throughput (samples/sec): 109.69
2019-08-12 06:22:19,511 epoch 35 - iter 1590/2650 - loss 0.57811914 throughput (samples/sec): 109.13
2019-08-12 06:23:36,579 epoch 35 - iter 1855/2650 - loss 0.57880241 throughput (samples/sec): 110.09
2019-08-12 06:24:54,002 epoch 35 - iter 2120/2650 - loss 0.58941703 throughput (samples/sec): 109.58
2019-08-12 06:26:10,759 epoch 35 - iter 2385/2650 - loss 0.59027181 throughput (samples/sec): 110.53
2019-08-12 06:27:31,872 ----------------------------------------------------------------------------------------------------
2019-08-12 06:27:31,872 EPOCH 35 done: loss 0.5902 - lr 0.1000
2019-08-12 06:27:31,873 BAD EPOCHS (no improvement): 0
2019-08-12 06:27:31,873 ----------------------------------------------------------------------------------------------------
2019-08-12 06:27:32,194 epoch 36 - iter 0/2650 - loss 0.56167185 throughput (samples/sec): 26726.63
2019-08-12 06:28:49,439 epoch 36 - iter 265/2650 - loss 0.56384915 throughput (samples/sec): 109.83
2019-08-12 06:30:07,677 epoch 36 - iter 530/2650 - loss 0.56975552 throughput (samples/sec): 108.44
2019-08-12 06:31:27,145 epoch 36 - iter 795/2650 - loss 0.57324598 throughput (samples/sec): 106.76
2019-08-12 06:32:47,316 epoch 36 - iter 1060/2650 - loss 0.57676428 throughput (samples/sec): 105.82
2019-08-12 06:34:03,091 epoch 36 - iter 1325/2650 - loss 0.57635033 throughput (samples/sec): 111.97
2019-08-12 06:35:20,021 epoch 36 - iter 1590/2650 - loss 0.57332623 throughput (samples/sec): 110.28
2019-08-12 06:36:38,995 epoch 36 - iter 1855/2650 - loss 0.57527380 throughput (samples/sec): 107.43
2019-08-12 06:37:55,881 epoch 36 - iter 2120/2650 - loss 0.57746613 throughput (samples/sec): 110.35
2019-08-12 06:39:14,862 epoch 36 - iter 2385/2650 - loss 0.57951162 throughput (samples/sec): 107.42
2019-08-12 06:40:30,551 ----------------------------------------------------------------------------------------------------
2019-08-12 06:40:30,551 EPOCH 36 done: loss 0.5814 - lr 0.1000
2019-08-12 06:40:30,552 BAD EPOCHS (no improvement): 0
2019-08-12 06:40:30,552 ----------------------------------------------------------------------------------------------------
2019-08-12 06:40:30,815 epoch 37 - iter 0/2650 - loss 0.32352453 throughput (samples/sec): 32662.08
2019-08-12 06:41:49,474 epoch 37 - iter 265/2650 - loss 0.57362247 throughput (samples/sec): 107.86
2019-08-12 06:43:09,629 epoch 37 - iter 530/2650 - loss 0.58336295 throughput (samples/sec): 105.84
2019-08-12 06:44:25,978 epoch 37 - iter 795/2650 - loss 0.59044774 throughput (samples/sec): 111.12
2019-08-12 06:45:41,876 epoch 37 - iter 1060/2650 - loss 0.58160977 throughput (samples/sec): 111.78
2019-08-12 06:46:58,145 epoch 37 - iter 1325/2650 - loss 0.57565541 throughput (samples/sec): 111.24
2019-08-12 06:48:15,353 epoch 37 - iter 1590/2650 - loss 0.57640482 throughput (samples/sec): 109.89
2019-08-12 06:49:33,911 epoch 37 - iter 1855/2650 - loss 0.57970388 throughput (samples/sec): 108.00
2019-08-12 06:50:50,516 epoch 37 - iter 2120/2650 - loss 0.57926017 throughput (samples/sec): 110.75
2019-08-12 06:52:10,756 epoch 37 - iter 2385/2650 - loss 0.58118940 throughput (samples/sec): 105.73
2019-08-12 06:53:30,369 ----------------------------------------------------------------------------------------------------
2019-08-12 06:53:30,369 EPOCH 37 done: loss 0.5834 - lr 0.1000
2019-08-12 06:53:30,369 BAD EPOCHS (no improvement): 1
2019-08-12 06:53:30,369 ----------------------------------------------------------------------------------------------------
2019-08-12 06:53:30,657 epoch 38 - iter 0/2650 - loss 1.04154897 throughput (samples/sec): 29879.88
2019-08-12 06:54:47,476 epoch 38 - iter 265/2650 - loss 0.54281433 throughput (samples/sec): 110.44
2019-08-12 06:56:05,430 epoch 38 - iter 530/2650 - loss 0.55703825 throughput (samples/sec): 108.83
2019-08-12 06:57:23,674 epoch 38 - iter 795/2650 - loss 0.55920839 throughput (samples/sec): 108.43
2019-08-12 06:58:41,080 epoch 38 - iter 1060/2650 - loss 0.57408578 throughput (samples/sec): 109.61
2019-08-12 06:59:58,284 epoch 38 - iter 1325/2650 - loss 0.57755061 throughput (samples/sec): 109.89
2019-08-12 07:01:13,998 epoch 38 - iter 1590/2650 - loss 0.57705816 throughput (samples/sec): 112.05
2019-08-12 07:02:32,613 epoch 38 - iter 1855/2650 - loss 0.57529318 throughput (samples/sec): 107.92
2019-08-12 07:03:48,875 epoch 38 - iter 2120/2650 - loss 0.57964452 throughput (samples/sec): 111.25
2019-08-12 07:05:06,492 epoch 38 - iter 2385/2650 - loss 0.58144331 throughput (samples/sec): 109.31
2019-08-12 07:06:23,789 ----------------------------------------------------------------------------------------------------
2019-08-12 07:06:23,789 EPOCH 38 done: loss 0.5819 - lr 0.1000
2019-08-12 07:06:23,789 BAD EPOCHS (no improvement): 2
2019-08-12 07:06:23,789 ----------------------------------------------------------------------------------------------------
2019-08-12 07:06:24,053 epoch 39 - iter 0/2650 - loss 0.27391660 throughput (samples/sec): 32552.31
2019-08-12 07:07:39,622 epoch 39 - iter 265/2650 - loss 0.54721591 throughput (samples/sec): 112.27
2019-08-12 07:08:58,869 epoch 39 - iter 530/2650 - loss 0.55731582 throughput (samples/sec): 107.06
2019-08-12 07:10:15,659 epoch 39 - iter 795/2650 - loss 0.56622201 throughput (samples/sec): 110.49
2019-08-12 07:11:32,335 epoch 39 - iter 1060/2650 - loss 0.55908616 throughput (samples/sec): 110.65
2019-08-12 07:12:50,501 epoch 39 - iter 1325/2650 - loss 0.55883354 throughput (samples/sec): 108.54
2019-08-12 07:14:08,206 epoch 39 - iter 1590/2650 - loss 0.56129843 throughput (samples/sec): 109.18
2019-08-12 07:15:24,588 epoch 39 - iter 1855/2650 - loss 0.56186764 throughput (samples/sec): 111.07
2019-08-12 07:16:40,819 epoch 39 - iter 2120/2650 - loss 0.56447744 throughput (samples/sec): 111.29
2019-08-12 07:17:58,355 epoch 39 - iter 2385/2650 - loss 0.56493288 throughput (samples/sec): 109.42
2019-08-12 07:19:15,178 ----------------------------------------------------------------------------------------------------
2019-08-12 07:19:15,178 EPOCH 39 done: loss 0.5660 - lr 0.1000
2019-08-12 07:19:15,179 BAD EPOCHS (no improvement): 0
2019-08-12 07:19:15,179 ----------------------------------------------------------------------------------------------------
2019-08-12 07:19:15,506 epoch 40 - iter 0/2650 - loss 0.45744342 throughput (samples/sec): 26162.72
2019-08-12 07:20:32,993 epoch 40 - iter 265/2650 - loss 0.56366497 throughput (samples/sec): 109.49
2019-08-12 07:21:51,424 epoch 40 - iter 530/2650 - loss 0.57046033 throughput (samples/sec): 108.17
2019-08-12 07:23:08,321 epoch 40 - iter 795/2650 - loss 0.56665819 throughput (samples/sec): 110.33
2019-08-12 07:24:26,510 epoch 40 - iter 1060/2650 - loss 0.57321512 throughput (samples/sec): 108.51
2019-08-12 07:25:42,415 epoch 40 - iter 1325/2650 - loss 0.56997633 throughput (samples/sec): 111.77
2019-08-12 07:26:58,719 epoch 40 - iter 1590/2650 - loss 0.56710771 throughput (samples/sec): 111.19
2019-08-12 07:28:15,718 epoch 40 - iter 1855/2650 - loss 0.57099357 throughput (samples/sec): 110.18
2019-08-12 07:29:30,861 epoch 40 - iter 2120/2650 - loss 0.57221719 throughput (samples/sec): 112.91
2019-08-12 07:30:51,023 epoch 40 - iter 2385/2650 - loss 0.57266856 throughput (samples/sec): 105.83
2019-08-12 07:32:06,929 ----------------------------------------------------------------------------------------------------
2019-08-12 07:32:06,929 EPOCH 40 done: loss 0.5684 - lr 0.1000
2019-08-12 07:32:06,929 BAD EPOCHS (no improvement): 1
2019-08-12 07:32:06,929 ----------------------------------------------------------------------------------------------------
2019-08-12 07:32:07,208 epoch 41 - iter 0/2650 - loss 0.33754057 throughput (samples/sec): 30844.70
2019-08-12 07:33:22,583 epoch 41 - iter 265/2650 - loss 0.56185313 throughput (samples/sec): 112.56
2019-08-12 07:34:40,989 epoch 41 - iter 530/2650 - loss 0.56090521 throughput (samples/sec): 108.20
2019-08-12 07:35:56,539 epoch 41 - iter 795/2650 - loss 0.55246444 throughput (samples/sec): 112.30
2019-08-12 07:37:15,379 epoch 41 - iter 1060/2650 - loss 0.55924684 throughput (samples/sec): 107.61
2019-08-12 07:38:34,491 epoch 41 - iter 1325/2650 - loss 0.55584073 throughput (samples/sec): 107.24
2019-08-12 07:39:52,613 epoch 41 - iter 1590/2650 - loss 0.55564500 throughput (samples/sec): 108.60
2019-08-12 07:41:09,807 epoch 41 - iter 1855/2650 - loss 0.55728773 throughput (samples/sec): 109.91
2019-08-12 07:42:25,836 epoch 41 - iter 2120/2650 - loss 0.55573247 throughput (samples/sec): 111.59
2019-08-12 07:43:44,055 epoch 41 - iter 2385/2650 - loss 0.55456819 throughput (samples/sec): 108.47
2019-08-12 07:45:02,015 ----------------------------------------------------------------------------------------------------
2019-08-12 07:45:02,016 EPOCH 41 done: loss 0.5587 - lr 0.1000
2019-08-12 07:45:02,016 BAD EPOCHS (no improvement): 0
2019-08-12 07:45:02,016 ----------------------------------------------------------------------------------------------------
2019-08-12 07:45:02,236 epoch 42 - iter 0/2650 - loss 0.49609411 throughput (samples/sec): 39077.70
2019-08-12 07:46:21,619 epoch 42 - iter 265/2650 - loss 0.54662167 throughput (samples/sec): 106.87
2019-08-12 07:47:39,639 epoch 42 - iter 530/2650 - loss 0.53622953 throughput (samples/sec): 108.74
2019-08-12 07:48:56,687 epoch 42 - iter 795/2650 - loss 0.54222631 throughput (samples/sec): 110.11
2019-08-12 07:50:12,776 epoch 42 - iter 1060/2650 - loss 0.54633203 throughput (samples/sec): 111.50
2019-08-12 07:51:29,519 epoch 42 - iter 1325/2650 - loss 0.54594687 throughput (samples/sec): 110.55
2019-08-12 07:52:46,679 epoch 42 - iter 1590/2650 - loss 0.54926990 throughput (samples/sec): 109.95
2019-08-12 07:54:03,439 epoch 42 - iter 1855/2650 - loss 0.54712247 throughput (samples/sec): 110.53
2019-08-12 07:55:20,726 epoch 42 - iter 2120/2650 - loss 0.55386487 throughput (samples/sec): 109.77
2019-08-12 07:56:38,950 epoch 42 - iter 2385/2650 - loss 0.55313493 throughput (samples/sec): 108.46
2019-08-12 07:57:57,425 ----------------------------------------------------------------------------------------------------
2019-08-12 07:57:57,425 EPOCH 42 done: loss 0.5558 - lr 0.1000
2019-08-12 07:57:57,425 BAD EPOCHS (no improvement): 0
2019-08-12 07:57:57,425 ----------------------------------------------------------------------------------------------------
2019-08-12 07:57:57,655 epoch 43 - iter 0/2650 - loss 0.40964073 throughput (samples/sec): 37412.47
2019-08-12 07:59:14,692 epoch 43 - iter 265/2650 - loss 0.49790392 throughput (samples/sec): 110.13
2019-08-12 08:00:33,764 epoch 43 - iter 530/2650 - loss 0.52865640 throughput (samples/sec): 107.30
2019-08-12 08:01:51,152 epoch 43 - iter 795/2650 - loss 0.54310985 throughput (samples/sec): 109.63
2019-08-12 08:03:07,381 epoch 43 - iter 1060/2650 - loss 0.54684992 throughput (samples/sec): 111.30
2019-08-12 08:04:24,876 epoch 43 - iter 1325/2650 - loss 0.54450049 throughput (samples/sec): 109.48
2019-08-12 08:05:43,116 epoch 43 - iter 1590/2650 - loss 0.54986071 throughput (samples/sec): 108.44
2019-08-12 08:07:01,917 epoch 43 - iter 1855/2650 - loss 0.55495419 throughput (samples/sec): 107.66
2019-08-12 08:08:20,860 epoch 43 - iter 2120/2650 - loss 0.55338030 throughput (samples/sec): 107.47
2019-08-12 08:09:35,583 epoch 43 - iter 2385/2650 - loss 0.55486665 throughput (samples/sec): 113.54
2019-08-12 08:10:54,127 ----------------------------------------------------------------------------------------------------
2019-08-12 08:10:54,127 EPOCH 43 done: loss 0.5529 - lr 0.1000
2019-08-12 08:10:54,127 BAD EPOCHS (no improvement): 0
2019-08-12 08:10:54,127 ----------------------------------------------------------------------------------------------------
2019-08-12 08:10:54,387 epoch 44 - iter 0/2650 - loss 0.33380723 throughput (samples/sec): 33090.20
2019-08-12 08:12:12,535 epoch 44 - iter 265/2650 - loss 0.52084228 throughput (samples/sec): 108.57
2019-08-12 08:13:32,367 epoch 44 - iter 530/2650 - loss 0.52451182 throughput (samples/sec): 106.27
2019-08-12 08:14:51,573 epoch 44 - iter 795/2650 - loss 0.52364945 throughput (samples/sec): 107.12
2019-08-12 08:16:10,539 epoch 44 - iter 1060/2650 - loss 0.53010831 throughput (samples/sec): 107.44
2019-08-12 08:17:30,541 epoch 44 - iter 1325/2650 - loss 0.53524521 throughput (samples/sec): 106.05
2019-08-12 08:18:52,045 epoch 44 - iter 1590/2650 - loss 0.53849351 throughput (samples/sec): 104.09
2019-08-12 08:20:11,111 epoch 44 - iter 1855/2650 - loss 0.54419018 throughput (samples/sec): 107.30
2019-08-12 08:21:28,850 epoch 44 - iter 2120/2650 - loss 0.54609862 throughput (samples/sec): 109.14
2019-08-12 08:22:46,197 epoch 44 - iter 2385/2650 - loss 0.54808011 throughput (samples/sec): 109.69
2019-08-12 08:24:03,098 ----------------------------------------------------------------------------------------------------
2019-08-12 08:24:03,098 EPOCH 44 done: loss 0.5484 - lr 0.1000
2019-08-12 08:24:03,098 BAD EPOCHS (no improvement): 0
2019-08-12 08:24:03,098 ----------------------------------------------------------------------------------------------------
2019-08-12 08:24:03,346 epoch 45 - iter 0/2650 - loss 0.30069634 throughput (samples/sec): 34657.76
2019-08-12 08:25:18,782 epoch 45 - iter 265/2650 - loss 0.52010026 throughput (samples/sec): 112.47
2019-08-12 08:26:35,845 epoch 45 - iter 530/2650 - loss 0.52371999 throughput (samples/sec): 110.09
2019-08-12 08:27:55,162 epoch 45 - iter 795/2650 - loss 0.53997693 throughput (samples/sec): 106.96
2019-08-12 08:29:13,902 epoch 45 - iter 1060/2650 - loss 0.55224887 throughput (samples/sec): 107.75
2019-08-12 08:30:34,189 epoch 45 - iter 1325/2650 - loss 0.55313371 throughput (samples/sec): 105.67
2019-08-12 08:31:50,942 epoch 45 - iter 1590/2650 - loss 0.55307428 throughput (samples/sec): 110.54
2019-08-12 08:33:07,812 epoch 45 - iter 1855/2650 - loss 0.55551101 throughput (samples/sec): 110.37
2019-08-12 08:34:24,423 epoch 45 - iter 2120/2650 - loss 0.55801176 throughput (samples/sec): 110.75
2019-08-12 08:35:42,738 epoch 45 - iter 2385/2650 - loss 0.55555997 throughput (samples/sec): 108.33
2019-08-12 08:36:59,608 ----------------------------------------------------------------------------------------------------
2019-08-12 08:36:59,609 EPOCH 45 done: loss 0.5569 - lr 0.1000
2019-08-12 08:36:59,609 BAD EPOCHS (no improvement): 1
2019-08-12 08:36:59,609 ----------------------------------------------------------------------------------------------------
2019-08-12 08:36:59,890 epoch 46 - iter 0/2650 - loss 0.42693734 throughput (samples/sec): 30534.30
2019-08-12 08:38:17,160 epoch 46 - iter 265/2650 - loss 0.54099922 throughput (samples/sec): 109.80
2019-08-12 08:39:37,075 epoch 46 - iter 530/2650 - loss 0.54687486 throughput (samples/sec): 106.16
2019-08-12 08:40:53,489 epoch 46 - iter 795/2650 - loss 0.54481380 throughput (samples/sec): 111.03
2019-08-12 08:42:13,194 epoch 46 - iter 1060/2650 - loss 0.54527042 throughput (samples/sec): 106.44
2019-08-12 08:43:31,885 epoch 46 - iter 1325/2650 - loss 0.54128639 throughput (samples/sec): 107.81
2019-08-12 08:44:49,039 epoch 46 - iter 1590/2650 - loss 0.54639355 throughput (samples/sec): 109.96
2019-08-12 08:46:04,059 epoch 46 - iter 1855/2650 - loss 0.54318811 throughput (samples/sec): 113.09
2019-08-12 08:47:22,370 epoch 46 - iter 2120/2650 - loss 0.54213748 throughput (samples/sec): 108.34
2019-08-12 08:48:40,175 epoch 46 - iter 2385/2650 - loss 0.54585788 throughput (samples/sec): 109.04
2019-08-12 08:49:58,662 ----------------------------------------------------------------------------------------------------
2019-08-12 08:49:58,662 EPOCH 46 done: loss 0.5447 - lr 0.1000
2019-08-12 08:49:58,662 BAD EPOCHS (no improvement): 0
2019-08-12 08:49:58,662 ----------------------------------------------------------------------------------------------------
2019-08-12 08:49:58,920 epoch 47 - iter 0/2650 - loss 0.36465502 throughput (samples/sec): 33361.38
2019-08-12 08:51:16,922 epoch 47 - iter 265/2650 - loss 0.51711505 throughput (samples/sec): 108.77
2019-08-12 08:52:35,591 epoch 47 - iter 530/2650 - loss 0.53714948 throughput (samples/sec): 107.85
2019-08-12 08:53:56,234 epoch 47 - iter 795/2650 - loss 0.52444796 throughput (samples/sec): 105.21
2019-08-12 08:55:15,384 epoch 47 - iter 1060/2650 - loss 0.52179292 throughput (samples/sec): 107.19
2019-08-12 08:56:33,287 epoch 47 - iter 1325/2650 - loss 0.52629117 throughput (samples/sec): 108.91
2019-08-12 08:57:53,522 epoch 47 - iter 1590/2650 - loss 0.53076857 throughput (samples/sec): 105.74
2019-08-12 08:59:11,641 epoch 47 - iter 1855/2650 - loss 0.53639338 throughput (samples/sec): 108.61
2019-08-12 09:00:32,656 epoch 47 - iter 2120/2650 - loss 0.53754388 throughput (samples/sec): 104.72
2019-08-12 09:01:52,148 epoch 47 - iter 2385/2650 - loss 0.54090305 throughput (samples/sec): 106.73
2019-08-12 09:03:11,169 ----------------------------------------------------------------------------------------------------
2019-08-12 09:03:11,169 EPOCH 47 done: loss 0.5384 - lr 0.1000
2019-08-12 09:03:11,169 BAD EPOCHS (no improvement): 0
2019-08-12 09:03:11,169 ----------------------------------------------------------------------------------------------------
2019-08-12 09:03:11,443 epoch 48 - iter 0/2650 - loss 0.76209402 throughput (samples/sec): 31393.74
2019-08-12 09:04:28,429 epoch 48 - iter 265/2650 - loss 0.49519406 throughput (samples/sec): 110.21
2019-08-12 09:05:45,491 epoch 48 - iter 530/2650 - loss 0.51825943 throughput (samples/sec): 110.10
2019-08-12 09:07:03,450 epoch 48 - iter 795/2650 - loss 0.51911756 throughput (samples/sec): 108.83
2019-08-12 09:08:21,741 epoch 48 - iter 1060/2650 - loss 0.51967802 throughput (samples/sec): 108.37
2019-08-12 09:09:36,293 epoch 48 - iter 1325/2650 - loss 0.52165324 throughput (samples/sec): 113.80
2019-08-12 09:10:54,560 epoch 48 - iter 1590/2650 - loss 0.53121548 throughput (samples/sec): 108.40
2019-08-12 09:12:13,803 epoch 48 - iter 1855/2650 - loss 0.53365179 throughput (samples/sec): 107.07
2019-08-12 09:13:31,146 epoch 48 - iter 2120/2650 - loss 0.53169291 throughput (samples/sec): 109.70
2019-08-12 09:14:49,524 epoch 48 - iter 2385/2650 - loss 0.53432548 throughput (samples/sec): 108.25
2019-08-12 09:16:10,363 ----------------------------------------------------------------------------------------------------
2019-08-12 09:16:10,364 EPOCH 48 done: loss 0.5351 - lr 0.1000
2019-08-12 09:16:10,364 BAD EPOCHS (no improvement): 0
2019-08-12 09:16:10,364 ----------------------------------------------------------------------------------------------------
2019-08-12 09:16:10,631 epoch 49 - iter 0/2650 - loss 0.08966357 throughput (samples/sec): 32219.10
2019-08-12 09:17:31,617 epoch 49 - iter 265/2650 - loss 0.52769356 throughput (samples/sec): 104.76
2019-08-12 09:18:52,478 epoch 49 - iter 530/2650 - loss 0.50250881 throughput (samples/sec): 104.92
2019-08-12 09:20:12,583 epoch 49 - iter 795/2650 - loss 0.51260349 throughput (samples/sec): 105.91
2019-08-12 09:21:30,819 epoch 49 - iter 1060/2650 - loss 0.51387094 throughput (samples/sec): 108.44
2019-08-12 09:22:52,503 epoch 49 - iter 1325/2650 - loss 0.51607227 throughput (samples/sec): 103.86
2019-08-12 09:24:11,949 epoch 49 - iter 1590/2650 - loss 0.51872845 throughput (samples/sec): 106.79
2019-08-12 09:25:29,990 epoch 49 - iter 1855/2650 - loss 0.52187473 throughput (samples/sec): 108.71
2019-08-12 09:26:49,822 epoch 49 - iter 2120/2650 - loss 0.52525796 throughput (samples/sec): 106.28
2019-08-12 09:28:08,886 epoch 49 - iter 2385/2650 - loss 0.52685621 throughput (samples/sec): 107.31
2019-08-12 09:29:27,091 ----------------------------------------------------------------------------------------------------
2019-08-12 09:29:27,091 EPOCH 49 done: loss 0.5284 - lr 0.1000
2019-08-12 09:29:27,091 BAD EPOCHS (no improvement): 0
2019-08-12 09:29:27,091 ----------------------------------------------------------------------------------------------------
2019-08-12 09:29:27,342 epoch 50 - iter 0/2650 - loss 0.23027354 throughput (samples/sec): 34338.68
2019-08-12 09:30:45,395 epoch 50 - iter 265/2650 - loss 0.48892211 throughput (samples/sec): 108.70
2019-08-12 09:32:02,133 epoch 50 - iter 530/2650 - loss 0.49618614 throughput (samples/sec): 110.56
2019-08-12 09:33:19,997 epoch 50 - iter 795/2650 - loss 0.50483582 throughput (samples/sec): 108.96
2019-08-12 09:34:37,959 epoch 50 - iter 1060/2650 - loss 0.51166262 throughput (samples/sec): 108.82
2019-08-12 09:35:54,335 epoch 50 - iter 1325/2650 - loss 0.51167091 throughput (samples/sec): 111.08
2019-08-12 09:37:13,779 epoch 50 - iter 1590/2650 - loss 0.51971357 throughput (samples/sec): 106.79
2019-08-12 09:38:31,947 epoch 50 - iter 1855/2650 - loss 0.52071599 throughput (samples/sec): 108.54
2019-08-12 09:39:50,046 epoch 50 - iter 2120/2650 - loss 0.52318734 throughput (samples/sec): 108.63
2019-08-12 09:41:08,196 epoch 50 - iter 2385/2650 - loss 0.52455772 throughput (samples/sec): 108.56
2019-08-12 09:42:25,052 ----------------------------------------------------------------------------------------------------
2019-08-12 09:42:25,052 EPOCH 50 done: loss 0.5265 - lr 0.1000
2019-08-12 09:42:25,052 BAD EPOCHS (no improvement): 0
2019-08-12 09:42:25,052 ----------------------------------------------------------------------------------------------------
2019-08-12 09:42:25,385 epoch 51 - iter 0/2650 - loss 0.67263484 throughput (samples/sec): 25767.89
2019-08-12 09:43:43,476 epoch 51 - iter 265/2650 - loss 0.51240191 throughput (samples/sec): 108.64
2019-08-12 09:45:00,835 epoch 51 - iter 530/2650 - loss 0.51477511 throughput (samples/sec): 109.67
2019-08-12 09:46:20,904 epoch 51 - iter 795/2650 - loss 0.51401747 throughput (samples/sec): 105.96
2019-08-12 09:47:39,200 epoch 51 - iter 1060/2650 - loss 0.51482441 throughput (samples/sec): 108.36
2019-08-12 09:48:55,956 epoch 51 - iter 1325/2650 - loss 0.51594191 throughput (samples/sec): 110.53
2019-08-12 09:50:12,770 epoch 51 - iter 1590/2650 - loss 0.51866380 throughput (samples/sec): 110.45
2019-08-12 09:51:30,827 epoch 51 - iter 1855/2650 - loss 0.51767208 throughput (samples/sec): 108.69
2019-08-12 09:52:48,806 epoch 51 - iter 2120/2650 - loss 0.51815957 throughput (samples/sec): 108.80
2019-08-12 09:54:06,818 epoch 51 - iter 2385/2650 - loss 0.52204659 throughput (samples/sec): 108.76
2019-08-12 09:55:24,452 ----------------------------------------------------------------------------------------------------
2019-08-12 09:55:24,452 EPOCH 51 done: loss 0.5208 - lr 0.1000
2019-08-12 09:55:24,452 BAD EPOCHS (no improvement): 0
2019-08-12 09:55:24,453 ----------------------------------------------------------------------------------------------------
2019-08-12 09:55:24,782 epoch 52 - iter 0/2650 - loss 0.11427093 throughput (samples/sec): 25995.79
2019-08-12 09:56:42,808 epoch 52 - iter 265/2650 - loss 0.52726005 throughput (samples/sec): 108.74
2019-08-12 09:58:02,300 epoch 52 - iter 530/2650 - loss 0.52325459 throughput (samples/sec): 106.73
2019-08-12 09:59:20,466 epoch 52 - iter 795/2650 - loss 0.51578378 throughput (samples/sec): 108.54
2019-08-12 10:00:36,998 epoch 52 - iter 1060/2650 - loss 0.51252964 throughput (samples/sec): 110.86
2019-08-12 10:01:54,335 epoch 52 - iter 1325/2650 - loss 0.51144501 throughput (samples/sec): 109.71
2019-08-12 10:03:12,266 epoch 52 - iter 1590/2650 - loss 0.51437415 throughput (samples/sec): 108.87
2019-08-12 10:04:29,865 epoch 52 - iter 1855/2650 - loss 0.51893561 throughput (samples/sec): 109.33
2019-08-12 10:05:49,151 epoch 52 - iter 2120/2650 - loss 0.51934983 throughput (samples/sec): 107.01
2019-08-12 10:07:06,155 epoch 52 - iter 2385/2650 - loss 0.52203950 throughput (samples/sec): 110.18
2019-08-12 10:08:23,720 ----------------------------------------------------------------------------------------------------
2019-08-12 10:08:23,720 EPOCH 52 done: loss 0.5229 - lr 0.1000
2019-08-12 10:08:23,720 BAD EPOCHS (no improvement): 1
2019-08-12 10:08:23,721 ----------------------------------------------------------------------------------------------------
2019-08-12 10:08:23,995 epoch 53 - iter 0/2650 - loss 0.62519002 throughput (samples/sec): 31326.94
2019-08-12 10:09:41,631 epoch 53 - iter 265/2650 - loss 0.53954853 throughput (samples/sec): 109.28
2019-08-12 10:10:57,715 epoch 53 - iter 530/2650 - loss 0.52353394 throughput (samples/sec): 111.51
2019-08-12 10:12:13,085 epoch 53 - iter 795/2650 - loss 0.52143431 throughput (samples/sec): 112.57
2019-08-12 10:13:33,064 epoch 53 - iter 1060/2650 - loss 0.52581944 throughput (samples/sec): 106.08
2019-08-12 10:14:52,957 epoch 53 - iter 1325/2650 - loss 0.52235465 throughput (samples/sec): 106.19
2019-08-12 10:16:13,713 epoch 53 - iter 1590/2650 - loss 0.52293470 throughput (samples/sec): 105.06
2019-08-12 10:17:35,200 epoch 53 - iter 1855/2650 - loss 0.52344659 throughput (samples/sec): 104.11
2019-08-12 10:18:55,238 epoch 53 - iter 2120/2650 - loss 0.52367783 throughput (samples/sec): 106.00
2019-08-12 10:20:16,370 epoch 53 - iter 2385/2650 - loss 0.52438680 throughput (samples/sec): 104.57
2019-08-12 10:21:34,280 ----------------------------------------------------------------------------------------------------
2019-08-12 10:21:34,280 EPOCH 53 done: loss 0.5247 - lr 0.1000
2019-08-12 10:21:34,281 BAD EPOCHS (no improvement): 2
2019-08-12 10:21:34,281 ----------------------------------------------------------------------------------------------------
2019-08-12 10:21:34,542 epoch 54 - iter 0/2650 - loss 0.26613206 throughput (samples/sec): 32897.51
2019-08-12 10:22:54,132 epoch 54 - iter 265/2650 - loss 0.48940829 throughput (samples/sec): 106.60
2019-08-12 10:24:14,543 epoch 54 - iter 530/2650 - loss 0.50563840 throughput (samples/sec): 105.51
2019-08-12 10:25:32,856 epoch 54 - iter 795/2650 - loss 0.51056526 throughput (samples/sec): 108.34
2019-08-12 10:26:53,163 epoch 54 - iter 1060/2650 - loss 0.52030244 throughput (samples/sec): 105.65
2019-08-12 10:28:11,122 epoch 54 - iter 1325/2650 - loss 0.51467976 throughput (samples/sec): 108.83
2019-08-12 10:29:31,619 epoch 54 - iter 1590/2650 - loss 0.51598839 throughput (samples/sec): 105.40
2019-08-12 10:30:52,536 epoch 54 - iter 1855/2650 - loss 0.51946085 throughput (samples/sec): 104.85
2019-08-12 10:32:11,714 epoch 54 - iter 2120/2650 - loss 0.52009488 throughput (samples/sec): 107.15
2019-08-12 10:33:30,862 epoch 54 - iter 2385/2650 - loss 0.51917658 throughput (samples/sec): 107.19
2019-08-12 10:34:47,920 ----------------------------------------------------------------------------------------------------
2019-08-12 10:34:47,921 EPOCH 54 done: loss 0.5198 - lr 0.1000
2019-08-12 10:34:47,921 BAD EPOCHS (no improvement): 0
2019-08-12 10:34:47,921 ----------------------------------------------------------------------------------------------------
2019-08-12 10:34:48,142 epoch 55 - iter 0/2650 - loss 0.26267117 throughput (samples/sec): 38938.66
2019-08-12 10:36:08,796 epoch 55 - iter 265/2650 - loss 0.49415482 throughput (samples/sec): 105.19
2019-08-12 10:37:28,347 epoch 55 - iter 530/2650 - loss 0.48539692 throughput (samples/sec): 106.65
2019-08-12 10:38:46,960 epoch 55 - iter 795/2650 - loss 0.48705161 throughput (samples/sec): 107.92
2019-08-12 10:40:02,661 epoch 55 - iter 1060/2650 - loss 0.48655657 throughput (samples/sec): 112.07
2019-08-12 10:41:20,151 epoch 55 - iter 1325/2650 - loss 0.49126869 throughput (samples/sec): 109.48
2019-08-12 10:42:36,316 epoch 55 - iter 1590/2650 - loss 0.49258110 throughput (samples/sec): 111.39
2019-08-12 10:43:53,644 epoch 55 - iter 1855/2650 - loss 0.49941904 throughput (samples/sec): 109.72
2019-08-12 10:45:11,685 epoch 55 - iter 2120/2650 - loss 0.50099511 throughput (samples/sec): 108.71
2019-08-12 10:46:30,480 epoch 55 - iter 2385/2650 - loss 0.50574968 throughput (samples/sec): 107.67
2019-08-12 10:47:47,860 ----------------------------------------------------------------------------------------------------
2019-08-12 10:47:47,860 EPOCH 55 done: loss 0.5088 - lr 0.1000
2019-08-12 10:47:47,861 BAD EPOCHS (no improvement): 0
2019-08-12 10:47:47,861 ----------------------------------------------------------------------------------------------------
2019-08-12 10:47:48,269 epoch 56 - iter 0/2650 - loss 0.11699539 throughput (samples/sec): 20964.72
2019-08-12 10:49:06,777 epoch 56 - iter 265/2650 - loss 0.46701337 throughput (samples/sec): 108.07
2019-08-12 10:50:23,064 epoch 56 - iter 530/2650 - loss 0.48362183 throughput (samples/sec): 111.22
2019-08-12 10:51:42,274 epoch 56 - iter 795/2650 - loss 0.49609465 throughput (samples/sec): 107.11
2019-08-12 10:53:00,187 epoch 56 - iter 1060/2650 - loss 0.50037971 throughput (samples/sec): 108.89
2019-08-12 10:54:18,660 epoch 56 - iter 1325/2650 - loss 0.49891612 throughput (samples/sec): 108.11
2019-08-12 10:55:36,368 epoch 56 - iter 1590/2650 - loss 0.50006037 throughput (samples/sec): 109.18
2019-08-12 10:56:52,882 epoch 56 - iter 1855/2650 - loss 0.50536310 throughput (samples/sec): 110.88
2019-08-12 10:58:08,747 epoch 56 - iter 2120/2650 - loss 0.50630645 throughput (samples/sec): 111.83
2019-08-12 10:59:23,783 epoch 56 - iter 2385/2650 - loss 0.50650984 throughput (samples/sec): 113.07
2019-08-12 11:00:42,020 ----------------------------------------------------------------------------------------------------
2019-08-12 11:00:42,020 EPOCH 56 done: loss 0.5092 - lr 0.1000
2019-08-12 11:00:42,021 BAD EPOCHS (no improvement): 1
2019-08-12 11:00:42,021 ----------------------------------------------------------------------------------------------------
2019-08-12 11:00:42,366 epoch 57 - iter 0/2650 - loss 0.49121720 throughput (samples/sec): 24832.25
2019-08-12 11:02:00,717 epoch 57 - iter 265/2650 - loss 0.46957165 throughput (samples/sec): 108.28
2019-08-12 11:03:17,610 epoch 57 - iter 530/2650 - loss 0.48848388 throughput (samples/sec): 110.34
2019-08-12 11:04:33,748 epoch 57 - iter 795/2650 - loss 0.48676433 throughput (samples/sec): 111.43
2019-08-12 11:05:51,186 epoch 57 - iter 1060/2650 - loss 0.49432349 throughput (samples/sec): 109.56
2019-08-12 11:07:09,322 epoch 57 - iter 1325/2650 - loss 0.49895011 throughput (samples/sec): 108.58
2019-08-12 11:08:26,913 epoch 57 - iter 1590/2650 - loss 0.50567819 throughput (samples/sec): 109.35
2019-08-12 11:09:43,619 epoch 57 - iter 1855/2650 - loss 0.50883251 throughput (samples/sec): 110.61
2019-08-12 11:11:00,346 epoch 57 - iter 2120/2650 - loss 0.50693422 throughput (samples/sec): 110.58
2019-08-12 11:12:16,700 epoch 57 - iter 2385/2650 - loss 0.51005195 throughput (samples/sec): 111.12
2019-08-12 11:13:34,110 ----------------------------------------------------------------------------------------------------
2019-08-12 11:13:34,110 EPOCH 57 done: loss 0.5101 - lr 0.1000
2019-08-12 11:13:34,110 BAD EPOCHS (no improvement): 2
2019-08-12 11:13:34,110 ----------------------------------------------------------------------------------------------------
2019-08-12 11:13:34,526 epoch 58 - iter 0/2650 - loss 0.58059561 throughput (samples/sec): 20575.20
2019-08-12 11:14:50,949 epoch 58 - iter 265/2650 - loss 0.51895632 throughput (samples/sec): 111.02
2019-08-12 11:16:06,465 epoch 58 - iter 530/2650 - loss 0.49929218 throughput (samples/sec): 112.35
2019-08-12 11:17:23,148 epoch 58 - iter 795/2650 - loss 0.50407357 throughput (samples/sec): 110.64
2019-08-12 11:18:39,091 epoch 58 - iter 1060/2650 - loss 0.50945062 throughput (samples/sec): 111.72
2019-08-12 11:19:55,645 epoch 58 - iter 1325/2650 - loss 0.51012843 throughput (samples/sec): 110.82
2019-08-12 11:21:11,910 epoch 58 - iter 1590/2650 - loss 0.51062630 throughput (samples/sec): 111.24
2019-08-12 11:22:27,695 epoch 58 - iter 1855/2650 - loss 0.51354432 throughput (samples/sec): 111.95
2019-08-12 11:23:43,190 epoch 58 - iter 2120/2650 - loss 0.51399192 throughput (samples/sec): 112.38
2019-08-12 11:25:02,604 epoch 58 - iter 2385/2650 - loss 0.51199966 throughput (samples/sec): 106.83
2019-08-12 11:26:17,716 ----------------------------------------------------------------------------------------------------
2019-08-12 11:26:17,716 EPOCH 58 done: loss 0.5115 - lr 0.1000
2019-08-12 11:26:17,716 BAD EPOCHS (no improvement): 3
2019-08-12 11:26:17,716 ----------------------------------------------------------------------------------------------------
2019-08-12 11:26:18,127 epoch 59 - iter 0/2650 - loss 0.68951619 throughput (samples/sec): 20831.11
2019-08-12 11:27:33,874 epoch 59 - iter 265/2650 - loss 0.53633732 throughput (samples/sec): 112.01
2019-08-12 11:28:51,504 epoch 59 - iter 530/2650 - loss 0.51412781 throughput (samples/sec): 109.29
2019-08-12 11:30:11,374 epoch 59 - iter 795/2650 - loss 0.50272292 throughput (samples/sec): 106.22
2019-08-12 11:31:29,622 epoch 59 - iter 1060/2650 - loss 0.49883736 throughput (samples/sec): 108.42
2019-08-12 11:32:47,234 epoch 59 - iter 1325/2650 - loss 0.50064599 throughput (samples/sec): 109.31
2019-08-12 11:34:06,197 epoch 59 - iter 1590/2650 - loss 0.49936305 throughput (samples/sec): 107.44
2019-08-12 11:35:23,068 epoch 59 - iter 1855/2650 - loss 0.49997760 throughput (samples/sec): 110.37
2019-08-12 11:36:40,905 epoch 59 - iter 2120/2650 - loss 0.50658907 throughput (samples/sec): 109.00
2019-08-12 11:37:57,377 epoch 59 - iter 2385/2650 - loss 0.50411548 throughput (samples/sec): 110.94
2019-08-12 11:39:13,326 ----------------------------------------------------------------------------------------------------
2019-08-12 11:39:13,326 EPOCH 59 done: loss 0.5055 - lr 0.1000
2019-08-12 11:39:13,326 BAD EPOCHS (no improvement): 0
2019-08-12 11:39:13,326 ----------------------------------------------------------------------------------------------------
2019-08-12 11:39:13,615 epoch 60 - iter 0/2650 - loss 0.15796173 throughput (samples/sec): 29723.92
2019-08-12 11:40:29,856 epoch 60 - iter 265/2650 - loss 0.50355042 throughput (samples/sec): 111.28
2019-08-12 11:41:48,612 epoch 60 - iter 530/2650 - loss 0.49222993 throughput (samples/sec): 107.73
2019-08-12 11:43:05,866 epoch 60 - iter 795/2650 - loss 0.49334844 throughput (samples/sec): 109.82
2019-08-12 11:44:22,708 epoch 60 - iter 1060/2650 - loss 0.49476992 throughput (samples/sec): 110.41
2019-08-12 11:45:38,677 epoch 60 - iter 1325/2650 - loss 0.49113680 throughput (samples/sec): 111.68
2019-08-12 11:46:55,036 epoch 60 - iter 1590/2650 - loss 0.49861914 throughput (samples/sec): 111.11
2019-08-12 11:48:12,644 epoch 60 - iter 1855/2650 - loss 0.50386417 throughput (samples/sec): 109.32
2019-08-12 11:49:28,915 epoch 60 - iter 2120/2650 - loss 0.49690998 throughput (samples/sec): 111.23
2019-08-12 11:50:45,756 epoch 60 - iter 2385/2650 - loss 0.49862084 throughput (samples/sec): 110.41
2019-08-12 11:52:01,666 ----------------------------------------------------------------------------------------------------
2019-08-12 11:52:01,666 EPOCH 60 done: loss 0.5029 - lr 0.1000
2019-08-12 11:52:01,666 BAD EPOCHS (no improvement): 0
2019-08-12 11:52:01,666 ----------------------------------------------------------------------------------------------------
2019-08-12 11:52:02,042 epoch 61 - iter 0/2650 - loss 0.59153724 throughput (samples/sec): 22754.63
2019-08-12 11:53:17,876 epoch 61 - iter 265/2650 - loss 0.48726756 throughput (samples/sec): 111.88
2019-08-12 11:54:35,339 epoch 61 - iter 530/2650 - loss 0.49702788 throughput (samples/sec): 109.52
2019-08-12 11:55:51,524 epoch 61 - iter 795/2650 - loss 0.50203507 throughput (samples/sec): 111.36
2019-08-12 11:57:08,247 epoch 61 - iter 1060/2650 - loss 0.50675233 throughput (samples/sec): 110.58
2019-08-12 11:58:26,819 epoch 61 - iter 1325/2650 - loss 0.50994041 throughput (samples/sec): 107.98
2019-08-12 11:59:42,558 epoch 61 - iter 1590/2650 - loss 0.51079881 throughput (samples/sec): 112.02
2019-08-12 12:01:00,301 epoch 61 - iter 1855/2650 - loss 0.51050157 throughput (samples/sec): 109.13
2019-08-12 12:02:17,056 epoch 61 - iter 2120/2650 - loss 0.50831956 throughput (samples/sec): 110.53
2019-08-12 12:03:32,208 epoch 61 - iter 2385/2650 - loss 0.50809217 throughput (samples/sec): 112.89
2019-08-12 12:04:48,530 ----------------------------------------------------------------------------------------------------
2019-08-12 12:04:48,530 EPOCH 61 done: loss 0.5078 - lr 0.1000
2019-08-12 12:04:48,530 BAD EPOCHS (no improvement): 1
2019-08-12 12:04:48,530 ----------------------------------------------------------------------------------------------------
2019-08-12 12:04:48,855 epoch 62 - iter 0/2650 - loss 0.43147719 throughput (samples/sec): 26373.13
2019-08-12 12:06:05,011 epoch 62 - iter 265/2650 - loss 0.47312670 throughput (samples/sec): 111.40
2019-08-12 12:07:20,303 epoch 62 - iter 530/2650 - loss 0.47047450 throughput (samples/sec): 112.68
2019-08-12 12:08:37,180 epoch 62 - iter 795/2650 - loss 0.47743557 throughput (samples/sec): 110.36
2019-08-12 12:09:52,537 epoch 62 - iter 1060/2650 - loss 0.48966704 throughput (samples/sec): 112.59
2019-08-12 12:11:10,268 epoch 62 - iter 1325/2650 - loss 0.49194592 throughput (samples/sec): 109.14
2019-08-12 12:12:26,186 epoch 62 - iter 1590/2650 - loss 0.49373040 throughput (samples/sec): 111.75
2019-08-12 12:13:42,638 epoch 62 - iter 1855/2650 - loss 0.49662910 throughput (samples/sec): 110.97
2019-08-12 12:14:58,774 epoch 62 - iter 2120/2650 - loss 0.49436961 throughput (samples/sec): 111.43
2019-08-12 12:16:14,494 epoch 62 - iter 2385/2650 - loss 0.49252737 throughput (samples/sec): 112.04
2019-08-12 12:17:31,650 ----------------------------------------------------------------------------------------------------
2019-08-12 12:17:31,651 EPOCH 62 done: loss 0.4939 - lr 0.1000
2019-08-12 12:17:31,651 BAD EPOCHS (no improvement): 0
2019-08-12 12:17:31,651 ----------------------------------------------------------------------------------------------------
2019-08-12 12:17:32,017 epoch 63 - iter 0/2650 - loss 0.44970968 throughput (samples/sec): 23410.67
2019-08-12 12:18:48,898 epoch 63 - iter 265/2650 - loss 0.48066836 throughput (samples/sec): 110.35
2019-08-12 12:20:10,005 epoch 63 - iter 530/2650 - loss 0.47576620 throughput (samples/sec): 104.60
2019-08-12 12:21:29,137 epoch 63 - iter 795/2650 - loss 0.49560808 throughput (samples/sec): 107.21
2019-08-12 12:22:47,482 epoch 63 - iter 1060/2650 - loss 0.49559237 throughput (samples/sec): 108.29
2019-08-12 12:24:05,474 epoch 63 - iter 1325/2650 - loss 0.49176046 throughput (samples/sec): 108.78
2019-08-12 12:25:27,526 epoch 63 - iter 1590/2650 - loss 0.49379389 throughput (samples/sec): 103.40
2019-08-12 12:26:46,622 epoch 63 - iter 1855/2650 - loss 0.49086206 throughput (samples/sec): 107.26
2019-08-12 12:28:02,618 epoch 63 - iter 2120/2650 - loss 0.49269984 throughput (samples/sec): 111.64
2019-08-12 12:29:21,078 epoch 63 - iter 2385/2650 - loss 0.49399415 throughput (samples/sec): 108.13
2019-08-12 12:30:40,428 ----------------------------------------------------------------------------------------------------
2019-08-12 12:30:40,428 EPOCH 63 done: loss 0.4991 - lr 0.1000
2019-08-12 12:30:40,428 BAD EPOCHS (no improvement): 1
2019-08-12 12:30:40,429 ----------------------------------------------------------------------------------------------------
2019-08-12 12:30:40,737 epoch 64 - iter 0/2650 - loss 0.83898234 throughput (samples/sec): 27775.13
2019-08-12 12:32:00,995 epoch 64 - iter 265/2650 - loss 0.51945217 throughput (samples/sec): 105.71
2019-08-12 12:33:16,985 epoch 64 - iter 530/2650 - loss 0.49001269 throughput (samples/sec): 111.65
2019-08-12 12:34:34,570 epoch 64 - iter 795/2650 - loss 0.49033607 throughput (samples/sec): 109.35
2019-08-12 12:35:52,544 epoch 64 - iter 1060/2650 - loss 0.49432280 throughput (samples/sec): 108.80
2019-08-12 12:37:10,196 epoch 64 - iter 1325/2650 - loss 0.49574733 throughput (samples/sec): 109.26
2019-08-12 12:38:29,214 epoch 64 - iter 1590/2650 - loss 0.49207065 throughput (samples/sec): 107.37
2019-08-12 12:39:46,274 epoch 64 - iter 1855/2650 - loss 0.49260375 throughput (samples/sec): 110.10
2019-08-12 12:41:03,861 epoch 64 - iter 2120/2650 - loss 0.49636495 throughput (samples/sec): 109.35
2019-08-12 12:42:19,852 epoch 64 - iter 2385/2650 - loss 0.49444269 throughput (samples/sec): 111.65
2019-08-12 12:43:38,220 ----------------------------------------------------------------------------------------------------
2019-08-12 12:43:38,220 EPOCH 64 done: loss 0.4935 - lr 0.1000
2019-08-12 12:43:38,220 BAD EPOCHS (no improvement): 0
2019-08-12 12:43:38,220 ----------------------------------------------------------------------------------------------------
2019-08-12 12:43:38,538 epoch 65 - iter 0/2650 - loss 0.51471126 throughput (samples/sec): 27005.48
2019-08-12 12:44:54,881 epoch 65 - iter 265/2650 - loss 0.46105807 throughput (samples/sec): 111.13
2019-08-12 12:46:13,695 epoch 65 - iter 530/2650 - loss 0.48979031 throughput (samples/sec): 107.65
2019-08-12 12:47:33,616 epoch 65 - iter 795/2650 - loss 0.48771245 throughput (samples/sec): 106.15
2019-08-12 12:48:52,188 epoch 65 - iter 1060/2650 - loss 0.48924587 throughput (samples/sec): 107.98
2019-08-12 12:50:10,186 epoch 65 - iter 1325/2650 - loss 0.48386568 throughput (samples/sec): 108.77
2019-08-12 12:51:27,953 epoch 65 - iter 1590/2650 - loss 0.48812057 throughput (samples/sec): 109.09
2019-08-12 12:52:46,205 epoch 65 - iter 1855/2650 - loss 0.48865780 throughput (samples/sec): 108.42
2019-08-12 12:54:03,423 epoch 65 - iter 2120/2650 - loss 0.49411103 throughput (samples/sec): 109.87
2019-08-12 12:55:20,437 epoch 65 - iter 2385/2650 - loss 0.49453819 throughput (samples/sec): 110.16
2019-08-12 12:56:41,747 ----------------------------------------------------------------------------------------------------
2019-08-12 12:56:41,747 EPOCH 65 done: loss 0.4926 - lr 0.1000
2019-08-12 12:56:41,747 BAD EPOCHS (no improvement): 0
2019-08-12 12:56:41,747 ----------------------------------------------------------------------------------------------------
2019-08-12 12:56:42,054 epoch 66 - iter 0/2650 - loss 0.84449202 throughput (samples/sec): 27993.14
2019-08-12 12:57:58,943 epoch 66 - iter 265/2650 - loss 0.48742840 throughput (samples/sec): 110.34
2019-08-12 12:59:16,036 epoch 66 - iter 530/2650 - loss 0.46705868 throughput (samples/sec): 110.05
2019-08-12 13:00:35,860 epoch 66 - iter 795/2650 - loss 0.48897716 throughput (samples/sec): 106.28
2019-08-12 13:01:52,253 epoch 66 - iter 1060/2650 - loss 0.48930337 throughput (samples/sec): 111.06
2019-08-12 13:03:09,104 epoch 66 - iter 1325/2650 - loss 0.49034843 throughput (samples/sec): 110.40
2019-08-12 13:04:26,689 epoch 66 - iter 1590/2650 - loss 0.48826870 throughput (samples/sec): 109.35
2019-08-12 13:05:44,603 epoch 66 - iter 1855/2650 - loss 0.49062122 throughput (samples/sec): 108.89
2019-08-12 13:07:00,662 epoch 66 - iter 2120/2650 - loss 0.49329560 throughput (samples/sec): 111.55
2019-08-12 13:08:16,060 epoch 66 - iter 2385/2650 - loss 0.49606165 throughput (samples/sec): 112.52
2019-08-12 13:09:30,836 ----------------------------------------------------------------------------------------------------
2019-08-12 13:09:30,836 EPOCH 66 done: loss 0.4948 - lr 0.1000
2019-08-12 13:09:30,836 BAD EPOCHS (no improvement): 1
2019-08-12 13:09:30,836 ----------------------------------------------------------------------------------------------------
2019-08-12 13:09:31,157 epoch 67 - iter 0/2650 - loss 1.05278242 throughput (samples/sec): 26676.38
2019-08-12 13:10:48,624 epoch 67 - iter 265/2650 - loss 0.48367242 throughput (samples/sec): 109.52
2019-08-12 13:12:04,602 epoch 67 - iter 530/2650 - loss 0.47831137 throughput (samples/sec): 111.66
2019-08-12 13:13:20,974 epoch 67 - iter 795/2650 - loss 0.46661970 throughput (samples/sec): 111.09
2019-08-12 13:14:35,862 epoch 67 - iter 1060/2650 - loss 0.46554622 throughput (samples/sec): 113.29
2019-08-12 13:15:51,342 epoch 67 - iter 1325/2650 - loss 0.47481670 throughput (samples/sec): 112.40
2019-08-12 13:17:07,677 epoch 67 - iter 1590/2650 - loss 0.47717319 throughput (samples/sec): 111.14
2019-08-12 13:18:25,321 epoch 67 - iter 1855/2650 - loss 0.48574195 throughput (samples/sec): 109.27
2019-08-12 13:19:42,993 epoch 67 - iter 2120/2650 - loss 0.48916077 throughput (samples/sec): 109.23
2019-08-12 13:20:58,930 epoch 67 - iter 2385/2650 - loss 0.48942138 throughput (samples/sec): 111.73
2019-08-12 13:22:17,048 ----------------------------------------------------------------------------------------------------
2019-08-12 13:22:17,048 EPOCH 67 done: loss 0.4895 - lr 0.1000
2019-08-12 13:22:17,048 BAD EPOCHS (no improvement): 0
2019-08-12 13:22:17,048 ----------------------------------------------------------------------------------------------------
2019-08-12 13:22:17,420 epoch 68 - iter 0/2650 - loss 0.71457261 throughput (samples/sec): 23041.33
2019-08-12 13:23:34,831 epoch 68 - iter 265/2650 - loss 0.51803515 throughput (samples/sec): 109.60
2019-08-12 13:24:50,882 epoch 68 - iter 530/2650 - loss 0.48896211 throughput (samples/sec): 111.56
2019-08-12 13:26:09,601 epoch 68 - iter 795/2650 - loss 0.49153956 throughput (samples/sec): 107.78
2019-08-12 13:27:24,000 epoch 68 - iter 1060/2650 - loss 0.49360891 throughput (samples/sec): 114.04
2019-08-12 13:28:40,656 epoch 68 - iter 1325/2650 - loss 0.49224172 throughput (samples/sec): 110.68
2019-08-12 13:29:56,579 epoch 68 - iter 1590/2650 - loss 0.49469501 throughput (samples/sec): 111.74
2019-08-12 13:31:13,984 epoch 68 - iter 1855/2650 - loss 0.49420445 throughput (samples/sec): 109.60
2019-08-12 13:32:30,922 epoch 68 - iter 2120/2650 - loss 0.49102090 throughput (samples/sec): 110.27
2019-08-12 13:33:47,602 epoch 68 - iter 2385/2650 - loss 0.49010321 throughput (samples/sec): 110.64
2019-08-12 13:35:02,326 ----------------------------------------------------------------------------------------------------
2019-08-12 13:35:02,326 EPOCH 68 done: loss 0.4901 - lr 0.1000
2019-08-12 13:35:02,326 BAD EPOCHS (no improvement): 1
2019-08-12 13:35:02,326 ----------------------------------------------------------------------------------------------------
2019-08-12 13:35:02,622 epoch 69 - iter 0/2650 - loss 0.17252702 throughput (samples/sec): 28939.74
2019-08-12 13:36:19,845 epoch 69 - iter 265/2650 - loss 0.45271046 throughput (samples/sec): 109.86
2019-08-12 13:37:36,630 epoch 69 - iter 530/2650 - loss 0.45327377 throughput (samples/sec): 110.49
2019-08-12 13:38:54,960 epoch 69 - iter 795/2650 - loss 0.46023356 throughput (samples/sec): 108.31
2019-08-12 13:40:12,468 epoch 69 - iter 1060/2650 - loss 0.46110312 throughput (samples/sec): 109.46
2019-08-12 13:41:29,792 epoch 69 - iter 1325/2650 - loss 0.46717844 throughput (samples/sec): 109.72
2019-08-12 13:42:47,223 epoch 69 - iter 1590/2650 - loss 0.47513514 throughput (samples/sec): 109.57
2019-08-12 13:44:03,919 epoch 69 - iter 1855/2650 - loss 0.47638214 throughput (samples/sec): 110.62
2019-08-12 13:45:19,914 epoch 69 - iter 2120/2650 - loss 0.47724745 throughput (samples/sec): 111.64
2019-08-12 13:46:39,060 epoch 69 - iter 2385/2650 - loss 0.47877114 throughput (samples/sec): 107.19
2019-08-12 13:47:54,844 ----------------------------------------------------------------------------------------------------
2019-08-12 13:47:54,844 EPOCH 69 done: loss 0.4810 - lr 0.1000
2019-08-12 13:47:54,844 BAD EPOCHS (no improvement): 0
2019-08-12 13:47:54,845 ----------------------------------------------------------------------------------------------------
2019-08-12 13:47:55,142 epoch 70 - iter 0/2650 - loss 0.45940238 throughput (samples/sec): 28879.07
2019-08-12 13:49:12,661 epoch 70 - iter 265/2650 - loss 0.47561843 throughput (samples/sec): 109.44
2019-08-12 13:50:28,625 epoch 70 - iter 530/2650 - loss 0.46331223 throughput (samples/sec): 111.69
2019-08-12 13:51:43,135 epoch 70 - iter 795/2650 - loss 0.46963501 throughput (samples/sec): 113.87
2019-08-12 13:53:02,823 epoch 70 - iter 1060/2650 - loss 0.47349647 throughput (samples/sec): 106.46
2019-08-12 13:54:20,965 epoch 70 - iter 1325/2650 - loss 0.47902322 throughput (samples/sec): 108.57
2019-08-12 13:55:38,582 epoch 70 - iter 1590/2650 - loss 0.47790279 throughput (samples/sec): 109.30
2019-08-12 13:56:56,827 epoch 70 - iter 1855/2650 - loss 0.48012460 throughput (samples/sec): 108.43
2019-08-12 13:58:13,703 epoch 70 - iter 2120/2650 - loss 0.48151723 throughput (samples/sec): 110.36
2019-08-12 13:59:30,813 epoch 70 - iter 2385/2650 - loss 0.48157740 throughput (samples/sec): 110.03
2019-08-12 14:00:52,097 ----------------------------------------------------------------------------------------------------
2019-08-12 14:00:52,097 EPOCH 70 done: loss 0.4830 - lr 0.1000
2019-08-12 14:00:52,097 BAD EPOCHS (no improvement): 1
2019-08-12 14:00:52,098 ----------------------------------------------------------------------------------------------------
2019-08-12 14:00:52,441 epoch 71 - iter 0/2650 - loss 0.96086407 throughput (samples/sec): 24981.65
2019-08-12 14:02:11,265 epoch 71 - iter 265/2650 - loss 0.44273237 throughput (samples/sec): 107.63
2019-08-12 14:03:31,098 epoch 71 - iter 530/2650 - loss 0.46914566 throughput (samples/sec): 106.27
2019-08-12 14:04:50,624 epoch 71 - iter 795/2650 - loss 0.46940925 throughput (samples/sec): 106.68
2019-08-12 14:06:09,225 epoch 71 - iter 1060/2650 - loss 0.47126541 throughput (samples/sec): 107.94
2019-08-12 14:07:28,468 epoch 71 - iter 1325/2650 - loss 0.47781853 throughput (samples/sec): 107.06
2019-08-12 14:08:46,497 epoch 71 - iter 1590/2650 - loss 0.47971609 throughput (samples/sec): 108.73
2019-08-12 14:10:03,763 epoch 71 - iter 1855/2650 - loss 0.48107224 throughput (samples/sec): 109.80
2019-08-12 14:11:23,128 epoch 71 - iter 2120/2650 - loss 0.48045442 throughput (samples/sec): 106.90
2019-08-12 14:12:41,476 epoch 71 - iter 2385/2650 - loss 0.48311796 throughput (samples/sec): 108.29
2019-08-12 14:14:00,130 ----------------------------------------------------------------------------------------------------
2019-08-12 14:14:00,130 EPOCH 71 done: loss 0.4839 - lr 0.1000
2019-08-12 14:14:00,130 BAD EPOCHS (no improvement): 2
2019-08-12 14:14:00,130 ----------------------------------------------------------------------------------------------------
2019-08-12 14:14:00,509 epoch 72 - iter 0/2650 - loss 0.41513059 throughput (samples/sec): 22604.37
2019-08-12 14:15:19,824 epoch 72 - iter 265/2650 - loss 0.47009553 throughput (samples/sec): 106.96
2019-08-12 14:16:37,091 epoch 72 - iter 530/2650 - loss 0.47624295 throughput (samples/sec): 109.80
2019-08-12 14:17:56,683 epoch 72 - iter 795/2650 - loss 0.47935785 throughput (samples/sec): 106.59
2019-08-12 14:19:12,042 epoch 72 - iter 1060/2650 - loss 0.47768538 throughput (samples/sec): 112.58
2019-08-12 14:20:30,951 epoch 72 - iter 1325/2650 - loss 0.47852821 throughput (samples/sec): 107.51
2019-08-12 14:21:50,340 epoch 72 - iter 1590/2650 - loss 0.48082850 throughput (samples/sec): 106.86
2019-08-12 14:23:09,987 epoch 72 - iter 1855/2650 - loss 0.47819758 throughput (samples/sec): 106.52
2019-08-12 14:24:27,609 epoch 72 - iter 2120/2650 - loss 0.48267757 throughput (samples/sec): 109.30
2019-08-12 14:25:48,785 epoch 72 - iter 2385/2650 - loss 0.48389539 throughput (samples/sec): 104.51
2019-08-12 14:27:07,409 ----------------------------------------------------------------------------------------------------
2019-08-12 14:27:07,409 EPOCH 72 done: loss 0.4846 - lr 0.1000
2019-08-12 14:27:07,409 BAD EPOCHS (no improvement): 3
2019-08-12 14:27:07,409 ----------------------------------------------------------------------------------------------------
2019-08-12 14:27:07,888 epoch 73 - iter 0/2650 - loss 0.62538075 throughput (samples/sec): 17865.66
2019-08-12 14:28:27,788 epoch 73 - iter 265/2650 - loss 0.49047177 throughput (samples/sec): 106.18
2019-08-12 14:29:46,559 epoch 73 - iter 530/2650 - loss 0.47583612 throughput (samples/sec): 107.70
2019-08-12 14:31:05,726 epoch 73 - iter 795/2650 - loss 0.47924337 throughput (samples/sec): 107.16
2019-08-12 14:32:23,463 epoch 73 - iter 1060/2650 - loss 0.47922236 throughput (samples/sec): 109.14
2019-08-12 14:33:40,582 epoch 73 - iter 1325/2650 - loss 0.47658383 throughput (samples/sec): 110.01
2019-08-12 14:34:57,186 epoch 73 - iter 1590/2650 - loss 0.47412361 throughput (samples/sec): 110.75
2019-08-12 14:36:12,713 epoch 73 - iter 1855/2650 - loss 0.47580839 throughput (samples/sec): 112.33
2019-08-12 14:37:30,613 epoch 73 - iter 2120/2650 - loss 0.47892538 throughput (samples/sec): 108.91
2019-08-12 14:38:46,913 epoch 73 - iter 2385/2650 - loss 0.48069653 throughput (samples/sec): 111.19
2019-08-12 14:40:01,760 ----------------------------------------------------------------------------------------------------
2019-08-12 14:40:01,760 EPOCH 73 done: loss 0.4804 - lr 0.1000
2019-08-12 14:40:01,760 BAD EPOCHS (no improvement): 0
2019-08-12 14:40:01,760 ----------------------------------------------------------------------------------------------------
2019-08-12 14:40:02,110 epoch 74 - iter 0/2650 - loss 0.28202450 throughput (samples/sec): 24490.58
2019-08-12 14:41:18,781 epoch 74 - iter 265/2650 - loss 0.44232301 throughput (samples/sec): 110.66
2019-08-12 14:42:37,156 epoch 74 - iter 530/2650 - loss 0.45597515 throughput (samples/sec): 108.25
2019-08-12 14:43:56,172 epoch 74 - iter 795/2650 - loss 0.46416908 throughput (samples/sec): 107.37
2019-08-12 14:45:16,394 epoch 74 - iter 1060/2650 - loss 0.46032570 throughput (samples/sec): 105.76
2019-08-12 14:46:35,183 epoch 74 - iter 1325/2650 - loss 0.46366915 throughput (samples/sec): 107.68
2019-08-12 14:47:54,082 epoch 74 - iter 1590/2650 - loss 0.47044123 throughput (samples/sec): 107.53
2019-08-12 14:49:13,775 epoch 74 - iter 1855/2650 - loss 0.47277840 throughput (samples/sec): 106.46
2019-08-12 14:50:31,729 epoch 74 - iter 2120/2650 - loss 0.47376256 throughput (samples/sec): 108.83
2019-08-12 14:51:47,954 epoch 74 - iter 2385/2650 - loss 0.47495727 throughput (samples/sec): 111.31
2019-08-12 14:53:03,818 ----------------------------------------------------------------------------------------------------
2019-08-12 14:53:03,818 EPOCH 74 done: loss 0.4781 - lr 0.1000
2019-08-12 14:53:03,818 BAD EPOCHS (no improvement): 0
2019-08-12 14:53:03,818 ----------------------------------------------------------------------------------------------------
2019-08-12 14:53:04,160 epoch 75 - iter 0/2650 - loss 0.91873598 throughput (samples/sec): 25067.94
2019-08-12 14:54:21,662 epoch 75 - iter 265/2650 - loss 0.46679306 throughput (samples/sec): 109.47
2019-08-12 14:55:38,508 epoch 75 - iter 530/2650 - loss 0.46160810 throughput (samples/sec): 110.41
2019-08-12 14:56:55,232 epoch 75 - iter 795/2650 - loss 0.46809354 throughput (samples/sec): 110.58
2019-08-12 14:58:13,376 epoch 75 - iter 1060/2650 - loss 0.46732711 throughput (samples/sec): 108.57
2019-08-12 14:59:29,841 epoch 75 - iter 1325/2650 - loss 0.46813764 throughput (samples/sec): 110.96
2019-08-12 15:00:47,378 epoch 75 - iter 1590/2650 - loss 0.46797509 throughput (samples/sec): 109.42
2019-08-12 15:02:04,229 epoch 75 - iter 1855/2650 - loss 0.46956116 throughput (samples/sec): 110.40
2019-08-12 15:03:21,893 epoch 75 - iter 2120/2650 - loss 0.47167304 throughput (samples/sec): 109.24
2019-08-12 15:04:38,202 epoch 75 - iter 2385/2650 - loss 0.46978638 throughput (samples/sec): 111.18
2019-08-12 15:05:56,775 ----------------------------------------------------------------------------------------------------
2019-08-12 15:05:56,775 EPOCH 75 done: loss 0.4720 - lr 0.1000
2019-08-12 15:05:56,775 BAD EPOCHS (no improvement): 0
2019-08-12 15:05:56,775 ----------------------------------------------------------------------------------------------------
2019-08-12 15:05:57,168 epoch 76 - iter 0/2650 - loss 0.23488498 throughput (samples/sec): 21805.18
2019-08-12 15:07:13,836 epoch 76 - iter 265/2650 - loss 0.49329102 throughput (samples/sec): 110.66
2019-08-12 15:08:29,480 epoch 76 - iter 530/2650 - loss 0.48118248 throughput (samples/sec): 112.16
2019-08-12 15:09:46,985 epoch 76 - iter 795/2650 - loss 0.48091855 throughput (samples/sec): 109.46
2019-08-12 15:11:01,780 epoch 76 - iter 1060/2650 - loss 0.47405063 throughput (samples/sec): 113.43
2019-08-12 15:12:21,290 epoch 76 - iter 1325/2650 - loss 0.47225290 throughput (samples/sec): 106.70
2019-08-12 15:13:41,348 epoch 76 - iter 1590/2650 - loss 0.47660753 throughput (samples/sec): 105.97
2019-08-12 15:14:58,128 epoch 76 - iter 1855/2650 - loss 0.47905504 throughput (samples/sec): 110.50
2019-08-12 15:16:16,050 epoch 76 - iter 2120/2650 - loss 0.47309960 throughput (samples/sec): 108.88
2019-08-12 15:17:33,457 epoch 76 - iter 2385/2650 - loss 0.47454776 throughput (samples/sec): 109.61
2019-08-12 15:18:49,816 ----------------------------------------------------------------------------------------------------
2019-08-12 15:18:49,817 EPOCH 76 done: loss 0.4758 - lr 0.1000
2019-08-12 15:18:49,817 BAD EPOCHS (no improvement): 1
2019-08-12 15:18:49,817 ----------------------------------------------------------------------------------------------------
2019-08-12 15:18:50,104 epoch 77 - iter 0/2650 - loss 0.36864221 throughput (samples/sec): 29903.95
2019-08-12 15:20:05,511 epoch 77 - iter 265/2650 - loss 0.45674052 throughput (samples/sec): 112.51
2019-08-12 15:21:22,543 epoch 77 - iter 530/2650 - loss 0.47618733 throughput (samples/sec): 110.14
2019-08-12 15:22:42,103 epoch 77 - iter 795/2650 - loss 0.47734985 throughput (samples/sec): 106.64
2019-08-12 15:23:57,687 epoch 77 - iter 1060/2650 - loss 0.47488862 throughput (samples/sec): 112.25
2019-08-12 15:25:14,265 epoch 77 - iter 1325/2650 - loss 0.46914282 throughput (samples/sec): 110.79
2019-08-12 15:26:32,708 epoch 77 - iter 1590/2650 - loss 0.46822922 throughput (samples/sec): 108.15
2019-08-12 15:27:49,493 epoch 77 - iter 1855/2650 - loss 0.46950743 throughput (samples/sec): 110.49
2019-08-12 15:29:04,379 epoch 77 - iter 2120/2650 - loss 0.46797688 throughput (samples/sec): 113.29
2019-08-12 15:30:25,373 epoch 77 - iter 2385/2650 - loss 0.46869610 throughput (samples/sec): 104.75
2019-08-12 15:31:41,107 ----------------------------------------------------------------------------------------------------
2019-08-12 15:31:41,107 EPOCH 77 done: loss 0.4699 - lr 0.1000
2019-08-12 15:31:41,107 BAD EPOCHS (no improvement): 0
2019-08-12 15:31:41,108 ----------------------------------------------------------------------------------------------------
2019-08-12 15:31:41,351 epoch 78 - iter 0/2650 - loss 0.46803468 throughput (samples/sec): 35392.61
2019-08-12 15:32:58,258 epoch 78 - iter 265/2650 - loss 0.44316883 throughput (samples/sec): 110.31
2019-08-12 15:34:16,603 epoch 78 - iter 530/2650 - loss 0.45789871 throughput (samples/sec): 108.29
2019-08-12 15:35:32,837 epoch 78 - iter 795/2650 - loss 0.46954513 throughput (samples/sec): 111.29
2019-08-12 15:36:54,167 epoch 78 - iter 1060/2650 - loss 0.47317064 throughput (samples/sec): 104.31
2019-08-12 15:38:08,339 epoch 78 - iter 1325/2650 - loss 0.46858003 throughput (samples/sec): 114.38
2019-08-12 15:39:25,912 epoch 78 - iter 1590/2650 - loss 0.47030883 throughput (samples/sec): 109.37
2019-08-12 15:40:43,688 epoch 78 - iter 1855/2650 - loss 0.47253512 throughput (samples/sec): 109.08
2019-08-12 15:42:00,564 epoch 78 - iter 2120/2650 - loss 0.47468405 throughput (samples/sec): 110.36
2019-08-12 15:43:16,273 epoch 78 - iter 2385/2650 - loss 0.47443569 throughput (samples/sec): 112.06
2019-08-12 15:44:32,956 ----------------------------------------------------------------------------------------------------
2019-08-12 15:44:32,956 EPOCH 78 done: loss 0.4722 - lr 0.1000
2019-08-12 15:44:32,956 BAD EPOCHS (no improvement): 1
2019-08-12 15:44:32,956 ----------------------------------------------------------------------------------------------------
2019-08-12 15:44:33,240 epoch 79 - iter 0/2650 - loss 0.64723849 throughput (samples/sec): 30299.57
2019-08-12 15:45:48,402 epoch 79 - iter 265/2650 - loss 0.46823227 throughput (samples/sec): 112.88
2019-08-12 15:47:06,875 epoch 79 - iter 530/2650 - loss 0.45989242 throughput (samples/sec): 108.11
2019-08-12 15:48:23,840 epoch 79 - iter 795/2650 - loss 0.45548548 throughput (samples/sec): 110.23
2019-08-12 15:49:41,745 epoch 79 - iter 1060/2650 - loss 0.46458733 throughput (samples/sec): 108.90
2019-08-12 15:50:55,613 epoch 79 - iter 1325/2650 - loss 0.46669685 throughput (samples/sec): 114.85
2019-08-12 15:52:12,918 epoch 79 - iter 1590/2650 - loss 0.46885274 throughput (samples/sec): 109.75
2019-08-12 15:53:29,735 epoch 79 - iter 1855/2650 - loss 0.46602976 throughput (samples/sec): 110.44
2019-08-12 15:54:44,956 epoch 79 - iter 2120/2650 - loss 0.46574423 throughput (samples/sec): 112.79
2019-08-12 15:56:03,717 epoch 79 - iter 2385/2650 - loss 0.46938465 throughput (samples/sec): 107.72
2019-08-12 15:57:20,688 ----------------------------------------------------------------------------------------------------
2019-08-12 15:57:20,688 EPOCH 79 done: loss 0.4702 - lr 0.1000
2019-08-12 15:57:20,688 BAD EPOCHS (no improvement): 2
2019-08-12 15:57:20,688 ----------------------------------------------------------------------------------------------------
2019-08-12 15:57:20,940 epoch 80 - iter 0/2650 - loss 0.32951510 throughput (samples/sec): 34165.15
2019-08-12 15:58:38,844 epoch 80 - iter 265/2650 - loss 0.43460415 throughput (samples/sec): 108.91
2019-08-12 15:59:57,143 epoch 80 - iter 530/2650 - loss 0.45261006 throughput (samples/sec): 108.36
2019-08-12 16:01:12,859 epoch 80 - iter 795/2650 - loss 0.46533096 throughput (samples/sec): 112.06
2019-08-12 16:02:33,419 epoch 80 - iter 1060/2650 - loss 0.46732557 throughput (samples/sec): 105.31
2019-08-12 16:03:51,457 epoch 80 - iter 1325/2650 - loss 0.46633641 throughput (samples/sec): 108.72
2019-08-12 16:05:08,955 epoch 80 - iter 1590/2650 - loss 0.46745441 throughput (samples/sec): 109.48
2019-08-12 16:06:29,150 epoch 80 - iter 1855/2650 - loss 0.46933473 throughput (samples/sec): 105.79
2019-08-12 16:07:46,558 epoch 80 - iter 2120/2650 - loss 0.47215207 throughput (samples/sec): 109.60
2019-08-12 16:09:00,554 epoch 80 - iter 2385/2650 - loss 0.47053044 throughput (samples/sec): 114.66
2019-08-12 16:10:14,594 ----------------------------------------------------------------------------------------------------
2019-08-12 16:10:14,595 EPOCH 80 done: loss 0.4699 - lr 0.1000
2019-08-12 16:10:14,595 BAD EPOCHS (no improvement): 0
2019-08-12 16:10:14,595 ----------------------------------------------------------------------------------------------------
2019-08-12 16:10:14,865 epoch 81 - iter 0/2650 - loss 0.32536948 throughput (samples/sec): 31765.04
2019-08-12 16:11:32,050 epoch 81 - iter 265/2650 - loss 0.45046669 throughput (samples/sec): 109.92
2019-08-12 16:12:49,503 epoch 81 - iter 530/2650 - loss 0.45931511 throughput (samples/sec): 109.54
2019-08-12 16:14:06,821 epoch 81 - iter 795/2650 - loss 0.47313117 throughput (samples/sec): 109.73
2019-08-12 16:15:25,962 epoch 81 - iter 1060/2650 - loss 0.46349138 throughput (samples/sec): 107.20
2019-08-12 16:16:44,178 epoch 81 - iter 1325/2650 - loss 0.46570083 throughput (samples/sec): 108.47
2019-08-12 16:17:59,604 epoch 81 - iter 1590/2650 - loss 0.46134800 throughput (samples/sec): 112.49
2019-08-12 16:19:16,534 epoch 81 - iter 1855/2650 - loss 0.46429630 throughput (samples/sec): 110.28
2019-08-12 16:20:31,051 epoch 81 - iter 2120/2650 - loss 0.46512154 throughput (samples/sec): 113.85
2019-08-12 16:21:49,093 epoch 81 - iter 2385/2650 - loss 0.46794711 throughput (samples/sec): 108.71
2019-08-12 16:23:07,036 ----------------------------------------------------------------------------------------------------
2019-08-12 16:23:07,037 EPOCH 81 done: loss 0.4692 - lr 0.1000
2019-08-12 16:23:07,037 BAD EPOCHS (no improvement): 0
2019-08-12 16:23:07,037 ----------------------------------------------------------------------------------------------------
2019-08-12 16:23:07,436 epoch 82 - iter 0/2650 - loss 0.54250562 throughput (samples/sec): 21426.09
2019-08-12 16:24:24,915 epoch 82 - iter 265/2650 - loss 0.46487518 throughput (samples/sec): 109.50
2019-08-12 16:25:42,567 epoch 82 - iter 530/2650 - loss 0.47447867 throughput (samples/sec): 109.26
2019-08-12 16:27:00,926 epoch 82 - iter 795/2650 - loss 0.46413182 throughput (samples/sec): 108.27
2019-08-12 16:28:16,061 epoch 82 - iter 1060/2650 - loss 0.46441975 throughput (samples/sec): 112.92
2019-08-12 16:29:32,897 epoch 82 - iter 1325/2650 - loss 0.46255648 throughput (samples/sec): 110.42
2019-08-12 16:30:46,747 epoch 82 - iter 1590/2650 - loss 0.46508238 throughput (samples/sec): 114.88
2019-08-12 16:32:04,567 epoch 82 - iter 1855/2650 - loss 0.46370942 throughput (samples/sec): 109.02
2019-08-12 16:33:20,120 epoch 82 - iter 2120/2650 - loss 0.46326583 throughput (samples/sec): 112.29
2019-08-12 16:34:38,343 epoch 82 - iter 2385/2650 - loss 0.46807083 throughput (samples/sec): 108.46
2019-08-12 16:35:56,355 ----------------------------------------------------------------------------------------------------
2019-08-12 16:35:56,355 EPOCH 82 done: loss 0.4684 - lr 0.1000
2019-08-12 16:35:56,355 BAD EPOCHS (no improvement): 0
2019-08-12 16:35:56,355 ----------------------------------------------------------------------------------------------------
2019-08-12 16:35:56,659 epoch 83 - iter 0/2650 - loss 0.60576677 throughput (samples/sec): 28219.60
2019-08-12 16:37:14,799 epoch 83 - iter 265/2650 - loss 0.43328053 throughput (samples/sec): 108.57
2019-08-12 16:38:34,290 epoch 83 - iter 530/2650 - loss 0.45963597 throughput (samples/sec): 106.73
2019-08-12 16:39:50,505 epoch 83 - iter 795/2650 - loss 0.45078792 throughput (samples/sec): 111.32
2019-08-12 16:41:06,429 epoch 83 - iter 1060/2650 - loss 0.45272367 throughput (samples/sec): 111.74
2019-08-12 16:42:21,644 epoch 83 - iter 1325/2650 - loss 0.45635124 throughput (samples/sec): 112.80
2019-08-12 16:43:36,565 epoch 83 - iter 1590/2650 - loss 0.45285411 throughput (samples/sec): 113.24
2019-08-12 16:44:53,646 epoch 83 - iter 1855/2650 - loss 0.45184520 throughput (samples/sec): 110.07
2019-08-12 16:46:10,493 epoch 83 - iter 2120/2650 - loss 0.45400676 throughput (samples/sec): 110.40
2019-08-12 16:47:27,819 epoch 83 - iter 2385/2650 - loss 0.45616392 throughput (samples/sec): 109.72
2019-08-12 16:48:45,691 ----------------------------------------------------------------------------------------------------
2019-08-12 16:48:45,691 EPOCH 83 done: loss 0.4597 - lr 0.1000
2019-08-12 16:48:45,691 BAD EPOCHS (no improvement): 0
2019-08-12 16:48:45,692 ----------------------------------------------------------------------------------------------------
2019-08-12 16:48:46,041 epoch 84 - iter 0/2650 - loss 0.51777959 throughput (samples/sec): 24522.55
2019-08-12 16:50:02,188 epoch 84 - iter 265/2650 - loss 0.44993128 throughput (samples/sec): 111.42
2019-08-12 16:51:18,722 epoch 84 - iter 530/2650 - loss 0.45376490 throughput (samples/sec): 110.85
2019-08-12 16:52:35,495 epoch 84 - iter 795/2650 - loss 0.45284096 throughput (samples/sec): 110.51
2019-08-12 16:53:54,426 epoch 84 - iter 1060/2650 - loss 0.45800684 throughput (samples/sec): 107.49
2019-08-12 16:55:12,406 epoch 84 - iter 1325/2650 - loss 0.45259156 throughput (samples/sec): 108.80
2019-08-12 16:56:29,052 epoch 84 - iter 1590/2650 - loss 0.45574582 throughput (samples/sec): 110.69
2019-08-12 16:57:46,969 epoch 84 - iter 1855/2650 - loss 0.45525983 throughput (samples/sec): 108.89
2019-08-12 16:59:04,008 epoch 84 - iter 2120/2650 - loss 0.45853050 throughput (samples/sec): 110.13
2019-08-12 17:00:20,952 epoch 84 - iter 2385/2650 - loss 0.46056114 throughput (samples/sec): 110.26
2019-08-12 17:01:35,171 ----------------------------------------------------------------------------------------------------
2019-08-12 17:01:35,171 EPOCH 84 done: loss 0.4622 - lr 0.1000
2019-08-12 17:01:35,171 BAD EPOCHS (no improvement): 1
2019-08-12 17:01:35,171 ----------------------------------------------------------------------------------------------------
2019-08-12 17:01:35,467 epoch 85 - iter 0/2650 - loss 0.18064657 throughput (samples/sec): 28977.28
2019-08-12 17:02:51,546 epoch 85 - iter 265/2650 - loss 0.46942316 throughput (samples/sec): 111.52
2019-08-12 17:04:10,552 epoch 85 - iter 530/2650 - loss 0.45463077 throughput (samples/sec): 107.39
2019-08-12 17:05:28,125 epoch 85 - iter 795/2650 - loss 0.45630995 throughput (samples/sec): 109.37
2019-08-12 17:06:44,588 epoch 85 - iter 1060/2650 - loss 0.45807083 throughput (samples/sec): 110.96
2019-08-12 17:08:02,735 epoch 85 - iter 1325/2650 - loss 0.45225988 throughput (samples/sec): 108.57
2019-08-12 17:09:20,470 epoch 85 - iter 1590/2650 - loss 0.45504016 throughput (samples/sec): 109.14
2019-08-12 17:10:38,256 epoch 85 - iter 1855/2650 - loss 0.45540592 throughput (samples/sec): 109.07
2019-08-12 17:11:56,342 epoch 85 - iter 2120/2650 - loss 0.45719793 throughput (samples/sec): 108.65
2019-08-12 17:13:12,452 epoch 85 - iter 2385/2650 - loss 0.45835288 throughput (samples/sec): 111.47
2019-08-12 17:14:30,848 ----------------------------------------------------------------------------------------------------
2019-08-12 17:14:30,848 EPOCH 85 done: loss 0.4606 - lr 0.1000
2019-08-12 17:14:30,848 BAD EPOCHS (no improvement): 2
2019-08-12 17:14:30,849 ----------------------------------------------------------------------------------------------------
2019-08-12 17:14:31,140 epoch 86 - iter 0/2650 - loss 0.29423270 throughput (samples/sec): 29429.57
2019-08-12 17:15:50,800 epoch 86 - iter 265/2650 - loss 0.44670858 throughput (samples/sec): 106.50
2019-08-12 17:17:07,736 epoch 86 - iter 530/2650 - loss 0.45524367 throughput (samples/sec): 110.28
2019-08-12 17:18:28,744 epoch 86 - iter 795/2650 - loss 0.45178078 throughput (samples/sec): 104.73
2019-08-12 17:19:45,425 epoch 86 - iter 1060/2650 - loss 0.45664704 throughput (samples/sec): 110.64
2019-08-12 17:21:01,832 epoch 86 - iter 1325/2650 - loss 0.45493237 throughput (samples/sec): 111.04
2019-08-12 17:22:19,272 epoch 86 - iter 1590/2650 - loss 0.45575299 throughput (samples/sec): 109.56
2019-08-12 17:23:36,294 epoch 86 - iter 1855/2650 - loss 0.45404100 throughput (samples/sec): 110.15
2019-08-12 17:24:52,061 epoch 86 - iter 2120/2650 - loss 0.45203189 throughput (samples/sec): 111.98
2019-08-12 17:26:10,143 epoch 86 - iter 2385/2650 - loss 0.45380672 throughput (samples/sec): 108.66
2019-08-12 17:27:26,775 ----------------------------------------------------------------------------------------------------
2019-08-12 17:27:26,775 EPOCH 86 done: loss 0.4533 - lr 0.1000
2019-08-12 17:27:26,775 BAD EPOCHS (no improvement): 0
2019-08-12 17:27:26,775 ----------------------------------------------------------------------------------------------------
2019-08-12 17:27:27,056 epoch 87 - iter 0/2650 - loss 0.83886492 throughput (samples/sec): 30606.87
2019-08-12 17:28:46,333 epoch 87 - iter 265/2650 - loss 0.44734208 throughput (samples/sec): 107.02
2019-08-12 17:30:02,724 epoch 87 - iter 530/2650 - loss 0.44454778 throughput (samples/sec): 111.06
2019-08-12 17:31:19,058 epoch 87 - iter 795/2650 - loss 0.44368650 throughput (samples/sec): 111.15
2019-08-12 17:32:35,397 epoch 87 - iter 1060/2650 - loss 0.44675180 throughput (samples/sec): 111.14
2019-08-12 17:33:50,894 epoch 87 - iter 1325/2650 - loss 0.44504642 throughput (samples/sec): 112.38
2019-08-12 17:35:10,097 epoch 87 - iter 1590/2650 - loss 0.45046150 throughput (samples/sec): 107.12
2019-08-12 17:36:29,033 epoch 87 - iter 1855/2650 - loss 0.45372353 throughput (samples/sec): 107.48
2019-08-12 17:37:46,916 epoch 87 - iter 2120/2650 - loss 0.45399977 throughput (samples/sec): 108.94
2019-08-12 17:39:07,003 epoch 87 - iter 2385/2650 - loss 0.45483683 throughput (samples/sec): 105.94
2019-08-12 17:40:23,870 ----------------------------------------------------------------------------------------------------
2019-08-12 17:40:23,870 EPOCH 87 done: loss 0.4553 - lr 0.1000
2019-08-12 17:40:23,870 BAD EPOCHS (no improvement): 1
2019-08-12 17:40:23,870 ----------------------------------------------------------------------------------------------------
2019-08-12 17:40:24,151 epoch 88 - iter 0/2650 - loss 0.57677639 throughput (samples/sec): 30574.41
2019-08-12 17:41:41,960 epoch 88 - iter 265/2650 - loss 0.43960605 throughput (samples/sec): 109.04
2019-08-12 17:43:01,015 epoch 88 - iter 530/2650 - loss 0.44103538 throughput (samples/sec): 107.32
2019-08-12 17:44:18,328 epoch 88 - iter 795/2650 - loss 0.44124453 throughput (samples/sec): 109.74
2019-08-12 17:45:34,755 epoch 88 - iter 1060/2650 - loss 0.44636435 throughput (samples/sec): 111.01
2019-08-12 17:46:54,357 epoch 88 - iter 1325/2650 - loss 0.44669070 throughput (samples/sec): 106.58
2019-08-12 17:48:13,643 epoch 88 - iter 1590/2650 - loss 0.45428978 throughput (samples/sec): 107.00
2019-08-12 17:49:32,543 epoch 88 - iter 1855/2650 - loss 0.45746173 throughput (samples/sec): 107.53
2019-08-12 17:50:49,900 epoch 88 - iter 2120/2650 - loss 0.45737959 throughput (samples/sec): 109.67
2019-08-12 17:52:08,380 epoch 88 - iter 2385/2650 - loss 0.45749714 throughput (samples/sec): 108.10
2019-08-12 17:53:27,824 ----------------------------------------------------------------------------------------------------
2019-08-12 17:53:27,825 EPOCH 88 done: loss 0.4596 - lr 0.1000
2019-08-12 17:53:27,825 BAD EPOCHS (no improvement): 2
2019-08-12 17:53:27,825 ----------------------------------------------------------------------------------------------------
2019-08-12 17:53:28,105 epoch 89 - iter 0/2650 - loss 0.67039323 throughput (samples/sec): 30645.93
2019-08-12 17:54:44,162 epoch 89 - iter 265/2650 - loss 0.43878107 throughput (samples/sec): 111.55
2019-08-12 17:56:00,114 epoch 89 - iter 530/2650 - loss 0.44482193 throughput (samples/sec): 111.70
2019-08-12 17:57:17,612 epoch 89 - iter 795/2650 - loss 0.44817289 throughput (samples/sec): 109.47
2019-08-12 17:58:33,260 epoch 89 - iter 1060/2650 - loss 0.45838465 throughput (samples/sec): 112.15
2019-08-12 17:59:49,640 epoch 89 - iter 1325/2650 - loss 0.45558141 throughput (samples/sec): 111.08
2019-08-12 18:01:06,804 epoch 89 - iter 1590/2650 - loss 0.45591410 throughput (samples/sec): 109.95
2019-08-12 18:02:23,609 epoch 89 - iter 1855/2650 - loss 0.45367706 throughput (samples/sec): 110.46
2019-08-12 18:03:39,628 epoch 89 - iter 2120/2650 - loss 0.45046526 throughput (samples/sec): 111.60
2019-08-12 18:04:56,685 epoch 89 - iter 2385/2650 - loss 0.45284543 throughput (samples/sec): 110.10
2019-08-12 18:06:15,757 ----------------------------------------------------------------------------------------------------
2019-08-12 18:06:15,757 EPOCH 89 done: loss 0.4531 - lr 0.1000
2019-08-12 18:06:15,757 BAD EPOCHS (no improvement): 0
2019-08-12 18:06:15,757 ----------------------------------------------------------------------------------------------------
2019-08-12 18:06:16,202 epoch 90 - iter 0/2650 - loss 0.35617733 throughput (samples/sec): 19213.29
2019-08-12 18:07:33,257 epoch 90 - iter 265/2650 - loss 0.41809181 throughput (samples/sec): 110.10
2019-08-12 18:08:50,693 epoch 90 - iter 530/2650 - loss 0.43988087 throughput (samples/sec): 109.56
2019-08-12 18:10:08,076 epoch 90 - iter 795/2650 - loss 0.44998513 throughput (samples/sec): 109.64
2019-08-12 18:11:25,110 epoch 90 - iter 1060/2650 - loss 0.45054675 throughput (samples/sec): 110.14
2019-08-12 18:12:44,081 epoch 90 - iter 1325/2650 - loss 0.45087253 throughput (samples/sec): 107.43
2019-08-12 18:14:01,779 epoch 90 - iter 1590/2650 - loss 0.45088619 throughput (samples/sec): 109.19
2019-08-12 18:15:19,143 epoch 90 - iter 1855/2650 - loss 0.45324295 throughput (samples/sec): 109.67
2019-08-12 18:16:36,305 epoch 90 - iter 2120/2650 - loss 0.45509506 throughput (samples/sec): 109.95
2019-08-12 18:17:53,527 epoch 90 - iter 2385/2650 - loss 0.45612633 throughput (samples/sec): 109.87
2019-08-12 18:19:11,539 ----------------------------------------------------------------------------------------------------
2019-08-12 18:19:11,539 EPOCH 90 done: loss 0.4585 - lr 0.1000
2019-08-12 18:19:11,539 BAD EPOCHS (no improvement): 1
2019-08-12 18:19:11,539 ----------------------------------------------------------------------------------------------------
2019-08-12 18:19:11,817 epoch 91 - iter 0/2650 - loss 0.25970328 throughput (samples/sec): 30869.16
2019-08-12 18:20:30,735 epoch 91 - iter 265/2650 - loss 0.49393473 throughput (samples/sec): 107.51
2019-08-12 18:21:48,316 epoch 91 - iter 530/2650 - loss 0.47241631 throughput (samples/sec): 109.36
2019-08-12 18:23:05,615 epoch 91 - iter 795/2650 - loss 0.46801873 throughput (samples/sec): 109.76
2019-08-12 18:24:23,223 epoch 91 - iter 1060/2650 - loss 0.46593705 throughput (samples/sec): 109.32
2019-08-12 18:25:40,421 epoch 91 - iter 1325/2650 - loss 0.46197166 throughput (samples/sec): 109.90
2019-08-12 18:26:58,607 epoch 91 - iter 1590/2650 - loss 0.45947118 throughput (samples/sec): 108.51
2019-08-12 18:28:16,022 epoch 91 - iter 1855/2650 - loss 0.45476609 throughput (samples/sec): 109.59
2019-08-12 18:29:32,598 epoch 91 - iter 2120/2650 - loss 0.46032965 throughput (samples/sec): 110.80
2019-08-12 18:30:51,111 epoch 91 - iter 2385/2650 - loss 0.46131060 throughput (samples/sec): 108.06
2019-08-12 18:32:06,375 ----------------------------------------------------------------------------------------------------
2019-08-12 18:32:06,375 EPOCH 91 done: loss 0.4605 - lr 0.1000
2019-08-12 18:32:06,375 BAD EPOCHS (no improvement): 2
2019-08-12 18:32:06,375 ----------------------------------------------------------------------------------------------------
2019-08-12 18:32:06,652 epoch 92 - iter 0/2650 - loss 0.34790558 throughput (samples/sec): 31003.11
2019-08-12 18:33:24,481 epoch 92 - iter 265/2650 - loss 0.44154354 throughput (samples/sec): 109.01
2019-08-12 18:34:42,614 epoch 92 - iter 530/2650 - loss 0.46598968 throughput (samples/sec): 108.59
2019-08-12 18:36:00,963 epoch 92 - iter 795/2650 - loss 0.46876466 throughput (samples/sec): 108.29
2019-08-12 18:37:19,091 epoch 92 - iter 1060/2650 - loss 0.46093133 throughput (samples/sec): 108.59
2019-08-12 18:38:39,526 epoch 92 - iter 1325/2650 - loss 0.46072419 throughput (samples/sec): 105.47
2019-08-12 18:39:56,573 epoch 92 - iter 1590/2650 - loss 0.45603983 throughput (samples/sec): 110.11
2019-08-12 18:41:15,196 epoch 92 - iter 1855/2650 - loss 0.45678717 throughput (samples/sec): 107.91
2019-08-12 18:42:34,503 epoch 92 - iter 2120/2650 - loss 0.45819307 throughput (samples/sec): 106.98
2019-08-12 18:43:52,473 epoch 92 - iter 2385/2650 - loss 0.45739987 throughput (samples/sec): 108.81
2019-08-12 18:45:08,748 ----------------------------------------------------------------------------------------------------
2019-08-12 18:45:08,748 EPOCH 92 done: loss 0.4555 - lr 0.1000
2019-08-12 18:45:08,748 BAD EPOCHS (no improvement): 3
2019-08-12 18:45:08,749 ----------------------------------------------------------------------------------------------------
2019-08-12 18:45:08,963 epoch 93 - iter 0/2650 - loss 0.10170478 throughput (samples/sec): 40212.98
2019-08-12 18:46:25,175 epoch 93 - iter 265/2650 - loss 0.46314124 throughput (samples/sec): 111.32
2019-08-12 18:47:42,541 epoch 93 - iter 530/2650 - loss 0.43131563 throughput (samples/sec): 109.66
2019-08-12 18:48:59,005 epoch 93 - iter 795/2650 - loss 0.42993432 throughput (samples/sec): 110.96
2019-08-12 18:50:14,598 epoch 93 - iter 1060/2650 - loss 0.43236707 throughput (samples/sec): 112.24
2019-08-12 18:51:34,389 epoch 93 - iter 1325/2650 - loss 0.43882797 throughput (samples/sec): 106.33
2019-08-12 18:52:53,407 epoch 93 - iter 1590/2650 - loss 0.44087689 throughput (samples/sec): 107.37
2019-08-12 18:54:10,903 epoch 93 - iter 1855/2650 - loss 0.44536949 throughput (samples/sec): 109.48
2019-08-12 18:55:30,571 epoch 93 - iter 2120/2650 - loss 0.44635474 throughput (samples/sec): 106.49
2019-08-12 18:56:48,142 epoch 93 - iter 2385/2650 - loss 0.44709220 throughput (samples/sec): 109.37
2019-08-12 18:58:04,506 ----------------------------------------------------------------------------------------------------
2019-08-12 18:58:04,506 EPOCH 93 done: loss 0.4489 - lr 0.1000
2019-08-12 18:58:04,506 BAD EPOCHS (no improvement): 0
2019-08-12 18:58:04,506 ----------------------------------------------------------------------------------------------------
2019-08-12 18:58:04,815 epoch 94 - iter 0/2650 - loss 0.63108671 throughput (samples/sec): 27780.25
2019-08-12 18:59:21,285 epoch 94 - iter 265/2650 - loss 0.41797796 throughput (samples/sec): 110.94
2019-08-12 19:00:39,702 epoch 94 - iter 530/2650 - loss 0.42443041 throughput (samples/sec): 108.19
2019-08-12 19:01:57,707 epoch 94 - iter 795/2650 - loss 0.43204393 throughput (samples/sec): 108.77
2019-08-12 19:03:15,838 epoch 94 - iter 1060/2650 - loss 0.44549446 throughput (samples/sec): 108.59
2019-08-12 19:04:33,846 epoch 94 - iter 1325/2650 - loss 0.44945035 throughput (samples/sec): 108.76
2019-08-12 19:05:52,399 epoch 94 - iter 1590/2650 - loss 0.44949669 throughput (samples/sec): 108.00
2019-08-12 19:07:11,761 epoch 94 - iter 1855/2650 - loss 0.44867811 throughput (samples/sec): 106.90
2019-08-12 19:08:28,327 epoch 94 - iter 2120/2650 - loss 0.45067856 throughput (samples/sec): 110.81
2019-08-12 19:09:44,984 epoch 94 - iter 2385/2650 - loss 0.45150156 throughput (samples/sec): 110.67
2019-08-12 19:10:59,813 ----------------------------------------------------------------------------------------------------
2019-08-12 19:10:59,813 EPOCH 94 done: loss 0.4512 - lr 0.1000
2019-08-12 19:10:59,813 BAD EPOCHS (no improvement): 1
2019-08-12 19:10:59,813 ----------------------------------------------------------------------------------------------------
2019-08-12 19:11:00,046 epoch 95 - iter 0/2650 - loss 0.39086977 throughput (samples/sec): 36992.54
2019-08-12 19:12:18,414 epoch 95 - iter 265/2650 - loss 0.43668618 throughput (samples/sec): 108.26
2019-08-12 19:13:36,570 epoch 95 - iter 530/2650 - loss 0.43490575 throughput (samples/sec): 108.55
2019-08-12 19:14:53,793 epoch 95 - iter 795/2650 - loss 0.43641989 throughput (samples/sec): 109.86
2019-08-12 19:16:10,650 epoch 95 - iter 1060/2650 - loss 0.44022956 throughput (samples/sec): 110.39
2019-08-12 19:17:27,662 epoch 95 - iter 1325/2650 - loss 0.44110763 throughput (samples/sec): 110.16
2019-08-12 19:18:42,559 epoch 95 - iter 1590/2650 - loss 0.44522810 throughput (samples/sec): 113.28
2019-08-12 19:19:54,655 epoch 95 - iter 1855/2650 - loss 0.44432022 throughput (samples/sec): 117.68
2019-08-12 19:21:13,537 epoch 95 - iter 2120/2650 - loss 0.44642805 throughput (samples/sec): 107.55
2019-08-12 19:22:29,832 epoch 95 - iter 2385/2650 - loss 0.44827503 throughput (samples/sec): 111.20
2019-08-12 19:23:45,792 ----------------------------------------------------------------------------------------------------
2019-08-12 19:23:45,793 EPOCH 95 done: loss 0.4489 - lr 0.1000
2019-08-12 19:23:45,793 BAD EPOCHS (no improvement): 2
2019-08-12 19:23:45,793 ----------------------------------------------------------------------------------------------------
2019-08-12 19:23:46,024 epoch 96 - iter 0/2650 - loss 0.36908245 throughput (samples/sec): 37297.13
2019-08-12 19:25:04,828 epoch 96 - iter 265/2650 - loss 0.42983311 throughput (samples/sec): 107.66
2019-08-12 19:26:21,402 epoch 96 - iter 530/2650 - loss 0.43127249 throughput (samples/sec): 110.80
2019-08-12 19:27:38,260 epoch 96 - iter 795/2650 - loss 0.43494937 throughput (samples/sec): 110.39
2019-08-12 19:28:55,123 epoch 96 - iter 1060/2650 - loss 0.43767415 throughput (samples/sec): 110.38
2019-08-12 19:30:12,858 epoch 96 - iter 1325/2650 - loss 0.43488932 throughput (samples/sec): 109.14
2019-08-12 19:31:31,697 epoch 96 - iter 1590/2650 - loss 0.43984567 throughput (samples/sec): 107.61
2019-08-12 19:32:48,121 epoch 96 - iter 1855/2650 - loss 0.44089419 throughput (samples/sec): 111.01
2019-08-12 19:34:04,277 epoch 96 - iter 2120/2650 - loss 0.43845865 throughput (samples/sec): 111.40
2019-08-12 19:35:19,083 epoch 96 - iter 2385/2650 - loss 0.43874295 throughput (samples/sec): 113.42
2019-08-12 19:36:36,044 ----------------------------------------------------------------------------------------------------
2019-08-12 19:36:36,044 EPOCH 96 done: loss 0.4428 - lr 0.1000
2019-08-12 19:36:36,044 BAD EPOCHS (no improvement): 0
2019-08-12 19:36:36,044 ----------------------------------------------------------------------------------------------------
2019-08-12 19:36:36,253 epoch 97 - iter 0/2650 - loss 0.42645025 throughput (samples/sec): 41330.44
2019-08-12 19:37:54,947 epoch 97 - iter 265/2650 - loss 0.44767416 throughput (samples/sec): 107.81
2019-08-12 19:39:11,152 epoch 97 - iter 530/2650 - loss 0.44452761 throughput (samples/sec): 111.33
2019-08-12 19:40:29,882 epoch 97 - iter 795/2650 - loss 0.44868415 throughput (samples/sec): 107.76
2019-08-12 19:41:46,592 epoch 97 - iter 1060/2650 - loss 0.44041988 throughput (samples/sec): 110.60
2019-08-12 19:43:01,688 epoch 97 - iter 1325/2650 - loss 0.44052243 throughput (samples/sec): 112.98
2019-08-12 19:44:18,372 epoch 97 - iter 1590/2650 - loss 0.43828334 throughput (samples/sec): 110.63
2019-08-12 19:45:35,721 epoch 97 - iter 1855/2650 - loss 0.43885003 throughput (samples/sec): 109.68
2019-08-12 19:46:50,930 epoch 97 - iter 2120/2650 - loss 0.44046519 throughput (samples/sec): 112.81
2019-08-12 19:48:06,851 epoch 97 - iter 2385/2650 - loss 0.44299551 throughput (samples/sec): 111.75
2019-08-12 19:49:23,097 ----------------------------------------------------------------------------------------------------
2019-08-12 19:49:23,097 EPOCH 97 done: loss 0.4453 - lr 0.1000
2019-08-12 19:49:23,097 BAD EPOCHS (no improvement): 1
2019-08-12 19:49:23,097 ----------------------------------------------------------------------------------------------------
2019-08-12 19:49:23,330 epoch 98 - iter 0/2650 - loss 0.26766720 throughput (samples/sec): 36935.19
2019-08-12 19:50:40,627 epoch 98 - iter 265/2650 - loss 0.43527113 throughput (samples/sec): 109.76
2019-08-12 19:51:57,002 epoch 98 - iter 530/2650 - loss 0.43833820 throughput (samples/sec): 111.08
2019-08-12 19:53:13,824 epoch 98 - iter 795/2650 - loss 0.43503402 throughput (samples/sec): 110.44
2019-08-12 19:54:32,638 epoch 98 - iter 1060/2650 - loss 0.44477068 throughput (samples/sec): 107.64
2019-08-12 19:55:50,194 epoch 98 - iter 1325/2650 - loss 0.44964333 throughput (samples/sec): 109.39
2019-08-12 19:57:08,508 epoch 98 - iter 1590/2650 - loss 0.44963046 throughput (samples/sec): 108.33
2019-08-12 19:58:24,531 epoch 98 - iter 1855/2650 - loss 0.44703298 throughput (samples/sec): 111.60
2019-08-12 19:59:39,516 epoch 98 - iter 2120/2650 - loss 0.44585884 throughput (samples/sec): 113.14
2019-08-12 20:00:55,893 epoch 98 - iter 2385/2650 - loss 0.44573804 throughput (samples/sec): 111.08
2019-08-12 20:02:12,415 ----------------------------------------------------------------------------------------------------
2019-08-12 20:02:12,416 EPOCH 98 done: loss 0.4453 - lr 0.1000
2019-08-12 20:02:12,416 BAD EPOCHS (no improvement): 2
2019-08-12 20:02:12,416 ----------------------------------------------------------------------------------------------------
2019-08-12 20:02:12,755 epoch 99 - iter 0/2650 - loss 0.30889976 throughput (samples/sec): 25288.54
2019-08-12 20:03:32,019 epoch 99 - iter 265/2650 - loss 0.41979911 throughput (samples/sec): 107.03
2019-08-12 20:04:48,993 epoch 99 - iter 530/2650 - loss 0.42365698 throughput (samples/sec): 110.22
2019-08-12 20:06:04,497 epoch 99 - iter 795/2650 - loss 0.43266714 throughput (samples/sec): 112.37
2019-08-12 20:07:20,087 epoch 99 - iter 1060/2650 - loss 0.43689977 throughput (samples/sec): 112.24
2019-08-12 20:08:37,409 epoch 99 - iter 1325/2650 - loss 0.44270738 throughput (samples/sec): 109.72
2019-08-12 20:09:53,171 epoch 99 - iter 1590/2650 - loss 0.44145682 throughput (samples/sec): 111.98
2019-08-12 20:11:09,084 epoch 99 - iter 1855/2650 - loss 0.44357467 throughput (samples/sec): 111.76
2019-08-12 20:12:25,667 epoch 99 - iter 2120/2650 - loss 0.44176331 throughput (samples/sec): 110.78
2019-08-12 20:13:41,226 epoch 99 - iter 2385/2650 - loss 0.44392422 throughput (samples/sec): 112.29
2019-08-12 20:14:58,431 ----------------------------------------------------------------------------------------------------
2019-08-12 20:14:58,431 EPOCH 99 done: loss 0.4465 - lr 0.1000
2019-08-12 20:14:58,431 BAD EPOCHS (no improvement): 3
2019-08-12 20:14:58,431 ----------------------------------------------------------------------------------------------------
2019-08-12 20:14:58,722 epoch 100 - iter 0/2650 - loss 0.84319854 throughput (samples/sec): 29521.71
2019-08-12 20:16:14,814 epoch 100 - iter 265/2650 - loss 0.41316634 throughput (samples/sec): 111.50
2019-08-12 20:17:32,305 epoch 100 - iter 530/2650 - loss 0.42813813 throughput (samples/sec): 109.48
2019-08-12 20:18:51,859 epoch 100 - iter 795/2650 - loss 0.43807254 throughput (samples/sec): 106.64
2019-08-12 20:20:11,475 epoch 100 - iter 1060/2650 - loss 0.43791680 throughput (samples/sec): 106.56
2019-08-12 20:21:29,708 epoch 100 - iter 1325/2650 - loss 0.44532739 throughput (samples/sec): 108.45
2019-08-12 20:22:47,977 epoch 100 - iter 1590/2650 - loss 0.44009638 throughput (samples/sec): 108.39
2019-08-12 20:24:07,248 epoch 100 - iter 1855/2650 - loss 0.44408477 throughput (samples/sec): 107.02
2019-08-12 20:25:27,444 epoch 100 - iter 2120/2650 - loss 0.44188944 throughput (samples/sec): 105.79
2019-08-12 20:26:46,871 epoch 100 - iter 2385/2650 - loss 0.44439823 throughput (samples/sec): 106.81
2019-08-12 20:28:04,967 ----------------------------------------------------------------------------------------------------
2019-08-12 20:28:04,968 EPOCH 100 done: loss 0.4460 - lr 0.1000
2019-08-12 20:28:04,968 BAD EPOCHS (no improvement): 4
2019-08-12 20:28:04,968 ----------------------------------------------------------------------------------------------------
2019-08-12 20:28:05,337 epoch 101 - iter 0/2650 - loss 0.63743496 throughput (samples/sec): 23194.45
2019-08-12 20:29:22,536 epoch 101 - iter 265/2650 - loss 0.42611070 throughput (samples/sec): 109.90
2019-08-12 20:30:39,821 epoch 101 - iter 530/2650 - loss 0.42298243 throughput (samples/sec): 109.77
2019-08-12 20:31:57,528 epoch 101 - iter 795/2650 - loss 0.41635250 throughput (samples/sec): 109.18
2019-08-12 20:33:19,473 epoch 101 - iter 1060/2650 - loss 0.41135086 throughput (samples/sec): 103.53
2019-08-12 20:34:38,699 epoch 101 - iter 1325/2650 - loss 0.41226003 throughput (samples/sec): 107.08
2019-08-12 20:35:57,378 epoch 101 - iter 1590/2650 - loss 0.41264404 throughput (samples/sec): 107.83
2019-08-12 20:37:15,901 epoch 101 - iter 1855/2650 - loss 0.41406957 throughput (samples/sec): 108.05
2019-08-12 20:38:33,333 epoch 101 - iter 2120/2650 - loss 0.41679887 throughput (samples/sec): 109.57
2019-08-12 20:39:55,296 epoch 101 - iter 2385/2650 - loss 0.41829300 throughput (samples/sec): 103.51
2019-08-12 20:41:13,123 ----------------------------------------------------------------------------------------------------
2019-08-12 20:41:13,123 EPOCH 101 done: loss 0.4189 - lr 0.0500
2019-08-12 20:41:13,123 BAD EPOCHS (no improvement): 0
2019-08-12 20:41:13,123 ----------------------------------------------------------------------------------------------------
2019-08-12 20:41:13,497 epoch 102 - iter 0/2650 - loss 0.77183872 throughput (samples/sec): 22869.48
2019-08-12 20:42:32,911 epoch 102 - iter 265/2650 - loss 0.40681841 throughput (samples/sec): 106.83
2019-08-12 20:43:50,617 epoch 102 - iter 530/2650 - loss 0.39503553 throughput (samples/sec): 109.18
2019-08-12 20:45:07,889 epoch 102 - iter 795/2650 - loss 0.37999227 throughput (samples/sec): 109.79
2019-08-12 20:46:26,639 epoch 102 - iter 1060/2650 - loss 0.39064290 throughput (samples/sec): 107.73
2019-08-12 20:47:44,057 epoch 102 - iter 1325/2650 - loss 0.39468824 throughput (samples/sec): 109.59
2019-08-12 20:49:02,749 epoch 102 - iter 1590/2650 - loss 0.39710336 throughput (samples/sec): 107.81
2019-08-12 20:50:23,167 epoch 102 - iter 1855/2650 - loss 0.39890119 throughput (samples/sec): 105.50
2019-08-12 20:51:40,964 epoch 102 - iter 2120/2650 - loss 0.39828095 throughput (samples/sec): 109.05
2019-08-12 20:53:01,566 epoch 102 - iter 2385/2650 - loss 0.39955696 throughput (samples/sec): 105.26
2019-08-12 20:54:19,797 ----------------------------------------------------------------------------------------------------
2019-08-12 20:54:19,797 EPOCH 102 done: loss 0.3985 - lr 0.0500
2019-08-12 20:54:19,797 BAD EPOCHS (no improvement): 0
2019-08-12 20:54:19,797 ----------------------------------------------------------------------------------------------------
2019-08-12 20:54:20,178 epoch 103 - iter 0/2650 - loss 0.29422939 throughput (samples/sec): 22450.61
2019-08-12 20:55:37,880 epoch 103 - iter 265/2650 - loss 0.37354760 throughput (samples/sec): 109.19
2019-08-12 20:56:53,824 epoch 103 - iter 530/2650 - loss 0.38259302 throughput (samples/sec): 111.71
2019-08-12 20:58:11,220 epoch 103 - iter 795/2650 - loss 0.37778378 throughput (samples/sec): 109.62
2019-08-12 20:59:26,629 epoch 103 - iter 1060/2650 - loss 0.38379320 throughput (samples/sec): 112.51
2019-08-12 21:00:42,568 epoch 103 - iter 1325/2650 - loss 0.38281057 throughput (samples/sec): 111.72
2019-08-12 21:01:58,740 epoch 103 - iter 1590/2650 - loss 0.38757865 throughput (samples/sec): 111.38
2019-08-12 21:03:16,463 epoch 103 - iter 1855/2650 - loss 0.38524295 throughput (samples/sec): 109.16
2019-08-12 21:04:34,919 epoch 103 - iter 2120/2650 - loss 0.38571242 throughput (samples/sec): 108.14
2019-08-12 21:05:52,333 epoch 103 - iter 2385/2650 - loss 0.38793356 throughput (samples/sec): 109.59
2019-08-12 21:07:12,071 ----------------------------------------------------------------------------------------------------
2019-08-12 21:07:12,071 EPOCH 103 done: loss 0.3910 - lr 0.0500
2019-08-12 21:07:12,071 BAD EPOCHS (no improvement): 0
2019-08-12 21:07:12,071 ----------------------------------------------------------------------------------------------------
2019-08-12 21:07:12,353 epoch 104 - iter 0/2650 - loss 0.16753381 throughput (samples/sec): 30515.33
2019-08-12 21:08:29,610 epoch 104 - iter 265/2650 - loss 0.39363925 throughput (samples/sec): 109.81
2019-08-12 21:09:46,254 epoch 104 - iter 530/2650 - loss 0.39004478 throughput (samples/sec): 110.69
2019-08-12 21:11:05,615 epoch 104 - iter 795/2650 - loss 0.39613594 throughput (samples/sec): 106.90
2019-08-12 21:12:23,404 epoch 104 - iter 1060/2650 - loss 0.39084678 throughput (samples/sec): 109.06
2019-08-12 21:13:44,505 epoch 104 - iter 1325/2650 - loss 0.38987460 throughput (samples/sec): 104.61
2019-08-12 21:15:04,116 epoch 104 - iter 1590/2650 - loss 0.39079155 throughput (samples/sec): 106.57
2019-08-12 21:16:22,990 epoch 104 - iter 1855/2650 - loss 0.38989758 throughput (samples/sec): 107.56
2019-08-12 21:17:42,547 epoch 104 - iter 2120/2650 - loss 0.38713215 throughput (samples/sec): 106.64
2019-08-12 21:19:02,795 epoch 104 - iter 2385/2650 - loss 0.38731664 throughput (samples/sec): 105.72
2019-08-12 21:20:22,362 ----------------------------------------------------------------------------------------------------
2019-08-12 21:20:22,362 EPOCH 104 done: loss 0.3890 - lr 0.0500
2019-08-12 21:20:22,362 BAD EPOCHS (no improvement): 0
2019-08-12 21:20:22,363 ----------------------------------------------------------------------------------------------------
2019-08-12 21:20:22,563 epoch 105 - iter 0/2650 - loss 0.32655203 throughput (samples/sec): 43115.13
2019-08-12 21:21:39,894 epoch 105 - iter 265/2650 - loss 0.37851122 throughput (samples/sec): 109.71
2019-08-12 21:22:56,973 epoch 105 - iter 530/2650 - loss 0.37854331 throughput (samples/sec): 110.07
2019-08-12 21:24:14,067 epoch 105 - iter 795/2650 - loss 0.39124768 throughput (samples/sec): 110.05
2019-08-12 21:25:30,871 epoch 105 - iter 1060/2650 - loss 0.38650906 throughput (samples/sec): 110.46
2019-08-12 21:26:47,271 epoch 105 - iter 1325/2650 - loss 0.39075980 throughput (samples/sec): 111.05
2019-08-12 21:28:02,068 epoch 105 - iter 1590/2650 - loss 0.39230919 throughput (samples/sec): 113.43
2019-08-12 21:29:18,001 epoch 105 - iter 1855/2650 - loss 0.38758998 throughput (samples/sec): 111.73
2019-08-12 21:30:36,252 epoch 105 - iter 2120/2650 - loss 0.38715163 throughput (samples/sec): 108.42
2019-08-12 21:31:53,967 epoch 105 - iter 2385/2650 - loss 0.38796395 throughput (samples/sec): 109.17
2019-08-12 21:33:12,772 ----------------------------------------------------------------------------------------------------
2019-08-12 21:33:12,772 EPOCH 105 done: loss 0.3889 - lr 0.0500
2019-08-12 21:33:12,772 BAD EPOCHS (no improvement): 0
2019-08-12 21:33:12,773 ----------------------------------------------------------------------------------------------------
2019-08-12 21:33:13,066 epoch 106 - iter 0/2650 - loss 0.30804062 throughput (samples/sec): 29272.74
2019-08-12 21:34:30,471 epoch 106 - iter 265/2650 - loss 0.36623936 throughput (samples/sec): 109.60
2019-08-12 21:35:48,232 epoch 106 - iter 530/2650 - loss 0.37008579 throughput (samples/sec): 109.10
2019-08-12 21:37:06,217 epoch 106 - iter 795/2650 - loss 0.38093496 throughput (samples/sec): 108.79
2019-08-12 21:38:23,495 epoch 106 - iter 1060/2650 - loss 0.37776833 throughput (samples/sec): 109.79
2019-08-12 21:39:38,022 epoch 106 - iter 1325/2650 - loss 0.37496735 throughput (samples/sec): 113.84
2019-08-12 21:40:55,728 epoch 106 - iter 1590/2650 - loss 0.37525891 throughput (samples/sec): 109.18
2019-08-12 21:42:12,524 epoch 106 - iter 1855/2650 - loss 0.37559595 throughput (samples/sec): 110.47
2019-08-12 21:43:29,948 epoch 106 - iter 2120/2650 - loss 0.37730456 throughput (samples/sec): 109.58
2019-08-12 21:44:45,562 epoch 106 - iter 2385/2650 - loss 0.37740786 throughput (samples/sec): 112.20
2019-08-12 21:46:02,449 ----------------------------------------------------------------------------------------------------
2019-08-12 21:46:02,449 EPOCH 106 done: loss 0.3789 - lr 0.0500
2019-08-12 21:46:02,449 BAD EPOCHS (no improvement): 0
2019-08-12 21:46:02,450 ----------------------------------------------------------------------------------------------------
2019-08-12 21:46:02,947 epoch 107 - iter 0/2650 - loss 0.56280959 throughput (samples/sec): 17175.05
2019-08-12 21:47:19,357 epoch 107 - iter 265/2650 - loss 0.39807299 throughput (samples/sec): 111.03
2019-08-12 21:48:35,146 epoch 107 - iter 530/2650 - loss 0.37956312 throughput (samples/sec): 111.94
2019-08-12 21:49:52,295 epoch 107 - iter 795/2650 - loss 0.38031137 throughput (samples/sec): 109.97
2019-08-12 21:51:09,012 epoch 107 - iter 1060/2650 - loss 0.37818273 throughput (samples/sec): 110.59
2019-08-12 21:52:25,463 epoch 107 - iter 1325/2650 - loss 0.37833994 throughput (samples/sec): 110.97
2019-08-12 21:53:44,385 epoch 107 - iter 1590/2650 - loss 0.37787193 throughput (samples/sec): 107.50
2019-08-12 21:54:59,384 epoch 107 - iter 1855/2650 - loss 0.37908298 throughput (samples/sec): 113.12
2019-08-12 21:56:14,373 epoch 107 - iter 2120/2650 - loss 0.37720252 throughput (samples/sec): 113.14
2019-08-12 21:57:30,242 epoch 107 - iter 2385/2650 - loss 0.37837274 throughput (samples/sec): 111.83
2019-08-12 21:58:47,185 ----------------------------------------------------------------------------------------------------
2019-08-12 21:58:47,185 EPOCH 107 done: loss 0.3788 - lr 0.0500
2019-08-12 21:58:47,185 BAD EPOCHS (no improvement): 0
2019-08-12 21:58:47,185 ----------------------------------------------------------------------------------------------------
2019-08-12 21:58:47,601 epoch 108 - iter 0/2650 - loss 0.71979797 throughput (samples/sec): 20570.59
2019-08-12 22:00:02,857 epoch 108 - iter 265/2650 - loss 0.36895721 throughput (samples/sec): 112.74
2019-08-12 22:01:20,737 epoch 108 - iter 530/2650 - loss 0.36860054 throughput (samples/sec): 108.94
2019-08-12 22:02:37,929 epoch 108 - iter 795/2650 - loss 0.37146821 throughput (samples/sec): 109.91
2019-08-12 22:03:55,186 epoch 108 - iter 1060/2650 - loss 0.37342745 throughput (samples/sec): 109.81
2019-08-12 22:05:11,789 epoch 108 - iter 1325/2650 - loss 0.37260258 throughput (samples/sec): 110.75
2019-08-12 22:06:29,805 epoch 108 - iter 1590/2650 - loss 0.37099702 throughput (samples/sec): 108.75
2019-08-12 22:07:50,354 epoch 108 - iter 1855/2650 - loss 0.36917733 throughput (samples/sec): 105.33
2019-08-12 22:09:09,102 epoch 108 - iter 2120/2650 - loss 0.37032659 throughput (samples/sec): 107.74
2019-08-12 22:10:25,449 epoch 108 - iter 2385/2650 - loss 0.36996146 throughput (samples/sec): 111.13
2019-08-12 22:11:42,273 ----------------------------------------------------------------------------------------------------
2019-08-12 22:11:42,274 EPOCH 108 done: loss 0.3705 - lr 0.0500
2019-08-12 22:11:42,274 BAD EPOCHS (no improvement): 0
2019-08-12 22:11:42,274 ----------------------------------------------------------------------------------------------------
2019-08-12 22:11:42,564 epoch 109 - iter 0/2650 - loss 0.50317210 throughput (samples/sec): 29591.61
2019-08-12 22:12:58,479 epoch 109 - iter 265/2650 - loss 0.34743532 throughput (samples/sec): 111.76
2019-08-12 22:14:16,660 epoch 109 - iter 530/2650 - loss 0.35885138 throughput (samples/sec): 108.52
2019-08-12 22:15:35,267 epoch 109 - iter 795/2650 - loss 0.36997955 throughput (samples/sec): 107.93
2019-08-12 22:16:52,749 epoch 109 - iter 1060/2650 - loss 0.37070541 throughput (samples/sec): 109.49
2019-08-12 22:18:11,237 epoch 109 - iter 1325/2650 - loss 0.37065553 throughput (samples/sec): 108.09
2019-08-12 22:19:31,207 epoch 109 - iter 1590/2650 - loss 0.37240432 throughput (samples/sec): 106.09
2019-08-12 22:20:50,056 epoch 109 - iter 1855/2650 - loss 0.37174949 throughput (samples/sec): 107.60
2019-08-12 22:22:08,894 epoch 109 - iter 2120/2650 - loss 0.37087774 throughput (samples/sec): 107.61
2019-08-12 22:23:28,745 epoch 109 - iter 2385/2650 - loss 0.37059680 throughput (samples/sec): 106.25
2019-08-12 22:24:46,215 ----------------------------------------------------------------------------------------------------
2019-08-12 22:24:46,215 EPOCH 109 done: loss 0.3740 - lr 0.0500
2019-08-12 22:24:46,215 BAD EPOCHS (no improvement): 1
2019-08-12 22:24:46,216 ----------------------------------------------------------------------------------------------------
2019-08-12 22:24:46,492 epoch 110 - iter 0/2650 - loss 0.13272190 throughput (samples/sec): 31104.84
2019-08-12 22:26:05,445 epoch 110 - iter 265/2650 - loss 0.36534985 throughput (samples/sec): 107.45
2019-08-12 22:27:24,346 epoch 110 - iter 530/2650 - loss 0.36490679 throughput (samples/sec): 107.53
2019-08-12 22:28:43,459 epoch 110 - iter 795/2650 - loss 0.35941596 throughput (samples/sec): 107.24
2019-08-12 22:30:02,495 epoch 110 - iter 1060/2650 - loss 0.36213226 throughput (samples/sec): 107.34
2019-08-12 22:31:22,245 epoch 110 - iter 1325/2650 - loss 0.36793000 throughput (samples/sec): 106.38
2019-08-12 22:32:41,648 epoch 110 - iter 1590/2650 - loss 0.36743435 throughput (samples/sec): 106.85
2019-08-12 22:34:00,811 epoch 110 - iter 1855/2650 - loss 0.37312458 throughput (samples/sec): 107.17
2019-08-12 22:35:19,112 epoch 110 - iter 2120/2650 - loss 0.37388829 throughput (samples/sec): 108.35
2019-08-12 22:36:38,399 epoch 110 - iter 2385/2650 - loss 0.37175849 throughput (samples/sec): 107.00
2019-08-12 22:37:55,923 ----------------------------------------------------------------------------------------------------
2019-08-12 22:37:55,923 EPOCH 110 done: loss 0.3722 - lr 0.0500
2019-08-12 22:37:55,923 BAD EPOCHS (no improvement): 2
2019-08-12 22:37:55,923 ----------------------------------------------------------------------------------------------------
2019-08-12 22:37:56,193 epoch 111 - iter 0/2650 - loss 0.16591635 throughput (samples/sec): 31927.40
2019-08-12 22:39:14,696 epoch 111 - iter 265/2650 - loss 0.34905146 throughput (samples/sec): 108.07
2019-08-12 22:40:32,689 epoch 111 - iter 530/2650 - loss 0.36005604 throughput (samples/sec): 108.78
2019-08-12 22:41:52,458 epoch 111 - iter 795/2650 - loss 0.35819647 throughput (samples/sec): 106.35
2019-08-12 22:43:12,972 epoch 111 - iter 1060/2650 - loss 0.36312275 throughput (samples/sec): 105.37
2019-08-12 22:44:30,443 epoch 111 - iter 1325/2650 - loss 0.36406057 throughput (samples/sec): 109.51
2019-08-12 22:45:49,786 epoch 111 - iter 1590/2650 - loss 0.36769744 throughput (samples/sec): 106.93
2019-08-12 22:47:07,437 epoch 111 - iter 1855/2650 - loss 0.37030196 throughput (samples/sec): 109.26
2019-08-12 22:48:25,383 epoch 111 - iter 2120/2650 - loss 0.37110771 throughput (samples/sec): 108.84
2019-08-12 22:49:43,354 epoch 111 - iter 2385/2650 - loss 0.37000703 throughput (samples/sec): 108.81
2019-08-12 22:51:02,087 ----------------------------------------------------------------------------------------------------
2019-08-12 22:51:02,087 EPOCH 111 done: loss 0.3700 - lr 0.0500
2019-08-12 22:51:02,087 BAD EPOCHS (no improvement): 0
2019-08-12 22:51:02,088 ----------------------------------------------------------------------------------------------------
2019-08-12 22:51:02,378 epoch 112 - iter 0/2650 - loss 0.70299637 throughput (samples/sec): 29604.62
2019-08-12 22:52:21,142 epoch 112 - iter 265/2650 - loss 0.34856314 throughput (samples/sec): 107.71
2019-08-12 22:53:40,651 epoch 112 - iter 530/2650 - loss 0.35359234 throughput (samples/sec): 106.70
2019-08-12 22:55:00,466 epoch 112 - iter 795/2650 - loss 0.36348598 throughput (samples/sec): 106.29
2019-08-12 22:56:20,878 epoch 112 - iter 1060/2650 - loss 0.36606699 throughput (samples/sec): 105.50
2019-08-12 22:57:39,037 epoch 112 - iter 1325/2650 - loss 0.36258720 throughput (samples/sec): 108.55
2019-08-12 22:58:58,292 epoch 112 - iter 1590/2650 - loss 0.36442293 throughput (samples/sec): 107.05
2019-08-12 23:00:17,005 epoch 112 - iter 1855/2650 - loss 0.36292442 throughput (samples/sec): 107.78
2019-08-12 23:01:34,585 epoch 112 - iter 2120/2650 - loss 0.36644235 throughput (samples/sec): 109.36
2019-08-12 23:02:53,819 epoch 112 - iter 2385/2650 - loss 0.36462065 throughput (samples/sec): 107.07
2019-08-12 23:04:09,261 ----------------------------------------------------------------------------------------------------
2019-08-12 23:04:09,261 EPOCH 112 done: loss 0.3651 - lr 0.0500
2019-08-12 23:04:09,261 BAD EPOCHS (no improvement): 0
2019-08-12 23:04:09,261 ----------------------------------------------------------------------------------------------------
2019-08-12 23:04:09,541 epoch 113 - iter 0/2650 - loss 0.47587374 throughput (samples/sec): 30685.30
2019-08-12 23:05:25,506 epoch 113 - iter 265/2650 - loss 0.34320528 throughput (samples/sec): 111.68
2019-08-12 23:06:40,537 epoch 113 - iter 530/2650 - loss 0.35187555 throughput (samples/sec): 113.08
2019-08-12 23:07:56,773 epoch 113 - iter 795/2650 - loss 0.35304294 throughput (samples/sec): 111.29
2019-08-12 23:09:12,862 epoch 113 - iter 1060/2650 - loss 0.36044638 throughput (samples/sec): 111.50
2019-08-12 23:10:28,817 epoch 113 - iter 1325/2650 - loss 0.35818638 throughput (samples/sec): 111.70
2019-08-12 23:11:44,657 epoch 113 - iter 1590/2650 - loss 0.35526989 throughput (samples/sec): 111.87
2019-08-12 23:13:00,952 epoch 113 - iter 1855/2650 - loss 0.35730616 throughput (samples/sec): 111.20
2019-08-12 23:14:16,548 epoch 113 - iter 2120/2650 - loss 0.36161047 throughput (samples/sec): 112.23
2019-08-12 23:15:33,173 epoch 113 - iter 2385/2650 - loss 0.36063535 throughput (samples/sec): 110.72
2019-08-12 23:16:50,075 ----------------------------------------------------------------------------------------------------
2019-08-12 23:16:50,075 EPOCH 113 done: loss 0.3609 - lr 0.0500
2019-08-12 23:16:50,075 BAD EPOCHS (no improvement): 0
2019-08-12 23:16:50,075 ----------------------------------------------------------------------------------------------------
2019-08-12 23:16:50,341 epoch 114 - iter 0/2650 - loss 0.18888485 throughput (samples/sec): 32390.51
2019-08-12 23:18:08,129 epoch 114 - iter 265/2650 - loss 0.35206903 throughput (samples/sec): 109.06
2019-08-12 23:19:25,890 epoch 114 - iter 530/2650 - loss 0.35431810 throughput (samples/sec): 109.10
2019-08-12 23:20:45,419 epoch 114 - iter 795/2650 - loss 0.36138464 throughput (samples/sec): 106.68
2019-08-12 23:22:03,686 epoch 114 - iter 1060/2650 - loss 0.36218798 throughput (samples/sec): 108.40
2019-08-12 23:23:18,124 epoch 114 - iter 1325/2650 - loss 0.36369582 throughput (samples/sec): 113.98
2019-08-12 23:24:33,638 epoch 114 - iter 1590/2650 - loss 0.36401366 throughput (samples/sec): 112.35
2019-08-12 23:25:49,040 epoch 114 - iter 1855/2650 - loss 0.36581705 throughput (samples/sec): 112.52
2019-08-12 23:27:03,108 epoch 114 - iter 2120/2650 - loss 0.36372053 throughput (samples/sec): 114.54
2019-08-12 23:28:20,357 epoch 114 - iter 2385/2650 - loss 0.36148787 throughput (samples/sec): 109.83
2019-08-12 23:29:36,329 ----------------------------------------------------------------------------------------------------
2019-08-12 23:29:36,329 EPOCH 114 done: loss 0.3606 - lr 0.0500
2019-08-12 23:29:36,330 BAD EPOCHS (no improvement): 0
2019-08-12 23:29:36,330 ----------------------------------------------------------------------------------------------------
2019-08-12 23:29:36,592 epoch 115 - iter 0/2650 - loss 0.18308914 throughput (samples/sec): 32799.43
2019-08-12 23:30:53,652 epoch 115 - iter 265/2650 - loss 0.34089637 throughput (samples/sec): 110.10
2019-08-12 23:32:10,522 epoch 115 - iter 530/2650 - loss 0.34398567 throughput (samples/sec): 110.37
2019-08-12 23:33:26,243 epoch 115 - iter 795/2650 - loss 0.35643425 throughput (samples/sec): 112.04
2019-08-12 23:34:42,788 epoch 115 - iter 1060/2650 - loss 0.35714566 throughput (samples/sec): 110.84
2019-08-12 23:35:58,625 epoch 115 - iter 1325/2650 - loss 0.36474019 throughput (samples/sec): 111.87
2019-08-12 23:37:14,388 epoch 115 - iter 1590/2650 - loss 0.36180954 throughput (samples/sec): 111.98
2019-08-12 23:38:32,586 epoch 115 - iter 1855/2650 - loss 0.36093593 throughput (samples/sec): 108.49
2019-08-12 23:39:52,296 epoch 115 - iter 2120/2650 - loss 0.35972958 throughput (samples/sec): 106.43
2019-08-12 23:41:11,418 epoch 115 - iter 2385/2650 - loss 0.35870265 throughput (samples/sec): 107.23
2019-08-12 23:42:29,950 ----------------------------------------------------------------------------------------------------
2019-08-12 23:42:29,950 EPOCH 115 done: loss 0.3612 - lr 0.0500
2019-08-12 23:42:29,950 BAD EPOCHS (no improvement): 1
2019-08-12 23:42:29,951 ----------------------------------------------------------------------------------------------------
2019-08-12 23:42:30,300 epoch 116 - iter 0/2650 - loss 0.15225053 throughput (samples/sec): 24537.69
2019-08-12 23:43:49,087 epoch 116 - iter 265/2650 - loss 0.35055243 throughput (samples/sec): 107.68
2019-08-12 23:45:04,948 epoch 116 - iter 530/2650 - loss 0.35374407 throughput (samples/sec): 111.84
2019-08-12 23:46:21,151 epoch 116 - iter 795/2650 - loss 0.35381273 throughput (samples/sec): 111.33
2019-08-12 23:47:38,097 epoch 116 - iter 1060/2650 - loss 0.35526756 throughput (samples/sec): 110.26
2019-08-12 23:48:53,656 epoch 116 - iter 1325/2650 - loss 0.35620859 throughput (samples/sec): 112.28
2019-08-12 23:50:10,535 epoch 116 - iter 1590/2650 - loss 0.35630938 throughput (samples/sec): 110.36
2019-08-12 23:51:27,664 epoch 116 - iter 1855/2650 - loss 0.35500816 throughput (samples/sec): 110.00
2019-08-12 23:52:46,093 epoch 116 - iter 2120/2650 - loss 0.35393574 throughput (samples/sec): 108.17
2019-08-12 23:54:02,810 epoch 116 - iter 2385/2650 - loss 0.35448851 throughput (samples/sec): 110.59
2019-08-12 23:55:19,363 ----------------------------------------------------------------------------------------------------
2019-08-12 23:55:19,364 EPOCH 116 done: loss 0.3543 - lr 0.0500
2019-08-12 23:55:19,364 BAD EPOCHS (no improvement): 0
2019-08-12 23:55:19,364 ----------------------------------------------------------------------------------------------------
2019-08-12 23:55:19,611 epoch 117 - iter 0/2650 - loss 0.68712026 throughput (samples/sec): 34879.05
2019-08-12 23:56:36,896 epoch 117 - iter 265/2650 - loss 0.34000547 throughput (samples/sec): 109.78
2019-08-12 23:57:54,240 epoch 117 - iter 530/2650 - loss 0.35422641 throughput (samples/sec): 109.69
2019-08-12 23:59:12,855 epoch 117 - iter 795/2650 - loss 0.35510168 throughput (samples/sec): 107.92
2019-08-13 00:00:29,339 epoch 117 - iter 1060/2650 - loss 0.35879333 throughput (samples/sec): 110.93
2019-08-13 00:01:47,155 epoch 117 - iter 1325/2650 - loss 0.35336556 throughput (samples/sec): 109.03
2019-08-13 00:03:02,550 epoch 117 - iter 1590/2650 - loss 0.35569177 throughput (samples/sec): 112.53
2019-08-13 00:04:18,306 epoch 117 - iter 1855/2650 - loss 0.35406171 throughput (samples/sec): 111.99
2019-08-13 00:05:35,264 epoch 117 - iter 2120/2650 - loss 0.35661505 throughput (samples/sec): 110.24
2019-08-13 00:06:52,328 epoch 117 - iter 2385/2650 - loss 0.35820472 throughput (samples/sec): 110.09
2019-08-13 00:08:10,726 ----------------------------------------------------------------------------------------------------
2019-08-13 00:08:10,726 EPOCH 117 done: loss 0.3588 - lr 0.0500
2019-08-13 00:08:10,726 BAD EPOCHS (no improvement): 1
2019-08-13 00:08:10,726 ----------------------------------------------------------------------------------------------------
2019-08-13 00:08:10,929 epoch 118 - iter 0/2650 - loss 0.38075423 throughput (samples/sec): 42547.89
2019-08-13 00:09:25,683 epoch 118 - iter 265/2650 - loss 0.34959598 throughput (samples/sec): 113.49
2019-08-13 00:10:42,669 epoch 118 - iter 530/2650 - loss 0.35747881 throughput (samples/sec): 110.20
2019-08-13 00:11:57,816 epoch 118 - iter 795/2650 - loss 0.36024732 throughput (samples/sec): 112.90
2019-08-13 00:13:13,275 epoch 118 - iter 1060/2650 - loss 0.35848438 throughput (samples/sec): 112.43
2019-08-13 00:14:29,649 epoch 118 - iter 1325/2650 - loss 0.35573723 throughput (samples/sec): 111.09
2019-08-13 00:15:47,788 epoch 118 - iter 1590/2650 - loss 0.35462776 throughput (samples/sec): 108.57
2019-08-13 00:17:03,448 epoch 118 - iter 1855/2650 - loss 0.35657152 throughput (samples/sec): 112.14
2019-08-13 00:18:21,524 epoch 118 - iter 2120/2650 - loss 0.35755381 throughput (samples/sec): 108.66
2019-08-13 00:19:38,428 epoch 118 - iter 2385/2650 - loss 0.35866651 throughput (samples/sec): 110.32
2019-08-13 00:20:55,875 ----------------------------------------------------------------------------------------------------
2019-08-13 00:20:55,875 EPOCH 118 done: loss 0.3574 - lr 0.0500
2019-08-13 00:20:55,875 BAD EPOCHS (no improvement): 2
2019-08-13 00:20:55,876 ----------------------------------------------------------------------------------------------------
2019-08-13 00:20:56,265 epoch 119 - iter 0/2650 - loss 0.36917275 throughput (samples/sec): 21943.57
2019-08-13 00:22:13,354 epoch 119 - iter 265/2650 - loss 0.34428705 throughput (samples/sec): 110.06
2019-08-13 00:23:31,148 epoch 119 - iter 530/2650 - loss 0.33846093 throughput (samples/sec): 109.06
2019-08-13 00:24:47,297 epoch 119 - iter 795/2650 - loss 0.33919559 throughput (samples/sec): 111.41
2019-08-13 00:26:04,704 epoch 119 - iter 1060/2650 - loss 0.33519556 throughput (samples/sec): 109.60
2019-08-13 00:27:21,312 epoch 119 - iter 1325/2650 - loss 0.33848448 throughput (samples/sec): 110.74
2019-08-13 00:28:36,526 epoch 119 - iter 1590/2650 - loss 0.33718575 throughput (samples/sec): 112.80
2019-08-13 00:29:54,090 epoch 119 - iter 1855/2650 - loss 0.33795787 throughput (samples/sec): 109.38
2019-08-13 00:31:09,028 epoch 119 - iter 2120/2650 - loss 0.33842255 throughput (samples/sec): 113.21
2019-08-13 00:32:25,730 epoch 119 - iter 2385/2650 - loss 0.34044778 throughput (samples/sec): 110.61
2019-08-13 00:33:41,953 ----------------------------------------------------------------------------------------------------
2019-08-13 00:33:41,954 EPOCH 119 done: loss 0.3419 - lr 0.0500
2019-08-13 00:33:41,954 BAD EPOCHS (no improvement): 0
2019-08-13 00:33:41,954 ----------------------------------------------------------------------------------------------------
2019-08-13 00:33:42,311 epoch 120 - iter 0/2650 - loss 0.30195156 throughput (samples/sec): 23956.81
2019-08-13 00:35:00,508 epoch 120 - iter 265/2650 - loss 0.33849561 throughput (samples/sec): 108.49
2019-08-13 00:36:15,892 epoch 120 - iter 530/2650 - loss 0.34109511 throughput (samples/sec): 112.55
2019-08-13 00:37:32,250 epoch 120 - iter 795/2650 - loss 0.33870522 throughput (samples/sec): 111.11
2019-08-13 00:38:46,943 epoch 120 - iter 1060/2650 - loss 0.34106999 throughput (samples/sec): 113.59
2019-08-13 00:40:05,173 epoch 120 - iter 1325/2650 - loss 0.34565492 throughput (samples/sec): 108.45
2019-08-13 00:41:22,362 epoch 120 - iter 1590/2650 - loss 0.34392561 throughput (samples/sec): 109.91
2019-08-13 00:42:38,388 epoch 120 - iter 1855/2650 - loss 0.34326280 throughput (samples/sec): 111.59
2019-08-13 00:43:53,220 epoch 120 - iter 2120/2650 - loss 0.34300769 throughput (samples/sec): 113.38
2019-08-13 00:45:12,088 epoch 120 - iter 2385/2650 - loss 0.34831989 throughput (samples/sec): 107.57
2019-08-13 00:46:29,561 ----------------------------------------------------------------------------------------------------
2019-08-13 00:46:29,561 EPOCH 120 done: loss 0.3496 - lr 0.0500
2019-08-13 00:46:29,561 BAD EPOCHS (no improvement): 1
2019-08-13 00:46:29,561 ----------------------------------------------------------------------------------------------------
2019-08-13 00:46:29,859 epoch 121 - iter 0/2650 - loss 0.93610263 throughput (samples/sec): 28874.69
2019-08-13 00:47:47,964 epoch 121 - iter 265/2650 - loss 0.34402300 throughput (samples/sec): 108.62
2019-08-13 00:49:04,154 epoch 121 - iter 530/2650 - loss 0.33997365 throughput (samples/sec): 111.35
2019-08-13 00:50:19,725 epoch 121 - iter 795/2650 - loss 0.34863555 throughput (samples/sec): 112.27
2019-08-13 00:51:37,826 epoch 121 - iter 1060/2650 - loss 0.35036639 throughput (samples/sec): 108.63
2019-08-13 00:52:55,923 epoch 121 - iter 1325/2650 - loss 0.34875581 throughput (samples/sec): 108.64
2019-08-13 00:54:14,584 epoch 121 - iter 1590/2650 - loss 0.35174585 throughput (samples/sec): 107.86
2019-08-13 00:55:30,259 epoch 121 - iter 1855/2650 - loss 0.35218646 throughput (samples/sec): 112.12
2019-08-13 00:56:45,880 epoch 121 - iter 2120/2650 - loss 0.35110488 throughput (samples/sec): 112.20
2019-08-13 00:58:04,358 epoch 121 - iter 2385/2650 - loss 0.35113506 throughput (samples/sec): 108.11
2019-08-13 00:59:24,011 ----------------------------------------------------------------------------------------------------
2019-08-13 00:59:24,011 EPOCH 121 done: loss 0.3525 - lr 0.0500
2019-08-13 00:59:24,011 BAD EPOCHS (no improvement): 2
2019-08-13 00:59:24,011 ----------------------------------------------------------------------------------------------------
2019-08-13 00:59:24,312 epoch 122 - iter 0/2650 - loss 0.09613314 throughput (samples/sec): 28537.12
2019-08-13 01:00:44,825 epoch 122 - iter 265/2650 - loss 0.34787294 throughput (samples/sec): 105.37
2019-08-13 01:02:03,009 epoch 122 - iter 530/2650 - loss 0.35363890 throughput (samples/sec): 108.51
2019-08-13 01:03:23,852 epoch 122 - iter 795/2650 - loss 0.35063267 throughput (samples/sec): 104.94
2019-08-13 01:04:43,925 epoch 122 - iter 1060/2650 - loss 0.34854571 throughput (samples/sec): 105.95
2019-08-13 01:06:03,539 epoch 122 - iter 1325/2650 - loss 0.34784991 throughput (samples/sec): 106.56
2019-08-13 01:07:21,280 epoch 122 - iter 1590/2650 - loss 0.34870978 throughput (samples/sec): 109.13
2019-08-13 01:08:36,825 epoch 122 - iter 1855/2650 - loss 0.34725776 throughput (samples/sec): 112.31
2019-08-13 01:09:53,473 epoch 122 - iter 2120/2650 - loss 0.34868872 throughput (samples/sec): 110.69
2019-08-13 01:11:10,401 epoch 122 - iter 2385/2650 - loss 0.34818428 throughput (samples/sec): 110.29
2019-08-13 01:12:26,666 ----------------------------------------------------------------------------------------------------
2019-08-13 01:12:26,666 EPOCH 122 done: loss 0.3469 - lr 0.0500
2019-08-13 01:12:26,667 BAD EPOCHS (no improvement): 3
2019-08-13 01:12:26,667 ----------------------------------------------------------------------------------------------------
2019-08-13 01:12:26,931 epoch 123 - iter 0/2650 - loss 0.51807725 throughput (samples/sec): 32455.68
2019-08-13 01:13:45,804 epoch 123 - iter 265/2650 - loss 0.34091868 throughput (samples/sec): 107.57
2019-08-13 01:15:03,588 epoch 123 - iter 530/2650 - loss 0.34720683 throughput (samples/sec): 109.07
2019-08-13 01:16:20,644 epoch 123 - iter 795/2650 - loss 0.34895119 throughput (samples/sec): 110.10
2019-08-13 01:17:37,094 epoch 123 - iter 1060/2650 - loss 0.34884536 throughput (samples/sec): 110.97
2019-08-13 01:18:55,311 epoch 123 - iter 1325/2650 - loss 0.35083522 throughput (samples/sec): 108.47
2019-08-13 01:20:11,807 epoch 123 - iter 1590/2650 - loss 0.35290075 throughput (samples/sec): 110.91
2019-08-13 01:21:29,925 epoch 123 - iter 1855/2650 - loss 0.35179532 throughput (samples/sec): 108.60
2019-08-13 01:22:46,887 epoch 123 - iter 2120/2650 - loss 0.35078266 throughput (samples/sec): 110.24
2019-08-13 01:24:01,120 epoch 123 - iter 2385/2650 - loss 0.35007367 throughput (samples/sec): 114.29
2019-08-13 01:25:16,941 ----------------------------------------------------------------------------------------------------
2019-08-13 01:25:16,941 EPOCH 123 done: loss 0.3511 - lr 0.0500
2019-08-13 01:25:16,942 BAD EPOCHS (no improvement): 4
2019-08-13 01:25:16,942 ----------------------------------------------------------------------------------------------------
2019-08-13 01:25:17,208 epoch 124 - iter 0/2650 - loss 0.10634750 throughput (samples/sec): 32239.14
2019-08-13 01:26:31,416 epoch 124 - iter 265/2650 - loss 0.33134226 throughput (samples/sec): 114.33
2019-08-13 01:27:50,151 epoch 124 - iter 530/2650 - loss 0.34263627 throughput (samples/sec): 107.76
2019-08-13 01:29:09,003 epoch 124 - iter 795/2650 - loss 0.33881415 throughput (samples/sec): 107.59
2019-08-13 01:30:25,523 epoch 124 - iter 1060/2650 - loss 0.33706452 throughput (samples/sec): 110.88
2019-08-13 01:31:45,924 epoch 124 - iter 1325/2650 - loss 0.33693548 throughput (samples/sec): 105.52
2019-08-13 01:33:02,823 epoch 124 - iter 1590/2650 - loss 0.33741706 throughput (samples/sec): 110.33
2019-08-13 01:34:18,966 epoch 124 - iter 1855/2650 - loss 0.33810493 throughput (samples/sec): 111.43
2019-08-13 01:35:36,835 epoch 124 - iter 2120/2650 - loss 0.33651430 throughput (samples/sec): 108.95
2019-08-13 01:36:56,404 epoch 124 - iter 2385/2650 - loss 0.33608796 throughput (samples/sec): 106.63
2019-08-13 01:38:13,539 ----------------------------------------------------------------------------------------------------
2019-08-13 01:38:13,539 EPOCH 124 done: loss 0.3363 - lr 0.0250
2019-08-13 01:38:13,539 BAD EPOCHS (no improvement): 0
2019-08-13 01:38:13,539 ----------------------------------------------------------------------------------------------------
2019-08-13 01:38:13,781 epoch 125 - iter 0/2650 - loss 0.29580587 throughput (samples/sec): 35563.61
2019-08-13 01:39:30,275 epoch 125 - iter 265/2650 - loss 0.32347959 throughput (samples/sec): 110.91
2019-08-13 01:40:48,527 epoch 125 - iter 530/2650 - loss 0.33229062 throughput (samples/sec): 108.42
2019-08-13 01:42:05,397 epoch 125 - iter 795/2650 - loss 0.32975240 throughput (samples/sec): 110.37
2019-08-13 01:43:26,981 epoch 125 - iter 1060/2650 - loss 0.33659289 throughput (samples/sec): 103.99
2019-08-13 01:44:42,634 epoch 125 - iter 1325/2650 - loss 0.33374817 throughput (samples/sec): 112.15
2019-08-13 01:45:59,543 epoch 125 - iter 1590/2650 - loss 0.33215666 throughput (samples/sec): 110.31
2019-08-13 01:47:19,201 epoch 125 - iter 1855/2650 - loss 0.33395651 throughput (samples/sec): 106.50
2019-08-13 01:48:39,827 epoch 125 - iter 2120/2650 - loss 0.33285270 throughput (samples/sec): 105.22
2019-08-13 01:49:55,150 epoch 125 - iter 2385/2650 - loss 0.33245456 throughput (samples/sec): 112.64
2019-08-13 01:51:10,504 ----------------------------------------------------------------------------------------------------
2019-08-13 01:51:10,504 EPOCH 125 done: loss 0.3327 - lr 0.0250
2019-08-13 01:51:10,504 BAD EPOCHS (no improvement): 0
2019-08-13 01:51:10,505 ----------------------------------------------------------------------------------------------------
2019-08-13 01:51:10,784 epoch 126 - iter 0/2650 - loss 0.41301680 throughput (samples/sec): 30720.71
2019-08-13 01:52:27,677 epoch 126 - iter 265/2650 - loss 0.34511059 throughput (samples/sec): 110.34
2019-08-13 01:53:44,408 epoch 126 - iter 530/2650 - loss 0.33433442 throughput (samples/sec): 110.57
2019-08-13 01:54:59,811 epoch 126 - iter 795/2650 - loss 0.32995493 throughput (samples/sec): 112.52
2019-08-13 01:56:18,366 epoch 126 - iter 1060/2650 - loss 0.33176699 throughput (samples/sec): 108.00
2019-08-13 01:57:36,342 epoch 126 - iter 1325/2650 - loss 0.33439872 throughput (samples/sec): 108.80
2019-08-13 01:58:53,132 epoch 126 - iter 1590/2650 - loss 0.33667681 throughput (samples/sec): 110.49
2019-08-13 02:00:09,868 epoch 126 - iter 1855/2650 - loss 0.33051092 throughput (samples/sec): 110.56
2019-08-13 02:01:27,689 epoch 126 - iter 2120/2650 - loss 0.32872282 throughput (samples/sec): 109.02
2019-08-13 02:02:42,625 epoch 126 - iter 2385/2650 - loss 0.32776643 throughput (samples/sec): 113.22
2019-08-13 02:03:59,745 ----------------------------------------------------------------------------------------------------
2019-08-13 02:03:59,745 EPOCH 126 done: loss 0.3285 - lr 0.0250
2019-08-13 02:03:59,745 BAD EPOCHS (no improvement): 0
2019-08-13 02:03:59,745 ----------------------------------------------------------------------------------------------------
2019-08-13 02:03:59,984 epoch 127 - iter 0/2650 - loss 0.38772976 throughput (samples/sec): 36007.27
2019-08-13 02:05:16,609 epoch 127 - iter 265/2650 - loss 0.29570206 throughput (samples/sec): 110.72
2019-08-13 02:06:34,420 epoch 127 - iter 530/2650 - loss 0.30805386 throughput (samples/sec): 109.03
2019-08-13 02:07:50,276 epoch 127 - iter 795/2650 - loss 0.30871582 throughput (samples/sec): 111.84
2019-08-13 02:09:08,585 epoch 127 - iter 1060/2650 - loss 0.31693417 throughput (samples/sec): 108.34
2019-08-13 02:10:27,168 epoch 127 - iter 1325/2650 - loss 0.31856782 throughput (samples/sec): 107.96
2019-08-13 02:11:45,762 epoch 127 - iter 1590/2650 - loss 0.31884626 throughput (samples/sec): 107.95
2019-08-13 02:13:02,614 epoch 127 - iter 1855/2650 - loss 0.32129643 throughput (samples/sec): 110.39
2019-08-13 02:14:17,578 epoch 127 - iter 2120/2650 - loss 0.32110572 throughput (samples/sec): 113.18
2019-08-13 02:15:34,737 epoch 127 - iter 2385/2650 - loss 0.32034215 throughput (samples/sec): 109.95
2019-08-13 02:16:50,838 ----------------------------------------------------------------------------------------------------
2019-08-13 02:16:50,838 EPOCH 127 done: loss 0.3216 - lr 0.0250
2019-08-13 02:16:50,838 BAD EPOCHS (no improvement): 0
2019-08-13 02:16:50,839 ----------------------------------------------------------------------------------------------------
2019-08-13 02:16:51,128 epoch 128 - iter 0/2650 - loss 0.24828541 throughput (samples/sec): 29675.43
2019-08-13 02:18:09,001 epoch 128 - iter 265/2650 - loss 0.31130030 throughput (samples/sec): 108.95
2019-08-13 02:19:26,507 epoch 128 - iter 530/2650 - loss 0.31359254 throughput (samples/sec): 109.46
2019-08-13 02:20:43,885 epoch 128 - iter 795/2650 - loss 0.31680831 throughput (samples/sec): 109.64
2019-08-13 02:22:01,708 epoch 128 - iter 1060/2650 - loss 0.31541107 throughput (samples/sec): 109.02
2019-08-13 02:23:18,577 epoch 128 - iter 1325/2650 - loss 0.31857211 throughput (samples/sec): 110.37
2019-08-13 02:24:35,944 epoch 128 - iter 1590/2650 - loss 0.31782741 throughput (samples/sec): 109.66
2019-08-13 02:25:52,319 epoch 128 - iter 1855/2650 - loss 0.32051285 throughput (samples/sec): 111.08
2019-08-13 02:27:07,897 epoch 128 - iter 2120/2650 - loss 0.32187355 throughput (samples/sec): 112.26
2019-08-13 02:28:24,276 epoch 128 - iter 2385/2650 - loss 0.32537344 throughput (samples/sec): 111.08
2019-08-13 02:29:40,909 ----------------------------------------------------------------------------------------------------
2019-08-13 02:29:40,909 EPOCH 128 done: loss 0.3251 - lr 0.0250
2019-08-13 02:29:40,909 BAD EPOCHS (no improvement): 1
2019-08-13 02:29:40,909 ----------------------------------------------------------------------------------------------------
2019-08-13 02:29:41,259 epoch 129 - iter 0/2650 - loss 0.11317647 throughput (samples/sec): 24491.59
2019-08-13 02:30:56,365 epoch 129 - iter 265/2650 - loss 0.32216724 throughput (samples/sec): 112.96
2019-08-13 02:32:15,225 epoch 129 - iter 530/2650 - loss 0.33176584 throughput (samples/sec): 107.58
2019-08-13 02:33:32,541 epoch 129 - iter 795/2650 - loss 0.32780667 throughput (samples/sec): 109.73
2019-08-13 02:34:48,687 epoch 129 - iter 1060/2650 - loss 0.32500018 throughput (samples/sec): 111.42
2019-08-13 02:36:05,243 epoch 129 - iter 1325/2650 - loss 0.32133229 throughput (samples/sec): 110.82
2019-08-13 02:37:24,222 epoch 129 - iter 1590/2650 - loss 0.32056689 throughput (samples/sec): 107.42
2019-08-13 02:38:42,931 epoch 129 - iter 1855/2650 - loss 0.32009840 throughput (samples/sec): 107.79
2019-08-13 02:40:00,177 epoch 129 - iter 2120/2650 - loss 0.32048281 throughput (samples/sec): 109.83
2019-08-13 02:41:15,742 epoch 129 - iter 2385/2650 - loss 0.32142602 throughput (samples/sec): 112.28
2019-08-13 02:42:33,776 ----------------------------------------------------------------------------------------------------
2019-08-13 02:42:33,776 EPOCH 129 done: loss 0.3197 - lr 0.0250
2019-08-13 02:42:33,776 BAD EPOCHS (no improvement): 0
2019-08-13 02:42:33,776 ----------------------------------------------------------------------------------------------------
2019-08-13 02:42:34,106 epoch 130 - iter 0/2650 - loss 0.06931660 throughput (samples/sec): 25972.06
2019-08-13 02:43:50,729 epoch 130 - iter 265/2650 - loss 0.33197435 throughput (samples/sec): 110.72
2019-08-13 02:45:10,193 epoch 130 - iter 530/2650 - loss 0.32154967 throughput (samples/sec): 106.76
2019-08-13 02:46:29,909 epoch 130 - iter 795/2650 - loss 0.31760018 throughput (samples/sec): 106.43
2019-08-13 02:47:47,128 epoch 130 - iter 1060/2650 - loss 0.31661032 throughput (samples/sec): 109.87
2019-08-13 02:49:06,217 epoch 130 - iter 1325/2650 - loss 0.31301853 throughput (samples/sec): 107.27
2019-08-13 02:50:23,175 epoch 130 - iter 1590/2650 - loss 0.31442879 throughput (samples/sec): 110.24
2019-08-13 02:51:41,564 epoch 130 - iter 1855/2650 - loss 0.31644757 throughput (samples/sec): 108.23
2019-08-13 02:53:01,476 epoch 130 - iter 2120/2650 - loss 0.31671162 throughput (samples/sec): 106.17
2019-08-13 02:54:22,346 epoch 130 - iter 2385/2650 - loss 0.31794553 throughput (samples/sec): 104.91
2019-08-13 02:55:40,284 ----------------------------------------------------------------------------------------------------
2019-08-13 02:55:40,284 EPOCH 130 done: loss 0.3180 - lr 0.0250
2019-08-13 02:55:40,285 BAD EPOCHS (no improvement): 0
2019-08-13 02:55:40,285 ----------------------------------------------------------------------------------------------------
2019-08-13 02:55:40,518 epoch 131 - iter 0/2650 - loss 0.10272545 throughput (samples/sec): 36952.30
2019-08-13 02:56:59,682 epoch 131 - iter 265/2650 - loss 0.31118230 throughput (samples/sec): 107.17
2019-08-13 02:58:17,948 epoch 131 - iter 530/2650 - loss 0.31765537 throughput (samples/sec): 108.40
2019-08-13 02:59:39,206 epoch 131 - iter 795/2650 - loss 0.31228914 throughput (samples/sec): 104.40
2019-08-13 03:00:57,257 epoch 131 - iter 1060/2650 - loss 0.31127924 throughput (samples/sec): 108.70
2019-08-13 03:02:14,784 epoch 131 - iter 1325/2650 - loss 0.31080690 throughput (samples/sec): 109.43
2019-08-13 03:03:31,767 epoch 131 - iter 1590/2650 - loss 0.31330723 throughput (samples/sec): 110.21
2019-08-13 03:04:48,882 epoch 131 - iter 1855/2650 - loss 0.31401338 throughput (samples/sec): 110.02
2019-08-13 03:06:03,928 epoch 131 - iter 2120/2650 - loss 0.31795205 throughput (samples/sec): 113.05
2019-08-13 03:07:21,910 epoch 131 - iter 2385/2650 - loss 0.31926351 throughput (samples/sec): 108.79
2019-08-13 03:08:39,248 ----------------------------------------------------------------------------------------------------
2019-08-13 03:08:39,248 EPOCH 131 done: loss 0.3196 - lr 0.0250
2019-08-13 03:08:39,248 BAD EPOCHS (no improvement): 1
2019-08-13 03:08:39,248 ----------------------------------------------------------------------------------------------------
2019-08-13 03:08:39,507 epoch 132 - iter 0/2650 - loss 0.70110250 throughput (samples/sec): 33296.04
2019-08-13 03:09:58,671 epoch 132 - iter 265/2650 - loss 0.30236240 throughput (samples/sec): 107.17
2019-08-13 03:11:13,986 epoch 132 - iter 530/2650 - loss 0.31755938 throughput (samples/sec): 112.65
2019-08-13 03:12:28,808 epoch 132 - iter 795/2650 - loss 0.32159244 throughput (samples/sec): 113.39
2019-08-13 03:13:45,237 epoch 132 - iter 1060/2650 - loss 0.32259007 throughput (samples/sec): 111.01
2019-08-13 03:15:02,357 epoch 132 - iter 1325/2650 - loss 0.32267257 throughput (samples/sec): 110.01
2019-08-13 03:16:19,307 epoch 132 - iter 1590/2650 - loss 0.32341855 throughput (samples/sec): 110.25
2019-08-13 03:17:37,209 epoch 132 - iter 1855/2650 - loss 0.32414314 throughput (samples/sec): 108.91
2019-08-13 03:18:54,178 epoch 132 - iter 2120/2650 - loss 0.32473776 throughput (samples/sec): 110.23
2019-08-13 03:20:11,370 epoch 132 - iter 2385/2650 - loss 0.32415545 throughput (samples/sec): 109.91
2019-08-13 03:21:27,422 ----------------------------------------------------------------------------------------------------
2019-08-13 03:21:27,422 EPOCH 132 done: loss 0.3225 - lr 0.0250
2019-08-13 03:21:27,422 BAD EPOCHS (no improvement): 2
2019-08-13 03:21:27,423 ----------------------------------------------------------------------------------------------------
2019-08-13 03:21:27,668 epoch 133 - iter 0/2650 - loss 0.13180113 throughput (samples/sec): 35020.33
2019-08-13 03:22:45,266 epoch 133 - iter 265/2650 - loss 0.31234149 throughput (samples/sec): 109.33
2019-08-13 03:24:03,531 epoch 133 - iter 530/2650 - loss 0.31149446 throughput (samples/sec): 108.40
2019-08-13 03:25:19,403 epoch 133 - iter 795/2650 - loss 0.31567760 throughput (samples/sec): 111.82
2019-08-13 03:26:36,532 epoch 133 - iter 1060/2650 - loss 0.31707056 throughput (samples/sec): 110.00
2019-08-13 03:27:54,747 epoch 133 - iter 1325/2650 - loss 0.31221910 throughput (samples/sec): 108.47
2019-08-13 03:29:13,637 epoch 133 - iter 1590/2650 - loss 0.31560388 throughput (samples/sec): 107.54
2019-08-13 03:30:31,579 epoch 133 - iter 1855/2650 - loss 0.31533074 throughput (samples/sec): 108.85
2019-08-13 03:31:50,452 epoch 133 - iter 2120/2650 - loss 0.31662479 throughput (samples/sec): 107.56
2019-08-13 03:33:09,904 epoch 133 - iter 2385/2650 - loss 0.31892891 throughput (samples/sec): 106.78
2019-08-13 03:34:27,794 ----------------------------------------------------------------------------------------------------
2019-08-13 03:34:27,794 EPOCH 133 done: loss 0.3169 - lr 0.0250
2019-08-13 03:34:27,794 BAD EPOCHS (no improvement): 0
2019-08-13 03:34:27,794 ----------------------------------------------------------------------------------------------------
2019-08-13 03:34:28,090 epoch 134 - iter 0/2650 - loss 0.40057439 throughput (samples/sec): 29048.56
2019-08-13 03:35:46,402 epoch 134 - iter 265/2650 - loss 0.31333856 throughput (samples/sec): 108.33
2019-08-13 03:37:02,510 epoch 134 - iter 530/2650 - loss 0.31704652 throughput (samples/sec): 111.47
2019-08-13 03:38:21,909 epoch 134 - iter 795/2650 - loss 0.31185274 throughput (samples/sec): 106.85
2019-08-13 03:39:43,441 epoch 134 - iter 1060/2650 - loss 0.31656159 throughput (samples/sec): 104.05
2019-08-13 03:41:01,917 epoch 134 - iter 1325/2650 - loss 0.31821507 throughput (samples/sec): 108.11
2019-08-13 03:42:20,524 epoch 134 - iter 1590/2650 - loss 0.31698511 throughput (samples/sec): 107.93
2019-08-13 03:43:41,641 epoch 134 - iter 1855/2650 - loss 0.31522165 throughput (samples/sec): 104.59
2019-08-13 03:44:58,989 epoch 134 - iter 2120/2650 - loss 0.31552760 throughput (samples/sec): 109.69
2019-08-13 03:46:18,900 epoch 134 - iter 2385/2650 - loss 0.31706214 throughput (samples/sec): 106.17
2019-08-13 03:47:38,367 ----------------------------------------------------------------------------------------------------
2019-08-13 03:47:38,368 EPOCH 134 done: loss 0.3141 - lr 0.0250
2019-08-13 03:47:38,368 BAD EPOCHS (no improvement): 0
2019-08-13 03:47:38,368 ----------------------------------------------------------------------------------------------------
2019-08-13 03:47:38,686 epoch 135 - iter 0/2650 - loss 0.16511428 throughput (samples/sec): 26915.68
2019-08-13 03:49:01,064 epoch 135 - iter 265/2650 - loss 0.31070513 throughput (samples/sec): 102.99
2019-08-13 03:50:20,404 epoch 135 - iter 530/2650 - loss 0.31533458 throughput (samples/sec): 106.93
2019-08-13 03:51:37,310 epoch 135 - iter 795/2650 - loss 0.31587078 throughput (samples/sec): 110.32
2019-08-13 03:52:55,570 epoch 135 - iter 1060/2650 - loss 0.31844804 throughput (samples/sec): 108.41
2019-08-13 03:54:14,851 epoch 135 - iter 1325/2650 - loss 0.31676785 throughput (samples/sec): 107.01
2019-08-13 03:55:33,305 epoch 135 - iter 1590/2650 - loss 0.31634223 throughput (samples/sec): 108.14
2019-08-13 03:56:52,053 epoch 135 - iter 1855/2650 - loss 0.31362642 throughput (samples/sec): 107.73
2019-08-13 03:58:10,221 epoch 135 - iter 2120/2650 - loss 0.31912887 throughput (samples/sec): 108.54
2019-08-13 03:59:29,073 epoch 135 - iter 2385/2650 - loss 0.32082573 throughput (samples/sec): 107.59
2019-08-13 04:00:47,834 ----------------------------------------------------------------------------------------------------
2019-08-13 04:00:47,834 EPOCH 135 done: loss 0.3178 - lr 0.0250
2019-08-13 04:00:47,834 BAD EPOCHS (no improvement): 1
2019-08-13 04:00:47,834 ----------------------------------------------------------------------------------------------------
2019-08-13 04:00:48,047 epoch 136 - iter 0/2650 - loss 0.65093875 throughput (samples/sec): 40505.06
2019-08-13 04:02:07,572 epoch 136 - iter 265/2650 - loss 0.30791360 throughput (samples/sec): 106.68
2019-08-13 04:03:27,109 epoch 136 - iter 530/2650 - loss 0.30979141 throughput (samples/sec): 106.67
2019-08-13 04:04:44,951 epoch 136 - iter 795/2650 - loss 0.31751069 throughput (samples/sec): 108.99
2019-08-13 04:06:04,007 epoch 136 - iter 1060/2650 - loss 0.31856657 throughput (samples/sec): 107.31
2019-08-13 04:07:21,862 epoch 136 - iter 1325/2650 - loss 0.31563705 throughput (samples/sec): 108.97
2019-08-13 04:08:40,367 epoch 136 - iter 1590/2650 - loss 0.31748915 throughput (samples/sec): 108.07
2019-08-13 04:09:57,134 epoch 136 - iter 1855/2650 - loss 0.31786299 throughput (samples/sec): 110.51
2019-08-13 04:11:15,812 epoch 136 - iter 2120/2650 - loss 0.31730254 throughput (samples/sec): 107.83
2019-08-13 04:12:32,652 epoch 136 - iter 2385/2650 - loss 0.31911100 throughput (samples/sec): 110.41
2019-08-13 04:13:51,276 ----------------------------------------------------------------------------------------------------
2019-08-13 04:13:51,276 EPOCH 136 done: loss 0.3174 - lr 0.0250
2019-08-13 04:13:51,276 BAD EPOCHS (no improvement): 2
2019-08-13 04:13:51,276 ----------------------------------------------------------------------------------------------------
2019-08-13 04:13:51,485 epoch 137 - iter 0/2650 - loss 0.21057415 throughput (samples/sec): 41357.84
2019-08-13 04:15:09,813 epoch 137 - iter 265/2650 - loss 0.27096179 throughput (samples/sec): 108.31
2019-08-13 04:16:27,075 epoch 137 - iter 530/2650 - loss 0.29087613 throughput (samples/sec): 109.81
2019-08-13 04:17:44,869 epoch 137 - iter 795/2650 - loss 0.30227077 throughput (samples/sec): 109.06
2019-08-13 04:19:02,602 epoch 137 - iter 1060/2650 - loss 0.30598135 throughput (samples/sec): 109.14
2019-08-13 04:20:21,354 epoch 137 - iter 1325/2650 - loss 0.30691156 throughput (samples/sec): 107.73
2019-08-13 04:21:41,351 epoch 137 - iter 1590/2650 - loss 0.30812680 throughput (samples/sec): 106.05
2019-08-13 04:22:58,438 epoch 137 - iter 1855/2650 - loss 0.30786555 throughput (samples/sec): 110.06
2019-08-13 04:24:16,451 epoch 137 - iter 2120/2650 - loss 0.31071294 throughput (samples/sec): 108.75
2019-08-13 04:25:33,935 epoch 137 - iter 2385/2650 - loss 0.31228261 throughput (samples/sec): 109.49
2019-08-13 04:26:53,482 ----------------------------------------------------------------------------------------------------
2019-08-13 04:26:53,482 EPOCH 137 done: loss 0.3117 - lr 0.0250
2019-08-13 04:26:53,482 BAD EPOCHS (no improvement): 0
2019-08-13 04:26:53,482 ----------------------------------------------------------------------------------------------------
2019-08-13 04:26:53,778 epoch 138 - iter 0/2650 - loss 0.54062247 throughput (samples/sec): 29033.93
2019-08-13 04:28:13,082 epoch 138 - iter 265/2650 - loss 0.30967032 throughput (samples/sec): 106.98
2019-08-13 04:29:31,038 epoch 138 - iter 530/2650 - loss 0.31428093 throughput (samples/sec): 108.83
2019-08-13 04:30:47,578 epoch 138 - iter 795/2650 - loss 0.30990332 throughput (samples/sec): 110.84
2019-08-13 04:32:04,492 epoch 138 - iter 1060/2650 - loss 0.30931051 throughput (samples/sec): 110.31
2019-08-13 04:33:22,920 epoch 138 - iter 1325/2650 - loss 0.30951366 throughput (samples/sec): 108.17
2019-08-13 04:34:40,263 epoch 138 - iter 1590/2650 - loss 0.30807466 throughput (samples/sec): 109.69
2019-08-13 04:35:57,141 epoch 138 - iter 1855/2650 - loss 0.30735861 throughput (samples/sec): 110.36
2019-08-13 04:37:12,129 epoch 138 - iter 2120/2650 - loss 0.30711867 throughput (samples/sec): 113.14
2019-08-13 04:38:29,784 epoch 138 - iter 2385/2650 - loss 0.30646182 throughput (samples/sec): 109.25
2019-08-13 04:39:44,725 ----------------------------------------------------------------------------------------------------
2019-08-13 04:39:44,725 EPOCH 138 done: loss 0.3075 - lr 0.0250
2019-08-13 04:39:44,726 BAD EPOCHS (no improvement): 0
2019-08-13 04:39:44,726 ----------------------------------------------------------------------------------------------------
2019-08-13 04:39:45,001 epoch 139 - iter 0/2650 - loss 0.38021708 throughput (samples/sec): 31162.12
2019-08-13 04:41:02,454 epoch 139 - iter 265/2650 - loss 0.29404630 throughput (samples/sec): 109.54
2019-08-13 04:42:18,604 epoch 139 - iter 530/2650 - loss 0.29990228 throughput (samples/sec): 111.41
2019-08-13 04:43:35,767 epoch 139 - iter 795/2650 - loss 0.30682213 throughput (samples/sec): 109.95
2019-08-13 04:44:54,430 epoch 139 - iter 1060/2650 - loss 0.30640976 throughput (samples/sec): 107.85
2019-08-13 04:46:09,783 epoch 139 - iter 1325/2650 - loss 0.30580356 throughput (samples/sec): 112.59
2019-08-13 04:47:24,816 epoch 139 - iter 1590/2650 - loss 0.30665590 throughput (samples/sec): 113.07
2019-08-13 04:48:42,730 epoch 139 - iter 1855/2650 - loss 0.30704851 throughput (samples/sec): 108.89
2019-08-13 04:50:00,885 epoch 139 - iter 2120/2650 - loss 0.30681664 throughput (samples/sec): 108.55
2019-08-13 04:51:19,450 epoch 139 - iter 2385/2650 - loss 0.30529256 throughput (samples/sec): 107.99
2019-08-13 04:52:35,907 ----------------------------------------------------------------------------------------------------
2019-08-13 04:52:35,907 EPOCH 139 done: loss 0.3054 - lr 0.0250
2019-08-13 04:52:35,907 BAD EPOCHS (no improvement): 0
2019-08-13 04:52:35,908 ----------------------------------------------------------------------------------------------------
2019-08-13 04:52:36,170 epoch 140 - iter 0/2650 - loss 0.20617980 throughput (samples/sec): 32770.81
2019-08-13 04:53:55,415 epoch 140 - iter 265/2650 - loss 0.30040273 throughput (samples/sec): 107.06
2019-08-13 04:55:11,777 epoch 140 - iter 530/2650 - loss 0.29946147 throughput (samples/sec): 111.11
2019-08-13 04:56:28,181 epoch 140 - iter 795/2650 - loss 0.30253311 throughput (samples/sec): 111.04
2019-08-13 04:57:47,136 epoch 140 - iter 1060/2650 - loss 0.30326306 throughput (samples/sec): 107.46
2019-08-13 04:59:02,727 epoch 140 - iter 1325/2650 - loss 0.30945584 throughput (samples/sec): 112.24
2019-08-13 05:00:20,523 epoch 140 - iter 1590/2650 - loss 0.31083850 throughput (samples/sec): 109.06
2019-08-13 05:01:39,785 epoch 140 - iter 1855/2650 - loss 0.31169934 throughput (samples/sec): 107.04
2019-08-13 05:02:56,378 epoch 140 - iter 2120/2650 - loss 0.30914101 throughput (samples/sec): 110.77
2019-08-13 05:04:16,291 epoch 140 - iter 2385/2650 - loss 0.30956830 throughput (samples/sec): 106.16
2019-08-13 05:05:34,278 ----------------------------------------------------------------------------------------------------
2019-08-13 05:05:34,278 EPOCH 140 done: loss 0.3098 - lr 0.0250
2019-08-13 05:05:34,278 BAD EPOCHS (no improvement): 1
2019-08-13 05:05:34,279 ----------------------------------------------------------------------------------------------------
2019-08-13 05:05:34,634 epoch 141 - iter 0/2650 - loss 0.43534207 throughput (samples/sec): 24095.28
2019-08-13 05:06:53,776 epoch 141 - iter 265/2650 - loss 0.32705341 throughput (samples/sec): 107.20
2019-08-13 05:08:11,610 epoch 141 - iter 530/2650 - loss 0.31721748 throughput (samples/sec): 109.00
2019-08-13 05:09:30,632 epoch 141 - iter 795/2650 - loss 0.30808182 throughput (samples/sec): 107.36
2019-08-13 05:10:50,071 epoch 141 - iter 1060/2650 - loss 0.30943132 throughput (samples/sec): 106.80
2019-08-13 05:12:07,048 epoch 141 - iter 1325/2650 - loss 0.30971865 throughput (samples/sec): 110.22
2019-08-13 05:13:23,097 epoch 141 - iter 1590/2650 - loss 0.31004295 throughput (samples/sec): 111.56
2019-08-13 05:14:40,769 epoch 141 - iter 1855/2650 - loss 0.30893552 throughput (samples/sec): 109.23
2019-08-13 05:16:01,042 epoch 141 - iter 2120/2650 - loss 0.30736362 throughput (samples/sec): 105.69
2019-08-13 05:17:22,057 epoch 141 - iter 2385/2650 - loss 0.30968803 throughput (samples/sec): 104.72
2019-08-13 05:18:40,700 ----------------------------------------------------------------------------------------------------
2019-08-13 05:18:40,701 EPOCH 141 done: loss 0.3103 - lr 0.0250
2019-08-13 05:18:40,701 BAD EPOCHS (no improvement): 2
2019-08-13 05:18:40,701 ----------------------------------------------------------------------------------------------------
2019-08-13 05:18:40,966 epoch 142 - iter 0/2650 - loss 0.47928274 throughput (samples/sec): 32453.79
2019-08-13 05:20:00,331 epoch 142 - iter 265/2650 - loss 0.30141804 throughput (samples/sec): 106.90
2019-08-13 05:21:18,972 epoch 142 - iter 530/2650 - loss 0.29705521 throughput (samples/sec): 107.88
2019-08-13 05:22:37,471 epoch 142 - iter 795/2650 - loss 0.29804210 throughput (samples/sec): 108.08
2019-08-13 05:23:54,862 epoch 142 - iter 1060/2650 - loss 0.30102716 throughput (samples/sec): 109.62
2019-08-13 05:25:14,539 epoch 142 - iter 1325/2650 - loss 0.30079299 throughput (samples/sec): 106.48
2019-08-13 05:26:29,305 epoch 142 - iter 1590/2650 - loss 0.30189124 throughput (samples/sec): 113.47
2019-08-13 05:27:46,022 epoch 142 - iter 1855/2650 - loss 0.30188401 throughput (samples/sec): 110.59
2019-08-13 05:29:01,952 epoch 142 - iter 2120/2650 - loss 0.30550901 throughput (samples/sec): 111.73
2019-08-13 05:30:17,391 epoch 142 - iter 2385/2650 - loss 0.30564577 throughput (samples/sec): 112.46
2019-08-13 05:31:34,782 ----------------------------------------------------------------------------------------------------
2019-08-13 05:31:34,782 EPOCH 142 done: loss 0.3074 - lr 0.0250
2019-08-13 05:31:34,782 BAD EPOCHS (no improvement): 3
2019-08-13 05:31:34,783 ----------------------------------------------------------------------------------------------------
2019-08-13 05:31:35,160 epoch 143 - iter 0/2650 - loss 0.29889572 throughput (samples/sec): 22645.31
2019-08-13 05:32:51,934 epoch 143 - iter 265/2650 - loss 0.30353197 throughput (samples/sec): 110.51
2019-08-13 05:34:09,156 epoch 143 - iter 530/2650 - loss 0.29377279 throughput (samples/sec): 109.87
2019-08-13 05:35:28,853 epoch 143 - iter 795/2650 - loss 0.29172550 throughput (samples/sec): 106.45
2019-08-13 05:36:48,159 epoch 143 - iter 1060/2650 - loss 0.29000905 throughput (samples/sec): 106.98
2019-08-13 05:38:08,282 epoch 143 - iter 1325/2650 - loss 0.29342627 throughput (samples/sec): 105.89
2019-08-13 05:39:26,886 epoch 143 - iter 1590/2650 - loss 0.29479130 throughput (samples/sec): 107.93
2019-08-13 05:40:43,698 epoch 143 - iter 1855/2650 - loss 0.29681543 throughput (samples/sec): 110.45
2019-08-13 05:42:02,459 epoch 143 - iter 2120/2650 - loss 0.29868792 throughput (samples/sec): 107.72
2019-08-13 05:43:19,201 epoch 143 - iter 2385/2650 - loss 0.30106595 throughput (samples/sec): 110.55
2019-08-13 05:44:36,298 ----------------------------------------------------------------------------------------------------
2019-08-13 05:44:36,299 EPOCH 143 done: loss 0.3009 - lr 0.0250
2019-08-13 05:44:36,299 BAD EPOCHS (no improvement): 0
2019-08-13 05:44:36,299 ----------------------------------------------------------------------------------------------------
2019-08-13 05:44:36,579 epoch 144 - iter 0/2650 - loss 0.71012264 throughput (samples/sec): 30627.19
2019-08-13 05:45:51,931 epoch 144 - iter 265/2650 - loss 0.28998981 throughput (samples/sec): 112.59
2019-08-13 05:47:10,682 epoch 144 - iter 530/2650 - loss 0.29710360 throughput (samples/sec): 107.73
2019-08-13 05:48:28,121 epoch 144 - iter 795/2650 - loss 0.30472066 throughput (samples/sec): 109.56
2019-08-13 05:49:47,368 epoch 144 - iter 1060/2650 - loss 0.31072286 throughput (samples/sec): 107.06
2019-08-13 05:51:06,287 epoch 144 - iter 1325/2650 - loss 0.30888439 throughput (samples/sec): 107.50
2019-08-13 05:52:21,694 epoch 144 - iter 1590/2650 - loss 0.30492061 throughput (samples/sec): 112.51
2019-08-13 05:53:38,485 epoch 144 - iter 1855/2650 - loss 0.30562079 throughput (samples/sec): 110.48
2019-08-13 05:54:52,942 epoch 144 - iter 2120/2650 - loss 0.30560797 throughput (samples/sec): 113.95
2019-08-13 05:56:10,876 epoch 144 - iter 2385/2650 - loss 0.30503972 throughput (samples/sec): 108.86
2019-08-13 05:57:27,514 ----------------------------------------------------------------------------------------------------
2019-08-13 05:57:27,514 EPOCH 144 done: loss 0.3052 - lr 0.0250
2019-08-13 05:57:27,514 BAD EPOCHS (no improvement): 1
2019-08-13 05:57:27,514 ----------------------------------------------------------------------------------------------------
2019-08-13 05:57:27,772 epoch 145 - iter 0/2650 - loss 0.23452812 throughput (samples/sec): 33304.62
2019-08-13 05:58:47,761 epoch 145 - iter 265/2650 - loss 0.29066452 throughput (samples/sec): 106.06
2019-08-13 06:00:06,929 epoch 145 - iter 530/2650 - loss 0.28972454 throughput (samples/sec): 107.16
2019-08-13 06:01:27,164 epoch 145 - iter 795/2650 - loss 0.29703261 throughput (samples/sec): 105.74
2019-08-13 06:02:46,569 epoch 145 - iter 1060/2650 - loss 0.29688008 throughput (samples/sec): 106.84
2019-08-13 06:04:05,598 epoch 145 - iter 1325/2650 - loss 0.29557573 throughput (samples/sec): 107.35
2019-08-13 06:05:24,469 epoch 145 - iter 1590/2650 - loss 0.30036045 throughput (samples/sec): 107.57
2019-08-13 06:06:44,888 epoch 145 - iter 1855/2650 - loss 0.30111198 throughput (samples/sec): 105.50
2019-08-13 06:08:02,379 epoch 145 - iter 2120/2650 - loss 0.29910815 throughput (samples/sec): 109.48
2019-08-13 06:09:18,089 epoch 145 - iter 2385/2650 - loss 0.29911048 throughput (samples/sec): 112.06
2019-08-13 06:10:33,870 ----------------------------------------------------------------------------------------------------
2019-08-13 06:10:33,870 EPOCH 145 done: loss 0.2994 - lr 0.0250
2019-08-13 06:10:33,871 BAD EPOCHS (no improvement): 0
2019-08-13 06:10:33,871 ----------------------------------------------------------------------------------------------------
2019-08-13 06:10:34,146 epoch 146 - iter 0/2650 - loss 0.07220873 throughput (samples/sec): 31231.68
2019-08-13 06:11:51,901 epoch 146 - iter 265/2650 - loss 0.29327658 throughput (samples/sec): 109.11
2019-08-13 06:13:07,324 epoch 146 - iter 530/2650 - loss 0.29960048 throughput (samples/sec): 112.49
2019-08-13 06:14:24,075 epoch 146 - iter 795/2650 - loss 0.29041880 throughput (samples/sec): 110.54
2019-08-13 06:15:44,383 epoch 146 - iter 1060/2650 - loss 0.29766118 throughput (samples/sec): 105.64
2019-08-13 06:17:02,136 epoch 146 - iter 1325/2650 - loss 0.30260461 throughput (samples/sec): 109.12
2019-08-13 06:18:20,378 epoch 146 - iter 1590/2650 - loss 0.30638919 throughput (samples/sec): 108.43
2019-08-13 06:19:37,221 epoch 146 - iter 1855/2650 - loss 0.30467223 throughput (samples/sec): 110.41
2019-08-13 06:20:55,236 epoch 146 - iter 2120/2650 - loss 0.30511045 throughput (samples/sec): 108.75
2019-08-13 06:22:12,099 epoch 146 - iter 2385/2650 - loss 0.30735983 throughput (samples/sec): 110.38
2019-08-13 06:23:28,174 ----------------------------------------------------------------------------------------------------
2019-08-13 06:23:28,174 EPOCH 146 done: loss 0.3067 - lr 0.0250
2019-08-13 06:23:28,175 BAD EPOCHS (no improvement): 1
2019-08-13 06:23:28,175 ----------------------------------------------------------------------------------------------------
2019-08-13 06:23:28,466 epoch 147 - iter 0/2650 - loss 0.35490754 throughput (samples/sec): 29430.30
2019-08-13 06:24:46,348 epoch 147 - iter 265/2650 - loss 0.30495649 throughput (samples/sec): 108.94
2019-08-13 06:26:03,120 epoch 147 - iter 530/2650 - loss 0.30285173 throughput (samples/sec): 110.51
2019-08-13 06:27:21,356 epoch 147 - iter 795/2650 - loss 0.30676251 throughput (samples/sec): 108.44
2019-08-13 06:28:40,209 epoch 147 - iter 1060/2650 - loss 0.30680185 throughput (samples/sec): 107.59
2019-08-13 06:29:55,531 epoch 147 - iter 1325/2650 - loss 0.30495333 throughput (samples/sec): 112.64
2019-08-13 06:31:14,736 epoch 147 - iter 1590/2650 - loss 0.30728604 throughput (samples/sec): 107.11
2019-08-13 06:32:33,030 epoch 147 - iter 1855/2650 - loss 0.30608959 throughput (samples/sec): 108.36
2019-08-13 06:33:49,922 epoch 147 - iter 2120/2650 - loss 0.30434250 throughput (samples/sec): 110.34
2019-08-13 06:35:10,116 epoch 147 - iter 2385/2650 - loss 0.30289333 throughput (samples/sec): 105.79
2019-08-13 06:36:27,244 ----------------------------------------------------------------------------------------------------
2019-08-13 06:36:27,244 EPOCH 147 done: loss 0.3012 - lr 0.0250
2019-08-13 06:36:27,244 BAD EPOCHS (no improvement): 2
2019-08-13 06:36:27,245 ----------------------------------------------------------------------------------------------------
2019-08-13 06:36:27,589 epoch 148 - iter 0/2650 - loss 1.07586217 throughput (samples/sec): 24853.59
2019-08-13 06:37:46,471 epoch 148 - iter 265/2650 - loss 0.30825993 throughput (samples/sec): 107.55
2019-08-13 06:39:04,609 epoch 148 - iter 530/2650 - loss 0.29666138 throughput (samples/sec): 108.58
2019-08-13 06:40:24,287 epoch 148 - iter 795/2650 - loss 0.29646969 throughput (samples/sec): 106.48
2019-08-13 06:41:44,065 epoch 148 - iter 1060/2650 - loss 0.30017373 throughput (samples/sec): 106.34
2019-08-13 06:43:00,974 epoch 148 - iter 1325/2650 - loss 0.30015820 throughput (samples/sec): 110.31
2019-08-13 06:44:15,236 epoch 148 - iter 1590/2650 - loss 0.29985909 throughput (samples/sec): 114.25
2019-08-13 06:45:33,684 epoch 148 - iter 1855/2650 - loss 0.29944590 throughput (samples/sec): 108.15
2019-08-13 06:46:53,155 epoch 148 - iter 2120/2650 - loss 0.30121082 throughput (samples/sec): 106.76
2019-08-13 06:48:13,555 epoch 148 - iter 2385/2650 - loss 0.29878348 throughput (samples/sec): 105.52
2019-08-13 06:49:30,570 ----------------------------------------------------------------------------------------------------
2019-08-13 06:49:30,571 EPOCH 148 done: loss 0.2984 - lr 0.0250
2019-08-13 06:49:30,571 BAD EPOCHS (no improvement): 0
2019-08-13 06:49:30,571 ----------------------------------------------------------------------------------------------------
2019-08-13 06:49:30,790 epoch 149 - iter 0/2650 - loss 0.16163969 throughput (samples/sec): 39323.79
2019-08-13 06:50:49,250 epoch 149 - iter 265/2650 - loss 0.31946356 throughput (samples/sec): 108.13
2019-08-13 06:52:10,245 epoch 149 - iter 530/2650 - loss 0.30288867 throughput (samples/sec): 104.74
2019-08-13 06:53:28,668 epoch 149 - iter 795/2650 - loss 0.30563707 throughput (samples/sec): 108.18
2019-08-13 06:54:46,474 epoch 149 - iter 1060/2650 - loss 0.30489216 throughput (samples/sec): 109.04
2019-08-13 06:56:01,492 epoch 149 - iter 1325/2650 - loss 0.30405882 throughput (samples/sec): 113.10
2019-08-13 06:57:18,121 epoch 149 - iter 1590/2650 - loss 0.30284805 throughput (samples/sec): 110.71
2019-08-13 06:58:38,803 epoch 149 - iter 1855/2650 - loss 0.30508024 throughput (samples/sec): 105.15
2019-08-13 06:59:53,961 epoch 149 - iter 2120/2650 - loss 0.30439189 throughput (samples/sec): 112.88
2019-08-13 07:01:08,393 epoch 149 - iter 2385/2650 - loss 0.30257349 throughput (samples/sec): 113.98
2019-08-13 07:02:25,303 ----------------------------------------------------------------------------------------------------
2019-08-13 07:02:25,303 EPOCH 149 done: loss 0.3022 - lr 0.0250
2019-08-13 07:02:25,303 BAD EPOCHS (no improvement): 1
2019-08-13 07:02:25,303 ----------------------------------------------------------------------------------------------------
2019-08-13 07:02:25,635 epoch 150 - iter 0/2650 - loss 0.49415582 throughput (samples/sec): 25770.11
2019-08-13 07:03:43,270 epoch 150 - iter 265/2650 - loss 0.31351270 throughput (samples/sec): 109.28
2019-08-13 07:04:59,482 epoch 150 - iter 530/2650 - loss 0.29610182 throughput (samples/sec): 111.32
2019-08-13 07:06:17,201 epoch 150 - iter 795/2650 - loss 0.29829859 throughput (samples/sec): 109.16
2019-08-13 07:07:34,150 epoch 150 - iter 1060/2650 - loss 0.30257288 throughput (samples/sec): 110.26
2019-08-13 07:08:51,725 epoch 150 - iter 1325/2650 - loss 0.30061251 throughput (samples/sec): 109.37
2019-08-13 07:10:09,721 epoch 150 - iter 1590/2650 - loss 0.30167634 throughput (samples/sec): 108.78
2019-08-13 07:11:27,726 epoch 150 - iter 1855/2650 - loss 0.30252096 throughput (samples/sec): 108.76
2019-08-13 07:12:45,338 epoch 150 - iter 2120/2650 - loss 0.30047910 throughput (samples/sec): 109.32
2019-08-13 07:14:02,864 epoch 150 - iter 2385/2650 - loss 0.30055780 throughput (samples/sec): 109.44
2019-08-13 07:15:20,775 ----------------------------------------------------------------------------------------------------
2019-08-13 07:15:20,775 EPOCH 150 done: loss 0.3021 - lr 0.0250
2019-08-13 07:15:20,775 BAD EPOCHS (no improvement): 2
2019-08-13 07:15:35,547 ----------------------------------------------------------------------------------------------------
2019-08-13 07:15:35,550 Testing using best model ...
2019-08-13 07:15:35,550 loading file resources/taggers/release-ner-ontonotes-fast-0/best-model.pt
2019-08-13 07:22:50,620 0.0567	0.0021	0.004
2019-08-13 07:22:50,620 
MICRO_AVG: acc 0.0021 - f1-score 0.004
MACRO_AVG: acc 0.0006 - f1-score 0.0011555555555555555
CARDINAL   tp: 0 - fp: 0 - fn: 935 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
DATE       tp: 0 - fp: 0 - fn: 1602 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
EVENT      tp: 0 - fp: 78 - fn: 63 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
FAC        tp: 0 - fp: 10 - fn: 135 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
GPE        tp: 0 - fp: 0 - fn: 2240 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
LANGUAGE   tp: 0 - fp: 1 - fn: 22 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
LAW        tp: 0 - fp: 0 - fn: 40 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
LOC        tp: 0 - fp: 8 - fn: 179 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
MONEY      tp: 0 - fp: 0 - fn: 314 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
NORP       tp: 0 - fp: 0 - fn: 841 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
ORDINAL    tp: 0 - fp: 3 - fn: 195 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
ORG        tp: 0 - fp: 0 - fn: 1795 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
PERCENT    tp: 0 - fp: 0 - fn: 349 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
PERSON     tp: 24 - fp: 298 - fn: 1964 - tn: 24 - precision: 0.0745 - recall: 0.0121 - accuracy: 0.0105 - f1-score: 0.0208
PRODUCT    tp: 0 - fp: 0 - fn: 76 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
QUANTITY   tp: 0 - fp: 0 - fn: 105 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
TIME       tp: 0 - fp: 1 - fn: 212 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
WORK_OF_ART tp: 0 - fp: 0 - fn: 166 - tn: 0 - precision: 0.0000 - recall: 0.0000 - accuracy: 0.0000 - f1-score: 0.0000
2019-08-13 07:22:50,620 ----------------------------------------------------------------------------------------------------