2019-08-13 12:32:04,635 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,635 Model: "SequenceTagger(
  (embeddings): StackedEmbeddings(
    (list_embedding_0): WordEmbeddings('de')
    (list_embedding_1): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.25)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
    (list_embedding_2): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.25)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=275, bias=True)
      )
    )
  )
  (word_dropout): WordDropout(p=0.05)
  (locked_dropout): LockedDropout(p=0.5)
  (embedding2nn): Linear(in_features=4396, out_features=4396, bias=True)
  (rnn): LSTM(4396, 256, bidirectional=True)
  (linear): Linear(in_features=512, out_features=20, bias=True)
)"
2019-08-13 12:32:04,635 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,635 Corpus: "Corpus: 12705 train + 3068 dev + 3160 test sentences"
2019-08-13 12:32:04,635 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,636 Parameters:
2019-08-13 12:32:04,636  - learning_rate: "0.1"
2019-08-13 12:32:04,636  - mini_batch_size: "32"
2019-08-13 12:32:04,636  - patience: "3"
2019-08-13 12:32:04,636  - anneal_factor: "0.5"
2019-08-13 12:32:04,636  - max_epochs: "150"
2019-08-13 12:32:04,636  - shuffle: "True"
2019-08-13 12:32:04,636  - train_with_dev: "True"
2019-08-13 12:32:04,636 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,636 Model training base path: "resources/taggers/release-de-ner-0"
2019-08-13 12:32:04,636 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,636 Device: cuda:0
2019-08-13 12:32:04,636 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,636 Embeddings storage mode: cpu
2019-08-13 12:32:04,637 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:05,002 epoch 1 - iter 0/493 - loss 54.26176834 throughput (samples/sec): 4310.35
2019-08-13 12:32:22,722 epoch 1 - iter 49/493 - loss 7.45197087 throughput (samples/sec): 88.63
2019-08-13 12:32:39,642 epoch 1 - iter 98/493 - loss 5.35501018 throughput (samples/sec): 92.81
2019-08-13 12:32:56,921 epoch 1 - iter 147/493 - loss 4.46123171 throughput (samples/sec): 90.88
2019-08-13 12:33:15,161 epoch 1 - iter 196/493 - loss 3.99668761 throughput (samples/sec): 86.08
2019-08-13 12:33:32,264 epoch 1 - iter 245/493 - loss 3.62682699 throughput (samples/sec): 91.81
2019-08-13 12:33:49,212 epoch 1 - iter 294/493 - loss 3.36890697 throughput (samples/sec): 92.65
2019-08-13 12:34:06,778 epoch 1 - iter 343/493 - loss 3.13436045 throughput (samples/sec): 89.39
2019-08-13 12:34:23,850 epoch 1 - iter 392/493 - loss 2.95560552 throughput (samples/sec): 91.98
2019-08-13 12:34:41,648 epoch 1 - iter 441/493 - loss 2.80974939 throughput (samples/sec): 88.23
2019-08-13 12:34:58,255 epoch 1 - iter 490/493 - loss 2.67589358 throughput (samples/sec): 94.56
2019-08-13 12:34:58,930 ----------------------------------------------------------------------------------------------------
2019-08-13 12:34:58,930 EPOCH 1 done: loss 2.6698 - lr 0.1000
2019-08-13 12:34:58,930 BAD EPOCHS (no improvement): 0
2019-08-13 12:34:58,930 ----------------------------------------------------------------------------------------------------
2019-08-13 12:34:59,091 epoch 2 - iter 0/493 - loss 0.76706958 throughput (samples/sec): 9829.99
2019-08-13 12:35:07,690 epoch 2 - iter 49/493 - loss 1.51093387 throughput (samples/sec): 182.85
2019-08-13 12:35:15,948 epoch 2 - iter 98/493 - loss 1.41661072 throughput (samples/sec): 190.44
2019-08-13 12:35:24,418 epoch 2 - iter 147/493 - loss 1.41566149 throughput (samples/sec): 185.65
2019-08-13 12:35:33,280 epoch 2 - iter 196/493 - loss 1.37155719 throughput (samples/sec): 177.43
2019-08-13 12:35:41,834 epoch 2 - iter 245/493 - loss 1.33758969 throughput (samples/sec): 183.83
2019-08-13 12:35:50,704 epoch 2 - iter 294/493 - loss 1.31382119 throughput (samples/sec): 177.25
2019-08-13 12:35:59,355 epoch 2 - iter 343/493 - loss 1.31247403 throughput (samples/sec): 181.77
2019-08-13 12:36:07,940 epoch 2 - iter 392/493 - loss 1.30388578 throughput (samples/sec): 183.18
2019-08-13 12:36:16,363 epoch 2 - iter 441/493 - loss 1.28779204 throughput (samples/sec): 186.68
2019-08-13 12:36:24,816 epoch 2 - iter 490/493 - loss 1.27199390 throughput (samples/sec): 186.05
2019-08-13 12:36:25,139 ----------------------------------------------------------------------------------------------------
2019-08-13 12:36:25,140 EPOCH 2 done: loss 1.2692 - lr 0.1000
2019-08-13 12:36:25,140 BAD EPOCHS (no improvement): 0
2019-08-13 12:36:25,140 ----------------------------------------------------------------------------------------------------
2019-08-13 12:36:25,379 epoch 3 - iter 0/493 - loss 1.37894988 throughput (samples/sec): 6594.35
2019-08-13 12:36:33,697 epoch 3 - iter 49/493 - loss 0.92803166 throughput (samples/sec): 189.06
2019-08-13 12:36:42,319 epoch 3 - iter 98/493 - loss 0.97919962 throughput (samples/sec): 182.37
2019-08-13 12:36:50,881 epoch 3 - iter 147/493 - loss 0.99783048 throughput (samples/sec): 183.67
2019-08-13 12:36:59,507 epoch 3 - iter 196/493 - loss 1.01397427 throughput (samples/sec): 182.27
2019-08-13 12:37:07,794 epoch 3 - iter 245/493 - loss 1.02722099 throughput (samples/sec): 189.78
2019-08-13 12:37:16,226 epoch 3 - iter 294/493 - loss 1.03641229 throughput (samples/sec): 186.51
2019-08-13 12:37:25,391 epoch 3 - iter 343/493 - loss 1.04012836 throughput (samples/sec): 171.53
2019-08-13 12:37:33,858 epoch 3 - iter 392/493 - loss 1.04728730 throughput (samples/sec): 185.74
2019-08-13 12:37:42,325 epoch 3 - iter 441/493 - loss 1.04028466 throughput (samples/sec): 185.72
2019-08-13 12:37:50,538 epoch 3 - iter 490/493 - loss 1.02819106 throughput (samples/sec): 191.48
2019-08-13 12:37:50,939 ----------------------------------------------------------------------------------------------------
2019-08-13 12:37:50,939 EPOCH 3 done: loss 1.0290 - lr 0.1000
2019-08-13 12:37:50,940 BAD EPOCHS (no improvement): 0
2019-08-13 12:37:50,940 ----------------------------------------------------------------------------------------------------
2019-08-13 12:37:51,199 epoch 4 - iter 0/493 - loss 0.95010042 throughput (samples/sec): 6067.17
2019-08-13 12:37:59,555 epoch 4 - iter 49/493 - loss 0.97231739 throughput (samples/sec): 188.21
2019-08-13 12:38:07,891 epoch 4 - iter 98/493 - loss 0.94843789 throughput (samples/sec): 188.65
2019-08-13 12:38:16,163 epoch 4 - iter 147/493 - loss 0.95005666 throughput (samples/sec): 190.13
2019-08-13 12:38:24,360 epoch 4 - iter 196/493 - loss 0.95267116 throughput (samples/sec): 191.85
2019-08-13 12:38:32,910 epoch 4 - iter 245/493 - loss 0.94003162 throughput (samples/sec): 183.93
2019-08-13 12:38:41,576 epoch 4 - iter 294/493 - loss 0.93568471 throughput (samples/sec): 181.45
2019-08-13 12:38:50,284 epoch 4 - iter 343/493 - loss 0.94381094 throughput (samples/sec): 180.57
2019-08-13 12:38:59,150 epoch 4 - iter 392/493 - loss 0.93796248 throughput (samples/sec): 177.34
2019-08-13 12:39:07,813 epoch 4 - iter 441/493 - loss 0.93034963 throughput (samples/sec): 181.52
2019-08-13 12:39:16,118 epoch 4 - iter 490/493 - loss 0.91713963 throughput (samples/sec): 189.36
2019-08-13 12:39:16,442 ----------------------------------------------------------------------------------------------------
2019-08-13 12:39:16,442 EPOCH 4 done: loss 0.9181 - lr 0.1000
2019-08-13 12:39:16,442 BAD EPOCHS (no improvement): 0
2019-08-13 12:39:16,442 ----------------------------------------------------------------------------------------------------
2019-08-13 12:39:16,676 epoch 5 - iter 0/493 - loss 0.40530181 throughput (samples/sec): 6732.90
2019-08-13 12:39:25,166 epoch 5 - iter 49/493 - loss 0.77617888 throughput (samples/sec): 185.23
2019-08-13 12:39:33,691 epoch 5 - iter 98/493 - loss 0.82141250 throughput (samples/sec): 184.49
2019-08-13 12:39:41,947 epoch 5 - iter 147/493 - loss 0.81687266 throughput (samples/sec): 190.50
2019-08-13 12:39:50,711 epoch 5 - iter 196/493 - loss 0.83791401 throughput (samples/sec): 179.41
2019-08-13 12:39:59,161 epoch 5 - iter 245/493 - loss 0.83181124 throughput (samples/sec): 186.11
2019-08-13 12:40:07,719 epoch 5 - iter 294/493 - loss 0.81843559 throughput (samples/sec): 183.77
2019-08-13 12:40:16,298 epoch 5 - iter 343/493 - loss 0.82653269 throughput (samples/sec): 183.30
2019-08-13 12:40:25,060 epoch 5 - iter 392/493 - loss 0.82926182 throughput (samples/sec): 179.46
2019-08-13 12:40:33,458 epoch 5 - iter 441/493 - loss 0.82673526 throughput (samples/sec): 187.27
2019-08-13 12:40:42,591 epoch 5 - iter 490/493 - loss 0.82241585 throughput (samples/sec): 172.16
2019-08-13 12:40:42,969 ----------------------------------------------------------------------------------------------------
2019-08-13 12:40:42,969 EPOCH 5 done: loss 0.8248 - lr 0.1000
2019-08-13 12:40:42,969 BAD EPOCHS (no improvement): 0
2019-08-13 12:40:42,969 ----------------------------------------------------------------------------------------------------
2019-08-13 12:40:43,143 epoch 6 - iter 0/493 - loss 0.50501120 throughput (samples/sec): 9049.59
2019-08-13 12:40:51,763 epoch 6 - iter 49/493 - loss 0.71407561 throughput (samples/sec): 182.45
2019-08-13 12:41:00,057 epoch 6 - iter 98/493 - loss 0.73086807 throughput (samples/sec): 189.62
2019-08-13 12:41:08,922 epoch 6 - iter 147/493 - loss 0.73413194 throughput (samples/sec): 177.37
2019-08-13 12:41:17,507 epoch 6 - iter 196/493 - loss 0.73058960 throughput (samples/sec): 183.17
2019-08-13 12:41:26,334 epoch 6 - iter 245/493 - loss 0.74032093 throughput (samples/sec): 178.15
2019-08-13 12:41:34,903 epoch 6 - iter 294/493 - loss 0.74352049 throughput (samples/sec): 183.52
2019-08-13 12:41:43,879 epoch 6 - iter 343/493 - loss 0.74494216 throughput (samples/sec): 175.17
2019-08-13 12:41:52,321 epoch 6 - iter 392/493 - loss 0.73976617 throughput (samples/sec): 186.29
2019-08-13 12:42:00,804 epoch 6 - iter 441/493 - loss 0.73865017 throughput (samples/sec): 185.39
2019-08-13 12:42:09,205 epoch 6 - iter 490/493 - loss 0.74375257 throughput (samples/sec): 187.20
2019-08-13 12:42:09,642 ----------------------------------------------------------------------------------------------------
2019-08-13 12:42:09,642 EPOCH 6 done: loss 0.7447 - lr 0.1000
2019-08-13 12:42:09,642 BAD EPOCHS (no improvement): 0
2019-08-13 12:42:09,642 ----------------------------------------------------------------------------------------------------
2019-08-13 12:42:09,819 epoch 7 - iter 0/493 - loss 0.44779930 throughput (samples/sec): 8906.90
2019-08-13 12:42:18,149 epoch 7 - iter 49/493 - loss 0.63027719 throughput (samples/sec): 188.80
2019-08-13 12:42:26,706 epoch 7 - iter 98/493 - loss 0.65525659 throughput (samples/sec): 183.77
2019-08-13 12:42:35,406 epoch 7 - iter 147/493 - loss 0.65087047 throughput (samples/sec): 180.75
2019-08-13 12:42:44,303 epoch 7 - iter 196/493 - loss 0.65720450 throughput (samples/sec): 176.74
2019-08-13 12:42:52,987 epoch 7 - iter 245/493 - loss 0.67852709 throughput (samples/sec): 181.09
2019-08-13 12:43:01,680 epoch 7 - iter 294/493 - loss 0.69685003 throughput (samples/sec): 180.88
2019-08-13 12:43:10,552 epoch 7 - iter 343/493 - loss 0.70726457 throughput (samples/sec): 177.24
2019-08-13 12:43:19,337 epoch 7 - iter 392/493 - loss 0.71650480 throughput (samples/sec): 178.99
2019-08-13 12:43:27,661 epoch 7 - iter 441/493 - loss 0.71506937 throughput (samples/sec): 188.94
2019-08-13 12:43:36,245 epoch 7 - iter 490/493 - loss 0.71004307 throughput (samples/sec): 183.19
2019-08-13 12:43:36,605 ----------------------------------------------------------------------------------------------------
2019-08-13 12:43:36,605 EPOCH 7 done: loss 0.7093 - lr 0.1000
2019-08-13 12:43:36,605 BAD EPOCHS (no improvement): 0
2019-08-13 12:43:36,606 ----------------------------------------------------------------------------------------------------
2019-08-13 12:43:36,806 epoch 8 - iter 0/493 - loss 0.55670226 throughput (samples/sec): 7841.44
2019-08-13 12:43:45,371 epoch 8 - iter 49/493 - loss 0.71507860 throughput (samples/sec): 183.61
2019-08-13 12:43:53,980 epoch 8 - iter 98/493 - loss 0.69736152 throughput (samples/sec): 182.68
2019-08-13 12:44:02,630 epoch 8 - iter 147/493 - loss 0.66287554 throughput (samples/sec): 181.79
2019-08-13 12:44:11,021 epoch 8 - iter 196/493 - loss 0.66621195 throughput (samples/sec): 187.44
2019-08-13 12:44:19,903 epoch 8 - iter 245/493 - loss 0.66964139 throughput (samples/sec): 177.01
2019-08-13 12:44:28,241 epoch 8 - iter 294/493 - loss 0.65612812 throughput (samples/sec): 188.62
2019-08-13 12:44:36,554 epoch 8 - iter 343/493 - loss 0.66197763 throughput (samples/sec): 189.17
2019-08-13 12:44:45,299 epoch 8 - iter 392/493 - loss 0.65967419 throughput (samples/sec): 179.81
2019-08-13 12:44:53,926 epoch 8 - iter 441/493 - loss 0.65645194 throughput (samples/sec): 182.27
2019-08-13 12:45:02,536 epoch 8 - iter 490/493 - loss 0.65698342 throughput (samples/sec): 182.65
2019-08-13 12:45:02,932 ----------------------------------------------------------------------------------------------------
2019-08-13 12:45:02,932 EPOCH 8 done: loss 0.6563 - lr 0.1000
2019-08-13 12:45:02,932 BAD EPOCHS (no improvement): 0
2019-08-13 12:45:02,933 ----------------------------------------------------------------------------------------------------
2019-08-13 12:45:03,116 epoch 9 - iter 0/493 - loss 0.34088182 throughput (samples/sec): 8588.87
2019-08-13 12:45:11,911 epoch 9 - iter 49/493 - loss 0.57577198 throughput (samples/sec): 178.80
2019-08-13 12:45:20,420 epoch 9 - iter 98/493 - loss 0.63099662 throughput (samples/sec): 184.80
2019-08-13 12:45:28,576 epoch 9 - iter 147/493 - loss 0.66182153 throughput (samples/sec): 192.83
2019-08-13 12:45:37,338 epoch 9 - iter 196/493 - loss 0.65840089 throughput (samples/sec): 179.45
2019-08-13 12:45:45,872 epoch 9 - iter 245/493 - loss 0.65015057 throughput (samples/sec): 184.26
2019-08-13 12:45:54,660 epoch 9 - iter 294/493 - loss 0.64066794 throughput (samples/sec): 178.93
2019-08-13 12:46:02,897 epoch 9 - iter 343/493 - loss 0.63354588 throughput (samples/sec): 190.92
2019-08-13 12:46:11,736 epoch 9 - iter 392/493 - loss 0.63328888 throughput (samples/sec): 177.90
2019-08-13 12:46:20,071 epoch 9 - iter 441/493 - loss 0.62852250 throughput (samples/sec): 188.69
2019-08-13 12:46:28,853 epoch 9 - iter 490/493 - loss 0.63639676 throughput (samples/sec): 179.04
2019-08-13 12:46:29,164 ----------------------------------------------------------------------------------------------------
2019-08-13 12:46:29,164 EPOCH 9 done: loss 0.6375 - lr 0.1000
2019-08-13 12:46:29,164 BAD EPOCHS (no improvement): 0
2019-08-13 12:46:29,164 ----------------------------------------------------------------------------------------------------
2019-08-13 12:46:29,378 epoch 10 - iter 0/493 - loss 1.17763615 throughput (samples/sec): 7388.65
2019-08-13 12:46:37,576 epoch 10 - iter 49/493 - loss 0.61343721 throughput (samples/sec): 191.83
2019-08-13 12:46:46,521 epoch 10 - iter 98/493 - loss 0.65214093 throughput (samples/sec): 175.78
2019-08-13 12:46:54,978 epoch 10 - iter 147/493 - loss 0.64992781 throughput (samples/sec): 185.95
2019-08-13 12:47:03,348 epoch 10 - iter 196/493 - loss 0.62276273 throughput (samples/sec): 187.89
2019-08-13 12:47:12,369 epoch 10 - iter 245/493 - loss 0.60576585 throughput (samples/sec): 174.29
2019-08-13 12:47:21,007 epoch 10 - iter 294/493 - loss 0.60374692 throughput (samples/sec): 182.05
2019-08-13 12:47:29,640 epoch 10 - iter 343/493 - loss 0.60941950 throughput (samples/sec): 182.14
2019-08-13 12:47:38,468 epoch 10 - iter 392/493 - loss 0.61041994 throughput (samples/sec): 178.11
2019-08-13 12:47:46,474 epoch 10 - iter 441/493 - loss 0.60177990 throughput (samples/sec): 196.44
2019-08-13 12:47:54,821 epoch 10 - iter 490/493 - loss 0.59856470 throughput (samples/sec): 188.42
2019-08-13 12:47:55,257 ----------------------------------------------------------------------------------------------------
2019-08-13 12:47:55,257 EPOCH 10 done: loss 0.5986 - lr 0.1000
2019-08-13 12:47:55,257 BAD EPOCHS (no improvement): 0
2019-08-13 12:47:55,257 ----------------------------------------------------------------------------------------------------
2019-08-13 12:47:55,459 epoch 11 - iter 0/493 - loss 0.40001374 throughput (samples/sec): 7806.47
2019-08-13 12:48:03,706 epoch 11 - iter 49/493 - loss 0.61267841 throughput (samples/sec): 190.69
2019-08-13 12:48:11,890 epoch 11 - iter 98/493 - loss 0.56157616 throughput (samples/sec): 192.18
2019-08-13 12:48:20,381 epoch 11 - iter 147/493 - loss 0.58428185 throughput (samples/sec): 185.21
2019-08-13 12:48:28,835 epoch 11 - iter 196/493 - loss 0.57925224 throughput (samples/sec): 185.99
2019-08-13 12:48:37,697 epoch 11 - iter 245/493 - loss 0.58093671 throughput (samples/sec): 177.42
2019-08-13 12:48:46,098 epoch 11 - iter 294/493 - loss 0.57312300 throughput (samples/sec): 187.21
2019-08-13 12:48:55,173 epoch 11 - iter 343/493 - loss 0.56952645 throughput (samples/sec): 173.25
2019-08-13 12:49:03,757 epoch 11 - iter 392/493 - loss 0.57265007 throughput (samples/sec): 183.18
2019-08-13 12:49:12,226 epoch 11 - iter 441/493 - loss 0.56983325 throughput (samples/sec): 185.68
2019-08-13 12:49:20,590 epoch 11 - iter 490/493 - loss 0.57083138 throughput (samples/sec): 188.02
2019-08-13 12:49:21,030 ----------------------------------------------------------------------------------------------------
2019-08-13 12:49:21,030 EPOCH 11 done: loss 0.5703 - lr 0.1000
2019-08-13 12:49:21,031 BAD EPOCHS (no improvement): 0
2019-08-13 12:49:21,031 ----------------------------------------------------------------------------------------------------
2019-08-13 12:49:21,191 epoch 12 - iter 0/493 - loss 0.30076072 throughput (samples/sec): 9864.91
2019-08-13 12:49:29,450 epoch 12 - iter 49/493 - loss 0.52239391 throughput (samples/sec): 190.41
2019-08-13 12:49:38,341 epoch 12 - iter 98/493 - loss 0.50880695 throughput (samples/sec): 176.85
2019-08-13 12:49:47,117 epoch 12 - iter 147/493 - loss 0.51691063 throughput (samples/sec): 179.16
2019-08-13 12:49:55,510 epoch 12 - iter 196/493 - loss 0.51442245 throughput (samples/sec): 187.36
2019-08-13 12:50:03,606 epoch 12 - iter 245/493 - loss 0.51535880 throughput (samples/sec): 194.26
2019-08-13 12:50:12,164 epoch 12 - iter 294/493 - loss 0.51586441 throughput (samples/sec): 183.75
2019-08-13 12:50:20,795 epoch 12 - iter 343/493 - loss 0.53167867 throughput (samples/sec): 182.18
2019-08-13 12:50:29,016 epoch 12 - iter 392/493 - loss 0.52993897 throughput (samples/sec): 191.29
2019-08-13 12:50:37,835 epoch 12 - iter 441/493 - loss 0.53592643 throughput (samples/sec): 178.30
2019-08-13 12:50:46,242 epoch 12 - iter 490/493 - loss 0.53424985 throughput (samples/sec): 187.05
2019-08-13 12:50:46,557 ----------------------------------------------------------------------------------------------------
2019-08-13 12:50:46,557 EPOCH 12 done: loss 0.5344 - lr 0.1000
2019-08-13 12:50:46,557 BAD EPOCHS (no improvement): 0
2019-08-13 12:50:46,557 ----------------------------------------------------------------------------------------------------
2019-08-13 12:50:46,716 epoch 13 - iter 0/493 - loss 0.26164722 throughput (samples/sec): 9960.11
2019-08-13 12:50:55,432 epoch 13 - iter 49/493 - loss 0.51347062 throughput (samples/sec): 180.40
2019-08-13 12:51:03,731 epoch 13 - iter 98/493 - loss 0.48566931 throughput (samples/sec): 189.50
2019-08-13 12:51:12,031 epoch 13 - iter 147/493 - loss 0.49598219 throughput (samples/sec): 189.46
2019-08-13 12:51:20,615 epoch 13 - iter 196/493 - loss 0.50574423 throughput (samples/sec): 183.19
2019-08-13 12:51:28,946 epoch 13 - iter 245/493 - loss 0.51728363 throughput (samples/sec): 188.77
2019-08-13 12:51:37,467 epoch 13 - iter 294/493 - loss 0.51348137 throughput (samples/sec): 184.54
2019-08-13 12:51:45,928 epoch 13 - iter 343/493 - loss 0.51554829 throughput (samples/sec): 185.85
2019-08-13 12:51:54,550 epoch 13 - iter 392/493 - loss 0.50950089 throughput (samples/sec): 182.39
2019-08-13 12:52:03,104 epoch 13 - iter 441/493 - loss 0.50970429 throughput (samples/sec): 183.81
2019-08-13 12:52:11,967 epoch 13 - iter 490/493 - loss 0.50798532 throughput (samples/sec): 177.41
2019-08-13 12:52:12,289 ----------------------------------------------------------------------------------------------------
2019-08-13 12:52:12,289 EPOCH 13 done: loss 0.5080 - lr 0.1000
2019-08-13 12:52:12,289 BAD EPOCHS (no improvement): 0
2019-08-13 12:52:12,290 ----------------------------------------------------------------------------------------------------
2019-08-13 12:52:12,461 epoch 14 - iter 0/493 - loss 0.25025496 throughput (samples/sec): 9204.06
2019-08-13 12:52:20,833 epoch 14 - iter 49/493 - loss 0.49328938 throughput (samples/sec): 187.82
2019-08-13 12:52:29,257 epoch 14 - iter 98/493 - loss 0.51575155 throughput (samples/sec): 186.67
2019-08-13 12:52:37,941 epoch 14 - iter 147/493 - loss 0.51655991 throughput (samples/sec): 181.08
2019-08-13 12:52:46,385 epoch 14 - iter 196/493 - loss 0.51616147 throughput (samples/sec): 186.23
2019-08-13 12:52:55,673 epoch 14 - iter 245/493 - loss 0.52890858 throughput (samples/sec): 169.25
2019-08-13 12:53:04,148 epoch 14 - iter 294/493 - loss 0.51594853 throughput (samples/sec): 185.56
2019-08-13 12:53:12,600 epoch 14 - iter 343/493 - loss 0.51501712 throughput (samples/sec): 186.04
2019-08-13 12:53:21,118 epoch 14 - iter 392/493 - loss 0.51036988 throughput (samples/sec): 184.61
2019-08-13 12:53:29,778 epoch 14 - iter 441/493 - loss 0.50188980 throughput (samples/sec): 181.58
2019-08-13 12:53:37,973 epoch 14 - iter 490/493 - loss 0.50366245 throughput (samples/sec): 191.90
2019-08-13 12:53:38,310 ----------------------------------------------------------------------------------------------------
2019-08-13 12:53:38,310 EPOCH 14 done: loss 0.5055 - lr 0.1000
2019-08-13 12:53:38,310 BAD EPOCHS (no improvement): 0
2019-08-13 12:53:38,311 ----------------------------------------------------------------------------------------------------
2019-08-13 12:53:38,497 epoch 15 - iter 0/493 - loss 0.65806317 throughput (samples/sec): 8455.69
2019-08-13 12:53:46,838 epoch 15 - iter 49/493 - loss 0.45747295 throughput (samples/sec): 188.54
2019-08-13 12:53:55,103 epoch 15 - iter 98/493 - loss 0.47279819 throughput (samples/sec): 190.27
2019-08-13 12:54:03,639 epoch 15 - iter 147/493 - loss 0.47034463 throughput (samples/sec): 184.21
2019-08-13 12:54:12,500 epoch 15 - iter 196/493 - loss 0.47543002 throughput (samples/sec): 177.45
2019-08-13 12:54:20,793 epoch 15 - iter 245/493 - loss 0.47646426 throughput (samples/sec): 189.63
2019-08-13 12:54:29,529 epoch 15 - iter 294/493 - loss 0.48043800 throughput (samples/sec): 179.98
2019-08-13 12:54:38,246 epoch 15 - iter 343/493 - loss 0.48243843 throughput (samples/sec): 180.38
2019-08-13 12:54:47,186 epoch 15 - iter 392/493 - loss 0.48056209 throughput (samples/sec): 175.87
2019-08-13 12:54:55,434 epoch 15 - iter 441/493 - loss 0.47781509 throughput (samples/sec): 190.68
2019-08-13 12:55:03,749 epoch 15 - iter 490/493 - loss 0.48123861 throughput (samples/sec): 189.12
2019-08-13 12:55:04,132 ----------------------------------------------------------------------------------------------------
2019-08-13 12:55:04,133 EPOCH 15 done: loss 0.4813 - lr 0.1000
2019-08-13 12:55:04,133 BAD EPOCHS (no improvement): 0
2019-08-13 12:55:04,133 ----------------------------------------------------------------------------------------------------
2019-08-13 12:55:04,284 epoch 16 - iter 0/493 - loss 0.32113385 throughput (samples/sec): 10463.07
2019-08-13 12:55:12,708 epoch 16 - iter 49/493 - loss 0.42261627 throughput (samples/sec): 186.68
2019-08-13 12:55:21,294 epoch 16 - iter 98/493 - loss 0.44550598 throughput (samples/sec): 183.16
2019-08-13 12:55:29,794 epoch 16 - iter 147/493 - loss 0.45848858 throughput (samples/sec): 185.00
2019-08-13 12:55:38,239 epoch 16 - iter 196/493 - loss 0.45489328 throughput (samples/sec): 186.20
2019-08-13 12:55:46,948 epoch 16 - iter 245/493 - loss 0.44736206 throughput (samples/sec): 180.57
2019-08-13 12:55:55,667 epoch 16 - iter 294/493 - loss 0.44605506 throughput (samples/sec): 180.32
2019-08-13 12:56:04,091 epoch 16 - iter 343/493 - loss 0.44256951 throughput (samples/sec): 186.68
2019-08-13 12:56:12,362 epoch 16 - iter 392/493 - loss 0.45432907 throughput (samples/sec): 190.14
2019-08-13 12:56:21,196 epoch 16 - iter 441/493 - loss 0.45926406 throughput (samples/sec): 177.99
2019-08-13 12:56:30,036 epoch 16 - iter 490/493 - loss 0.46217313 throughput (samples/sec): 177.87
2019-08-13 12:56:30,339 ----------------------------------------------------------------------------------------------------
2019-08-13 12:56:30,339 EPOCH 16 done: loss 0.4617 - lr 0.1000
2019-08-13 12:56:30,339 BAD EPOCHS (no improvement): 0
2019-08-13 12:56:30,339 ----------------------------------------------------------------------------------------------------
2019-08-13 12:56:30,479 epoch 17 - iter 0/493 - loss 0.45685747 throughput (samples/sec): 11265.08
2019-08-13 12:56:39,201 epoch 17 - iter 49/493 - loss 0.45634410 throughput (samples/sec): 180.28
2019-08-13 12:56:47,752 epoch 17 - iter 98/493 - loss 0.45014080 throughput (samples/sec): 183.90
2019-08-13 12:56:56,485 epoch 17 - iter 147/493 - loss 0.44057460 throughput (samples/sec): 180.04
2019-08-13 12:57:05,508 epoch 17 - iter 196/493 - loss 0.44643217 throughput (samples/sec): 174.25
2019-08-13 12:57:13,826 epoch 17 - iter 245/493 - loss 0.45872864 throughput (samples/sec): 189.06
2019-08-13 12:57:22,073 epoch 17 - iter 294/493 - loss 0.45752462 throughput (samples/sec): 190.70
2019-08-13 12:57:30,289 epoch 17 - iter 343/493 - loss 0.45096910 throughput (samples/sec): 191.42
2019-08-13 12:57:38,794 epoch 17 - iter 392/493 - loss 0.44406229 throughput (samples/sec): 184.88
2019-08-13 12:57:47,307 epoch 17 - iter 441/493 - loss 0.44404171 throughput (samples/sec): 184.73
2019-08-13 12:57:55,599 epoch 17 - iter 490/493 - loss 0.44512019 throughput (samples/sec): 189.64
2019-08-13 12:57:55,977 ----------------------------------------------------------------------------------------------------
2019-08-13 12:57:55,977 EPOCH 17 done: loss 0.4455 - lr 0.1000
2019-08-13 12:57:55,977 BAD EPOCHS (no improvement): 0
2019-08-13 12:57:55,977 ----------------------------------------------------------------------------------------------------
2019-08-13 12:57:56,138 epoch 18 - iter 0/493 - loss 0.83245289 throughput (samples/sec): 9807.36
2019-08-13 12:58:04,769 epoch 18 - iter 49/493 - loss 0.43407969 throughput (samples/sec): 182.18
2019-08-13 12:58:13,572 epoch 18 - iter 98/493 - loss 0.41251757 throughput (samples/sec): 178.62
2019-08-13 12:58:21,956 epoch 18 - iter 147/493 - loss 0.41424506 throughput (samples/sec): 187.56
2019-08-13 12:58:30,889 epoch 18 - iter 196/493 - loss 0.39679573 throughput (samples/sec): 176.02
2019-08-13 12:58:39,360 epoch 18 - iter 245/493 - loss 0.41381138 throughput (samples/sec): 185.62
2019-08-13 12:58:47,827 epoch 18 - iter 294/493 - loss 0.42376393 throughput (samples/sec): 185.73
2019-08-13 12:58:56,084 epoch 18 - iter 343/493 - loss 0.42191917 throughput (samples/sec): 190.46
2019-08-13 12:59:04,895 epoch 18 - iter 392/493 - loss 0.42249173 throughput (samples/sec): 178.46
2019-08-13 12:59:13,104 epoch 18 - iter 441/493 - loss 0.42190314 throughput (samples/sec): 191.58
2019-08-13 12:59:21,436 epoch 18 - iter 490/493 - loss 0.42838264 throughput (samples/sec): 188.74
2019-08-13 12:59:21,750 ----------------------------------------------------------------------------------------------------
2019-08-13 12:59:21,751 EPOCH 18 done: loss 0.4287 - lr 0.1000
2019-08-13 12:59:21,751 BAD EPOCHS (no improvement): 0
2019-08-13 12:59:21,751 ----------------------------------------------------------------------------------------------------
2019-08-13 12:59:21,906 epoch 19 - iter 0/493 - loss 0.32538933 throughput (samples/sec): 10170.31
2019-08-13 12:59:30,553 epoch 19 - iter 49/493 - loss 0.43862224 throughput (samples/sec): 181.87
2019-08-13 12:59:39,195 epoch 19 - iter 98/493 - loss 0.40404903 throughput (samples/sec): 181.95
2019-08-13 12:59:47,506 epoch 19 - iter 147/493 - loss 0.40339020 throughput (samples/sec): 189.21
2019-08-13 12:59:56,230 epoch 19 - iter 196/493 - loss 0.40988937 throughput (samples/sec): 180.23
2019-08-13 13:00:04,481 epoch 19 - iter 245/493 - loss 0.41370059 throughput (samples/sec): 190.60
2019-08-13 13:00:13,266 epoch 19 - iter 294/493 - loss 0.41817647 throughput (samples/sec): 179.00
2019-08-13 13:00:21,587 epoch 19 - iter 343/493 - loss 0.41435126 throughput (samples/sec): 188.99
2019-08-13 13:00:30,016 epoch 19 - iter 392/493 - loss 0.41686264 throughput (samples/sec): 186.56
2019-08-13 13:00:38,613 epoch 19 - iter 441/493 - loss 0.41744207 throughput (samples/sec): 182.90
2019-08-13 13:00:47,305 epoch 19 - iter 490/493 - loss 0.41547419 throughput (samples/sec): 180.90
2019-08-13 13:00:47,698 ----------------------------------------------------------------------------------------------------
2019-08-13 13:00:47,698 EPOCH 19 done: loss 0.4173 - lr 0.1000
2019-08-13 13:00:47,698 BAD EPOCHS (no improvement): 0
2019-08-13 13:00:47,699 ----------------------------------------------------------------------------------------------------
2019-08-13 13:00:47,906 epoch 20 - iter 0/493 - loss 0.37347433 throughput (samples/sec): 7602.44
2019-08-13 13:00:56,391 epoch 20 - iter 49/493 - loss 0.44384164 throughput (samples/sec): 185.33
2019-08-13 13:01:05,284 epoch 20 - iter 98/493 - loss 0.41577730 throughput (samples/sec): 176.80
2019-08-13 13:01:13,693 epoch 20 - iter 147/493 - loss 0.39876110 throughput (samples/sec): 187.00
2019-08-13 13:01:22,157 epoch 20 - iter 196/493 - loss 0.38109033 throughput (samples/sec): 185.79
2019-08-13 13:01:30,654 epoch 20 - iter 245/493 - loss 0.38249509 throughput (samples/sec): 185.06
2019-08-13 13:01:39,264 epoch 20 - iter 294/493 - loss 0.37667877 throughput (samples/sec): 182.63
2019-08-13 13:01:47,989 epoch 20 - iter 343/493 - loss 0.38357111 throughput (samples/sec): 180.21
2019-08-13 13:01:56,767 epoch 20 - iter 392/493 - loss 0.39134447 throughput (samples/sec): 179.14
2019-08-13 13:02:05,338 epoch 20 - iter 441/493 - loss 0.39523744 throughput (samples/sec): 183.46
2019-08-13 13:02:14,015 epoch 20 - iter 490/493 - loss 0.39552516 throughput (samples/sec): 181.20
2019-08-13 13:02:14,395 ----------------------------------------------------------------------------------------------------
2019-08-13 13:02:14,395 EPOCH 20 done: loss 0.3959 - lr 0.1000
2019-08-13 13:02:14,396 BAD EPOCHS (no improvement): 0
2019-08-13 13:02:14,396 ----------------------------------------------------------------------------------------------------
2019-08-13 13:02:14,609 epoch 21 - iter 0/493 - loss 0.15595460 throughput (samples/sec): 7374.41
2019-08-13 13:02:22,910 epoch 21 - iter 49/493 - loss 0.40143904 throughput (samples/sec): 189.45
2019-08-13 13:02:31,462 epoch 21 - iter 98/493 - loss 0.37842845 throughput (samples/sec): 183.88
2019-08-13 13:02:39,642 epoch 21 - iter 147/493 - loss 0.38100905 throughput (samples/sec): 192.26
2019-08-13 13:02:48,215 epoch 21 - iter 196/493 - loss 0.37830083 throughput (samples/sec): 183.41
2019-08-13 13:02:56,474 epoch 21 - iter 245/493 - loss 0.37267664 throughput (samples/sec): 190.43
2019-08-13 13:03:05,541 epoch 21 - iter 294/493 - loss 0.36998370 throughput (samples/sec): 173.39
2019-08-13 13:03:14,453 epoch 21 - iter 343/493 - loss 0.37208267 throughput (samples/sec): 176.44
2019-08-13 13:03:22,885 epoch 21 - iter 392/493 - loss 0.37520443 throughput (samples/sec): 186.50
2019-08-13 13:03:31,538 epoch 21 - iter 441/493 - loss 0.37833698 throughput (samples/sec): 181.71
2019-08-13 13:03:40,169 epoch 21 - iter 490/493 - loss 0.38408806 throughput (samples/sec): 182.19
2019-08-13 13:03:40,580 ----------------------------------------------------------------------------------------------------
2019-08-13 13:03:40,580 EPOCH 21 done: loss 0.3835 - lr 0.1000
2019-08-13 13:03:40,580 BAD EPOCHS (no improvement): 0
2019-08-13 13:03:40,580 ----------------------------------------------------------------------------------------------------
2019-08-13 13:03:40,773 epoch 22 - iter 0/493 - loss 0.38031760 throughput (samples/sec): 8171.53
2019-08-13 13:03:49,158 epoch 22 - iter 49/493 - loss 0.40760530 throughput (samples/sec): 187.56
2019-08-13 13:03:58,171 epoch 22 - iter 98/493 - loss 0.37243043 throughput (samples/sec): 174.45
2019-08-13 13:04:07,200 epoch 22 - iter 147/493 - loss 0.37348899 throughput (samples/sec): 174.13
2019-08-13 13:04:15,717 epoch 22 - iter 196/493 - loss 0.36647534 throughput (samples/sec): 184.62
2019-08-13 13:04:24,123 epoch 22 - iter 245/493 - loss 0.36709750 throughput (samples/sec): 187.08
2019-08-13 13:04:32,431 epoch 22 - iter 294/493 - loss 0.37094147 throughput (samples/sec): 189.28
2019-08-13 13:04:41,066 epoch 22 - iter 343/493 - loss 0.37385356 throughput (samples/sec): 182.11
2019-08-13 13:04:49,091 epoch 22 - iter 392/493 - loss 0.37620894 throughput (samples/sec): 195.97
2019-08-13 13:04:57,781 epoch 22 - iter 441/493 - loss 0.37425201 throughput (samples/sec): 180.96
2019-08-13 13:05:06,163 epoch 22 - iter 490/493 - loss 0.37290107 throughput (samples/sec): 187.62
2019-08-13 13:05:06,522 ----------------------------------------------------------------------------------------------------
2019-08-13 13:05:06,523 EPOCH 22 done: loss 0.3729 - lr 0.1000
2019-08-13 13:05:06,523 BAD EPOCHS (no improvement): 0
2019-08-13 13:05:06,523 ----------------------------------------------------------------------------------------------------
2019-08-13 13:05:06,690 epoch 23 - iter 0/493 - loss 0.16041324 throughput (samples/sec): 9430.01
2019-08-13 13:05:15,480 epoch 23 - iter 49/493 - loss 0.34254282 throughput (samples/sec): 178.90
2019-08-13 13:05:23,959 epoch 23 - iter 98/493 - loss 0.34425312 throughput (samples/sec): 185.46
2019-08-13 13:05:32,099 epoch 23 - iter 147/493 - loss 0.35516957 throughput (samples/sec): 193.20
2019-08-13 13:05:40,887 epoch 23 - iter 196/493 - loss 0.36130304 throughput (samples/sec): 178.92
2019-08-13 13:05:49,580 epoch 23 - iter 245/493 - loss 0.37018444 throughput (samples/sec): 180.91
2019-08-13 13:05:58,195 epoch 23 - iter 294/493 - loss 0.36306766 throughput (samples/sec): 182.54
2019-08-13 13:06:07,247 epoch 23 - iter 343/493 - loss 0.37175198 throughput (samples/sec): 173.68
2019-08-13 13:06:15,441 epoch 23 - iter 392/493 - loss 0.36892259 throughput (samples/sec): 191.93
2019-08-13 13:06:23,741 epoch 23 - iter 441/493 - loss 0.36688239 throughput (samples/sec): 189.49
2019-08-13 13:06:32,394 epoch 23 - iter 490/493 - loss 0.36939711 throughput (samples/sec): 181.73
2019-08-13 13:06:32,769 ----------------------------------------------------------------------------------------------------
2019-08-13 13:06:32,769 EPOCH 23 done: loss 0.3696 - lr 0.1000
2019-08-13 13:06:32,769 BAD EPOCHS (no improvement): 0
2019-08-13 13:06:32,770 ----------------------------------------------------------------------------------------------------
2019-08-13 13:06:32,917 epoch 24 - iter 0/493 - loss 0.15900993 throughput (samples/sec): 10696.85
2019-08-13 13:06:41,202 epoch 24 - iter 49/493 - loss 0.30137997 throughput (samples/sec): 189.83
2019-08-13 13:06:49,526 epoch 24 - iter 98/493 - loss 0.31547144 throughput (samples/sec): 188.92
2019-08-13 13:06:57,759 epoch 24 - iter 147/493 - loss 0.32688311 throughput (samples/sec): 191.02
2019-08-13 13:07:06,430 epoch 24 - iter 196/493 - loss 0.32212229 throughput (samples/sec): 181.35
2019-08-13 13:07:15,543 epoch 24 - iter 245/493 - loss 0.32785766 throughput (samples/sec): 172.51
2019-08-13 13:07:24,136 epoch 24 - iter 294/493 - loss 0.32802132 throughput (samples/sec): 182.99
2019-08-13 13:07:32,580 epoch 24 - iter 343/493 - loss 0.32963013 throughput (samples/sec): 186.25
2019-08-13 13:07:41,267 epoch 24 - iter 392/493 - loss 0.33033821 throughput (samples/sec): 181.01
2019-08-13 13:07:49,952 epoch 24 - iter 441/493 - loss 0.33495684 throughput (samples/sec): 181.06
2019-08-13 13:07:58,343 epoch 24 - iter 490/493 - loss 0.33732090 throughput (samples/sec): 187.42
2019-08-13 13:07:58,648 ----------------------------------------------------------------------------------------------------
2019-08-13 13:07:58,648 EPOCH 24 done: loss 0.3377 - lr 0.1000
2019-08-13 13:07:58,648 BAD EPOCHS (no improvement): 0
2019-08-13 13:07:58,648 ----------------------------------------------------------------------------------------------------
2019-08-13 13:07:58,850 epoch 25 - iter 0/493 - loss 0.38993293 throughput (samples/sec): 7809.98
2019-08-13 13:08:07,305 epoch 25 - iter 49/493 - loss 0.30823894 throughput (samples/sec): 185.98
2019-08-13 13:08:16,134 epoch 25 - iter 98/493 - loss 0.30308885 throughput (samples/sec): 178.11
2019-08-13 13:08:24,466 epoch 25 - iter 147/493 - loss 0.31463880 throughput (samples/sec): 188.72
2019-08-13 13:08:33,351 epoch 25 - iter 196/493 - loss 0.31648569 throughput (samples/sec): 176.99
2019-08-13 13:08:41,788 epoch 25 - iter 245/493 - loss 0.32293284 throughput (samples/sec): 186.37
2019-08-13 13:08:50,598 epoch 25 - iter 294/493 - loss 0.32578427 throughput (samples/sec): 178.49
2019-08-13 13:08:59,155 epoch 25 - iter 343/493 - loss 0.32463334 throughput (samples/sec): 183.77
2019-08-13 13:09:07,786 epoch 25 - iter 392/493 - loss 0.33402222 throughput (samples/sec): 182.18
2019-08-13 13:09:16,434 epoch 25 - iter 441/493 - loss 0.33875732 throughput (samples/sec): 181.85
2019-08-13 13:09:24,948 epoch 25 - iter 490/493 - loss 0.34109263 throughput (samples/sec): 184.68
2019-08-13 13:09:25,307 ----------------------------------------------------------------------------------------------------
2019-08-13 13:09:25,307 EPOCH 25 done: loss 0.3409 - lr 0.1000
2019-08-13 13:09:25,307 BAD EPOCHS (no improvement): 1
2019-08-13 13:09:25,307 ----------------------------------------------------------------------------------------------------
2019-08-13 13:09:25,459 epoch 26 - iter 0/493 - loss 0.36861834 throughput (samples/sec): 10404.15
2019-08-13 13:09:34,194 epoch 26 - iter 49/493 - loss 0.33155598 throughput (samples/sec): 180.02
2019-08-13 13:09:42,498 epoch 26 - iter 98/493 - loss 0.34441156 throughput (samples/sec): 189.38
2019-08-13 13:09:51,165 epoch 26 - iter 147/493 - loss 0.34093977 throughput (samples/sec): 181.42
2019-08-13 13:09:59,790 epoch 26 - iter 196/493 - loss 0.33815420 throughput (samples/sec): 182.32
2019-08-13 13:10:08,239 epoch 26 - iter 245/493 - loss 0.34072901 throughput (samples/sec): 186.11
2019-08-13 13:10:16,949 epoch 26 - iter 294/493 - loss 0.34246755 throughput (samples/sec): 180.53
2019-08-13 13:10:25,472 epoch 26 - iter 343/493 - loss 0.33219704 throughput (samples/sec): 184.52
2019-08-13 13:10:33,891 epoch 26 - iter 392/493 - loss 0.33225220 throughput (samples/sec): 186.79
2019-08-13 13:10:43,059 epoch 26 - iter 441/493 - loss 0.33442864 throughput (samples/sec): 171.49
2019-08-13 13:10:51,275 epoch 26 - iter 490/493 - loss 0.33863137 throughput (samples/sec): 191.44
2019-08-13 13:10:51,632 ----------------------------------------------------------------------------------------------------
2019-08-13 13:10:51,633 EPOCH 26 done: loss 0.3401 - lr 0.1000
2019-08-13 13:10:51,633 BAD EPOCHS (no improvement): 2
2019-08-13 13:10:51,633 ----------------------------------------------------------------------------------------------------
2019-08-13 13:10:51,855 epoch 27 - iter 0/493 - loss 0.56846982 throughput (samples/sec): 7078.52
2019-08-13 13:11:00,447 epoch 27 - iter 49/493 - loss 0.35116105 throughput (samples/sec): 183.03
2019-08-13 13:11:08,763 epoch 27 - iter 98/493 - loss 0.33265639 throughput (samples/sec): 189.13
2019-08-13 13:11:17,576 epoch 27 - iter 147/493 - loss 0.32163946 throughput (samples/sec): 178.43
2019-08-13 13:11:26,085 epoch 27 - iter 196/493 - loss 0.32551415 throughput (samples/sec): 184.81
2019-08-13 13:11:34,712 epoch 27 - iter 245/493 - loss 0.32038006 throughput (samples/sec): 182.30
2019-08-13 13:11:43,096 epoch 27 - iter 294/493 - loss 0.32331425 throughput (samples/sec): 187.56
2019-08-13 13:11:51,706 epoch 27 - iter 343/493 - loss 0.31820772 throughput (samples/sec): 182.66
2019-08-13 13:12:00,242 epoch 27 - iter 392/493 - loss 0.31900627 throughput (samples/sec): 184.22
2019-08-13 13:12:09,050 epoch 27 - iter 441/493 - loss 0.32291329 throughput (samples/sec): 178.53
2019-08-13 13:12:17,821 epoch 27 - iter 490/493 - loss 0.32174085 throughput (samples/sec): 179.27
2019-08-13 13:12:18,233 ----------------------------------------------------------------------------------------------------
2019-08-13 13:12:18,233 EPOCH 27 done: loss 0.3214 - lr 0.1000
2019-08-13 13:12:18,233 BAD EPOCHS (no improvement): 0
2019-08-13 13:12:18,233 ----------------------------------------------------------------------------------------------------
2019-08-13 13:12:18,451 epoch 28 - iter 0/493 - loss 0.10151005 throughput (samples/sec): 7241.90
2019-08-13 13:12:26,903 epoch 28 - iter 49/493 - loss 0.25486740 throughput (samples/sec): 186.07
2019-08-13 13:12:35,591 epoch 28 - iter 98/493 - loss 0.27592506 throughput (samples/sec): 180.99
2019-08-13 13:12:44,215 epoch 28 - iter 147/493 - loss 0.28980302 throughput (samples/sec): 182.35
2019-08-13 13:12:52,597 epoch 28 - iter 196/493 - loss 0.28903667 throughput (samples/sec): 187.63
2019-08-13 13:13:01,365 epoch 28 - iter 245/493 - loss 0.29752108 throughput (samples/sec): 179.36
2019-08-13 13:13:10,061 epoch 28 - iter 294/493 - loss 0.30172152 throughput (samples/sec): 180.83
2019-08-13 13:13:18,662 epoch 28 - iter 343/493 - loss 0.30002782 throughput (samples/sec): 182.83
2019-08-13 13:13:27,334 epoch 28 - iter 392/493 - loss 0.30447476 throughput (samples/sec): 181.35
2019-08-13 13:13:35,702 epoch 28 - iter 441/493 - loss 0.30991827 throughput (samples/sec): 187.93
2019-08-13 13:13:44,142 epoch 28 - iter 490/493 - loss 0.31534626 throughput (samples/sec): 186.33
2019-08-13 13:13:44,514 ----------------------------------------------------------------------------------------------------
2019-08-13 13:13:44,514 EPOCH 28 done: loss 0.3147 - lr 0.1000
2019-08-13 13:13:44,514 BAD EPOCHS (no improvement): 0
2019-08-13 13:13:44,514 ----------------------------------------------------------------------------------------------------
2019-08-13 13:13:44,704 epoch 29 - iter 0/493 - loss 0.58358979 throughput (samples/sec): 8322.22
2019-08-13 13:13:53,879 epoch 29 - iter 49/493 - loss 0.30902729 throughput (samples/sec): 171.36
2019-08-13 13:14:02,446 epoch 29 - iter 98/493 - loss 0.30786715 throughput (samples/sec): 183.57
2019-08-13 13:14:11,101 epoch 29 - iter 147/493 - loss 0.31258818 throughput (samples/sec): 181.69
2019-08-13 13:14:19,613 epoch 29 - iter 196/493 - loss 0.30883840 throughput (samples/sec): 184.73
2019-08-13 13:14:28,156 epoch 29 - iter 245/493 - loss 0.30905582 throughput (samples/sec): 184.10
2019-08-13 13:14:36,955 epoch 29 - iter 294/493 - loss 0.30890569 throughput (samples/sec): 178.69
2019-08-13 13:14:45,384 epoch 29 - iter 343/493 - loss 0.30893863 throughput (samples/sec): 186.59
2019-08-13 13:14:53,702 epoch 29 - iter 392/493 - loss 0.31119523 throughput (samples/sec): 189.07
2019-08-13 13:15:01,885 epoch 29 - iter 441/493 - loss 0.30868978 throughput (samples/sec): 192.20
2019-08-13 13:15:10,519 epoch 29 - iter 490/493 - loss 0.31141302 throughput (samples/sec): 182.13
2019-08-13 13:15:10,831 ----------------------------------------------------------------------------------------------------
2019-08-13 13:15:10,831 EPOCH 29 done: loss 0.3113 - lr 0.1000
2019-08-13 13:15:10,831 BAD EPOCHS (no improvement): 0
2019-08-13 13:15:10,831 ----------------------------------------------------------------------------------------------------
2019-08-13 13:15:10,977 epoch 30 - iter 0/493 - loss 0.21257666 throughput (samples/sec): 10806.33
2019-08-13 13:15:19,583 epoch 30 - iter 49/493 - loss 0.24154660 throughput (samples/sec): 182.73
2019-08-13 13:15:27,869 epoch 30 - iter 98/493 - loss 0.25621088 throughput (samples/sec): 189.80
2019-08-13 13:15:36,593 epoch 30 - iter 147/493 - loss 0.26019654 throughput (samples/sec): 180.26
2019-08-13 13:15:45,234 epoch 30 - iter 196/493 - loss 0.27470920 throughput (samples/sec): 181.98
2019-08-13 13:15:53,770 epoch 30 - iter 245/493 - loss 0.27231044 throughput (samples/sec): 184.23
2019-08-13 13:16:02,469 epoch 30 - iter 294/493 - loss 0.28895769 throughput (samples/sec): 180.77
2019-08-13 13:16:11,557 epoch 30 - iter 343/493 - loss 0.29721795 throughput (samples/sec): 173.01
2019-08-13 13:16:20,072 epoch 30 - iter 392/493 - loss 0.30228754 throughput (samples/sec): 184.67
2019-08-13 13:16:28,420 epoch 30 - iter 441/493 - loss 0.30274320 throughput (samples/sec): 188.39
2019-08-13 13:16:37,034 epoch 30 - iter 490/493 - loss 0.30512158 throughput (samples/sec): 182.56
2019-08-13 13:16:37,429 ----------------------------------------------------------------------------------------------------
2019-08-13 13:16:37,429 EPOCH 30 done: loss 0.3056 - lr 0.1000
2019-08-13 13:16:37,429 BAD EPOCHS (no improvement): 0
2019-08-13 13:16:37,430 ----------------------------------------------------------------------------------------------------
2019-08-13 13:16:37,597 epoch 31 - iter 0/493 - loss 0.42581978 throughput (samples/sec): 9436.25
2019-08-13 13:16:46,336 epoch 31 - iter 49/493 - loss 0.27120700 throughput (samples/sec): 179.93
2019-08-13 13:16:55,011 epoch 31 - iter 98/493 - loss 0.28992774 throughput (samples/sec): 181.27
2019-08-13 13:17:03,462 epoch 31 - iter 147/493 - loss 0.30485076 throughput (samples/sec): 186.09
2019-08-13 13:17:12,177 epoch 31 - iter 196/493 - loss 0.31276080 throughput (samples/sec): 180.45
2019-08-13 13:17:20,773 epoch 31 - iter 245/493 - loss 0.30976130 throughput (samples/sec): 182.93
2019-08-13 13:17:29,333 epoch 31 - iter 294/493 - loss 0.31058574 throughput (samples/sec): 183.72
2019-08-13 13:17:37,684 epoch 31 - iter 343/493 - loss 0.30488883 throughput (samples/sec): 188.33
2019-08-13 13:17:46,305 epoch 31 - iter 392/493 - loss 0.30453494 throughput (samples/sec): 182.41
2019-08-13 13:17:55,060 epoch 31 - iter 441/493 - loss 0.30579607 throughput (samples/sec): 179.60
2019-08-13 13:18:03,626 epoch 31 - iter 490/493 - loss 0.30464687 throughput (samples/sec): 183.60
2019-08-13 13:18:03,986 ----------------------------------------------------------------------------------------------------
2019-08-13 13:18:03,986 EPOCH 31 done: loss 0.3041 - lr 0.1000
2019-08-13 13:18:03,986 BAD EPOCHS (no improvement): 0
2019-08-13 13:18:03,987 ----------------------------------------------------------------------------------------------------
2019-08-13 13:18:04,143 epoch 32 - iter 0/493 - loss 0.51433909 throughput (samples/sec): 10078.46
2019-08-13 13:18:12,850 epoch 32 - iter 49/493 - loss 0.33752194 throughput (samples/sec): 180.60
2019-08-13 13:18:21,205 epoch 32 - iter 98/493 - loss 0.29868747 throughput (samples/sec): 188.24
2019-08-13 13:18:29,854 epoch 32 - iter 147/493 - loss 0.29511956 throughput (samples/sec): 181.82
2019-08-13 13:18:38,327 epoch 32 - iter 196/493 - loss 0.29091224 throughput (samples/sec): 185.60
2019-08-13 13:18:47,158 epoch 32 - iter 245/493 - loss 0.29001353 throughput (samples/sec): 178.08
2019-08-13 13:18:55,885 epoch 32 - iter 294/493 - loss 0.28295410 throughput (samples/sec): 180.18
2019-08-13 13:19:04,516 epoch 32 - iter 343/493 - loss 0.28561890 throughput (samples/sec): 182.19
2019-08-13 13:19:13,234 epoch 32 - iter 392/493 - loss 0.28432568 throughput (samples/sec): 180.39
2019-08-13 13:19:21,271 epoch 32 - iter 441/493 - loss 0.28732165 throughput (samples/sec): 195.69
2019-08-13 13:19:30,284 epoch 32 - iter 490/493 - loss 0.28772223 throughput (samples/sec): 174.45
2019-08-13 13:19:30,646 ----------------------------------------------------------------------------------------------------
2019-08-13 13:19:30,646 EPOCH 32 done: loss 0.2886 - lr 0.1000
2019-08-13 13:19:30,646 BAD EPOCHS (no improvement): 0
2019-08-13 13:19:30,647 ----------------------------------------------------------------------------------------------------
2019-08-13 13:19:30,807 epoch 33 - iter 0/493 - loss 0.23711374 throughput (samples/sec): 9820.29
2019-08-13 13:19:39,427 epoch 33 - iter 49/493 - loss 0.25960778 throughput (samples/sec): 182.43
2019-08-13 13:19:47,997 epoch 33 - iter 98/493 - loss 0.26672792 throughput (samples/sec): 183.50
2019-08-13 13:19:56,679 epoch 33 - iter 147/493 - loss 0.27107936 throughput (samples/sec): 181.12
2019-08-13 13:20:05,432 epoch 33 - iter 196/493 - loss 0.27098579 throughput (samples/sec): 179.65
2019-08-13 13:20:14,150 epoch 33 - iter 245/493 - loss 0.27501836 throughput (samples/sec): 180.38
2019-08-13 13:20:22,952 epoch 33 - iter 294/493 - loss 0.27872276 throughput (samples/sec): 178.64
2019-08-13 13:20:31,440 epoch 33 - iter 343/493 - loss 0.27780728 throughput (samples/sec): 185.28
2019-08-13 13:20:39,935 epoch 33 - iter 392/493 - loss 0.28116317 throughput (samples/sec): 185.12
2019-08-13 13:20:48,583 epoch 33 - iter 441/493 - loss 0.28705013 throughput (samples/sec): 181.84
2019-08-13 13:20:57,106 epoch 33 - iter 490/493 - loss 0.29157583 throughput (samples/sec): 184.51
2019-08-13 13:20:57,456 ----------------------------------------------------------------------------------------------------
2019-08-13 13:20:57,456 EPOCH 33 done: loss 0.2917 - lr 0.1000
2019-08-13 13:20:57,456 BAD EPOCHS (no improvement): 1
2019-08-13 13:20:57,456 ----------------------------------------------------------------------------------------------------
2019-08-13 13:20:57,611 epoch 34 - iter 0/493 - loss 0.37360695 throughput (samples/sec): 10213.92
2019-08-13 13:21:06,288 epoch 34 - iter 49/493 - loss 0.25804191 throughput (samples/sec): 181.22
2019-08-13 13:21:14,625 epoch 34 - iter 98/493 - loss 0.27329150 throughput (samples/sec): 188.65
2019-08-13 13:21:23,093 epoch 34 - iter 147/493 - loss 0.27029744 throughput (samples/sec): 185.71
2019-08-13 13:21:31,882 epoch 34 - iter 196/493 - loss 0.27303168 throughput (samples/sec): 178.92
2019-08-13 13:21:40,814 epoch 34 - iter 245/493 - loss 0.26437437 throughput (samples/sec): 176.05
2019-08-13 13:21:49,499 epoch 34 - iter 294/493 - loss 0.26782224 throughput (samples/sec): 181.06
2019-08-13 13:21:58,193 epoch 34 - iter 343/493 - loss 0.27095409 throughput (samples/sec): 180.88
2019-08-13 13:22:06,624 epoch 34 - iter 392/493 - loss 0.27822504 throughput (samples/sec): 186.52
2019-08-13 13:22:15,045 epoch 34 - iter 441/493 - loss 0.27567254 throughput (samples/sec): 186.75
2019-08-13 13:22:23,600 epoch 34 - iter 490/493 - loss 0.27717298 throughput (samples/sec): 183.84
2019-08-13 13:22:23,972 ----------------------------------------------------------------------------------------------------
2019-08-13 13:22:23,972 EPOCH 34 done: loss 0.2765 - lr 0.1000
2019-08-13 13:22:23,972 BAD EPOCHS (no improvement): 0
2019-08-13 13:22:23,972 ----------------------------------------------------------------------------------------------------
2019-08-13 13:22:24,135 epoch 35 - iter 0/493 - loss 0.45720294 throughput (samples/sec): 9671.78
2019-08-13 13:22:32,645 epoch 35 - iter 49/493 - loss 0.26099602 throughput (samples/sec): 184.80
2019-08-13 13:22:41,079 epoch 35 - iter 98/493 - loss 0.25000722 throughput (samples/sec): 186.46
2019-08-13 13:22:50,094 epoch 35 - iter 147/493 - loss 0.25258292 throughput (samples/sec): 174.41
2019-08-13 13:22:59,208 epoch 35 - iter 196/493 - loss 0.25386540 throughput (samples/sec): 172.51
2019-08-13 13:23:07,949 epoch 35 - iter 245/493 - loss 0.26040775 throughput (samples/sec): 179.90
2019-08-13 13:23:16,339 epoch 35 - iter 294/493 - loss 0.26710596 throughput (samples/sec): 187.46
2019-08-13 13:23:24,638 epoch 35 - iter 343/493 - loss 0.26637860 throughput (samples/sec): 189.50
2019-08-13 13:23:33,420 epoch 35 - iter 392/493 - loss 0.26808618 throughput (samples/sec): 179.05
2019-08-13 13:23:42,076 epoch 35 - iter 441/493 - loss 0.27056497 throughput (samples/sec): 181.68
2019-08-13 13:23:50,795 epoch 35 - iter 490/493 - loss 0.27051968 throughput (samples/sec): 180.35
2019-08-13 13:23:51,142 ----------------------------------------------------------------------------------------------------
2019-08-13 13:23:51,142 EPOCH 35 done: loss 0.2702 - lr 0.1000
2019-08-13 13:23:51,142 BAD EPOCHS (no improvement): 0
2019-08-13 13:23:51,142 ----------------------------------------------------------------------------------------------------
2019-08-13 13:23:51,320 epoch 36 - iter 0/493 - loss 0.43819594 throughput (samples/sec): 8893.95
2019-08-13 13:23:59,636 epoch 36 - iter 49/493 - loss 0.29495765 throughput (samples/sec): 189.11
2019-08-13 13:24:08,501 epoch 36 - iter 98/493 - loss 0.28028682 throughput (samples/sec): 177.38
2019-08-13 13:24:17,524 epoch 36 - iter 147/493 - loss 0.27867891 throughput (samples/sec): 174.26
2019-08-13 13:24:26,136 epoch 36 - iter 196/493 - loss 0.27760053 throughput (samples/sec): 182.60
2019-08-13 13:24:34,494 epoch 36 - iter 245/493 - loss 0.27643387 throughput (samples/sec): 188.16
2019-08-13 13:24:43,042 epoch 36 - iter 294/493 - loss 0.26476608 throughput (samples/sec): 183.96
2019-08-13 13:24:52,006 epoch 36 - iter 343/493 - loss 0.27202004 throughput (samples/sec): 175.42
2019-08-13 13:25:00,367 epoch 36 - iter 392/493 - loss 0.26888030 throughput (samples/sec): 188.10
2019-08-13 13:25:08,938 epoch 36 - iter 441/493 - loss 0.27220951 throughput (samples/sec): 183.47
2019-08-13 13:25:17,518 epoch 36 - iter 490/493 - loss 0.27387796 throughput (samples/sec): 183.28
2019-08-13 13:25:17,852 ----------------------------------------------------------------------------------------------------
2019-08-13 13:25:17,852 EPOCH 36 done: loss 0.2729 - lr 0.1000
2019-08-13 13:25:17,852 BAD EPOCHS (no improvement): 1
2019-08-13 13:25:17,852 ----------------------------------------------------------------------------------------------------
2019-08-13 13:25:18,033 epoch 37 - iter 0/493 - loss 0.23242295 throughput (samples/sec): 8741.85
2019-08-13 13:25:26,682 epoch 37 - iter 49/493 - loss 0.25393972 throughput (samples/sec): 181.80
2019-08-13 13:25:35,483 epoch 37 - iter 98/493 - loss 0.25715930 throughput (samples/sec): 178.68
2019-08-13 13:25:44,218 epoch 37 - iter 147/493 - loss 0.25147262 throughput (samples/sec): 180.02
2019-08-13 13:25:53,126 epoch 37 - iter 196/493 - loss 0.24523397 throughput (samples/sec): 176.51
2019-08-13 13:26:01,693 epoch 37 - iter 245/493 - loss 0.24946296 throughput (samples/sec): 183.57
2019-08-13 13:26:10,434 epoch 37 - iter 294/493 - loss 0.25385495 throughput (samples/sec): 179.90
2019-08-13 13:26:18,916 epoch 37 - iter 343/493 - loss 0.25248900 throughput (samples/sec): 185.42
2019-08-13 13:26:27,237 epoch 37 - iter 392/493 - loss 0.25415011 throughput (samples/sec): 189.00
2019-08-13 13:26:35,744 epoch 37 - iter 441/493 - loss 0.25217384 throughput (samples/sec): 184.86
2019-08-13 13:26:44,091 epoch 37 - iter 490/493 - loss 0.25218345 throughput (samples/sec): 188.42
2019-08-13 13:26:44,576 ----------------------------------------------------------------------------------------------------
2019-08-13 13:26:44,576 EPOCH 37 done: loss 0.2516 - lr 0.1000
2019-08-13 13:26:44,576 BAD EPOCHS (no improvement): 0
2019-08-13 13:26:44,577 ----------------------------------------------------------------------------------------------------
2019-08-13 13:26:44,733 epoch 38 - iter 0/493 - loss 0.14609179 throughput (samples/sec): 10092.74
2019-08-13 13:26:53,115 epoch 38 - iter 49/493 - loss 0.28419751 throughput (samples/sec): 187.62
2019-08-13 13:27:02,053 epoch 38 - iter 98/493 - loss 0.26515254 throughput (samples/sec): 175.94
2019-08-13 13:27:10,648 epoch 38 - iter 147/493 - loss 0.25568470 throughput (samples/sec): 182.96
2019-08-13 13:27:19,325 epoch 38 - iter 196/493 - loss 0.25271590 throughput (samples/sec): 181.22
2019-08-13 13:27:27,786 epoch 38 - iter 245/493 - loss 0.25176335 throughput (samples/sec): 185.88
2019-08-13 13:27:36,192 epoch 38 - iter 294/493 - loss 0.24419705 throughput (samples/sec): 187.07
2019-08-13 13:27:44,981 epoch 38 - iter 343/493 - loss 0.24721059 throughput (samples/sec): 178.92
2019-08-13 13:27:53,316 epoch 38 - iter 392/493 - loss 0.24840939 throughput (samples/sec): 188.69
2019-08-13 13:28:02,351 epoch 38 - iter 441/493 - loss 0.24899780 throughput (samples/sec): 174.03
2019-08-13 13:28:10,878 epoch 38 - iter 490/493 - loss 0.24811893 throughput (samples/sec): 184.42
2019-08-13 13:28:11,198 ----------------------------------------------------------------------------------------------------
2019-08-13 13:28:11,198 EPOCH 38 done: loss 0.2478 - lr 0.1000
2019-08-13 13:28:11,198 BAD EPOCHS (no improvement): 0
2019-08-13 13:28:11,199 ----------------------------------------------------------------------------------------------------
2019-08-13 13:28:11,388 epoch 39 - iter 0/493 - loss 0.69354898 throughput (samples/sec): 8322.74
2019-08-13 13:28:19,979 epoch 39 - iter 49/493 - loss 0.24778159 throughput (samples/sec): 183.05
2019-08-13 13:28:28,443 epoch 39 - iter 98/493 - loss 0.24094343 throughput (samples/sec): 185.79
2019-08-13 13:28:37,102 epoch 39 - iter 147/493 - loss 0.24673668 throughput (samples/sec): 181.61
2019-08-13 13:28:45,950 epoch 39 - iter 196/493 - loss 0.24925890 throughput (samples/sec): 177.72
2019-08-13 13:28:54,507 epoch 39 - iter 245/493 - loss 0.24767995 throughput (samples/sec): 183.76
2019-08-13 13:29:03,156 epoch 39 - iter 294/493 - loss 0.24924776 throughput (samples/sec): 181.84
2019-08-13 13:29:11,401 epoch 39 - iter 343/493 - loss 0.24912652 throughput (samples/sec): 190.75
2019-08-13 13:29:20,265 epoch 39 - iter 392/493 - loss 0.24690468 throughput (samples/sec): 177.39
2019-08-13 13:29:29,198 epoch 39 - iter 441/493 - loss 0.25304322 throughput (samples/sec): 176.02
2019-08-13 13:29:37,623 epoch 39 - iter 490/493 - loss 0.25633785 throughput (samples/sec): 186.68
2019-08-13 13:29:37,940 ----------------------------------------------------------------------------------------------------
2019-08-13 13:29:37,940 EPOCH 39 done: loss 0.2567 - lr 0.1000
2019-08-13 13:29:37,940 BAD EPOCHS (no improvement): 1
2019-08-13 13:29:37,941 ----------------------------------------------------------------------------------------------------
2019-08-13 13:29:38,184 epoch 40 - iter 0/493 - loss 0.23012710 throughput (samples/sec): 6461.66
2019-08-13 13:29:46,929 epoch 40 - iter 49/493 - loss 0.24773637 throughput (samples/sec): 179.82
2019-08-13 13:29:55,457 epoch 40 - iter 98/493 - loss 0.22714260 throughput (samples/sec): 184.41
2019-08-13 13:30:04,342 epoch 40 - iter 147/493 - loss 0.22817360 throughput (samples/sec): 176.95
2019-08-13 13:30:12,627 epoch 40 - iter 196/493 - loss 0.23369204 throughput (samples/sec): 189.83
2019-08-13 13:30:21,309 epoch 40 - iter 245/493 - loss 0.24687028 throughput (samples/sec): 181.12
2019-08-13 13:30:29,910 epoch 40 - iter 294/493 - loss 0.24656931 throughput (samples/sec): 182.82
2019-08-13 13:30:38,211 epoch 40 - iter 343/493 - loss 0.24374586 throughput (samples/sec): 189.46
2019-08-13 13:30:46,760 epoch 40 - iter 392/493 - loss 0.23747550 throughput (samples/sec): 183.92
2019-08-13 13:30:55,043 epoch 40 - iter 441/493 - loss 0.23867609 throughput (samples/sec): 189.88
2019-08-13 13:31:03,827 epoch 40 - iter 490/493 - loss 0.23744767 throughput (samples/sec): 179.00
2019-08-13 13:31:04,167 ----------------------------------------------------------------------------------------------------
2019-08-13 13:31:04,167 EPOCH 40 done: loss 0.2371 - lr 0.1000
2019-08-13 13:31:04,167 BAD EPOCHS (no improvement): 0
2019-08-13 13:31:04,167 ----------------------------------------------------------------------------------------------------
2019-08-13 13:31:04,329 epoch 41 - iter 0/493 - loss 0.26353076 throughput (samples/sec): 9771.64
2019-08-13 13:31:12,929 epoch 41 - iter 49/493 - loss 0.24544868 throughput (samples/sec): 182.83
2019-08-13 13:31:21,433 epoch 41 - iter 98/493 - loss 0.24071392 throughput (samples/sec): 184.92
2019-08-13 13:31:30,263 epoch 41 - iter 147/493 - loss 0.23822908 throughput (samples/sec): 178.07
2019-08-13 13:31:38,950 epoch 41 - iter 196/493 - loss 0.25722413 throughput (samples/sec): 181.01
2019-08-13 13:31:47,562 epoch 41 - iter 245/493 - loss 0.25703082 throughput (samples/sec): 182.59
2019-08-13 13:31:56,042 epoch 41 - iter 294/493 - loss 0.25082908 throughput (samples/sec): 185.42
2019-08-13 13:32:04,471 epoch 41 - iter 343/493 - loss 0.24703262 throughput (samples/sec): 186.58
2019-08-13 13:32:12,714 epoch 41 - iter 392/493 - loss 0.24214273 throughput (samples/sec): 190.78
2019-08-13 13:32:21,094 epoch 41 - iter 441/493 - loss 0.24329319 throughput (samples/sec): 187.66
2019-08-13 13:32:29,626 epoch 41 - iter 490/493 - loss 0.24644695 throughput (samples/sec): 184.30
2019-08-13 13:32:30,064 ----------------------------------------------------------------------------------------------------
2019-08-13 13:32:30,064 EPOCH 41 done: loss 0.2472 - lr 0.1000
2019-08-13 13:32:30,064 BAD EPOCHS (no improvement): 1
2019-08-13 13:32:30,064 ----------------------------------------------------------------------------------------------------
2019-08-13 13:32:30,206 epoch 42 - iter 0/493 - loss 0.14465764 throughput (samples/sec): 11142.57
2019-08-13 13:32:38,708 epoch 42 - iter 49/493 - loss 0.22819171 throughput (samples/sec): 184.96
2019-08-13 13:32:47,333 epoch 42 - iter 98/493 - loss 0.22396815 throughput (samples/sec): 182.31
2019-08-13 13:32:55,952 epoch 42 - iter 147/493 - loss 0.23819072 throughput (samples/sec): 182.46
2019-08-13 13:33:05,035 epoch 42 - iter 196/493 - loss 0.24381560 throughput (samples/sec): 173.09
2019-08-13 13:33:13,709 epoch 42 - iter 245/493 - loss 0.24589754 throughput (samples/sec): 181.28
2019-08-13 13:33:22,267 epoch 42 - iter 294/493 - loss 0.24882664 throughput (samples/sec): 183.74
2019-08-13 13:33:30,969 epoch 42 - iter 343/493 - loss 0.24690578 throughput (samples/sec): 180.69
2019-08-13 13:33:39,184 epoch 42 - iter 392/493 - loss 0.24810100 throughput (samples/sec): 191.44
2019-08-13 13:33:47,442 epoch 42 - iter 441/493 - loss 0.24478427 throughput (samples/sec): 190.44
2019-08-13 13:33:56,098 epoch 42 - iter 490/493 - loss 0.24172878 throughput (samples/sec): 181.64
2019-08-13 13:33:56,456 ----------------------------------------------------------------------------------------------------
2019-08-13 13:33:56,456 EPOCH 42 done: loss 0.2423 - lr 0.1000
2019-08-13 13:33:56,456 BAD EPOCHS (no improvement): 2
2019-08-13 13:33:56,457 ----------------------------------------------------------------------------------------------------
2019-08-13 13:33:56,606 epoch 43 - iter 0/493 - loss 0.02929825 throughput (samples/sec): 10599.61
2019-08-13 13:34:04,953 epoch 43 - iter 49/493 - loss 0.19514494 throughput (samples/sec): 188.39
2019-08-13 13:34:13,605 epoch 43 - iter 98/493 - loss 0.21832304 throughput (samples/sec): 181.74
2019-08-13 13:34:21,998 epoch 43 - iter 147/493 - loss 0.21828803 throughput (samples/sec): 187.37
2019-08-13 13:34:30,513 epoch 43 - iter 196/493 - loss 0.22134843 throughput (samples/sec): 184.67
2019-08-13 13:34:38,880 epoch 43 - iter 245/493 - loss 0.22202311 throughput (samples/sec): 187.97
2019-08-13 13:34:47,118 epoch 43 - iter 294/493 - loss 0.22644072 throughput (samples/sec): 190.90
2019-08-13 13:34:55,894 epoch 43 - iter 343/493 - loss 0.22727654 throughput (samples/sec): 179.16
2019-08-13 13:35:04,409 epoch 43 - iter 392/493 - loss 0.23028358 throughput (samples/sec): 184.68
2019-08-13 13:35:13,632 epoch 43 - iter 441/493 - loss 0.23183110 throughput (samples/sec): 170.46
2019-08-13 13:35:22,144 epoch 43 - iter 490/493 - loss 0.23277271 throughput (samples/sec): 184.75
2019-08-13 13:35:22,445 ----------------------------------------------------------------------------------------------------
2019-08-13 13:35:22,445 EPOCH 43 done: loss 0.2326 - lr 0.1000
2019-08-13 13:35:22,445 BAD EPOCHS (no improvement): 0
2019-08-13 13:35:22,445 ----------------------------------------------------------------------------------------------------
2019-08-13 13:35:22,653 epoch 44 - iter 0/493 - loss 0.08769709 throughput (samples/sec): 7575.77
2019-08-13 13:35:31,111 epoch 44 - iter 49/493 - loss 0.20275163 throughput (samples/sec): 185.93
2019-08-13 13:35:39,929 epoch 44 - iter 98/493 - loss 0.22389514 throughput (samples/sec): 178.31
2019-08-13 13:35:48,338 epoch 44 - iter 147/493 - loss 0.21321526 throughput (samples/sec): 187.01
2019-08-13 13:35:56,741 epoch 44 - iter 196/493 - loss 0.20585991 throughput (samples/sec): 187.13
2019-08-13 13:36:05,064 epoch 44 - iter 245/493 - loss 0.20506668 throughput (samples/sec): 188.95
2019-08-13 13:36:13,566 epoch 44 - iter 294/493 - loss 0.21181616 throughput (samples/sec): 184.97
2019-08-13 13:36:21,903 epoch 44 - iter 343/493 - loss 0.21571163 throughput (samples/sec): 188.62
2019-08-13 13:36:30,410 epoch 44 - iter 392/493 - loss 0.21838385 throughput (samples/sec): 184.84
2019-08-13 13:36:38,817 epoch 44 - iter 441/493 - loss 0.22281854 throughput (samples/sec): 187.07
2019-08-13 13:36:48,017 epoch 44 - iter 490/493 - loss 0.22299195 throughput (samples/sec): 170.88
2019-08-13 13:36:48,341 ----------------------------------------------------------------------------------------------------
2019-08-13 13:36:48,342 EPOCH 44 done: loss 0.2228 - lr 0.1000
2019-08-13 13:36:48,342 BAD EPOCHS (no improvement): 0
2019-08-13 13:36:48,342 ----------------------------------------------------------------------------------------------------
2019-08-13 13:36:48,485 epoch 45 - iter 0/493 - loss 0.07462400 throughput (samples/sec): 11063.94
2019-08-13 13:36:56,868 epoch 45 - iter 49/493 - loss 0.23709719 throughput (samples/sec): 187.57
2019-08-13 13:37:05,408 epoch 45 - iter 98/493 - loss 0.21681044 throughput (samples/sec): 184.15
2019-08-13 13:37:14,215 epoch 45 - iter 147/493 - loss 0.22977275 throughput (samples/sec): 178.53
2019-08-13 13:37:22,501 epoch 45 - iter 196/493 - loss 0.22693101 throughput (samples/sec): 189.79
2019-08-13 13:37:30,811 epoch 45 - iter 245/493 - loss 0.23278961 throughput (samples/sec): 189.26
2019-08-13 13:37:39,153 epoch 45 - iter 294/493 - loss 0.23071546 throughput (samples/sec): 188.50
2019-08-13 13:37:47,803 epoch 45 - iter 343/493 - loss 0.23153426 throughput (samples/sec): 181.78
2019-08-13 13:37:56,324 epoch 45 - iter 392/493 - loss 0.22947047 throughput (samples/sec): 184.54
2019-08-13 13:38:05,198 epoch 45 - iter 441/493 - loss 0.22343307 throughput (samples/sec): 177.19
2019-08-13 13:38:14,107 epoch 45 - iter 490/493 - loss 0.22274655 throughput (samples/sec): 176.49
2019-08-13 13:38:14,479 ----------------------------------------------------------------------------------------------------
2019-08-13 13:38:14,479 EPOCH 45 done: loss 0.2223 - lr 0.1000
2019-08-13 13:38:14,479 BAD EPOCHS (no improvement): 0
2019-08-13 13:38:14,480 ----------------------------------------------------------------------------------------------------
2019-08-13 13:38:14,636 epoch 46 - iter 0/493 - loss 0.16420591 throughput (samples/sec): 10082.00
2019-08-13 13:38:23,037 epoch 46 - iter 49/493 - loss 0.19822553 throughput (samples/sec): 187.19
2019-08-13 13:38:31,660 epoch 46 - iter 98/493 - loss 0.21284257 throughput (samples/sec): 182.36
2019-08-13 13:38:39,960 epoch 46 - iter 147/493 - loss 0.20702680 throughput (samples/sec): 189.47
2019-08-13 13:38:48,840 epoch 46 - iter 196/493 - loss 0.20927286 throughput (samples/sec): 177.07
2019-08-13 13:38:57,074 epoch 46 - iter 245/493 - loss 0.20759362 throughput (samples/sec): 191.01
2019-08-13 13:39:05,579 epoch 46 - iter 294/493 - loss 0.21157774 throughput (samples/sec): 184.91
2019-08-13 13:39:14,223 epoch 46 - iter 343/493 - loss 0.20912233 throughput (samples/sec): 181.92
2019-08-13 13:39:22,838 epoch 46 - iter 392/493 - loss 0.21419702 throughput (samples/sec): 182.53
2019-08-13 13:39:31,276 epoch 46 - iter 441/493 - loss 0.21709244 throughput (samples/sec): 186.36
2019-08-13 13:39:40,018 epoch 46 - iter 490/493 - loss 0.22093786 throughput (samples/sec): 179.88
2019-08-13 13:39:40,384 ----------------------------------------------------------------------------------------------------
2019-08-13 13:39:40,384 EPOCH 46 done: loss 0.2206 - lr 0.1000
2019-08-13 13:39:40,384 BAD EPOCHS (no improvement): 0
2019-08-13 13:39:40,384 ----------------------------------------------------------------------------------------------------
2019-08-13 13:39:40,669 epoch 47 - iter 0/493 - loss 0.33604783 throughput (samples/sec): 5532.97
2019-08-13 13:39:49,037 epoch 47 - iter 49/493 - loss 0.22631970 throughput (samples/sec): 187.92
2019-08-13 13:39:57,400 epoch 47 - iter 98/493 - loss 0.22299204 throughput (samples/sec): 188.06
2019-08-13 13:40:06,328 epoch 47 - iter 147/493 - loss 0.20262379 throughput (samples/sec): 176.10
2019-08-13 13:40:15,128 epoch 47 - iter 196/493 - loss 0.20256662 throughput (samples/sec): 178.69
2019-08-13 13:40:23,301 epoch 47 - iter 245/493 - loss 0.20202292 throughput (samples/sec): 192.42
2019-08-13 13:40:31,792 epoch 47 - iter 294/493 - loss 0.20003346 throughput (samples/sec): 185.19
2019-08-13 13:40:40,065 epoch 47 - iter 343/493 - loss 0.20134074 throughput (samples/sec): 190.11
2019-08-13 13:40:48,866 epoch 47 - iter 392/493 - loss 0.20490537 throughput (samples/sec): 178.65
2019-08-13 13:40:57,419 epoch 47 - iter 441/493 - loss 0.20791655 throughput (samples/sec): 183.85
2019-08-13 13:41:06,009 epoch 47 - iter 490/493 - loss 0.20857130 throughput (samples/sec): 183.07
2019-08-13 13:41:06,364 ----------------------------------------------------------------------------------------------------
2019-08-13 13:41:06,365 EPOCH 47 done: loss 0.2085 - lr 0.1000
2019-08-13 13:41:06,365 BAD EPOCHS (no improvement): 0
2019-08-13 13:41:06,365 ----------------------------------------------------------------------------------------------------
2019-08-13 13:41:06,516 epoch 48 - iter 0/493 - loss 0.27528796 throughput (samples/sec): 10466.09
2019-08-13 13:41:15,009 epoch 48 - iter 49/493 - loss 0.18596754 throughput (samples/sec): 185.14
2019-08-13 13:41:23,589 epoch 48 - iter 98/493 - loss 0.19655749 throughput (samples/sec): 183.27
2019-08-13 13:41:32,039 epoch 48 - iter 147/493 - loss 0.19467149 throughput (samples/sec): 186.10
2019-08-13 13:41:40,887 epoch 48 - iter 196/493 - loss 0.19249502 throughput (samples/sec): 177.70
2019-08-13 13:41:49,751 epoch 48 - iter 245/493 - loss 0.19436551 throughput (samples/sec): 177.39
2019-08-13 13:41:58,050 epoch 48 - iter 294/493 - loss 0.19710409 throughput (samples/sec): 189.49
2019-08-13 13:42:06,437 epoch 48 - iter 343/493 - loss 0.19999715 throughput (samples/sec): 187.50
2019-08-13 13:42:14,986 epoch 48 - iter 392/493 - loss 0.20673300 throughput (samples/sec): 183.94
2019-08-13 13:42:23,547 epoch 48 - iter 441/493 - loss 0.21448544 throughput (samples/sec): 183.67
2019-08-13 13:42:31,858 epoch 48 - iter 490/493 - loss 0.21761146 throughput (samples/sec): 189.22
2019-08-13 13:42:32,264 ----------------------------------------------------------------------------------------------------
2019-08-13 13:42:32,265 EPOCH 48 done: loss 0.2170 - lr 0.1000
2019-08-13 13:42:32,265 BAD EPOCHS (no improvement): 1
2019-08-13 13:42:32,265 ----------------------------------------------------------------------------------------------------
2019-08-13 13:42:32,420 epoch 49 - iter 0/493 - loss 0.44328868 throughput (samples/sec): 10183.80
2019-08-13 13:42:41,008 epoch 49 - iter 49/493 - loss 0.20675680 throughput (samples/sec): 183.11
2019-08-13 13:42:49,647 epoch 49 - iter 98/493 - loss 0.20979611 throughput (samples/sec): 182.01
2019-08-13 13:42:58,415 epoch 49 - iter 147/493 - loss 0.19889925 throughput (samples/sec): 179.34
2019-08-13 13:43:06,798 epoch 49 - iter 196/493 - loss 0.19156934 throughput (samples/sec): 187.58
2019-08-13 13:43:15,111 epoch 49 - iter 245/493 - loss 0.18982234 throughput (samples/sec): 189.18
2019-08-13 13:43:23,674 epoch 49 - iter 294/493 - loss 0.19309803 throughput (samples/sec): 183.64
2019-08-13 13:43:32,105 epoch 49 - iter 343/493 - loss 0.19187686 throughput (samples/sec): 186.53
2019-08-13 13:43:40,693 epoch 49 - iter 392/493 - loss 0.19128661 throughput (samples/sec): 183.10
2019-08-13 13:43:49,212 epoch 49 - iter 441/493 - loss 0.19433984 throughput (samples/sec): 184.58
2019-08-13 13:43:57,877 epoch 49 - iter 490/493 - loss 0.19614039 throughput (samples/sec): 181.48
2019-08-13 13:43:58,218 ----------------------------------------------------------------------------------------------------
2019-08-13 13:43:58,218 EPOCH 49 done: loss 0.1964 - lr 0.1000
2019-08-13 13:43:58,218 BAD EPOCHS (no improvement): 0
2019-08-13 13:43:58,218 ----------------------------------------------------------------------------------------------------
2019-08-13 13:43:58,451 epoch 50 - iter 0/493 - loss 0.17841551 throughput (samples/sec): 6778.99
2019-08-13 13:44:07,242 epoch 50 - iter 49/493 - loss 0.16457466 throughput (samples/sec): 178.86
2019-08-13 13:44:15,473 epoch 50 - iter 98/493 - loss 0.17386461 throughput (samples/sec): 191.06
2019-08-13 13:44:24,295 epoch 50 - iter 147/493 - loss 0.18079607 throughput (samples/sec): 178.22
2019-08-13 13:44:32,931 epoch 50 - iter 196/493 - loss 0.18753052 throughput (samples/sec): 182.09
2019-08-13 13:44:41,176 epoch 50 - iter 245/493 - loss 0.18842114 throughput (samples/sec): 190.74
2019-08-13 13:44:49,347 epoch 50 - iter 294/493 - loss 0.18932797 throughput (samples/sec): 192.47
2019-08-13 13:44:57,972 epoch 50 - iter 343/493 - loss 0.18917586 throughput (samples/sec): 182.31
2019-08-13 13:45:06,768 epoch 50 - iter 392/493 - loss 0.19018867 throughput (samples/sec): 178.76
2019-08-13 13:45:15,349 epoch 50 - iter 441/493 - loss 0.19230708 throughput (samples/sec): 183.25
2019-08-13 13:45:24,101 epoch 50 - iter 490/493 - loss 0.19322786 throughput (samples/sec): 179.66
2019-08-13 13:45:24,398 ----------------------------------------------------------------------------------------------------
2019-08-13 13:45:24,398 EPOCH 50 done: loss 0.1929 - lr 0.1000
2019-08-13 13:45:24,399 BAD EPOCHS (no improvement): 0
2019-08-13 13:45:24,399 ----------------------------------------------------------------------------------------------------
2019-08-13 13:45:24,566 epoch 51 - iter 0/493 - loss 0.08613881 throughput (samples/sec): 9449.60
2019-08-13 13:45:33,103 epoch 51 - iter 49/493 - loss 0.20912389 throughput (samples/sec): 184.20
2019-08-13 13:45:41,378 epoch 51 - iter 98/493 - loss 0.19870644 throughput (samples/sec): 190.04
2019-08-13 13:45:50,374 epoch 51 - iter 147/493 - loss 0.20314390 throughput (samples/sec): 174.78
2019-08-13 13:45:58,292 epoch 51 - iter 196/493 - loss 0.20445490 throughput (samples/sec): 198.64
2019-08-13 13:46:06,749 epoch 51 - iter 245/493 - loss 0.20142859 throughput (samples/sec): 185.94
2019-08-13 13:46:14,982 epoch 51 - iter 294/493 - loss 0.19783331 throughput (samples/sec): 191.02
2019-08-13 13:46:23,745 epoch 51 - iter 343/493 - loss 0.20238963 throughput (samples/sec): 179.43
2019-08-13 13:46:32,458 epoch 51 - iter 392/493 - loss 0.20181119 throughput (samples/sec): 180.47
2019-08-13 13:46:41,261 epoch 51 - iter 441/493 - loss 0.20114972 throughput (samples/sec): 178.61
2019-08-13 13:46:49,882 epoch 51 - iter 490/493 - loss 0.19762465 throughput (samples/sec): 182.40
2019-08-13 13:46:50,198 ----------------------------------------------------------------------------------------------------
2019-08-13 13:46:50,198 EPOCH 51 done: loss 0.1973 - lr 0.1000
2019-08-13 13:46:50,198 BAD EPOCHS (no improvement): 1
2019-08-13 13:46:50,198 ----------------------------------------------------------------------------------------------------
2019-08-13 13:46:50,455 epoch 52 - iter 0/493 - loss 0.20600307 throughput (samples/sec): 6126.04
2019-08-13 13:46:58,872 epoch 52 - iter 49/493 - loss 0.20216907 throughput (samples/sec): 186.83
2019-08-13 13:47:07,277 epoch 52 - iter 98/493 - loss 0.18704792 throughput (samples/sec): 187.11
2019-08-13 13:47:15,737 epoch 52 - iter 147/493 - loss 0.19110908 throughput (samples/sec): 185.86
2019-08-13 13:47:24,425 epoch 52 - iter 196/493 - loss 0.19409071 throughput (samples/sec): 181.01
2019-08-13 13:47:33,072 epoch 52 - iter 245/493 - loss 0.20139150 throughput (samples/sec): 181.84
2019-08-13 13:47:41,831 epoch 52 - iter 294/493 - loss 0.20002864 throughput (samples/sec): 179.51
2019-08-13 13:47:50,732 epoch 52 - iter 343/493 - loss 0.20000024 throughput (samples/sec): 176.64
2019-08-13 13:47:59,068 epoch 52 - iter 392/493 - loss 0.19786069 throughput (samples/sec): 188.66
2019-08-13 13:48:07,825 epoch 52 - iter 441/493 - loss 0.20118994 throughput (samples/sec): 179.58
2019-08-13 13:48:16,417 epoch 52 - iter 490/493 - loss 0.20527906 throughput (samples/sec): 183.02
2019-08-13 13:48:16,768 ----------------------------------------------------------------------------------------------------
2019-08-13 13:48:16,768 EPOCH 52 done: loss 0.2048 - lr 0.1000
2019-08-13 13:48:16,768 BAD EPOCHS (no improvement): 2
2019-08-13 13:48:16,768 ----------------------------------------------------------------------------------------------------
2019-08-13 13:48:16,928 epoch 53 - iter 0/493 - loss 0.43876529 throughput (samples/sec): 9878.93
2019-08-13 13:48:25,208 epoch 53 - iter 49/493 - loss 0.20075739 throughput (samples/sec): 189.95
2019-08-13 13:48:33,724 epoch 53 - iter 98/493 - loss 0.20603170 throughput (samples/sec): 184.66
2019-08-13 13:48:42,545 epoch 53 - iter 147/493 - loss 0.19917689 throughput (samples/sec): 178.27
2019-08-13 13:48:51,184 epoch 53 - iter 196/493 - loss 0.18847527 throughput (samples/sec): 182.02
2019-08-13 13:48:59,943 epoch 53 - iter 245/493 - loss 0.18759137 throughput (samples/sec): 179.52
2019-08-13 13:49:08,313 epoch 53 - iter 294/493 - loss 0.19134202 throughput (samples/sec): 187.89
2019-08-13 13:49:16,904 epoch 53 - iter 343/493 - loss 0.19202214 throughput (samples/sec): 183.04
2019-08-13 13:49:25,454 epoch 53 - iter 392/493 - loss 0.18954289 throughput (samples/sec): 183.95
2019-08-13 13:49:34,228 epoch 53 - iter 441/493 - loss 0.19141205 throughput (samples/sec): 179.22
2019-08-13 13:49:43,015 epoch 53 - iter 490/493 - loss 0.19276253 throughput (samples/sec): 178.94
2019-08-13 13:49:43,417 ----------------------------------------------------------------------------------------------------
2019-08-13 13:49:43,418 EPOCH 53 done: loss 0.1928 - lr 0.1000
2019-08-13 13:49:43,418 BAD EPOCHS (no improvement): 0
2019-08-13 13:49:43,418 ----------------------------------------------------------------------------------------------------
2019-08-13 13:49:43,605 epoch 54 - iter 0/493 - loss 0.05410907 throughput (samples/sec): 8426.07
2019-08-13 13:49:52,417 epoch 54 - iter 49/493 - loss 0.17829184 throughput (samples/sec): 178.45
2019-08-13 13:50:00,893 epoch 54 - iter 98/493 - loss 0.18906935 throughput (samples/sec): 185.55
2019-08-13 13:50:09,746 epoch 54 - iter 147/493 - loss 0.18482968 throughput (samples/sec): 177.61
2019-08-13 13:50:18,546 epoch 54 - iter 196/493 - loss 0.18601380 throughput (samples/sec): 178.67
2019-08-13 13:50:27,027 epoch 54 - iter 245/493 - loss 0.17703706 throughput (samples/sec): 185.44
2019-08-13 13:50:35,524 epoch 54 - iter 294/493 - loss 0.18352570 throughput (samples/sec): 185.08
2019-08-13 13:50:44,230 epoch 54 - iter 343/493 - loss 0.18551989 throughput (samples/sec): 180.61
2019-08-13 13:50:52,846 epoch 54 - iter 392/493 - loss 0.18625803 throughput (samples/sec): 182.52
2019-08-13 13:51:01,660 epoch 54 - iter 441/493 - loss 0.18831141 throughput (samples/sec): 178.41
2019-08-13 13:51:10,056 epoch 54 - iter 490/493 - loss 0.18547113 throughput (samples/sec): 187.31
2019-08-13 13:51:10,358 ----------------------------------------------------------------------------------------------------
2019-08-13 13:51:10,358 EPOCH 54 done: loss 0.1853 - lr 0.1000
2019-08-13 13:51:10,359 BAD EPOCHS (no improvement): 0
2019-08-13 13:51:10,359 ----------------------------------------------------------------------------------------------------
2019-08-13 13:51:10,535 epoch 55 - iter 0/493 - loss 0.27022129 throughput (samples/sec): 8931.54
2019-08-13 13:51:19,028 epoch 55 - iter 49/493 - loss 0.19575577 throughput (samples/sec): 185.18
2019-08-13 13:51:27,291 epoch 55 - iter 98/493 - loss 0.18202834 throughput (samples/sec): 190.34
2019-08-13 13:51:35,855 epoch 55 - iter 147/493 - loss 0.19668895 throughput (samples/sec): 183.62
2019-08-13 13:51:44,473 epoch 55 - iter 196/493 - loss 0.19697697 throughput (samples/sec): 182.46
2019-08-13 13:51:52,779 epoch 55 - iter 245/493 - loss 0.19922227 throughput (samples/sec): 189.35
2019-08-13 13:52:01,141 epoch 55 - iter 294/493 - loss 0.20250797 throughput (samples/sec): 188.07
2019-08-13 13:52:10,206 epoch 55 - iter 343/493 - loss 0.20198044 throughput (samples/sec): 173.46
2019-08-13 13:52:18,880 epoch 55 - iter 392/493 - loss 0.19773541 throughput (samples/sec): 181.28
2019-08-13 13:52:27,342 epoch 55 - iter 441/493 - loss 0.19474941 throughput (samples/sec): 185.87
2019-08-13 13:52:36,238 epoch 55 - iter 490/493 - loss 0.19598700 throughput (samples/sec): 176.75
2019-08-13 13:52:36,582 ----------------------------------------------------------------------------------------------------
2019-08-13 13:52:36,582 EPOCH 55 done: loss 0.1958 - lr 0.1000
2019-08-13 13:52:36,582 BAD EPOCHS (no improvement): 1
2019-08-13 13:52:36,583 ----------------------------------------------------------------------------------------------------
2019-08-13 13:52:36,736 epoch 56 - iter 0/493 - loss 0.14742017 throughput (samples/sec): 10298.61
2019-08-13 13:52:45,504 epoch 56 - iter 49/493 - loss 0.15460273 throughput (samples/sec): 179.34
2019-08-13 13:52:54,302 epoch 56 - iter 98/493 - loss 0.17379424 throughput (samples/sec): 178.72
2019-08-13 13:53:02,978 epoch 56 - iter 147/493 - loss 0.16406477 throughput (samples/sec): 181.26
2019-08-13 13:53:11,431 epoch 56 - iter 196/493 - loss 0.16871137 throughput (samples/sec): 186.04
2019-08-13 13:53:19,897 epoch 56 - iter 245/493 - loss 0.17114755 throughput (samples/sec): 185.76
2019-08-13 13:53:28,764 epoch 56 - iter 294/493 - loss 0.17264912 throughput (samples/sec): 177.33
2019-08-13 13:53:37,274 epoch 56 - iter 343/493 - loss 0.18014659 throughput (samples/sec): 184.80
2019-08-13 13:53:45,763 epoch 56 - iter 392/493 - loss 0.17702290 throughput (samples/sec): 185.26
2019-08-13 13:53:54,417 epoch 56 - iter 441/493 - loss 0.17767964 throughput (samples/sec): 181.70
2019-08-13 13:54:02,587 epoch 56 - iter 490/493 - loss 0.17781591 throughput (samples/sec): 192.51
2019-08-13 13:54:02,957 ----------------------------------------------------------------------------------------------------
2019-08-13 13:54:02,957 EPOCH 56 done: loss 0.1773 - lr 0.1000
2019-08-13 13:54:02,957 BAD EPOCHS (no improvement): 0
2019-08-13 13:54:02,958 ----------------------------------------------------------------------------------------------------
2019-08-13 13:54:03,125 epoch 57 - iter 0/493 - loss 0.17734194 throughput (samples/sec): 9405.72
2019-08-13 13:54:11,734 epoch 57 - iter 49/493 - loss 0.20601394 throughput (samples/sec): 182.67
2019-08-13 13:54:20,494 epoch 57 - iter 98/493 - loss 0.17690941 throughput (samples/sec): 179.51
2019-08-13 13:54:29,349 epoch 57 - iter 147/493 - loss 0.17618170 throughput (samples/sec): 177.58
2019-08-13 13:54:37,915 epoch 57 - iter 196/493 - loss 0.17091835 throughput (samples/sec): 183.59
2019-08-13 13:54:46,341 epoch 57 - iter 245/493 - loss 0.17664622 throughput (samples/sec): 186.63
2019-08-13 13:54:54,887 epoch 57 - iter 294/493 - loss 0.17630082 throughput (samples/sec): 184.03
2019-08-13 13:55:03,641 epoch 57 - iter 343/493 - loss 0.17546327 throughput (samples/sec): 179.62
2019-08-13 13:55:12,050 epoch 57 - iter 392/493 - loss 0.17806788 throughput (samples/sec): 187.02
2019-08-13 13:55:20,959 epoch 57 - iter 441/493 - loss 0.18386903 throughput (samples/sec): 176.49
2019-08-13 13:55:29,415 epoch 57 - iter 490/493 - loss 0.18620315 throughput (samples/sec): 185.98
2019-08-13 13:55:29,779 ----------------------------------------------------------------------------------------------------
2019-08-13 13:55:29,780 EPOCH 57 done: loss 0.1871 - lr 0.1000
2019-08-13 13:55:29,780 BAD EPOCHS (no improvement): 1
2019-08-13 13:55:29,780 ----------------------------------------------------------------------------------------------------
2019-08-13 13:55:29,971 epoch 58 - iter 0/493 - loss 0.24860367 throughput (samples/sec): 8263.05
2019-08-13 13:55:38,556 epoch 58 - iter 49/493 - loss 0.18496217 throughput (samples/sec): 183.17
2019-08-13 13:55:46,947 epoch 58 - iter 98/493 - loss 0.17463885 throughput (samples/sec): 187.42
2019-08-13 13:55:55,332 epoch 58 - iter 147/493 - loss 0.18375687 throughput (samples/sec): 187.56
2019-08-13 13:56:03,803 epoch 58 - iter 196/493 - loss 0.18381316 throughput (samples/sec): 185.66
2019-08-13 13:56:12,558 epoch 58 - iter 245/493 - loss 0.18155176 throughput (samples/sec): 179.61
2019-08-13 13:56:21,045 epoch 58 - iter 294/493 - loss 0.18492559 throughput (samples/sec): 185.30
2019-08-13 13:56:29,774 epoch 58 - iter 343/493 - loss 0.18356461 throughput (samples/sec): 180.13
2019-08-13 13:56:38,258 epoch 58 - iter 392/493 - loss 0.17814990 throughput (samples/sec): 185.37
2019-08-13 13:56:47,427 epoch 58 - iter 441/493 - loss 0.17974223 throughput (samples/sec): 171.47
2019-08-13 13:56:55,919 epoch 58 - iter 490/493 - loss 0.18011574 throughput (samples/sec): 185.19
2019-08-13 13:56:56,404 ----------------------------------------------------------------------------------------------------
2019-08-13 13:56:56,404 EPOCH 58 done: loss 0.1807 - lr 0.1000
2019-08-13 13:56:56,404 BAD EPOCHS (no improvement): 2
2019-08-13 13:56:56,404 ----------------------------------------------------------------------------------------------------
2019-08-13 13:56:56,580 epoch 59 - iter 0/493 - loss 0.14894944 throughput (samples/sec): 8991.46
2019-08-13 13:57:05,160 epoch 59 - iter 49/493 - loss 0.16639755 throughput (samples/sec): 183.27
2019-08-13 13:57:13,550 epoch 59 - iter 98/493 - loss 0.16645714 throughput (samples/sec): 187.46
2019-08-13 13:57:21,827 epoch 59 - iter 147/493 - loss 0.16323380 throughput (samples/sec): 190.01
2019-08-13 13:57:30,368 epoch 59 - iter 196/493 - loss 0.15858471 throughput (samples/sec): 184.12
2019-08-13 13:57:38,987 epoch 59 - iter 245/493 - loss 0.16219947 throughput (samples/sec): 182.46
2019-08-13 13:57:48,105 epoch 59 - iter 294/493 - loss 0.16399589 throughput (samples/sec): 172.43
2019-08-13 13:57:56,643 epoch 59 - iter 343/493 - loss 0.16721037 throughput (samples/sec): 184.20
2019-08-13 13:58:05,708 epoch 59 - iter 392/493 - loss 0.16794018 throughput (samples/sec): 173.44
2019-08-13 13:58:14,195 epoch 59 - iter 441/493 - loss 0.16722767 throughput (samples/sec): 185.31
2019-08-13 13:58:22,465 epoch 59 - iter 490/493 - loss 0.16664719 throughput (samples/sec): 190.17
2019-08-13 13:58:22,826 ----------------------------------------------------------------------------------------------------
2019-08-13 13:58:22,826 EPOCH 59 done: loss 0.1668 - lr 0.1000
2019-08-13 13:58:22,826 BAD EPOCHS (no improvement): 0
2019-08-13 13:58:22,826 ----------------------------------------------------------------------------------------------------
2019-08-13 13:58:22,990 epoch 60 - iter 0/493 - loss 0.08807170 throughput (samples/sec): 9593.61
2019-08-13 13:58:31,313 epoch 60 - iter 49/493 - loss 0.13402895 throughput (samples/sec): 188.98
2019-08-13 13:58:39,994 epoch 60 - iter 98/493 - loss 0.13253379 throughput (samples/sec): 181.13
2019-08-13 13:58:48,292 epoch 60 - iter 147/493 - loss 0.14651745 throughput (samples/sec): 189.53
2019-08-13 13:58:56,730 epoch 60 - iter 196/493 - loss 0.15001050 throughput (samples/sec): 186.40
2019-08-13 13:59:05,211 epoch 60 - iter 245/493 - loss 0.15826376 throughput (samples/sec): 185.41
2019-08-13 13:59:14,328 epoch 60 - iter 294/493 - loss 0.16099535 throughput (samples/sec): 172.47
2019-08-13 13:59:23,253 epoch 60 - iter 343/493 - loss 0.16364460 throughput (samples/sec): 176.19
2019-08-13 13:59:31,719 epoch 60 - iter 392/493 - loss 0.16454670 throughput (samples/sec): 185.77
2019-08-13 13:59:40,486 epoch 60 - iter 441/493 - loss 0.16697537 throughput (samples/sec): 179.37
2019-08-13 13:59:49,095 epoch 60 - iter 490/493 - loss 0.16910700 throughput (samples/sec): 182.66
2019-08-13 13:59:49,434 ----------------------------------------------------------------------------------------------------
2019-08-13 13:59:49,434 EPOCH 60 done: loss 0.1688 - lr 0.1000
2019-08-13 13:59:49,434 BAD EPOCHS (no improvement): 1
2019-08-13 13:59:49,434 ----------------------------------------------------------------------------------------------------
2019-08-13 13:59:49,608 epoch 61 - iter 0/493 - loss 0.06532961 throughput (samples/sec): 9079.21
2019-08-13 13:59:58,108 epoch 61 - iter 49/493 - loss 0.13690905 throughput (samples/sec): 185.01
2019-08-13 14:00:06,998 epoch 61 - iter 98/493 - loss 0.17322578 throughput (samples/sec): 176.87
2019-08-13 14:00:15,426 epoch 61 - iter 147/493 - loss 0.16897484 throughput (samples/sec): 186.59
2019-08-13 14:00:23,754 epoch 61 - iter 196/493 - loss 0.16537393 throughput (samples/sec): 188.85
2019-08-13 14:00:32,480 epoch 61 - iter 245/493 - loss 0.16748502 throughput (samples/sec): 180.22
2019-08-13 14:00:41,411 epoch 61 - iter 294/493 - loss 0.17041871 throughput (samples/sec): 176.05
2019-08-13 14:00:49,793 epoch 61 - iter 343/493 - loss 0.16482247 throughput (samples/sec): 187.62
2019-08-13 14:00:58,549 epoch 61 - iter 392/493 - loss 0.16570040 throughput (samples/sec): 179.60
2019-08-13 14:01:07,385 epoch 61 - iter 441/493 - loss 0.16407899 throughput (samples/sec): 177.97
2019-08-13 14:01:15,967 epoch 61 - iter 490/493 - loss 0.17190961 throughput (samples/sec): 183.23
2019-08-13 14:01:16,300 ----------------------------------------------------------------------------------------------------
2019-08-13 14:01:16,301 EPOCH 61 done: loss 0.1715 - lr 0.1000
2019-08-13 14:01:16,301 BAD EPOCHS (no improvement): 2
2019-08-13 14:01:16,301 ----------------------------------------------------------------------------------------------------
2019-08-13 14:01:16,448 epoch 62 - iter 0/493 - loss 0.00582600 throughput (samples/sec): 10706.23
2019-08-13 14:01:24,876 epoch 62 - iter 49/493 - loss 0.12428242 throughput (samples/sec): 186.60
2019-08-13 14:01:33,573 epoch 62 - iter 98/493 - loss 0.15464350 throughput (samples/sec): 180.82
2019-08-13 14:01:42,265 epoch 62 - iter 147/493 - loss 0.16740625 throughput (samples/sec): 180.90
2019-08-13 14:01:50,600 epoch 62 - iter 196/493 - loss 0.16783225 throughput (samples/sec): 188.68
2019-08-13 14:01:59,344 epoch 62 - iter 245/493 - loss 0.17183657 throughput (samples/sec): 179.83
2019-08-13 14:02:07,733 epoch 62 - iter 294/493 - loss 0.17501722 throughput (samples/sec): 187.47
2019-08-13 14:02:16,557 epoch 62 - iter 343/493 - loss 0.17717036 throughput (samples/sec): 178.21
2019-08-13 14:02:25,308 epoch 62 - iter 392/493 - loss 0.17777706 throughput (samples/sec): 179.69
2019-08-13 14:02:33,769 epoch 62 - iter 441/493 - loss 0.17667191 throughput (samples/sec): 185.87
2019-08-13 14:02:42,446 epoch 62 - iter 490/493 - loss 0.17572807 throughput (samples/sec): 181.23
2019-08-13 14:02:42,806 ----------------------------------------------------------------------------------------------------
2019-08-13 14:02:42,806 EPOCH 62 done: loss 0.1758 - lr 0.1000
2019-08-13 14:02:42,806 BAD EPOCHS (no improvement): 3
2019-08-13 14:02:42,806 ----------------------------------------------------------------------------------------------------
2019-08-13 14:02:43,012 epoch 63 - iter 0/493 - loss 0.19633782 throughput (samples/sec): 7657.65
2019-08-13 14:02:51,379 epoch 63 - iter 49/493 - loss 0.19679528 throughput (samples/sec): 187.95
2019-08-13 14:02:59,999 epoch 63 - iter 98/493 - loss 0.18658040 throughput (samples/sec): 182.43
2019-08-13 14:03:08,544 epoch 63 - iter 147/493 - loss 0.18034645 throughput (samples/sec): 184.05
2019-08-13 14:03:17,046 epoch 63 - iter 196/493 - loss 0.17601248 throughput (samples/sec): 184.96
2019-08-13 14:03:25,435 epoch 63 - iter 245/493 - loss 0.17392074 throughput (samples/sec): 187.48
2019-08-13 14:03:34,630 epoch 63 - iter 294/493 - loss 0.17099954 throughput (samples/sec): 171.00
2019-08-13 14:03:43,421 epoch 63 - iter 343/493 - loss 0.16896377 throughput (samples/sec): 178.86
2019-08-13 14:03:51,893 epoch 63 - iter 392/493 - loss 0.17123750 throughput (samples/sec): 185.65
2019-08-13 14:04:00,798 epoch 63 - iter 441/493 - loss 0.16952163 throughput (samples/sec): 176.57
2019-08-13 14:04:09,197 epoch 63 - iter 490/493 - loss 0.16858163 throughput (samples/sec): 187.25
2019-08-13 14:04:09,539 ----------------------------------------------------------------------------------------------------
2019-08-13 14:04:09,539 EPOCH 63 done: loss 0.1684 - lr 0.1000
2019-08-13 14:04:09,540 BAD EPOCHS (no improvement): 4
2019-08-13 14:04:09,540 ----------------------------------------------------------------------------------------------------
2019-08-13 14:04:09,684 epoch 64 - iter 0/493 - loss 0.14104852 throughput (samples/sec): 10957.12
2019-08-13 14:04:18,019 epoch 64 - iter 49/493 - loss 0.14252550 throughput (samples/sec): 188.68
2019-08-13 14:04:26,549 epoch 64 - iter 98/493 - loss 0.14073285 throughput (samples/sec): 184.36
2019-08-13 14:04:34,923 epoch 64 - iter 147/493 - loss 0.14650798 throughput (samples/sec): 187.82
2019-08-13 14:04:43,683 epoch 64 - iter 196/493 - loss 0.14778361 throughput (samples/sec): 179.50
2019-08-13 14:04:52,702 epoch 64 - iter 245/493 - loss 0.14923975 throughput (samples/sec): 174.33
2019-08-13 14:05:01,231 epoch 64 - iter 294/493 - loss 0.15117273 throughput (samples/sec): 184.38
2019-08-13 14:05:09,773 epoch 64 - iter 343/493 - loss 0.15371011 throughput (samples/sec): 184.12
2019-08-13 14:05:18,143 epoch 64 - iter 392/493 - loss 0.15171335 throughput (samples/sec): 187.90
2019-08-13 14:05:27,344 epoch 64 - iter 441/493 - loss 0.14882477 throughput (samples/sec): 170.88
2019-08-13 14:05:35,761 epoch 64 - iter 490/493 - loss 0.15272743 throughput (samples/sec): 186.84
2019-08-13 14:05:36,174 ----------------------------------------------------------------------------------------------------
2019-08-13 14:05:36,174 EPOCH 64 done: loss 0.1530 - lr 0.0500
2019-08-13 14:05:36,174 BAD EPOCHS (no improvement): 0
2019-08-13 14:05:36,174 ----------------------------------------------------------------------------------------------------
2019-08-13 14:05:36,358 epoch 65 - iter 0/493 - loss 0.05908602 throughput (samples/sec): 8597.23
2019-08-13 14:05:45,110 epoch 65 - iter 49/493 - loss 0.14518051 throughput (samples/sec): 179.68
2019-08-13 14:05:53,654 epoch 65 - iter 98/493 - loss 0.14007788 throughput (samples/sec): 184.04
2019-08-13 14:06:02,450 epoch 65 - iter 147/493 - loss 0.14495020 throughput (samples/sec): 178.77
2019-08-13 14:06:11,030 epoch 65 - iter 196/493 - loss 0.14878727 throughput (samples/sec): 183.29
2019-08-13 14:06:19,545 epoch 65 - iter 245/493 - loss 0.14485525 throughput (samples/sec): 184.69
2019-08-13 14:06:27,979 epoch 65 - iter 294/493 - loss 0.14221352 throughput (samples/sec): 186.47
2019-08-13 14:06:36,240 epoch 65 - iter 343/493 - loss 0.14170649 throughput (samples/sec): 190.37
2019-08-13 14:06:44,745 epoch 65 - iter 392/493 - loss 0.14303634 throughput (samples/sec): 184.91
2019-08-13 14:06:53,225 epoch 65 - iter 441/493 - loss 0.14535102 throughput (samples/sec): 185.47
2019-08-13 14:07:02,422 epoch 65 - iter 490/493 - loss 0.14401212 throughput (samples/sec): 170.95
2019-08-13 14:07:02,725 ----------------------------------------------------------------------------------------------------
2019-08-13 14:07:02,725 EPOCH 65 done: loss 0.1444 - lr 0.0500
2019-08-13 14:07:02,726 BAD EPOCHS (no improvement): 0
2019-08-13 14:07:02,726 ----------------------------------------------------------------------------------------------------
2019-08-13 14:07:02,889 epoch 66 - iter 0/493 - loss 0.04337835 throughput (samples/sec): 9687.44
2019-08-13 14:07:11,412 epoch 66 - iter 49/493 - loss 0.14125566 throughput (samples/sec): 184.52
2019-08-13 14:07:19,983 epoch 66 - iter 98/493 - loss 0.13216875 throughput (samples/sec): 183.47
2019-08-13 14:07:28,737 epoch 66 - iter 147/493 - loss 0.13878778 throughput (samples/sec): 179.63
2019-08-13 14:07:37,457 epoch 66 - iter 196/493 - loss 0.14309951 throughput (samples/sec): 180.32
2019-08-13 14:07:45,817 epoch 66 - iter 245/493 - loss 0.13591532 throughput (samples/sec): 188.12
2019-08-13 14:07:54,439 epoch 66 - iter 294/493 - loss 0.13617079 throughput (samples/sec): 182.40
2019-08-13 14:08:03,462 epoch 66 - iter 343/493 - loss 0.13500133 throughput (samples/sec): 174.26
2019-08-13 14:08:12,130 epoch 66 - iter 392/493 - loss 0.13363425 throughput (samples/sec): 181.41
2019-08-13 14:08:20,482 epoch 66 - iter 441/493 - loss 0.13348304 throughput (samples/sec): 188.30
2019-08-13 14:08:29,019 epoch 66 - iter 490/493 - loss 0.13920046 throughput (samples/sec): 184.21
2019-08-13 14:08:29,347 ----------------------------------------------------------------------------------------------------
2019-08-13 14:08:29,347 EPOCH 66 done: loss 0.1392 - lr 0.0500
2019-08-13 14:08:29,347 BAD EPOCHS (no improvement): 0
2019-08-13 14:08:29,347 ----------------------------------------------------------------------------------------------------
2019-08-13 14:08:29,538 epoch 67 - iter 0/493 - loss 0.01409811 throughput (samples/sec): 8274.93
2019-08-13 14:08:37,928 epoch 67 - iter 49/493 - loss 0.14478586 throughput (samples/sec): 187.45
2019-08-13 14:08:46,373 epoch 67 - iter 98/493 - loss 0.13696950 throughput (samples/sec): 186.21
2019-08-13 14:08:55,277 epoch 67 - iter 147/493 - loss 0.14291842 throughput (samples/sec): 176.61
2019-08-13 14:09:03,919 epoch 67 - iter 196/493 - loss 0.14367563 throughput (samples/sec): 181.96
2019-08-13 14:09:12,605 epoch 67 - iter 245/493 - loss 0.14302778 throughput (samples/sec): 181.04
2019-08-13 14:09:21,451 epoch 67 - iter 294/493 - loss 0.13991513 throughput (samples/sec): 177.75
2019-08-13 14:09:29,984 epoch 67 - iter 343/493 - loss 0.13771244 throughput (samples/sec): 184.30
2019-08-13 14:09:38,673 epoch 67 - iter 392/493 - loss 0.13750911 throughput (samples/sec): 180.98
2019-08-13 14:09:47,153 epoch 67 - iter 441/493 - loss 0.13765153 throughput (samples/sec): 185.46
2019-08-13 14:09:55,632 epoch 67 - iter 490/493 - loss 0.13899216 throughput (samples/sec): 185.48
2019-08-13 14:09:55,940 ----------------------------------------------------------------------------------------------------
2019-08-13 14:09:55,940 EPOCH 67 done: loss 0.1389 - lr 0.0500
2019-08-13 14:09:55,940 BAD EPOCHS (no improvement): 0
2019-08-13 14:09:55,940 ----------------------------------------------------------------------------------------------------
2019-08-13 14:09:56,114 epoch 68 - iter 0/493 - loss 0.13803786 throughput (samples/sec): 9068.84
2019-08-13 14:10:05,290 epoch 68 - iter 49/493 - loss 0.15958914 throughput (samples/sec): 171.34
2019-08-13 14:10:13,913 epoch 68 - iter 98/493 - loss 0.14773254 throughput (samples/sec): 182.38
2019-08-13 14:10:22,517 epoch 68 - iter 147/493 - loss 0.14099311 throughput (samples/sec): 182.77
2019-08-13 14:10:30,820 epoch 68 - iter 196/493 - loss 0.13922652 throughput (samples/sec): 189.42
2019-08-13 14:10:39,322 epoch 68 - iter 245/493 - loss 0.13404154 throughput (samples/sec): 184.97
2019-08-13 14:10:48,072 epoch 68 - iter 294/493 - loss 0.13659344 throughput (samples/sec): 179.71
2019-08-13 14:10:56,776 epoch 68 - iter 343/493 - loss 0.13629619 throughput (samples/sec): 180.66
2019-08-13 14:11:05,215 epoch 68 - iter 392/493 - loss 0.13664670 throughput (samples/sec): 186.36
2019-08-13 14:11:14,020 epoch 68 - iter 441/493 - loss 0.13295689 throughput (samples/sec): 178.59
2019-08-13 14:11:22,551 epoch 68 - iter 490/493 - loss 0.13671381 throughput (samples/sec): 184.34
2019-08-13 14:11:22,892 ----------------------------------------------------------------------------------------------------
2019-08-13 14:11:22,893 EPOCH 68 done: loss 0.1365 - lr 0.0500
2019-08-13 14:11:22,893 BAD EPOCHS (no improvement): 0
2019-08-13 14:11:22,893 ----------------------------------------------------------------------------------------------------
2019-08-13 14:11:23,042 epoch 69 - iter 0/493 - loss 0.15433574 throughput (samples/sec): 10583.92
2019-08-13 14:11:31,310 epoch 69 - iter 49/493 - loss 0.10142608 throughput (samples/sec): 190.21
2019-08-13 14:11:39,977 epoch 69 - iter 98/493 - loss 0.11662814 throughput (samples/sec): 181.45
2019-08-13 14:11:48,655 epoch 69 - iter 147/493 - loss 0.12749814 throughput (samples/sec): 181.21
2019-08-13 14:11:56,870 epoch 69 - iter 196/493 - loss 0.12634154 throughput (samples/sec): 191.45
2019-08-13 14:12:05,260 epoch 69 - iter 245/493 - loss 0.12275177 throughput (samples/sec): 187.45
2019-08-13 14:12:14,125 epoch 69 - iter 294/493 - loss 0.12645979 throughput (samples/sec): 177.36
2019-08-13 14:12:22,936 epoch 69 - iter 343/493 - loss 0.13263801 throughput (samples/sec): 178.46
2019-08-13 14:12:31,695 epoch 69 - iter 392/493 - loss 0.13103346 throughput (samples/sec): 179.52
2019-08-13 14:12:40,432 epoch 69 - iter 441/493 - loss 0.13247717 throughput (samples/sec): 179.99
2019-08-13 14:12:49,052 epoch 69 - iter 490/493 - loss 0.13413542 throughput (samples/sec): 182.44
2019-08-13 14:12:49,494 ----------------------------------------------------------------------------------------------------
2019-08-13 14:12:49,494 EPOCH 69 done: loss 0.1342 - lr 0.0500
2019-08-13 14:12:49,494 BAD EPOCHS (no improvement): 0
2019-08-13 14:12:49,494 ----------------------------------------------------------------------------------------------------
2019-08-13 14:12:49,645 epoch 70 - iter 0/493 - loss 0.12874922 throughput (samples/sec): 10444.49
2019-08-13 14:12:58,205 epoch 70 - iter 49/493 - loss 0.13110073 throughput (samples/sec): 183.71
2019-08-13 14:13:07,018 epoch 70 - iter 98/493 - loss 0.12928193 throughput (samples/sec): 178.43
2019-08-13 14:13:15,388 epoch 70 - iter 147/493 - loss 0.12220742 throughput (samples/sec): 187.90
2019-08-13 14:13:24,282 epoch 70 - iter 196/493 - loss 0.12458057 throughput (samples/sec): 176.80
2019-08-13 14:13:32,617 epoch 70 - iter 245/493 - loss 0.12413980 throughput (samples/sec): 188.70
2019-08-13 14:13:41,199 epoch 70 - iter 294/493 - loss 0.12610418 throughput (samples/sec): 183.24
2019-08-13 14:13:49,924 epoch 70 - iter 343/493 - loss 0.12673930 throughput (samples/sec): 180.22
2019-08-13 14:13:58,543 epoch 70 - iter 392/493 - loss 0.12766043 throughput (samples/sec): 182.47
2019-08-13 14:14:07,351 epoch 70 - iter 441/493 - loss 0.13067307 throughput (samples/sec): 178.51
2019-08-13 14:14:15,831 epoch 70 - iter 490/493 - loss 0.13069815 throughput (samples/sec): 185.47
2019-08-13 14:14:16,267 ----------------------------------------------------------------------------------------------------
2019-08-13 14:14:16,267 EPOCH 70 done: loss 0.1309 - lr 0.0500
2019-08-13 14:14:16,267 BAD EPOCHS (no improvement): 0
2019-08-13 14:14:16,267 ----------------------------------------------------------------------------------------------------
2019-08-13 14:14:16,449 epoch 71 - iter 0/493 - loss 0.04841250 throughput (samples/sec): 8671.25
2019-08-13 14:14:25,550 epoch 71 - iter 49/493 - loss 0.13030074 throughput (samples/sec): 172.77
2019-08-13 14:14:33,999 epoch 71 - iter 98/493 - loss 0.12417500 throughput (samples/sec): 186.12
2019-08-13 14:14:42,422 epoch 71 - iter 147/493 - loss 0.12871574 throughput (samples/sec): 186.70
2019-08-13 14:14:50,942 epoch 71 - iter 196/493 - loss 0.13056458 throughput (samples/sec): 184.58
2019-08-13 14:14:59,693 epoch 71 - iter 245/493 - loss 0.12850430 throughput (samples/sec): 179.70
2019-08-13 14:15:08,125 epoch 71 - iter 294/493 - loss 0.13301173 throughput (samples/sec): 186.50
2019-08-13 14:15:17,026 epoch 71 - iter 343/493 - loss 0.13236315 throughput (samples/sec): 176.66
2019-08-13 14:15:25,748 epoch 71 - iter 392/493 - loss 0.12862294 throughput (samples/sec): 180.29
2019-08-13 14:15:34,077 epoch 71 - iter 441/493 - loss 0.12793844 throughput (samples/sec): 188.82
2019-08-13 14:15:42,319 epoch 71 - iter 490/493 - loss 0.12727322 throughput (samples/sec): 190.83
2019-08-13 14:15:42,718 ----------------------------------------------------------------------------------------------------
2019-08-13 14:15:42,719 EPOCH 71 done: loss 0.1272 - lr 0.0500
2019-08-13 14:15:42,719 BAD EPOCHS (no improvement): 0
2019-08-13 14:15:42,719 ----------------------------------------------------------------------------------------------------
2019-08-13 14:15:42,916 epoch 72 - iter 0/493 - loss 0.05543905 throughput (samples/sec): 7994.57
2019-08-13 14:15:51,540 epoch 72 - iter 49/493 - loss 0.12594792 throughput (samples/sec): 182.34
2019-08-13 14:16:00,153 epoch 72 - iter 98/493 - loss 0.13488134 throughput (samples/sec): 182.59
2019-08-13 14:16:08,910 epoch 72 - iter 147/493 - loss 0.12516541 throughput (samples/sec): 179.57
2019-08-13 14:16:17,506 epoch 72 - iter 196/493 - loss 0.12571737 throughput (samples/sec): 182.95
2019-08-13 14:16:26,009 epoch 72 - iter 245/493 - loss 0.12534870 throughput (samples/sec): 184.96
2019-08-13 14:16:34,909 epoch 72 - iter 294/493 - loss 0.12724307 throughput (samples/sec): 176.68
2019-08-13 14:16:43,315 epoch 72 - iter 343/493 - loss 0.12647760 throughput (samples/sec): 187.09
2019-08-13 14:16:51,608 epoch 72 - iter 392/493 - loss 0.12866807 throughput (samples/sec): 189.64
2019-08-13 14:17:00,540 epoch 72 - iter 441/493 - loss 0.13070508 throughput (samples/sec): 176.03
2019-08-13 14:17:08,950 epoch 72 - iter 490/493 - loss 0.13041367 throughput (samples/sec): 186.99
2019-08-13 14:17:09,267 ----------------------------------------------------------------------------------------------------
2019-08-13 14:17:09,267 EPOCH 72 done: loss 0.1302 - lr 0.0500
2019-08-13 14:17:09,268 BAD EPOCHS (no improvement): 1
2019-08-13 14:17:09,268 ----------------------------------------------------------------------------------------------------
2019-08-13 14:17:09,432 epoch 73 - iter 0/493 - loss 0.02451068 throughput (samples/sec): 9621.33
2019-08-13 14:17:18,246 epoch 73 - iter 49/493 - loss 0.14299687 throughput (samples/sec): 178.40
2019-08-13 14:17:26,948 epoch 73 - iter 98/493 - loss 0.13719838 throughput (samples/sec): 180.72
2019-08-13 14:17:35,702 epoch 73 - iter 147/493 - loss 0.13177209 throughput (samples/sec): 179.62
2019-08-13 14:17:44,322 epoch 73 - iter 196/493 - loss 0.12323476 throughput (samples/sec): 182.43
2019-08-13 14:17:52,997 epoch 73 - iter 245/493 - loss 0.12520199 throughput (samples/sec): 181.29
2019-08-13 14:18:01,773 epoch 73 - iter 294/493 - loss 0.12384841 throughput (samples/sec): 179.17
2019-08-13 14:18:10,774 epoch 73 - iter 343/493 - loss 0.13068991 throughput (samples/sec): 174.70
2019-08-13 14:18:19,211 epoch 73 - iter 392/493 - loss 0.12805902 throughput (samples/sec): 186.41
2019-08-13 14:18:27,234 epoch 73 - iter 441/493 - loss 0.12831151 throughput (samples/sec): 196.03
2019-08-13 14:18:35,637 epoch 73 - iter 490/493 - loss 0.12913829 throughput (samples/sec): 187.16
2019-08-13 14:18:35,979 ----------------------------------------------------------------------------------------------------
2019-08-13 14:18:35,980 EPOCH 73 done: loss 0.1289 - lr 0.0500
2019-08-13 14:18:35,980 BAD EPOCHS (no improvement): 2
2019-08-13 14:18:35,980 ----------------------------------------------------------------------------------------------------
2019-08-13 14:18:36,140 epoch 74 - iter 0/493 - loss 0.07412499 throughput (samples/sec): 9873.48
2019-08-13 14:18:44,783 epoch 74 - iter 49/493 - loss 0.12037854 throughput (samples/sec): 181.95
2019-08-13 14:18:53,175 epoch 74 - iter 98/493 - loss 0.12943130 throughput (samples/sec): 187.40
2019-08-13 14:19:01,691 epoch 74 - iter 147/493 - loss 0.13307981 throughput (samples/sec): 184.67
2019-08-13 14:19:10,354 epoch 74 - iter 196/493 - loss 0.13025313 throughput (samples/sec): 181.52
2019-08-13 14:19:18,878 epoch 74 - iter 245/493 - loss 0.12507085 throughput (samples/sec): 184.49
2019-08-13 14:19:27,628 epoch 74 - iter 294/493 - loss 0.12539609 throughput (samples/sec): 179.72
2019-08-13 14:19:35,992 epoch 74 - iter 343/493 - loss 0.12517776 throughput (samples/sec): 188.03
2019-08-13 14:19:44,480 epoch 74 - iter 392/493 - loss 0.12660615 throughput (samples/sec): 185.28
2019-08-13 14:19:53,842 epoch 74 - iter 441/493 - loss 0.12327867 throughput (samples/sec): 167.94
2019-08-13 14:20:02,236 epoch 74 - iter 490/493 - loss 0.12323734 throughput (samples/sec): 187.36
2019-08-13 14:20:02,630 ----------------------------------------------------------------------------------------------------
2019-08-13 14:20:02,630 EPOCH 74 done: loss 0.1230 - lr 0.0500
2019-08-13 14:20:02,630 BAD EPOCHS (no improvement): 0
2019-08-13 14:20:02,630 ----------------------------------------------------------------------------------------------------
2019-08-13 14:20:02,805 epoch 75 - iter 0/493 - loss 0.10929412 throughput (samples/sec): 9027.80
2019-08-13 14:20:11,833 epoch 75 - iter 49/493 - loss 0.12905306 throughput (samples/sec): 174.17
2019-08-13 14:20:20,412 epoch 75 - iter 98/493 - loss 0.11864185 throughput (samples/sec): 183.31
2019-08-13 14:20:28,880 epoch 75 - iter 147/493 - loss 0.11787230 throughput (samples/sec): 185.72
2019-08-13 14:20:37,403 epoch 75 - iter 196/493 - loss 0.12428484 throughput (samples/sec): 184.51
2019-08-13 14:20:46,288 epoch 75 - iter 245/493 - loss 0.11891050 throughput (samples/sec): 176.96
2019-08-13 14:20:54,775 epoch 75 - iter 294/493 - loss 0.12019204 throughput (samples/sec): 185.32
2019-08-13 14:21:03,173 epoch 75 - iter 343/493 - loss 0.12050509 throughput (samples/sec): 187.25
2019-08-13 14:21:11,822 epoch 75 - iter 392/493 - loss 0.12025060 throughput (samples/sec): 181.82
2019-08-13 14:21:20,332 epoch 75 - iter 441/493 - loss 0.11801601 throughput (samples/sec): 184.80
2019-08-13 14:21:28,855 epoch 75 - iter 490/493 - loss 0.11705725 throughput (samples/sec): 184.51
2019-08-13 14:21:29,202 ----------------------------------------------------------------------------------------------------
2019-08-13 14:21:29,202 EPOCH 75 done: loss 0.1168 - lr 0.0500
2019-08-13 14:21:29,202 BAD EPOCHS (no improvement): 0
2019-08-13 14:21:29,203 ----------------------------------------------------------------------------------------------------
2019-08-13 14:21:29,380 epoch 76 - iter 0/493 - loss 0.07475102 throughput (samples/sec): 8881.35
2019-08-13 14:21:38,275 epoch 76 - iter 49/493 - loss 0.13076539 throughput (samples/sec): 176.78
2019-08-13 14:21:47,017 epoch 76 - iter 98/493 - loss 0.12161269 throughput (samples/sec): 179.87
2019-08-13 14:21:55,380 epoch 76 - iter 147/493 - loss 0.11121851 throughput (samples/sec): 188.05
2019-08-13 14:22:03,895 epoch 76 - iter 196/493 - loss 0.11856514 throughput (samples/sec): 184.69
2019-08-13 14:22:12,461 epoch 76 - iter 245/493 - loss 0.11614218 throughput (samples/sec): 183.59
2019-08-13 14:22:20,834 epoch 76 - iter 294/493 - loss 0.11941647 throughput (samples/sec): 187.83
2019-08-13 14:22:29,445 epoch 76 - iter 343/493 - loss 0.11785895 throughput (samples/sec): 182.63
2019-08-13 14:22:38,373 epoch 76 - iter 392/493 - loss 0.11976947 throughput (samples/sec): 176.12
2019-08-13 14:22:46,954 epoch 76 - iter 441/493 - loss 0.12183257 throughput (samples/sec): 183.26
2019-08-13 14:22:55,700 epoch 76 - iter 490/493 - loss 0.12336961 throughput (samples/sec): 179.79
2019-08-13 14:22:56,103 ----------------------------------------------------------------------------------------------------
2019-08-13 14:22:56,103 EPOCH 76 done: loss 0.1232 - lr 0.0500
2019-08-13 14:22:56,103 BAD EPOCHS (no improvement): 1
2019-08-13 14:22:56,104 ----------------------------------------------------------------------------------------------------
2019-08-13 14:22:56,298 epoch 77 - iter 0/493 - loss 0.00865248 throughput (samples/sec): 8090.78
2019-08-13 14:23:05,360 epoch 77 - iter 49/493 - loss 0.11264164 throughput (samples/sec): 173.52
2019-08-13 14:23:13,784 epoch 77 - iter 98/493 - loss 0.10445335 throughput (samples/sec): 186.68
2019-08-13 14:23:22,368 epoch 77 - iter 147/493 - loss 0.10323484 throughput (samples/sec): 183.19
2019-08-13 14:23:30,739 epoch 77 - iter 196/493 - loss 0.10944856 throughput (samples/sec): 187.88
2019-08-13 14:23:39,097 epoch 77 - iter 245/493 - loss 0.10895774 throughput (samples/sec): 188.17
2019-08-13 14:23:47,796 epoch 77 - iter 294/493 - loss 0.10802982 throughput (samples/sec): 180.76
2019-08-13 14:23:55,852 epoch 77 - iter 343/493 - loss 0.10832131 throughput (samples/sec): 195.23
2019-08-13 14:24:04,456 epoch 77 - iter 392/493 - loss 0.10934658 throughput (samples/sec): 182.78
2019-08-13 14:24:13,036 epoch 77 - iter 441/493 - loss 0.10987452 throughput (samples/sec): 183.28
2019-08-13 14:24:21,833 epoch 77 - iter 490/493 - loss 0.11196654 throughput (samples/sec): 178.75
2019-08-13 14:24:22,573 ----------------------------------------------------------------------------------------------------
2019-08-13 14:24:22,573 EPOCH 77 done: loss 0.1122 - lr 0.0500
2019-08-13 14:24:22,573 BAD EPOCHS (no improvement): 0
2019-08-13 14:24:22,573 ----------------------------------------------------------------------------------------------------
2019-08-13 14:24:22,741 epoch 78 - iter 0/493 - loss 0.05090839 throughput (samples/sec): 9423.21
2019-08-13 14:24:31,152 epoch 78 - iter 49/493 - loss 0.12558413 throughput (samples/sec): 186.96
2019-08-13 14:24:39,810 epoch 78 - iter 98/493 - loss 0.12415632 throughput (samples/sec): 181.63
2019-08-13 14:24:48,280 epoch 78 - iter 147/493 - loss 0.11654910 throughput (samples/sec): 185.68
2019-08-13 14:24:57,106 epoch 78 - iter 196/493 - loss 0.12253626 throughput (samples/sec): 178.18
2019-08-13 14:25:06,001 epoch 78 - iter 245/493 - loss 0.12436433 throughput (samples/sec): 176.77
2019-08-13 14:25:14,722 epoch 78 - iter 294/493 - loss 0.12446803 throughput (samples/sec): 180.31
2019-08-13 14:25:23,227 epoch 78 - iter 343/493 - loss 0.12161946 throughput (samples/sec): 184.91
2019-08-13 14:25:31,869 epoch 78 - iter 392/493 - loss 0.11885826 throughput (samples/sec): 181.98
2019-08-13 14:25:40,574 epoch 78 - iter 441/493 - loss 0.11634240 throughput (samples/sec): 180.64
2019-08-13 14:25:48,935 epoch 78 - iter 490/493 - loss 0.11521450 throughput (samples/sec): 188.10
2019-08-13 14:25:49,275 ----------------------------------------------------------------------------------------------------
2019-08-13 14:25:49,276 EPOCH 78 done: loss 0.1152 - lr 0.0500
2019-08-13 14:25:49,276 BAD EPOCHS (no improvement): 1
2019-08-13 14:25:49,276 ----------------------------------------------------------------------------------------------------
2019-08-13 14:25:49,455 epoch 79 - iter 0/493 - loss 0.01661217 throughput (samples/sec): 8811.08
2019-08-13 14:25:57,932 epoch 79 - iter 49/493 - loss 0.12590038 throughput (samples/sec): 185.51
2019-08-13 14:26:06,574 epoch 79 - iter 98/493 - loss 0.12127228 throughput (samples/sec): 181.97
2019-08-13 14:26:15,139 epoch 79 - iter 147/493 - loss 0.12219668 throughput (samples/sec): 183.61
2019-08-13 14:26:23,470 epoch 79 - iter 196/493 - loss 0.12705651 throughput (samples/sec): 188.78
2019-08-13 14:26:32,398 epoch 79 - iter 245/493 - loss 0.12999329 throughput (samples/sec): 176.12
2019-08-13 14:26:40,765 epoch 79 - iter 294/493 - loss 0.12876909 throughput (samples/sec): 187.97
2019-08-13 14:26:49,214 epoch 79 - iter 343/493 - loss 0.13297090 throughput (samples/sec): 186.14
2019-08-13 14:26:57,628 epoch 79 - iter 392/493 - loss 0.13606221 throughput (samples/sec): 186.91
2019-08-13 14:27:06,381 epoch 79 - iter 441/493 - loss 0.13150275 throughput (samples/sec): 179.65
2019-08-13 14:27:15,341 epoch 79 - iter 490/493 - loss 0.13021771 throughput (samples/sec): 175.49
2019-08-13 14:27:15,697 ----------------------------------------------------------------------------------------------------
2019-08-13 14:27:15,698 EPOCH 79 done: loss 0.1300 - lr 0.0500
2019-08-13 14:27:15,698 BAD EPOCHS (no improvement): 2
2019-08-13 14:27:15,698 ----------------------------------------------------------------------------------------------------
2019-08-13 14:27:15,868 epoch 80 - iter 0/493 - loss 0.09872293 throughput (samples/sec): 9294.87
2019-08-13 14:27:24,237 epoch 80 - iter 49/493 - loss 0.12905185 throughput (samples/sec): 187.91
2019-08-13 14:27:32,820 epoch 80 - iter 98/493 - loss 0.13812296 throughput (samples/sec): 183.23
2019-08-13 14:27:41,691 epoch 80 - iter 147/493 - loss 0.13219716 throughput (samples/sec): 177.26
2019-08-13 14:27:49,897 epoch 80 - iter 196/493 - loss 0.12247885 throughput (samples/sec): 191.66
2019-08-13 14:27:58,581 epoch 80 - iter 245/493 - loss 0.12334596 throughput (samples/sec): 181.08
2019-08-13 14:28:06,994 epoch 80 - iter 294/493 - loss 0.12527446 throughput (samples/sec): 186.94
2019-08-13 14:28:15,983 epoch 80 - iter 343/493 - loss 0.12561508 throughput (samples/sec): 174.92
2019-08-13 14:28:24,607 epoch 80 - iter 392/493 - loss 0.12483221 throughput (samples/sec): 182.34
2019-08-13 14:28:32,863 epoch 80 - iter 441/493 - loss 0.12252756 throughput (samples/sec): 190.51
2019-08-13 14:28:41,382 epoch 80 - iter 490/493 - loss 0.12193188 throughput (samples/sec): 184.59
2019-08-13 14:28:41,714 ----------------------------------------------------------------------------------------------------
2019-08-13 14:28:41,715 EPOCH 80 done: loss 0.1218 - lr 0.0500
2019-08-13 14:28:41,715 BAD EPOCHS (no improvement): 3
2019-08-13 14:28:41,715 ----------------------------------------------------------------------------------------------------
2019-08-13 14:28:41,871 epoch 81 - iter 0/493 - loss 0.05725813 throughput (samples/sec): 10121.80
2019-08-13 14:28:50,470 epoch 81 - iter 49/493 - loss 0.11927916 throughput (samples/sec): 182.88
2019-08-13 14:28:59,201 epoch 81 - iter 98/493 - loss 0.11019794 throughput (samples/sec): 180.10
2019-08-13 14:29:07,808 epoch 81 - iter 147/493 - loss 0.11306850 throughput (samples/sec): 182.70
2019-08-13 14:29:16,877 epoch 81 - iter 196/493 - loss 0.11893307 throughput (samples/sec): 173.37
2019-08-13 14:29:25,235 epoch 81 - iter 245/493 - loss 0.12002630 throughput (samples/sec): 188.18
2019-08-13 14:29:33,482 epoch 81 - iter 294/493 - loss 0.11996450 throughput (samples/sec): 190.71
2019-08-13 14:29:42,215 epoch 81 - iter 343/493 - loss 0.11645748 throughput (samples/sec): 180.07
2019-08-13 14:29:50,562 epoch 81 - iter 392/493 - loss 0.11660789 throughput (samples/sec): 188.41
2019-08-13 14:29:59,498 epoch 81 - iter 441/493 - loss 0.11851549 throughput (samples/sec): 175.96
2019-08-13 14:30:07,860 epoch 81 - iter 490/493 - loss 0.11575036 throughput (samples/sec): 188.09
2019-08-13 14:30:08,221 ----------------------------------------------------------------------------------------------------
2019-08-13 14:30:08,221 EPOCH 81 done: loss 0.1157 - lr 0.0500
2019-08-13 14:30:08,221 BAD EPOCHS (no improvement): 4
2019-08-13 14:30:08,221 ----------------------------------------------------------------------------------------------------
2019-08-13 14:30:08,396 epoch 82 - iter 0/493 - loss 0.02588487 throughput (samples/sec): 9030.83
2019-08-13 14:30:17,181 epoch 82 - iter 49/493 - loss 0.07747845 throughput (samples/sec): 178.99
2019-08-13 14:30:25,410 epoch 82 - iter 98/493 - loss 0.08659739 throughput (samples/sec): 191.13
2019-08-13 14:30:34,070 epoch 82 - iter 147/493 - loss 0.10336804 throughput (samples/sec): 181.60
2019-08-13 14:30:42,468 epoch 82 - iter 196/493 - loss 0.10228812 throughput (samples/sec): 187.26
2019-08-13 14:30:51,500 epoch 82 - iter 245/493 - loss 0.10162311 throughput (samples/sec): 174.08
2019-08-13 14:31:00,096 epoch 82 - iter 294/493 - loss 0.10086260 throughput (samples/sec): 182.95
2019-08-13 14:31:08,633 epoch 82 - iter 343/493 - loss 0.10134978 throughput (samples/sec): 184.21
2019-08-13 14:31:17,189 epoch 82 - iter 392/493 - loss 0.10371354 throughput (samples/sec): 183.80
2019-08-13 14:31:26,081 epoch 82 - iter 441/493 - loss 0.10046498 throughput (samples/sec): 176.84
2019-08-13 14:31:34,554 epoch 82 - iter 490/493 - loss 0.10007221 throughput (samples/sec): 185.62
2019-08-13 14:31:34,911 ----------------------------------------------------------------------------------------------------
2019-08-13 14:31:34,912 EPOCH 82 done: loss 0.1001 - lr 0.0250
2019-08-13 14:31:34,912 BAD EPOCHS (no improvement): 0
2019-08-13 14:31:34,912 ----------------------------------------------------------------------------------------------------
2019-08-13 14:31:35,076 epoch 83 - iter 0/493 - loss 0.02372706 throughput (samples/sec): 9592.29
2019-08-13 14:31:43,754 epoch 83 - iter 49/493 - loss 0.12213796 throughput (samples/sec): 181.22
2019-08-13 14:31:52,268 epoch 83 - iter 98/493 - loss 0.12081178 throughput (samples/sec): 184.70
2019-08-13 14:32:00,400 epoch 83 - iter 147/493 - loss 0.10977439 throughput (samples/sec): 193.40
2019-08-13 14:32:09,146 epoch 83 - iter 196/493 - loss 0.11588317 throughput (samples/sec): 179.80
2019-08-13 14:32:17,730 epoch 83 - iter 245/493 - loss 0.11218601 throughput (samples/sec): 183.20
2019-08-13 14:32:26,727 epoch 83 - iter 294/493 - loss 0.11112680 throughput (samples/sec): 174.76
2019-08-13 14:32:35,150 epoch 83 - iter 343/493 - loss 0.10706347 throughput (samples/sec): 186.73
2019-08-13 14:32:43,893 epoch 83 - iter 392/493 - loss 0.10885047 throughput (samples/sec): 179.86
2019-08-13 14:32:52,499 epoch 83 - iter 441/493 - loss 0.10906311 throughput (samples/sec): 182.72
2019-08-13 14:33:00,927 epoch 83 - iter 490/493 - loss 0.10996847 throughput (samples/sec): 186.59
2019-08-13 14:33:01,454 ----------------------------------------------------------------------------------------------------
2019-08-13 14:33:01,454 EPOCH 83 done: loss 0.1101 - lr 0.0250
2019-08-13 14:33:01,454 BAD EPOCHS (no improvement): 1
2019-08-13 14:33:01,454 ----------------------------------------------------------------------------------------------------
2019-08-13 14:33:01,660 epoch 84 - iter 0/493 - loss 0.13409317 throughput (samples/sec): 7673.50
2019-08-13 14:33:10,380 epoch 84 - iter 49/493 - loss 0.11849903 throughput (samples/sec): 180.34
2019-08-13 14:33:18,749 epoch 84 - iter 98/493 - loss 0.10890091 throughput (samples/sec): 187.91
2019-08-13 14:33:27,404 epoch 84 - iter 147/493 - loss 0.10735587 throughput (samples/sec): 181.70
2019-08-13 14:33:35,872 epoch 84 - iter 196/493 - loss 0.10333306 throughput (samples/sec): 185.70
2019-08-13 14:33:44,490 epoch 84 - iter 245/493 - loss 0.10640074 throughput (samples/sec): 182.47
2019-08-13 14:33:53,347 epoch 84 - iter 294/493 - loss 0.10526007 throughput (samples/sec): 177.55
2019-08-13 14:34:01,675 epoch 84 - iter 343/493 - loss 0.10397685 throughput (samples/sec): 188.85
2019-08-13 14:34:10,412 epoch 84 - iter 392/493 - loss 0.10308617 throughput (samples/sec): 179.98
2019-08-13 14:34:19,245 epoch 84 - iter 441/493 - loss 0.10288272 throughput (samples/sec): 178.02
2019-08-13 14:34:27,773 epoch 84 - iter 490/493 - loss 0.10327477 throughput (samples/sec): 184.40
2019-08-13 14:34:28,124 ----------------------------------------------------------------------------------------------------
2019-08-13 14:34:28,124 EPOCH 84 done: loss 0.1031 - lr 0.0250
2019-08-13 14:34:28,124 BAD EPOCHS (no improvement): 2
2019-08-13 14:34:28,125 ----------------------------------------------------------------------------------------------------
2019-08-13 14:34:28,298 epoch 85 - iter 0/493 - loss 0.08955121 throughput (samples/sec): 9067.74
2019-08-13 14:34:36,593 epoch 85 - iter 49/493 - loss 0.08371199 throughput (samples/sec): 189.61
2019-08-13 14:34:45,190 epoch 85 - iter 98/493 - loss 0.09611509 throughput (samples/sec): 182.91
2019-08-13 14:34:53,533 epoch 85 - iter 147/493 - loss 0.10493437 throughput (samples/sec): 188.52
2019-08-13 14:35:01,862 epoch 85 - iter 196/493 - loss 0.10853505 throughput (samples/sec): 188.82
2019-08-13 14:35:10,904 epoch 85 - iter 245/493 - loss 0.10902344 throughput (samples/sec): 173.89
2019-08-13 14:35:19,782 epoch 85 - iter 294/493 - loss 0.11021483 throughput (samples/sec): 177.12
2019-08-13 14:35:28,123 epoch 85 - iter 343/493 - loss 0.10943437 throughput (samples/sec): 188.55
2019-08-13 14:35:36,689 epoch 85 - iter 392/493 - loss 0.11071907 throughput (samples/sec): 183.58
2019-08-13 14:35:45,439 epoch 85 - iter 441/493 - loss 0.11213809 throughput (samples/sec): 179.72
2019-08-13 14:35:53,948 epoch 85 - iter 490/493 - loss 0.11360883 throughput (samples/sec): 184.83
2019-08-13 14:35:54,320 ----------------------------------------------------------------------------------------------------
2019-08-13 14:35:54,320 EPOCH 85 done: loss 0.1133 - lr 0.0250
2019-08-13 14:35:54,320 BAD EPOCHS (no improvement): 3
2019-08-13 14:35:54,320 ----------------------------------------------------------------------------------------------------
2019-08-13 14:35:54,486 epoch 86 - iter 0/493 - loss 0.21013439 throughput (samples/sec): 9553.09
2019-08-13 14:36:03,043 epoch 86 - iter 49/493 - loss 0.10986072 throughput (samples/sec): 183.78
2019-08-13 14:36:11,574 epoch 86 - iter 98/493 - loss 0.08931731 throughput (samples/sec): 184.32
2019-08-13 14:36:20,117 epoch 86 - iter 147/493 - loss 0.09965009 throughput (samples/sec): 184.09
2019-08-13 14:36:28,885 epoch 86 - iter 196/493 - loss 0.09863684 throughput (samples/sec): 179.32
2019-08-13 14:36:37,413 epoch 86 - iter 245/493 - loss 0.10209567 throughput (samples/sec): 184.40
2019-08-13 14:36:46,154 epoch 86 - iter 294/493 - loss 0.09903859 throughput (samples/sec): 179.89
2019-08-13 14:36:54,631 epoch 86 - iter 343/493 - loss 0.09626342 throughput (samples/sec): 185.51
2019-08-13 14:37:02,832 epoch 86 - iter 392/493 - loss 0.09775238 throughput (samples/sec): 191.79
2019-08-13 14:37:11,497 epoch 86 - iter 441/493 - loss 0.10013404 throughput (samples/sec): 181.48
2019-08-13 14:37:20,157 epoch 86 - iter 490/493 - loss 0.10107684 throughput (samples/sec): 181.58
2019-08-13 14:37:20,615 ----------------------------------------------------------------------------------------------------
2019-08-13 14:37:20,616 EPOCH 86 done: loss 0.1021 - lr 0.0250
2019-08-13 14:37:20,616 BAD EPOCHS (no improvement): 4
2019-08-13 14:37:20,616 ----------------------------------------------------------------------------------------------------
2019-08-13 14:37:20,767 epoch 87 - iter 0/493 - loss 0.09399718 throughput (samples/sec): 10470.92
2019-08-13 14:37:29,218 epoch 87 - iter 49/493 - loss 0.12654075 throughput (samples/sec): 186.08
2019-08-13 14:37:37,634 epoch 87 - iter 98/493 - loss 0.11482414 throughput (samples/sec): 186.86
2019-08-13 14:37:46,363 epoch 87 - iter 147/493 - loss 0.11087506 throughput (samples/sec): 180.13
2019-08-13 14:37:54,939 epoch 87 - iter 196/493 - loss 0.10298807 throughput (samples/sec): 183.37
2019-08-13 14:38:03,975 epoch 87 - iter 245/493 - loss 0.11588833 throughput (samples/sec): 174.01
2019-08-13 14:38:12,428 epoch 87 - iter 294/493 - loss 0.11209602 throughput (samples/sec): 186.05
2019-08-13 14:38:21,032 epoch 87 - iter 343/493 - loss 0.11401893 throughput (samples/sec): 182.76
2019-08-13 14:38:29,721 epoch 87 - iter 392/493 - loss 0.11093620 throughput (samples/sec): 180.97
2019-08-13 14:38:38,048 epoch 87 - iter 441/493 - loss 0.10931241 throughput (samples/sec): 188.85
2019-08-13 14:38:46,592 epoch 87 - iter 490/493 - loss 0.10797298 throughput (samples/sec): 184.06
2019-08-13 14:38:46,942 ----------------------------------------------------------------------------------------------------
2019-08-13 14:38:46,942 EPOCH 87 done: loss 0.1083 - lr 0.0125
2019-08-13 14:38:46,943 BAD EPOCHS (no improvement): 1
2019-08-13 14:38:46,943 ----------------------------------------------------------------------------------------------------
2019-08-13 14:38:47,151 epoch 88 - iter 0/493 - loss 0.13987434 throughput (samples/sec): 7561.08
2019-08-13 14:38:56,102 epoch 88 - iter 49/493 - loss 0.09391599 throughput (samples/sec): 175.66
2019-08-13 14:39:04,706 epoch 88 - iter 98/493 - loss 0.09470037 throughput (samples/sec): 182.77
2019-08-13 14:39:13,158 epoch 88 - iter 147/493 - loss 0.09529360 throughput (samples/sec): 186.06
2019-08-13 14:39:21,535 epoch 88 - iter 196/493 - loss 0.09206748 throughput (samples/sec): 187.71
2019-08-13 14:39:30,574 epoch 88 - iter 245/493 - loss 0.09452911 throughput (samples/sec): 173.94
2019-08-13 14:39:38,998 epoch 88 - iter 294/493 - loss 0.09642692 throughput (samples/sec): 186.69
2019-08-13 14:39:47,559 epoch 88 - iter 343/493 - loss 0.10001238 throughput (samples/sec): 183.69
2019-08-13 14:39:55,714 epoch 88 - iter 392/493 - loss 0.10157899 throughput (samples/sec): 192.84
2019-08-13 14:40:04,263 epoch 88 - iter 441/493 - loss 0.10154617 throughput (samples/sec): 183.94
2019-08-13 14:40:12,855 epoch 88 - iter 490/493 - loss 0.10197414 throughput (samples/sec): 183.02
2019-08-13 14:40:13,180 ----------------------------------------------------------------------------------------------------
2019-08-13 14:40:13,181 EPOCH 88 done: loss 0.1021 - lr 0.0125
2019-08-13 14:40:13,181 BAD EPOCHS (no improvement): 2
2019-08-13 14:40:13,181 ----------------------------------------------------------------------------------------------------
2019-08-13 14:40:13,375 epoch 89 - iter 0/493 - loss 0.11079550 throughput (samples/sec): 8107.23
2019-08-13 14:40:21,734 epoch 89 - iter 49/493 - loss 0.11450938 throughput (samples/sec): 188.15
2019-08-13 14:40:30,376 epoch 89 - iter 98/493 - loss 0.10912788 throughput (samples/sec): 181.94
2019-08-13 14:40:38,984 epoch 89 - iter 147/493 - loss 0.11232777 throughput (samples/sec): 182.69
2019-08-13 14:40:47,789 epoch 89 - iter 196/493 - loss 0.11463517 throughput (samples/sec): 178.58
2019-08-13 14:40:56,235 epoch 89 - iter 245/493 - loss 0.11082146 throughput (samples/sec): 186.19
2019-08-13 14:41:04,394 epoch 89 - iter 294/493 - loss 0.11151577 throughput (samples/sec): 192.76
2019-08-13 14:41:12,892 epoch 89 - iter 343/493 - loss 0.10750066 throughput (samples/sec): 185.07
2019-08-13 14:41:21,476 epoch 89 - iter 392/493 - loss 0.10324256 throughput (samples/sec): 183.17
2019-08-13 14:41:30,275 epoch 89 - iter 441/493 - loss 0.10287727 throughput (samples/sec): 178.71
2019-08-13 14:41:38,844 epoch 89 - iter 490/493 - loss 0.10575462 throughput (samples/sec): 183.51
2019-08-13 14:41:39,170 ----------------------------------------------------------------------------------------------------
2019-08-13 14:41:39,170 EPOCH 89 done: loss 0.1058 - lr 0.0125
2019-08-13 14:41:39,170 BAD EPOCHS (no improvement): 3
2019-08-13 14:41:39,170 ----------------------------------------------------------------------------------------------------
2019-08-13 14:41:39,342 epoch 90 - iter 0/493 - loss 0.10459915 throughput (samples/sec): 9184.44
2019-08-13 14:41:47,469 epoch 90 - iter 49/493 - loss 0.09283458 throughput (samples/sec): 193.53
2019-08-13 14:41:56,078 epoch 90 - iter 98/493 - loss 0.11295318 throughput (samples/sec): 182.66
2019-08-13 14:42:04,492 epoch 90 - iter 147/493 - loss 0.10547867 throughput (samples/sec): 186.90
2019-08-13 14:42:12,971 epoch 90 - iter 196/493 - loss 0.10846027 throughput (samples/sec): 185.48
2019-08-13 14:42:21,594 epoch 90 - iter 245/493 - loss 0.10560272 throughput (samples/sec): 182.34
2019-08-13 14:42:29,977 epoch 90 - iter 294/493 - loss 0.10039493 throughput (samples/sec): 187.59
2019-08-13 14:42:38,629 epoch 90 - iter 343/493 - loss 0.10234349 throughput (samples/sec): 181.75
2019-08-13 14:42:46,953 epoch 90 - iter 392/493 - loss 0.10080553 throughput (samples/sec): 188.94
2019-08-13 14:42:55,914 epoch 90 - iter 441/493 - loss 0.10148199 throughput (samples/sec): 175.47
2019-08-13 14:43:04,832 epoch 90 - iter 490/493 - loss 0.10038426 throughput (samples/sec): 176.30
2019-08-13 14:43:05,189 ----------------------------------------------------------------------------------------------------
2019-08-13 14:43:05,189 EPOCH 90 done: loss 0.1004 - lr 0.0125
2019-08-13 14:43:05,190 BAD EPOCHS (no improvement): 4
2019-08-13 14:43:05,190 ----------------------------------------------------------------------------------------------------
2019-08-13 14:43:05,332 epoch 91 - iter 0/493 - loss 0.04527986 throughput (samples/sec): 11115.30
2019-08-13 14:43:13,771 epoch 91 - iter 49/493 - loss 0.09324182 throughput (samples/sec): 186.34
2019-08-13 14:43:22,267 epoch 91 - iter 98/493 - loss 0.08831755 throughput (samples/sec): 185.09
2019-08-13 14:43:30,717 epoch 91 - iter 147/493 - loss 0.08698582 throughput (samples/sec): 186.10
2019-08-13 14:43:39,152 epoch 91 - iter 196/493 - loss 0.08803397 throughput (samples/sec): 186.44
2019-08-13 14:43:47,568 epoch 91 - iter 245/493 - loss 0.09003739 throughput (samples/sec): 186.85
2019-08-13 14:43:56,279 epoch 91 - iter 294/493 - loss 0.09705508 throughput (samples/sec): 180.50
2019-08-13 14:44:05,346 epoch 91 - iter 343/493 - loss 0.09963512 throughput (samples/sec): 173.41
2019-08-13 14:44:14,256 epoch 91 - iter 392/493 - loss 0.09717630 throughput (samples/sec): 176.47
2019-08-13 14:44:22,637 epoch 91 - iter 441/493 - loss 0.10005169 throughput (samples/sec): 187.62
2019-08-13 14:44:31,100 epoch 91 - iter 490/493 - loss 0.10173890 throughput (samples/sec): 185.82
2019-08-13 14:44:31,497 ----------------------------------------------------------------------------------------------------
2019-08-13 14:44:31,498 EPOCH 91 done: loss 0.1015 - lr 0.0063
2019-08-13 14:44:31,498 BAD EPOCHS (no improvement): 1
2019-08-13 14:44:31,498 ----------------------------------------------------------------------------------------------------
2019-08-13 14:44:31,703 epoch 92 - iter 0/493 - loss 0.32615161 throughput (samples/sec): 7672.87
2019-08-13 14:44:40,107 epoch 92 - iter 49/493 - loss 0.10792381 throughput (samples/sec): 187.13
2019-08-13 14:44:48,568 epoch 92 - iter 98/493 - loss 0.09363183 throughput (samples/sec): 185.85
2019-08-13 14:44:57,077 epoch 92 - iter 147/493 - loss 0.09268637 throughput (samples/sec): 184.81
2019-08-13 14:45:05,873 epoch 92 - iter 196/493 - loss 0.09057758 throughput (samples/sec): 178.76
2019-08-13 14:45:14,695 epoch 92 - iter 245/493 - loss 0.09148513 throughput (samples/sec): 178.23
2019-08-13 14:45:23,166 epoch 92 - iter 294/493 - loss 0.09737721 throughput (samples/sec): 185.64
2019-08-13 14:45:31,778 epoch 92 - iter 343/493 - loss 0.09869899 throughput (samples/sec): 182.60
2019-08-13 14:45:40,426 epoch 92 - iter 392/493 - loss 0.09914598 throughput (samples/sec): 181.83
2019-08-13 14:45:48,885 epoch 92 - iter 441/493 - loss 0.09960431 throughput (samples/sec): 185.89
2019-08-13 14:45:57,419 epoch 92 - iter 490/493 - loss 0.09879224 throughput (samples/sec): 184.27
2019-08-13 14:45:57,738 ----------------------------------------------------------------------------------------------------
2019-08-13 14:45:57,738 EPOCH 92 done: loss 0.0988 - lr 0.0063
2019-08-13 14:45:57,738 BAD EPOCHS (no improvement): 0
2019-08-13 14:45:57,738 ----------------------------------------------------------------------------------------------------
2019-08-13 14:45:57,893 epoch 93 - iter 0/493 - loss 0.21409404 throughput (samples/sec): 10177.80
2019-08-13 14:46:06,801 epoch 93 - iter 49/493 - loss 0.09546279 throughput (samples/sec): 176.51
2019-08-13 14:46:15,416 epoch 93 - iter 98/493 - loss 0.08754082 throughput (samples/sec): 182.52
2019-08-13 14:46:24,202 epoch 93 - iter 147/493 - loss 0.08560989 throughput (samples/sec): 178.96
2019-08-13 14:46:32,928 epoch 93 - iter 196/493 - loss 0.09820085 throughput (samples/sec): 180.20
2019-08-13 14:46:41,081 epoch 93 - iter 245/493 - loss 0.09917202 throughput (samples/sec): 192.90
2019-08-13 14:46:49,325 epoch 93 - iter 294/493 - loss 0.09727259 throughput (samples/sec): 190.78
2019-08-13 14:46:57,672 epoch 93 - iter 343/493 - loss 0.09660668 throughput (samples/sec): 188.40
2019-08-13 14:47:06,646 epoch 93 - iter 392/493 - loss 0.09493009 throughput (samples/sec): 175.21
2019-08-13 14:47:15,017 epoch 93 - iter 441/493 - loss 0.09532600 throughput (samples/sec): 187.86
2019-08-13 14:47:23,597 epoch 93 - iter 490/493 - loss 0.09409639 throughput (samples/sec): 183.26
2019-08-13 14:47:23,955 ----------------------------------------------------------------------------------------------------
2019-08-13 14:47:23,955 EPOCH 93 done: loss 0.0939 - lr 0.0063
2019-08-13 14:47:23,955 BAD EPOCHS (no improvement): 0
2019-08-13 14:47:23,956 ----------------------------------------------------------------------------------------------------
2019-08-13 14:47:24,141 epoch 94 - iter 0/493 - loss 0.06752709 throughput (samples/sec): 8488.04
2019-08-13 14:47:32,546 epoch 94 - iter 49/493 - loss 0.10571156 throughput (samples/sec): 187.11
2019-08-13 14:47:41,161 epoch 94 - iter 98/493 - loss 0.09829229 throughput (samples/sec): 182.52
2019-08-13 14:47:49,632 epoch 94 - iter 147/493 - loss 0.10357284 throughput (samples/sec): 185.65
2019-08-13 14:47:58,626 epoch 94 - iter 196/493 - loss 0.10197707 throughput (samples/sec): 174.81
2019-08-13 14:48:07,078 epoch 94 - iter 245/493 - loss 0.09730104 throughput (samples/sec): 186.05
2019-08-13 14:48:15,501 epoch 94 - iter 294/493 - loss 0.09996888 throughput (samples/sec): 186.70
2019-08-13 14:48:23,953 epoch 94 - iter 343/493 - loss 0.10036176 throughput (samples/sec): 186.06
2019-08-13 14:48:32,514 epoch 94 - iter 392/493 - loss 0.09741441 throughput (samples/sec): 183.68
2019-08-13 14:48:41,140 epoch 94 - iter 441/493 - loss 0.09896915 throughput (samples/sec): 182.29
2019-08-13 14:48:49,670 epoch 94 - iter 490/493 - loss 0.10079158 throughput (samples/sec): 184.35
2019-08-13 14:48:50,020 ----------------------------------------------------------------------------------------------------
2019-08-13 14:48:50,020 EPOCH 94 done: loss 0.1007 - lr 0.0063
2019-08-13 14:48:50,020 BAD EPOCHS (no improvement): 1
2019-08-13 14:48:50,020 ----------------------------------------------------------------------------------------------------
2019-08-13 14:48:50,177 epoch 95 - iter 0/493 - loss 0.33335775 throughput (samples/sec): 10057.74
2019-08-13 14:48:58,349 epoch 95 - iter 49/493 - loss 0.10825989 throughput (samples/sec): 192.47
2019-08-13 14:49:06,755 epoch 95 - iter 98/493 - loss 0.11415332 throughput (samples/sec): 187.06
2019-08-13 14:49:15,423 epoch 95 - iter 147/493 - loss 0.11174673 throughput (samples/sec): 181.42
2019-08-13 14:49:23,995 epoch 95 - iter 196/493 - loss 0.11439564 throughput (samples/sec): 183.44
2019-08-13 14:49:32,423 epoch 95 - iter 245/493 - loss 0.11023898 throughput (samples/sec): 186.58
2019-08-13 14:49:40,840 epoch 95 - iter 294/493 - loss 0.11301280 throughput (samples/sec): 186.84
2019-08-13 14:49:49,300 epoch 95 - iter 343/493 - loss 0.11383106 throughput (samples/sec): 185.89
2019-08-13 14:49:58,079 epoch 95 - iter 392/493 - loss 0.11444363 throughput (samples/sec): 179.11
2019-08-13 14:50:06,556 epoch 95 - iter 441/493 - loss 0.11289278 throughput (samples/sec): 185.50
2019-08-13 14:50:15,734 epoch 95 - iter 490/493 - loss 0.10951264 throughput (samples/sec): 171.30
2019-08-13 14:50:16,072 ----------------------------------------------------------------------------------------------------
2019-08-13 14:50:16,072 EPOCH 95 done: loss 0.1094 - lr 0.0063
2019-08-13 14:50:16,072 BAD EPOCHS (no improvement): 2
2019-08-13 14:50:16,072 ----------------------------------------------------------------------------------------------------
2019-08-13 14:50:16,227 epoch 96 - iter 0/493 - loss 0.01523057 throughput (samples/sec): 10203.55
2019-08-13 14:50:24,844 epoch 96 - iter 49/493 - loss 0.09390311 throughput (samples/sec): 182.49
2019-08-13 14:50:33,448 epoch 96 - iter 98/493 - loss 0.09972270 throughput (samples/sec): 182.76
2019-08-13 14:50:42,231 epoch 96 - iter 147/493 - loss 0.10534545 throughput (samples/sec): 179.03
2019-08-13 14:50:50,646 epoch 96 - iter 196/493 - loss 0.10731248 throughput (samples/sec): 186.87
2019-08-13 14:50:59,740 epoch 96 - iter 245/493 - loss 0.10967708 throughput (samples/sec): 172.88
2019-08-13 14:51:07,999 epoch 96 - iter 294/493 - loss 0.10860633 throughput (samples/sec): 190.42
2019-08-13 14:51:16,350 epoch 96 - iter 343/493 - loss 0.10375679 throughput (samples/sec): 188.31
2019-08-13 14:51:24,890 epoch 96 - iter 392/493 - loss 0.10445308 throughput (samples/sec): 184.14
2019-08-13 14:51:33,527 epoch 96 - iter 441/493 - loss 0.10566275 throughput (samples/sec): 182.06
2019-08-13 14:51:42,228 epoch 96 - iter 490/493 - loss 0.10851965 throughput (samples/sec): 180.72
2019-08-13 14:51:42,578 ----------------------------------------------------------------------------------------------------
2019-08-13 14:51:42,578 EPOCH 96 done: loss 0.1088 - lr 0.0063
2019-08-13 14:51:42,579 BAD EPOCHS (no improvement): 3
2019-08-13 14:51:42,579 ----------------------------------------------------------------------------------------------------
2019-08-13 14:51:42,748 epoch 97 - iter 0/493 - loss 0.22050321 throughput (samples/sec): 9334.34
2019-08-13 14:51:51,397 epoch 97 - iter 49/493 - loss 0.09270862 throughput (samples/sec): 181.80
2019-08-13 14:51:59,846 epoch 97 - iter 98/493 - loss 0.08723867 throughput (samples/sec): 186.12
2019-08-13 14:52:08,356 epoch 97 - iter 147/493 - loss 0.08433042 throughput (samples/sec): 184.79
2019-08-13 14:52:16,718 epoch 97 - iter 196/493 - loss 0.08685081 throughput (samples/sec): 188.06
2019-08-13 14:52:25,572 epoch 97 - iter 245/493 - loss 0.09292080 throughput (samples/sec): 177.58
2019-08-13 14:52:33,851 epoch 97 - iter 294/493 - loss 0.08991256 throughput (samples/sec): 189.96
2019-08-13 14:52:42,622 epoch 97 - iter 343/493 - loss 0.08908446 throughput (samples/sec): 179.27
2019-08-13 14:52:51,209 epoch 97 - iter 392/493 - loss 0.08927000 throughput (samples/sec): 183.13
2019-08-13 14:52:59,573 epoch 97 - iter 441/493 - loss 0.08939263 throughput (samples/sec): 188.01
2019-08-13 14:53:08,523 epoch 97 - iter 490/493 - loss 0.09077525 throughput (samples/sec): 175.69
2019-08-13 14:53:08,861 ----------------------------------------------------------------------------------------------------
2019-08-13 14:53:08,861 EPOCH 97 done: loss 0.0906 - lr 0.0063
2019-08-13 14:53:08,861 BAD EPOCHS (no improvement): 0
2019-08-13 14:53:08,861 ----------------------------------------------------------------------------------------------------
2019-08-13 14:53:09,056 epoch 98 - iter 0/493 - loss 0.02575123 throughput (samples/sec): 8074.29
2019-08-13 14:53:17,501 epoch 98 - iter 49/493 - loss 0.09421305 throughput (samples/sec): 186.23
2019-08-13 14:53:26,142 epoch 98 - iter 98/493 - loss 0.09482027 throughput (samples/sec): 181.96
2019-08-13 14:53:34,886 epoch 98 - iter 147/493 - loss 0.09634293 throughput (samples/sec): 179.82
2019-08-13 14:53:43,419 epoch 98 - iter 196/493 - loss 0.09581905 throughput (samples/sec): 184.28
2019-08-13 14:53:52,175 epoch 98 - iter 245/493 - loss 0.09871383 throughput (samples/sec): 179.59
2019-08-13 14:54:00,840 epoch 98 - iter 294/493 - loss 0.10081506 throughput (samples/sec): 181.47
2019-08-13 14:54:09,150 epoch 98 - iter 343/493 - loss 0.09827209 throughput (samples/sec): 189.23
2019-08-13 14:54:17,597 epoch 98 - iter 392/493 - loss 0.09766903 throughput (samples/sec): 186.18
2019-08-13 14:54:26,073 epoch 98 - iter 441/493 - loss 0.09947300 throughput (samples/sec): 185.53
2019-08-13 14:54:34,734 epoch 98 - iter 490/493 - loss 0.09675675 throughput (samples/sec): 181.54
2019-08-13 14:54:35,136 ----------------------------------------------------------------------------------------------------
2019-08-13 14:54:35,136 EPOCH 98 done: loss 0.0968 - lr 0.0063
2019-08-13 14:54:35,137 BAD EPOCHS (no improvement): 1
2019-08-13 14:54:35,137 ----------------------------------------------------------------------------------------------------
2019-08-13 14:54:35,339 epoch 99 - iter 0/493 - loss 0.08614630 throughput (samples/sec): 7798.23
2019-08-13 14:54:43,659 epoch 99 - iter 49/493 - loss 0.09744664 throughput (samples/sec): 189.01
2019-08-13 14:54:52,370 epoch 99 - iter 98/493 - loss 0.09477426 throughput (samples/sec): 180.50
2019-08-13 14:55:00,838 epoch 99 - iter 147/493 - loss 0.09908608 throughput (samples/sec): 185.70
2019-08-13 14:55:09,328 epoch 99 - iter 196/493 - loss 0.10179733 throughput (samples/sec): 185.21
2019-08-13 14:55:18,112 epoch 99 - iter 245/493 - loss 0.10036535 throughput (samples/sec): 179.01
2019-08-13 14:55:26,340 epoch 99 - iter 294/493 - loss 0.10101216 throughput (samples/sec): 191.13
2019-08-13 14:55:35,228 epoch 99 - iter 343/493 - loss 0.09911740 throughput (samples/sec): 176.90
2019-08-13 14:55:43,698 epoch 99 - iter 392/493 - loss 0.10158950 throughput (samples/sec): 185.66
2019-08-13 14:55:52,132 epoch 99 - iter 441/493 - loss 0.10146295 throughput (samples/sec): 186.46
2019-08-13 14:56:00,653 epoch 99 - iter 490/493 - loss 0.10214850 throughput (samples/sec): 184.55
2019-08-13 14:56:01,043 ----------------------------------------------------------------------------------------------------
2019-08-13 14:56:01,044 EPOCH 99 done: loss 0.1023 - lr 0.0063
2019-08-13 14:56:01,044 BAD EPOCHS (no improvement): 2
2019-08-13 14:56:01,044 ----------------------------------------------------------------------------------------------------
2019-08-13 14:56:01,203 epoch 100 - iter 0/493 - loss 0.21559682 throughput (samples/sec): 9938.07
2019-08-13 14:56:09,793 epoch 100 - iter 49/493 - loss 0.11515455 throughput (samples/sec): 183.06
2019-08-13 14:56:18,399 epoch 100 - iter 98/493 - loss 0.12005325 throughput (samples/sec): 182.70
2019-08-13 14:56:27,046 epoch 100 - iter 147/493 - loss 0.10573691 throughput (samples/sec): 181.86
2019-08-13 14:56:35,577 epoch 100 - iter 196/493 - loss 0.10729453 throughput (samples/sec): 184.34
2019-08-13 14:56:43,914 epoch 100 - iter 245/493 - loss 0.10287504 throughput (samples/sec): 188.64
2019-08-13 14:56:52,928 epoch 100 - iter 294/493 - loss 0.09952003 throughput (samples/sec): 174.42
2019-08-13 14:57:01,100 epoch 100 - iter 343/493 - loss 0.09737282 throughput (samples/sec): 192.46
2019-08-13 14:57:09,771 epoch 100 - iter 392/493 - loss 0.10063449 throughput (samples/sec): 181.34
2019-08-13 14:57:18,347 epoch 100 - iter 441/493 - loss 0.10051317 throughput (samples/sec): 183.37
2019-08-13 14:57:26,757 epoch 100 - iter 490/493 - loss 0.09988318 throughput (samples/sec): 186.98
2019-08-13 14:57:27,114 ----------------------------------------------------------------------------------------------------
2019-08-13 14:57:27,115 EPOCH 100 done: loss 0.0996 - lr 0.0063
2019-08-13 14:57:27,115 BAD EPOCHS (no improvement): 3
2019-08-13 14:57:27,115 ----------------------------------------------------------------------------------------------------
2019-08-13 14:57:27,293 epoch 101 - iter 0/493 - loss 0.08125275 throughput (samples/sec): 8876.10
2019-08-13 14:57:35,708 epoch 101 - iter 49/493 - loss 0.09051991 throughput (samples/sec): 186.87
2019-08-13 14:57:44,591 epoch 101 - iter 98/493 - loss 0.08881230 throughput (samples/sec): 177.00
2019-08-13 14:57:52,869 epoch 101 - iter 147/493 - loss 0.08678255 throughput (samples/sec): 189.99
2019-08-13 14:58:01,627 epoch 101 - iter 196/493 - loss 0.08727867 throughput (samples/sec): 179.53
2019-08-13 14:58:10,558 epoch 101 - iter 245/493 - loss 0.09298128 throughput (samples/sec): 176.07
2019-08-13 14:58:18,792 epoch 101 - iter 294/493 - loss 0.09429368 throughput (samples/sec): 190.97
2019-08-13 14:58:27,100 epoch 101 - iter 343/493 - loss 0.09044516 throughput (samples/sec): 189.29
2019-08-13 14:58:35,874 epoch 101 - iter 392/493 - loss 0.09212841 throughput (samples/sec): 179.21
2019-08-13 14:58:44,278 epoch 101 - iter 441/493 - loss 0.09005405 throughput (samples/sec): 187.12
2019-08-13 14:58:52,729 epoch 101 - iter 490/493 - loss 0.08905683 throughput (samples/sec): 186.07
2019-08-13 14:58:53,063 ----------------------------------------------------------------------------------------------------
2019-08-13 14:58:53,063 EPOCH 101 done: loss 0.0891 - lr 0.0063
2019-08-13 14:58:53,063 BAD EPOCHS (no improvement): 0
2019-08-13 14:58:53,064 ----------------------------------------------------------------------------------------------------
2019-08-13 14:58:53,199 epoch 102 - iter 0/493 - loss 0.13412762 throughput (samples/sec): 11649.15
2019-08-13 14:59:02,077 epoch 102 - iter 49/493 - loss 0.10531912 throughput (samples/sec): 177.10
2019-08-13 14:59:10,657 epoch 102 - iter 98/493 - loss 0.09143284 throughput (samples/sec): 183.27
2019-08-13 14:59:19,327 epoch 102 - iter 147/493 - loss 0.09384328 throughput (samples/sec): 181.36
2019-08-13 14:59:27,577 epoch 102 - iter 196/493 - loss 0.10153000 throughput (samples/sec): 190.64
2019-08-13 14:59:36,235 epoch 102 - iter 245/493 - loss 0.09951774 throughput (samples/sec): 181.60
2019-08-13 14:59:44,671 epoch 102 - iter 294/493 - loss 0.09873201 throughput (samples/sec): 186.41
2019-08-13 14:59:53,581 epoch 102 - iter 343/493 - loss 0.09975570 throughput (samples/sec): 176.47
2019-08-13 15:00:01,978 epoch 102 - iter 392/493 - loss 0.09695119 throughput (samples/sec): 187.26
2019-08-13 15:00:10,464 epoch 102 - iter 441/493 - loss 0.09693691 throughput (samples/sec): 185.31
2019-08-13 15:00:19,050 epoch 102 - iter 490/493 - loss 0.09587926 throughput (samples/sec): 183.15
2019-08-13 15:00:19,438 ----------------------------------------------------------------------------------------------------
2019-08-13 15:00:19,438 EPOCH 102 done: loss 0.0963 - lr 0.0063
2019-08-13 15:00:19,439 BAD EPOCHS (no improvement): 1
2019-08-13 15:00:19,439 ----------------------------------------------------------------------------------------------------
2019-08-13 15:00:19,604 epoch 103 - iter 0/493 - loss 0.06903970 throughput (samples/sec): 9529.25
2019-08-13 15:00:28,291 epoch 103 - iter 49/493 - loss 0.09490624 throughput (samples/sec): 181.01
2019-08-13 15:00:37,136 epoch 103 - iter 98/493 - loss 0.08441674 throughput (samples/sec): 177.77
2019-08-13 15:00:45,330 epoch 103 - iter 147/493 - loss 0.09019976 throughput (samples/sec): 191.93
2019-08-13 15:00:54,044 epoch 103 - iter 196/493 - loss 0.09826225 throughput (samples/sec): 180.46
2019-08-13 15:01:02,458 epoch 103 - iter 245/493 - loss 0.09607366 throughput (samples/sec): 186.90
2019-08-13 15:01:10,762 epoch 103 - iter 294/493 - loss 0.09872685 throughput (samples/sec): 189.39
2019-08-13 15:01:19,458 epoch 103 - iter 343/493 - loss 0.09953812 throughput (samples/sec): 180.82
2019-08-13 15:01:27,842 epoch 103 - iter 392/493 - loss 0.09742371 throughput (samples/sec): 187.56
2019-08-13 15:01:36,419 epoch 103 - iter 441/493 - loss 0.09860834 throughput (samples/sec): 183.34
2019-08-13 15:01:45,197 epoch 103 - iter 490/493 - loss 0.10070759 throughput (samples/sec): 179.13
2019-08-13 15:01:45,536 ----------------------------------------------------------------------------------------------------
2019-08-13 15:01:45,536 EPOCH 103 done: loss 0.1008 - lr 0.0063
2019-08-13 15:01:45,536 BAD EPOCHS (no improvement): 2
2019-08-13 15:01:45,536 ----------------------------------------------------------------------------------------------------
2019-08-13 15:01:45,682 epoch 104 - iter 0/493 - loss 0.03075659 throughput (samples/sec): 10820.40
2019-08-13 15:01:54,383 epoch 104 - iter 49/493 - loss 0.08818966 throughput (samples/sec): 180.71
2019-08-13 15:02:02,817 epoch 104 - iter 98/493 - loss 0.08310341 throughput (samples/sec): 186.47
2019-08-13 15:02:11,177 epoch 104 - iter 147/493 - loss 0.09678153 throughput (samples/sec): 188.10
2019-08-13 15:02:19,835 epoch 104 - iter 196/493 - loss 0.09097300 throughput (samples/sec): 181.60
2019-08-13 15:02:28,259 epoch 104 - iter 245/493 - loss 0.09162769 throughput (samples/sec): 186.67
2019-08-13 15:02:36,962 epoch 104 - iter 294/493 - loss 0.09102045 throughput (samples/sec): 180.68
2019-08-13 15:02:45,306 epoch 104 - iter 343/493 - loss 0.08841693 throughput (samples/sec): 188.46
2019-08-13 15:02:53,837 epoch 104 - iter 392/493 - loss 0.09123137 throughput (samples/sec): 184.33
2019-08-13 15:03:02,186 epoch 104 - iter 441/493 - loss 0.08858908 throughput (samples/sec): 188.37
2019-08-13 15:03:11,093 epoch 104 - iter 490/493 - loss 0.08664966 throughput (samples/sec): 176.53
2019-08-13 15:03:11,448 ----------------------------------------------------------------------------------------------------
2019-08-13 15:03:11,448 EPOCH 104 done: loss 0.0864 - lr 0.0063
2019-08-13 15:03:11,448 BAD EPOCHS (no improvement): 0
2019-08-13 15:03:11,448 ----------------------------------------------------------------------------------------------------
2019-08-13 15:03:11,590 epoch 105 - iter 0/493 - loss 0.05595046 throughput (samples/sec): 11177.57
2019-08-13 15:03:20,296 epoch 105 - iter 49/493 - loss 0.08809429 throughput (samples/sec): 180.61
2019-08-13 15:03:28,607 epoch 105 - iter 98/493 - loss 0.09476045 throughput (samples/sec): 189.23
2019-08-13 15:03:37,703 epoch 105 - iter 147/493 - loss 0.08591894 throughput (samples/sec): 172.83
2019-08-13 15:03:45,954 epoch 105 - iter 196/493 - loss 0.08406118 throughput (samples/sec): 190.61
2019-08-13 15:03:55,045 epoch 105 - iter 245/493 - loss 0.08914766 throughput (samples/sec): 172.96
2019-08-13 15:04:03,403 epoch 105 - iter 294/493 - loss 0.09031575 throughput (samples/sec): 188.15
2019-08-13 15:04:12,057 epoch 105 - iter 343/493 - loss 0.09198294 throughput (samples/sec): 181.70
2019-08-13 15:04:20,537 epoch 105 - iter 392/493 - loss 0.09467238 throughput (samples/sec): 185.44
2019-08-13 15:04:29,009 epoch 105 - iter 441/493 - loss 0.09398716 throughput (samples/sec): 185.61
2019-08-13 15:04:37,623 epoch 105 - iter 490/493 - loss 0.09627306 throughput (samples/sec): 182.55
2019-08-13 15:04:37,984 ----------------------------------------------------------------------------------------------------
2019-08-13 15:04:37,984 EPOCH 105 done: loss 0.0963 - lr 0.0063
2019-08-13 15:04:37,984 BAD EPOCHS (no improvement): 1
2019-08-13 15:04:37,984 ----------------------------------------------------------------------------------------------------
2019-08-13 15:04:38,171 epoch 106 - iter 0/493 - loss 0.12710166 throughput (samples/sec): 8425.18
2019-08-13 15:04:46,782 epoch 106 - iter 49/493 - loss 0.12971163 throughput (samples/sec): 182.61
2019-08-13 15:04:55,601 epoch 106 - iter 98/493 - loss 0.11553847 throughput (samples/sec): 178.29
2019-08-13 15:05:04,043 epoch 106 - iter 147/493 - loss 0.10912237 throughput (samples/sec): 186.28
2019-08-13 15:05:12,525 epoch 106 - iter 196/493 - loss 0.11400276 throughput (samples/sec): 185.38
2019-08-13 15:05:21,239 epoch 106 - iter 245/493 - loss 0.11664249 throughput (samples/sec): 180.47
2019-08-13 15:05:30,251 epoch 106 - iter 294/493 - loss 0.11366650 throughput (samples/sec): 174.46
2019-08-13 15:05:38,500 epoch 106 - iter 343/493 - loss 0.11214905 throughput (samples/sec): 190.64
2019-08-13 15:05:47,178 epoch 106 - iter 392/493 - loss 0.10860876 throughput (samples/sec): 181.20
2019-08-13 15:05:55,564 epoch 106 - iter 441/493 - loss 0.10880597 throughput (samples/sec): 187.52
2019-08-13 15:06:04,011 epoch 106 - iter 490/493 - loss 0.10752811 throughput (samples/sec): 186.17
2019-08-13 15:06:04,428 ----------------------------------------------------------------------------------------------------
2019-08-13 15:06:04,428 EPOCH 106 done: loss 0.1073 - lr 0.0063
2019-08-13 15:06:04,428 BAD EPOCHS (no improvement): 2
2019-08-13 15:06:04,428 ----------------------------------------------------------------------------------------------------
2019-08-13 15:06:04,595 epoch 107 - iter 0/493 - loss 0.05328560 throughput (samples/sec): 9475.42
2019-08-13 15:06:13,178 epoch 107 - iter 49/493 - loss 0.09484026 throughput (samples/sec): 183.20
2019-08-13 15:06:21,597 epoch 107 - iter 98/493 - loss 0.09217745 throughput (samples/sec): 186.78
2019-08-13 15:06:29,995 epoch 107 - iter 147/493 - loss 0.08379630 throughput (samples/sec): 187.25
2019-08-13 15:06:38,357 epoch 107 - iter 196/493 - loss 0.08738156 throughput (samples/sec): 188.08
2019-08-13 15:06:46,671 epoch 107 - iter 245/493 - loss 0.08940872 throughput (samples/sec): 189.14
2019-08-13 15:06:55,305 epoch 107 - iter 294/493 - loss 0.09501636 throughput (samples/sec): 182.12
2019-08-13 15:07:04,222 epoch 107 - iter 343/493 - loss 0.09373443 throughput (samples/sec): 176.33
2019-08-13 15:07:12,824 epoch 107 - iter 392/493 - loss 0.09743436 throughput (samples/sec): 182.80
2019-08-13 15:07:21,346 epoch 107 - iter 441/493 - loss 0.09598938 throughput (samples/sec): 184.54
2019-08-13 15:07:30,158 epoch 107 - iter 490/493 - loss 0.09786048 throughput (samples/sec): 178.42
2019-08-13 15:07:30,504 ----------------------------------------------------------------------------------------------------
2019-08-13 15:07:30,504 EPOCH 107 done: loss 0.0976 - lr 0.0063
2019-08-13 15:07:30,504 BAD EPOCHS (no improvement): 3
2019-08-13 15:07:30,504 ----------------------------------------------------------------------------------------------------
2019-08-13 15:07:30,698 epoch 108 - iter 0/493 - loss 0.09357727 throughput (samples/sec): 8132.26
2019-08-13 15:07:39,313 epoch 108 - iter 49/493 - loss 0.10320001 throughput (samples/sec): 182.51
2019-08-13 15:07:48,002 epoch 108 - iter 98/493 - loss 0.09442427 throughput (samples/sec): 180.97
2019-08-13 15:07:56,427 epoch 108 - iter 147/493 - loss 0.09113419 throughput (samples/sec): 186.66
2019-08-13 15:08:04,990 epoch 108 - iter 196/493 - loss 0.09373098 throughput (samples/sec): 183.63
2019-08-13 15:08:14,104 epoch 108 - iter 245/493 - loss 0.09903709 throughput (samples/sec): 172.50
2019-08-13 15:08:22,522 epoch 108 - iter 294/493 - loss 0.10068797 throughput (samples/sec): 186.82
2019-08-13 15:08:30,864 epoch 108 - iter 343/493 - loss 0.10035962 throughput (samples/sec): 188.52
2019-08-13 15:08:39,484 epoch 108 - iter 392/493 - loss 0.10076638 throughput (samples/sec): 182.41
2019-08-13 15:08:47,870 epoch 108 - iter 441/493 - loss 0.10101501 throughput (samples/sec): 187.52
2019-08-13 15:08:56,430 epoch 108 - iter 490/493 - loss 0.09920663 throughput (samples/sec): 183.71
2019-08-13 15:08:56,823 ----------------------------------------------------------------------------------------------------
2019-08-13 15:08:56,823 EPOCH 108 done: loss 0.0989 - lr 0.0063
2019-08-13 15:08:56,823 BAD EPOCHS (no improvement): 4
2019-08-13 15:08:56,824 ----------------------------------------------------------------------------------------------------
2019-08-13 15:08:56,973 epoch 109 - iter 0/493 - loss 0.01245594 throughput (samples/sec): 10562.57
2019-08-13 15:09:05,513 epoch 109 - iter 49/493 - loss 0.08830234 throughput (samples/sec): 184.16
2019-08-13 15:09:13,845 epoch 109 - iter 98/493 - loss 0.08090097 throughput (samples/sec): 188.74
2019-08-13 15:09:22,457 epoch 109 - iter 147/493 - loss 0.08930578 throughput (samples/sec): 182.58
2019-08-13 15:09:30,888 epoch 109 - iter 196/493 - loss 0.08982941 throughput (samples/sec): 186.53
2019-08-13 15:09:39,741 epoch 109 - iter 245/493 - loss 0.09223187 throughput (samples/sec): 177.60
2019-08-13 15:09:48,551 epoch 109 - iter 294/493 - loss 0.08914799 throughput (samples/sec): 178.47
2019-08-13 15:09:56,713 epoch 109 - iter 343/493 - loss 0.08888367 throughput (samples/sec): 192.70
2019-08-13 15:10:05,286 epoch 109 - iter 392/493 - loss 0.08982309 throughput (samples/sec): 183.41
2019-08-13 15:10:14,027 epoch 109 - iter 441/493 - loss 0.09164401 throughput (samples/sec): 179.90
2019-08-13 15:10:22,384 epoch 109 - iter 490/493 - loss 0.09361804 throughput (samples/sec): 188.18
2019-08-13 15:10:22,817 ----------------------------------------------------------------------------------------------------
2019-08-13 15:10:22,817 EPOCH 109 done: loss 0.0937 - lr 0.0031
2019-08-13 15:10:22,817 BAD EPOCHS (no improvement): 1
2019-08-13 15:10:22,817 ----------------------------------------------------------------------------------------------------
2019-08-13 15:10:23,002 epoch 110 - iter 0/493 - loss 0.00755867 throughput (samples/sec): 8545.52
2019-08-13 15:10:31,702 epoch 110 - iter 49/493 - loss 0.09999630 throughput (samples/sec): 180.73
2019-08-13 15:10:40,245 epoch 110 - iter 98/493 - loss 0.09025306 throughput (samples/sec): 184.06
2019-08-13 15:10:48,902 epoch 110 - iter 147/493 - loss 0.08883111 throughput (samples/sec): 181.64
2019-08-13 15:10:57,492 epoch 110 - iter 196/493 - loss 0.09813093 throughput (samples/sec): 183.04
2019-08-13 15:11:05,895 epoch 110 - iter 245/493 - loss 0.09658159 throughput (samples/sec): 187.15
2019-08-13 15:11:14,373 epoch 110 - iter 294/493 - loss 0.09479339 throughput (samples/sec): 185.48
2019-08-13 15:11:22,865 epoch 110 - iter 343/493 - loss 0.09368994 throughput (samples/sec): 185.17
2019-08-13 15:11:31,293 epoch 110 - iter 392/493 - loss 0.09569613 throughput (samples/sec): 186.58
2019-08-13 15:11:40,115 epoch 110 - iter 441/493 - loss 0.09481037 throughput (samples/sec): 178.24
2019-08-13 15:11:48,584 epoch 110 - iter 490/493 - loss 0.09527567 throughput (samples/sec): 185.69
2019-08-13 15:11:48,991 ----------------------------------------------------------------------------------------------------
2019-08-13 15:11:48,991 EPOCH 110 done: loss 0.0950 - lr 0.0031
2019-08-13 15:11:48,991 BAD EPOCHS (no improvement): 2
2019-08-13 15:11:48,991 ----------------------------------------------------------------------------------------------------
2019-08-13 15:11:49,144 epoch 111 - iter 0/493 - loss 0.02912006 throughput (samples/sec): 10363.44
2019-08-13 15:11:58,049 epoch 111 - iter 49/493 - loss 0.09183539 throughput (samples/sec): 176.56
2019-08-13 15:12:06,595 epoch 111 - iter 98/493 - loss 0.09006233 throughput (samples/sec): 184.00
2019-08-13 15:12:14,855 epoch 111 - iter 147/493 - loss 0.09019538 throughput (samples/sec): 190.39
2019-08-13 15:12:23,268 epoch 111 - iter 196/493 - loss 0.09803956 throughput (samples/sec): 186.92
2019-08-13 15:12:31,731 epoch 111 - iter 245/493 - loss 0.09717574 throughput (samples/sec): 185.82
2019-08-13 15:12:40,443 epoch 111 - iter 294/493 - loss 0.09440217 throughput (samples/sec): 180.49
2019-08-13 15:12:48,955 epoch 111 - iter 343/493 - loss 0.09530707 throughput (samples/sec): 184.72
2019-08-13 15:12:57,626 epoch 111 - iter 392/493 - loss 0.09760833 throughput (samples/sec): 181.35
2019-08-13 15:13:06,687 epoch 111 - iter 441/493 - loss 0.10017406 throughput (samples/sec): 173.50
2019-08-13 15:13:15,129 epoch 111 - iter 490/493 - loss 0.09950334 throughput (samples/sec): 186.28
2019-08-13 15:13:15,455 ----------------------------------------------------------------------------------------------------
2019-08-13 15:13:15,456 EPOCH 111 done: loss 0.0993 - lr 0.0031
2019-08-13 15:13:15,456 BAD EPOCHS (no improvement): 3
2019-08-13 15:13:15,456 ----------------------------------------------------------------------------------------------------
2019-08-13 15:13:15,642 epoch 112 - iter 0/493 - loss 0.02837771 throughput (samples/sec): 8466.48
2019-08-13 15:13:24,233 epoch 112 - iter 49/493 - loss 0.08268090 throughput (samples/sec): 183.04
2019-08-13 15:13:32,679 epoch 112 - iter 98/493 - loss 0.08937687 throughput (samples/sec): 186.18
2019-08-13 15:13:41,192 epoch 112 - iter 147/493 - loss 0.08830570 throughput (samples/sec): 184.72
2019-08-13 15:13:49,386 epoch 112 - iter 196/493 - loss 0.08790021 throughput (samples/sec): 191.94
2019-08-13 15:13:58,278 epoch 112 - iter 245/493 - loss 0.08800352 throughput (samples/sec): 176.83
2019-08-13 15:14:06,704 epoch 112 - iter 294/493 - loss 0.08484016 throughput (samples/sec): 186.63
2019-08-13 15:14:15,582 epoch 112 - iter 343/493 - loss 0.09044392 throughput (samples/sec): 177.11
2019-08-13 15:14:23,960 epoch 112 - iter 392/493 - loss 0.08739951 throughput (samples/sec): 187.69
2019-08-13 15:14:32,403 epoch 112 - iter 441/493 - loss 0.09236113 throughput (samples/sec): 186.27
2019-08-13 15:14:40,981 epoch 112 - iter 490/493 - loss 0.09341018 throughput (samples/sec): 183.30
2019-08-13 15:14:41,315 ----------------------------------------------------------------------------------------------------
2019-08-13 15:14:41,315 EPOCH 112 done: loss 0.0934 - lr 0.0031
2019-08-13 15:14:41,315 BAD EPOCHS (no improvement): 4
2019-08-13 15:14:41,315 ----------------------------------------------------------------------------------------------------
2019-08-13 15:14:41,479 epoch 113 - iter 0/493 - loss 0.03967896 throughput (samples/sec): 9609.17
2019-08-13 15:14:50,215 epoch 113 - iter 49/493 - loss 0.08194337 throughput (samples/sec): 180.01
2019-08-13 15:14:58,722 epoch 113 - iter 98/493 - loss 0.09404452 throughput (samples/sec): 184.83
2019-08-13 15:15:07,792 epoch 113 - iter 147/493 - loss 0.10030696 throughput (samples/sec): 173.36
2019-08-13 15:15:16,362 epoch 113 - iter 196/493 - loss 0.10011387 throughput (samples/sec): 183.46
2019-08-13 15:15:24,751 epoch 113 - iter 245/493 - loss 0.09977362 throughput (samples/sec): 187.46
2019-08-13 15:15:33,323 epoch 113 - iter 294/493 - loss 0.09688171 throughput (samples/sec): 183.44
2019-08-13 15:15:41,951 epoch 113 - iter 343/493 - loss 0.09956502 throughput (samples/sec): 182.26
2019-08-13 15:15:50,293 epoch 113 - iter 392/493 - loss 0.09922967 throughput (samples/sec): 188.51
2019-08-13 15:15:58,388 epoch 113 - iter 441/493 - loss 0.09939048 throughput (samples/sec): 194.30
2019-08-13 15:16:06,925 epoch 113 - iter 490/493 - loss 0.09887773 throughput (samples/sec): 184.20
2019-08-13 15:16:07,290 ----------------------------------------------------------------------------------------------------
2019-08-13 15:16:07,291 EPOCH 113 done: loss 0.0987 - lr 0.0016
2019-08-13 15:16:07,291 BAD EPOCHS (no improvement): 1
2019-08-13 15:16:07,291 ----------------------------------------------------------------------------------------------------
2019-08-13 15:16:07,464 epoch 114 - iter 0/493 - loss 0.05978882 throughput (samples/sec): 9128.89
2019-08-13 15:16:15,796 epoch 114 - iter 49/493 - loss 0.08597652 throughput (samples/sec): 188.73
2019-08-13 15:16:24,080 epoch 114 - iter 98/493 - loss 0.09327857 throughput (samples/sec): 189.84
2019-08-13 15:16:32,621 epoch 114 - iter 147/493 - loss 0.09364932 throughput (samples/sec): 184.12
2019-08-13 15:16:41,097 epoch 114 - iter 196/493 - loss 0.09572620 throughput (samples/sec): 185.52
2019-08-13 15:16:49,915 epoch 114 - iter 245/493 - loss 0.09577161 throughput (samples/sec): 178.31
2019-08-13 15:16:58,441 epoch 114 - iter 294/493 - loss 0.09520740 throughput (samples/sec): 184.44
2019-08-13 15:17:07,033 epoch 114 - iter 343/493 - loss 0.09375111 throughput (samples/sec): 183.02
2019-08-13 15:17:15,525 epoch 114 - iter 392/493 - loss 0.09299538 throughput (samples/sec): 185.17
2019-08-13 15:17:23,964 epoch 114 - iter 441/493 - loss 0.09570415 throughput (samples/sec): 186.35
2019-08-13 15:17:33,017 epoch 114 - iter 490/493 - loss 0.09629453 throughput (samples/sec): 173.67
2019-08-13 15:17:33,367 ----------------------------------------------------------------------------------------------------
2019-08-13 15:17:33,368 EPOCH 114 done: loss 0.0966 - lr 0.0016
2019-08-13 15:17:33,368 BAD EPOCHS (no improvement): 2
2019-08-13 15:17:33,368 ----------------------------------------------------------------------------------------------------
2019-08-13 15:17:33,536 epoch 115 - iter 0/493 - loss 0.11487782 throughput (samples/sec): 9381.41
2019-08-13 15:17:41,770 epoch 115 - iter 49/493 - loss 0.08079770 throughput (samples/sec): 191.00
2019-08-13 15:17:50,801 epoch 115 - iter 98/493 - loss 0.08637283 throughput (samples/sec): 174.08
2019-08-13 15:17:58,948 epoch 115 - iter 147/493 - loss 0.09209629 throughput (samples/sec): 193.04
2019-08-13 15:18:07,281 epoch 115 - iter 196/493 - loss 0.09113014 throughput (samples/sec): 188.72
2019-08-13 15:18:15,894 epoch 115 - iter 245/493 - loss 0.09502574 throughput (samples/sec): 182.57
2019-08-13 15:18:24,615 epoch 115 - iter 294/493 - loss 0.09292758 throughput (samples/sec): 180.31
2019-08-13 15:18:33,500 epoch 115 - iter 343/493 - loss 0.08912681 throughput (samples/sec): 176.97
2019-08-13 15:18:41,794 epoch 115 - iter 392/493 - loss 0.09004670 throughput (samples/sec): 189.60
2019-08-13 15:18:50,081 epoch 115 - iter 441/493 - loss 0.09029769 throughput (samples/sec): 189.77
2019-08-13 15:18:58,447 epoch 115 - iter 490/493 - loss 0.09119456 throughput (samples/sec): 187.97
2019-08-13 15:18:58,869 ----------------------------------------------------------------------------------------------------
2019-08-13 15:18:58,869 EPOCH 115 done: loss 0.0913 - lr 0.0016
2019-08-13 15:18:58,869 BAD EPOCHS (no improvement): 3
2019-08-13 15:18:58,870 ----------------------------------------------------------------------------------------------------
2019-08-13 15:18:59,023 epoch 116 - iter 0/493 - loss 0.28783396 throughput (samples/sec): 10259.34
2019-08-13 15:19:07,616 epoch 116 - iter 49/493 - loss 0.10501418 throughput (samples/sec): 182.99
2019-08-13 15:19:16,393 epoch 116 - iter 98/493 - loss 0.10138879 throughput (samples/sec): 179.16
2019-08-13 15:19:24,705 epoch 116 - iter 147/493 - loss 0.09486732 throughput (samples/sec): 189.20
2019-08-13 15:19:33,794 epoch 116 - iter 196/493 - loss 0.09356082 throughput (samples/sec): 172.97
2019-08-13 15:19:42,457 epoch 116 - iter 245/493 - loss 0.09439362 throughput (samples/sec): 181.51
2019-08-13 15:19:50,720 epoch 116 - iter 294/493 - loss 0.09255274 throughput (samples/sec): 190.31
2019-08-13 15:19:59,564 epoch 116 - iter 343/493 - loss 0.09317334 throughput (samples/sec): 177.80
2019-08-13 15:20:08,095 epoch 116 - iter 392/493 - loss 0.09301687 throughput (samples/sec): 184.31
2019-08-13 15:20:16,332 epoch 116 - iter 441/493 - loss 0.09386896 throughput (samples/sec): 190.94
2019-08-13 15:20:24,807 epoch 116 - iter 490/493 - loss 0.09380335 throughput (samples/sec): 185.55
2019-08-13 15:20:25,228 ----------------------------------------------------------------------------------------------------
2019-08-13 15:20:25,228 EPOCH 116 done: loss 0.0935 - lr 0.0016
2019-08-13 15:20:25,228 BAD EPOCHS (no improvement): 4
2019-08-13 15:20:25,228 ----------------------------------------------------------------------------------------------------
2019-08-13 15:20:25,466 epoch 117 - iter 0/493 - loss 0.01579219 throughput (samples/sec): 6620.86
2019-08-13 15:20:33,715 epoch 117 - iter 49/493 - loss 0.07178715 throughput (samples/sec): 190.65
2019-08-13 15:20:42,664 epoch 117 - iter 98/493 - loss 0.09345584 throughput (samples/sec): 175.71
2019-08-13 15:20:51,328 epoch 117 - iter 147/493 - loss 0.09810403 throughput (samples/sec): 181.49
2019-08-13 15:20:59,949 epoch 117 - iter 196/493 - loss 0.09682829 throughput (samples/sec): 182.42
2019-08-13 15:21:08,563 epoch 117 - iter 245/493 - loss 0.09810225 throughput (samples/sec): 182.55
2019-08-13 15:21:17,138 epoch 117 - iter 294/493 - loss 0.09409086 throughput (samples/sec): 183.39
2019-08-13 15:21:25,585 epoch 117 - iter 343/493 - loss 0.09182780 throughput (samples/sec): 186.17
2019-08-13 15:21:34,219 epoch 117 - iter 392/493 - loss 0.09336362 throughput (samples/sec): 182.14
2019-08-13 15:21:42,612 epoch 117 - iter 441/493 - loss 0.09196420 throughput (samples/sec): 187.38
2019-08-13 15:21:51,693 epoch 117 - iter 490/493 - loss 0.09017648 throughput (samples/sec): 173.16
2019-08-13 15:21:52,046 ----------------------------------------------------------------------------------------------------
2019-08-13 15:21:52,047 EPOCH 117 done: loss 0.0903 - lr 0.0008
2019-08-13 15:21:52,047 BAD EPOCHS (no improvement): 1
2019-08-13 15:21:52,047 ----------------------------------------------------------------------------------------------------
2019-08-13 15:21:52,236 epoch 118 - iter 0/493 - loss 0.05304426 throughput (samples/sec): 8329.08
2019-08-13 15:22:01,004 epoch 118 - iter 49/493 - loss 0.08418267 throughput (samples/sec): 179.34
2019-08-13 15:22:09,386 epoch 118 - iter 98/493 - loss 0.09409550 throughput (samples/sec): 187.64
2019-08-13 15:22:17,515 epoch 118 - iter 147/493 - loss 0.08946177 throughput (samples/sec): 193.47
2019-08-13 15:22:26,325 epoch 118 - iter 196/493 - loss 0.09163628 throughput (samples/sec): 178.48
2019-08-13 15:22:35,055 epoch 118 - iter 245/493 - loss 0.09365191 throughput (samples/sec): 180.11
2019-08-13 15:22:43,631 epoch 118 - iter 294/493 - loss 0.09217070 throughput (samples/sec): 183.37
2019-08-13 15:22:52,079 epoch 118 - iter 343/493 - loss 0.09220224 throughput (samples/sec): 186.13
2019-08-13 15:23:00,785 epoch 118 - iter 392/493 - loss 0.09228383 throughput (samples/sec): 180.62
2019-08-13 15:23:09,180 epoch 118 - iter 441/493 - loss 0.09303523 throughput (samples/sec): 187.32
2019-08-13 15:23:17,893 epoch 118 - iter 490/493 - loss 0.09587882 throughput (samples/sec): 180.47
2019-08-13 15:23:18,280 ----------------------------------------------------------------------------------------------------
2019-08-13 15:23:18,280 EPOCH 118 done: loss 0.0956 - lr 0.0008
2019-08-13 15:23:18,280 BAD EPOCHS (no improvement): 2
2019-08-13 15:23:18,280 ----------------------------------------------------------------------------------------------------
2019-08-13 15:23:18,434 epoch 119 - iter 0/493 - loss 0.17674640 throughput (samples/sec): 10281.81
2019-08-13 15:23:26,663 epoch 119 - iter 49/493 - loss 0.08770498 throughput (samples/sec): 191.11
2019-08-13 15:23:35,601 epoch 119 - iter 98/493 - loss 0.09942442 throughput (samples/sec): 175.90
2019-08-13 15:23:44,033 epoch 119 - iter 147/493 - loss 0.09638686 throughput (samples/sec): 186.51
2019-08-13 15:23:52,443 epoch 119 - iter 196/493 - loss 0.09056683 throughput (samples/sec): 186.99
2019-08-13 15:24:00,928 epoch 119 - iter 245/493 - loss 0.08969975 throughput (samples/sec): 185.33
2019-08-13 15:24:09,576 epoch 119 - iter 294/493 - loss 0.08941957 throughput (samples/sec): 181.82
2019-08-13 15:24:18,115 epoch 119 - iter 343/493 - loss 0.08781007 throughput (samples/sec): 184.16
2019-08-13 15:24:26,609 epoch 119 - iter 392/493 - loss 0.08791352 throughput (samples/sec): 185.12
2019-08-13 15:24:35,078 epoch 119 - iter 441/493 - loss 0.08870057 throughput (samples/sec): 185.69
2019-08-13 15:24:44,068 epoch 119 - iter 490/493 - loss 0.08922071 throughput (samples/sec): 174.90
2019-08-13 15:24:44,423 ----------------------------------------------------------------------------------------------------
2019-08-13 15:24:44,424 EPOCH 119 done: loss 0.0890 - lr 0.0008
2019-08-13 15:24:44,424 BAD EPOCHS (no improvement): 3
2019-08-13 15:24:44,424 ----------------------------------------------------------------------------------------------------
2019-08-13 15:24:44,562 epoch 120 - iter 0/493 - loss 0.06040365 throughput (samples/sec): 11416.80
2019-08-13 15:24:53,132 epoch 120 - iter 49/493 - loss 0.06979885 throughput (samples/sec): 183.49
2019-08-13 15:25:01,519 epoch 120 - iter 98/493 - loss 0.08312178 throughput (samples/sec): 187.51
2019-08-13 15:25:10,257 epoch 120 - iter 147/493 - loss 0.07780736 throughput (samples/sec): 179.95
2019-08-13 15:25:18,917 epoch 120 - iter 196/493 - loss 0.08481575 throughput (samples/sec): 181.57
2019-08-13 15:25:27,248 epoch 120 - iter 245/493 - loss 0.08384681 throughput (samples/sec): 188.76
2019-08-13 15:25:35,932 epoch 120 - iter 294/493 - loss 0.08961811 throughput (samples/sec): 181.08
2019-08-13 15:25:44,483 epoch 120 - iter 343/493 - loss 0.08972313 throughput (samples/sec): 183.88
2019-08-13 15:25:53,575 epoch 120 - iter 392/493 - loss 0.09212537 throughput (samples/sec): 172.93
2019-08-13 15:26:01,913 epoch 120 - iter 441/493 - loss 0.09457654 throughput (samples/sec): 188.61
2019-08-13 15:26:10,427 epoch 120 - iter 490/493 - loss 0.09562244 throughput (samples/sec): 184.71
2019-08-13 15:26:10,743 ----------------------------------------------------------------------------------------------------
2019-08-13 15:26:10,743 EPOCH 120 done: loss 0.0955 - lr 0.0008
2019-08-13 15:26:10,743 BAD EPOCHS (no improvement): 4
2019-08-13 15:26:10,744 ----------------------------------------------------------------------------------------------------
2019-08-13 15:26:10,920 epoch 121 - iter 0/493 - loss 0.03243092 throughput (samples/sec): 8950.50
2019-08-13 15:26:19,337 epoch 121 - iter 49/493 - loss 0.09409705 throughput (samples/sec): 186.82
2019-08-13 15:26:27,849 epoch 121 - iter 98/493 - loss 0.09316757 throughput (samples/sec): 184.73
2019-08-13 15:26:36,787 epoch 121 - iter 147/493 - loss 0.09026791 throughput (samples/sec): 175.91
2019-08-13 15:26:45,709 epoch 121 - iter 196/493 - loss 0.08757131 throughput (samples/sec): 176.23
2019-08-13 15:26:54,518 epoch 121 - iter 245/493 - loss 0.08711587 throughput (samples/sec): 178.50
2019-08-13 15:27:03,059 epoch 121 - iter 294/493 - loss 0.08780127 throughput (samples/sec): 184.11
2019-08-13 15:27:11,813 epoch 121 - iter 343/493 - loss 0.08990621 throughput (samples/sec): 179.61
2019-08-13 15:27:20,253 epoch 121 - iter 392/493 - loss 0.09303890 throughput (samples/sec): 186.33
2019-08-13 15:27:28,588 epoch 121 - iter 441/493 - loss 0.09561999 throughput (samples/sec): 188.68
2019-08-13 15:27:36,987 epoch 121 - iter 490/493 - loss 0.09387077 throughput (samples/sec): 187.24
2019-08-13 15:27:37,297 ----------------------------------------------------------------------------------------------------
2019-08-13 15:27:37,297 EPOCH 121 done: loss 0.0946 - lr 0.0004
2019-08-13 15:27:37,297 BAD EPOCHS (no improvement): 1
2019-08-13 15:27:37,298 ----------------------------------------------------------------------------------------------------
2019-08-13 15:27:37,457 epoch 122 - iter 0/493 - loss 0.10086432 throughput (samples/sec): 9917.89
2019-08-13 15:27:46,217 epoch 122 - iter 49/493 - loss 0.12220089 throughput (samples/sec): 179.48
2019-08-13 15:27:54,498 epoch 122 - iter 98/493 - loss 0.10395977 throughput (samples/sec): 189.91
2019-08-13 15:28:02,895 epoch 122 - iter 147/493 - loss 0.09775957 throughput (samples/sec): 187.27
2019-08-13 15:28:11,398 epoch 122 - iter 196/493 - loss 0.09884024 throughput (samples/sec): 184.95
2019-08-13 15:28:19,834 epoch 122 - iter 245/493 - loss 0.09727751 throughput (samples/sec): 186.41
2019-08-13 15:28:28,992 epoch 122 - iter 294/493 - loss 0.09600240 throughput (samples/sec): 171.66
2019-08-13 15:28:37,383 epoch 122 - iter 343/493 - loss 0.09431318 throughput (samples/sec): 187.40
2019-08-13 15:28:45,750 epoch 122 - iter 392/493 - loss 0.09602316 throughput (samples/sec): 187.96
2019-08-13 15:28:54,024 epoch 122 - iter 441/493 - loss 0.09311198 throughput (samples/sec): 190.06
2019-08-13 15:29:02,938 epoch 122 - iter 490/493 - loss 0.09424445 throughput (samples/sec): 176.40
2019-08-13 15:29:03,252 ----------------------------------------------------------------------------------------------------
2019-08-13 15:29:03,253 EPOCH 122 done: loss 0.0943 - lr 0.0004
2019-08-13 15:29:03,253 BAD EPOCHS (no improvement): 2
2019-08-13 15:29:03,253 ----------------------------------------------------------------------------------------------------
2019-08-13 15:29:03,416 epoch 123 - iter 0/493 - loss 0.22405833 throughput (samples/sec): 9636.10
2019-08-13 15:29:11,688 epoch 123 - iter 49/493 - loss 0.11712514 throughput (samples/sec): 190.13
2019-08-13 15:29:20,492 epoch 123 - iter 98/493 - loss 0.12024924 throughput (samples/sec): 178.60
2019-08-13 15:29:28,843 epoch 123 - iter 147/493 - loss 0.11075948 throughput (samples/sec): 188.30
2019-08-13 15:29:37,427 epoch 123 - iter 196/493 - loss 0.10659515 throughput (samples/sec): 183.20
2019-08-13 15:29:46,102 epoch 123 - iter 245/493 - loss 0.10415486 throughput (samples/sec): 181.25
2019-08-13 15:29:54,528 epoch 123 - iter 294/493 - loss 0.10398171 throughput (samples/sec): 186.62
2019-08-13 15:30:02,989 epoch 123 - iter 343/493 - loss 0.09893709 throughput (samples/sec): 185.86
2019-08-13 15:30:11,880 epoch 123 - iter 392/493 - loss 0.09556753 throughput (samples/sec): 176.84
2019-08-13 15:30:20,606 epoch 123 - iter 441/493 - loss 0.09457201 throughput (samples/sec): 180.20
2019-08-13 15:30:29,337 epoch 123 - iter 490/493 - loss 0.09273720 throughput (samples/sec): 180.11
2019-08-13 15:30:29,691 ----------------------------------------------------------------------------------------------------
2019-08-13 15:30:29,692 EPOCH 123 done: loss 0.0927 - lr 0.0004
2019-08-13 15:30:29,692 BAD EPOCHS (no improvement): 3
2019-08-13 15:30:29,692 ----------------------------------------------------------------------------------------------------
2019-08-13 15:30:29,846 epoch 124 - iter 0/493 - loss 0.01049644 throughput (samples/sec): 10243.57
2019-08-13 15:30:38,409 epoch 124 - iter 49/493 - loss 0.12221716 throughput (samples/sec): 183.63
2019-08-13 15:30:46,811 epoch 124 - iter 98/493 - loss 0.10358732 throughput (samples/sec): 187.16
2019-08-13 15:30:55,405 epoch 124 - iter 147/493 - loss 0.09828427 throughput (samples/sec): 182.97
2019-08-13 15:31:03,728 epoch 124 - iter 196/493 - loss 0.09402642 throughput (samples/sec): 188.95
2019-08-13 15:31:12,443 epoch 124 - iter 245/493 - loss 0.09173565 throughput (samples/sec): 180.43
2019-08-13 15:31:21,141 epoch 124 - iter 294/493 - loss 0.08995409 throughput (samples/sec): 180.77
2019-08-13 15:31:29,897 epoch 124 - iter 343/493 - loss 0.09021509 throughput (samples/sec): 179.60
2019-08-13 15:31:38,646 epoch 124 - iter 392/493 - loss 0.08972928 throughput (samples/sec): 179.72
2019-08-13 15:31:47,515 epoch 124 - iter 441/493 - loss 0.08823929 throughput (samples/sec): 177.31
2019-08-13 15:31:56,036 epoch 124 - iter 490/493 - loss 0.08967212 throughput (samples/sec): 184.56
2019-08-13 15:31:56,354 ----------------------------------------------------------------------------------------------------
2019-08-13 15:31:56,355 EPOCH 124 done: loss 0.0900 - lr 0.0004
2019-08-13 15:31:56,355 BAD EPOCHS (no improvement): 4
2019-08-13 15:31:56,355 ----------------------------------------------------------------------------------------------------
2019-08-13 15:31:56,507 epoch 125 - iter 0/493 - loss 0.03781831 throughput (samples/sec): 10398.62
2019-08-13 15:32:05,497 epoch 125 - iter 49/493 - loss 0.09734734 throughput (samples/sec): 174.90
2019-08-13 15:32:14,252 epoch 125 - iter 98/493 - loss 0.09008048 throughput (samples/sec): 179.61
2019-08-13 15:32:22,573 epoch 125 - iter 147/493 - loss 0.10003969 throughput (samples/sec): 189.01
2019-08-13 15:32:31,218 epoch 125 - iter 196/493 - loss 0.09675115 throughput (samples/sec): 181.88
2019-08-13 15:32:39,645 epoch 125 - iter 245/493 - loss 0.09548232 throughput (samples/sec): 186.63
2019-08-13 15:32:48,605 epoch 125 - iter 294/493 - loss 0.09381926 throughput (samples/sec): 175.49
2019-08-13 15:32:57,412 epoch 125 - iter 343/493 - loss 0.09490828 throughput (samples/sec): 178.56
2019-08-13 15:33:06,159 epoch 125 - iter 392/493 - loss 0.09475375 throughput (samples/sec): 179.77
2019-08-13 15:33:14,721 epoch 125 - iter 441/493 - loss 0.09565349 throughput (samples/sec): 183.68
2019-08-13 15:33:23,357 epoch 125 - iter 490/493 - loss 0.09710780 throughput (samples/sec): 182.11
2019-08-13 15:33:23,714 ----------------------------------------------------------------------------------------------------
2019-08-13 15:33:23,714 EPOCH 125 done: loss 0.0971 - lr 0.0002
2019-08-13 15:33:23,714 BAD EPOCHS (no improvement): 1
2019-08-13 15:33:23,714 ----------------------------------------------------------------------------------------------------
2019-08-13 15:33:23,893 epoch 126 - iter 0/493 - loss 0.12386203 throughput (samples/sec): 8790.33
2019-08-13 15:33:32,460 epoch 126 - iter 49/493 - loss 0.07719148 throughput (samples/sec): 183.56
2019-08-13 15:33:41,137 epoch 126 - iter 98/493 - loss 0.07424758 throughput (samples/sec): 181.23
2019-08-13 15:33:49,472 epoch 126 - iter 147/493 - loss 0.08256353 throughput (samples/sec): 188.71
2019-08-13 15:33:58,259 epoch 126 - iter 196/493 - loss 0.08429360 throughput (samples/sec): 178.95
2019-08-13 15:34:07,033 epoch 126 - iter 245/493 - loss 0.08836743 throughput (samples/sec): 179.22
2019-08-13 15:34:15,256 epoch 126 - iter 294/493 - loss 0.08734651 throughput (samples/sec): 191.27
2019-08-13 15:34:24,215 epoch 126 - iter 343/493 - loss 0.09072667 throughput (samples/sec): 175.51
2019-08-13 15:34:32,818 epoch 126 - iter 392/493 - loss 0.09261866 throughput (samples/sec): 182.80
2019-08-13 15:34:42,049 epoch 126 - iter 441/493 - loss 0.09188262 throughput (samples/sec): 170.31
2019-08-13 15:34:50,814 epoch 126 - iter 490/493 - loss 0.09180908 throughput (samples/sec): 179.41
2019-08-13 15:34:51,173 ----------------------------------------------------------------------------------------------------
2019-08-13 15:34:51,173 EPOCH 126 done: loss 0.0916 - lr 0.0002
2019-08-13 15:34:51,173 BAD EPOCHS (no improvement): 2
2019-08-13 15:34:51,174 ----------------------------------------------------------------------------------------------------
2019-08-13 15:34:51,355 epoch 127 - iter 0/493 - loss 0.05825290 throughput (samples/sec): 8713.67
2019-08-13 15:35:00,236 epoch 127 - iter 49/493 - loss 0.08469846 throughput (samples/sec): 177.06
2019-08-13 15:35:08,896 epoch 127 - iter 98/493 - loss 0.09319009 throughput (samples/sec): 181.59
2019-08-13 15:35:17,238 epoch 127 - iter 147/493 - loss 0.09420480 throughput (samples/sec): 188.54
2019-08-13 15:35:25,820 epoch 127 - iter 196/493 - loss 0.08974214 throughput (samples/sec): 183.25
2019-08-13 15:35:34,588 epoch 127 - iter 245/493 - loss 0.08633705 throughput (samples/sec): 179.35
2019-08-13 15:35:42,956 epoch 127 - iter 294/493 - loss 0.09103740 throughput (samples/sec): 187.94
2019-08-13 15:35:51,352 epoch 127 - iter 343/493 - loss 0.08985914 throughput (samples/sec): 187.32
2019-08-13 15:36:00,109 epoch 127 - iter 392/493 - loss 0.09022029 throughput (samples/sec): 179.57
2019-08-13 15:36:08,781 epoch 127 - iter 441/493 - loss 0.08878405 throughput (samples/sec): 181.33
2019-08-13 15:36:17,620 epoch 127 - iter 490/493 - loss 0.09285819 throughput (samples/sec): 177.89
2019-08-13 15:36:18,003 ----------------------------------------------------------------------------------------------------
2019-08-13 15:36:18,004 EPOCH 127 done: loss 0.0928 - lr 0.0002
2019-08-13 15:36:18,004 BAD EPOCHS (no improvement): 3
2019-08-13 15:36:18,004 ----------------------------------------------------------------------------------------------------
2019-08-13 15:36:18,178 epoch 128 - iter 0/493 - loss 0.03650999 throughput (samples/sec): 9061.22
2019-08-13 15:36:26,408 epoch 128 - iter 49/493 - loss 0.08690073 throughput (samples/sec): 191.10
2019-08-13 15:36:35,447 epoch 128 - iter 98/493 - loss 0.09707096 throughput (samples/sec): 173.96
2019-08-13 15:36:44,198 epoch 128 - iter 147/493 - loss 0.09368953 throughput (samples/sec): 179.70
2019-08-13 15:36:52,620 epoch 128 - iter 196/493 - loss 0.09638063 throughput (samples/sec): 186.72
2019-08-13 15:37:01,215 epoch 128 - iter 245/493 - loss 0.09534180 throughput (samples/sec): 182.98
2019-08-13 15:37:09,884 epoch 128 - iter 294/493 - loss 0.09598167 throughput (samples/sec): 181.40
2019-08-13 15:37:18,592 epoch 128 - iter 343/493 - loss 0.09570799 throughput (samples/sec): 180.59
2019-08-13 15:37:27,185 epoch 128 - iter 392/493 - loss 0.09354465 throughput (samples/sec): 183.02
2019-08-13 15:37:35,826 epoch 128 - iter 441/493 - loss 0.09218864 throughput (samples/sec): 181.99
2019-08-13 15:37:44,711 epoch 128 - iter 490/493 - loss 0.09191915 throughput (samples/sec): 176.97
2019-08-13 15:37:45,144 ----------------------------------------------------------------------------------------------------
2019-08-13 15:37:45,145 EPOCH 128 done: loss 0.0925 - lr 0.0002
2019-08-13 15:37:45,145 BAD EPOCHS (no improvement): 4
2019-08-13 15:37:45,145 ----------------------------------------------------------------------------------------------------
2019-08-13 15:37:45,145 ----------------------------------------------------------------------------------------------------
2019-08-13 15:37:45,145 learning rate too small - quitting training!
2019-08-13 15:37:45,145 ----------------------------------------------------------------------------------------------------
2019-08-13 15:37:56,106 ----------------------------------------------------------------------------------------------------
2019-08-13 15:37:56,106 Testing using best model ...
2019-08-13 15:38:55,856 0.8996	0.86	0.8794
2019-08-13 15:38:55,856 
MICRO_AVG: acc 0.7847 - f1-score 0.8794
MACRO_AVG: acc 0.7001 - f1-score 0.810675
LOC        tp: 934 - fp: 99 - fn: 117 - tn: 934 - precision: 0.9042 - recall: 0.8887 - accuracy: 0.8122 - f1-score: 0.8964
MISC       tp: 103 - fp: 28 - fn: 103 - tn: 103 - precision: 0.7863 - recall: 0.5000 - accuracy: 0.4402 - f1-score: 0.6113
ORG        tp: 448 - fp: 99 - fn: 136 - tn: 448 - precision: 0.8190 - recall: 0.7671 - accuracy: 0.6559 - f1-score: 0.7922
PER        tp: 1139 - fp: 67 - fn: 71 - tn: 1139 - precision: 0.9444 - recall: 0.9413 - accuracy: 0.8919 - f1-score: 0.9428
2019-08-13 15:38:55,856 ----------------------------------------------------------------------------------------------------