2019-08-08 05:26:07,763 ----------------------------------------------------------------------------------------------------
2019-08-08 05:26:07,764 Model: "SequenceTagger(
  (embeddings): StackedEmbeddings(
    (list_embedding_0): WordEmbeddings('glove')
    (list_embedding_1): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.25)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 1024)
        (decoder): Linear(in_features=1024, out_features=275, bias=True)
      )
    )
    (list_embedding_2): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.25)
        (encoder): Embedding(275, 100)
        (rnn): LSTM(100, 1024)
        (decoder): Linear(in_features=1024, out_features=275, bias=True)
      )
    )
  )
  (word_dropout): WordDropout(p=0.05)
  (locked_dropout): LockedDropout(p=0.5)
  (embedding2nn): Linear(in_features=2148, out_features=2148, bias=True)
  (rnn): LSTM(2148, 256, bidirectional=True)
  (linear): Linear(in_features=512, out_features=20, bias=True)
)"
2019-08-08 05:26:07,764 ----------------------------------------------------------------------------------------------------
2019-08-08 05:26:07,764 Corpus: "Corpus: 14987 train + 3466 dev + 3684 test sentences"
2019-08-08 05:26:07,764 ----------------------------------------------------------------------------------------------------
2019-08-08 05:26:07,764 Parameters:
2019-08-08 05:26:07,764  - learning_rate: "0.1"
2019-08-08 05:26:07,764  - mini_batch_size: "32"
2019-08-08 05:26:07,764  - patience: "3"
2019-08-08 05:26:07,764  - anneal_factor: "0.5"
2019-08-08 05:26:07,764  - max_epochs: "150"
2019-08-08 05:26:07,764  - shuffle: "True"
2019-08-08 05:26:07,764  - train_with_dev: "True"
2019-08-08 05:26:07,765 ----------------------------------------------------------------------------------------------------
2019-08-08 05:26:07,765 Model training base path: "resources/taggers/NER-conll03--h256-l1-b32-p3-0.5-+glove+news-forward-fast+news-backward-fast-normal-locked0.5-word0.05--release_4"
2019-08-08 05:26:07,765 ----------------------------------------------------------------------------------------------------
2019-08-08 05:26:07,765 Device: cuda:0
2019-08-08 05:26:07,765 ----------------------------------------------------------------------------------------------------
2019-08-08 05:26:07,765 Embeddings storage mode: cpu
2019-08-08 05:26:07,767 ----------------------------------------------------------------------------------------------------
2019-08-08 05:26:07,927 epoch 1 - iter 0/577 - loss 52.29169464 throughput (samples/sec): 11476.18
2019-08-08 05:26:17,853 epoch 1 - iter 57/577 - loss 10.49776010 throughput (samples/sec): 185.47
2019-08-08 05:26:27,906 epoch 1 - iter 114/577 - loss 7.46437231 throughput (samples/sec): 183.07
2019-08-08 05:26:37,971 epoch 1 - iter 171/577 - loss 6.12380889 throughput (samples/sec): 182.88
2019-08-08 05:26:52,982 epoch 1 - iter 228/577 - loss 5.29700275 throughput (samples/sec): 122.21
2019-08-08 05:27:03,005 epoch 1 - iter 285/577 - loss 4.74904494 throughput (samples/sec): 183.62
2019-08-08 05:27:12,591 epoch 1 - iter 342/577 - loss 4.32806871 throughput (samples/sec): 192.15
2019-08-08 05:27:22,380 epoch 1 - iter 399/577 - loss 3.98204130 throughput (samples/sec): 188.06
2019-08-08 05:27:31,903 epoch 1 - iter 456/577 - loss 3.72205593 throughput (samples/sec): 193.30
2019-08-08 05:27:41,892 epoch 1 - iter 513/577 - loss 3.51037591 throughput (samples/sec): 184.14
2019-08-08 05:27:51,800 epoch 1 - iter 570/577 - loss 3.31462981 throughput (samples/sec): 185.83
2019-08-08 05:27:52,925 ----------------------------------------------------------------------------------------------------
2019-08-08 05:27:52,925 EPOCH 1 done: loss 3.2955 - lr 0.1000
2019-08-08 05:28:30,839 TEST : loss 1.1326942443847656 - score 0.856
2019-08-08 05:28:31,007 BAD EPOCHS (no improvement): 0
2019-08-08 05:28:31,008 ----------------------------------------------------------------------------------------------------
2019-08-08 05:28:31,106 epoch 2 - iter 0/577 - loss 1.21484971 throughput (samples/sec): 18890.32
2019-08-08 05:28:37,029 epoch 2 - iter 57/577 - loss 1.54035008 throughput (samples/sec): 312.46
2019-08-08 05:28:42,855 epoch 2 - iter 114/577 - loss 1.49006875 throughput (samples/sec): 318.07
2019-08-08 05:28:48,634 epoch 2 - iter 171/577 - loss 1.44647314 throughput (samples/sec): 320.84
2019-08-08 05:28:54,413 epoch 2 - iter 228/577 - loss 1.44513940 throughput (samples/sec): 320.51
2019-08-08 05:29:00,282 epoch 2 - iter 285/577 - loss 1.42755859 throughput (samples/sec): 315.48
2019-08-08 05:29:06,061 epoch 2 - iter 342/577 - loss 1.40035592 throughput (samples/sec): 320.40
2019-08-08 05:29:11,862 epoch 2 - iter 399/577 - loss 1.38685859 throughput (samples/sec): 319.51
2019-08-08 05:29:17,885 epoch 2 - iter 456/577 - loss 1.37493018 throughput (samples/sec): 307.45
2019-08-08 05:29:23,774 epoch 2 - iter 513/577 - loss 1.36745549 throughput (samples/sec): 314.71
2019-08-08 05:29:29,642 epoch 2 - iter 570/577 - loss 1.35710893 throughput (samples/sec): 315.90
2019-08-08 05:29:30,317 ----------------------------------------------------------------------------------------------------
2019-08-08 05:29:30,318 EPOCH 2 done: loss 1.3523 - lr 0.1000
2019-08-08 05:29:59,501 TEST : loss 0.9518426060676575 - score 0.8763
2019-08-08 05:29:59,675 BAD EPOCHS (no improvement): 0
2019-08-08 05:29:59,676 ----------------------------------------------------------------------------------------------------
2019-08-08 05:29:59,782 epoch 3 - iter 0/577 - loss 1.69461000 throughput (samples/sec): 17389.31
2019-08-08 05:30:05,772 epoch 3 - iter 57/577 - loss 1.17148084 throughput (samples/sec): 309.22
2019-08-08 05:30:11,807 epoch 3 - iter 114/577 - loss 1.18889956 throughput (samples/sec): 306.43
2019-08-08 05:30:17,732 epoch 3 - iter 171/577 - loss 1.17253002 throughput (samples/sec): 312.17
2019-08-08 05:30:23,643 epoch 3 - iter 228/577 - loss 1.17086720 throughput (samples/sec): 313.45
2019-08-08 05:30:29,476 epoch 3 - iter 285/577 - loss 1.14601340 throughput (samples/sec): 317.20
2019-08-08 05:30:35,401 epoch 3 - iter 342/577 - loss 1.13897121 throughput (samples/sec): 312.44
2019-08-08 05:30:41,204 epoch 3 - iter 399/577 - loss 1.10360933 throughput (samples/sec): 319.09
2019-08-08 05:30:47,164 epoch 3 - iter 456/577 - loss 1.10284035 throughput (samples/sec): 310.62
2019-08-08 05:30:52,917 epoch 3 - iter 513/577 - loss 1.09037617 throughput (samples/sec): 322.27
2019-08-08 05:30:58,843 epoch 3 - iter 570/577 - loss 1.07855872 throughput (samples/sec): 312.25
2019-08-08 05:30:59,510 ----------------------------------------------------------------------------------------------------
2019-08-08 05:30:59,510 EPOCH 3 done: loss 1.0813 - lr 0.1000
2019-08-08 05:31:28,953 TEST : loss 0.8123615980148315 - score 0.8976
2019-08-08 05:31:29,126 BAD EPOCHS (no improvement): 0
2019-08-08 05:31:29,126 ----------------------------------------------------------------------------------------------------
2019-08-08 05:31:29,238 epoch 4 - iter 0/577 - loss 0.63397831 throughput (samples/sec): 16548.01
2019-08-08 05:31:35,118 epoch 4 - iter 57/577 - loss 0.97647998 throughput (samples/sec): 314.81
2019-08-08 05:31:41,229 epoch 4 - iter 114/577 - loss 0.90408128 throughput (samples/sec): 309.23
2019-08-08 05:31:47,210 epoch 4 - iter 171/577 - loss 0.92705981 throughput (samples/sec): 309.70
2019-08-08 05:31:53,241 epoch 4 - iter 228/577 - loss 0.90622784 throughput (samples/sec): 307.00
2019-08-08 05:31:59,158 epoch 4 - iter 285/577 - loss 0.89149477 throughput (samples/sec): 313.23
2019-08-08 05:32:05,001 epoch 4 - iter 342/577 - loss 0.89020092 throughput (samples/sec): 316.93
2019-08-08 05:32:10,822 epoch 4 - iter 399/577 - loss 0.89495042 throughput (samples/sec): 318.19
2019-08-08 05:32:16,621 epoch 4 - iter 456/577 - loss 0.89449324 throughput (samples/sec): 319.62
2019-08-08 05:32:22,398 epoch 4 - iter 513/577 - loss 0.90116880 throughput (samples/sec): 320.71
2019-08-08 05:32:28,368 epoch 4 - iter 570/577 - loss 0.90478870 throughput (samples/sec): 310.48
2019-08-08 05:32:29,073 ----------------------------------------------------------------------------------------------------
2019-08-08 05:32:29,074 EPOCH 4 done: loss 0.9034 - lr 0.1000
2019-08-08 05:32:58,341 TEST : loss 0.8617953658103943 - score 0.8986
2019-08-08 05:32:58,512 BAD EPOCHS (no improvement): 0
2019-08-08 05:32:58,513 ----------------------------------------------------------------------------------------------------
2019-08-08 05:32:58,612 epoch 5 - iter 0/577 - loss 0.88791358 throughput (samples/sec): 18587.14
2019-08-08 05:33:04,438 epoch 5 - iter 57/577 - loss 0.86773812 throughput (samples/sec): 318.00
2019-08-08 05:33:10,289 epoch 5 - iter 114/577 - loss 0.85642925 throughput (samples/sec): 316.61
2019-08-08 05:33:16,282 epoch 5 - iter 171/577 - loss 0.86060912 throughput (samples/sec): 309.05
2019-08-08 05:33:22,114 epoch 5 - iter 228/577 - loss 0.85297379 throughput (samples/sec): 317.41
2019-08-08 05:33:28,027 epoch 5 - iter 285/577 - loss 0.83113545 throughput (samples/sec): 313.03
2019-08-08 05:33:33,876 epoch 5 - iter 342/577 - loss 0.83994775 throughput (samples/sec): 316.30
2019-08-08 05:33:39,859 epoch 5 - iter 399/577 - loss 0.83694819 throughput (samples/sec): 309.55
2019-08-08 05:33:45,826 epoch 5 - iter 456/577 - loss 0.85411038 throughput (samples/sec): 310.43
2019-08-08 05:33:51,590 epoch 5 - iter 513/577 - loss 0.85214873 throughput (samples/sec): 321.15
2019-08-08 05:33:57,380 epoch 5 - iter 570/577 - loss 0.86534477 throughput (samples/sec): 319.96
2019-08-08 05:33:58,086 ----------------------------------------------------------------------------------------------------
2019-08-08 05:33:58,087 EPOCH 5 done: loss 0.8662 - lr 0.1000
2019-08-08 05:34:27,387 TEST : loss 0.7896023392677307 - score 0.8995
2019-08-08 05:34:27,559 BAD EPOCHS (no improvement): 0
2019-08-08 05:34:27,560 ----------------------------------------------------------------------------------------------------
2019-08-08 05:34:27,663 epoch 6 - iter 0/577 - loss 0.53397703 throughput (samples/sec): 17830.76
2019-08-08 05:34:33,654 epoch 6 - iter 57/577 - loss 0.75129466 throughput (samples/sec): 309.61
2019-08-08 05:34:39,470 epoch 6 - iter 114/577 - loss 0.76401025 throughput (samples/sec): 318.47
2019-08-08 05:34:45,232 epoch 6 - iter 171/577 - loss 0.77209097 throughput (samples/sec): 321.45
2019-08-08 05:34:51,108 epoch 6 - iter 228/577 - loss 0.78742046 throughput (samples/sec): 315.08
2019-08-08 05:34:56,832 epoch 6 - iter 285/577 - loss 0.76584536 throughput (samples/sec): 323.58
2019-08-08 05:35:02,652 epoch 6 - iter 342/577 - loss 0.76267043 throughput (samples/sec): 317.90
2019-08-08 05:35:08,419 epoch 6 - iter 399/577 - loss 0.77207214 throughput (samples/sec): 321.14
2019-08-08 05:35:14,277 epoch 6 - iter 456/577 - loss 0.77314177 throughput (samples/sec): 316.26
2019-08-08 05:35:20,151 epoch 6 - iter 513/577 - loss 0.77012852 throughput (samples/sec): 315.10
2019-08-08 05:35:26,033 epoch 6 - iter 570/577 - loss 0.76653189 throughput (samples/sec): 314.75
2019-08-08 05:35:26,707 ----------------------------------------------------------------------------------------------------
2019-08-08 05:35:26,708 EPOCH 6 done: loss 0.7666 - lr 0.1000
2019-08-08 05:35:56,044 TEST : loss 0.766166090965271 - score 0.9121
2019-08-08 05:35:56,212 BAD EPOCHS (no improvement): 0
2019-08-08 05:35:56,213 ----------------------------------------------------------------------------------------------------
2019-08-08 05:35:56,327 epoch 7 - iter 0/577 - loss 0.36094952 throughput (samples/sec): 16157.73
2019-08-08 05:36:02,247 epoch 7 - iter 57/577 - loss 0.68012854 throughput (samples/sec): 312.94
2019-08-08 05:36:08,136 epoch 7 - iter 114/577 - loss 0.69139151 throughput (samples/sec): 314.56
2019-08-08 05:36:14,053 epoch 7 - iter 171/577 - loss 0.68026242 throughput (samples/sec): 312.84
2019-08-08 05:36:19,849 epoch 7 - iter 228/577 - loss 0.70938771 throughput (samples/sec): 319.65
2019-08-08 05:36:25,739 epoch 7 - iter 285/577 - loss 0.70406894 throughput (samples/sec): 314.49
2019-08-08 05:36:31,554 epoch 7 - iter 342/577 - loss 0.69918676 throughput (samples/sec): 318.69
2019-08-08 05:36:37,320 epoch 7 - iter 399/577 - loss 0.71461672 throughput (samples/sec): 321.72
2019-08-08 05:36:43,268 epoch 7 - iter 456/577 - loss 0.71242531 throughput (samples/sec): 311.68
2019-08-08 05:36:49,142 epoch 7 - iter 513/577 - loss 0.71065420 throughput (samples/sec): 315.36
2019-08-08 05:36:54,937 epoch 7 - iter 570/577 - loss 0.70864762 throughput (samples/sec): 319.69
2019-08-08 05:36:55,609 ----------------------------------------------------------------------------------------------------
2019-08-08 05:36:55,610 EPOCH 7 done: loss 0.7090 - lr 0.1000
2019-08-08 05:37:24,987 TEST : loss 0.7541283965110779 - score 0.9068
2019-08-08 05:37:25,156 BAD EPOCHS (no improvement): 0
2019-08-08 05:37:25,157 ----------------------------------------------------------------------------------------------------
2019-08-08 05:37:25,258 epoch 8 - iter 0/577 - loss 0.91301328 throughput (samples/sec): 18285.44
2019-08-08 05:37:31,225 epoch 8 - iter 57/577 - loss 0.60901395 throughput (samples/sec): 310.48
2019-08-08 05:37:37,060 epoch 8 - iter 114/577 - loss 0.63041725 throughput (samples/sec): 317.34
2019-08-08 05:37:42,951 epoch 8 - iter 171/577 - loss 0.67780850 throughput (samples/sec): 314.36
2019-08-08 05:37:49,020 epoch 8 - iter 228/577 - loss 0.68852852 throughput (samples/sec): 305.13
2019-08-08 05:37:54,782 epoch 8 - iter 285/577 - loss 0.67777822 throughput (samples/sec): 321.67
2019-08-08 05:38:00,658 epoch 8 - iter 342/577 - loss 0.66705121 throughput (samples/sec): 315.32
2019-08-08 05:38:06,446 epoch 8 - iter 399/577 - loss 0.67570842 throughput (samples/sec): 320.25
2019-08-08 05:38:12,305 epoch 8 - iter 456/577 - loss 0.68061271 throughput (samples/sec): 316.17
2019-08-08 05:38:18,113 epoch 8 - iter 513/577 - loss 0.67957809 throughput (samples/sec): 318.99
2019-08-08 05:38:23,947 epoch 8 - iter 570/577 - loss 0.67668072 throughput (samples/sec): 317.52
2019-08-08 05:38:24,629 ----------------------------------------------------------------------------------------------------
2019-08-08 05:38:24,630 EPOCH 8 done: loss 0.6788 - lr 0.1000
2019-08-08 05:38:53,947 TEST : loss 0.7555541396141052 - score 0.9122
2019-08-08 05:38:54,112 BAD EPOCHS (no improvement): 0
2019-08-08 05:38:54,113 ----------------------------------------------------------------------------------------------------
2019-08-08 05:38:54,258 epoch 9 - iter 0/577 - loss 0.96597153 throughput (samples/sec): 12713.77
2019-08-08 05:39:00,086 epoch 9 - iter 57/577 - loss 0.68614991 throughput (samples/sec): 317.97
2019-08-08 05:39:05,932 epoch 9 - iter 114/577 - loss 0.64971698 throughput (samples/sec): 316.89
2019-08-08 05:39:11,711 epoch 9 - iter 171/577 - loss 0.64202869 throughput (samples/sec): 320.71
2019-08-08 05:39:17,622 epoch 9 - iter 228/577 - loss 0.63526086 throughput (samples/sec): 313.25
2019-08-08 05:39:23,568 epoch 9 - iter 285/577 - loss 0.64398330 throughput (samples/sec): 311.57
2019-08-08 05:39:29,462 epoch 9 - iter 342/577 - loss 0.64296578 throughput (samples/sec): 314.48
2019-08-08 05:39:35,477 epoch 9 - iter 399/577 - loss 0.65117428 throughput (samples/sec): 307.85
2019-08-08 05:39:41,461 epoch 9 - iter 456/577 - loss 0.65044069 throughput (samples/sec): 309.29
2019-08-08 05:39:47,222 epoch 9 - iter 513/577 - loss 0.64897315 throughput (samples/sec): 321.50
2019-08-08 05:39:53,105 epoch 9 - iter 570/577 - loss 0.64177100 throughput (samples/sec): 314.71
2019-08-08 05:39:53,756 ----------------------------------------------------------------------------------------------------
2019-08-08 05:39:53,756 EPOCH 9 done: loss 0.6410 - lr 0.1000
2019-08-08 05:40:23,095 TEST : loss 0.7348212003707886 - score 0.9143
2019-08-08 05:40:23,272 BAD EPOCHS (no improvement): 0
2019-08-08 05:40:23,273 ----------------------------------------------------------------------------------------------------
2019-08-08 05:40:23,377 epoch 10 - iter 0/577 - loss 1.13150907 throughput (samples/sec): 18040.49
2019-08-08 05:40:29,360 epoch 10 - iter 57/577 - loss 0.60733698 throughput (samples/sec): 310.26
2019-08-08 05:40:35,151 epoch 10 - iter 114/577 - loss 0.60922609 throughput (samples/sec): 320.38
2019-08-08 05:40:41,020 epoch 10 - iter 171/577 - loss 0.59450396 throughput (samples/sec): 315.76
2019-08-08 05:40:46,970 epoch 10 - iter 228/577 - loss 0.60295825 throughput (samples/sec): 311.36
2019-08-08 05:40:52,832 epoch 10 - iter 285/577 - loss 0.60344073 throughput (samples/sec): 316.04
2019-08-08 05:40:58,785 epoch 10 - iter 342/577 - loss 0.61318716 throughput (samples/sec): 310.90
2019-08-08 05:41:04,531 epoch 10 - iter 399/577 - loss 0.61328659 throughput (samples/sec): 322.10
2019-08-08 05:41:10,337 epoch 10 - iter 456/577 - loss 0.60770096 throughput (samples/sec): 318.88
2019-08-08 05:41:16,213 epoch 10 - iter 513/577 - loss 0.61235636 throughput (samples/sec): 315.12
2019-08-08 05:41:22,007 epoch 10 - iter 570/577 - loss 0.62510740 throughput (samples/sec): 319.43
2019-08-08 05:41:22,774 ----------------------------------------------------------------------------------------------------
2019-08-08 05:41:22,774 EPOCH 10 done: loss 0.6274 - lr 0.1000
2019-08-08 05:41:52,066 TEST : loss 0.7307957410812378 - score 0.9158
2019-08-08 05:41:52,233 BAD EPOCHS (no improvement): 0
2019-08-08 05:41:52,234 ----------------------------------------------------------------------------------------------------
2019-08-08 05:41:52,345 epoch 11 - iter 0/577 - loss 0.78802061 throughput (samples/sec): 17028.73
2019-08-08 05:41:58,247 epoch 11 - iter 57/577 - loss 0.56772639 throughput (samples/sec): 314.04
2019-08-08 05:42:04,086 epoch 11 - iter 114/577 - loss 0.56112158 throughput (samples/sec): 317.50
2019-08-08 05:42:09,776 epoch 11 - iter 171/577 - loss 0.57566416 throughput (samples/sec): 325.48
2019-08-08 05:42:15,688 epoch 11 - iter 228/577 - loss 0.56611468 throughput (samples/sec): 313.31
2019-08-08 05:42:21,619 epoch 11 - iter 285/577 - loss 0.56810260 throughput (samples/sec): 312.33
2019-08-08 05:42:27,510 epoch 11 - iter 342/577 - loss 0.57676922 throughput (samples/sec): 314.26
2019-08-08 05:42:33,245 epoch 11 - iter 399/577 - loss 0.56697320 throughput (samples/sec): 323.13
2019-08-08 05:42:39,005 epoch 11 - iter 456/577 - loss 0.57018144 throughput (samples/sec): 321.24
2019-08-08 05:42:45,027 epoch 11 - iter 513/577 - loss 0.57341465 throughput (samples/sec): 307.29
2019-08-08 05:42:51,001 epoch 11 - iter 570/577 - loss 0.57706667 throughput (samples/sec): 309.95
2019-08-08 05:42:51,677 ----------------------------------------------------------------------------------------------------
2019-08-08 05:42:51,677 EPOCH 11 done: loss 0.5777 - lr 0.1000
2019-08-08 05:43:21,068 TEST : loss 0.7447970509529114 - score 0.9141
2019-08-08 05:43:21,228 BAD EPOCHS (no improvement): 0
2019-08-08 05:43:21,229 ----------------------------------------------------------------------------------------------------
2019-08-08 05:43:21,348 epoch 12 - iter 0/577 - loss 1.13221335 throughput (samples/sec): 15548.45
2019-08-08 05:43:27,248 epoch 12 - iter 57/577 - loss 0.54845268 throughput (samples/sec): 314.05
2019-08-08 05:43:33,141 epoch 12 - iter 114/577 - loss 0.56547286 throughput (samples/sec): 314.46
2019-08-08 05:43:38,894 epoch 12 - iter 171/577 - loss 0.56217306 throughput (samples/sec): 321.95
2019-08-08 05:43:44,807 epoch 12 - iter 228/577 - loss 0.56926585 throughput (samples/sec): 312.95
2019-08-08 05:43:50,581 epoch 12 - iter 285/577 - loss 0.56245912 throughput (samples/sec): 320.94
2019-08-08 05:43:56,404 epoch 12 - iter 342/577 - loss 0.55783970 throughput (samples/sec): 318.00
2019-08-08 05:44:02,361 epoch 12 - iter 399/577 - loss 0.54763459 throughput (samples/sec): 311.08
2019-08-08 05:44:08,212 epoch 12 - iter 456/577 - loss 0.54971191 throughput (samples/sec): 316.48
2019-08-08 05:44:14,028 epoch 12 - iter 513/577 - loss 0.56095815 throughput (samples/sec): 318.37
2019-08-08 05:44:19,988 epoch 12 - iter 570/577 - loss 0.55558822 throughput (samples/sec): 310.53
2019-08-08 05:44:20,661 ----------------------------------------------------------------------------------------------------
2019-08-08 05:44:20,661 EPOCH 12 done: loss 0.5563 - lr 0.1000
2019-08-08 05:44:50,007 TEST : loss 0.7758545279502869 - score 0.9151
2019-08-08 05:44:50,169 BAD EPOCHS (no improvement): 0
2019-08-08 05:44:50,169 ----------------------------------------------------------------------------------------------------
2019-08-08 05:44:50,258 epoch 13 - iter 0/577 - loss 0.47750124 throughput (samples/sec): 20883.65
2019-08-08 05:44:56,248 epoch 13 - iter 57/577 - loss 0.51263558 throughput (samples/sec): 309.16
2019-08-08 05:45:02,219 epoch 13 - iter 114/577 - loss 0.53057552 throughput (samples/sec): 310.08
2019-08-08 05:45:07,974 epoch 13 - iter 171/577 - loss 0.51832472 throughput (samples/sec): 322.10
2019-08-08 05:45:13,631 epoch 13 - iter 228/577 - loss 0.52570936 throughput (samples/sec): 327.41
2019-08-08 05:45:19,500 epoch 13 - iter 285/577 - loss 0.55052724 throughput (samples/sec): 315.80
2019-08-08 05:45:25,306 epoch 13 - iter 342/577 - loss 0.54825924 throughput (samples/sec): 319.02
2019-08-08 05:45:31,092 epoch 13 - iter 399/577 - loss 0.54636642 throughput (samples/sec): 320.10
2019-08-08 05:45:36,951 epoch 13 - iter 456/577 - loss 0.54973416 throughput (samples/sec): 316.02
2019-08-08 05:45:42,935 epoch 13 - iter 513/577 - loss 0.55908311 throughput (samples/sec): 309.36
2019-08-08 05:45:48,624 epoch 13 - iter 570/577 - loss 0.55579458 throughput (samples/sec): 325.46
2019-08-08 05:45:49,294 ----------------------------------------------------------------------------------------------------
2019-08-08 05:45:49,294 EPOCH 13 done: loss 0.5552 - lr 0.1000
2019-08-08 05:46:18,534 TEST : loss 0.7316373586654663 - score 0.916
2019-08-08 05:46:18,704 BAD EPOCHS (no improvement): 0
2019-08-08 05:46:18,705 ----------------------------------------------------------------------------------------------------
2019-08-08 05:46:18,807 epoch 14 - iter 0/577 - loss 0.49772203 throughput (samples/sec): 18201.83
2019-08-08 05:46:24,775 epoch 14 - iter 57/577 - loss 0.46826978 throughput (samples/sec): 310.14
2019-08-08 05:46:30,651 epoch 14 - iter 114/577 - loss 0.49454939 throughput (samples/sec): 315.59
2019-08-08 05:46:36,616 epoch 14 - iter 171/577 - loss 0.49768278 throughput (samples/sec): 310.55
2019-08-08 05:46:42,355 epoch 14 - iter 228/577 - loss 0.50349770 throughput (samples/sec): 323.00
2019-08-08 05:46:48,185 epoch 14 - iter 285/577 - loss 0.50689337 throughput (samples/sec): 318.05
2019-08-08 05:46:53,960 epoch 14 - iter 342/577 - loss 0.50869326 throughput (samples/sec): 320.56
2019-08-08 05:46:59,815 epoch 14 - iter 399/577 - loss 0.50870278 throughput (samples/sec): 316.15
2019-08-08 05:47:05,724 epoch 14 - iter 456/577 - loss 0.52005688 throughput (samples/sec): 313.34
2019-08-08 05:47:11,580 epoch 14 - iter 513/577 - loss 0.51531644 throughput (samples/sec): 316.39
2019-08-08 05:47:17,478 epoch 14 - iter 570/577 - loss 0.51805799 throughput (samples/sec): 313.74
2019-08-08 05:47:18,175 ----------------------------------------------------------------------------------------------------
2019-08-08 05:47:18,176 EPOCH 14 done: loss 0.5180 - lr 0.1000
2019-08-08 05:47:47,479 TEST : loss 0.76283198595047 - score 0.9207
2019-08-08 05:47:47,648 BAD EPOCHS (no improvement): 0
2019-08-08 05:47:47,648 ----------------------------------------------------------------------------------------------------
2019-08-08 05:47:47,750 epoch 15 - iter 0/577 - loss 1.36074138 throughput (samples/sec): 18256.56
2019-08-08 05:47:53,500 epoch 15 - iter 57/577 - loss 0.57507082 throughput (samples/sec): 322.13
2019-08-08 05:47:59,356 epoch 15 - iter 114/577 - loss 0.52828634 throughput (samples/sec): 316.07
2019-08-08 05:48:05,229 epoch 15 - iter 171/577 - loss 0.52528880 throughput (samples/sec): 315.24
2019-08-08 05:48:11,152 epoch 15 - iter 228/577 - loss 0.52127397 throughput (samples/sec): 312.41
2019-08-08 05:48:17,127 epoch 15 - iter 285/577 - loss 0.52553155 throughput (samples/sec): 309.66
2019-08-08 05:48:22,929 epoch 15 - iter 342/577 - loss 0.53121793 throughput (samples/sec): 319.26
2019-08-08 05:48:28,790 epoch 15 - iter 399/577 - loss 0.53107332 throughput (samples/sec): 316.35
2019-08-08 05:48:34,578 epoch 15 - iter 456/577 - loss 0.52764548 throughput (samples/sec): 319.88
2019-08-08 05:48:40,420 epoch 15 - iter 513/577 - loss 0.51885917 throughput (samples/sec): 317.09
2019-08-08 05:48:46,259 epoch 15 - iter 570/577 - loss 0.51504740 throughput (samples/sec): 317.52
2019-08-08 05:48:46,901 ----------------------------------------------------------------------------------------------------
2019-08-08 05:48:46,902 EPOCH 15 done: loss 0.5178 - lr 0.1000
2019-08-08 05:49:16,138 TEST : loss 0.7165988087654114 - score 0.922
2019-08-08 05:49:16,312 BAD EPOCHS (no improvement): 0
2019-08-08 05:49:16,313 ----------------------------------------------------------------------------------------------------
2019-08-08 05:49:16,406 epoch 16 - iter 0/577 - loss 0.07252461 throughput (samples/sec): 19858.66
2019-08-08 05:49:22,390 epoch 16 - iter 57/577 - loss 0.52799694 throughput (samples/sec): 309.57
2019-08-08 05:49:28,236 epoch 16 - iter 114/577 - loss 0.49293250 throughput (samples/sec): 317.07
2019-08-08 05:49:34,066 epoch 16 - iter 171/577 - loss 0.49271647 throughput (samples/sec): 317.42
2019-08-08 05:49:39,936 epoch 16 - iter 228/577 - loss 0.49466662 throughput (samples/sec): 315.48
2019-08-08 05:49:45,824 epoch 16 - iter 285/577 - loss 0.50335792 throughput (samples/sec): 314.36
2019-08-08 05:49:51,747 epoch 16 - iter 342/577 - loss 0.49070791 throughput (samples/sec): 312.53
2019-08-08 05:49:57,689 epoch 16 - iter 399/577 - loss 0.48696651 throughput (samples/sec): 311.62
2019-08-08 05:50:03,658 epoch 16 - iter 456/577 - loss 0.48402478 throughput (samples/sec): 310.68
2019-08-08 05:50:09,558 epoch 16 - iter 513/577 - loss 0.48546621 throughput (samples/sec): 314.15
2019-08-08 05:50:15,387 epoch 16 - iter 570/577 - loss 0.49081869 throughput (samples/sec): 317.74
2019-08-08 05:50:16,052 ----------------------------------------------------------------------------------------------------
2019-08-08 05:50:16,053 EPOCH 16 done: loss 0.4899 - lr 0.1000
2019-08-08 05:50:45,311 TEST : loss 0.7171238660812378 - score 0.9207
2019-08-08 05:50:45,488 BAD EPOCHS (no improvement): 0
2019-08-08 05:50:45,489 ----------------------------------------------------------------------------------------------------
2019-08-08 05:50:45,597 epoch 17 - iter 0/577 - loss 0.35236219 throughput (samples/sec): 17143.66
2019-08-08 05:50:51,516 epoch 17 - iter 57/577 - loss 0.49396112 throughput (samples/sec): 312.94
2019-08-08 05:50:57,398 epoch 17 - iter 114/577 - loss 0.49592634 throughput (samples/sec): 315.01
2019-08-08 05:51:03,166 epoch 17 - iter 171/577 - loss 0.50205633 throughput (samples/sec): 321.41
2019-08-08 05:51:09,054 epoch 17 - iter 228/577 - loss 0.49566176 throughput (samples/sec): 314.66
2019-08-08 05:51:14,844 epoch 17 - iter 285/577 - loss 0.48829300 throughput (samples/sec): 319.82
2019-08-08 05:51:20,668 epoch 17 - iter 342/577 - loss 0.49325667 throughput (samples/sec): 317.56
2019-08-08 05:51:26,608 epoch 17 - iter 399/577 - loss 0.49013561 throughput (samples/sec): 311.78
2019-08-08 05:51:32,373 epoch 17 - iter 456/577 - loss 0.47861180 throughput (samples/sec): 321.02
2019-08-08 05:51:38,231 epoch 17 - iter 513/577 - loss 0.48206328 throughput (samples/sec): 316.10
2019-08-08 05:51:44,082 epoch 17 - iter 570/577 - loss 0.48024056 throughput (samples/sec): 316.45
2019-08-08 05:51:44,725 ----------------------------------------------------------------------------------------------------
2019-08-08 05:51:44,725 EPOCH 17 done: loss 0.4812 - lr 0.1000
2019-08-08 05:52:14,014 TEST : loss 0.7480577230453491 - score 0.9196
2019-08-08 05:52:14,196 BAD EPOCHS (no improvement): 0
2019-08-08 05:52:14,197 ----------------------------------------------------------------------------------------------------
2019-08-08 05:52:14,311 epoch 18 - iter 0/577 - loss 0.69781506 throughput (samples/sec): 16181.93
2019-08-08 05:52:20,126 epoch 18 - iter 57/577 - loss 0.45121538 throughput (samples/sec): 320.18
2019-08-08 05:52:26,024 epoch 18 - iter 114/577 - loss 0.43852971 throughput (samples/sec): 313.96
2019-08-08 05:52:31,910 epoch 18 - iter 171/577 - loss 0.46310229 throughput (samples/sec): 314.56
2019-08-08 05:52:37,777 epoch 18 - iter 228/577 - loss 0.46630353 throughput (samples/sec): 315.45
2019-08-08 05:52:43,513 epoch 18 - iter 285/577 - loss 0.46183467 throughput (samples/sec): 323.04
2019-08-08 05:52:49,229 epoch 18 - iter 342/577 - loss 0.45726383 throughput (samples/sec): 324.37
2019-08-08 05:52:55,049 epoch 18 - iter 399/577 - loss 0.45927353 throughput (samples/sec): 318.39
2019-08-08 05:53:00,998 epoch 18 - iter 456/577 - loss 0.45965958 throughput (samples/sec): 311.06
2019-08-08 05:53:06,864 epoch 18 - iter 513/577 - loss 0.46252227 throughput (samples/sec): 315.76
2019-08-08 05:53:12,761 epoch 18 - iter 570/577 - loss 0.46385026 throughput (samples/sec): 314.12
2019-08-08 05:53:13,395 ----------------------------------------------------------------------------------------------------
2019-08-08 05:53:13,396 EPOCH 18 done: loss 0.4629 - lr 0.1000
2019-08-08 05:53:42,679 TEST : loss 0.7346667647361755 - score 0.9225
2019-08-08 05:53:42,860 BAD EPOCHS (no improvement): 0
2019-08-08 05:53:42,861 ----------------------------------------------------------------------------------------------------
2019-08-08 05:53:42,964 epoch 19 - iter 0/577 - loss 0.27011573 throughput (samples/sec): 17842.77
2019-08-08 05:53:48,865 epoch 19 - iter 57/577 - loss 0.45694936 throughput (samples/sec): 313.68
2019-08-08 05:53:54,873 epoch 19 - iter 114/577 - loss 0.46606169 throughput (samples/sec): 308.35
2019-08-08 05:54:00,707 epoch 19 - iter 171/577 - loss 0.46990486 throughput (samples/sec): 317.66
2019-08-08 05:54:06,437 epoch 19 - iter 228/577 - loss 0.47095680 throughput (samples/sec): 323.38
2019-08-08 05:54:12,308 epoch 19 - iter 285/577 - loss 0.47709269 throughput (samples/sec): 315.43
2019-08-08 05:54:18,043 epoch 19 - iter 342/577 - loss 0.48285032 throughput (samples/sec): 323.26
2019-08-08 05:54:23,893 epoch 19 - iter 399/577 - loss 0.47132140 throughput (samples/sec): 316.61
2019-08-08 05:54:29,833 epoch 19 - iter 456/577 - loss 0.47601128 throughput (samples/sec): 312.02
2019-08-08 05:54:35,672 epoch 19 - iter 513/577 - loss 0.46655845 throughput (samples/sec): 317.54
2019-08-08 05:54:41,392 epoch 19 - iter 570/577 - loss 0.46600758 throughput (samples/sec): 323.99
2019-08-08 05:54:42,138 ----------------------------------------------------------------------------------------------------
2019-08-08 05:54:42,139 EPOCH 19 done: loss 0.4675 - lr 0.1000
2019-08-08 05:55:11,301 TEST : loss 0.7530593872070312 - score 0.9203
2019-08-08 05:55:11,472 BAD EPOCHS (no improvement): 1
2019-08-08 05:55:11,473 ----------------------------------------------------------------------------------------------------
2019-08-08 05:55:11,582 epoch 20 - iter 0/577 - loss 0.91229975 throughput (samples/sec): 17052.71
2019-08-08 05:55:17,394 epoch 20 - iter 57/577 - loss 0.40700711 throughput (samples/sec): 318.73
2019-08-08 05:55:23,286 epoch 20 - iter 114/577 - loss 0.42093427 throughput (samples/sec): 314.17
2019-08-08 05:55:29,261 epoch 20 - iter 171/577 - loss 0.42836875 throughput (samples/sec): 309.82
2019-08-08 05:55:35,217 epoch 20 - iter 228/577 - loss 0.43668211 throughput (samples/sec): 311.12
2019-08-08 05:55:41,014 epoch 20 - iter 285/577 - loss 0.44438056 throughput (samples/sec): 319.38
2019-08-08 05:55:46,747 epoch 20 - iter 342/577 - loss 0.44172029 throughput (samples/sec): 323.18
2019-08-08 05:55:52,541 epoch 20 - iter 399/577 - loss 0.44374365 throughput (samples/sec): 319.50
2019-08-08 05:55:58,435 epoch 20 - iter 456/577 - loss 0.44805592 throughput (samples/sec): 314.07
2019-08-08 05:56:04,219 epoch 20 - iter 513/577 - loss 0.45280804 throughput (samples/sec): 320.30
2019-08-08 05:56:10,130 epoch 20 - iter 570/577 - loss 0.45293473 throughput (samples/sec): 313.57
2019-08-08 05:56:10,819 ----------------------------------------------------------------------------------------------------
2019-08-08 05:56:10,820 EPOCH 20 done: loss 0.4544 - lr 0.1000
2019-08-08 05:56:40,128 TEST : loss 0.7423906922340393 - score 0.92
2019-08-08 05:56:40,302 BAD EPOCHS (no improvement): 0
2019-08-08 05:56:40,303 ----------------------------------------------------------------------------------------------------
2019-08-08 05:56:40,404 epoch 21 - iter 0/577 - loss 0.30950421 throughput (samples/sec): 18168.54
2019-08-08 05:56:46,268 epoch 21 - iter 57/577 - loss 0.43128029 throughput (samples/sec): 315.95
2019-08-08 05:56:52,011 epoch 21 - iter 114/577 - loss 0.39652657 throughput (samples/sec): 322.87
2019-08-08 05:56:57,702 epoch 21 - iter 171/577 - loss 0.39860983 throughput (samples/sec): 325.69
2019-08-08 05:57:03,549 epoch 21 - iter 228/577 - loss 0.40602524 throughput (samples/sec): 316.91
2019-08-08 05:57:09,606 epoch 21 - iter 285/577 - loss 0.41996905 throughput (samples/sec): 306.16
2019-08-08 05:57:15,484 epoch 21 - iter 342/577 - loss 0.42211382 throughput (samples/sec): 315.15
2019-08-08 05:57:21,347 epoch 21 - iter 399/577 - loss 0.42877716 throughput (samples/sec): 315.89
2019-08-08 05:57:27,242 epoch 21 - iter 456/577 - loss 0.43010495 throughput (samples/sec): 313.93
2019-08-08 05:57:33,102 epoch 21 - iter 513/577 - loss 0.42856478 throughput (samples/sec): 316.11
2019-08-08 05:57:39,171 epoch 21 - iter 570/577 - loss 0.43577978 throughput (samples/sec): 304.71
2019-08-08 05:57:39,859 ----------------------------------------------------------------------------------------------------
2019-08-08 05:57:39,859 EPOCH 21 done: loss 0.4359 - lr 0.1000
2019-08-08 05:58:09,184 TEST : loss 0.7441935539245605 - score 0.9219
2019-08-08 05:58:09,359 BAD EPOCHS (no improvement): 0
2019-08-08 05:58:09,360 ----------------------------------------------------------------------------------------------------
2019-08-08 05:58:09,458 epoch 22 - iter 0/577 - loss 0.53363764 throughput (samples/sec): 18936.24
2019-08-08 05:58:15,291 epoch 22 - iter 57/577 - loss 0.46666948 throughput (samples/sec): 317.87
2019-08-08 05:58:21,121 epoch 22 - iter 114/577 - loss 0.42428485 throughput (samples/sec): 318.09
2019-08-08 05:58:27,076 epoch 22 - iter 171/577 - loss 0.43136029 throughput (samples/sec): 310.84
2019-08-08 05:58:32,893 epoch 22 - iter 228/577 - loss 0.42473810 throughput (samples/sec): 318.46
2019-08-08 05:58:38,777 epoch 22 - iter 285/577 - loss 0.42028443 throughput (samples/sec): 314.83
2019-08-08 05:58:44,566 epoch 22 - iter 342/577 - loss 0.42439345 throughput (samples/sec): 320.03
2019-08-08 05:58:50,593 epoch 22 - iter 399/577 - loss 0.42709951 throughput (samples/sec): 307.10
2019-08-08 05:58:56,603 epoch 22 - iter 456/577 - loss 0.42851319 throughput (samples/sec): 308.44
2019-08-08 05:59:02,378 epoch 22 - iter 513/577 - loss 0.43189375 throughput (samples/sec): 320.64
2019-08-08 05:59:08,277 epoch 22 - iter 570/577 - loss 0.43146064 throughput (samples/sec): 314.09
2019-08-08 05:59:08,942 ----------------------------------------------------------------------------------------------------
2019-08-08 05:59:08,942 EPOCH 22 done: loss 0.4313 - lr 0.1000
2019-08-08 05:59:38,100 TEST : loss 0.7702522873878479 - score 0.9199
2019-08-08 05:59:38,275 BAD EPOCHS (no improvement): 0
2019-08-08 05:59:38,276 ----------------------------------------------------------------------------------------------------
2019-08-08 05:59:38,392 epoch 23 - iter 0/577 - loss 0.50147116 throughput (samples/sec): 15925.52
2019-08-08 05:59:44,256 epoch 23 - iter 57/577 - loss 0.44832238 throughput (samples/sec): 316.02
2019-08-08 05:59:50,187 epoch 23 - iter 114/577 - loss 0.42478039 throughput (samples/sec): 312.39
2019-08-08 05:59:55,991 epoch 23 - iter 171/577 - loss 0.42187672 throughput (samples/sec): 319.10
2019-08-08 06:00:01,829 epoch 23 - iter 228/577 - loss 0.42182667 throughput (samples/sec): 317.17
2019-08-08 06:00:07,571 epoch 23 - iter 285/577 - loss 0.43401086 throughput (samples/sec): 322.61
2019-08-08 06:00:13,440 epoch 23 - iter 342/577 - loss 0.42104030 throughput (samples/sec): 315.20
2019-08-08 06:00:19,139 epoch 23 - iter 399/577 - loss 0.42187969 throughput (samples/sec): 325.01
2019-08-08 06:00:25,054 epoch 23 - iter 456/577 - loss 0.42095151 throughput (samples/sec): 313.14
2019-08-08 06:00:30,978 epoch 23 - iter 513/577 - loss 0.42008605 throughput (samples/sec): 312.67
2019-08-08 06:00:36,846 epoch 23 - iter 570/577 - loss 0.42797735 throughput (samples/sec): 315.57
2019-08-08 06:00:37,491 ----------------------------------------------------------------------------------------------------
2019-08-08 06:00:37,491 EPOCH 23 done: loss 0.4269 - lr 0.1000
2019-08-08 06:01:06,739 TEST : loss 0.7528337240219116 - score 0.9213
2019-08-08 06:01:06,916 BAD EPOCHS (no improvement): 0
2019-08-08 06:01:06,917 ----------------------------------------------------------------------------------------------------
2019-08-08 06:01:07,034 epoch 24 - iter 0/577 - loss 0.61837459 throughput (samples/sec): 15752.57
2019-08-08 06:01:12,956 epoch 24 - iter 57/577 - loss 0.38053489 throughput (samples/sec): 312.87
2019-08-08 06:01:18,912 epoch 24 - iter 114/577 - loss 0.37924307 throughput (samples/sec): 310.82
2019-08-08 06:01:24,871 epoch 24 - iter 171/577 - loss 0.38206334 throughput (samples/sec): 310.91
2019-08-08 06:01:30,774 epoch 24 - iter 228/577 - loss 0.38879629 throughput (samples/sec): 313.86
2019-08-08 06:01:36,840 epoch 24 - iter 285/577 - loss 0.39573797 throughput (samples/sec): 305.09
2019-08-08 06:01:42,688 epoch 24 - iter 342/577 - loss 0.39248862 throughput (samples/sec): 316.42
2019-08-08 06:01:48,451 epoch 24 - iter 399/577 - loss 0.39291512 throughput (samples/sec): 321.16
2019-08-08 06:01:54,253 epoch 24 - iter 456/577 - loss 0.40082587 throughput (samples/sec): 319.10
2019-08-08 06:02:00,330 epoch 24 - iter 513/577 - loss 0.40848456 throughput (samples/sec): 304.66
2019-08-08 06:02:06,186 epoch 24 - iter 570/577 - loss 0.41237122 throughput (samples/sec): 316.14
2019-08-08 06:02:06,874 ----------------------------------------------------------------------------------------------------
2019-08-08 06:02:06,875 EPOCH 24 done: loss 0.4134 - lr 0.1000
2019-08-08 06:02:36,110 TEST : loss 0.7451838850975037 - score 0.9215
2019-08-08 06:02:36,289 BAD EPOCHS (no improvement): 0
2019-08-08 06:02:36,290 ----------------------------------------------------------------------------------------------------
2019-08-08 06:02:36,393 epoch 25 - iter 0/577 - loss 0.23741907 throughput (samples/sec): 17902.82
2019-08-08 06:02:42,338 epoch 25 - iter 57/577 - loss 0.38393367 throughput (samples/sec): 311.33
2019-08-08 06:02:48,191 epoch 25 - iter 114/577 - loss 0.37255938 throughput (samples/sec): 316.19
2019-08-08 06:02:54,101 epoch 25 - iter 171/577 - loss 0.37510031 throughput (samples/sec): 313.28
2019-08-08 06:03:00,142 epoch 25 - iter 228/577 - loss 0.39398628 throughput (samples/sec): 306.17
2019-08-08 06:03:05,837 epoch 25 - iter 285/577 - loss 0.39481227 throughput (samples/sec): 324.92
2019-08-08 06:03:11,682 epoch 25 - iter 342/577 - loss 0.39577935 throughput (samples/sec): 316.56
2019-08-08 06:03:17,412 epoch 25 - iter 399/577 - loss 0.39199416 throughput (samples/sec): 323.00
2019-08-08 06:03:23,526 epoch 25 - iter 456/577 - loss 0.40771655 throughput (samples/sec): 302.33
2019-08-08 06:03:29,273 epoch 25 - iter 513/577 - loss 0.41242296 throughput (samples/sec): 322.18
2019-08-08 06:03:35,148 epoch 25 - iter 570/577 - loss 0.40889599 throughput (samples/sec): 315.04
2019-08-08 06:03:35,856 ----------------------------------------------------------------------------------------------------
2019-08-08 06:03:35,856 EPOCH 25 done: loss 0.4100 - lr 0.1000
2019-08-08 06:04:04,994 TEST : loss 0.7305242419242859 - score 0.9224
2019-08-08 06:04:05,174 BAD EPOCHS (no improvement): 0
2019-08-08 06:04:05,175 ----------------------------------------------------------------------------------------------------
2019-08-08 06:04:05,286 epoch 26 - iter 0/577 - loss 0.76165366 throughput (samples/sec): 16750.99
2019-08-08 06:04:11,123 epoch 26 - iter 57/577 - loss 0.42580360 throughput (samples/sec): 316.84
2019-08-08 06:04:17,057 epoch 26 - iter 114/577 - loss 0.44060134 throughput (samples/sec): 311.95
2019-08-08 06:04:22,866 epoch 26 - iter 171/577 - loss 0.42066817 throughput (samples/sec): 318.61
2019-08-08 06:04:28,666 epoch 26 - iter 228/577 - loss 0.41786582 throughput (samples/sec): 319.25
2019-08-08 06:04:34,582 epoch 26 - iter 285/577 - loss 0.42677911 throughput (samples/sec): 312.79
2019-08-08 06:04:40,513 epoch 26 - iter 342/577 - loss 0.42871728 throughput (samples/sec): 311.73
2019-08-08 06:04:46,344 epoch 26 - iter 399/577 - loss 0.43178990 throughput (samples/sec): 317.43
2019-08-08 06:04:52,094 epoch 26 - iter 456/577 - loss 0.42470615 throughput (samples/sec): 322.15
2019-08-08 06:04:58,116 epoch 26 - iter 513/577 - loss 0.41858845 throughput (samples/sec): 307.23
2019-08-08 06:05:04,130 epoch 26 - iter 570/577 - loss 0.41978647 throughput (samples/sec): 307.41
2019-08-08 06:05:04,830 ----------------------------------------------------------------------------------------------------
2019-08-08 06:05:04,830 EPOCH 26 done: loss 0.4202 - lr 0.1000
2019-08-08 06:05:34,168 TEST : loss 0.7898996472358704 - score 0.9191
2019-08-08 06:05:34,357 BAD EPOCHS (no improvement): 1
2019-08-08 06:05:34,357 ----------------------------------------------------------------------------------------------------
2019-08-08 06:05:34,462 epoch 27 - iter 0/577 - loss 0.18217829 throughput (samples/sec): 17721.96
2019-08-08 06:05:40,530 epoch 27 - iter 57/577 - loss 0.37643504 throughput (samples/sec): 305.21
2019-08-08 06:05:46,345 epoch 27 - iter 114/577 - loss 0.38618202 throughput (samples/sec): 318.37
2019-08-08 06:05:52,173 epoch 27 - iter 171/577 - loss 0.38832811 throughput (samples/sec): 317.98
2019-08-08 06:05:58,157 epoch 27 - iter 228/577 - loss 0.36543063 throughput (samples/sec): 309.77
2019-08-08 06:06:04,086 epoch 27 - iter 285/577 - loss 0.36894550 throughput (samples/sec): 311.76
2019-08-08 06:06:09,898 epoch 27 - iter 342/577 - loss 0.38123348 throughput (samples/sec): 318.52
2019-08-08 06:06:15,787 epoch 27 - iter 399/577 - loss 0.38582296 throughput (samples/sec): 314.32
2019-08-08 06:06:21,571 epoch 27 - iter 456/577 - loss 0.38673426 throughput (samples/sec): 319.88
2019-08-08 06:06:27,369 epoch 27 - iter 513/577 - loss 0.38156549 throughput (samples/sec): 319.39
2019-08-08 06:06:33,335 epoch 27 - iter 570/577 - loss 0.38689151 throughput (samples/sec): 309.93
2019-08-08 06:06:33,990 ----------------------------------------------------------------------------------------------------
2019-08-08 06:06:33,990 EPOCH 27 done: loss 0.3858 - lr 0.1000
2019-08-08 06:07:03,234 TEST : loss 0.7404301166534424 - score 0.9251
2019-08-08 06:07:03,418 BAD EPOCHS (no improvement): 0
2019-08-08 06:07:03,419 ----------------------------------------------------------------------------------------------------
2019-08-08 06:07:03,513 epoch 28 - iter 0/577 - loss 0.75308305 throughput (samples/sec): 19656.61
2019-08-08 06:07:09,387 epoch 28 - iter 57/577 - loss 0.40902063 throughput (samples/sec): 315.14
2019-08-08 06:07:15,319 epoch 28 - iter 114/577 - loss 0.41593959 throughput (samples/sec): 312.21
2019-08-08 06:07:21,101 epoch 28 - iter 171/577 - loss 0.39717455 throughput (samples/sec): 320.22
2019-08-08 06:07:26,950 epoch 28 - iter 228/577 - loss 0.38432518 throughput (samples/sec): 316.61
2019-08-08 06:07:32,814 epoch 28 - iter 285/577 - loss 0.37512891 throughput (samples/sec): 315.51
2019-08-08 06:07:38,579 epoch 28 - iter 342/577 - loss 0.37604062 throughput (samples/sec): 321.17
2019-08-08 06:07:44,421 epoch 28 - iter 399/577 - loss 0.37797602 throughput (samples/sec): 316.73
2019-08-08 06:07:50,271 epoch 28 - iter 456/577 - loss 0.37925968 throughput (samples/sec): 316.35
2019-08-08 06:07:56,394 epoch 28 - iter 513/577 - loss 0.37691645 throughput (samples/sec): 302.06
2019-08-08 06:08:02,323 epoch 28 - iter 570/577 - loss 0.38044724 throughput (samples/sec): 312.01
2019-08-08 06:08:02,954 ----------------------------------------------------------------------------------------------------
2019-08-08 06:08:02,955 EPOCH 28 done: loss 0.3800 - lr 0.1000
2019-08-08 06:08:32,076 TEST : loss 0.7724323868751526 - score 0.9224
2019-08-08 06:08:32,257 BAD EPOCHS (no improvement): 0
2019-08-08 06:08:32,258 ----------------------------------------------------------------------------------------------------
2019-08-08 06:08:32,412 epoch 29 - iter 0/577 - loss 0.41718522 throughput (samples/sec): 11934.11
2019-08-08 06:08:38,415 epoch 29 - iter 57/577 - loss 0.38704741 throughput (samples/sec): 310.44
2019-08-08 06:08:44,274 epoch 29 - iter 114/577 - loss 0.35748752 throughput (samples/sec): 315.97
2019-08-08 06:08:50,157 epoch 29 - iter 171/577 - loss 0.36422474 throughput (samples/sec): 314.15
2019-08-08 06:08:56,005 epoch 29 - iter 228/577 - loss 0.36620586 throughput (samples/sec): 316.25
2019-08-08 06:09:01,916 epoch 29 - iter 285/577 - loss 0.37177469 throughput (samples/sec): 313.09
2019-08-08 06:09:07,597 epoch 29 - iter 342/577 - loss 0.37082485 throughput (samples/sec): 325.78
2019-08-08 06:09:13,416 epoch 29 - iter 399/577 - loss 0.37354360 throughput (samples/sec): 318.18
2019-08-08 06:09:19,216 epoch 29 - iter 456/577 - loss 0.37912992 throughput (samples/sec): 319.02
2019-08-08 06:09:25,039 epoch 29 - iter 513/577 - loss 0.38429931 throughput (samples/sec): 317.78
2019-08-08 06:09:31,038 epoch 29 - iter 570/577 - loss 0.39018503 throughput (samples/sec): 308.32
2019-08-08 06:09:31,695 ----------------------------------------------------------------------------------------------------
2019-08-08 06:09:31,695 EPOCH 29 done: loss 0.3901 - lr 0.1000
2019-08-08 06:10:01,027 TEST : loss 0.7786343097686768 - score 0.9246
2019-08-08 06:10:01,217 BAD EPOCHS (no improvement): 1
2019-08-08 06:10:01,217 ----------------------------------------------------------------------------------------------------
2019-08-08 06:10:01,322 epoch 30 - iter 0/577 - loss 0.32699770 throughput (samples/sec): 17638.65
2019-08-08 06:10:07,255 epoch 30 - iter 57/577 - loss 0.33450255 throughput (samples/sec): 312.08
2019-08-08 06:10:13,156 epoch 30 - iter 114/577 - loss 0.33941086 throughput (samples/sec): 313.58
2019-08-08 06:10:19,133 epoch 30 - iter 171/577 - loss 0.36191325 throughput (samples/sec): 309.71
2019-08-08 06:10:25,064 epoch 30 - iter 228/577 - loss 0.34515103 throughput (samples/sec): 311.89
2019-08-08 06:10:30,945 epoch 30 - iter 285/577 - loss 0.35509126 throughput (samples/sec): 314.79
2019-08-08 06:10:36,660 epoch 30 - iter 342/577 - loss 0.35839341 throughput (samples/sec): 324.24
2019-08-08 06:10:42,382 epoch 30 - iter 399/577 - loss 0.36922630 throughput (samples/sec): 323.92
2019-08-08 06:10:48,407 epoch 30 - iter 456/577 - loss 0.36440364 throughput (samples/sec): 307.06
2019-08-08 06:10:54,272 epoch 30 - iter 513/577 - loss 0.36652174 throughput (samples/sec): 315.38
2019-08-08 06:11:00,036 epoch 30 - iter 570/577 - loss 0.36193660 throughput (samples/sec): 321.24
2019-08-08 06:11:00,701 ----------------------------------------------------------------------------------------------------
2019-08-08 06:11:00,701 EPOCH 30 done: loss 0.3618 - lr 0.1000
2019-08-08 06:11:29,926 TEST : loss 0.7748025059700012 - score 0.9229
2019-08-08 06:11:30,105 BAD EPOCHS (no improvement): 0
2019-08-08 06:11:30,106 ----------------------------------------------------------------------------------------------------
2019-08-08 06:11:30,238 epoch 31 - iter 0/577 - loss 0.30639052 throughput (samples/sec): 13967.46
2019-08-08 06:11:36,053 epoch 31 - iter 57/577 - loss 0.34849249 throughput (samples/sec): 318.69
2019-08-08 06:11:41,889 epoch 31 - iter 114/577 - loss 0.34550989 throughput (samples/sec): 317.34
2019-08-08 06:11:47,741 epoch 31 - iter 171/577 - loss 0.34415764 throughput (samples/sec): 316.44
2019-08-08 06:11:53,528 epoch 31 - iter 228/577 - loss 0.35030430 throughput (samples/sec): 320.24
2019-08-08 06:11:59,390 epoch 31 - iter 285/577 - loss 0.35832630 throughput (samples/sec): 315.63
2019-08-08 06:12:05,283 epoch 31 - iter 342/577 - loss 0.35694019 throughput (samples/sec): 314.06
2019-08-08 06:12:11,147 epoch 31 - iter 399/577 - loss 0.35863185 throughput (samples/sec): 315.42
2019-08-08 06:12:17,006 epoch 31 - iter 456/577 - loss 0.36328361 throughput (samples/sec): 315.71
2019-08-08 06:12:22,875 epoch 31 - iter 513/577 - loss 0.37044720 throughput (samples/sec): 315.06
2019-08-08 06:12:28,721 epoch 31 - iter 570/577 - loss 0.37102675 throughput (samples/sec): 316.53
2019-08-08 06:12:29,410 ----------------------------------------------------------------------------------------------------
2019-08-08 06:12:29,410 EPOCH 31 done: loss 0.3728 - lr 0.1000
2019-08-08 06:12:58,582 TEST : loss 0.7835682034492493 - score 0.9227
2019-08-08 06:12:58,768 BAD EPOCHS (no improvement): 1
2019-08-08 06:12:58,769 ----------------------------------------------------------------------------------------------------
2019-08-08 06:12:58,874 epoch 32 - iter 0/577 - loss 0.60652232 throughput (samples/sec): 17518.33
2019-08-08 06:13:04,781 epoch 32 - iter 57/577 - loss 0.38938569 throughput (samples/sec): 313.57
2019-08-08 06:13:10,650 epoch 32 - iter 114/577 - loss 0.38813958 throughput (samples/sec): 315.43
2019-08-08 06:13:16,499 epoch 32 - iter 171/577 - loss 0.38305135 throughput (samples/sec): 316.65
2019-08-08 06:13:22,333 epoch 32 - iter 228/577 - loss 0.38729029 throughput (samples/sec): 317.27
2019-08-08 06:13:28,219 epoch 32 - iter 285/577 - loss 0.38148867 throughput (samples/sec): 314.46
2019-08-08 06:13:34,109 epoch 32 - iter 342/577 - loss 0.37445155 throughput (samples/sec): 314.17
2019-08-08 06:13:40,003 epoch 32 - iter 399/577 - loss 0.37213774 throughput (samples/sec): 314.19
2019-08-08 06:13:45,879 epoch 32 - iter 456/577 - loss 0.36364487 throughput (samples/sec): 315.11
2019-08-08 06:13:51,776 epoch 32 - iter 513/577 - loss 0.36172735 throughput (samples/sec): 314.06
2019-08-08 06:13:57,583 epoch 32 - iter 570/577 - loss 0.36154073 throughput (samples/sec): 319.10
2019-08-08 06:13:58,245 ----------------------------------------------------------------------------------------------------
2019-08-08 06:13:58,245 EPOCH 32 done: loss 0.3629 - lr 0.1000
2019-08-08 06:14:27,492 TEST : loss 0.7811443209648132 - score 0.9227
2019-08-08 06:14:27,671 BAD EPOCHS (no improvement): 2
2019-08-08 06:14:27,672 ----------------------------------------------------------------------------------------------------
2019-08-08 06:14:27,777 epoch 33 - iter 0/577 - loss 0.07307941 throughput (samples/sec): 17576.85
2019-08-08 06:14:33,645 epoch 33 - iter 57/577 - loss 0.31719701 throughput (samples/sec): 315.52
2019-08-08 06:14:39,564 epoch 33 - iter 114/577 - loss 0.34297877 throughput (samples/sec): 313.50
2019-08-08 06:14:45,284 epoch 33 - iter 171/577 - loss 0.35912956 throughput (samples/sec): 323.87
2019-08-08 06:14:51,228 epoch 33 - iter 228/577 - loss 0.34923191 throughput (samples/sec): 311.77
2019-08-08 06:14:57,029 epoch 33 - iter 285/577 - loss 0.35014453 throughput (samples/sec): 319.34
2019-08-08 06:15:02,706 epoch 33 - iter 342/577 - loss 0.34377934 throughput (samples/sec): 326.58
2019-08-08 06:15:08,550 epoch 33 - iter 399/577 - loss 0.34440193 throughput (samples/sec): 317.15
2019-08-08 06:15:14,635 epoch 33 - iter 456/577 - loss 0.34562457 throughput (samples/sec): 304.57
2019-08-08 06:15:20,328 epoch 33 - iter 513/577 - loss 0.35288627 throughput (samples/sec): 325.84
2019-08-08 06:15:26,164 epoch 33 - iter 570/577 - loss 0.35225461 throughput (samples/sec): 317.76
2019-08-08 06:15:26,795 ----------------------------------------------------------------------------------------------------
2019-08-08 06:15:26,796 EPOCH 33 done: loss 0.3518 - lr 0.1000
2019-08-08 06:15:57,562 TEST : loss 0.766357958316803 - score 0.9241
2019-08-08 06:15:57,720 BAD EPOCHS (no improvement): 0
2019-08-08 06:15:57,721 ----------------------------------------------------------------------------------------------------
2019-08-08 06:15:57,815 epoch 34 - iter 0/577 - loss 0.11765984 throughput (samples/sec): 19661.31
2019-08-08 06:16:03,674 epoch 34 - iter 57/577 - loss 0.38265951 throughput (samples/sec): 316.43
2019-08-08 06:16:09,502 epoch 34 - iter 114/577 - loss 0.37228790 throughput (samples/sec): 318.51
2019-08-08 06:16:15,308 epoch 34 - iter 171/577 - loss 0.36551305 throughput (samples/sec): 319.28
2019-08-08 06:16:21,127 epoch 34 - iter 228/577 - loss 0.35802801 throughput (samples/sec): 318.46
2019-08-08 06:16:26,964 epoch 34 - iter 285/577 - loss 0.34970398 throughput (samples/sec): 317.58
2019-08-08 06:16:32,769 epoch 34 - iter 342/577 - loss 0.34541491 throughput (samples/sec): 319.39
2019-08-08 06:16:38,627 epoch 34 - iter 399/577 - loss 0.35710619 throughput (samples/sec): 316.17
2019-08-08 06:16:44,546 epoch 34 - iter 456/577 - loss 0.35575765 throughput (samples/sec): 312.97
2019-08-08 06:16:50,559 epoch 34 - iter 513/577 - loss 0.35072185 throughput (samples/sec): 308.14
2019-08-08 06:16:56,568 epoch 34 - iter 570/577 - loss 0.35652579 throughput (samples/sec): 308.42
2019-08-08 06:16:57,220 ----------------------------------------------------------------------------------------------------
2019-08-08 06:16:57,220 EPOCH 34 done: loss 0.3559 - lr 0.1000
2019-08-08 06:17:26,675 TEST : loss 0.7784662842750549 - score 0.925
2019-08-08 06:17:26,834 BAD EPOCHS (no improvement): 1
2019-08-08 06:17:26,835 ----------------------------------------------------------------------------------------------------
2019-08-08 06:17:26,933 epoch 35 - iter 0/577 - loss 0.16400522 throughput (samples/sec): 18893.59
2019-08-08 06:17:32,792 epoch 35 - iter 57/577 - loss 0.33717408 throughput (samples/sec): 316.16
2019-08-08 06:17:38,530 epoch 35 - iter 114/577 - loss 0.34023554 throughput (samples/sec): 323.14
2019-08-08 06:17:44,351 epoch 35 - iter 171/577 - loss 0.34211032 throughput (samples/sec): 318.26
2019-08-08 06:17:50,027 epoch 35 - iter 228/577 - loss 0.34609605 throughput (samples/sec): 326.50
2019-08-08 06:17:55,961 epoch 35 - iter 285/577 - loss 0.34919635 throughput (samples/sec): 311.99
2019-08-08 06:18:01,931 epoch 35 - iter 342/577 - loss 0.34573347 throughput (samples/sec): 309.62
2019-08-08 06:18:07,895 epoch 35 - iter 399/577 - loss 0.34730185 throughput (samples/sec): 310.43
2019-08-08 06:18:13,693 epoch 35 - iter 456/577 - loss 0.34933568 throughput (samples/sec): 319.51
2019-08-08 06:18:19,651 epoch 35 - iter 513/577 - loss 0.34562548 throughput (samples/sec): 310.82
2019-08-08 06:18:25,494 epoch 35 - iter 570/577 - loss 0.34767146 throughput (samples/sec): 317.17
2019-08-08 06:18:26,163 ----------------------------------------------------------------------------------------------------
2019-08-08 06:18:26,164 EPOCH 35 done: loss 0.3486 - lr 0.1000
2019-08-08 06:18:55,556 TEST : loss 0.7846673727035522 - score 0.9241
2019-08-08 06:18:55,717 BAD EPOCHS (no improvement): 0
2019-08-08 06:18:55,718 ----------------------------------------------------------------------------------------------------
2019-08-08 06:18:55,821 epoch 36 - iter 0/577 - loss 0.07105619 throughput (samples/sec): 17901.89
2019-08-08 06:19:01,727 epoch 36 - iter 57/577 - loss 0.29897428 throughput (samples/sec): 313.30
2019-08-08 06:19:07,456 epoch 36 - iter 114/577 - loss 0.30926500 throughput (samples/sec): 323.45
2019-08-08 06:19:13,406 epoch 36 - iter 171/577 - loss 0.33741169 throughput (samples/sec): 311.33
2019-08-08 06:19:19,207 epoch 36 - iter 228/577 - loss 0.32518555 throughput (samples/sec): 319.55
2019-08-08 06:19:25,009 epoch 36 - iter 285/577 - loss 0.33947189 throughput (samples/sec): 319.36
2019-08-08 06:19:30,945 epoch 36 - iter 342/577 - loss 0.33383249 throughput (samples/sec): 312.19
2019-08-08 06:19:36,824 epoch 36 - iter 399/577 - loss 0.33098836 throughput (samples/sec): 315.09
2019-08-08 06:19:42,634 epoch 36 - iter 456/577 - loss 0.33922582 throughput (samples/sec): 318.97
2019-08-08 06:19:48,395 epoch 36 - iter 513/577 - loss 0.33884190 throughput (samples/sec): 321.81
2019-08-08 06:19:54,257 epoch 36 - iter 570/577 - loss 0.34096847 throughput (samples/sec): 315.89
2019-08-08 06:19:54,971 ----------------------------------------------------------------------------------------------------
2019-08-08 06:19:54,972 EPOCH 36 done: loss 0.3417 - lr 0.1000
2019-08-08 06:20:24,374 TEST : loss 0.781215488910675 - score 0.9231
2019-08-08 06:20:24,536 BAD EPOCHS (no improvement): 0
2019-08-08 06:20:24,537 ----------------------------------------------------------------------------------------------------
2019-08-08 06:20:24,654 epoch 37 - iter 0/577 - loss 0.66388762 throughput (samples/sec): 15811.11
2019-08-08 06:20:30,405 epoch 37 - iter 57/577 - loss 0.36420509 throughput (samples/sec): 322.13
2019-08-08 06:20:36,245 epoch 37 - iter 114/577 - loss 0.36218348 throughput (samples/sec): 317.35
2019-08-08 06:20:42,143 epoch 37 - iter 171/577 - loss 0.34203031 throughput (samples/sec): 314.08
2019-08-08 06:20:47,918 epoch 37 - iter 228/577 - loss 0.34034507 throughput (samples/sec): 320.86
2019-08-08 06:20:53,598 epoch 37 - iter 285/577 - loss 0.33134915 throughput (samples/sec): 326.37
2019-08-08 06:20:59,410 epoch 37 - iter 342/577 - loss 0.34184289 throughput (samples/sec): 318.90
2019-08-08 06:21:05,264 epoch 37 - iter 399/577 - loss 0.34484660 throughput (samples/sec): 316.51
2019-08-08 06:21:11,162 epoch 37 - iter 456/577 - loss 0.34198329 throughput (samples/sec): 314.20
2019-08-08 06:21:17,007 epoch 37 - iter 513/577 - loss 0.33771254 throughput (samples/sec): 317.04
2019-08-08 06:21:22,855 epoch 37 - iter 570/577 - loss 0.33379804 throughput (samples/sec): 317.13
2019-08-08 06:21:23,596 ----------------------------------------------------------------------------------------------------
2019-08-08 06:21:23,596 EPOCH 37 done: loss 0.3341 - lr 0.1000
2019-08-08 06:21:52,992 TEST : loss 0.798126220703125 - score 0.921
2019-08-08 06:21:53,153 BAD EPOCHS (no improvement): 0
2019-08-08 06:21:53,154 ----------------------------------------------------------------------------------------------------
2019-08-08 06:21:53,261 epoch 38 - iter 0/577 - loss 0.05466482 throughput (samples/sec): 17394.97
2019-08-08 06:21:59,214 epoch 38 - iter 57/577 - loss 0.34560169 throughput (samples/sec): 311.53
2019-08-08 06:22:04,970 epoch 38 - iter 114/577 - loss 0.31624852 throughput (samples/sec): 321.97
2019-08-08 06:22:10,819 epoch 38 - iter 171/577 - loss 0.31745975 throughput (samples/sec): 316.82
2019-08-08 06:22:16,727 epoch 38 - iter 228/577 - loss 0.31963113 throughput (samples/sec): 313.59
2019-08-08 06:22:22,458 epoch 38 - iter 285/577 - loss 0.30911647 throughput (samples/sec): 323.51
2019-08-08 06:22:28,404 epoch 38 - iter 342/577 - loss 0.31824638 throughput (samples/sec): 311.64
2019-08-08 06:22:34,214 epoch 38 - iter 399/577 - loss 0.32780841 throughput (samples/sec): 318.76
2019-08-08 06:22:40,238 epoch 38 - iter 456/577 - loss 0.32782932 throughput (samples/sec): 307.69
2019-08-08 06:22:45,993 epoch 38 - iter 513/577 - loss 0.33190339 throughput (samples/sec): 322.06
2019-08-08 06:22:51,957 epoch 38 - iter 570/577 - loss 0.33449267 throughput (samples/sec): 310.70
2019-08-08 06:22:52,626 ----------------------------------------------------------------------------------------------------
2019-08-08 06:22:52,626 EPOCH 38 done: loss 0.3359 - lr 0.1000
2019-08-08 06:23:21,977 TEST : loss 0.7797606587409973 - score 0.9227
2019-08-08 06:23:22,136 BAD EPOCHS (no improvement): 1
2019-08-08 06:23:22,137 ----------------------------------------------------------------------------------------------------
2019-08-08 06:23:22,241 epoch 39 - iter 0/577 - loss 0.27149430 throughput (samples/sec): 17616.59
2019-08-08 06:23:28,202 epoch 39 - iter 57/577 - loss 0.33722029 throughput (samples/sec): 310.83
2019-08-08 06:23:34,111 epoch 39 - iter 114/577 - loss 0.35486246 throughput (samples/sec): 313.46
2019-08-08 06:23:39,865 epoch 39 - iter 171/577 - loss 0.35380838 throughput (samples/sec): 322.02
2019-08-08 06:23:45,723 epoch 39 - iter 228/577 - loss 0.34698369 throughput (samples/sec): 316.28
2019-08-08 06:23:51,624 epoch 39 - iter 285/577 - loss 0.33673069 throughput (samples/sec): 313.87
2019-08-08 06:23:57,358 epoch 39 - iter 342/577 - loss 0.33142500 throughput (samples/sec): 323.17
2019-08-08 06:24:03,230 epoch 39 - iter 399/577 - loss 0.33387173 throughput (samples/sec): 315.43
2019-08-08 06:24:09,097 epoch 39 - iter 456/577 - loss 0.33894877 throughput (samples/sec): 315.87
2019-08-08 06:24:14,886 epoch 39 - iter 513/577 - loss 0.33908433 throughput (samples/sec): 319.97
2019-08-08 06:24:20,697 epoch 39 - iter 570/577 - loss 0.33591737 throughput (samples/sec): 318.80
2019-08-08 06:24:21,393 ----------------------------------------------------------------------------------------------------
2019-08-08 06:24:21,393 EPOCH 39 done: loss 0.3378 - lr 0.1000
2019-08-08 06:24:50,760 TEST : loss 0.8161228895187378 - score 0.9234
2019-08-08 06:24:50,926 BAD EPOCHS (no improvement): 2
2019-08-08 06:24:50,926 ----------------------------------------------------------------------------------------------------
2019-08-08 06:24:51,035 epoch 40 - iter 0/577 - loss 0.09226707 throughput (samples/sec): 17062.83
2019-08-08 06:24:56,814 epoch 40 - iter 57/577 - loss 0.33285125 throughput (samples/sec): 320.63
2019-08-08 06:25:02,678 epoch 40 - iter 114/577 - loss 0.32707358 throughput (samples/sec): 315.91
2019-08-08 06:25:08,563 epoch 40 - iter 171/577 - loss 0.33253831 throughput (samples/sec): 314.95
2019-08-08 06:25:14,422 epoch 40 - iter 228/577 - loss 0.33982561 throughput (samples/sec): 316.40
2019-08-08 06:25:20,419 epoch 40 - iter 285/577 - loss 0.34489823 throughput (samples/sec): 309.08
2019-08-08 06:25:26,307 epoch 40 - iter 342/577 - loss 0.33808704 throughput (samples/sec): 314.83
2019-08-08 06:25:32,142 epoch 40 - iter 399/577 - loss 0.33107290 throughput (samples/sec): 317.90
2019-08-08 06:25:38,007 epoch 40 - iter 456/577 - loss 0.33455557 throughput (samples/sec): 315.94
2019-08-08 06:25:43,927 epoch 40 - iter 513/577 - loss 0.33148646 throughput (samples/sec): 312.86
2019-08-08 06:25:49,906 epoch 40 - iter 570/577 - loss 0.33456837 throughput (samples/sec): 309.72
2019-08-08 06:25:50,575 ----------------------------------------------------------------------------------------------------
2019-08-08 06:25:50,576 EPOCH 40 done: loss 0.3330 - lr 0.1000
2019-08-08 06:26:19,916 TEST : loss 0.8236170411109924 - score 0.9223
2019-08-08 06:26:20,093 BAD EPOCHS (no improvement): 0
2019-08-08 06:26:20,094 ----------------------------------------------------------------------------------------------------
2019-08-08 06:26:20,198 epoch 41 - iter 0/577 - loss 0.48017794 throughput (samples/sec): 17603.30
2019-08-08 06:26:26,085 epoch 41 - iter 57/577 - loss 0.33427517 throughput (samples/sec): 314.76
2019-08-08 06:26:31,918 epoch 41 - iter 114/577 - loss 0.30172611 throughput (samples/sec): 317.94
2019-08-08 06:26:37,880 epoch 41 - iter 171/577 - loss 0.30301149 throughput (samples/sec): 310.99
2019-08-08 06:26:43,663 epoch 41 - iter 228/577 - loss 0.31251525 throughput (samples/sec): 320.47
2019-08-08 06:26:49,650 epoch 41 - iter 285/577 - loss 0.33025019 throughput (samples/sec): 309.45
2019-08-08 06:26:55,507 epoch 41 - iter 342/577 - loss 0.32345978 throughput (samples/sec): 316.17
2019-08-08 06:27:01,319 epoch 41 - iter 399/577 - loss 0.32150973 throughput (samples/sec): 318.71
2019-08-08 06:27:07,098 epoch 41 - iter 456/577 - loss 0.32225316 throughput (samples/sec): 320.64
2019-08-08 06:27:12,994 epoch 41 - iter 513/577 - loss 0.32219090 throughput (samples/sec): 314.65
2019-08-08 06:27:18,937 epoch 41 - iter 570/577 - loss 0.33011309 throughput (samples/sec): 311.90
2019-08-08 06:27:19,636 ----------------------------------------------------------------------------------------------------
2019-08-08 06:27:19,636 EPOCH 41 done: loss 0.3306 - lr 0.1000
2019-08-08 06:27:49,232 TEST : loss 0.8577920794487 - score 0.9213
2019-08-08 06:27:49,397 BAD EPOCHS (no improvement): 0
2019-08-08 06:27:49,398 ----------------------------------------------------------------------------------------------------
2019-08-08 06:27:49,513 epoch 42 - iter 0/577 - loss 0.29219815 throughput (samples/sec): 16033.39
2019-08-08 06:27:55,354 epoch 42 - iter 57/577 - loss 0.28329630 throughput (samples/sec): 317.90
2019-08-08 06:28:01,160 epoch 42 - iter 114/577 - loss 0.29223388 throughput (samples/sec): 319.34
2019-08-08 06:28:07,084 epoch 42 - iter 171/577 - loss 0.29847997 throughput (samples/sec): 312.57
2019-08-08 06:28:12,915 epoch 42 - iter 228/577 - loss 0.29500379 throughput (samples/sec): 317.68
2019-08-08 06:28:18,797 epoch 42 - iter 285/577 - loss 0.29124950 throughput (samples/sec): 315.00
2019-08-08 06:28:24,624 epoch 42 - iter 342/577 - loss 0.29134586 throughput (samples/sec): 318.08
2019-08-08 06:28:30,469 epoch 42 - iter 399/577 - loss 0.29734989 throughput (samples/sec): 317.11
2019-08-08 06:28:36,283 epoch 42 - iter 456/577 - loss 0.30085280 throughput (samples/sec): 318.67
2019-08-08 06:28:41,936 epoch 42 - iter 513/577 - loss 0.30533440 throughput (samples/sec): 328.02
2019-08-08 06:28:47,966 epoch 42 - iter 570/577 - loss 0.30865664 throughput (samples/sec): 307.08
2019-08-08 06:28:48,657 ----------------------------------------------------------------------------------------------------
2019-08-08 06:28:48,658 EPOCH 42 done: loss 0.3089 - lr 0.1000
2019-08-08 06:29:18,090 TEST : loss 0.8012210726737976 - score 0.9219
2019-08-08 06:29:18,249 BAD EPOCHS (no improvement): 0
2019-08-08 06:29:18,249 ----------------------------------------------------------------------------------------------------
2019-08-08 06:29:18,333 epoch 43 - iter 0/577 - loss 0.58718419 throughput (samples/sec): 22282.06
2019-08-08 06:29:24,109 epoch 43 - iter 57/577 - loss 0.31825456 throughput (samples/sec): 320.90
2019-08-08 06:29:29,928 epoch 43 - iter 114/577 - loss 0.29471381 throughput (samples/sec): 318.35
2019-08-08 06:29:35,794 epoch 43 - iter 171/577 - loss 0.30236250 throughput (samples/sec): 315.66
2019-08-08 06:29:41,724 epoch 43 - iter 228/577 - loss 0.30759358 throughput (samples/sec): 312.47
2019-08-08 06:29:47,621 epoch 43 - iter 285/577 - loss 0.30922485 throughput (samples/sec): 314.09
2019-08-08 06:29:53,453 epoch 43 - iter 342/577 - loss 0.31134094 throughput (samples/sec): 317.46
2019-08-08 06:29:59,348 epoch 43 - iter 399/577 - loss 0.31338631 throughput (samples/sec): 314.13
2019-08-08 06:30:05,106 epoch 43 - iter 456/577 - loss 0.31787829 throughput (samples/sec): 321.75
2019-08-08 06:30:10,920 epoch 43 - iter 513/577 - loss 0.31701040 throughput (samples/sec): 318.60
2019-08-08 06:30:16,813 epoch 43 - iter 570/577 - loss 0.31641106 throughput (samples/sec): 314.46
2019-08-08 06:30:17,499 ----------------------------------------------------------------------------------------------------
2019-08-08 06:30:17,500 EPOCH 43 done: loss 0.3152 - lr 0.1000
2019-08-08 06:30:46,950 TEST : loss 0.8242294192314148 - score 0.9242
2019-08-08 06:30:47,113 BAD EPOCHS (no improvement): 1
2019-08-08 06:30:47,114 ----------------------------------------------------------------------------------------------------
2019-08-08 06:30:47,220 epoch 44 - iter 0/577 - loss 0.09387916 throughput (samples/sec): 17438.58
2019-08-08 06:30:53,138 epoch 44 - iter 57/577 - loss 0.28639248 throughput (samples/sec): 313.44
2019-08-08 06:30:58,952 epoch 44 - iter 114/577 - loss 0.29362579 throughput (samples/sec): 318.84
2019-08-08 06:31:04,791 epoch 44 - iter 171/577 - loss 0.28930051 throughput (samples/sec): 318.31
2019-08-08 06:31:10,722 epoch 44 - iter 228/577 - loss 0.29507514 throughput (samples/sec): 312.94
2019-08-08 06:31:16,756 epoch 44 - iter 285/577 - loss 0.30975805 throughput (samples/sec): 307.45
2019-08-08 06:31:22,421 epoch 44 - iter 342/577 - loss 0.30042324 throughput (samples/sec): 327.31
2019-08-08 06:31:28,246 epoch 44 - iter 399/577 - loss 0.30657949 throughput (samples/sec): 318.01
2019-08-08 06:31:34,078 epoch 44 - iter 456/577 - loss 0.31357954 throughput (samples/sec): 317.69
2019-08-08 06:31:39,838 epoch 44 - iter 513/577 - loss 0.31580345 throughput (samples/sec): 321.80
2019-08-08 06:31:45,698 epoch 44 - iter 570/577 - loss 0.31869289 throughput (samples/sec): 316.25
2019-08-08 06:31:46,344 ----------------------------------------------------------------------------------------------------
2019-08-08 06:31:46,344 EPOCH 44 done: loss 0.3183 - lr 0.1000
2019-08-08 06:32:15,703 TEST : loss 0.7914369702339172 - score 0.925
2019-08-08 06:32:15,862 BAD EPOCHS (no improvement): 2
2019-08-08 06:32:15,863 ----------------------------------------------------------------------------------------------------
2019-08-08 06:32:15,974 epoch 45 - iter 0/577 - loss 0.54645401 throughput (samples/sec): 16614.60
2019-08-08 06:32:21,794 epoch 45 - iter 57/577 - loss 0.27417390 throughput (samples/sec): 318.42
2019-08-08 06:32:27,777 epoch 45 - iter 114/577 - loss 0.28035574 throughput (samples/sec): 309.68
2019-08-08 06:32:33,710 epoch 45 - iter 171/577 - loss 0.29440529 throughput (samples/sec): 312.51
2019-08-08 06:32:39,570 epoch 45 - iter 228/577 - loss 0.31697866 throughput (samples/sec): 316.23
2019-08-08 06:32:45,433 epoch 45 - iter 285/577 - loss 0.31732894 throughput (samples/sec): 315.80
2019-08-08 06:32:51,378 epoch 45 - iter 342/577 - loss 0.31060462 throughput (samples/sec): 311.87
2019-08-08 06:32:57,371 epoch 45 - iter 399/577 - loss 0.30988426 throughput (samples/sec): 309.10
2019-08-08 06:33:03,145 epoch 45 - iter 456/577 - loss 0.31119414 throughput (samples/sec): 320.87
2019-08-08 06:33:09,078 epoch 45 - iter 513/577 - loss 0.31311086 throughput (samples/sec): 312.20
2019-08-08 06:33:15,032 epoch 45 - iter 570/577 - loss 0.31628950 throughput (samples/sec): 310.83
2019-08-08 06:33:15,729 ----------------------------------------------------------------------------------------------------
2019-08-08 06:33:15,730 EPOCH 45 done: loss 0.3156 - lr 0.1000
2019-08-08 06:33:45,062 TEST : loss 0.7956357598304749 - score 0.9259
2019-08-08 06:33:45,222 BAD EPOCHS (no improvement): 3
2019-08-08 06:33:45,222 ----------------------------------------------------------------------------------------------------
2019-08-08 06:33:45,324 epoch 46 - iter 0/577 - loss 0.16741180 throughput (samples/sec): 18152.59
2019-08-08 06:33:51,118 epoch 46 - iter 57/577 - loss 0.32548488 throughput (samples/sec): 319.82
2019-08-08 06:33:57,172 epoch 46 - iter 114/577 - loss 0.33317216 throughput (samples/sec): 305.96
2019-08-08 06:34:02,927 epoch 46 - iter 171/577 - loss 0.32317179 throughput (samples/sec): 322.47
2019-08-08 06:34:08,762 epoch 46 - iter 228/577 - loss 0.31998968 throughput (samples/sec): 318.35
2019-08-08 06:34:14,627 epoch 46 - iter 285/577 - loss 0.31871783 throughput (samples/sec): 316.46
2019-08-08 06:34:20,586 epoch 46 - iter 342/577 - loss 0.32157943 throughput (samples/sec): 310.86
2019-08-08 06:34:26,510 epoch 46 - iter 399/577 - loss 0.31489943 throughput (samples/sec): 312.81
2019-08-08 06:34:32,558 epoch 46 - iter 456/577 - loss 0.32045888 throughput (samples/sec): 306.22
2019-08-08 06:34:38,461 epoch 46 - iter 513/577 - loss 0.31545531 throughput (samples/sec): 313.83
2019-08-08 06:34:44,399 epoch 46 - iter 570/577 - loss 0.31731413 throughput (samples/sec): 311.91
2019-08-08 06:34:45,064 ----------------------------------------------------------------------------------------------------
2019-08-08 06:34:45,064 EPOCH 46 done: loss 0.3172 - lr 0.1000
2019-08-08 06:35:14,425 TEST : loss 0.8044819235801697 - score 0.9253
2019-08-08 06:35:14,585 BAD EPOCHS (no improvement): 4
2019-08-08 06:35:14,586 ----------------------------------------------------------------------------------------------------
2019-08-08 06:35:14,770 epoch 47 - iter 0/577 - loss 0.38337731 throughput (samples/sec): 9974.10
2019-08-08 06:35:20,621 epoch 47 - iter 57/577 - loss 0.28908746 throughput (samples/sec): 316.54
2019-08-08 06:35:26,425 epoch 47 - iter 114/577 - loss 0.30342813 throughput (samples/sec): 319.29
2019-08-08 06:35:32,298 epoch 47 - iter 171/577 - loss 0.30094038 throughput (samples/sec): 315.46
2019-08-08 06:35:37,973 epoch 47 - iter 228/577 - loss 0.28962268 throughput (samples/sec): 326.54
2019-08-08 06:35:43,884 epoch 47 - iter 285/577 - loss 0.28963494 throughput (samples/sec): 313.51
2019-08-08 06:35:49,599 epoch 47 - iter 342/577 - loss 0.28264897 throughput (samples/sec): 324.36
2019-08-08 06:35:55,459 epoch 47 - iter 399/577 - loss 0.28001481 throughput (samples/sec): 316.08
2019-08-08 06:36:01,418 epoch 47 - iter 456/577 - loss 0.28354025 throughput (samples/sec): 310.84
2019-08-08 06:36:07,187 epoch 47 - iter 513/577 - loss 0.28418012 throughput (samples/sec): 321.22
2019-08-08 06:36:12,985 epoch 47 - iter 570/577 - loss 0.28280698 throughput (samples/sec): 319.68
2019-08-08 06:36:13,728 ----------------------------------------------------------------------------------------------------
2019-08-08 06:36:13,728 EPOCH 47 done: loss 0.2818 - lr 0.0500
2019-08-08 06:36:43,080 TEST : loss 0.8278021216392517 - score 0.9258
2019-08-08 06:36:43,240 BAD EPOCHS (no improvement): 0
2019-08-08 06:36:43,241 ----------------------------------------------------------------------------------------------------
2019-08-08 06:36:43,335 epoch 48 - iter 0/577 - loss 0.10306400 throughput (samples/sec): 19819.92
2019-08-08 06:36:49,188 epoch 48 - iter 57/577 - loss 0.29640080 throughput (samples/sec): 316.52
2019-08-08 06:36:55,078 epoch 48 - iter 114/577 - loss 0.28552771 throughput (samples/sec): 314.58
2019-08-08 06:37:00,988 epoch 48 - iter 171/577 - loss 0.30032779 throughput (samples/sec): 313.36
2019-08-08 06:37:06,885 epoch 48 - iter 228/577 - loss 0.29030629 throughput (samples/sec): 314.21
2019-08-08 06:37:12,827 epoch 48 - iter 285/577 - loss 0.28924664 throughput (samples/sec): 311.79
2019-08-08 06:37:18,649 epoch 48 - iter 342/577 - loss 0.29134247 throughput (samples/sec): 318.29
2019-08-08 06:37:24,410 epoch 48 - iter 399/577 - loss 0.28787368 throughput (samples/sec): 321.62
2019-08-08 06:37:30,206 epoch 48 - iter 456/577 - loss 0.28049129 throughput (samples/sec): 319.70
2019-08-08 06:37:35,808 epoch 48 - iter 513/577 - loss 0.27485572 throughput (samples/sec): 331.06
2019-08-08 06:37:41,766 epoch 48 - iter 570/577 - loss 0.27508067 throughput (samples/sec): 311.04
2019-08-08 06:37:42,464 ----------------------------------------------------------------------------------------------------
2019-08-08 06:37:42,464 EPOCH 48 done: loss 0.2747 - lr 0.0500
2019-08-08 06:38:11,787 TEST : loss 0.8594202399253845 - score 0.925
2019-08-08 06:38:11,948 BAD EPOCHS (no improvement): 0
2019-08-08 06:38:11,949 ----------------------------------------------------------------------------------------------------
2019-08-08 06:38:12,060 epoch 49 - iter 0/577 - loss 0.22700843 throughput (samples/sec): 16645.62
2019-08-08 06:38:17,891 epoch 49 - iter 57/577 - loss 0.26903360 throughput (samples/sec): 317.93
2019-08-08 06:38:23,830 epoch 49 - iter 114/577 - loss 0.25528134 throughput (samples/sec): 311.89
2019-08-08 06:38:29,569 epoch 49 - iter 171/577 - loss 0.24535380 throughput (samples/sec): 323.11
2019-08-08 06:38:35,293 epoch 49 - iter 228/577 - loss 0.25588498 throughput (samples/sec): 323.70
2019-08-08 06:38:41,245 epoch 49 - iter 285/577 - loss 0.25567482 throughput (samples/sec): 311.26
2019-08-08 06:38:47,171 epoch 49 - iter 342/577 - loss 0.25379426 throughput (samples/sec): 312.77
2019-08-08 06:38:52,987 epoch 49 - iter 399/577 - loss 0.25647170 throughput (samples/sec): 318.28
2019-08-08 06:38:58,869 epoch 49 - iter 456/577 - loss 0.25983782 throughput (samples/sec): 314.92
2019-08-08 06:39:04,714 epoch 49 - iter 513/577 - loss 0.25958651 throughput (samples/sec): 317.43
2019-08-08 06:39:10,539 epoch 49 - iter 570/577 - loss 0.26520114 throughput (samples/sec): 318.00
2019-08-08 06:39:11,237 ----------------------------------------------------------------------------------------------------
2019-08-08 06:39:11,237 EPOCH 49 done: loss 0.2660 - lr 0.0500
2019-08-08 06:39:40,579 TEST : loss 0.8339102864265442 - score 0.9262
2019-08-08 06:39:40,739 BAD EPOCHS (no improvement): 0
2019-08-08 06:39:40,740 ----------------------------------------------------------------------------------------------------
2019-08-08 06:39:40,846 epoch 50 - iter 0/577 - loss 0.47219205 throughput (samples/sec): 17534.63
2019-08-08 06:39:46,780 epoch 50 - iter 57/577 - loss 0.26102652 throughput (samples/sec): 312.80
2019-08-08 06:39:52,597 epoch 50 - iter 114/577 - loss 0.23970390 throughput (samples/sec): 318.71
2019-08-08 06:39:58,394 epoch 50 - iter 171/577 - loss 0.23560745 throughput (samples/sec): 319.82
2019-08-08 06:40:04,139 epoch 50 - iter 228/577 - loss 0.25396428 throughput (samples/sec): 322.61
2019-08-08 06:40:09,849 epoch 50 - iter 285/577 - loss 0.25886929 throughput (samples/sec): 324.55
2019-08-08 06:40:15,769 epoch 50 - iter 342/577 - loss 0.26488997 throughput (samples/sec): 312.95
2019-08-08 06:40:21,540 epoch 50 - iter 399/577 - loss 0.27297932 throughput (samples/sec): 321.07
2019-08-08 06:40:27,497 epoch 50 - iter 456/577 - loss 0.27004753 throughput (samples/sec): 310.82
2019-08-08 06:40:33,442 epoch 50 - iter 513/577 - loss 0.26974680 throughput (samples/sec): 311.65
2019-08-08 06:40:39,448 epoch 50 - iter 570/577 - loss 0.27407348 throughput (samples/sec): 308.23
2019-08-08 06:40:40,120 ----------------------------------------------------------------------------------------------------
2019-08-08 06:40:40,120 EPOCH 50 done: loss 0.2743 - lr 0.0500
2019-08-08 06:41:09,392 TEST : loss 0.8467368483543396 - score 0.924
2019-08-08 06:41:09,564 BAD EPOCHS (no improvement): 1
2019-08-08 06:41:09,565 ----------------------------------------------------------------------------------------------------
2019-08-08 06:41:09,660 epoch 51 - iter 0/577 - loss 0.06906384 throughput (samples/sec): 19506.90
2019-08-08 06:41:15,602 epoch 51 - iter 57/577 - loss 0.22735987 throughput (samples/sec): 311.82
2019-08-08 06:41:21,489 epoch 51 - iter 114/577 - loss 0.22756000 throughput (samples/sec): 315.02
2019-08-08 06:41:27,368 epoch 51 - iter 171/577 - loss 0.24091749 throughput (samples/sec): 315.17
2019-08-08 06:41:33,267 epoch 51 - iter 228/577 - loss 0.24060197 throughput (samples/sec): 314.26
2019-08-08 06:41:39,062 epoch 51 - iter 285/577 - loss 0.25319001 throughput (samples/sec): 319.78
2019-08-08 06:41:44,984 epoch 51 - iter 342/577 - loss 0.25721155 throughput (samples/sec): 312.85
2019-08-08 06:41:50,836 epoch 51 - iter 399/577 - loss 0.25890528 throughput (samples/sec): 316.68
2019-08-08 06:41:56,741 epoch 51 - iter 456/577 - loss 0.26132755 throughput (samples/sec): 313.81
2019-08-08 06:42:02,561 epoch 51 - iter 513/577 - loss 0.26266760 throughput (samples/sec): 318.43
2019-08-08 06:42:08,439 epoch 51 - iter 570/577 - loss 0.26081445 throughput (samples/sec): 315.11
2019-08-08 06:42:09,080 ----------------------------------------------------------------------------------------------------
2019-08-08 06:42:09,081 EPOCH 51 done: loss 0.2605 - lr 0.0500
2019-08-08 06:42:38,232 TEST : loss 0.8409085869789124 - score 0.927
2019-08-08 06:42:38,401 BAD EPOCHS (no improvement): 0
2019-08-08 06:42:38,402 ----------------------------------------------------------------------------------------------------
2019-08-08 06:42:38,507 epoch 52 - iter 0/577 - loss 0.10377896 throughput (samples/sec): 17579.75
2019-08-08 06:42:44,385 epoch 52 - iter 57/577 - loss 0.26751831 throughput (samples/sec): 315.35
2019-08-08 06:42:50,169 epoch 52 - iter 114/577 - loss 0.26640885 throughput (samples/sec): 319.93
2019-08-08 06:42:55,912 epoch 52 - iter 171/577 - loss 0.26470329 throughput (samples/sec): 322.71
2019-08-08 06:43:01,720 epoch 52 - iter 228/577 - loss 0.27120041 throughput (samples/sec): 319.16
2019-08-08 06:43:07,522 epoch 52 - iter 285/577 - loss 0.26778756 throughput (samples/sec): 319.39
2019-08-08 06:43:13,293 epoch 52 - iter 342/577 - loss 0.26460048 throughput (samples/sec): 321.07
2019-08-08 06:43:18,998 epoch 52 - iter 399/577 - loss 0.26326317 throughput (samples/sec): 325.05
2019-08-08 06:43:24,986 epoch 52 - iter 456/577 - loss 0.26433564 throughput (samples/sec): 309.41
2019-08-08 06:43:30,895 epoch 52 - iter 513/577 - loss 0.26598517 throughput (samples/sec): 313.52
2019-08-08 06:43:36,743 epoch 52 - iter 570/577 - loss 0.26354470 throughput (samples/sec): 316.78
2019-08-08 06:43:37,403 ----------------------------------------------------------------------------------------------------
2019-08-08 06:43:37,404 EPOCH 52 done: loss 0.2640 - lr 0.0500
2019-08-08 06:44:06,720 TEST : loss 0.8419521450996399 - score 0.926
2019-08-08 06:44:06,893 BAD EPOCHS (no improvement): 1
2019-08-08 06:44:06,894 ----------------------------------------------------------------------------------------------------
2019-08-08 06:44:06,998 epoch 53 - iter 0/577 - loss 0.09842625 throughput (samples/sec): 17914.60
2019-08-08 06:44:12,825 epoch 53 - iter 57/577 - loss 0.22875457 throughput (samples/sec): 317.97
2019-08-08 06:44:18,809 epoch 53 - iter 114/577 - loss 0.23223110 throughput (samples/sec): 309.74
2019-08-08 06:44:24,648 epoch 53 - iter 171/577 - loss 0.23529788 throughput (samples/sec): 317.87
2019-08-08 06:44:30,535 epoch 53 - iter 228/577 - loss 0.25916279 throughput (samples/sec): 314.82
2019-08-08 06:44:36,416 epoch 53 - iter 285/577 - loss 0.25585428 throughput (samples/sec): 315.24
2019-08-08 06:44:42,275 epoch 53 - iter 342/577 - loss 0.25379814 throughput (samples/sec): 316.12
2019-08-08 06:44:48,175 epoch 53 - iter 399/577 - loss 0.24918473 throughput (samples/sec): 313.90
2019-08-08 06:44:53,939 epoch 53 - iter 456/577 - loss 0.24426100 throughput (samples/sec): 321.68
2019-08-08 06:44:59,867 epoch 53 - iter 513/577 - loss 0.24722989 throughput (samples/sec): 312.44
2019-08-08 06:45:05,894 epoch 53 - iter 570/577 - loss 0.24591945 throughput (samples/sec): 307.28
2019-08-08 06:45:06,595 ----------------------------------------------------------------------------------------------------
2019-08-08 06:45:06,595 EPOCH 53 done: loss 0.2471 - lr 0.0500
2019-08-08 06:45:35,858 TEST : loss 0.8457019329071045 - score 0.9264
2019-08-08 06:45:36,033 BAD EPOCHS (no improvement): 0
2019-08-08 06:45:36,034 ----------------------------------------------------------------------------------------------------
2019-08-08 06:45:36,133 epoch 54 - iter 0/577 - loss 0.25082257 throughput (samples/sec): 18609.70
2019-08-08 06:45:41,837 epoch 54 - iter 57/577 - loss 0.19805782 throughput (samples/sec): 325.09
2019-08-08 06:45:47,781 epoch 54 - iter 114/577 - loss 0.22429125 throughput (samples/sec): 311.92
2019-08-08 06:45:53,794 epoch 54 - iter 171/577 - loss 0.24289420 throughput (samples/sec): 308.34
2019-08-08 06:45:59,608 epoch 54 - iter 228/577 - loss 0.25103469 throughput (samples/sec): 318.79
2019-08-08 06:46:05,570 epoch 54 - iter 285/577 - loss 0.25084768 throughput (samples/sec): 310.86
2019-08-08 06:46:11,422 epoch 54 - iter 342/577 - loss 0.24862760 throughput (samples/sec): 316.71
2019-08-08 06:46:17,398 epoch 54 - iter 399/577 - loss 0.25094151 throughput (samples/sec): 310.04
2019-08-08 06:46:23,164 epoch 54 - iter 456/577 - loss 0.25039883 throughput (samples/sec): 321.50
2019-08-08 06:46:29,069 epoch 54 - iter 513/577 - loss 0.25036089 throughput (samples/sec): 313.74
2019-08-08 06:46:34,921 epoch 54 - iter 570/577 - loss 0.25154900 throughput (samples/sec): 316.31
2019-08-08 06:46:35,581 ----------------------------------------------------------------------------------------------------
2019-08-08 06:46:35,581 EPOCH 54 done: loss 0.2507 - lr 0.0500
2019-08-08 06:47:04,744 TEST : loss 0.847665011882782 - score 0.9273
2019-08-08 06:47:04,920 BAD EPOCHS (no improvement): 1
2019-08-08 06:47:04,921 ----------------------------------------------------------------------------------------------------
2019-08-08 06:47:05,016 epoch 55 - iter 0/577 - loss 0.07133356 throughput (samples/sec): 19512.22
2019-08-08 06:47:10,936 epoch 55 - iter 57/577 - loss 0.24628548 throughput (samples/sec): 313.01
2019-08-08 06:47:16,875 epoch 55 - iter 114/577 - loss 0.23946847 throughput (samples/sec): 312.06
2019-08-08 06:47:22,740 epoch 55 - iter 171/577 - loss 0.25069785 throughput (samples/sec): 316.07
2019-08-08 06:47:28,619 epoch 55 - iter 228/577 - loss 0.25349176 throughput (samples/sec): 315.38
2019-08-08 06:47:34,464 epoch 55 - iter 285/577 - loss 0.24440910 throughput (samples/sec): 316.99
2019-08-08 06:47:40,385 epoch 55 - iter 342/577 - loss 0.24595794 throughput (samples/sec): 313.72
2019-08-08 06:47:46,267 epoch 55 - iter 399/577 - loss 0.24949116 throughput (samples/sec): 315.07
2019-08-08 06:47:52,157 epoch 55 - iter 456/577 - loss 0.25178820 throughput (samples/sec): 314.58
2019-08-08 06:47:57,973 epoch 55 - iter 513/577 - loss 0.25143634 throughput (samples/sec): 318.75
2019-08-08 06:48:03,921 epoch 55 - iter 570/577 - loss 0.25224391 throughput (samples/sec): 311.45
2019-08-08 06:48:04,609 ----------------------------------------------------------------------------------------------------
2019-08-08 06:48:04,610 EPOCH 55 done: loss 0.2515 - lr 0.0500
2019-08-08 06:48:33,921 TEST : loss 0.8332847952842712 - score 0.9289
2019-08-08 06:48:34,097 BAD EPOCHS (no improvement): 2
2019-08-08 06:48:34,098 ----------------------------------------------------------------------------------------------------
2019-08-08 06:48:34,199 epoch 56 - iter 0/577 - loss 0.05413675 throughput (samples/sec): 18357.71
2019-08-08 06:48:40,114 epoch 56 - iter 57/577 - loss 0.28454183 throughput (samples/sec): 313.20
2019-08-08 06:48:45,969 epoch 56 - iter 114/577 - loss 0.25837403 throughput (samples/sec): 316.54
2019-08-08 06:48:52,173 epoch 56 - iter 171/577 - loss 0.25124708 throughput (samples/sec): 298.49
2019-08-08 06:48:58,041 epoch 56 - iter 228/577 - loss 0.25648748 throughput (samples/sec): 315.76
2019-08-08 06:49:03,850 epoch 56 - iter 285/577 - loss 0.25729815 throughput (samples/sec): 319.28
2019-08-08 06:49:09,691 epoch 56 - iter 342/577 - loss 0.25808699 throughput (samples/sec): 317.27
2019-08-08 06:49:15,434 epoch 56 - iter 399/577 - loss 0.25449369 throughput (samples/sec): 322.83
2019-08-08 06:49:21,182 epoch 56 - iter 456/577 - loss 0.25553436 throughput (samples/sec): 322.48
2019-08-08 06:49:26,990 epoch 56 - iter 513/577 - loss 0.25233679 throughput (samples/sec): 319.16
2019-08-08 06:49:32,875 epoch 56 - iter 570/577 - loss 0.25084175 throughput (samples/sec): 315.02
2019-08-08 06:49:33,544 ----------------------------------------------------------------------------------------------------
2019-08-08 06:49:33,544 EPOCH 56 done: loss 0.2509 - lr 0.0500
2019-08-08 06:50:02,834 TEST : loss 0.8250455260276794 - score 0.9276
2019-08-08 06:50:03,010 BAD EPOCHS (no improvement): 3
2019-08-08 06:50:03,010 ----------------------------------------------------------------------------------------------------
2019-08-08 06:50:03,114 epoch 57 - iter 0/577 - loss 0.29822335 throughput (samples/sec): 17878.76
2019-08-08 06:50:08,911 epoch 57 - iter 57/577 - loss 0.23377489 throughput (samples/sec): 319.57
2019-08-08 06:50:14,799 epoch 57 - iter 114/577 - loss 0.24445269 throughput (samples/sec): 314.68
2019-08-08 06:50:20,731 epoch 57 - iter 171/577 - loss 0.23959338 throughput (samples/sec): 312.46
2019-08-08 06:50:26,671 epoch 57 - iter 228/577 - loss 0.24892560 throughput (samples/sec): 312.00
2019-08-08 06:50:32,453 epoch 57 - iter 285/577 - loss 0.25423284 throughput (samples/sec): 320.63
2019-08-08 06:50:38,277 epoch 57 - iter 342/577 - loss 0.25297664 throughput (samples/sec): 318.53
2019-08-08 06:50:44,315 epoch 57 - iter 399/577 - loss 0.25324259 throughput (samples/sec): 306.79
2019-08-08 06:50:50,211 epoch 57 - iter 456/577 - loss 0.25591298 throughput (samples/sec): 314.29
2019-08-08 06:50:55,998 epoch 57 - iter 513/577 - loss 0.25159460 throughput (samples/sec): 320.63
2019-08-08 06:51:01,975 epoch 57 - iter 570/577 - loss 0.25030278 throughput (samples/sec): 309.95
2019-08-08 06:51:02,625 ----------------------------------------------------------------------------------------------------
2019-08-08 06:51:02,625 EPOCH 57 done: loss 0.2505 - lr 0.0500
2019-08-08 06:51:31,884 TEST : loss 0.8393857479095459 - score 0.9273
2019-08-08 06:51:32,061 BAD EPOCHS (no improvement): 4
2019-08-08 06:51:32,062 ----------------------------------------------------------------------------------------------------
2019-08-08 06:51:32,156 epoch 58 - iter 0/577 - loss 0.10365355 throughput (samples/sec): 19591.72
2019-08-08 06:51:38,052 epoch 58 - iter 57/577 - loss 0.25295384 throughput (samples/sec): 314.16
2019-08-08 06:51:43,945 epoch 58 - iter 114/577 - loss 0.26365041 throughput (samples/sec): 314.60
2019-08-08 06:51:49,973 epoch 58 - iter 171/577 - loss 0.25742967 throughput (samples/sec): 307.15
2019-08-08 06:51:55,903 epoch 58 - iter 228/577 - loss 0.25000830 throughput (samples/sec): 312.31
2019-08-08 06:52:01,583 epoch 58 - iter 285/577 - loss 0.24599352 throughput (samples/sec): 326.17
2019-08-08 06:52:07,391 epoch 58 - iter 342/577 - loss 0.24540957 throughput (samples/sec): 318.96
2019-08-08 06:52:13,278 epoch 58 - iter 399/577 - loss 0.25289796 throughput (samples/sec): 314.58
2019-08-08 06:52:19,056 epoch 58 - iter 456/577 - loss 0.24463284 throughput (samples/sec): 320.77
2019-08-08 06:52:24,851 epoch 58 - iter 513/577 - loss 0.24593538 throughput (samples/sec): 319.68
2019-08-08 06:52:30,647 epoch 58 - iter 570/577 - loss 0.24622401 throughput (samples/sec): 319.69
2019-08-08 06:52:31,322 ----------------------------------------------------------------------------------------------------
2019-08-08 06:52:31,322 EPOCH 58 done: loss 0.2455 - lr 0.0250
2019-08-08 06:53:00,605 TEST : loss 0.8498694896697998 - score 0.9271
2019-08-08 06:53:00,782 BAD EPOCHS (no improvement): 0
2019-08-08 06:53:00,783 ----------------------------------------------------------------------------------------------------
2019-08-08 06:53:00,901 epoch 59 - iter 0/577 - loss 0.05098695 throughput (samples/sec): 15582.27
2019-08-08 06:53:06,744 epoch 59 - iter 57/577 - loss 0.23902788 throughput (samples/sec): 317.17
2019-08-08 06:53:12,667 epoch 59 - iter 114/577 - loss 0.24038869 throughput (samples/sec): 312.68
2019-08-08 06:53:18,521 epoch 59 - iter 171/577 - loss 0.24128851 throughput (samples/sec): 316.45
2019-08-08 06:53:24,372 epoch 59 - iter 228/577 - loss 0.25065493 throughput (samples/sec): 317.16
2019-08-08 06:53:30,185 epoch 59 - iter 285/577 - loss 0.24466271 throughput (samples/sec): 318.95
2019-08-08 06:53:36,109 epoch 59 - iter 342/577 - loss 0.23993562 throughput (samples/sec): 312.72
2019-08-08 06:53:42,076 epoch 59 - iter 399/577 - loss 0.23642359 throughput (samples/sec): 310.44
2019-08-08 06:53:47,941 epoch 59 - iter 456/577 - loss 0.23211200 throughput (samples/sec): 315.83
2019-08-08 06:53:53,585 epoch 59 - iter 513/577 - loss 0.22989415 throughput (samples/sec): 328.44
2019-08-08 06:53:59,340 epoch 59 - iter 570/577 - loss 0.22817596 throughput (samples/sec): 322.05
2019-08-08 06:53:59,972 ----------------------------------------------------------------------------------------------------
2019-08-08 06:53:59,972 EPOCH 59 done: loss 0.2270 - lr 0.0250
2019-08-08 06:54:29,251 TEST : loss 0.8537213802337646 - score 0.9268
2019-08-08 06:54:29,424 BAD EPOCHS (no improvement): 0
2019-08-08 06:54:29,425 ----------------------------------------------------------------------------------------------------
2019-08-08 06:54:29,523 epoch 60 - iter 0/577 - loss 0.43101928 throughput (samples/sec): 18913.39
2019-08-08 06:54:35,491 epoch 60 - iter 57/577 - loss 0.27970696 throughput (samples/sec): 310.64
2019-08-08 06:54:41,417 epoch 60 - iter 114/577 - loss 0.26358242 throughput (samples/sec): 312.71
2019-08-08 06:54:47,234 epoch 60 - iter 171/577 - loss 0.24991019 throughput (samples/sec): 318.65
2019-08-08 06:54:52,979 epoch 60 - iter 228/577 - loss 0.25389070 throughput (samples/sec): 322.70
2019-08-08 06:54:58,841 epoch 60 - iter 285/577 - loss 0.24770168 throughput (samples/sec): 316.13
2019-08-08 06:55:04,649 epoch 60 - iter 342/577 - loss 0.23811078 throughput (samples/sec): 318.91
2019-08-08 06:55:10,518 epoch 60 - iter 399/577 - loss 0.23503100 throughput (samples/sec): 315.76
2019-08-08 06:55:16,461 epoch 60 - iter 456/577 - loss 0.24262209 throughput (samples/sec): 311.67
2019-08-08 06:55:22,360 epoch 60 - iter 513/577 - loss 0.23607703 throughput (samples/sec): 314.01
2019-08-08 06:55:28,390 epoch 60 - iter 570/577 - loss 0.23817940 throughput (samples/sec): 307.22
2019-08-08 06:55:29,022 ----------------------------------------------------------------------------------------------------
2019-08-08 06:55:29,022 EPOCH 60 done: loss 0.2373 - lr 0.0250
2019-08-08 06:55:58,306 TEST : loss 0.8524962663650513 - score 0.9272
2019-08-08 06:55:58,480 BAD EPOCHS (no improvement): 1
2019-08-08 06:55:58,481 ----------------------------------------------------------------------------------------------------
2019-08-08 06:55:58,578 epoch 61 - iter 0/577 - loss 0.22031063 throughput (samples/sec): 19173.62
2019-08-08 06:56:04,379 epoch 61 - iter 57/577 - loss 0.24245322 throughput (samples/sec): 319.63
2019-08-08 06:56:10,298 epoch 61 - iter 114/577 - loss 0.22880967 throughput (samples/sec): 313.15
2019-08-08 06:56:16,197 epoch 61 - iter 171/577 - loss 0.23459846 throughput (samples/sec): 314.23
2019-08-08 06:56:22,095 epoch 61 - iter 228/577 - loss 0.24045588 throughput (samples/sec): 314.22
2019-08-08 06:56:28,028 epoch 61 - iter 285/577 - loss 0.24081280 throughput (samples/sec): 312.28
2019-08-08 06:56:34,042 epoch 61 - iter 342/577 - loss 0.23895025 throughput (samples/sec): 308.11
2019-08-08 06:56:39,876 epoch 61 - iter 399/577 - loss 0.24197157 throughput (samples/sec): 317.64
2019-08-08 06:56:45,709 epoch 61 - iter 456/577 - loss 0.23563067 throughput (samples/sec): 317.71
2019-08-08 06:56:51,403 epoch 61 - iter 513/577 - loss 0.23367906 throughput (samples/sec): 325.51
2019-08-08 06:56:57,230 epoch 61 - iter 570/577 - loss 0.23507591 throughput (samples/sec): 317.94
2019-08-08 06:56:57,916 ----------------------------------------------------------------------------------------------------
2019-08-08 06:56:57,917 EPOCH 61 done: loss 0.2350 - lr 0.0250
2019-08-08 06:57:27,159 TEST : loss 0.8519457578659058 - score 0.927
2019-08-08 06:57:27,330 BAD EPOCHS (no improvement): 2
2019-08-08 06:57:27,331 ----------------------------------------------------------------------------------------------------
2019-08-08 06:57:27,435 epoch 62 - iter 0/577 - loss 0.08378702 throughput (samples/sec): 17713.38
2019-08-08 06:57:33,163 epoch 62 - iter 57/577 - loss 0.18738796 throughput (samples/sec): 323.79
2019-08-08 06:57:38,981 epoch 62 - iter 114/577 - loss 0.19361766 throughput (samples/sec): 318.44
2019-08-08 06:57:44,796 epoch 62 - iter 171/577 - loss 0.20470343 throughput (samples/sec): 318.73
2019-08-08 06:57:50,502 epoch 62 - iter 228/577 - loss 0.21403425 throughput (samples/sec): 324.87
2019-08-08 06:57:56,210 epoch 62 - iter 285/577 - loss 0.21648641 throughput (samples/sec): 324.92
2019-08-08 06:58:01,816 epoch 62 - iter 342/577 - loss 0.21511143 throughput (samples/sec): 330.86
2019-08-08 06:58:07,601 epoch 62 - iter 399/577 - loss 0.21826604 throughput (samples/sec): 320.25
2019-08-08 06:58:13,441 epoch 62 - iter 456/577 - loss 0.22390077 throughput (samples/sec): 317.39
2019-08-08 06:58:19,396 epoch 62 - iter 513/577 - loss 0.22361773 throughput (samples/sec): 310.84
2019-08-08 06:58:25,492 epoch 62 - iter 570/577 - loss 0.22544737 throughput (samples/sec): 303.62
2019-08-08 06:58:26,171 ----------------------------------------------------------------------------------------------------
2019-08-08 06:58:26,171 EPOCH 62 done: loss 0.2243 - lr 0.0250
2019-08-08 06:58:55,474 TEST : loss 0.851050615310669 - score 0.9268
2019-08-08 06:58:55,648 BAD EPOCHS (no improvement): 0
2019-08-08 06:58:55,649 ----------------------------------------------------------------------------------------------------
2019-08-08 06:58:55,748 epoch 63 - iter 0/577 - loss 0.11609906 throughput (samples/sec): 18676.80
2019-08-08 06:59:01,544 epoch 63 - iter 57/577 - loss 0.23561132 throughput (samples/sec): 319.93
2019-08-08 06:59:07,502 epoch 63 - iter 114/577 - loss 0.21642143 throughput (samples/sec): 310.93
2019-08-08 06:59:13,322 epoch 63 - iter 171/577 - loss 0.21642819 throughput (samples/sec): 318.43
2019-08-08 06:59:19,217 epoch 63 - iter 228/577 - loss 0.21577144 throughput (samples/sec): 314.35
2019-08-08 06:59:25,029 epoch 63 - iter 285/577 - loss 0.22170131 throughput (samples/sec): 318.87
2019-08-08 06:59:30,884 epoch 63 - iter 342/577 - loss 0.22621710 throughput (samples/sec): 316.56
2019-08-08 06:59:36,753 epoch 63 - iter 399/577 - loss 0.22888619 throughput (samples/sec): 315.70
2019-08-08 06:59:42,785 epoch 63 - iter 456/577 - loss 0.22411178 throughput (samples/sec): 307.06
2019-08-08 06:59:48,464 epoch 63 - iter 513/577 - loss 0.22446459 throughput (samples/sec): 326.35
2019-08-08 06:59:54,306 epoch 63 - iter 570/577 - loss 0.22453435 throughput (samples/sec): 317.14
2019-08-08 06:59:54,986 ----------------------------------------------------------------------------------------------------
2019-08-08 06:59:54,986 EPOCH 63 done: loss 0.2249 - lr 0.0250
2019-08-08 07:00:24,209 TEST : loss 0.8560118675231934 - score 0.9276
2019-08-08 07:00:24,386 BAD EPOCHS (no improvement): 1
2019-08-08 07:00:24,387 ----------------------------------------------------------------------------------------------------
2019-08-08 07:00:24,489 epoch 64 - iter 0/577 - loss 0.12408137 throughput (samples/sec): 18153.93
2019-08-08 07:00:30,415 epoch 64 - iter 57/577 - loss 0.24319614 throughput (samples/sec): 312.78
2019-08-08 07:00:36,325 epoch 64 - iter 114/577 - loss 0.21940688 throughput (samples/sec): 313.82
2019-08-08 07:00:42,213 epoch 64 - iter 171/577 - loss 0.21476935 throughput (samples/sec): 314.74
2019-08-08 07:00:47,969 epoch 64 - iter 228/577 - loss 0.21331230 throughput (samples/sec): 321.97
2019-08-08 07:00:53,813 epoch 64 - iter 285/577 - loss 0.21790933 throughput (samples/sec): 317.12
2019-08-08 07:00:59,585 epoch 64 - iter 342/577 - loss 0.22722452 throughput (samples/sec): 321.13
2019-08-08 07:01:05,382 epoch 64 - iter 399/577 - loss 0.22877115 throughput (samples/sec): 319.71
2019-08-08 07:01:11,317 epoch 64 - iter 456/577 - loss 0.22946722 throughput (samples/sec): 312.11
2019-08-08 07:01:17,095 epoch 64 - iter 513/577 - loss 0.23011738 throughput (samples/sec): 320.63
2019-08-08 07:01:22,906 epoch 64 - iter 570/577 - loss 0.23459380 throughput (samples/sec): 318.79
2019-08-08 07:01:23,535 ----------------------------------------------------------------------------------------------------
2019-08-08 07:01:23,535 EPOCH 64 done: loss 0.2351 - lr 0.0250
2019-08-08 07:01:52,770 TEST : loss 0.8623631596565247 - score 0.9264
2019-08-08 07:01:52,952 BAD EPOCHS (no improvement): 2
2019-08-08 07:01:52,953 ----------------------------------------------------------------------------------------------------
2019-08-08 07:01:53,061 epoch 65 - iter 0/577 - loss 0.23412991 throughput (samples/sec): 17156.19
2019-08-08 07:01:59,016 epoch 65 - iter 57/577 - loss 0.19404737 throughput (samples/sec): 311.31
2019-08-08 07:02:04,848 epoch 65 - iter 114/577 - loss 0.19740459 throughput (samples/sec): 317.85
2019-08-08 07:02:10,696 epoch 65 - iter 171/577 - loss 0.20577774 throughput (samples/sec): 316.98
2019-08-08 07:02:16,506 epoch 65 - iter 228/577 - loss 0.20910699 throughput (samples/sec): 318.82
2019-08-08 07:02:22,527 epoch 65 - iter 285/577 - loss 0.21334562 throughput (samples/sec): 307.68
2019-08-08 07:02:28,386 epoch 65 - iter 342/577 - loss 0.21789739 throughput (samples/sec): 316.30
2019-08-08 07:02:34,306 epoch 65 - iter 399/577 - loss 0.21549905 throughput (samples/sec): 312.88
2019-08-08 07:02:40,114 epoch 65 - iter 456/577 - loss 0.21597375 throughput (samples/sec): 319.02
2019-08-08 07:02:45,897 epoch 65 - iter 513/577 - loss 0.21617252 throughput (samples/sec): 320.44
2019-08-08 07:02:51,596 epoch 65 - iter 570/577 - loss 0.21304986 throughput (samples/sec): 324.97
2019-08-08 07:02:52,236 ----------------------------------------------------------------------------------------------------
2019-08-08 07:02:52,236 EPOCH 65 done: loss 0.2128 - lr 0.0250
2019-08-08 07:03:21,435 TEST : loss 0.8576115965843201 - score 0.9271
2019-08-08 07:03:21,615 BAD EPOCHS (no improvement): 0
2019-08-08 07:03:21,615 ----------------------------------------------------------------------------------------------------
2019-08-08 07:03:21,717 epoch 66 - iter 0/577 - loss 0.08975062 throughput (samples/sec): 18306.84
2019-08-08 07:03:27,625 epoch 66 - iter 57/577 - loss 0.25520370 throughput (samples/sec): 313.74
2019-08-08 07:03:33,670 epoch 66 - iter 114/577 - loss 0.22733832 throughput (samples/sec): 306.46
2019-08-08 07:03:39,386 epoch 66 - iter 171/577 - loss 0.21672485 throughput (samples/sec): 324.47
2019-08-08 07:03:45,129 epoch 66 - iter 228/577 - loss 0.22458000 throughput (samples/sec): 322.78
2019-08-08 07:03:51,105 epoch 66 - iter 285/577 - loss 0.21842198 throughput (samples/sec): 309.97
2019-08-08 07:03:56,989 epoch 66 - iter 342/577 - loss 0.21268925 throughput (samples/sec): 314.98
2019-08-08 07:04:02,963 epoch 66 - iter 399/577 - loss 0.20923990 throughput (samples/sec): 310.02
2019-08-08 07:04:08,896 epoch 66 - iter 456/577 - loss 0.20870049 throughput (samples/sec): 312.21
2019-08-08 07:04:14,779 epoch 66 - iter 513/577 - loss 0.20825485 throughput (samples/sec): 315.00
2019-08-08 07:04:20,588 epoch 66 - iter 570/577 - loss 0.20661184 throughput (samples/sec): 318.97
2019-08-08 07:04:21,259 ----------------------------------------------------------------------------------------------------
2019-08-08 07:04:21,259 EPOCH 66 done: loss 0.2075 - lr 0.0250
2019-08-08 07:04:50,527 TEST : loss 0.8520722985267639 - score 0.9273
2019-08-08 07:04:50,713 BAD EPOCHS (no improvement): 0
2019-08-08 07:04:50,714 ----------------------------------------------------------------------------------------------------
2019-08-08 07:04:50,818 epoch 67 - iter 0/577 - loss 0.36865780 throughput (samples/sec): 17765.05
2019-08-08 07:04:56,757 epoch 67 - iter 57/577 - loss 0.21289381 throughput (samples/sec): 311.75
2019-08-08 07:05:02,614 epoch 67 - iter 114/577 - loss 0.21214962 throughput (samples/sec): 316.53
2019-08-08 07:05:08,494 epoch 67 - iter 171/577 - loss 0.22212571 throughput (samples/sec): 315.11
2019-08-08 07:05:14,317 epoch 67 - iter 228/577 - loss 0.21178702 throughput (samples/sec): 318.03
2019-08-08 07:05:20,301 epoch 67 - iter 285/577 - loss 0.21391380 throughput (samples/sec): 309.51
2019-08-08 07:05:26,238 epoch 67 - iter 342/577 - loss 0.21231313 throughput (samples/sec): 311.88
2019-08-08 07:05:32,149 epoch 67 - iter 399/577 - loss 0.21409116 throughput (samples/sec): 313.46
2019-08-08 07:05:37,944 epoch 67 - iter 456/577 - loss 0.21801047 throughput (samples/sec): 319.58
2019-08-08 07:05:43,949 epoch 67 - iter 513/577 - loss 0.21970537 throughput (samples/sec): 308.28
2019-08-08 07:05:49,966 epoch 67 - iter 570/577 - loss 0.21800666 throughput (samples/sec): 307.90
2019-08-08 07:05:50,702 ----------------------------------------------------------------------------------------------------
2019-08-08 07:05:50,702 EPOCH 67 done: loss 0.2187 - lr 0.0250
2019-08-08 07:06:20,010 TEST : loss 0.8611341118812561 - score 0.9273
2019-08-08 07:06:20,188 BAD EPOCHS (no improvement): 1
2019-08-08 07:06:20,188 ----------------------------------------------------------------------------------------------------
2019-08-08 07:06:20,285 epoch 68 - iter 0/577 - loss 0.97944999 throughput (samples/sec): 19155.53
2019-08-08 07:06:26,313 epoch 68 - iter 57/577 - loss 0.22517147 throughput (samples/sec): 307.42
2019-08-08 07:06:32,246 epoch 68 - iter 114/577 - loss 0.21184435 throughput (samples/sec): 312.51
2019-08-08 07:06:38,296 epoch 68 - iter 171/577 - loss 0.20694057 throughput (samples/sec): 306.26
2019-08-08 07:06:44,142 epoch 68 - iter 228/577 - loss 0.21305360 throughput (samples/sec): 317.08
2019-08-08 07:06:49,956 epoch 68 - iter 285/577 - loss 0.21237116 throughput (samples/sec): 318.82
2019-08-08 07:06:55,875 epoch 68 - iter 342/577 - loss 0.22014979 throughput (samples/sec): 313.32
2019-08-08 07:07:01,622 epoch 68 - iter 399/577 - loss 0.21945725 throughput (samples/sec): 322.48
2019-08-08 07:07:07,507 epoch 68 - iter 456/577 - loss 0.21791783 throughput (samples/sec): 314.58
2019-08-08 07:07:13,326 epoch 68 - iter 513/577 - loss 0.21788753 throughput (samples/sec): 318.31
2019-08-08 07:07:19,327 epoch 68 - iter 570/577 - loss 0.21525166 throughput (samples/sec): 308.54
2019-08-08 07:07:20,005 ----------------------------------------------------------------------------------------------------
2019-08-08 07:07:20,005 EPOCH 68 done: loss 0.2160 - lr 0.0250
2019-08-08 07:07:49,216 TEST : loss 0.8570160269737244 - score 0.9279
2019-08-08 07:07:49,388 BAD EPOCHS (no improvement): 2
2019-08-08 07:07:49,389 ----------------------------------------------------------------------------------------------------
2019-08-08 07:07:49,493 epoch 69 - iter 0/577 - loss 0.16340214 throughput (samples/sec): 17938.04
2019-08-08 07:07:55,321 epoch 69 - iter 57/577 - loss 0.25290040 throughput (samples/sec): 318.08
2019-08-08 07:08:01,114 epoch 69 - iter 114/577 - loss 0.22637382 throughput (samples/sec): 319.97
2019-08-08 07:08:06,978 epoch 69 - iter 171/577 - loss 0.22361631 throughput (samples/sec): 315.95
2019-08-08 07:08:12,707 epoch 69 - iter 228/577 - loss 0.22429999 throughput (samples/sec): 323.31
2019-08-08 07:08:18,609 epoch 69 - iter 285/577 - loss 0.22735492 throughput (samples/sec): 314.47
2019-08-08 07:08:24,497 epoch 69 - iter 342/577 - loss 0.22558012 throughput (samples/sec): 314.61
2019-08-08 07:08:30,478 epoch 69 - iter 399/577 - loss 0.22521257 throughput (samples/sec): 309.82
2019-08-08 07:08:36,445 epoch 69 - iter 456/577 - loss 0.22227474 throughput (samples/sec): 310.49
2019-08-08 07:08:42,361 epoch 69 - iter 513/577 - loss 0.22557250 throughput (samples/sec): 313.08
2019-08-08 07:08:48,458 epoch 69 - iter 570/577 - loss 0.22216240 throughput (samples/sec): 303.57
2019-08-08 07:08:49,150 ----------------------------------------------------------------------------------------------------
2019-08-08 07:08:49,151 EPOCH 69 done: loss 0.2222 - lr 0.0250
2019-08-08 07:09:18,403 TEST : loss 0.8576691150665283 - score 0.9273
2019-08-08 07:09:18,578 BAD EPOCHS (no improvement): 3
2019-08-08 07:09:18,579 ----------------------------------------------------------------------------------------------------
2019-08-08 07:09:18,687 epoch 70 - iter 0/577 - loss 0.47740173 throughput (samples/sec): 17049.60
2019-08-08 07:09:24,582 epoch 70 - iter 57/577 - loss 0.19893347 throughput (samples/sec): 314.34
2019-08-08 07:09:30,459 epoch 70 - iter 114/577 - loss 0.19556305 throughput (samples/sec): 315.18
2019-08-08 07:09:36,441 epoch 70 - iter 171/577 - loss 0.18885423 throughput (samples/sec): 309.62
2019-08-08 07:09:42,275 epoch 70 - iter 228/577 - loss 0.19886236 throughput (samples/sec): 317.50
2019-08-08 07:09:48,122 epoch 70 - iter 285/577 - loss 0.21049962 throughput (samples/sec): 316.98
2019-08-08 07:09:54,029 epoch 70 - iter 342/577 - loss 0.20879585 throughput (samples/sec): 313.60
2019-08-08 07:09:59,830 epoch 70 - iter 399/577 - loss 0.20760762 throughput (samples/sec): 319.52
2019-08-08 07:10:05,662 epoch 70 - iter 456/577 - loss 0.21126550 throughput (samples/sec): 317.68
2019-08-08 07:10:11,524 epoch 70 - iter 513/577 - loss 0.21289980 throughput (samples/sec): 315.88
2019-08-08 07:10:17,599 epoch 70 - iter 570/577 - loss 0.21236817 throughput (samples/sec): 304.71
2019-08-08 07:10:18,271 ----------------------------------------------------------------------------------------------------
2019-08-08 07:10:18,271 EPOCH 70 done: loss 0.2133 - lr 0.0250
2019-08-08 07:10:47,459 TEST : loss 0.8718554377555847 - score 0.9267
2019-08-08 07:10:47,632 BAD EPOCHS (no improvement): 4
2019-08-08 07:10:47,633 ----------------------------------------------------------------------------------------------------
2019-08-08 07:10:47,745 epoch 71 - iter 0/577 - loss 0.10145047 throughput (samples/sec): 16690.40
2019-08-08 07:10:53,611 epoch 71 - iter 57/577 - loss 0.21940100 throughput (samples/sec): 316.01
2019-08-08 07:10:59,525 epoch 71 - iter 114/577 - loss 0.22184069 throughput (samples/sec): 313.45
2019-08-08 07:11:05,423 epoch 71 - iter 171/577 - loss 0.21791508 throughput (samples/sec): 314.14
2019-08-08 07:11:11,380 epoch 71 - iter 228/577 - loss 0.21926080 throughput (samples/sec): 310.97
2019-08-08 07:11:17,046 epoch 71 - iter 285/577 - loss 0.21843366 throughput (samples/sec): 327.09
2019-08-08 07:11:22,901 epoch 71 - iter 342/577 - loss 0.21539093 throughput (samples/sec): 316.44
2019-08-08 07:11:28,679 epoch 71 - iter 399/577 - loss 0.21606533 throughput (samples/sec): 320.85
2019-08-08 07:11:34,478 epoch 71 - iter 456/577 - loss 0.21589298 throughput (samples/sec): 319.47
2019-08-08 07:11:40,399 epoch 71 - iter 513/577 - loss 0.21429370 throughput (samples/sec): 312.80
2019-08-08 07:11:46,221 epoch 71 - iter 570/577 - loss 0.21326760 throughput (samples/sec): 318.10
2019-08-08 07:11:46,876 ----------------------------------------------------------------------------------------------------
2019-08-08 07:11:46,877 EPOCH 71 done: loss 0.2122 - lr 0.0125
2019-08-08 07:12:15,997 TEST : loss 0.8669012784957886 - score 0.9263
2019-08-08 07:12:16,170 BAD EPOCHS (no improvement): 1
2019-08-08 07:12:16,171 ----------------------------------------------------------------------------------------------------
2019-08-08 07:12:16,295 epoch 72 - iter 0/577 - loss 0.30027154 throughput (samples/sec): 14854.19
2019-08-08 07:12:22,134 epoch 72 - iter 57/577 - loss 0.16818202 throughput (samples/sec): 317.40
2019-08-08 07:12:27,962 epoch 72 - iter 114/577 - loss 0.18610090 throughput (samples/sec): 317.88
2019-08-08 07:12:33,874 epoch 72 - iter 171/577 - loss 0.19496664 throughput (samples/sec): 313.41
2019-08-08 07:12:39,663 epoch 72 - iter 228/577 - loss 0.19993498 throughput (samples/sec): 320.15
2019-08-08 07:12:45,555 epoch 72 - iter 285/577 - loss 0.20032266 throughput (samples/sec): 314.62
2019-08-08 07:12:51,434 epoch 72 - iter 342/577 - loss 0.20934420 throughput (samples/sec): 315.26
2019-08-08 07:12:57,205 epoch 72 - iter 399/577 - loss 0.20618731 throughput (samples/sec): 321.15
2019-08-08 07:13:03,272 epoch 72 - iter 456/577 - loss 0.20737233 throughput (samples/sec): 313.28
2019-08-08 07:13:09,232 epoch 72 - iter 513/577 - loss 0.20419961 throughput (samples/sec): 310.65
2019-08-08 07:13:15,179 epoch 72 - iter 570/577 - loss 0.21038239 throughput (samples/sec): 311.57
2019-08-08 07:13:15,867 ----------------------------------------------------------------------------------------------------
2019-08-08 07:13:15,868 EPOCH 72 done: loss 0.2095 - lr 0.0125
2019-08-08 07:13:45,112 TEST : loss 0.8724766373634338 - score 0.927
2019-08-08 07:13:45,286 BAD EPOCHS (no improvement): 2
2019-08-08 07:13:45,287 ----------------------------------------------------------------------------------------------------
2019-08-08 07:13:45,405 epoch 73 - iter 0/577 - loss 0.03631562 throughput (samples/sec): 15634.01
2019-08-08 07:13:51,273 epoch 73 - iter 57/577 - loss 0.23121007 throughput (samples/sec): 315.96
2019-08-08 07:13:57,096 epoch 73 - iter 114/577 - loss 0.23276704 throughput (samples/sec): 318.27
2019-08-08 07:14:02,862 epoch 73 - iter 171/577 - loss 0.22479178 throughput (samples/sec): 321.58
2019-08-08 07:14:08,833 epoch 73 - iter 228/577 - loss 0.22518817 throughput (samples/sec): 310.15
2019-08-08 07:14:14,826 epoch 73 - iter 285/577 - loss 0.21394163 throughput (samples/sec): 309.09
2019-08-08 07:14:20,630 epoch 73 - iter 342/577 - loss 0.21530632 throughput (samples/sec): 319.40
2019-08-08 07:14:26,509 epoch 73 - iter 399/577 - loss 0.21040908 throughput (samples/sec): 315.49
2019-08-08 07:14:32,336 epoch 73 - iter 456/577 - loss 0.20756015 throughput (samples/sec): 318.19
2019-08-08 07:14:38,152 epoch 73 - iter 513/577 - loss 0.20893726 throughput (samples/sec): 318.56
2019-08-08 07:14:43,943 epoch 73 - iter 570/577 - loss 0.20928162 throughput (samples/sec): 319.87
2019-08-08 07:14:44,681 ----------------------------------------------------------------------------------------------------
2019-08-08 07:14:44,681 EPOCH 73 done: loss 0.2090 - lr 0.0125
2019-08-08 07:15:13,900 TEST : loss 0.8697599768638611 - score 0.9267
2019-08-08 07:15:14,076 BAD EPOCHS (no improvement): 3
2019-08-08 07:15:14,077 ----------------------------------------------------------------------------------------------------
2019-08-08 07:15:14,175 epoch 74 - iter 0/577 - loss 0.13222709 throughput (samples/sec): 18988.31
2019-08-08 07:15:19,981 epoch 74 - iter 57/577 - loss 0.23124577 throughput (samples/sec): 319.07
2019-08-08 07:15:25,811 epoch 74 - iter 114/577 - loss 0.23346065 throughput (samples/sec): 318.27
2019-08-08 07:15:31,761 epoch 74 - iter 171/577 - loss 0.22204104 throughput (samples/sec): 311.48
2019-08-08 07:15:37,670 epoch 74 - iter 228/577 - loss 0.21611851 throughput (samples/sec): 313.75
2019-08-08 07:15:43,359 epoch 74 - iter 285/577 - loss 0.21693776 throughput (samples/sec): 325.91
2019-08-08 07:15:49,310 epoch 74 - iter 342/577 - loss 0.21076105 throughput (samples/sec): 311.14
2019-08-08 07:15:55,202 epoch 74 - iter 399/577 - loss 0.21039990 throughput (samples/sec): 314.39
2019-08-08 07:16:00,968 epoch 74 - iter 456/577 - loss 0.21494388 throughput (samples/sec): 321.19
2019-08-08 07:16:06,790 epoch 74 - iter 513/577 - loss 0.21832201 throughput (samples/sec): 318.42
2019-08-08 07:16:12,815 epoch 74 - iter 570/577 - loss 0.21955208 throughput (samples/sec): 307.48
2019-08-08 07:16:13,473 ----------------------------------------------------------------------------------------------------
2019-08-08 07:16:13,474 EPOCH 74 done: loss 0.2193 - lr 0.0125
2019-08-08 07:16:42,573 TEST : loss 0.8652893304824829 - score 0.9278
2019-08-08 07:16:42,755 BAD EPOCHS (no improvement): 4
2019-08-08 07:16:42,756 ----------------------------------------------------------------------------------------------------
2019-08-08 07:16:42,865 epoch 75 - iter 0/577 - loss 0.09503195 throughput (samples/sec): 17013.62
2019-08-08 07:16:48,692 epoch 75 - iter 57/577 - loss 0.17017232 throughput (samples/sec): 318.12
2019-08-08 07:16:54,626 epoch 75 - iter 114/577 - loss 0.19434962 throughput (samples/sec): 312.16
2019-08-08 07:17:00,430 epoch 75 - iter 171/577 - loss 0.18986498 throughput (samples/sec): 319.40
2019-08-08 07:17:06,227 epoch 75 - iter 228/577 - loss 0.19838044 throughput (samples/sec): 320.38
2019-08-08 07:17:12,107 epoch 75 - iter 285/577 - loss 0.19655747 throughput (samples/sec): 315.59
2019-08-08 07:17:17,924 epoch 75 - iter 342/577 - loss 0.19688102 throughput (samples/sec): 318.58
2019-08-08 07:17:23,659 epoch 75 - iter 399/577 - loss 0.20045498 throughput (samples/sec): 323.18
2019-08-08 07:17:29,629 epoch 75 - iter 456/577 - loss 0.20368896 throughput (samples/sec): 310.22
2019-08-08 07:17:35,369 epoch 75 - iter 513/577 - loss 0.20364193 throughput (samples/sec): 322.69
2019-08-08 07:17:41,263 epoch 75 - iter 570/577 - loss 0.20493459 throughput (samples/sec): 314.41
2019-08-08 07:17:41,930 ----------------------------------------------------------------------------------------------------
2019-08-08 07:17:41,930 EPOCH 75 done: loss 0.2057 - lr 0.0063
2019-08-08 07:18:12,727 TEST : loss 0.8659113645553589 - score 0.9273
2019-08-08 07:18:12,889 BAD EPOCHS (no improvement): 0
2019-08-08 07:18:12,890 ----------------------------------------------------------------------------------------------------
2019-08-08 07:18:13,004 epoch 76 - iter 0/577 - loss 0.12584406 throughput (samples/sec): 16243.70
2019-08-08 07:18:18,673 epoch 76 - iter 57/577 - loss 0.21488527 throughput (samples/sec): 326.79
2019-08-08 07:18:24,548 epoch 76 - iter 114/577 - loss 0.21061854 throughput (samples/sec): 315.44
2019-08-08 07:18:30,416 epoch 76 - iter 171/577 - loss 0.20629201 throughput (samples/sec): 315.97
2019-08-08 07:18:36,209 epoch 76 - iter 228/577 - loss 0.21872979 throughput (samples/sec): 320.00
2019-08-08 07:18:42,122 epoch 76 - iter 285/577 - loss 0.21421667 throughput (samples/sec): 313.12
2019-08-08 07:18:47,967 epoch 76 - iter 342/577 - loss 0.22191272 throughput (samples/sec): 317.21
2019-08-08 07:18:53,760 epoch 76 - iter 399/577 - loss 0.22174930 throughput (samples/sec): 320.02
2019-08-08 07:18:59,688 epoch 76 - iter 456/577 - loss 0.21998011 throughput (samples/sec): 312.52
2019-08-08 07:19:05,779 epoch 76 - iter 513/577 - loss 0.21445053 throughput (samples/sec): 304.06
2019-08-08 07:19:11,597 epoch 76 - iter 570/577 - loss 0.21501819 throughput (samples/sec): 318.65
2019-08-08 07:19:12,252 ----------------------------------------------------------------------------------------------------
2019-08-08 07:19:12,252 EPOCH 76 done: loss 0.2145 - lr 0.0063
2019-08-08 07:19:41,600 TEST : loss 0.8677815794944763 - score 0.927
2019-08-08 07:19:41,771 BAD EPOCHS (no improvement): 1
2019-08-08 07:19:41,772 ----------------------------------------------------------------------------------------------------
2019-08-08 07:19:41,872 epoch 77 - iter 0/577 - loss 0.10513410 throughput (samples/sec): 18570.26
2019-08-08 07:19:47,709 epoch 77 - iter 57/577 - loss 0.18268186 throughput (samples/sec): 317.45
2019-08-08 07:19:53,509 epoch 77 - iter 114/577 - loss 0.18565379 throughput (samples/sec): 319.55
2019-08-08 07:19:59,273 epoch 77 - iter 171/577 - loss 0.18877020 throughput (samples/sec): 321.63
2019-08-08 07:20:05,108 epoch 77 - iter 228/577 - loss 0.17891714 throughput (samples/sec): 317.67
2019-08-08 07:20:11,020 epoch 77 - iter 285/577 - loss 0.19422373 throughput (samples/sec): 313.21
2019-08-08 07:20:16,894 epoch 77 - iter 342/577 - loss 0.19794834 throughput (samples/sec): 315.14
2019-08-08 07:20:22,801 epoch 77 - iter 399/577 - loss 0.20112973 throughput (samples/sec): 313.53
2019-08-08 07:20:28,602 epoch 77 - iter 456/577 - loss 0.20602136 throughput (samples/sec): 319.70
2019-08-08 07:20:34,474 epoch 77 - iter 513/577 - loss 0.21059935 throughput (samples/sec): 315.52
2019-08-08 07:20:40,308 epoch 77 - iter 570/577 - loss 0.20479161 throughput (samples/sec): 317.51
2019-08-08 07:20:40,972 ----------------------------------------------------------------------------------------------------
2019-08-08 07:20:40,973 EPOCH 77 done: loss 0.2048 - lr 0.0063
2019-08-08 07:21:10,213 TEST : loss 0.8723264932632446 - score 0.9273
2019-08-08 07:21:10,376 BAD EPOCHS (no improvement): 0
2019-08-08 07:21:10,377 ----------------------------------------------------------------------------------------------------
2019-08-08 07:21:10,477 epoch 78 - iter 0/577 - loss 0.25363871 throughput (samples/sec): 18363.26
2019-08-08 07:21:16,305 epoch 78 - iter 57/577 - loss 0.24355766 throughput (samples/sec): 317.94
2019-08-08 07:21:22,084 epoch 78 - iter 114/577 - loss 0.21927916 throughput (samples/sec): 320.74
2019-08-08 07:21:27,973 epoch 78 - iter 171/577 - loss 0.21238954 throughput (samples/sec): 314.85
2019-08-08 07:21:33,748 epoch 78 - iter 228/577 - loss 0.20608441 throughput (samples/sec): 320.81
2019-08-08 07:21:39,712 epoch 78 - iter 285/577 - loss 0.20778398 throughput (samples/sec): 310.67
2019-08-08 07:21:45,505 epoch 78 - iter 342/577 - loss 0.21269467 throughput (samples/sec): 319.88
2019-08-08 07:21:51,384 epoch 78 - iter 399/577 - loss 0.22042250 throughput (samples/sec): 315.10
2019-08-08 07:21:57,209 epoch 78 - iter 456/577 - loss 0.22090451 throughput (samples/sec): 318.17
2019-08-08 07:22:03,127 epoch 78 - iter 513/577 - loss 0.21745324 throughput (samples/sec): 312.92
2019-08-08 07:22:09,078 epoch 78 - iter 570/577 - loss 0.21592784 throughput (samples/sec): 311.30
2019-08-08 07:22:09,719 ----------------------------------------------------------------------------------------------------
2019-08-08 07:22:09,719 EPOCH 78 done: loss 0.2159 - lr 0.0063
2019-08-08 07:22:39,059 TEST : loss 0.8717271685600281 - score 0.9273
2019-08-08 07:22:39,221 BAD EPOCHS (no improvement): 1
2019-08-08 07:22:39,222 ----------------------------------------------------------------------------------------------------
2019-08-08 07:22:39,339 epoch 79 - iter 0/577 - loss 0.15557355 throughput (samples/sec): 15721.85
2019-08-08 07:22:45,283 epoch 79 - iter 57/577 - loss 0.16979755 throughput (samples/sec): 311.61
2019-08-08 07:22:51,103 epoch 79 - iter 114/577 - loss 0.19037651 throughput (samples/sec): 318.45
2019-08-08 07:22:56,883 epoch 79 - iter 171/577 - loss 0.19423573 throughput (samples/sec): 320.84
2019-08-08 07:23:02,790 epoch 79 - iter 228/577 - loss 0.19337891 throughput (samples/sec): 313.84
2019-08-08 07:23:08,687 epoch 79 - iter 285/577 - loss 0.19515483 throughput (samples/sec): 314.36
2019-08-08 07:23:14,508 epoch 79 - iter 342/577 - loss 0.19813637 throughput (samples/sec): 318.35
2019-08-08 07:23:20,450 epoch 79 - iter 399/577 - loss 0.19770505 throughput (samples/sec): 311.67
2019-08-08 07:23:26,314 epoch 79 - iter 456/577 - loss 0.19967724 throughput (samples/sec): 315.84
2019-08-08 07:23:32,186 epoch 79 - iter 513/577 - loss 0.20255826 throughput (samples/sec): 315.44
2019-08-08 07:23:37,944 epoch 79 - iter 570/577 - loss 0.20252520 throughput (samples/sec): 321.74
2019-08-08 07:23:38,612 ----------------------------------------------------------------------------------------------------
2019-08-08 07:23:38,613 EPOCH 79 done: loss 0.2023 - lr 0.0063
2019-08-08 07:24:08,006 TEST : loss 0.8703242540359497 - score 0.9271
2019-08-08 07:24:08,188 BAD EPOCHS (no improvement): 0
2019-08-08 07:24:08,189 ----------------------------------------------------------------------------------------------------
2019-08-08 07:24:08,320 epoch 80 - iter 0/577 - loss 0.13991702 throughput (samples/sec): 14062.74
2019-08-08 07:24:14,180 epoch 80 - iter 57/577 - loss 0.21267744 throughput (samples/sec): 316.39
2019-08-08 07:24:20,073 epoch 80 - iter 114/577 - loss 0.19958918 throughput (samples/sec): 314.57
2019-08-08 07:24:26,090 epoch 80 - iter 171/577 - loss 0.21339646 throughput (samples/sec): 307.88
2019-08-08 07:24:31,926 epoch 80 - iter 228/577 - loss 0.21666421 throughput (samples/sec): 317.60
2019-08-08 07:24:37,811 epoch 80 - iter 285/577 - loss 0.21574868 throughput (samples/sec): 314.95
2019-08-08 07:24:43,684 epoch 80 - iter 342/577 - loss 0.21867622 throughput (samples/sec): 315.62
2019-08-08 07:24:49,641 epoch 80 - iter 399/577 - loss 0.21835260 throughput (samples/sec): 311.02
2019-08-08 07:24:55,541 epoch 80 - iter 456/577 - loss 0.21954131 throughput (samples/sec): 314.09
2019-08-08 07:25:01,341 epoch 80 - iter 513/577 - loss 0.21684841 throughput (samples/sec): 319.36
2019-08-08 07:25:07,324 epoch 80 - iter 570/577 - loss 0.21750489 throughput (samples/sec): 309.63
2019-08-08 07:25:07,982 ----------------------------------------------------------------------------------------------------
2019-08-08 07:25:07,982 EPOCH 80 done: loss 0.2162 - lr 0.0063
2019-08-08 07:25:37,357 TEST : loss 0.8701008558273315 - score 0.9274
2019-08-08 07:25:37,519 BAD EPOCHS (no improvement): 1
2019-08-08 07:25:37,520 ----------------------------------------------------------------------------------------------------
2019-08-08 07:25:37,616 epoch 81 - iter 0/577 - loss 0.09959310 throughput (samples/sec): 19288.68
2019-08-08 07:25:43,549 epoch 81 - iter 57/577 - loss 0.16094904 throughput (samples/sec): 312.10
2019-08-08 07:25:49,543 epoch 81 - iter 114/577 - loss 0.18561541 throughput (samples/sec): 309.08
2019-08-08 07:25:55,307 epoch 81 - iter 171/577 - loss 0.19086200 throughput (samples/sec): 321.60
2019-08-08 07:26:01,215 epoch 81 - iter 228/577 - loss 0.19085825 throughput (samples/sec): 313.79
2019-08-08 07:26:07,060 epoch 81 - iter 285/577 - loss 0.19561139 throughput (samples/sec): 316.92
2019-08-08 07:26:12,893 epoch 81 - iter 342/577 - loss 0.20032731 throughput (samples/sec): 317.66
2019-08-08 07:26:18,752 epoch 81 - iter 399/577 - loss 0.19650871 throughput (samples/sec): 316.12
2019-08-08 07:26:24,825 epoch 81 - iter 456/577 - loss 0.19833002 throughput (samples/sec): 304.92
2019-08-08 07:26:30,548 epoch 81 - iter 513/577 - loss 0.19843027 throughput (samples/sec): 323.99
2019-08-08 07:26:36,339 epoch 81 - iter 570/577 - loss 0.19930775 throughput (samples/sec): 320.30
2019-08-08 07:26:37,025 ----------------------------------------------------------------------------------------------------
2019-08-08 07:26:37,025 EPOCH 81 done: loss 0.1988 - lr 0.0063
2019-08-08 07:27:06,459 TEST : loss 0.8724620342254639 - score 0.9275
2019-08-08 07:27:06,621 BAD EPOCHS (no improvement): 0
2019-08-08 07:27:06,622 ----------------------------------------------------------------------------------------------------
2019-08-08 07:27:06,721 epoch 82 - iter 0/577 - loss 0.15282026 throughput (samples/sec): 18745.77
2019-08-08 07:27:12,461 epoch 82 - iter 57/577 - loss 0.22451782 throughput (samples/sec): 323.08
2019-08-08 07:27:18,203 epoch 82 - iter 114/577 - loss 0.21423058 throughput (samples/sec): 323.01
2019-08-08 07:27:24,094 epoch 82 - iter 171/577 - loss 0.22751179 throughput (samples/sec): 314.43
2019-08-08 07:27:29,948 epoch 82 - iter 228/577 - loss 0.22113414 throughput (samples/sec): 316.43
2019-08-08 07:27:35,793 epoch 82 - iter 285/577 - loss 0.21731106 throughput (samples/sec): 316.98
2019-08-08 07:27:41,727 epoch 82 - iter 342/577 - loss 0.20709725 throughput (samples/sec): 312.12
2019-08-08 07:27:47,550 epoch 82 - iter 399/577 - loss 0.21396467 throughput (samples/sec): 318.29
2019-08-08 07:27:53,506 epoch 82 - iter 456/577 - loss 0.21118665 throughput (samples/sec): 311.06
2019-08-08 07:27:59,572 epoch 82 - iter 513/577 - loss 0.20985322 throughput (samples/sec): 305.34
2019-08-08 07:28:05,387 epoch 82 - iter 570/577 - loss 0.20936445 throughput (samples/sec): 318.67
2019-08-08 07:28:06,053 ----------------------------------------------------------------------------------------------------
2019-08-08 07:28:06,053 EPOCH 82 done: loss 0.2082 - lr 0.0063
2019-08-08 07:28:35,469 TEST : loss 0.873591423034668 - score 0.9276
2019-08-08 07:28:35,631 BAD EPOCHS (no improvement): 1
2019-08-08 07:28:35,631 ----------------------------------------------------------------------------------------------------
2019-08-08 07:28:35,738 epoch 83 - iter 0/577 - loss 0.06115478 throughput (samples/sec): 17354.28
2019-08-08 07:28:41,354 epoch 83 - iter 57/577 - loss 0.17135101 throughput (samples/sec): 330.13
2019-08-08 07:28:47,170 epoch 83 - iter 114/577 - loss 0.18584340 throughput (samples/sec): 318.73
2019-08-08 07:28:53,061 epoch 83 - iter 171/577 - loss 0.18612883 throughput (samples/sec): 314.29
2019-08-08 07:28:58,784 epoch 83 - iter 228/577 - loss 0.18826015 throughput (samples/sec): 323.75
2019-08-08 07:29:04,716 epoch 83 - iter 285/577 - loss 0.18852467 throughput (samples/sec): 312.37
2019-08-08 07:29:10,643 epoch 83 - iter 342/577 - loss 0.18713491 throughput (samples/sec): 312.55
2019-08-08 07:29:16,541 epoch 83 - iter 399/577 - loss 0.18764420 throughput (samples/sec): 313.92
2019-08-08 07:29:22,585 epoch 83 - iter 456/577 - loss 0.18914578 throughput (samples/sec): 306.27
2019-08-08 07:29:28,501 epoch 83 - iter 513/577 - loss 0.18838655 throughput (samples/sec): 312.96
2019-08-08 07:29:34,289 epoch 83 - iter 570/577 - loss 0.18958505 throughput (samples/sec): 320.18
2019-08-08 07:29:34,922 ----------------------------------------------------------------------------------------------------
2019-08-08 07:29:34,922 EPOCH 83 done: loss 0.1907 - lr 0.0063
2019-08-08 07:30:04,350 TEST : loss 0.8740469217300415 - score 0.9273
2019-08-08 07:30:04,511 BAD EPOCHS (no improvement): 0
2019-08-08 07:30:04,512 ----------------------------------------------------------------------------------------------------
2019-08-08 07:30:04,606 epoch 84 - iter 0/577 - loss 0.22753194 throughput (samples/sec): 19715.62
2019-08-08 07:30:10,354 epoch 84 - iter 57/577 - loss 0.19968267 throughput (samples/sec): 322.26
2019-08-08 07:30:16,116 epoch 84 - iter 114/577 - loss 0.21566210 throughput (samples/sec): 321.52
2019-08-08 07:30:21,993 epoch 84 - iter 171/577 - loss 0.22045002 throughput (samples/sec): 315.14
2019-08-08 07:30:27,879 epoch 84 - iter 228/577 - loss 0.21611692 throughput (samples/sec): 314.68
2019-08-08 07:30:33,669 epoch 84 - iter 285/577 - loss 0.20585827 throughput (samples/sec): 319.96
2019-08-08 07:30:39,669 epoch 84 - iter 342/577 - loss 0.20243517 throughput (samples/sec): 308.71
2019-08-08 07:30:45,470 epoch 84 - iter 399/577 - loss 0.20436986 throughput (samples/sec): 319.74
2019-08-08 07:30:51,423 epoch 84 - iter 456/577 - loss 0.20195254 throughput (samples/sec): 311.04
2019-08-08 07:30:57,244 epoch 84 - iter 513/577 - loss 0.20232347 throughput (samples/sec): 318.34
2019-08-08 07:31:03,065 epoch 84 - iter 570/577 - loss 0.20085565 throughput (samples/sec): 318.76
2019-08-08 07:31:03,721 ----------------------------------------------------------------------------------------------------
2019-08-08 07:31:03,722 EPOCH 84 done: loss 0.2013 - lr 0.0063
2019-08-08 07:31:33,166 TEST : loss 0.8716253042221069 - score 0.9278
2019-08-08 07:31:33,330 BAD EPOCHS (no improvement): 1
2019-08-08 07:31:33,331 ----------------------------------------------------------------------------------------------------
2019-08-08 07:31:33,429 epoch 85 - iter 0/577 - loss 0.01619878 throughput (samples/sec): 18868.43
2019-08-08 07:31:39,293 epoch 85 - iter 57/577 - loss 0.17529036 throughput (samples/sec): 315.93
2019-08-08 07:31:45,062 epoch 85 - iter 114/577 - loss 0.20639619 throughput (samples/sec): 321.18
2019-08-08 07:31:50,766 epoch 85 - iter 171/577 - loss 0.21050864 throughput (samples/sec): 324.91
2019-08-08 07:31:56,661 epoch 85 - iter 228/577 - loss 0.20592269 throughput (samples/sec): 314.21
2019-08-08 07:32:02,531 epoch 85 - iter 285/577 - loss 0.19956019 throughput (samples/sec): 315.39
2019-08-08 07:32:08,489 epoch 85 - iter 342/577 - loss 0.19639894 throughput (samples/sec): 310.93
2019-08-08 07:32:14,345 epoch 85 - iter 399/577 - loss 0.19134219 throughput (samples/sec): 316.19
2019-08-08 07:32:20,205 epoch 85 - iter 456/577 - loss 0.19334146 throughput (samples/sec): 316.17
2019-08-08 07:32:26,201 epoch 85 - iter 513/577 - loss 0.19304062 throughput (samples/sec): 308.93
2019-08-08 07:32:32,051 epoch 85 - iter 570/577 - loss 0.19766407 throughput (samples/sec): 316.55
2019-08-08 07:32:32,742 ----------------------------------------------------------------------------------------------------
2019-08-08 07:32:32,743 EPOCH 85 done: loss 0.1982 - lr 0.0063
2019-08-08 07:33:02,137 TEST : loss 0.8770170211791992 - score 0.9273
2019-08-08 07:33:02,298 BAD EPOCHS (no improvement): 2
2019-08-08 07:33:02,299 ----------------------------------------------------------------------------------------------------
2019-08-08 07:33:02,407 epoch 86 - iter 0/577 - loss 0.40518877 throughput (samples/sec): 16995.59
2019-08-08 07:33:08,136 epoch 86 - iter 57/577 - loss 0.22284082 throughput (samples/sec): 323.52
2019-08-08 07:33:13,979 epoch 86 - iter 114/577 - loss 0.19834722 throughput (samples/sec): 316.99
2019-08-08 07:33:19,973 epoch 86 - iter 171/577 - loss 0.19812163 throughput (samples/sec): 308.78
2019-08-08 07:33:25,839 epoch 86 - iter 228/577 - loss 0.19525009 throughput (samples/sec): 315.67
2019-08-08 07:33:31,635 epoch 86 - iter 285/577 - loss 0.19701156 throughput (samples/sec): 319.85
2019-08-08 07:33:37,393 epoch 86 - iter 342/577 - loss 0.20160606 throughput (samples/sec): 321.85
2019-08-08 07:33:43,209 epoch 86 - iter 399/577 - loss 0.20507819 throughput (samples/sec): 318.74
2019-08-08 07:33:49,005 epoch 86 - iter 456/577 - loss 0.20184908 throughput (samples/sec): 319.65
2019-08-08 07:33:55,023 epoch 86 - iter 513/577 - loss 0.20330623 throughput (samples/sec): 308.05
2019-08-08 07:34:00,888 epoch 86 - iter 570/577 - loss 0.20397292 throughput (samples/sec): 315.81
2019-08-08 07:34:01,532 ----------------------------------------------------------------------------------------------------
2019-08-08 07:34:01,532 EPOCH 86 done: loss 0.2046 - lr 0.0063
2019-08-08 07:34:30,914 TEST : loss 0.8693020343780518 - score 0.928
2019-08-08 07:34:31,075 BAD EPOCHS (no improvement): 3
2019-08-08 07:34:31,076 ----------------------------------------------------------------------------------------------------
2019-08-08 07:34:31,192 epoch 87 - iter 0/577 - loss 0.04996124 throughput (samples/sec): 15907.27
2019-08-08 07:34:37,137 epoch 87 - iter 57/577 - loss 0.18814341 throughput (samples/sec): 311.23
2019-08-08 07:34:42,840 epoch 87 - iter 114/577 - loss 0.18548200 throughput (samples/sec): 325.10
2019-08-08 07:34:48,773 epoch 87 - iter 171/577 - loss 0.20416448 throughput (samples/sec): 312.17
2019-08-08 07:34:54,511 epoch 87 - iter 228/577 - loss 0.19735510 throughput (samples/sec): 323.05
2019-08-08 07:35:00,208 epoch 87 - iter 285/577 - loss 0.20047900 throughput (samples/sec): 325.44
2019-08-08 07:35:06,234 epoch 87 - iter 342/577 - loss 0.20252956 throughput (samples/sec): 307.38
2019-08-08 07:35:12,013 epoch 87 - iter 399/577 - loss 0.19972967 throughput (samples/sec): 320.53
2019-08-08 07:35:17,904 epoch 87 - iter 456/577 - loss 0.20222565 throughput (samples/sec): 314.70
2019-08-08 07:35:23,824 epoch 87 - iter 513/577 - loss 0.20191437 throughput (samples/sec): 313.00
2019-08-08 07:35:29,759 epoch 87 - iter 570/577 - loss 0.19957294 throughput (samples/sec): 311.87
2019-08-08 07:35:30,424 ----------------------------------------------------------------------------------------------------
2019-08-08 07:35:30,424 EPOCH 87 done: loss 0.2002 - lr 0.0063
2019-08-08 07:35:59,803 TEST : loss 0.8711224794387817 - score 0.9279
2019-08-08 07:35:59,965 BAD EPOCHS (no improvement): 4
2019-08-08 07:35:59,966 ----------------------------------------------------------------------------------------------------
2019-08-08 07:36:00,072 epoch 88 - iter 0/577 - loss 0.22863930 throughput (samples/sec): 17595.04
2019-08-08 07:36:05,920 epoch 88 - iter 57/577 - loss 0.24123169 throughput (samples/sec): 316.87
2019-08-08 07:36:11,679 epoch 88 - iter 114/577 - loss 0.20269390 throughput (samples/sec): 321.94
2019-08-08 07:36:17,664 epoch 88 - iter 171/577 - loss 0.20212227 throughput (samples/sec): 309.26
2019-08-08 07:36:23,653 epoch 88 - iter 228/577 - loss 0.19674816 throughput (samples/sec): 309.27
2019-08-08 07:36:29,679 epoch 88 - iter 285/577 - loss 0.20686443 throughput (samples/sec): 307.32
2019-08-08 07:36:35,485 epoch 88 - iter 342/577 - loss 0.20759085 throughput (samples/sec): 319.16
2019-08-08 07:36:41,361 epoch 88 - iter 399/577 - loss 0.20647558 throughput (samples/sec): 315.39
2019-08-08 07:36:47,269 epoch 88 - iter 456/577 - loss 0.20797940 throughput (samples/sec): 313.91
2019-08-08 07:36:53,277 epoch 88 - iter 513/577 - loss 0.20571457 throughput (samples/sec): 308.41
2019-08-08 07:36:58,971 epoch 88 - iter 570/577 - loss 0.20317375 throughput (samples/sec): 325.59
2019-08-08 07:36:59,658 ----------------------------------------------------------------------------------------------------
2019-08-08 07:36:59,658 EPOCH 88 done: loss 0.2035 - lr 0.0031
2019-08-08 07:37:29,007 TEST : loss 0.8718320727348328 - score 0.928
2019-08-08 07:37:29,166 BAD EPOCHS (no improvement): 1
2019-08-08 07:37:29,167 ----------------------------------------------------------------------------------------------------
2019-08-08 07:37:29,256 epoch 89 - iter 0/577 - loss 0.03557968 throughput (samples/sec): 20935.14
2019-08-08 07:37:35,067 epoch 89 - iter 57/577 - loss 0.17131066 throughput (samples/sec): 318.98
2019-08-08 07:37:40,954 epoch 89 - iter 114/577 - loss 0.20316389 throughput (samples/sec): 314.66
2019-08-08 07:37:46,769 epoch 89 - iter 171/577 - loss 0.22265008 throughput (samples/sec): 318.61
2019-08-08 07:37:52,634 epoch 89 - iter 228/577 - loss 0.22188142 throughput (samples/sec): 315.82
2019-08-08 07:37:58,437 epoch 89 - iter 285/577 - loss 0.22109918 throughput (samples/sec): 319.16
2019-08-08 07:38:04,289 epoch 89 - iter 342/577 - loss 0.21780152 throughput (samples/sec): 316.99
2019-08-08 07:38:10,127 epoch 89 - iter 399/577 - loss 0.21756909 throughput (samples/sec): 317.35
2019-08-08 07:38:16,107 epoch 89 - iter 456/577 - loss 0.21620800 throughput (samples/sec): 309.77
2019-08-08 07:38:22,151 epoch 89 - iter 513/577 - loss 0.21104935 throughput (samples/sec): 306.55
2019-08-08 07:38:28,023 epoch 89 - iter 570/577 - loss 0.20568682 throughput (samples/sec): 315.43
2019-08-08 07:38:28,720 ----------------------------------------------------------------------------------------------------
2019-08-08 07:38:28,720 EPOCH 89 done: loss 0.2046 - lr 0.0031
2019-08-08 07:38:58,104 TEST : loss 0.8737925887107849 - score 0.9277
2019-08-08 07:38:58,261 BAD EPOCHS (no improvement): 2
2019-08-08 07:38:58,262 ----------------------------------------------------------------------------------------------------
2019-08-08 07:38:58,362 epoch 90 - iter 0/577 - loss 0.13899943 throughput (samples/sec): 18418.66
2019-08-08 07:39:04,257 epoch 90 - iter 57/577 - loss 0.22094629 throughput (samples/sec): 314.25
2019-08-08 07:39:10,272 epoch 90 - iter 114/577 - loss 0.19688996 throughput (samples/sec): 307.99
2019-08-08 07:39:16,100 epoch 90 - iter 171/577 - loss 0.20705837 throughput (samples/sec): 318.02
2019-08-08 07:39:22,074 epoch 90 - iter 228/577 - loss 0.19892906 throughput (samples/sec): 310.04
2019-08-08 07:39:27,937 epoch 90 - iter 285/577 - loss 0.19936481 throughput (samples/sec): 316.02
2019-08-08 07:39:33,835 epoch 90 - iter 342/577 - loss 0.19617805 throughput (samples/sec): 313.97
2019-08-08 07:39:39,507 epoch 90 - iter 399/577 - loss 0.19361044 throughput (samples/sec): 326.87
2019-08-08 07:39:45,280 epoch 90 - iter 456/577 - loss 0.19314022 throughput (samples/sec): 321.06
2019-08-08 07:39:51,155 epoch 90 - iter 513/577 - loss 0.19039524 throughput (samples/sec): 315.15
2019-08-08 07:39:56,890 epoch 90 - iter 570/577 - loss 0.19230565 throughput (samples/sec): 323.54
2019-08-08 07:39:57,600 ----------------------------------------------------------------------------------------------------
2019-08-08 07:39:57,600 EPOCH 90 done: loss 0.1930 - lr 0.0031
2019-08-08 07:40:26,935 TEST : loss 0.8728114366531372 - score 0.9275
2019-08-08 07:40:27,094 BAD EPOCHS (no improvement): 3
2019-08-08 07:40:27,095 ----------------------------------------------------------------------------------------------------
2019-08-08 07:40:27,206 epoch 91 - iter 0/577 - loss 0.22624004 throughput (samples/sec): 16666.25
2019-08-08 07:40:33,047 epoch 91 - iter 57/577 - loss 0.14456346 throughput (samples/sec): 317.41
2019-08-08 07:40:38,788 epoch 91 - iter 114/577 - loss 0.15307779 throughput (samples/sec): 322.94
2019-08-08 07:40:44,643 epoch 91 - iter 171/577 - loss 0.17115146 throughput (samples/sec): 316.50
2019-08-08 07:40:50,392 epoch 91 - iter 228/577 - loss 0.18104187 throughput (samples/sec): 322.36
2019-08-08 07:40:56,263 epoch 91 - iter 285/577 - loss 0.18932841 throughput (samples/sec): 315.37
2019-08-08 07:41:02,245 epoch 91 - iter 342/577 - loss 0.19083866 throughput (samples/sec): 309.52
2019-08-08 07:41:08,150 epoch 91 - iter 399/577 - loss 0.18777313 throughput (samples/sec): 313.79
2019-08-08 07:41:13,962 epoch 91 - iter 456/577 - loss 0.18827993 throughput (samples/sec): 318.88
2019-08-08 07:41:19,812 epoch 91 - iter 513/577 - loss 0.19305749 throughput (samples/sec): 316.85
2019-08-08 07:41:25,666 epoch 91 - iter 570/577 - loss 0.19216386 throughput (samples/sec): 316.57
2019-08-08 07:41:26,356 ----------------------------------------------------------------------------------------------------
2019-08-08 07:41:26,356 EPOCH 91 done: loss 0.1916 - lr 0.0031
2019-08-08 07:41:55,617 TEST : loss 0.87270587682724 - score 0.9274
2019-08-08 07:41:55,789 BAD EPOCHS (no improvement): 4
2019-08-08 07:41:55,790 ----------------------------------------------------------------------------------------------------
2019-08-08 07:41:55,915 epoch 92 - iter 0/577 - loss 0.09371054 throughput (samples/sec): 14782.52
2019-08-08 07:42:01,773 epoch 92 - iter 57/577 - loss 0.16740688 throughput (samples/sec): 316.62
2019-08-08 07:42:07,552 epoch 92 - iter 114/577 - loss 0.16953307 throughput (samples/sec): 321.05
2019-08-08 07:42:13,317 epoch 92 - iter 171/577 - loss 0.17428574 throughput (samples/sec): 321.51
2019-08-08 07:42:19,208 epoch 92 - iter 228/577 - loss 0.17992190 throughput (samples/sec): 314.80
2019-08-08 07:42:24,964 epoch 92 - iter 285/577 - loss 0.18174859 throughput (samples/sec): 322.20
2019-08-08 07:42:30,646 epoch 92 - iter 342/577 - loss 0.17928248 throughput (samples/sec): 326.35
2019-08-08 07:42:36,543 epoch 92 - iter 399/577 - loss 0.18713829 throughput (samples/sec): 314.22
2019-08-08 07:42:42,615 epoch 92 - iter 456/577 - loss 0.18992412 throughput (samples/sec): 305.24
2019-08-08 07:42:48,672 epoch 92 - iter 513/577 - loss 0.18693839 throughput (samples/sec): 305.79
2019-08-08 07:42:54,559 epoch 92 - iter 570/577 - loss 0.19096192 throughput (samples/sec): 314.68
2019-08-08 07:42:55,232 ----------------------------------------------------------------------------------------------------
2019-08-08 07:42:55,232 EPOCH 92 done: loss 0.1904 - lr 0.0016
2019-08-08 07:43:24,548 TEST : loss 0.8734557628631592 - score 0.9275
2019-08-08 07:43:24,722 BAD EPOCHS (no improvement): 0
2019-08-08 07:43:24,723 ----------------------------------------------------------------------------------------------------
2019-08-08 07:43:24,824 epoch 93 - iter 0/577 - loss 0.12137386 throughput (samples/sec): 18411.79
2019-08-08 07:43:30,782 epoch 93 - iter 57/577 - loss 0.20466540 throughput (samples/sec): 310.98
2019-08-08 07:43:36,790 epoch 93 - iter 114/577 - loss 0.23065335 throughput (samples/sec): 308.29
2019-08-08 07:43:42,658 epoch 93 - iter 171/577 - loss 0.22527952 throughput (samples/sec): 315.88
2019-08-08 07:43:48,549 epoch 93 - iter 228/577 - loss 0.22580126 throughput (samples/sec): 314.81
2019-08-08 07:43:54,349 epoch 93 - iter 285/577 - loss 0.22195676 throughput (samples/sec): 319.71
2019-08-08 07:44:00,130 epoch 93 - iter 342/577 - loss 0.21438842 throughput (samples/sec): 320.74
2019-08-08 07:44:06,066 epoch 93 - iter 399/577 - loss 0.20937587 throughput (samples/sec): 312.06
2019-08-08 07:44:11,814 epoch 93 - iter 456/577 - loss 0.20459418 throughput (samples/sec): 322.18
2019-08-08 07:44:17,561 epoch 93 - iter 513/577 - loss 0.20741546 throughput (samples/sec): 322.64
2019-08-08 07:44:23,550 epoch 93 - iter 570/577 - loss 0.20997001 throughput (samples/sec): 309.09
2019-08-08 07:44:24,228 ----------------------------------------------------------------------------------------------------
2019-08-08 07:44:24,228 EPOCH 93 done: loss 0.2111 - lr 0.0016
2019-08-08 07:44:53,493 TEST : loss 0.8720453381538391 - score 0.9277
2019-08-08 07:44:53,668 BAD EPOCHS (no improvement): 1
2019-08-08 07:44:53,669 ----------------------------------------------------------------------------------------------------
2019-08-08 07:44:53,759 epoch 94 - iter 0/577 - loss 0.16335103 throughput (samples/sec): 20592.08
2019-08-08 07:44:59,676 epoch 94 - iter 57/577 - loss 0.23581713 throughput (samples/sec): 313.11
2019-08-08 07:45:05,378 epoch 94 - iter 114/577 - loss 0.19166114 throughput (samples/sec): 324.96
2019-08-08 07:45:11,181 epoch 94 - iter 171/577 - loss 0.20073855 throughput (samples/sec): 319.38
2019-08-08 07:45:16,906 epoch 94 - iter 228/577 - loss 0.20607896 throughput (samples/sec): 323.67
2019-08-08 07:45:22,734 epoch 94 - iter 285/577 - loss 0.20346819 throughput (samples/sec): 318.00
2019-08-08 07:45:28,692 epoch 94 - iter 342/577 - loss 0.20820167 throughput (samples/sec): 311.18
2019-08-08 07:45:34,776 epoch 94 - iter 399/577 - loss 0.20750473 throughput (samples/sec): 304.42
2019-08-08 07:45:40,675 epoch 94 - iter 456/577 - loss 0.20317068 throughput (samples/sec): 314.12
2019-08-08 07:45:46,626 epoch 94 - iter 513/577 - loss 0.20280569 throughput (samples/sec): 311.26
2019-08-08 07:45:52,410 epoch 94 - iter 570/577 - loss 0.20336805 throughput (samples/sec): 320.43
2019-08-08 07:45:53,100 ----------------------------------------------------------------------------------------------------
2019-08-08 07:45:53,100 EPOCH 94 done: loss 0.2036 - lr 0.0016
2019-08-08 07:46:22,300 TEST : loss 0.8723781704902649 - score 0.9276
2019-08-08 07:46:22,472 BAD EPOCHS (no improvement): 2
2019-08-08 07:46:22,472 ----------------------------------------------------------------------------------------------------
2019-08-08 07:46:22,567 epoch 95 - iter 0/577 - loss 0.12295294 throughput (samples/sec): 19639.40
2019-08-08 07:46:28,475 epoch 95 - iter 57/577 - loss 0.17426180 throughput (samples/sec): 313.79
2019-08-08 07:46:34,375 epoch 95 - iter 114/577 - loss 0.18244570 throughput (samples/sec): 314.23
2019-08-08 07:46:40,271 epoch 95 - iter 171/577 - loss 0.17739881 throughput (samples/sec): 314.41
2019-08-08 07:46:46,252 epoch 95 - iter 228/577 - loss 0.18748038 throughput (samples/sec): 309.78
2019-08-08 07:46:52,022 epoch 95 - iter 285/577 - loss 0.19252143 throughput (samples/sec): 321.27
2019-08-08 07:46:57,890 epoch 95 - iter 342/577 - loss 0.19231622 throughput (samples/sec): 315.82
2019-08-08 07:47:03,783 epoch 95 - iter 399/577 - loss 0.18689039 throughput (samples/sec): 314.49
2019-08-08 07:47:09,753 epoch 95 - iter 456/577 - loss 0.18690909 throughput (samples/sec): 310.37
2019-08-08 07:47:15,613 epoch 95 - iter 513/577 - loss 0.18687881 throughput (samples/sec): 316.12
2019-08-08 07:47:21,481 epoch 95 - iter 570/577 - loss 0.19015737 throughput (samples/sec): 315.78
2019-08-08 07:47:22,168 ----------------------------------------------------------------------------------------------------
2019-08-08 07:47:22,168 EPOCH 95 done: loss 0.1903 - lr 0.0016
2019-08-08 07:47:51,426 TEST : loss 0.8742213249206543 - score 0.9275
2019-08-08 07:47:51,594 BAD EPOCHS (no improvement): 0
2019-08-08 07:47:51,595 ----------------------------------------------------------------------------------------------------
2019-08-08 07:47:51,702 epoch 96 - iter 0/577 - loss 0.21460849 throughput (samples/sec): 17258.37
2019-08-08 07:47:57,668 epoch 96 - iter 57/577 - loss 0.19449719 throughput (samples/sec): 310.53
2019-08-08 07:48:03,392 epoch 96 - iter 114/577 - loss 0.21597073 throughput (samples/sec): 323.98
2019-08-08 07:48:09,264 epoch 96 - iter 171/577 - loss 0.21891204 throughput (samples/sec): 315.75
2019-08-08 07:48:15,207 epoch 96 - iter 228/577 - loss 0.22197158 throughput (samples/sec): 311.66
2019-08-08 07:48:21,082 epoch 96 - iter 285/577 - loss 0.22163763 throughput (samples/sec): 315.45
2019-08-08 07:48:27,031 epoch 96 - iter 342/577 - loss 0.21690753 throughput (samples/sec): 311.43
2019-08-08 07:48:32,850 epoch 96 - iter 399/577 - loss 0.21219251 throughput (samples/sec): 318.62
2019-08-08 07:48:38,677 epoch 96 - iter 456/577 - loss 0.21061146 throughput (samples/sec): 318.14
2019-08-08 07:48:44,603 epoch 96 - iter 513/577 - loss 0.21173374 throughput (samples/sec): 312.70
2019-08-08 07:48:50,415 epoch 96 - iter 570/577 - loss 0.21046159 throughput (samples/sec): 318.80
2019-08-08 07:48:51,095 ----------------------------------------------------------------------------------------------------
2019-08-08 07:48:51,095 EPOCH 96 done: loss 0.2099 - lr 0.0016
2019-08-08 07:49:20,353 TEST : loss 0.8751494884490967 - score 0.9277
2019-08-08 07:49:20,524 BAD EPOCHS (no improvement): 1
2019-08-08 07:49:20,525 ----------------------------------------------------------------------------------------------------
2019-08-08 07:49:20,630 epoch 97 - iter 0/577 - loss 0.35068691 throughput (samples/sec): 17601.31
2019-08-08 07:49:26,509 epoch 97 - iter 57/577 - loss 0.17611631 throughput (samples/sec): 315.30
2019-08-08 07:49:32,555 epoch 97 - iter 114/577 - loss 0.17707981 throughput (samples/sec): 306.43
2019-08-08 07:49:38,450 epoch 97 - iter 171/577 - loss 0.18316287 throughput (samples/sec): 314.44
2019-08-08 07:49:44,218 epoch 97 - iter 228/577 - loss 0.18121205 throughput (samples/sec): 321.32
2019-08-08 07:49:50,152 epoch 97 - iter 285/577 - loss 0.17601311 throughput (samples/sec): 312.27
2019-08-08 07:49:55,988 epoch 97 - iter 342/577 - loss 0.18056688 throughput (samples/sec): 317.67
2019-08-08 07:50:01,822 epoch 97 - iter 399/577 - loss 0.18030307 throughput (samples/sec): 317.79
2019-08-08 07:50:07,661 epoch 97 - iter 456/577 - loss 0.18270814 throughput (samples/sec): 317.22
2019-08-08 07:50:13,570 epoch 97 - iter 513/577 - loss 0.18719054 throughput (samples/sec): 313.42
2019-08-08 07:50:19,352 epoch 97 - iter 570/577 - loss 0.19332650 throughput (samples/sec): 320.54
2019-08-08 07:50:20,032 ----------------------------------------------------------------------------------------------------
2019-08-08 07:50:20,032 EPOCH 97 done: loss 0.1929 - lr 0.0016
2019-08-08 07:50:49,239 TEST : loss 0.8753471374511719 - score 0.9276
2019-08-08 07:50:49,410 BAD EPOCHS (no improvement): 2
2019-08-08 07:50:49,411 ----------------------------------------------------------------------------------------------------
2019-08-08 07:50:49,525 epoch 98 - iter 0/577 - loss 0.14779150 throughput (samples/sec): 16144.06
2019-08-08 07:50:55,451 epoch 98 - iter 57/577 - loss 0.19480498 throughput (samples/sec): 312.79
2019-08-08 07:51:01,327 epoch 98 - iter 114/577 - loss 0.19651301 throughput (samples/sec): 315.35
2019-08-08 07:51:07,214 epoch 98 - iter 171/577 - loss 0.19704873 throughput (samples/sec): 314.49
2019-08-08 07:51:13,091 epoch 98 - iter 228/577 - loss 0.19150062 throughput (samples/sec): 315.37
2019-08-08 07:51:18,931 epoch 98 - iter 285/577 - loss 0.19062671 throughput (samples/sec): 317.23
2019-08-08 07:51:24,890 epoch 98 - iter 342/577 - loss 0.18971523 throughput (samples/sec): 310.86
2019-08-08 07:51:30,947 epoch 98 - iter 399/577 - loss 0.19311131 throughput (samples/sec): 305.62
2019-08-08 07:51:36,730 epoch 98 - iter 456/577 - loss 0.19711491 throughput (samples/sec): 320.22
2019-08-08 07:51:42,556 epoch 98 - iter 513/577 - loss 0.19635953 throughput (samples/sec): 318.01
2019-08-08 07:51:48,321 epoch 98 - iter 570/577 - loss 0.19676512 throughput (samples/sec): 321.36
2019-08-08 07:51:48,988 ----------------------------------------------------------------------------------------------------
2019-08-08 07:51:48,988 EPOCH 98 done: loss 0.1961 - lr 0.0016
2019-08-08 07:52:18,317 TEST : loss 0.8737627863883972 - score 0.9275
2019-08-08 07:52:18,488 BAD EPOCHS (no improvement): 3
2019-08-08 07:52:18,489 ----------------------------------------------------------------------------------------------------
2019-08-08 07:52:18,599 epoch 99 - iter 0/577 - loss 0.09119320 throughput (samples/sec): 16807.18
2019-08-08 07:52:24,586 epoch 99 - iter 57/577 - loss 0.18903756 throughput (samples/sec): 309.68
2019-08-08 07:52:30,318 epoch 99 - iter 114/577 - loss 0.19738373 throughput (samples/sec): 323.52
2019-08-08 07:52:36,037 epoch 99 - iter 171/577 - loss 0.20655580 throughput (samples/sec): 324.25
2019-08-08 07:52:41,711 epoch 99 - iter 228/577 - loss 0.20411832 throughput (samples/sec): 327.11
2019-08-08 07:52:47,482 epoch 99 - iter 285/577 - loss 0.20156956 throughput (samples/sec): 321.07
2019-08-08 07:52:53,448 epoch 99 - iter 342/577 - loss 0.19868697 throughput (samples/sec): 310.56
2019-08-08 07:52:59,180 epoch 99 - iter 399/577 - loss 0.19958611 throughput (samples/sec): 323.43
2019-08-08 07:53:05,146 epoch 99 - iter 456/577 - loss 0.20054653 throughput (samples/sec): 310.38
2019-08-08 07:53:10,973 epoch 99 - iter 513/577 - loss 0.20130976 throughput (samples/sec): 318.10
2019-08-08 07:53:16,967 epoch 99 - iter 570/577 - loss 0.20016878 throughput (samples/sec): 309.52
2019-08-08 07:53:17,655 ----------------------------------------------------------------------------------------------------
2019-08-08 07:53:17,656 EPOCH 99 done: loss 0.2001 - lr 0.0016
2019-08-08 07:53:46,963 TEST : loss 0.8742904663085938 - score 0.9276
2019-08-08 07:53:47,139 BAD EPOCHS (no improvement): 4
2019-08-08 07:53:47,140 ----------------------------------------------------------------------------------------------------
2019-08-08 07:53:47,249 epoch 100 - iter 0/577 - loss 0.25058126 throughput (samples/sec): 17004.99
2019-08-08 07:53:53,266 epoch 100 - iter 57/577 - loss 0.19127637 throughput (samples/sec): 308.40
2019-08-08 07:53:59,076 epoch 100 - iter 114/577 - loss 0.20282534 throughput (samples/sec): 319.50
2019-08-08 07:54:05,071 epoch 100 - iter 171/577 - loss 0.19669075 throughput (samples/sec): 309.49
2019-08-08 07:54:10,845 epoch 100 - iter 228/577 - loss 0.20371593 throughput (samples/sec): 321.61
2019-08-08 07:54:16,639 epoch 100 - iter 285/577 - loss 0.19906274 throughput (samples/sec): 319.91
2019-08-08 07:54:22,694 epoch 100 - iter 342/577 - loss 0.19798303 throughput (samples/sec): 305.96
2019-08-08 07:54:28,517 epoch 100 - iter 399/577 - loss 0.20243821 throughput (samples/sec): 318.38
2019-08-08 07:54:34,334 epoch 100 - iter 456/577 - loss 0.20431605 throughput (samples/sec): 318.45
2019-08-08 07:54:40,212 epoch 100 - iter 513/577 - loss 0.20331098 throughput (samples/sec): 315.21
2019-08-08 07:54:46,120 epoch 100 - iter 570/577 - loss 0.20257942 throughput (samples/sec): 313.48
2019-08-08 07:54:46,787 ----------------------------------------------------------------------------------------------------
2019-08-08 07:54:46,787 EPOCH 100 done: loss 0.2020 - lr 0.0008
2019-08-08 07:55:15,928 TEST : loss 0.8738542199134827 - score 0.9277
2019-08-08 07:55:16,101 BAD EPOCHS (no improvement): 1
2019-08-08 07:55:16,102 ----------------------------------------------------------------------------------------------------
2019-08-08 07:55:16,201 epoch 101 - iter 0/577 - loss 0.07875106 throughput (samples/sec): 18735.58
2019-08-08 07:55:22,188 epoch 101 - iter 57/577 - loss 0.20936762 throughput (samples/sec): 309.51
2019-08-08 07:55:28,069 epoch 101 - iter 114/577 - loss 0.19529988 throughput (samples/sec): 315.16
2019-08-08 07:55:33,919 epoch 101 - iter 171/577 - loss 0.19706950 throughput (samples/sec): 316.93
2019-08-08 07:55:39,724 epoch 101 - iter 228/577 - loss 0.19293689 throughput (samples/sec): 319.37
2019-08-08 07:55:45,731 epoch 101 - iter 285/577 - loss 0.18839812 throughput (samples/sec): 308.26
2019-08-08 07:55:51,677 epoch 101 - iter 342/577 - loss 0.18881658 throughput (samples/sec): 311.61
2019-08-08 07:55:57,513 epoch 101 - iter 399/577 - loss 0.18928677 throughput (samples/sec): 317.54
2019-08-08 07:56:03,401 epoch 101 - iter 456/577 - loss 0.19275353 throughput (samples/sec): 314.60
2019-08-08 07:56:09,268 epoch 101 - iter 513/577 - loss 0.19320621 throughput (samples/sec): 315.89
2019-08-08 07:56:15,019 epoch 101 - iter 570/577 - loss 0.19346230 throughput (samples/sec): 322.30
2019-08-08 07:56:15,717 ----------------------------------------------------------------------------------------------------
2019-08-08 07:56:15,718 EPOCH 101 done: loss 0.1946 - lr 0.0008
2019-08-08 07:56:44,978 TEST : loss 0.8738155364990234 - score 0.9277
2019-08-08 07:56:45,149 BAD EPOCHS (no improvement): 2
2019-08-08 07:56:45,150 ----------------------------------------------------------------------------------------------------
2019-08-08 07:56:45,264 epoch 102 - iter 0/577 - loss 0.09268570 throughput (samples/sec): 16333.45
2019-08-08 07:56:51,170 epoch 102 - iter 57/577 - loss 0.20694781 throughput (samples/sec): 313.61
2019-08-08 07:56:57,260 epoch 102 - iter 114/577 - loss 0.19821795 throughput (samples/sec): 304.20
2019-08-08 07:57:03,244 epoch 102 - iter 171/577 - loss 0.20159636 throughput (samples/sec): 309.85
2019-08-08 07:57:09,134 epoch 102 - iter 228/577 - loss 0.20355955 throughput (samples/sec): 314.68
2019-08-08 07:57:14,942 epoch 102 - iter 285/577 - loss 0.20071485 throughput (samples/sec): 318.98
2019-08-08 07:57:20,687 epoch 102 - iter 342/577 - loss 0.19752460 throughput (samples/sec): 322.74
2019-08-08 07:57:26,508 epoch 102 - iter 399/577 - loss 0.19894545 throughput (samples/sec): 318.40
2019-08-08 07:57:32,452 epoch 102 - iter 456/577 - loss 0.19552785 throughput (samples/sec): 311.68
2019-08-08 07:57:38,253 epoch 102 - iter 513/577 - loss 0.19083693 throughput (samples/sec): 319.41
2019-08-08 07:57:44,017 epoch 102 - iter 570/577 - loss 0.19042190 throughput (samples/sec): 321.61
2019-08-08 07:57:44,744 ----------------------------------------------------------------------------------------------------
2019-08-08 07:57:44,744 EPOCH 102 done: loss 0.1915 - lr 0.0008
2019-08-08 07:58:14,086 TEST : loss 0.8732653856277466 - score 0.9277
2019-08-08 07:58:14,260 BAD EPOCHS (no improvement): 3
2019-08-08 07:58:14,261 ----------------------------------------------------------------------------------------------------
2019-08-08 07:58:14,369 epoch 103 - iter 0/577 - loss 0.45795262 throughput (samples/sec): 17041.21
2019-08-08 07:58:20,327 epoch 103 - iter 57/577 - loss 0.16723342 throughput (samples/sec): 310.98
2019-08-08 07:58:26,234 epoch 103 - iter 114/577 - loss 0.16633305 throughput (samples/sec): 313.79
2019-08-08 07:58:32,246 epoch 103 - iter 171/577 - loss 0.18017744 throughput (samples/sec): 308.15
2019-08-08 07:58:38,070 epoch 103 - iter 228/577 - loss 0.17560136 throughput (samples/sec): 318.13
2019-08-08 07:58:43,804 epoch 103 - iter 285/577 - loss 0.18063152 throughput (samples/sec): 323.36
2019-08-08 07:58:49,669 epoch 103 - iter 342/577 - loss 0.18327475 throughput (samples/sec): 315.93
2019-08-08 07:58:55,444 epoch 103 - iter 399/577 - loss 0.18363461 throughput (samples/sec): 321.04
2019-08-08 07:59:01,247 epoch 103 - iter 456/577 - loss 0.18610103 throughput (samples/sec): 319.14
2019-08-08 07:59:07,152 epoch 103 - iter 513/577 - loss 0.18730793 throughput (samples/sec): 313.71
2019-08-08 07:59:13,137 epoch 103 - iter 570/577 - loss 0.19143151 throughput (samples/sec): 309.62
2019-08-08 07:59:13,809 ----------------------------------------------------------------------------------------------------
2019-08-08 07:59:13,809 EPOCH 103 done: loss 0.1911 - lr 0.0008
2019-08-08 07:59:42,970 TEST : loss 0.8741992115974426 - score 0.9277
2019-08-08 07:59:43,141 BAD EPOCHS (no improvement): 4
2019-08-08 07:59:43,142 ----------------------------------------------------------------------------------------------------
2019-08-08 07:59:43,245 epoch 104 - iter 0/577 - loss 0.06910205 throughput (samples/sec): 18016.35
2019-08-08 07:59:49,179 epoch 104 - iter 57/577 - loss 0.21234407 throughput (samples/sec): 312.22
2019-08-08 07:59:54,978 epoch 104 - iter 114/577 - loss 0.20222202 throughput (samples/sec): 319.77
2019-08-08 08:00:00,945 epoch 104 - iter 171/577 - loss 0.22360445 throughput (samples/sec): 310.52
2019-08-08 08:00:06,767 epoch 104 - iter 228/577 - loss 0.21929287 throughput (samples/sec): 318.37
2019-08-08 08:00:12,725 epoch 104 - iter 285/577 - loss 0.22160707 throughput (samples/sec): 310.94
2019-08-08 08:00:18,696 epoch 104 - iter 342/577 - loss 0.22221811 throughput (samples/sec): 310.32
2019-08-08 08:00:24,539 epoch 104 - iter 399/577 - loss 0.21502720 throughput (samples/sec): 317.22
2019-08-08 08:00:30,483 epoch 104 - iter 456/577 - loss 0.21182400 throughput (samples/sec): 311.70
2019-08-08 08:00:36,260 epoch 104 - iter 513/577 - loss 0.20744257 throughput (samples/sec): 320.70
2019-08-08 08:00:42,136 epoch 104 - iter 570/577 - loss 0.20455534 throughput (samples/sec): 315.43
2019-08-08 08:00:42,803 ----------------------------------------------------------------------------------------------------
2019-08-08 08:00:42,804 EPOCH 104 done: loss 0.2038 - lr 0.0004
2019-08-08 08:01:12,059 TEST : loss 0.8742879629135132 - score 0.9277
2019-08-08 08:01:12,228 BAD EPOCHS (no improvement): 1
2019-08-08 08:01:12,229 ----------------------------------------------------------------------------------------------------
2019-08-08 08:01:12,343 epoch 105 - iter 0/577 - loss 0.44869143 throughput (samples/sec): 16294.11
2019-08-08 08:01:18,227 epoch 105 - iter 57/577 - loss 0.19045205 throughput (samples/sec): 314.86
2019-08-08 08:01:24,038 epoch 105 - iter 114/577 - loss 0.19227313 throughput (samples/sec): 319.06
2019-08-08 08:01:29,831 epoch 105 - iter 171/577 - loss 0.19309324 throughput (samples/sec): 319.79
2019-08-08 08:01:35,807 epoch 105 - iter 228/577 - loss 0.20047614 throughput (samples/sec): 310.06
2019-08-08 08:01:41,763 epoch 105 - iter 285/577 - loss 0.19939760 throughput (samples/sec): 311.00
2019-08-08 08:01:47,702 epoch 105 - iter 342/577 - loss 0.19877247 throughput (samples/sec): 311.82
2019-08-08 08:01:53,557 epoch 105 - iter 399/577 - loss 0.20142429 throughput (samples/sec): 316.56
2019-08-08 08:01:59,536 epoch 105 - iter 456/577 - loss 0.20355950 throughput (samples/sec): 309.87
2019-08-08 08:02:05,391 epoch 105 - iter 513/577 - loss 0.20329534 throughput (samples/sec): 316.41
2019-08-08 08:02:11,097 epoch 105 - iter 570/577 - loss 0.19753830 throughput (samples/sec): 324.78
2019-08-08 08:02:11,754 ----------------------------------------------------------------------------------------------------
2019-08-08 08:02:11,754 EPOCH 105 done: loss 0.1984 - lr 0.0004
2019-08-08 08:02:40,967 TEST : loss 0.8745050430297852 - score 0.9275
2019-08-08 08:02:41,144 BAD EPOCHS (no improvement): 2
2019-08-08 08:02:41,144 ----------------------------------------------------------------------------------------------------
2019-08-08 08:02:41,246 epoch 106 - iter 0/577 - loss 0.09953415 throughput (samples/sec): 18165.61
2019-08-08 08:02:47,078 epoch 106 - iter 57/577 - loss 0.17260219 throughput (samples/sec): 317.76
2019-08-08 08:02:52,997 epoch 106 - iter 114/577 - loss 0.17946764 throughput (samples/sec): 313.03
2019-08-08 08:02:58,793 epoch 106 - iter 171/577 - loss 0.18466954 throughput (samples/sec): 319.74
2019-08-08 08:03:04,747 epoch 106 - iter 228/577 - loss 0.18465080 throughput (samples/sec): 311.25
2019-08-08 08:03:10,779 epoch 106 - iter 285/577 - loss 0.19581584 throughput (samples/sec): 307.04
2019-08-08 08:03:16,742 epoch 106 - iter 342/577 - loss 0.19248815 throughput (samples/sec): 310.68
2019-08-08 08:03:22,666 epoch 106 - iter 399/577 - loss 0.19551862 throughput (samples/sec): 312.88
2019-08-08 08:03:28,402 epoch 106 - iter 456/577 - loss 0.19541551 throughput (samples/sec): 323.17
2019-08-08 08:03:34,414 epoch 106 - iter 513/577 - loss 0.19416144 throughput (samples/sec): 308.22
2019-08-08 08:03:40,215 epoch 106 - iter 570/577 - loss 0.19477462 throughput (samples/sec): 319.81
2019-08-08 08:03:40,920 ----------------------------------------------------------------------------------------------------
2019-08-08 08:03:40,921 EPOCH 106 done: loss 0.1950 - lr 0.0004
2019-08-08 08:04:10,223 TEST : loss 0.8742600679397583 - score 0.9275
2019-08-08 08:04:10,388 BAD EPOCHS (no improvement): 3
2019-08-08 08:04:10,389 ----------------------------------------------------------------------------------------------------
2019-08-08 08:04:10,496 epoch 107 - iter 0/577 - loss 0.14511356 throughput (samples/sec): 17349.44
2019-08-08 08:04:16,512 epoch 107 - iter 57/577 - loss 0.22188345 throughput (samples/sec): 308.03
2019-08-08 08:04:22,402 epoch 107 - iter 114/577 - loss 0.21762816 throughput (samples/sec): 314.80
2019-08-08 08:04:28,291 epoch 107 - iter 171/577 - loss 0.22677664 throughput (samples/sec): 314.85
2019-08-08 08:04:34,155 epoch 107 - iter 228/577 - loss 0.22284704 throughput (samples/sec): 316.26
2019-08-08 08:04:40,002 epoch 107 - iter 285/577 - loss 0.21840210 throughput (samples/sec): 317.48
2019-08-08 08:04:45,733 epoch 107 - iter 342/577 - loss 0.21742881 throughput (samples/sec): 323.71
2019-08-08 08:04:51,644 epoch 107 - iter 399/577 - loss 0.21081512 throughput (samples/sec): 313.50
2019-08-08 08:04:57,392 epoch 107 - iter 456/577 - loss 0.21021263 throughput (samples/sec): 322.49
2019-08-08 08:05:03,368 epoch 107 - iter 513/577 - loss 0.20908524 throughput (samples/sec): 310.03
2019-08-08 08:05:09,162 epoch 107 - iter 570/577 - loss 0.20619670 throughput (samples/sec): 319.85
2019-08-08 08:05:09,843 ----------------------------------------------------------------------------------------------------
2019-08-08 08:05:09,844 EPOCH 107 done: loss 0.2065 - lr 0.0004
2019-08-08 08:05:39,074 TEST : loss 0.8741471767425537 - score 0.9275
2019-08-08 08:05:39,245 BAD EPOCHS (no improvement): 4
2019-08-08 08:05:39,246 ----------------------------------------------------------------------------------------------------
2019-08-08 08:05:39,367 epoch 108 - iter 0/577 - loss 0.22521687 throughput (samples/sec): 15303.55
2019-08-08 08:05:45,467 epoch 108 - iter 57/577 - loss 0.17029909 throughput (samples/sec): 303.64
2019-08-08 08:05:51,480 epoch 108 - iter 114/577 - loss 0.17535514 throughput (samples/sec): 308.13
2019-08-08 08:05:57,316 epoch 108 - iter 171/577 - loss 0.19255326 throughput (samples/sec): 317.50
2019-08-08 08:06:03,147 epoch 108 - iter 228/577 - loss 0.19646170 throughput (samples/sec): 317.80
2019-08-08 08:06:09,071 epoch 108 - iter 285/577 - loss 0.19713453 throughput (samples/sec): 312.91
2019-08-08 08:06:14,965 epoch 108 - iter 342/577 - loss 0.19772833 throughput (samples/sec): 314.63
2019-08-08 08:06:20,715 epoch 108 - iter 399/577 - loss 0.19295852 throughput (samples/sec): 322.34
2019-08-08 08:06:26,580 epoch 108 - iter 456/577 - loss 0.19319905 throughput (samples/sec): 315.92
2019-08-08 08:06:32,356 epoch 108 - iter 513/577 - loss 0.19450710 throughput (samples/sec): 320.77
2019-08-08 08:06:38,331 epoch 108 - iter 570/577 - loss 0.19577159 throughput (samples/sec): 310.00
2019-08-08 08:06:38,989 ----------------------------------------------------------------------------------------------------
2019-08-08 08:06:38,990 EPOCH 108 done: loss 0.1952 - lr 0.0002
2019-08-08 08:07:08,197 TEST : loss 0.8742099404335022 - score 0.9275
2019-08-08 08:07:08,370 BAD EPOCHS (no improvement): 1
2019-08-08 08:07:08,371 ----------------------------------------------------------------------------------------------------
2019-08-08 08:07:08,471 epoch 109 - iter 0/577 - loss 0.30561906 throughput (samples/sec): 18423.23
2019-08-08 08:07:14,244 epoch 109 - iter 57/577 - loss 0.21303645 throughput (samples/sec): 321.53
2019-08-08 08:07:19,956 epoch 109 - iter 114/577 - loss 0.19141214 throughput (samples/sec): 324.71
2019-08-08 08:07:25,811 epoch 109 - iter 171/577 - loss 0.18428765 throughput (samples/sec): 316.70
2019-08-08 08:07:31,790 epoch 109 - iter 228/577 - loss 0.19061599 throughput (samples/sec): 309.75
2019-08-08 08:07:37,676 epoch 109 - iter 285/577 - loss 0.19046972 throughput (samples/sec): 314.90
2019-08-08 08:07:43,632 epoch 109 - iter 342/577 - loss 0.19216558 throughput (samples/sec): 311.61
2019-08-08 08:07:49,593 epoch 109 - iter 399/577 - loss 0.19405099 throughput (samples/sec): 310.87
2019-08-08 08:07:55,444 epoch 109 - iter 456/577 - loss 0.19450499 throughput (samples/sec): 316.67
2019-08-08 08:08:01,255 epoch 109 - iter 513/577 - loss 0.19718988 throughput (samples/sec): 318.92
2019-08-08 08:08:06,978 epoch 109 - iter 570/577 - loss 0.19855099 throughput (samples/sec): 323.79
2019-08-08 08:08:07,665 ----------------------------------------------------------------------------------------------------
2019-08-08 08:08:07,665 EPOCH 109 done: loss 0.1981 - lr 0.0002
2019-08-08 08:08:36,987 TEST : loss 0.8745347857475281 - score 0.9275
2019-08-08 08:08:37,163 BAD EPOCHS (no improvement): 2
2019-08-08 08:08:37,164 ----------------------------------------------------------------------------------------------------
2019-08-08 08:08:37,260 epoch 110 - iter 0/577 - loss 0.22643155 throughput (samples/sec): 19307.91
2019-08-08 08:08:43,007 epoch 110 - iter 57/577 - loss 0.20952004 throughput (samples/sec): 322.61
2019-08-08 08:08:48,909 epoch 110 - iter 114/577 - loss 0.20374469 throughput (samples/sec): 314.12
2019-08-08 08:08:54,769 epoch 110 - iter 171/577 - loss 0.19739310 throughput (samples/sec): 316.00
2019-08-08 08:09:00,681 epoch 110 - iter 228/577 - loss 0.19613218 throughput (samples/sec): 313.52
2019-08-08 08:09:06,606 epoch 110 - iter 285/577 - loss 0.19834618 throughput (samples/sec): 312.75
2019-08-08 08:09:12,697 epoch 110 - iter 342/577 - loss 0.19886261 throughput (samples/sec): 304.44
2019-08-08 08:09:18,485 epoch 110 - iter 399/577 - loss 0.20320067 throughput (samples/sec): 320.22
2019-08-08 08:09:24,243 epoch 110 - iter 456/577 - loss 0.20472895 throughput (samples/sec): 321.92
2019-08-08 08:09:30,059 epoch 110 - iter 513/577 - loss 0.20626673 throughput (samples/sec): 318.64
2019-08-08 08:09:35,812 epoch 110 - iter 570/577 - loss 0.20852668 throughput (samples/sec): 322.06
2019-08-08 08:09:36,454 ----------------------------------------------------------------------------------------------------
2019-08-08 08:09:36,454 EPOCH 110 done: loss 0.2092 - lr 0.0002
2019-08-08 08:10:05,695 TEST : loss 0.8745435476303101 - score 0.9275
2019-08-08 08:10:05,870 BAD EPOCHS (no improvement): 3
2019-08-08 08:10:05,871 ----------------------------------------------------------------------------------------------------
2019-08-08 08:10:05,984 epoch 111 - iter 0/577 - loss 0.45891169 throughput (samples/sec): 16356.54
2019-08-08 08:10:11,973 epoch 111 - iter 57/577 - loss 0.19495062 throughput (samples/sec): 309.37
2019-08-08 08:10:17,726 epoch 111 - iter 114/577 - loss 0.19427626 throughput (samples/sec): 322.25
2019-08-08 08:10:23,566 epoch 111 - iter 171/577 - loss 0.19769697 throughput (samples/sec): 317.47
2019-08-08 08:10:29,390 epoch 111 - iter 228/577 - loss 0.19237448 throughput (samples/sec): 318.23
2019-08-08 08:10:35,395 epoch 111 - iter 285/577 - loss 0.19423867 throughput (samples/sec): 308.56
2019-08-08 08:10:41,265 epoch 111 - iter 342/577 - loss 0.19736686 throughput (samples/sec): 315.58
2019-08-08 08:10:47,160 epoch 111 - iter 399/577 - loss 0.19654183 throughput (samples/sec): 314.43
2019-08-08 08:10:53,049 epoch 111 - iter 456/577 - loss 0.19713033 throughput (samples/sec): 314.67
2019-08-08 08:10:58,858 epoch 111 - iter 513/577 - loss 0.19306222 throughput (samples/sec): 318.85
2019-08-08 08:11:04,879 epoch 111 - iter 570/577 - loss 0.19551036 throughput (samples/sec): 307.43
2019-08-08 08:11:05,512 ----------------------------------------------------------------------------------------------------
2019-08-08 08:11:05,512 EPOCH 111 done: loss 0.1946 - lr 0.0002
2019-08-08 08:11:34,787 TEST : loss 0.8745341300964355 - score 0.9275
2019-08-08 08:11:34,965 BAD EPOCHS (no improvement): 4
2019-08-08 08:11:34,966 ----------------------------------------------------------------------------------------------------
2019-08-08 08:11:34,966 ----------------------------------------------------------------------------------------------------
2019-08-08 08:11:34,966 learning rate too small - quitting training!
2019-08-08 08:11:34,966 ----------------------------------------------------------------------------------------------------
2019-08-08 08:11:49,698 ----------------------------------------------------------------------------------------------------
2019-08-08 08:11:49,698 Testing using best model ...
2019-08-08 08:12:18,758 0.9257	0.9294	0.9275
2019-08-08 08:12:18,758 
MICRO_AVG: acc 0.8649 - f1-score 0.9275
MACRO_AVG: acc 0.8432 - f1-score 0.9119499999999999
LOC        tp: 1565 - fp: 100 - fn: 103 - tn: 1565 - precision: 0.9399 - recall: 0.9382 - accuracy: 0.8852 - f1-score: 0.9390
MISC       tp: 574 - fp: 128 - fn: 128 - tn: 574 - precision: 0.8177 - recall: 0.8177 - accuracy: 0.6916 - f1-score: 0.8177
ORG        tp: 1533 - fp: 144 - fn: 128 - tn: 1533 - precision: 0.9141 - recall: 0.9229 - accuracy: 0.8493 - f1-score: 0.9185
PER        tp: 1577 - fp: 49 - fn: 40 - tn: 1577 - precision: 0.9699 - recall: 0.9753 - accuracy: 0.9466 - f1-score: 0.9726
2019-08-08 08:12:18,758 ----------------------------------------------------------------------------------------------------