ScaDaMaLe Course site and book

This is a 2019-2021 augmentation and update of Adam Breindel's initial notebooks.

Thanks to Christian von Koch and William Anzén for their contributions towards making these materials Spark 3.0.1 and Python 3+ compliant.

'''Example script to generate text from Nietzsche's writings.

At least 20 epochs are required before the generated text
starts sounding coherent.

It is recommended to run this script on GPU, as recurrent
networks are quite computationally intensive.

If you try this script on new data, make sure your corpus
has at least ~100k characters. ~1M is better.
'''

from __future__ import print_function
from keras.models import Sequential
from keras.layers import Dense, Activation
from keras.layers import LSTM
from keras.optimizers import RMSprop
from keras.utils.data_utils import get_file
import numpy as np
import random
import sys

path = get_file('nietzsche.txt', origin='https://s3.amazonaws.com/text-datasets/nietzsche.txt')
text = open(path).read().lower()
print('corpus length:', len(text))

chars = sorted(list(set(text)))
print('total chars:', len(chars))
char_indices = dict((c, i) for i, c in enumerate(chars))
indices_char = dict((i, c) for i, c in enumerate(chars))

# cut the text in semi-redundant sequences of maxlen characters
maxlen = 40
step = 3
sentences = []
next_chars = []
for i in range(0, len(text) - maxlen, step):
    sentences.append(text[i: i + maxlen])
    next_chars.append(text[i + maxlen])
print('nb sequences:', len(sentences))

print('Vectorization...')
X = np.zeros((len(sentences), maxlen, len(chars)), dtype=np.bool)
y = np.zeros((len(sentences), len(chars)), dtype=np.bool)
for i, sentence in enumerate(sentences):
    for t, char in enumerate(sentence):
        X[i, t, char_indices[char]] = 1
    y[i, char_indices[next_chars[i]]] = 1


# build the model: a single LSTM
print('Build model...')
model = Sequential()
model.add(LSTM(128, input_shape=(maxlen, len(chars))))
model.add(Dense(len(chars)))
model.add(Activation('softmax'))

optimizer = RMSprop(lr=0.01)
model.compile(loss='categorical_crossentropy', optimizer=optimizer)


def sample(preds, temperature=1.0):
    # helper function to sample an index from a probability array
    preds = np.asarray(preds).astype('float64')
    preds = np.log(preds) / temperature
    exp_preds = np.exp(preds)
    preds = exp_preds / np.sum(exp_preds)
    probas = np.random.multinomial(1, preds, 1)
    return np.argmax(probas)

# train the model, output generated text after each iteration
for iteration in range(1, 60):
    print()
    print('-' * 50)
    print('Iteration', iteration)
    model.fit(X, y,
              batch_size=128,
              epochs=1)

    start_index = random.randint(0, len(text) - maxlen - 1)

    for diversity in [0.2, 0.5, 1.0, 1.2]:
        print()
        print('----- diversity:', diversity)

        generated = ''
        sentence = text[start_index: start_index + maxlen]
        generated += sentence
        print('----- Generating with seed: "' + sentence + '"')
        sys.stdout.write(generated)

        for i in range(400):
            x = np.zeros((1, maxlen, len(chars)))
            for t, char in enumerate(sentence):
                x[0, t, char_indices[char]] = 1.

            preds = model.predict(x, verbose=0)[0]
            next_index = sample(preds, diversity)
            next_char = indices_char[next_index]

            generated += next_char
            sentence = sentence[1:] + next_char

            sys.stdout.write(next_char)
            sys.stdout.flush()
        print()
Using TensorFlow backend.
Downloading data from https://s3.amazonaws.com/text-datasets/nietzsche.txt

  8192/600901 [..............................] - ETA: 5s
 57344/600901 [=>............................] - ETA: 1s
 90112/600901 [===>..........................] - ETA: 1s
131072/600901 [=====>........................] - ETA: 1s
180224/600901 [=======>......................] - ETA: 0s
212992/600901 [=========>....................] - ETA: 0s
245760/600901 [===========>..................] - ETA: 0s
319488/600901 [==============>...............] - ETA: 0s
475136/600901 [======================>.......] - ETA: 0s
606208/600901 [==============================] - 1s 1us/step
corpus length: 600893
total chars: 57
nb sequences: 200285
Vectorization...
Build model...
WARNING:tensorflow:From /databricks/python/lib/python3.7/site-packages/tensorflow/python/framework/op_def_library.py:263: colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version.
Instructions for updating:
Colocations handled automatically by placer.

--------------------------------------------------
Iteration 1
WARNING:tensorflow:From /databricks/python/lib/python3.7/site-packages/tensorflow/python/ops/math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
Epoch 1/1

   128/200285 [..............................] - ETA: 1:51:43 - loss: 4.0438
   256/200285 [..............................] - ETA: 1:01:34 - loss: 3.8643
   384/200285 [..............................] - ETA: 44:38 - loss: 3.9969  
   512/200285 [..............................] - ETA: 35:53 - loss: 3.9730
   640/200285 [..............................] - ETA: 30:43 - loss: 3.8894
   768/200285 [..............................] - ETA: 27:27 - loss: 3.7772
   896/200285 [..............................] - ETA: 24:54 - loss: 3.6588
  1024/200285 [..............................] - ETA: 22:58 - loss: 3.5957
  1152/200285 [..............................] - ETA: 21:24 - loss: 3.5234
  1280/200285 [..............................] - ETA: 20:14 - loss: 3.4729
  1408/200285 [..............................] - ETA: 19:14 - loss: 3.4467
  1536/200285 [..............................] - ETA: 18:29 - loss: 3.4135
  1664/200285 [..............................] - ETA: 17:46 - loss: 3.3925
  1792/200285 [..............................] - ETA: 17:10 - loss: 3.3634
  1920/200285 [..............................] - ETA: 16:43 - loss: 3.3300
  2048/200285 [..............................] - ETA: 16:26 - loss: 3.3182
  2176/200285 [..............................] - ETA: 16:04 - loss: 3.2964
  2304/200285 [..............................] - ETA: 15:45 - loss: 3.2769
  2432/200285 [..............................] - ETA: 15:24 - loss: 3.2639
  2560/200285 [..............................] - ETA: 15:02 - loss: 3.2490
  2688/200285 [..............................] - ETA: 14:44 - loss: 3.2349
  2816/200285 [..............................] - ETA: 14:36 - loss: 3.2276
  2944/200285 [..............................] - ETA: 14:27 - loss: 3.2195
  3072/200285 [..............................] - ETA: 14:17 - loss: 3.2163
  3200/200285 [..............................] - ETA: 14:03 - loss: 3.2052
  3328/200285 [..............................] - ETA: 13:53 - loss: 3.1999
  3456/200285 [..............................] - ETA: 13:49 - loss: 3.1922
  3584/200285 [..............................] - ETA: 13:44 - loss: 3.1859
  3712/200285 [..............................] - ETA: 13:40 - loss: 3.1801
  3840/200285 [..............................] - ETA: 13:33 - loss: 3.1739
  3968/200285 [..............................] - ETA: 13:27 - loss: 3.1672
  4096/200285 [..............................] - ETA: 13:21 - loss: 3.1585
  4224/200285 [..............................] - ETA: 13:18 - loss: 3.1521
  4352/200285 [..............................] - ETA: 13:13 - loss: 3.1484
  4480/200285 [..............................] - ETA: 13:10 - loss: 3.1393
  4608/200285 [..............................] - ETA: 13:07 - loss: 3.1348
  4736/200285 [..............................] - ETA: 13:05 - loss: 3.1296
  4864/200285 [..............................] - ETA: 13:01 - loss: 3.1216
  4992/200285 [..............................] - ETA: 12:57 - loss: 3.1132
  5120/200285 [..............................] - ETA: 12:51 - loss: 3.1076
  5248/200285 [..............................] - ETA: 12:46 - loss: 3.1005
  5376/200285 [..............................] - ETA: 12:40 - loss: 3.0970
  5504/200285 [..............................] - ETA: 12:36 - loss: 3.0924
  5632/200285 [..............................] - ETA: 12:31 - loss: 3.0858
  5760/200285 [..............................] - ETA: 12:27 - loss: 3.0794
  5888/200285 [..............................] - ETA: 12:24 - loss: 3.0728
  6016/200285 [..............................] - ETA: 12:21 - loss: 3.0695
  6144/200285 [..............................] - ETA: 12:18 - loss: 3.0679
  6272/200285 [..............................] - ETA: 12:15 - loss: 3.0609
  6400/200285 [..............................] - ETA: 12:14 - loss: 3.0523
  6528/200285 [..............................] - ETA: 12:15 - loss: 3.0485
  6656/200285 [..............................] - ETA: 12:13 - loss: 3.0431
  6784/200285 [>.............................] - ETA: 12:11 - loss: 3.0397
  6912/200285 [>.............................] - ETA: 12:08 - loss: 3.0348
  7040/200285 [>.............................] - ETA: 12:06 - loss: 3.0265
  7168/200285 [>.............................] - ETA: 12:02 - loss: 3.0215
  7296/200285 [>.............................] - ETA: 12:00 - loss: 3.0153
  7424/200285 [>.............................] - ETA: 11:57 - loss: 3.0066
  7552/200285 [>.............................] - ETA: 11:55 - loss: 3.0044
  7680/200285 [>.............................] - ETA: 11:53 - loss: 2.9986
  7808/200285 [>.............................] - ETA: 11:49 - loss: 2.9911
  7936/200285 [>.............................] - ETA: 11:47 - loss: 2.9867
  8064/200285 [>.............................] - ETA: 11:47 - loss: 2.9814
  8192/200285 [>.............................] - ETA: 11:47 - loss: 2.9778
  8320/200285 [>.............................] - ETA: 11:47 - loss: 2.9721
  8448/200285 [>.............................] - ETA: 11:44 - loss: 2.9666
  8576/200285 [>.............................] - ETA: 11:40 - loss: 2.9609
  8704/200285 [>.............................] - ETA: 11:37 - loss: 2.9548
  8832/200285 [>.............................] - ETA: 11:34 - loss: 2.9480
  8960/200285 [>.............................] - ETA: 11:34 - loss: 2.9429
  9088/200285 [>.............................] - ETA: 11:31 - loss: 2.9380
  9216/200285 [>.............................] - ETA: 11:30 - loss: 2.9321
  9344/200285 [>.............................] - ETA: 11:27 - loss: 2.9302
  9472/200285 [>.............................] - ETA: 11:25 - loss: 2.9251
  9600/200285 [>.............................] - ETA: 11:21 - loss: 2.9223
  9728/200285 [>.............................] - ETA: 11:18 - loss: 2.9175
  9856/200285 [>.............................] - ETA: 11:14 - loss: 2.9115
  9984/200285 [>.............................] - ETA: 11:12 - loss: 2.9070
 10112/200285 [>.............................] - ETA: 11:09 - loss: 2.9050
 10240/200285 [>.............................] - ETA: 11:07 - loss: 2.9000
 10368/200285 [>.............................] - ETA: 11:05 - loss: 2.8975
 10496/200285 [>.............................] - ETA: 11:03 - loss: 2.8965
 10624/200285 [>.............................] - ETA: 11:02 - loss: 2.8910
 10752/200285 [>.............................] - ETA: 10:59 - loss: 2.8852
 10880/200285 [>.............................] - ETA: 10:58 - loss: 2.8817
 11008/200285 [>.............................] - ETA: 10:56 - loss: 2.8773
 11136/200285 [>.............................] - ETA: 10:55 - loss: 2.8748
 11264/200285 [>.............................] - ETA: 10:54 - loss: 2.8674
 11392/200285 [>.............................] - ETA: 10:55 - loss: 2.8634
 11520/200285 [>.............................] - ETA: 10:52 - loss: 2.8604
 11648/200285 [>.............................] - ETA: 10:52 - loss: 2.8592
 11776/200285 [>.............................] - ETA: 10:50 - loss: 2.8572
 11904/200285 [>.............................] - ETA: 10:49 - loss: 2.8543
 12032/200285 [>.............................] - ETA: 10:48 - loss: 2.8495
 12160/200285 [>.............................] - ETA: 10:46 - loss: 2.8447
 12288/200285 [>.............................] - ETA: 10:46 - loss: 2.8409
 12416/200285 [>.............................] - ETA: 10:45 - loss: 2.8376
 12544/200285 [>.............................] - ETA: 10:45 - loss: 2.8351
 12672/200285 [>.............................] - ETA: 10:44 - loss: 2.8321
 12800/200285 [>.............................] - ETA: 10:42 - loss: 2.8289
 12928/200285 [>.............................] - ETA: 10:41 - loss: 2.8260
 13056/200285 [>.............................] - ETA: 10:40 - loss: 2.8218
 13184/200285 [>.............................] - ETA: 10:39 - loss: 2.8206
 13312/200285 [>.............................] - ETA: 10:38 - loss: 2.8176
 13440/200285 [=>............................] - ETA: 10:37 - loss: 2.8165
 13568/200285 [=>............................] - ETA: 10:35 - loss: 2.8143
 13696/200285 [=>............................] - ETA: 10:33 - loss: 2.8116
 13824/200285 [=>............................] - ETA: 10:32 - loss: 2.8085
 13952/200285 [=>............................] - ETA: 10:31 - loss: 2.8068
 14080/200285 [=>............................] - ETA: 10:29 - loss: 2.8046
 14208/200285 [=>............................] - ETA: 10:27 - loss: 2.8014
 14336/200285 [=>............................] - ETA: 10:26 - loss: 2.7968
 14464/200285 [=>............................] - ETA: 10:24 - loss: 2.7946
 14592/200285 [=>............................] - ETA: 10:23 - loss: 2.7926
 14720/200285 [=>............................] - ETA: 10:22 - loss: 2.7902
 14848/200285 [=>............................] - ETA: 10:21 - loss: 2.7875
 14976/200285 [=>............................] - ETA: 10:19 - loss: 2.7851
 15104/200285 [=>............................] - ETA: 10:18 - loss: 2.7817
 15232/200285 [=>............................] - ETA: 10:17 - loss: 2.7773
 15360/200285 [=>............................] - ETA: 10:16 - loss: 2.7751
 15488/200285 [=>............................] - ETA: 10:15 - loss: 2.7699
 15616/200285 [=>............................] - ETA: 10:14 - loss: 2.7669
 15744/200285 [=>............................] - ETA: 10:13 - loss: 2.7667
 15872/200285 [=>............................] - ETA: 10:12 - loss: 2.7642
 16000/200285 [=>............................] - ETA: 10:11 - loss: 2.7626
 16128/200285 [=>............................] - ETA: 10:11 - loss: 2.7602
 16256/200285 [=>............................] - ETA: 10:09 - loss: 2.7582
 16384/200285 [=>............................] - ETA: 10:08 - loss: 2.7564
 16512/200285 [=>............................] - ETA: 10:08 - loss: 2.7554
 16640/200285 [=>............................] - ETA: 10:06 - loss: 2.7538
 16768/200285 [=>............................] - ETA: 10:04 - loss: 2.7505
 16896/200285 [=>............................] - ETA: 10:03 - loss: 2.7482
 17024/200285 [=>............................] - ETA: 10:02 - loss: 2.7448
 17152/200285 [=>............................] - ETA: 10:02 - loss: 2.7432
 17280/200285 [=>............................] - ETA: 10:01 - loss: 2.7406
 17408/200285 [=>............................] - ETA: 10:01 - loss: 2.7382
 17536/200285 [=>............................] - ETA: 10:00 - loss: 2.7364
 17664/200285 [=>............................] - ETA: 9:58 - loss: 2.7329 
 17792/200285 [=>............................] - ETA: 9:57 - loss: 2.7311
 17920/200285 [=>............................] - ETA: 9:55 - loss: 2.7303
 18048/200285 [=>............................] - ETA: 9:55 - loss: 2.7282
 18176/200285 [=>............................] - ETA: 9:54 - loss: 2.7259
 18304/200285 [=>............................] - ETA: 9:54 - loss: 2.7232
 18432/200285 [=>............................] - ETA: 9:53 - loss: 2.7217
 18560/200285 [=>............................] - ETA: 9:52 - loss: 2.7170
 18688/200285 [=>............................] - ETA: 9:51 - loss: 2.7141
 18816/200285 [=>............................] - ETA: 9:50 - loss: 2.7135
 18944/200285 [=>............................] - ETA: 9:49 - loss: 2.7122
 19072/200285 [=>............................] - ETA: 9:48 - loss: 2.7103
 19200/200285 [=>............................] - ETA: 9:48 - loss: 2.7078
 19328/200285 [=>............................] - ETA: 9:47 - loss: 2.7055
 19456/200285 [=>............................] - ETA: 9:46 - loss: 2.7028
 19584/200285 [=>............................] - ETA: 9:46 - loss: 2.6997
 19712/200285 [=>............................] - ETA: 9:46 - loss: 2.6988
 19840/200285 [=>............................] - ETA: 9:45 - loss: 2.6967
 19968/200285 [=>............................] - ETA: 9:46 - loss: 2.6941
 20096/200285 [==>...........................] - ETA: 9:44 - loss: 2.6908
 20224/200285 [==>...........................] - ETA: 9:44 - loss: 2.6879
 20352/200285 [==>...........................] - ETA: 9:43 - loss: 2.6862
 20480/200285 [==>...........................] - ETA: 9:42 - loss: 2.6839
 20608/200285 [==>...........................] - ETA: 9:41 - loss: 2.6819
 20736/200285 [==>...........................] - ETA: 9:40 - loss: 2.6797
 20864/200285 [==>...........................] - ETA: 9:40 - loss: 2.6774
 20992/200285 [==>...........................] - ETA: 9:40 - loss: 2.6767
 21120/200285 [==>...........................] - ETA: 9:40 - loss: 2.6748
 21248/200285 [==>...........................] - ETA: 9:40 - loss: 2.6727
 21376/200285 [==>...........................] - ETA: 9:39 - loss: 2.6715
 21504/200285 [==>...........................] - ETA: 9:40 - loss: 2.6692
 21632/200285 [==>...........................] - ETA: 9:39 - loss: 2.6660
 21760/200285 [==>...........................] - ETA: 9:39 - loss: 2.6641
 21888/200285 [==>...........................] - ETA: 9:39 - loss: 2.6622
 22016/200285 [==>...........................] - ETA: 9:39 - loss: 2.6594
 22144/200285 [==>...........................] - ETA: 9:39 - loss: 2.6577
 22272/200285 [==>...........................] - ETA: 9:39 - loss: 2.6561
 22400/200285 [==>...........................] - ETA: 9:38 - loss: 2.6540
 22528/200285 [==>...........................] - ETA: 9:38 - loss: 2.6515
 22656/200285 [==>...........................] - ETA: 9:37 - loss: 2.6492
 22784/200285 [==>...........................] - ETA: 9:36 - loss: 2.6479
 22912/200285 [==>...........................] - ETA: 9:36 - loss: 2.6461
 23040/200285 [==>...........................] - ETA: 9:35 - loss: 2.6446
 23168/200285 [==>...........................] - ETA: 9:35 - loss: 2.6429
 23296/200285 [==>...........................] - ETA: 9:35 - loss: 2.6408
 23424/200285 [==>...........................] - ETA: 9:35 - loss: 2.6399
 23552/200285 [==>...........................] - ETA: 9:35 - loss: 2.6381
 23680/200285 [==>...........................] - ETA: 9:35 - loss: 2.6360
 23808/200285 [==>...........................] - ETA: 9:35 - loss: 2.6343
 23936/200285 [==>...........................] - ETA: 9:35 - loss: 2.6318
 24064/200285 [==>...........................] - ETA: 9:35 - loss: 2.6306
 24192/200285 [==>...........................] - ETA: 9:36 - loss: 2.6285
 24320/200285 [==>...........................] - ETA: 9:35 - loss: 2.6267
 24448/200285 [==>...........................] - ETA: 9:35 - loss: 2.6251
 24576/200285 [==>...........................] - ETA: 9:35 - loss: 2.6239
 24704/200285 [==>...........................] - ETA: 9:36 - loss: 2.6219
 24832/200285 [==>...........................] - ETA: 9:36 - loss: 2.6210
 24960/200285 [==>...........................] - ETA: 9:36 - loss: 2.6195
 25088/200285 [==>...........................] - ETA: 9:36 - loss: 2.6176
 25216/200285 [==>...........................] - ETA: 9:36 - loss: 2.6155
 25344/200285 [==>...........................] - ETA: 9:36 - loss: 2.6139
 25472/200285 [==>...........................] - ETA: 9:36 - loss: 2.6114
 25600/200285 [==>...........................] - ETA: 9:36 - loss: 2.6103
 25728/200285 [==>...........................] - ETA: 9:36 - loss: 2.6082
 25856/200285 [==>...........................] - ETA: 9:35 - loss: 2.6064
 25984/200285 [==>...........................] - ETA: 9:35 - loss: 2.6059
 26112/200285 [==>...........................] - ETA: 9:35 - loss: 2.6043
 26240/200285 [==>...........................] - ETA: 9:36 - loss: 2.6022
 26368/200285 [==>...........................] - ETA: 9:36 - loss: 2.6003
 26496/200285 [==>...........................] - ETA: 9:37 - loss: 2.5979
 26624/200285 [==>...........................] - ETA: 9:36 - loss: 2.5975
 26752/200285 [===>..........................] - ETA: 9:35 - loss: 2.5962
 26880/200285 [===>..........................] - ETA: 9:35 - loss: 2.5947
 27008/200285 [===>..........................] - ETA: 9:35 - loss: 2.5935
 27136/200285 [===>..........................] - ETA: 9:34 - loss: 2.5911
 27264/200285 [===>..........................] - ETA: 9:34 - loss: 2.5894
 27392/200285 [===>..........................] - ETA: 9:33 - loss: 2.5876
 27520/200285 [===>..........................] - ETA: 9:34 - loss: 2.5853
 27648/200285 [===>..........................] - ETA: 9:34 - loss: 2.5825
 27776/200285 [===>..........................] - ETA: 9:33 - loss: 2.5817
 27904/200285 [===>..........................] - ETA: 9:33 - loss: 2.5798
 28032/200285 [===>..........................] - ETA: 9:32 - loss: 2.5779
 28160/200285 [===>..........................] - ETA: 9:32 - loss: 2.5755
 28288/200285 [===>..........................] - ETA: 9:32 - loss: 2.5746
 28416/200285 [===>..........................] - ETA: 9:32 - loss: 2.5738
 28544/200285 [===>..........................] - ETA: 9:31 - loss: 2.5722
 28672/200285 [===>..........................] - ETA: 9:31 - loss: 2.5703
 28800/200285 [===>..........................] - ETA: 9:31 - loss: 2.5683
 28928/200285 [===>..........................] - ETA: 9:31 - loss: 2.5675
 29056/200285 [===>..........................] - ETA: 9:31 - loss: 2.5655
 29184/200285 [===>..........................] - ETA: 9:30 - loss: 2.5635
 29312/200285 [===>..........................] - ETA: 9:30 - loss: 2.5617
 29440/200285 [===>..........................] - ETA: 9:30 - loss: 2.5618
 29568/200285 [===>..........................] - ETA: 9:30 - loss: 2.5601
 29696/200285 [===>..........................] - ETA: 9:29 - loss: 2.5579
 29824/200285 [===>..........................] - ETA: 9:29 - loss: 2.5570
 29952/200285 [===>..........................] - ETA: 9:29 - loss: 2.5559
 30080/200285 [===>..........................] - ETA: 9:29 - loss: 2.5553
 30208/200285 [===>..........................] - ETA: 9:29 - loss: 2.5537
 30336/200285 [===>..........................] - ETA: 9:28 - loss: 2.5528
 30464/200285 [===>..........................] - ETA: 9:29 - loss: 2.5515
 30592/200285 [===>..........................] - ETA: 9:28 - loss: 2.5503
 30720/200285 [===>..........................] - ETA: 9:27 - loss: 2.5485
 30848/200285 [===>..........................] - ETA: 9:27 - loss: 2.5464
 30976/200285 [===>..........................] - ETA: 9:27 - loss: 2.5438
 31104/200285 [===>..........................] - ETA: 9:26 - loss: 2.5423
 31232/200285 [===>..........................] - ETA: 9:26 - loss: 2.5415
 31360/200285 [===>..........................] - ETA: 9:25 - loss: 2.5398
 31488/200285 [===>..........................] - ETA: 9:25 - loss: 2.5382
 31616/200285 [===>..........................] - ETA: 9:24 - loss: 2.5363
 31744/200285 [===>..........................] - ETA: 9:23 - loss: 2.5345
 31872/200285 [===>..........................] - ETA: 9:23 - loss: 2.5326
 32000/200285 [===>..........................] - ETA: 9:22 - loss: 2.5316
 32128/200285 [===>..........................] - ETA: 9:21 - loss: 2.5298
 32256/200285 [===>..........................] - ETA: 9:21 - loss: 2.5282
 32384/200285 [===>..........................] - ETA: 9:21 - loss: 2.5269
 32512/200285 [===>..........................] - ETA: 9:21 - loss: 2.5256
 32640/200285 [===>..........................] - ETA: 9:20 - loss: 2.5244
 32768/200285 [===>..........................] - ETA: 9:20 - loss: 2.5224
 32896/200285 [===>..........................] - ETA: 9:20 - loss: 2.5212
 33024/200285 [===>..........................] - ETA: 9:19 - loss: 2.5203
 33152/200285 [===>..........................] - ETA: 9:19 - loss: 2.5182
 33280/200285 [===>..........................] - ETA: 9:20 - loss: 2.5168
 33408/200285 [====>.........................] - ETA: 9:19 - loss: 2.5156
 33536/200285 [====>.........................] - ETA: 9:19 - loss: 2.5142
 33664/200285 [====>.........................] - ETA: 9:19 - loss: 2.5122
 33792/200285 [====>.........................] - ETA: 9:19 - loss: 2.5109
 33920/200285 [====>.........................] - ETA: 9:18 - loss: 2.5090
 34048/200285 [====>.........................] - ETA: 9:18 - loss: 2.5078
 34176/200285 [====>.........................] - ETA: 9:18 - loss: 2.5066
 34304/200285 [====>.........................] - ETA: 9:18 - loss: 2.5055
 34432/200285 [====>.........................] - ETA: 9:17 - loss: 2.5048
 34560/200285 [====>.........................] - ETA: 9:17 - loss: 2.5041
 34688/200285 [====>.........................] - ETA: 9:16 - loss: 2.5030
 34816/200285 [====>.........................] - ETA: 9:16 - loss: 2.5018
 34944/200285 [====>.........................] - ETA: 9:15 - loss: 2.5007
 35072/200285 [====>.........................] - ETA: 9:15 - loss: 2.4992
 35200/200285 [====>.........................] - ETA: 9:14 - loss: 2.4981
 35328/200285 [====>.........................] - ETA: 9:14 - loss: 2.4972
 35456/200285 [====>.........................] - ETA: 9:14 - loss: 2.4964
 35584/200285 [====>.........................] - ETA: 9:14 - loss: 2.4942
 35712/200285 [====>.........................] - ETA: 9:13 - loss: 2.4930
 35840/200285 [====>.........................] - ETA: 9:13 - loss: 2.4912
 35968/200285 [====>.........................] - ETA: 9:12 - loss: 2.4906
 36096/200285 [====>.........................] - ETA: 9:12 - loss: 2.4893
 36224/200285 [====>.........................] - ETA: 9:11 - loss: 2.4895
 36352/200285 [====>.........................] - ETA: 9:11 - loss: 2.4886
 36480/200285 [====>.........................] - ETA: 9:10 - loss: 2.4877
 36608/200285 [====>.........................] - ETA: 9:10 - loss: 2.4867
 36736/200285 [====>.........................] - ETA: 9:10 - loss: 2.4854
 36864/200285 [====>.........................] - ETA: 9:09 - loss: 2.4844
 36992/200285 [====>.........................] - ETA: 9:09 - loss: 2.4829
 37120/200285 [====>.........................] - ETA: 9:08 - loss: 2.4818
 37248/200285 [====>.........................] - ETA: 9:08 - loss: 2.4798
 37376/200285 [====>.........................] - ETA: 9:08 - loss: 2.4782
 37504/200285 [====>.........................] - ETA: 9:08 - loss: 2.4774
 37632/200285 [====>.........................] - ETA: 9:07 - loss: 2.4756
 37760/200285 [====>.........................] - ETA: 9:06 - loss: 2.4750
 37888/200285 [====>.........................] - ETA: 9:06 - loss: 2.4742
 38016/200285 [====>.........................] - ETA: 9:06 - loss: 2.4729
 38144/200285 [====>.........................] - ETA: 9:05 - loss: 2.4716
 38272/200285 [====>.........................] - ETA: 9:05 - loss: 2.4710
 38400/200285 [====>.........................] - ETA: 9:05 - loss: 2.4701
 38528/200285 [====>.........................] - ETA: 9:05 - loss: 2.4690
 38656/200285 [====>.........................] - ETA: 9:05 - loss: 2.4677
 38784/200285 [====>.........................] - ETA: 9:05 - loss: 2.4669
 38912/200285 [====>.........................] - ETA: 9:04 - loss: 2.4653
 39040/200285 [====>.........................] - ETA: 9:04 - loss: 2.4645
 39168/200285 [====>.........................] - ETA: 9:03 - loss: 2.4627
 39296/200285 [====>.........................] - ETA: 9:03 - loss: 2.4619
 39424/200285 [====>.........................] - ETA: 9:03 - loss: 2.4604
 39552/200285 [====>.........................] - ETA: 9:02 - loss: 2.4592
 39680/200285 [====>.........................] - ETA: 9:02 - loss: 2.4579
 39808/200285 [====>.........................] - ETA: 9:02 - loss: 2.4576
 39936/200285 [====>.........................] - ETA: 9:02 - loss: 2.4566
 40064/200285 [=====>........................] - ETA: 9:01 - loss: 2.4563
 40192/200285 [=====>........................] - ETA: 9:01 - loss: 2.4549
 40320/200285 [=====>........................] - ETA: 9:00 - loss: 2.4535
 40448/200285 [=====>........................] - ETA: 9:00 - loss: 2.4523
 40576/200285 [=====>........................] - ETA: 9:00 - loss: 2.4518

*** WARNING: skipped 6880799 bytes of output ***

160256/200285 [=======================>......] - ETA: 32s - loss: 1.2854
160384/200285 [=======================>......] - ETA: 32s - loss: 1.2855
160512/200285 [=======================>......] - ETA: 31s - loss: 1.2855
160640/200285 [=======================>......] - ETA: 31s - loss: 1.2855
160768/200285 [=======================>......] - ETA: 31s - loss: 1.2855
160896/200285 [=======================>......] - ETA: 31s - loss: 1.2855
161024/200285 [=======================>......] - ETA: 31s - loss: 1.2855
161152/200285 [=======================>......] - ETA: 31s - loss: 1.2857
161280/200285 [=======================>......] - ETA: 31s - loss: 1.2857
161408/200285 [=======================>......] - ETA: 31s - loss: 1.2858
161536/200285 [=======================>......] - ETA: 31s - loss: 1.2857
161664/200285 [=======================>......] - ETA: 31s - loss: 1.2857
161792/200285 [=======================>......] - ETA: 30s - loss: 1.2857
161920/200285 [=======================>......] - ETA: 30s - loss: 1.2859
162048/200285 [=======================>......] - ETA: 30s - loss: 1.2860
162176/200285 [=======================>......] - ETA: 30s - loss: 1.2859
162304/200285 [=======================>......] - ETA: 30s - loss: 1.2859
162432/200285 [=======================>......] - ETA: 30s - loss: 1.2860
162560/200285 [=======================>......] - ETA: 30s - loss: 1.2860
162688/200285 [=======================>......] - ETA: 30s - loss: 1.2862
162816/200285 [=======================>......] - ETA: 30s - loss: 1.2861
162944/200285 [=======================>......] - ETA: 30s - loss: 1.2862
163072/200285 [=======================>......] - ETA: 29s - loss: 1.2862
163200/200285 [=======================>......] - ETA: 29s - loss: 1.2862
163328/200285 [=======================>......] - ETA: 29s - loss: 1.2860
163456/200285 [=======================>......] - ETA: 29s - loss: 1.2860
163584/200285 [=======================>......] - ETA: 29s - loss: 1.2859
163712/200285 [=======================>......] - ETA: 29s - loss: 1.2859
163840/200285 [=======================>......] - ETA: 29s - loss: 1.2859
163968/200285 [=======================>......] - ETA: 29s - loss: 1.2856
164096/200285 [=======================>......] - ETA: 29s - loss: 1.2857
164224/200285 [=======================>......] - ETA: 28s - loss: 1.2858
164352/200285 [=======================>......] - ETA: 28s - loss: 1.2858
164480/200285 [=======================>......] - ETA: 28s - loss: 1.2858
164608/200285 [=======================>......] - ETA: 28s - loss: 1.2857
164736/200285 [=======================>......] - ETA: 28s - loss: 1.2858
164864/200285 [=======================>......] - ETA: 28s - loss: 1.2858
164992/200285 [=======================>......] - ETA: 28s - loss: 1.2857
165120/200285 [=======================>......] - ETA: 28s - loss: 1.2857
165248/200285 [=======================>......] - ETA: 28s - loss: 1.2857
165376/200285 [=======================>......] - ETA: 28s - loss: 1.2859
165504/200285 [=======================>......] - ETA: 27s - loss: 1.2860
165632/200285 [=======================>......] - ETA: 27s - loss: 1.2859
165760/200285 [=======================>......] - ETA: 27s - loss: 1.2857
165888/200285 [=======================>......] - ETA: 27s - loss: 1.2858
166016/200285 [=======================>......] - ETA: 27s - loss: 1.2858
166144/200285 [=======================>......] - ETA: 27s - loss: 1.2859
166272/200285 [=======================>......] - ETA: 27s - loss: 1.2857
166400/200285 [=======================>......] - ETA: 27s - loss: 1.2858
166528/200285 [=======================>......] - ETA: 27s - loss: 1.2857
166656/200285 [=======================>......] - ETA: 27s - loss: 1.2856
166784/200285 [=======================>......] - ETA: 26s - loss: 1.2858
166912/200285 [========================>.....] - ETA: 26s - loss: 1.2858
167040/200285 [========================>.....] - ETA: 26s - loss: 1.2858
167168/200285 [========================>.....] - ETA: 26s - loss: 1.2859
167296/200285 [========================>.....] - ETA: 26s - loss: 1.2858
167424/200285 [========================>.....] - ETA: 26s - loss: 1.2859
167552/200285 [========================>.....] - ETA: 26s - loss: 1.2861
167680/200285 [========================>.....] - ETA: 26s - loss: 1.2862
167808/200285 [========================>.....] - ETA: 26s - loss: 1.2862
167936/200285 [========================>.....] - ETA: 25s - loss: 1.2863
168064/200285 [========================>.....] - ETA: 25s - loss: 1.2864
168192/200285 [========================>.....] - ETA: 25s - loss: 1.2862
168320/200285 [========================>.....] - ETA: 25s - loss: 1.2863
168448/200285 [========================>.....] - ETA: 25s - loss: 1.2862
168576/200285 [========================>.....] - ETA: 25s - loss: 1.2862
168704/200285 [========================>.....] - ETA: 25s - loss: 1.2862
168832/200285 [========================>.....] - ETA: 25s - loss: 1.2862
168960/200285 [========================>.....] - ETA: 25s - loss: 1.2861
169088/200285 [========================>.....] - ETA: 25s - loss: 1.2862
169216/200285 [========================>.....] - ETA: 24s - loss: 1.2862
169344/200285 [========================>.....] - ETA: 24s - loss: 1.2863
169472/200285 [========================>.....] - ETA: 24s - loss: 1.2862
169600/200285 [========================>.....] - ETA: 24s - loss: 1.2862
169728/200285 [========================>.....] - ETA: 24s - loss: 1.2864
169856/200285 [========================>.....] - ETA: 24s - loss: 1.2863
169984/200285 [========================>.....] - ETA: 24s - loss: 1.2864
170112/200285 [========================>.....] - ETA: 24s - loss: 1.2865
170240/200285 [========================>.....] - ETA: 24s - loss: 1.2864
170368/200285 [========================>.....] - ETA: 24s - loss: 1.2864
170496/200285 [========================>.....] - ETA: 23s - loss: 1.2865
170624/200285 [========================>.....] - ETA: 23s - loss: 1.2865
170752/200285 [========================>.....] - ETA: 23s - loss: 1.2865
170880/200285 [========================>.....] - ETA: 23s - loss: 1.2864
171008/200285 [========================>.....] - ETA: 23s - loss: 1.2866
171136/200285 [========================>.....] - ETA: 23s - loss: 1.2866
171264/200285 [========================>.....] - ETA: 23s - loss: 1.2865
171392/200285 [========================>.....] - ETA: 23s - loss: 1.2866
171520/200285 [========================>.....] - ETA: 23s - loss: 1.2867
171648/200285 [========================>.....] - ETA: 23s - loss: 1.2867
171776/200285 [========================>.....] - ETA: 22s - loss: 1.2867
171904/200285 [========================>.....] - ETA: 22s - loss: 1.2868
172032/200285 [========================>.....] - ETA: 22s - loss: 1.2869
172160/200285 [========================>.....] - ETA: 22s - loss: 1.2869
172288/200285 [========================>.....] - ETA: 22s - loss: 1.2870
172416/200285 [========================>.....] - ETA: 22s - loss: 1.2870
172544/200285 [========================>.....] - ETA: 22s - loss: 1.2870
172672/200285 [========================>.....] - ETA: 22s - loss: 1.2869
172800/200285 [========================>.....] - ETA: 22s - loss: 1.2869
172928/200285 [========================>.....] - ETA: 21s - loss: 1.2869
173056/200285 [========================>.....] - ETA: 21s - loss: 1.2870
173184/200285 [========================>.....] - ETA: 21s - loss: 1.2870
173312/200285 [========================>.....] - ETA: 21s - loss: 1.2869
173440/200285 [========================>.....] - ETA: 21s - loss: 1.2869
173568/200285 [========================>.....] - ETA: 21s - loss: 1.2869
173696/200285 [=========================>....] - ETA: 21s - loss: 1.2870
173824/200285 [=========================>....] - ETA: 21s - loss: 1.2870
173952/200285 [=========================>....] - ETA: 21s - loss: 1.2869
174080/200285 [=========================>....] - ETA: 21s - loss: 1.2871
174208/200285 [=========================>....] - ETA: 20s - loss: 1.2871
174336/200285 [=========================>....] - ETA: 20s - loss: 1.2871
174464/200285 [=========================>....] - ETA: 20s - loss: 1.2871
174592/200285 [=========================>....] - ETA: 20s - loss: 1.2870
174720/200285 [=========================>....] - ETA: 20s - loss: 1.2870
174848/200285 [=========================>....] - ETA: 20s - loss: 1.2870
174976/200285 [=========================>....] - ETA: 20s - loss: 1.2870
175104/200285 [=========================>....] - ETA: 20s - loss: 1.2870
175232/200285 [=========================>....] - ETA: 20s - loss: 1.2870
175360/200285 [=========================>....] - ETA: 20s - loss: 1.2871
175488/200285 [=========================>....] - ETA: 19s - loss: 1.2871
175616/200285 [=========================>....] - ETA: 19s - loss: 1.2871
175744/200285 [=========================>....] - ETA: 19s - loss: 1.2872
175872/200285 [=========================>....] - ETA: 19s - loss: 1.2871
176000/200285 [=========================>....] - ETA: 19s - loss: 1.2871
176128/200285 [=========================>....] - ETA: 19s - loss: 1.2870
176256/200285 [=========================>....] - ETA: 19s - loss: 1.2870
176384/200285 [=========================>....] - ETA: 19s - loss: 1.2872
176512/200285 [=========================>....] - ETA: 19s - loss: 1.2872
176640/200285 [=========================>....] - ETA: 18s - loss: 1.2872
176768/200285 [=========================>....] - ETA: 18s - loss: 1.2874
176896/200285 [=========================>....] - ETA: 18s - loss: 1.2875
177024/200285 [=========================>....] - ETA: 18s - loss: 1.2874
177152/200285 [=========================>....] - ETA: 18s - loss: 1.2873
177280/200285 [=========================>....] - ETA: 18s - loss: 1.2873
177408/200285 [=========================>....] - ETA: 18s - loss: 1.2875
177536/200285 [=========================>....] - ETA: 18s - loss: 1.2877
177664/200285 [=========================>....] - ETA: 18s - loss: 1.2875
177792/200285 [=========================>....] - ETA: 18s - loss: 1.2874
177920/200285 [=========================>....] - ETA: 17s - loss: 1.2876
178048/200285 [=========================>....] - ETA: 17s - loss: 1.2878
178176/200285 [=========================>....] - ETA: 17s - loss: 1.2879
178304/200285 [=========================>....] - ETA: 17s - loss: 1.2878
178432/200285 [=========================>....] - ETA: 17s - loss: 1.2878
178560/200285 [=========================>....] - ETA: 17s - loss: 1.2878
178688/200285 [=========================>....] - ETA: 17s - loss: 1.2880
178816/200285 [=========================>....] - ETA: 17s - loss: 1.2878
178944/200285 [=========================>....] - ETA: 17s - loss: 1.2878
179072/200285 [=========================>....] - ETA: 17s - loss: 1.2877
179200/200285 [=========================>....] - ETA: 16s - loss: 1.2875
179328/200285 [=========================>....] - ETA: 16s - loss: 1.2876
179456/200285 [=========================>....] - ETA: 16s - loss: 1.2877
179584/200285 [=========================>....] - ETA: 16s - loss: 1.2877
179712/200285 [=========================>....] - ETA: 16s - loss: 1.2877
179840/200285 [=========================>....] - ETA: 16s - loss: 1.2879
179968/200285 [=========================>....] - ETA: 16s - loss: 1.2878
180096/200285 [=========================>....] - ETA: 16s - loss: 1.2877
180224/200285 [=========================>....] - ETA: 16s - loss: 1.2876
180352/200285 [==========================>...] - ETA: 16s - loss: 1.2876
180480/200285 [==========================>...] - ETA: 15s - loss: 1.2877
180608/200285 [==========================>...] - ETA: 15s - loss: 1.2877
180736/200285 [==========================>...] - ETA: 15s - loss: 1.2878
180864/200285 [==========================>...] - ETA: 15s - loss: 1.2877
180992/200285 [==========================>...] - ETA: 15s - loss: 1.2878
181120/200285 [==========================>...] - ETA: 15s - loss: 1.2879
181248/200285 [==========================>...] - ETA: 15s - loss: 1.2878
181376/200285 [==========================>...] - ETA: 15s - loss: 1.2878
181504/200285 [==========================>...] - ETA: 15s - loss: 1.2879
181632/200285 [==========================>...] - ETA: 14s - loss: 1.2879
181760/200285 [==========================>...] - ETA: 14s - loss: 1.2880
181888/200285 [==========================>...] - ETA: 14s - loss: 1.2880
182016/200285 [==========================>...] - ETA: 14s - loss: 1.2879
182144/200285 [==========================>...] - ETA: 14s - loss: 1.2879
182272/200285 [==========================>...] - ETA: 14s - loss: 1.2879
182400/200285 [==========================>...] - ETA: 14s - loss: 1.2882
182528/200285 [==========================>...] - ETA: 14s - loss: 1.2882
182656/200285 [==========================>...] - ETA: 14s - loss: 1.2882
182784/200285 [==========================>...] - ETA: 14s - loss: 1.2883
182912/200285 [==========================>...] - ETA: 13s - loss: 1.2884
183040/200285 [==========================>...] - ETA: 13s - loss: 1.2883
183168/200285 [==========================>...] - ETA: 13s - loss: 1.2883
183296/200285 [==========================>...] - ETA: 13s - loss: 1.2882
183424/200285 [==========================>...] - ETA: 13s - loss: 1.2883
183552/200285 [==========================>...] - ETA: 13s - loss: 1.2884
183680/200285 [==========================>...] - ETA: 13s - loss: 1.2884
183808/200285 [==========================>...] - ETA: 13s - loss: 1.2884
183936/200285 [==========================>...] - ETA: 13s - loss: 1.2883
184064/200285 [==========================>...] - ETA: 13s - loss: 1.2885
184192/200285 [==========================>...] - ETA: 12s - loss: 1.2885
184320/200285 [==========================>...] - ETA: 12s - loss: 1.2885
184448/200285 [==========================>...] - ETA: 12s - loss: 1.2885
184576/200285 [==========================>...] - ETA: 12s - loss: 1.2885
184704/200285 [==========================>...] - ETA: 12s - loss: 1.2885
184832/200285 [==========================>...] - ETA: 12s - loss: 1.2885
184960/200285 [==========================>...] - ETA: 12s - loss: 1.2886
185088/200285 [==========================>...] - ETA: 12s - loss: 1.2886
185216/200285 [==========================>...] - ETA: 12s - loss: 1.2886
185344/200285 [==========================>...] - ETA: 12s - loss: 1.2885
185472/200285 [==========================>...] - ETA: 11s - loss: 1.2886
185600/200285 [==========================>...] - ETA: 11s - loss: 1.2885
185728/200285 [==========================>...] - ETA: 11s - loss: 1.2885
185856/200285 [==========================>...] - ETA: 11s - loss: 1.2885
185984/200285 [==========================>...] - ETA: 11s - loss: 1.2883
186112/200285 [==========================>...] - ETA: 11s - loss: 1.2884
186240/200285 [==========================>...] - ETA: 11s - loss: 1.2884
186368/200285 [==========================>...] - ETA: 11s - loss: 1.2884
186496/200285 [==========================>...] - ETA: 11s - loss: 1.2884
186624/200285 [==========================>...] - ETA: 10s - loss: 1.2887
186752/200285 [==========================>...] - ETA: 10s - loss: 1.2888
186880/200285 [==========================>...] - ETA: 10s - loss: 1.2888
187008/200285 [===========================>..] - ETA: 10s - loss: 1.2888
187136/200285 [===========================>..] - ETA: 10s - loss: 1.2888
187264/200285 [===========================>..] - ETA: 10s - loss: 1.2888
187392/200285 [===========================>..] - ETA: 10s - loss: 1.2889
187520/200285 [===========================>..] - ETA: 10s - loss: 1.2889
187648/200285 [===========================>..] - ETA: 10s - loss: 1.2887
187776/200285 [===========================>..] - ETA: 10s - loss: 1.2887
187904/200285 [===========================>..] - ETA: 9s - loss: 1.2887 
188032/200285 [===========================>..] - ETA: 9s - loss: 1.2888
188160/200285 [===========================>..] - ETA: 9s - loss: 1.2888
188288/200285 [===========================>..] - ETA: 9s - loss: 1.2890
188416/200285 [===========================>..] - ETA: 9s - loss: 1.2891
188544/200285 [===========================>..] - ETA: 9s - loss: 1.2889
188672/200285 [===========================>..] - ETA: 9s - loss: 1.2889
188800/200285 [===========================>..] - ETA: 9s - loss: 1.2888
188928/200285 [===========================>..] - ETA: 9s - loss: 1.2887
189056/200285 [===========================>..] - ETA: 9s - loss: 1.2886
189184/200285 [===========================>..] - ETA: 8s - loss: 1.2886
189312/200285 [===========================>..] - ETA: 8s - loss: 1.2886
189440/200285 [===========================>..] - ETA: 8s - loss: 1.2886
189568/200285 [===========================>..] - ETA: 8s - loss: 1.2886
189696/200285 [===========================>..] - ETA: 8s - loss: 1.2885
189824/200285 [===========================>..] - ETA: 8s - loss: 1.2885
189952/200285 [===========================>..] - ETA: 8s - loss: 1.2884
190080/200285 [===========================>..] - ETA: 8s - loss: 1.2883
190208/200285 [===========================>..] - ETA: 8s - loss: 1.2881
190336/200285 [===========================>..] - ETA: 7s - loss: 1.2881
190464/200285 [===========================>..] - ETA: 7s - loss: 1.2882
190592/200285 [===========================>..] - ETA: 7s - loss: 1.2882
190720/200285 [===========================>..] - ETA: 7s - loss: 1.2882
190848/200285 [===========================>..] - ETA: 7s - loss: 1.2881
190976/200285 [===========================>..] - ETA: 7s - loss: 1.2881
191104/200285 [===========================>..] - ETA: 7s - loss: 1.2882
191232/200285 [===========================>..] - ETA: 7s - loss: 1.2881
191360/200285 [===========================>..] - ETA: 7s - loss: 1.2881
191488/200285 [===========================>..] - ETA: 7s - loss: 1.2881
191616/200285 [===========================>..] - ETA: 6s - loss: 1.2880
191744/200285 [===========================>..] - ETA: 6s - loss: 1.2880
191872/200285 [===========================>..] - ETA: 6s - loss: 1.2879
192000/200285 [===========================>..] - ETA: 6s - loss: 1.2880
192128/200285 [===========================>..] - ETA: 6s - loss: 1.2880
192256/200285 [===========================>..] - ETA: 6s - loss: 1.2879
192384/200285 [===========================>..] - ETA: 6s - loss: 1.2880
192512/200285 [===========================>..] - ETA: 6s - loss: 1.2880
192640/200285 [===========================>..] - ETA: 6s - loss: 1.2880
192768/200285 [===========================>..] - ETA: 6s - loss: 1.2880
192896/200285 [===========================>..] - ETA: 5s - loss: 1.2881
193024/200285 [===========================>..] - ETA: 5s - loss: 1.2883
193152/200285 [===========================>..] - ETA: 5s - loss: 1.2884
193280/200285 [===========================>..] - ETA: 5s - loss: 1.2886
193408/200285 [===========================>..] - ETA: 5s - loss: 1.2886
193536/200285 [===========================>..] - ETA: 5s - loss: 1.2887
193664/200285 [============================>.] - ETA: 5s - loss: 1.2891
193792/200285 [============================>.] - ETA: 5s - loss: 1.2890
193920/200285 [============================>.] - ETA: 5s - loss: 1.2890
194048/200285 [============================>.] - ETA: 5s - loss: 1.2890
194176/200285 [============================>.] - ETA: 4s - loss: 1.2889
194304/200285 [============================>.] - ETA: 4s - loss: 1.2889
194432/200285 [============================>.] - ETA: 4s - loss: 1.2888
194560/200285 [============================>.] - ETA: 4s - loss: 1.2888
194688/200285 [============================>.] - ETA: 4s - loss: 1.2888
194816/200285 [============================>.] - ETA: 4s - loss: 1.2887
194944/200285 [============================>.] - ETA: 4s - loss: 1.2886
195072/200285 [============================>.] - ETA: 4s - loss: 1.2887
195200/200285 [============================>.] - ETA: 4s - loss: 1.2888
195328/200285 [============================>.] - ETA: 3s - loss: 1.2888
195456/200285 [============================>.] - ETA: 3s - loss: 1.2889
195584/200285 [============================>.] - ETA: 3s - loss: 1.2890
195712/200285 [============================>.] - ETA: 3s - loss: 1.2890
195840/200285 [============================>.] - ETA: 3s - loss: 1.2890
195968/200285 [============================>.] - ETA: 3s - loss: 1.2891
196096/200285 [============================>.] - ETA: 3s - loss: 1.2891
196224/200285 [============================>.] - ETA: 3s - loss: 1.2891
196352/200285 [============================>.] - ETA: 3s - loss: 1.2893
196480/200285 [============================>.] - ETA: 3s - loss: 1.2893
196608/200285 [============================>.] - ETA: 2s - loss: 1.2892
196736/200285 [============================>.] - ETA: 2s - loss: 1.2891
196864/200285 [============================>.] - ETA: 2s - loss: 1.2893
196992/200285 [============================>.] - ETA: 2s - loss: 1.2891
197120/200285 [============================>.] - ETA: 2s - loss: 1.2892
197248/200285 [============================>.] - ETA: 2s - loss: 1.2892
197376/200285 [============================>.] - ETA: 2s - loss: 1.2891
197504/200285 [============================>.] - ETA: 2s - loss: 1.2891
197632/200285 [============================>.] - ETA: 2s - loss: 1.2892
197760/200285 [============================>.] - ETA: 2s - loss: 1.2892
197888/200285 [============================>.] - ETA: 1s - loss: 1.2892
198016/200285 [============================>.] - ETA: 1s - loss: 1.2893
198144/200285 [============================>.] - ETA: 1s - loss: 1.2894
198272/200285 [============================>.] - ETA: 1s - loss: 1.2893
198400/200285 [============================>.] - ETA: 1s - loss: 1.2893
198528/200285 [============================>.] - ETA: 1s - loss: 1.2893
198656/200285 [============================>.] - ETA: 1s - loss: 1.2894
198784/200285 [============================>.] - ETA: 1s - loss: 1.2897
198912/200285 [============================>.] - ETA: 1s - loss: 1.2897
199040/200285 [============================>.] - ETA: 1s - loss: 1.2897
199168/200285 [============================>.] - ETA: 0s - loss: 1.2897
199296/200285 [============================>.] - ETA: 0s - loss: 1.2899
199424/200285 [============================>.] - ETA: 0s - loss: 1.2900
199552/200285 [============================>.] - ETA: 0s - loss: 1.2900
199680/200285 [============================>.] - ETA: 0s - loss: 1.2900
199808/200285 [============================>.] - ETA: 0s - loss: 1.2899
199936/200285 [============================>.] - ETA: 0s - loss: 1.2900
200064/200285 [============================>.] - ETA: 0s - loss: 1.2902
200192/200285 [============================>.] - ETA: 0s - loss: 1.2900
200285/200285 [==============================] - 161s 804us/step - loss: 1.2899

----- diversity: 0.2
----- Generating with seed: "re fostered; the species needs itself as"
re fostered; the species needs itself as a man is a strong for the strength of the subjection of the strength of the still finally and all that is a present and the strength of the power of the strive of the sense of the probably and the state of the subjection of the spiritual and stands and the strength of the strength of the subjection of the strange, and all that is the strong stands to the former and the strength of the strength of

----- diversity: 0.5
----- Generating with seed: "re fostered; the species needs itself as"
re fostered; the species needs itself as a delight of god, the far to mankind responsibility, and all the head
and the problem
of the same type--that is the content, to us. the instinct it is sociatisment and serrection of a present and repultion of the will and delight and complancess of the strong
that is the secret and ancient devours, a strong strength and habits of the science and and laten his state to the concerned to the stread 

----- diversity: 1.0
----- Generating with seed: "re fostered; the species needs itself as"
re fostered; the species needs itself as' by a child.

1
9r
=whet for from a altrre as well conscience that there are that is always bemn) pernewlies, and that sthe or unines"--but in his consciven to us? but as attaine and internil, exception id strength of frenchmen spects.--the most bodyy and came to a nemensy in the glooly, reun in every metaphorion; or as srigor appreciates, have path plant, the bestow daesersy; this,--according to

----- diversity: 1.2
----- Generating with seed: "re fostered; the species needs itself as"
re fostered; the species needs itself as
side, such belief.

25xaxence; the most fical tumm his not glan apttignd burding, the longly?incitians,
toripaped seems ones"--a natural libering,
free fortune, suskinatic wisre possessing couragematation, exulation: with a long especient,
and they which has been regear who have physeem being i him iting
were-do againstives a cases of a cries:
"his fact
agr ity gup.

6hxthsb these, io do alvated