Original README renamed to GPT-2.

Just playing around with this:

• Commented out model downloads from docker files.
• Tidy some basic formatting.
• Default "model" is already set to 124M.
• Edit "top_k" (diversity) to default to 40.
• Fix access path to sort in "sample.py", tf.contrib.framework.sort.
• Update docker files to (latest V1) tensorflow 1.15.2.
• Fix some of the compatibility issues highlighted.

Instead of using my usual Linux Laptop I tested this on my Windows Desktop PC using the latest Windows 10 WSL 2 (Windows Subsystem for Linux) with Ubuntu 20.04 LTS and Windows Docker Desktop.

Open a linux shell to install pip3 (Python3 package installer), clone this repository and install the requirements:

$ cd ~
$ sudo apt install python3-pip
$ git clone https://github.com/RatJuggler/gpt-2.git
$ pip3 intall -r requirements.txt
$ echo 'PATH="$PATH:$HOME/.local/bin"' >> ~/.profile

Since we updated the PATH in .profile we need to exit the shell then restart it.

We can then download the model we want (I'm starting with the smallest), build and run the docker image and finally run the generation (ignore any compatibility warnings due to using the older V1 TensorFlow):

$ cd ~/gpt-2
$ python3 download_model.py 124M
$ docker image build --tag gpt-2:0.1 -f Dockerfile.cpu .
$ docker run -it -v ~/gpt-2/:/gpt-2 gpt-2:0.1 bash
.../gpt-t# python3 src/generate_unconditional_samples.py
.../gpt-t# python3 src/interactive_conditional_samples.py

Remember you are now in the Docker shell so make sure to exit that before making any other changes.

The large model is just over 6GB should you want to download and run with that (there is no need to rebuild the docker image):

$ python3 download_model.py 1558M
$ docker run -it -v ~/gpt-2/:/gpt-2 gpt-2:0.1 bash
.../gpt-t# python3 src/generate_unconditional_samples.py --model=1558M
.../gpt-t# python3 src/interactive_conditional_samples.py --model=1558M

Londoners, the people of London, are proud of their city's rich culture and heritage, the importance of which can be seen in the many national and cultural sits of honor. Historically, London remains one of the world's principal cities of literature, music, theatre, drama and architecture. One of the oldest extant sites for artistic performance, theater and architecture is the British Library. This famous institution, the oldest and most significant in the UK, houses some of the world's greatest collections of manuscripts, paintings, prints, art, pottery and the collection of world monuments ″from the Pyramids to Stonehenge to Wembley Stadium to London Bridge to Nelson's Column.

The London Eye was built in 1794. The London Eye, which is the main light at the heart of the city, was constructed to show the location of The New Great Exhibition, which began in the autumn of 1851 and lasted for over a year. The original London Eye was constructed as much in honour of The London Times as it was to help display the sights of the city at night. The London Eye was constructed by architect Sir Richard B. Smith (1788–1871) and the former editor of the London Times, Joseph Needham (1810–1860). It consists of a 60-foot (18 m) high white iron structure (the London Eye's tower) and a 50-