Follow following steps to set up GPT NeoX:

Link to setup instructions

There's a simple flask server set up in run_server.py. Requirements are :

Flask-Cors
Flask-RESTful

python run_server.py runs the server at 127.0.0.1:5000 by default.

Post endpoint setup at 127.0.0.1:5000/text_completion.

Example Post Request:

POST /text_completion HTTP/1.1
Host: 127.0.0.1:5000
Content-Type: application/json
cache-control: no-cache
{
	"prompt":"To use the facilities at your own risk, and take responsibility for any personal injury."
}