Follow following steps to set up GPT NeoX:
There's a simple flask server set up in run_server.py
.
Requirements are :
Flask-Cors
Flask-RESTful
python run_server.py
runs the server at 127.0.0.1:5000 by default.
Post endpoint setup at 127.0.0.1:5000/text_completion
.
Example Post Request:
POST /text_completion HTTP/1.1
Host: 127.0.0.1:5000
Content-Type: application/json
cache-control: no-cache
{
"prompt":"To use the facilities at your own risk, and take responsibility for any personal injury."
}