The project will help you create in runtime dynamic routing backend based on URL stored in Redis. If you want to dynamically create or serve some backend (web app, vm or other services) for your users you can save custom url in Redis and it will work without restarting the nginx.

The main goal is to build the counterpart of hipache (https://github.com/hipache/hipache) with nginx. The proxy tries to find the host in redis database and without the reloading (proxy server) use it as upstream server.

The data stored in redis is in the same format as in hipache. All code is built from source.

This procject is based on wonderfull projects:

• https://github.com/danday74/docker-nginx-lua
• https://github.com/samalba/hipache-nginx

1. Run REDIS database, it is essential to name it redis, because the lua resty redis connection objects rely on hostname=redis,

   docker run -d --name redis redis
   

2. Run nginx-lua-proxy container and linked it with redis

   docker run -d --link redis:redis -p 9090:80 --name $CONTAINER_NAME ermlab/nginx-lua-proxy
   

3. Add to redis some hosts

   $ redis-cli rpush frontend:dynamic1.example.com mywebsite
   $ redis-cli rpush frontend:dynamic1.example.com https://192.168.0.50:80
   
   $ redis-cli rpush frontend:dynamic2.example.com mywebsite
   $ redis-cli rpush frontend:dynamic2.example.com https://192.168.0.100:80
   

4. Check if everything is working

   curl -H 'Host: dynamic1.example.com' https://localhost:9090
   
   or
   
   curl -H 'Host: dynamic2.example.com' https://localhost:9090
   

5. If you want to test in the browser you should set the dns wildcard for domain *.example.com and it should point to your nginx proxy

Testing scenario:

• at front sits haproxy and do routing between two backends: hipache.ermlab.com and nginx.ermlab.com
• haproxy redirects traffic from *.hipache.ermlab.com to hipache proxy and *.nginx.ermlab.com to nginx-lua-proxy
• haproxy, hipache, nginx-lua-proxy and redis are installed on the same server (proxy server)
• there is one simple static website, it is available at 192.168.0.10 (web server)
• redis contains two dynamic backends both point to the same website (192.168.0.10)
  • host for hipache: id1.hipache.ermlab.com->192.168.0.10
  • host for nginx-lua-proxy: id1.nginx.ermlab.com->192.168.0.10
• software runs as docker containers: redis, hipache, nginx-lua-proxy
• proxy server and web server have 2CPUs and 2GB RAM

Testing with apache benchmark

ab -n 20000 -c 200 https://id1.hipache.ermlab.com
ab -n 20000 -c 200 https://id1.nginx.ermlab.com

*Lower is better

**Higher is better

Our solution is 3-4x better than Hipache.

All VHOST configuration is managed through a REDIS. This makes it possible to update the configuration dynamically and gracefully while the server is running, and have that state shared across workers.

Let's take an example to proxify requests to 2 backends for the hostname example.com. The 2 backends IP are 192.168.0.42 and 192.168.0.43 and they serve the HTTP traffic on the port 80.

redis-cli is the standard client tool to talk to Redis from the terminal.

Follow these steps:

1. Create the frontend and associate an identifier:

    $ redis-cli rpush frontend:example.com mywebsite
    (integer) 1
   

The frontend identifier is mywebsite, it could be anything.

2. Associate the 2 backends:

    $ redis-cli rpush frontend:example.com https://192.168.0.42:80
    (integer) 2
    $ redis-cli rpush frontend:example.com https://192.168.0.43:80
    (integer) 3
   

3. Review the configuration:

    $ redis-cli lrange frontend:example.com 0 -1
    1) "mywebsite"
    2) "https://192.168.0.42:80"
    3) "https://192.168.0.43:80"
   

While the server is running, any of these steps can be re-run without messing up with the traffic.

The master branch on the GitHub repo is watched by an automated docker build

Which builds docker image ermlab/nginx-lua on push to master

On success, the docker build triggers the docker repo's webhooks (if any)

• Ermlab software house
  • Krzysztof Sopyła ([email protected])

https://www.apache.org/licenses/LICENSE-2.0

APACHE LICENSE-2.0 ... In other words, please use freely and do whatever you want with it for good of all people :)

1. Run REDIS database, it is essential to name it redis, because the lua resty redis connection objects relies on hostname=redis,

   docker run -d --name redis redis
   

2. Run nginx-lua-proxy container and linked it with redis

   docker run -d --link redis:redis -p 9090:80 --name $CONTAINER_NAME ermlab/nginx-lua-proxy
   

3. Add to redis some hosts

   $ redis-cli rpush frontend:dynamic1.example.com mywebsite
   $ redis-cli rpush frontend:dynamic1.example.com https://192.168.0.50:80
   
   $ redis-cli rpush frontend:dynamic2.example.com mywebsite
   $ redis-cli rpush frontend:dynamic2.example.com https://192.168.0.100:80
   

4. Check if everything is working

   curl -H 'Host: dynamic1.example.com' https://localhost:9090
   
   or
   
   curl -H 'Host: dynamic2.example.com' https://localhost:9090
   

5. If you want to test in the browser you should set the dns wildcard for domain *.example.com and it should point to your nginx proxy

Testing scenario:

• at front sits haproxy and do routing between two backends: hipache.ermlab.com and nginx.ermlab.com
• haproxy redirects traffic from *.hipache.ermlab.com to hipache proxy and *.nginx.ermlab.com to nginx-lua-proxy
• haproxy, hipache, nginx-lua-proxy and redis are installed on the same server (proxy server)
• there is one simple static website, it is available at 192.168.0.10 (web server)
• redis contains two dynamic backends both point to the same website (192.168.0.10)
  • host for hipache: id1.hipache.ermlab.com->192.168.0.10
  • host for nginx-lua-proxy: id1.nginx.ermlab.com->192.168.0.10
• software runs as docker containers: redis, hipache, nginx-lua-proxy
• proxy server and web server have 2CPUs and 2GB RAM

Testing with apache benchmark

ab -n 20000 -c 200 https://id1.hipache.ermlab.com
ab -n 20000 -c 200 https://id1.nginx.ermlab.com

*Lower is better

**Higher is better

Our solution is 3-4x better than Hipache.

All VHOST configuration is managed through a REDIS. This makes it possible to update the configuration dynamically and gracefully while the server is running, and have that state shared across workers.

Let's take an example to proxify requests to 2 backends for the hostname example.com. The 2 backends IP are 192.168.0.42 and 192.168.0.43 and they serve the HTTP traffic on the port 80.

redis-cli is the standard client tool to talk to Redis from the terminal.

Follow these steps:

1. Create the frontend and associate an identifier:

    $ redis-cli rpush frontend:example.com mywebsite
    (integer) 1
   

The frontend identifer is mywebsite, it could be anything.

2. Associate the 2 backends:

    $ redis-cli rpush frontend:example.com https://192.168.0.42:80
    (integer) 2
    $ redis-cli rpush frontend:example.com https://192.168.0.43:80
    (integer) 3
   

3. Review the configuration:

    $ redis-cli lrange frontend:example.com 0 -1
    1) "mywebsite"
    2) "https://192.168.0.42:80"
    3) "https://192.168.0.43:80"
   

While the server is running, any of these steps can be re-run without messing up with the traffic.

The master branch on the github repo is watched by an automated docker build

Which builds docker image ermlab/nginx-lua on push to master

On success, the docker build triggers the docker repo's webhooks (if any)

• Ermlab software house
  • Krzysztof Sopyła ([email protected])

https://www.apache.org/licenses/LICENSE-2.0

APACHE LICENSE-2.0 ... In other words, please use freely and do whatever you want with it for good of all people :)