An example microservice pipeline to visualize the tech stack demand on the current job market.
- Install docker/docker-compose
- Assure docker has enough resources (Preferences > Advanced; tested with 4 CPUs and 6 GiB RAM)
- Run
docker-compose up - Open in your browser http:https://localhost:5000/
- Collect new data (reload page to see progress; this can take up to 20 min)
- Check out this basic action wiki
- Kafka logs are not mounted
- While collecting new data, check http:https://localhost:9000/
- Data mounted to /neo4j_data_loader/neo4j_data
- Open Neo4j browser: http:https://localhost:7474/
- Login with user: neo4j password: password
docker-compose -f docker-compose-tests.yml up
- Delete old data saved in
keywords_api/redis_data - Run:
docker-compose -f docker-compose-keywords-update.yml up