Skip to content

Commit

Permalink
Some missing parameters
Browse files Browse the repository at this point in the history
  • Loading branch information
svebk committed Jan 22, 2020
1 parent 05ab188 commit c6c209b
Show file tree
Hide file tree
Showing 2 changed files with 19 additions and 2 deletions.
10 changes: 10 additions & 0 deletions setup/all-in-one/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,16 @@ The monitoring docker compose files will additionally start a docker container f
it should be accessible at [http:https://localhost:9997/kafka_manager/](http:https://localhost:9997/kafka_manager/).
However, by default no Kafka clusters will be available. You need to add your cluster based on the settings of the environment file you use.

## Startup issues

If the API port is already used you would get an error like:
> Error starting userland proxy: listen tcp 0.0.0.0:80: bind: address already in use
You can run the following command to check which process are causing the issue:
```sudo lsof -i:80 -P -n | grep LISTEN```. You can either kill the running process, e.g. apache, or change the `port_host` parameter
in the environment file.


## Check status

You can check all docker logs to monitor the processing status.
Expand Down
11 changes: 9 additions & 2 deletions setup/all-in-one/docker-compose_kinesis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -76,11 +76,13 @@ services:
environment:
# General environment variables
- input_type
- "image_pushing_type=${image_ingestion_type}"
- input_path
- input_nb_threads
- verbose
- source_zip
- "nb_workers=${input_nb_workers}"
- input_nb_workers
#- "nb_workers=${input_nb_workers}"
- "conf_name=${input_conf_name}"
# # Kafka related environment variables
# - input_topic
Expand All @@ -96,6 +98,7 @@ services:
- endpoint_url
- producer_type
- producer_prefix
#- "PYTHONWARNINGS='ignore:Unverified HTTPS request'" # Does not seem to work
cap_add:
- IPC_LOCK
# nothing really needs to be persistent here. no other volumes needed
Expand Down Expand Up @@ -124,9 +127,12 @@ services:
environment:
# General environment variables
- input_type
- image_ingestion_type
- update_ingestion_type
- producer_type
- region_name
- images_stream
- "image_shard_infos_filename=${indocker_repo_path}/kinesis_${images_stream}_${extr_conf_name}.json"
- aws_profile
- verify_certificates
- endpoint_url
Expand All @@ -153,6 +159,7 @@ services:
- image_buffer_column_family
- image_buffer_column_name
- update_info_column_family
- "PYTHONWARNINGS='ignore:Unverified HTTPS request'"
# nothing really needs to be persistent here. no other volumes needed
volumes:
- $repo_path:$indocker_repo_path
Expand Down Expand Up @@ -194,7 +201,7 @@ services:
- table_updateinfos
- batch_update_size
- column_list_sha1s
- extr_family_column
- extr_column_family
- image_info_column_family
- image_buffer_column_family
- image_buffer_column_name
Expand Down

0 comments on commit c6c209b

Please sign in to comment.