Debezium Server is a standalone Java application built on Qurkus framework.
The application itself contains the core
module and a set of modules responsible for communication with different target systems.
The per-module integration tests depend on the availability of the external services. It is thus recommended to execute integration tests per-module and set-up necessary pre-requisities beforehand.
Note: running these tests against external infrastructure may incur cost with your cloud provider. We're not going to pay your AWS/GCP/Azure bill.
- Execute
aws configure
as described in AWS CLI getting started guide and setup the account. - Create Kinesis stream
aws kinesis create-stream --stream-name testc.inventory.customers --shard-count 1
- Build the module and execute the tests
mvn clean install -DskipITs=false -am -pl debezium-server-kinesis
- Remove the stream
aws kinesis delete-stream --stream-name testc.inventory.customers
- Login into your Google Cloud account using
gcloud auth application-default login
as described in the documentation. - Build the module and execute the tests
mvn clean install -DskipITs=false -am -pl debezium-server-pubsub
Login into your Azure account and create a resource group, e.g. on the CLI:
az login
az group create --name eventhubstest --location westeurope
Create an Event Hubs namespace. Check the documentation for options on how do this using the Azure Portal, Azure CLI etc., e.g. on the CLI:
az eventhubs namespace create --name debezium-test --resource-group eventhubstest -l westeurope
Create an Event Hub (equivalent to a topic) with one
partition. Check the documentation for options on how do this using the Azure Portal, Azure CLI etc. , e.g. on the CLI:
az eventhubs eventhub create --name debezium-test-hub --resource-group eventhubstest --namespace-name debezium-test
Get the Connection string required to communicate with Event Hubs. The format is: Endpoint=sb:https://<NAMESPACE>/;SharedAccessKeyName=<ACCESS_KEY_NAME>;SharedAccessKey=<ACCESS_KEY_VALUE>
.
E.g. on the CLI:
az eventhubs namespace authorization-rule keys list --resource-group eventhubstest --namespace-name debezium-test --name RootManageSharedAccessKey
Set environment variables required for tests:
export EVENTHUBS_CONNECTION_STRING=<Event Hubs connection string>
export EVENTHUBS_NAME=<name of the Event hub created in previous step>
Execute the tests:
mvn clean install -DskipITs=false -Deventhubs.connection.string=$EVENTHUBS_CONNECTION_STRING -Deventhubs.hub.name=$EVENTHUBS_NAME -am -pl :debezium-server-eventhubs
E.g. using kafkacat. Create kafkacat.conf:
metadata.broker.list=debezium-test.servicebus.windows.net:9093
security.protocol=SASL_SSL
sasl.mechanisms=PLAIN
sasl.username=$ConnectionString
sasl.password=Endpoint=sb:https://debezium-test.servicebus.windows.net/;SharedAccessKeyName=RootManageSharedAccessKey;SharedAccessKey=<access key>
Start consuming events:
export KAFKACAT_CONFIG= kafkacat -b debezium-test.servicebus.windows.net:9093 -t debezium-test-hub
Delete the Event Hubs namespace and log out, e.g. on the CLI:
az group delete -n eventhubstest
az logout