Blink ETL gives you the ability to create truly flexible data pipelines to implement even-driven architecture, database replication, and data lakes
Let's give Blink a try. Check out different options to start Blink on your local machine
Currently, we offer only Linux-based arm64 build for docker
Create a config with the name blink.yaml and run the docker image
docker run -v blink.yaml:/blink.yaml usedatabrew/blink startgo install -u github.com/usedatabrew/blinkbrew tap usedatabrew/blink
brew install usedatabrew/blinkTo run Blink locally - you have to create a config file that will define streams
service:
id: 123
pipeline_id: 1234
stream_schema:
- stream: crypto_price_change
columns:
- name: name
databrewType: String
pk: true
nullable: false
- name: price
databrewType: Float64
pk: false
nullable: false
source:
driver: websocket
config:
url: ws:https://databrew-ws-gateway.fly.dev/ws
processors:
- driver: sql
config:
query: "select * from streams.crypto_price_change where name = 'BTC'"
sink:
driver: stdout
config: {}blink start -c blink-config.yaml