[Task]: Expand Airflow DAG documentation

[everton137]

What needs to happen?

My team is likely going to use Apache Airflow as our task scheduler. I am aware we already have one DAG example in the official documentation, but I was wondering if some best practice or real case scenarios could be shared.

I've started to play around with the Docker version of Airflow, but its docker-compose YAML file seems to be an overkill. I made an Airflow tutorial where Redis and Celery Flower are removed.

Some cases that could be added in the documentation:

• In case we have several Hop workflows, do we create a DAG for each workflow? Or we add as tasks in the same DAG? I am planning to use the DockerOperator.
• How is your docker-compose YAML file?
• How to pass Hop parameters to Airflow parameters?

These are a few questions that came to my mind after a quick discussion with @bamaer in the Hop chat.

Issue Priority

Priority: 2

Issue Component

Component: Documentation