Python

I have a list of operators that were appended to a list in a for loop. I would like to set a relationship for my DAG where each task is set downstream in the order of the list. For example

task_list = []
for operator in operator_array:
    task = operator
    task_list.append(task)

# theoretically I would want something like this:

some_other_operator >> task_list[0] >> task_list[1] >> task_list[2] and so on and so forth for however long the length of the list is

JavaScript
​x
 
task_list = []
for operator in operator_array:
    task = operator
    task_list.append(task)
​
# theoretically I would want something like this:
​
some_other_operator >> task_list[0] >> task_list[1] >> task_list[2] and so on and so forth for however long the length of the list is
​
​

Thank you

Answer

There’s a helper function created for that, will be much more performant than the accepted answer

See airflow.utils.helpers module

from airflow.utils.helpers import chain

chain(*task_list)

JavaScript
 
from airflow.utils.helpers import chain
​
chain(*task_list)
​

Advertisement

Answer