Ask Your Question
1

Before Airflow, how were the management of data pipelines and workflows carried out?

asked 2023-05-30 21:44:30 +0000

pufferfish gravatar image

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
3

answered 2023-05-30 22:12:02 +0000

huitzilopochtli gravatar image

Before Airflow, the management of data pipelines and workflows was usually done manually using scripts and cron jobs. This approach required significant development effort, as it involved writing code for each task and schedule it accordingly. Additionally, there was no centralized platform for monitoring and managing workflows, making it difficult to track and troubleshoot issues. The lack of automation and visibility made it challenging to reliably process data at-scale and resulted in high maintenance costs.

edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account. This space is reserved only for answers. If you would like to engage in a discussion, please instead post a comment under the question or an answer that you would like to discuss

Add Answer


Question Tools

Stats

Asked: 2023-05-30 21:44:30 +0000

Seen: 8 times

Last updated: May 30 '23