Apache Airflow 2.0 : Complete Distributed Configuration Udemy

Apache Airflow 2.0 : Complete Distributed Configuration by Ganesh Dhareshwar

The Apache Airflow 2.0 : Complete Distributed Configuration course is undoubtedly the most interesting and the most sought after by those seeking to specialize in IT & Software.

Setup HA Airflow using multiple Schedulers and Celery Workers

Also, keep in mind that Ganesh Dhareshwar, professor of the course, is an excellent professional with worldwide recognition.

Therefore, if you want to study and learn more, we recommend that you start this udemy course right now.

Download Udemy Course

Apache Airflow 2.0 : Complete Distributed Configuration Udemy

What is the Apache Airflow 2.0 : Complete Distributed Configuration course about?

Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. Airflow is one of the best open source orchestrators and it is used widely because it is simplicity, scalability and extensibility. Main goal of this course is to achieve an Airflow distributed setup using Celery Executor and be able to run more than 100 jobs or DAGs in parallel at any instance in time. I cover Sequential, Local and Celery Executor in this course. We acquire few EC2 instances from AWS and configure these executors. Airflow community recently released Airflow 2.0 . It contains many amazing features like HA Scheduler , Massive performance improvement on scheduler as well as celery workers etc. I myself fascinated by airflow 2.0 performance and migrated all airflow 1.x to 2.x in my organisation. I am adding a new module on apache airflow 2.0. Here, we begin the module by learning new enhancements and HA architecture of airflow 2.0. Next, we install Webserver, Scheduler, Celery workers and Flower components. At the end, we configure multiple schedulers and observe its performance. In addition to this, we explore salient features like Login, Email alerting and Logs management . By the end of this course, you own a great distributed airflow setup which could be shared by multi teams in your organisation.

Other courses on the specialty: IT & Software

Start Udemy Course

This udemy course includes:

Without Reporting

To enroll in the course you need:

No Data

Download Udemy Course

Course dictated by Ganesh Dhareshwar

6+ years working experience from many fast growing companies like Myntra Designs Pvt. Ltd, Swiggy, Lendingkart Technologies Private Limited, Sprinklr. Currently working as Big Data Engineer at Myntra Designs Pvt. Ltd. Highly dedicated, self-motivated and confident person. Hands-on experience in developing large scale web application, writing Spark Jobs, developing Api’s etc.

More courses by the author: Ganesh Dhareshwar