Learn Apache Airflow 2024 – Best Apache Airflow Courses & Best Apache Airflow Books

Table of Contents

Best Apache Airflow Courses 2021

The Complete Hands-On Introduction to Apache Airflow

Learn More on Udemy.com

Apache Airflow: The Hands-On Guide

Learn More on Udemy.com

Apache Airflow A Real-Time & Hands-On Course on Airflow

Learn More on Udemy.com

Best Apache Airflow Tutorials 2021

The Complete Hands-On Introduction to Apache Airflow

Learn More on Udemy.com

Apache Airflow is an open-source platform for creating, planning, and monitoring workflows programmatically. If you have a lot of ETLs to manage, Airflow is a must.

In this course, you will learn everything you need to start using Apache Airflow through theory and how-to videos. Starting from very basic notion such as what Airflow is and how it works, we will dive into advanced concepts such as, how to create plugins and create real dynamic pipelines.

You will learn:

Create plugins to add functionality to Apache Airflow.
Using Docker with Airflow and various runners
Master basic functionalities such as DAGs, operators, tasks, workflows, etc.
Understand and apply advanced concepts of Apache Airflow such as XCOM, branching and SubDAG.
The difference between sequential, local and celery runners, how they work and how can you use them.
Use Apache Airflow in a Big Data ecosystem with Hive, PostgreSQL, Elasticsearch, etc.
Install and configure Apache Airflow
Think, respond and implement solutions using Airflow to real data processing problems

Apache Airflow: The Hands-On Guide

Learn More on Udemy.com

Apache Airflow is a community-created platform for creating, planning, and monitoring workflows programmatically.

It is scalable, dynamic, extensible and modular.

Without a doubt, mastering Airflow is becoming a must and an appealing skill for anyone who works with data.

What you will learn in the course:

The fundamentals of Airflow are explained such as what Airflow is, how scheduler and web server work

The Forex Data Pipeline project is an amazing way to discover many operators in Airflow and manage Slack, Spark, Hadoop and more

Mastering your DAGs is a top priority and you will be able to play with time zones, test your DAGs, how to structure your DAG record and much more.

Scaling of Airflow across different executors such as Local Executor, Celery Executor, and Kubernetes Executor will be explained in detail. You will learn how to specialize your workers, how to add new workers, what happens when a node crashes.

A 3-node Kubernetes cluster will be configured with Rancher, Airflow, and Kubernetes Executor locally to run your data pipelines.

Advanced concepts will be introduced through practical examples such as creating models of your DAGs, how to make your DAG dependent on another, what are sub-tags and blocks, and more.

You’ll set up a Kubernetes cluster in the cloud with AWS EKS and Rancher to use Airflow with Kubernetes Executor

Monitoring the air flow is extremely important! That’s why you will know how to do it with Elasticsearch and Grafana.

Security will also be addressed in order to make your Airflow instance compliant with your business. Specify roles and permissions for your users with RBAC, prevent access to the Airflow UI with authentication and password, data encryption and more.

You will learn:

Coding production data pipelines by controlling airflow with practical examples
How to follow best practices with Apache Airflow
How to Scale Airflow with Local, Celery, and Kubernetes Wxecutors
How to configure monitoring with Elasticsearch and Grafana
How to Secure Airflow with Authentication, Crypto, and RBAC UI
Basic and advanced concepts with advantages and limitations
Master the DAGs with time zones, unit tests, filling and catching up
Organize the DAG folder and keep things clean

Apache Airflow | A Real-Time & Hands-On Course on Airflow

Apache Airflow A Real-Time & Hands-On Course on Airflow

Learn More on Udemy.com

“Apache Airflow is a community-created platform for creating, planning, and monitoring workflows programmatically.”

Airflow will change the way of planning data pipelines and that is why it has become Apache’s top-level project.

What is included in the course?

Complete Apache Airflow concepts explained from Scratch to ADVANCE with real-time implementation.

Each Airflow concept is explained with HANDS-ON examples.

Includes every detail, even end, of Airflow.

XComs, Hooks, Pools, SubDAGs, Variables, Connections, Plugins, Adhoc Queries, Sensors and many more …

Even include these concepts, the explanation of which is not very clear even in the official Apache Airflow documentation.

Exclusive Features – Data Profiling, Charts, Trigger Rules, Airflowignore File, Zombies, Undeads, LatestOnly Operator.

Learn the best practices / dos and don’ts in real-time airflow projects.

Build a real-time case study data pipeline using Airflow.

After completing this course, you can start working on any Airflow project with confidence.

Additional modules

Questions and queries will be answered very quickly.

Airflow codes and data sets used in lectures are attached to the course for your convenience.

You will learn:

Learn fully how to get in and out of Apache Airflow with proper HANDS-ON examples from scratch.
Start with the implementation of the main Airflow BOM – DAG, Operators, Tasks, Executors, Cfg file, UI views, etc.
ADVANCE Airflow concepts, the explanation of which is not very clear even in the official Airflow documentation.
XComs, Hooks, Pools, SubDAGs, Variables, Connections, Plugins, Adhoc Requests, Branching, Sensors and many more …
Exclusive Features – Data Profiling, Charts, Trigger Rules, Airflowignore File, Zombies, Undeads, LatestOnly Operator.
Build a real-time case study data pipeline using Apache Airflow.
Codes and datasets are available in the Resources tab. It will save your typing effort.
Learn the best practices / dos and don’ts in real-time airflow projects.