Skip to content

ReactDOM

Search
Close this search box.

Learn Apache Airflow 2024 – Best Apache Airflow Courses & Best Apache Airflow Books

Best Apache Airflow Courses 2021

 

Best Apache Airflow Tutorials 2021

The Complete Hands-On Introduction to Apache Airflow

Apache Airflow is an open-source platform for creating, planning, and monitoring workflows programmatically. If you have a lot of ETLs to manage, Airflow is a must.

In this course, you will learn everything you need to start using Apache Airflow through theory and how-to videos. Starting from very basic notion such as what Airflow is and how it works, we will dive into advanced concepts such as, how to create plugins and create real dynamic pipelines.

You will learn:

Create plugins to add functionality to Apache Airflow.
Using Docker with Airflow and various runners
Master basic functionalities such as DAGs, operators, tasks, workflows, etc.
Understand and apply advanced concepts of Apache Airflow such as XCOM, branching and SubDAG.
The difference between sequential, local and celery runners, how they work and how can you use them.
Use Apache Airflow in a Big Data ecosystem with Hive, PostgreSQL, Elasticsearch, etc.
Install and configure Apache Airflow
Think, respond and implement solutions using Airflow to real data processing problems

Apache Airflow: The Hands-On Guide

Apache Airflow is a community-created platform for creating, planning, and monitoring workflows programmatically.

It is scalable, dynamic, extensible and modular.

Without a doubt, mastering Airflow is becoming a must and an appealing skill for anyone who works with data.

What you will learn in the course:

The fundamentals of Airflow are explained such as what Airflow is, how scheduler and web server work

The Forex Data Pipeline project is an amazing way to discover many operators in Airflow and manage Slack, Spark, Hadoop and more

Mastering your DAGs is a top priority and you will be able to play with time zones, test your DAGs, how to structure your DAG record and much more.

Scaling of Airflow across different executors such as Local Executor, Celery Executor, and Kubernetes Executor will be explained in detail. You will learn how to specialize your workers, how to add new workers, what happens when a node crashes.

A 3-node Kubernetes cluster will be configured with Rancher, Airflow, and Kubernetes Executor locally to run your data pipelines.

Advanced concepts will be introduced through practical examples such as creating models of your DAGs, how to make your DAG dependent on another, what are sub-tags and blocks, and more.

You’ll set up a Kubernetes cluster in the cloud with AWS EKS and Rancher to use Airflow with Kubernetes Executor

Monitoring the air flow is extremely important! That’s why you will know how to do it with Elasticsearch and Grafana.

Security will also be addressed in order to make your Airflow instance compliant with your business. Specify roles and permissions for your users with RBAC, prevent access to the Airflow UI with authentication and password, data encryption and more.

You will learn:

Coding production data pipelines by controlling airflow with practical examples
How to follow best practices with Apache Airflow
How to Scale Airflow with Local, Celery, and Kubernetes Wxecutors
How to configure monitoring with Elasticsearch and Grafana
How to Secure Airflow with Authentication, Crypto, and RBAC UI
Basic and advanced concepts with advantages and limitations
Master the DAGs with time zones, unit tests, filling and catching up
Organize the DAG folder and keep things clean

Apache Airflow | A Real-Time & Hands-On Course on Airflow

“Apache Airflow is a community-created platform for creating, planning, and monitoring workflows programmatically.”

Airflow will change the way of planning data pipelines and that is why it has become Apache’s top-level project.

What is included in the course?

Complete Apache Airflow concepts explained from Scratch to ADVANCE with real-time implementation.

Each Airflow concept is explained with HANDS-ON examples.

Includes every detail, even end, of Airflow.

XComs, Hooks, Pools, SubDAGs, Variables, Connections, Plugins, Adhoc Queries, Sensors and many more …

Even include these concepts, the explanation of which is not very clear even in the official Apache Airflow documentation.

Exclusive Features – Data Profiling, Charts, Trigger Rules, Airflowignore File, Zombies, Undeads, LatestOnly Operator.

Learn the best practices / dos and don’ts in real-time airflow projects.

Build a real-time case study data pipeline using Airflow.

After completing this course, you can start working on any Airflow project with confidence.

Additional modules

Questions and queries will be answered very quickly.

Airflow codes and data sets used in lectures are attached to the course for your convenience.

You will learn:

Learn fully how to get in and out of Apache Airflow with proper HANDS-ON examples from scratch.
Start with the implementation of the main Airflow BOM – DAG, Operators, Tasks, Executors, Cfg file, UI views, etc.
ADVANCE Airflow concepts, the explanation of which is not very clear even in the official Airflow documentation.
XComs, Hooks, Pools, SubDAGs, Variables, Connections, Plugins, Adhoc Requests, Branching, Sensors and many more …
Exclusive Features – Data Profiling, Charts, Trigger Rules, Airflowignore File, Zombies, Undeads, LatestOnly Operator.
Build a real-time case study data pipeline using Apache Airflow.
Codes and datasets are available in the Resources tab. It will save your typing effort.
Learn the best practices / dos and don’ts in real-time airflow projects.

Best Apache Airflow Books 2021

Bestsellers

SaleBestseller No. 1
Data Pipelines with Apache Airflow
  • Harenslak, Bas P. (Author)
  • English (Publication Language)
  • 480 Pages - 04/27/2021 (Publication Date) - Manning (Publisher)
Bestseller No. 2
Apache Airflow Demystified: Build, Schedule, and Monitor Data Pipelines: Practical Examples and Best...
  • Amazon Kindle Edition
  • Parvin, R. (Author)
  • English (Publication Language)
Bestseller No. 3
Mastering Apache Airflow: A Comprehensive Guide to Learn Apache Airflow
  • Ltd, Cybellium (Author)
  • English (Publication Language)
  • 187 Pages - 09/26/2023 (Publication Date) - Independently published (Publisher)
Bestseller No. 4
Don't Panic! I'm A Professional Remote Apache Airflow Specialist: Customized 100 Page Lined Notebook...
  • CoolChap, Jimmy (Author)
  • English (Publication Language)
  • 102 Pages - 09/29/2021 (Publication Date) - Independently published (Publisher)
Bestseller No. 5
Apache Airflow. Einführung, Komponenten und Einsatz in der Praxis (German Edition)
  • Anonymous (Author)
  • German (Publication Language)
  • 28 Pages - 05/15/2023 (Publication Date) - Grin Verlag (Publisher)
Bestseller No. 6
Apache Airflow data orchestration practice(Chinese Edition)
  • [ HE ] BA SI · HA LUN SI LA KE ( Bas Harenslak ) (Author)
  • Chinese (Publication Language)
  • 11/01/2022 (Publication Date) - Tsinghua University Press (Publisher)
Bestseller No. 7
Apache Airflow i konveieri obrabotka dannih
  • Hardcover Book
  • DMK-Press (Publisher)
Bestseller No. 8
Apache
  • Audio CD – Audiobook
  • Ed Macy (Author)
  • English (Publication Language)
Bestseller No. 9
Apache
  • Level: 3-4
  • Instrumentation: Marching Band
  • Voicing: SCORE+PARTS

© 2023 ReactDOM

As an Amazon Associate I earn from qualifying purchases.