Apache Airflow 2.x on AWS EKS - Production Guide

person icon Faizan Qazi

Apache Airflow 2.x on AWS EKS - Production Guide

A.B.C.D Apache Airflow 2.3.x - Helm | AWS - EKS | Minikube

updated on icon Updated on Jul, 2023

language icon Language - English

person icon Faizan Qazi

architecture icon apache airflow,Kubernetes,DevOps,Amazon AWS,IT & Software


30-days Money-Back Guarantee

Training 5 or more people ?

Get your team access to 19,000+ top Tutorialspoint courses anytime, anywhere.

Course Description

Any Body Can Deploy Airflow. Be it Local Development or Production Deployment on AWS - EKS. It's as simple as it can be.

This course is lined up with the Production Guide of Apache Airflow to deploy a Highly Scalable Airflow on EKS and also follows official Documentation of AWS while deploying Services making sure you always stay up to date and acquire more detailed information whenever you want to.


What will you learn in this course:

  • Create a Script to seamlessly deploy Airflow for Local Development

  • Create your own Helm Chart

  • Template Scripts and YAML files

  • Configure Airflow using Helm

  • Create a Scalable EKS Cluster using eksctl

  • Deploy an ALB Ingress Controller for Load Balancing and accessing the Airflow UI

  • Mounting EFS for Persisting Kubernetes Executor Logs

  • Creating a Pipeline to Deploy Airflow using AWS Code Pipeline


What are the prerequisites for this course?

  • Basic Knowledge of Airflow Components

  • Basic Knowledge of Kubernetes

  • Basic Knowledge of AWS

  • Familiar with working on an IDE

Apache Airflow 2.x on AWS EKS - Production Guide


Check out the detailed breakdown of what’s inside the course

Getting Started
4 Lectures
  • play icon Welcome 03:29 03:29
  • play icon Introduction 06:20 06:20
  • play icon Project Repo Access
  • play icon Setting up our Environment 09:29 09:29
Local Airflow Deployment - Minikube
1 Lectures
Creating Helm Chart
2 Lectures
Airflow on AWS EKS
4 Lectures
Exposing UI and Persisting Logs
2 Lectures
CI/CD Pipeline
1 Lectures
Airflow in Action
1 Lectures
Clean Up
1 Lectures
Enabling SSL (Optional)
1 Lectures

Instructor Details

Faizan Qazi

Faizan Qazi

Technical Instructor | Consultant API Management and Integration

M Tech educated Full Stack Developer with 3+ Y.O.E

Assumed various roles such as Embedded/ IoT Engineer, Python Developer, and Technical Analyst dealing with a wide variety of frameworks including Flask, Airflow, TensorFlow, Kubernetes, AWS, and the likes.

Discovering uncharted solutions. Enjoys Training and Creating Technical Content.

Pure Optimist | Former Robot | Snowboarder

Course Certificate

User your certification to make a career change or to advance in your current career. Salaries are among the highest in the world.

sample Tutorialspoint certificate

Our students work
with the Best

Related Video Courses

View More

Annual Membership

Become a valued member of Tutorials Point and enjoy unlimited access to our vast library of top-rated Video Courses

Subscribe now
People having fun around a laptop

Online Certifications

Master prominent technologies at full length and become a valued certified professional.

Explore Now
People having fun around a laptop

Talk to us