Apache Airflow 2.x on AWS EKS - Production Guide

person icon Faizan Qazi

Buy Now

Apache Airflow 2.x on AWS EKS - Production Guide

Name: Apache Airflow 2.x on AWS EKS - Production Guide
Price: 100 USD
Author: Faizan Qazi

A.B.C.D Apache Airflow 2.3.x - Helm | AWS - EKS | Minikube

updated on icon Updated on Jul, 2023

language icon Language - English

person icon Faizan Qazi

architecture icon apache airflow,Kubernetes,DevOps,Amazon AWS,IT & Software

Add to Cart Buy Now

30-days Money-Back Guarantee

Training 5 or more people ?

Get your team access to 19,000+ top Tutorialspoint courses anytime, anywhere.

Course Description

Any Body Can Deploy Airflow. Be it Local Development or Production Deployment on AWS - EKS. It's as simple as it can be.

This course is lined up with the Production Guide of Apache Airflow to deploy a Highly Scalable Airflow on EKS and also follows official Documentation of AWS while deploying Services making sure you always stay up to date and acquire more detailed information whenever you want to.

Goals

What will you learn in this course:

Create a Script to seamlessly deploy Airflow for Local Development
Create your own Helm Chart
Template Scripts and YAML files
Configure Airflow using Helm
Create a Scalable EKS Cluster using eksctl
Deploy an ALB Ingress Controller for Load Balancing and accessing the Airflow UI
Mounting EFS for Persisting Kubernetes Executor Logs
Creating a Pipeline to Deploy Airflow using AWS Code Pipeline

Prerequisites

What are the prerequisites for this course?

Basic Knowledge of Airflow Components
Basic Knowledge of Kubernetes
Basic Knowledge of AWS
Familiar with working on an IDE

Apache Airflow 2.x on AWS EKS - Production Guide

Curriculum

Check out the detailed breakdown of what’s inside the course

Getting Started
4 Lectures

Welcome 03:29 03:29
Introduction 06:20 06:20
Project Repo Access
Setting up our Environment 09:29 09:29

Local Airflow Deployment - Minikube
1 Lectures

Creating Helm Chart
2 Lectures

Airflow on AWS EKS
4 Lectures

Exposing UI and Persisting Logs
2 Lectures

CI/CD Pipeline
1 Lectures

Airflow in Action
1 Lectures

Clean Up
1 Lectures

Enabling SSL (Optional)
1 Lectures

Instructor Details

Faizan Qazi

Technical Instructor | Consultant API Management and Integration

M Tech educated Full Stack Developer with 3+ Y.O.E

Assumed various roles such as Embedded/ IoT Engineer, Python Developer, and Technical Analyst dealing with a wide variety of frameworks including Flask, Airflow, TensorFlow, Kubernetes, AWS, and the likes.

Discovering uncharted solutions. Enjoys Training and Creating Technical Content.

Pure Optimist | Former Robot | Snowboarder

Course Certificate

User your certification to make a career change or to advance in your current career. Salaries are among the highest in the world.