Learn Azure data factory and AWS GLUE (ETL)
Master ETL in cloud with AWS glue & Azure data factory lab
Updated on Sep, 2023
Language - English
In this course, we would learn the following:
1) We will start with Basics on Server less Computing .
2) We will learn Schema Discovery, ETL, Scheduling, and Tools integration using Server less AWS Glue Engine built on Spark environment.
3) We will learn to develop a centralized Data Catalogue too using Server less AWS Glue Engine.
Businesses have always wanted to manage less infrastructure and more solutions. Big data challenges are continuously challenging the infrastructure boundaries. Having Server less Storage, Server less ETL, Server less Analytics, and Server less Reporting, all on one cloud platform had sounded too good to be true for a very long time. But now its a reality on AWS platform. AWS is the only cloud provider that has all the native server less components for a true Server less Data Lake Analytics solution.
This course understands your time is important, and so the course is designed to be laser-sharp on lecture timings, where all the trivial details are kept at a minimum and focus is kept on core content for experienced AWS Developers / Architects / Administrators. By the end of this course, you can feel assured and confident that you are future-proof for the next change and disruption sweeping the cloud industry.
I am very passionate about AWS Server less computing on Data and Analytics platform, and am covering A-to-Z of all the topics discussed in this course.
This course will target anyone who likes to learn azure data factory and data bricks . This course will cover all ADF components from the Model and View layer. In this course I have selected 15+ real time industry level project learning which will cover all the topic which is necessary to learn azure data factory and data bricks and will be able to work on industry . This is completely hands on learning tutorial where we will do practical's based learning and by end of this course we will develop a complete ADF application together (step by step) and By the end of this course, you should be able to develop a complete ADF application by yourself.
If you will be able to practical's with me you will be able to get complete picture of data factory
I have also included lessons on the storage blob Storage, amazon s3 , Azure SQL Database etc. Also, there are lessons on Azure Data bricks. I have even included lessons on building reports using Power BI on the data processed by the Azure Data Factory data pipelines.
Who this course is for:
- Any one who wants to learn and get hands on azure data factory and data bricks
- Any one looking for job change in the data engineering field
- Anyone who wants to learn AWS Server less technologies for data and analytics should take this course
What will you learn in this course:
Confidently work with AWS Serverless services to develop Data Catalogue, ETL, Analytics on a Data Lake
Build a serverless data lake on AWS using structured and unstructured data
By end of this course you will be able to develop pipeline in azure data factory
how to perform transformation in azure data factory
you will learn how to develop incremental load pipeline
you will be able to understand about databricks architecture and how to use
Industry level SCD type-1,type-2 projects
Failure handling and debug pipeline and learn about email alerts and all
What are the prerequisites for this course?
Good to have Azure and AWS Account for the practical lab
Good internet and laptop/desktop
Willing to learn
Check out the detailed breakdown of what’s inside the course
- Introduction 00:48 00:48
ADF (COPY & DELETE activities)
ADF ( SQL TO BLOB)
ADF (CSV file to SQL table data pipeline)
ADF (INCREMENTAL LOAD)
ADF (Parameterization )
ADF( SCD TYPE-1 & SCD TYPE 2)
Hi I am manish and I am a full time data engineer and having 5+ years of IT experiences delivering some of the large data projects for industries ranging from technology, security, finance, retail . The projects I delivered were both on cloud platforms such as Azure and AWS as well as On-premises.
I have a passion for teaching and I take great pride in the success of my students. I have a different style of teaching than that of a standard I.T. trainer. My courses are based on real world projects. My courses will, not only explain the concepts, but also make them stick by using real world projects and examples. Throughout the course I give guidance on good practices and guide you towards building a production ready application. I strongly believe that once you have completed my courses you will have sufficient experience and knowledge required to start a real time project on that technology. Of course you may require further learning to progress in your career, but I will give you the required foundation and put you in the right direction to gain additional knowledge.
I value your time as much as I do mine. So, I keep my courses to the point and my courses have been taught in simple English without any jargons.
User your certification to make a career change or to advance in your current career. Salaries are among the highest in the world.
Our students work
with the Best
Related Video CoursesView More
Become a valued member of Tutorials Point and enjoy unlimited access to our vast library of top-rated Video CoursesSubscribe now
Master prominent technologies at full length and become a valued certified professional.Explore Now