Practical Multi-Armed Bandit Algorithms in Python
Acquire skills to build digital AI agents capable of adaptively making critical business decisions under uncertainties.
Lectures -13
Duration -3.5 hours
30-days Money-Back Guarantee
Get your team access to 10000+ top Tutorials Point courses anytime, anywhere.
Course Description
This course is your perfect entry point into the exciting field of Reinforcement Learning where digital Artificial Intelligence agents are built to automatically learn how to make sequential decisions through trial and error. Specifically, this course focuses on the Multi-Armed Bandit problems and the practical hands-on implementation of various algorithmic strategies for balancing between exploration and exploitation. Whenever you desire to consistently make the best choice out of a limited number of options over time, you are dealing with a Multi-Armed Bandit problem and this course teaches you every detail you need to know to be able to build realistic business agents to handle such situations.
With very concise explanations, this course teaches you how to confidently translate seemingly scary mathematical formulas into Python code painlessly. We understand that not many of us are technically adept in the subject of mathematics so this course intentionally stays away from maths unless it is necessary. And even when it becomes necessary to talk about mathematics, the approach taken in this course is such that anyone with basic algebra skills can understand and most importantly easily translate the maths into code and build useful intuitions in the process.
Some of the algorithmic strategies taught in this course are Epsilon Greedy, Softmax Exploration, Optimistic Initialization, Upper Confidence Bounds, and Thompson Sampling. With these tools under your belt, you are adequately equipped to readily build and deploy AI agents that can handle critical business operations under uncertainties.
To bridge the gap between theory and application, I've updated this course to include a section where I show how to apply the MAB algorithms in Robotics using the EV3 Mindstorm. I'll soon upload a section that will show how to apply the algorithms taught in this course to optimize advertisements.
Goals
What will you learn in this course:
- Understanding and being able to identify Multi-Armed Bandit problems.
- Modeling real business problems as MAB and implementing digital AI agents to automate them.
- Understanding the challenge of RL regarding the exploration-exploitation dilemma.
- Practical implementation of the various algorithmic strategies for balancing between exploration and exploitation.
- Python implementation of the Epsilon-greedy strategy.
- Python implementation of the Softmax Exploration strategy.
- Python implementation of the Optimistic Initialization strategy.
- Python implementation of the Upper Confidence Bounds (UCB) strategy.
- Understand the challenges of RL in terms of the design of reward functions and sample efficiency.
- Estimation of action values through incremental sampling.
Prerequisites
What are the prerequisites for this course?
- Be able to understand basic OOP programs in Python.
- Have basic Numpy and Matplotlib knowledge.
- Basic algebra skills. If you know how to add, subtract, multiply, and divide numbers, you are good to go.
Curriculum
Check out the detailed breakdown of what’s inside the course
Reinforcement Learning & The Multi-Armed Bandit Algorithms
1 Lectures
- Introduction to reinforcement learning and the multi-armed bandit problem. 22:30 22:30
Implementing Simulated Environments For Your Agents
1 Lectures
Using Sampling Techniques To Estimate Action Values
3 Lectures
Implementing MAB Agents In Python
3 Lectures
Balancing Exploration & Exploitation
5 Lectures
Instructor Details
Edward Pie
Course Certificate
Use your certificate to make a career change or to advance in your current career.
Our students work
with the Best
Related Video Courses
View MoreAnnual Membership
Become a valued member of Tutorials Point and enjoy unlimited access to our vast library of top-rated Video Courses
Subscribe nowOnline Certifications
Master prominent technologies at full length and become a valued certified professional.
Explore Now