VBA Selenium Web Scraping
WebScraping with VBA Selenium via Google Chrome
Updated on Mar, 2024
Language - English
Office Productivity,Microsoft,Excel VBA
Lectures -36
Resources -14
Duration -8 hours
30-days Money-Back Guarantee
Get your team access to 10000+ top Tutorials Point courses anytime, anywhere.
Course Description
In this Part1 you shall learn below written things. Please go through them.
We are going to learn Webscraping using google chrome and it will be done using selenium library.
Learn how to download selenium and browser drivers to first initially do the setup.
How work with attributes like name, id using findelement methods.
How to work with tags like A tag and its attribute href to click on the links.
How to use class attribute and is it a good approach to use class attribute.
how to work with Xpath to insert the data into textboxes and click on search buttons. Not just use but understand the structure of Xpath as well.
Learn how we can change the xpath elements by their indexes.
How to work with header tags like h1 or h2 or h3 using normal way and using xpath.
How to run the collection loops and why we need it and when we can avoid using collection loops.
What is difference between Web-element and Webelements and why we use set word for collection elements and not for single object.
How to click on links on webpage using link -text and partial link text property. Based on this knowledge one mini project -how to load website by default on current date.
How to scrape tables and its rows and rows data values and table headers.
Collection loops design and execution from very start while working with tables.
Do you like to export all tables in a website or do you want to scrape one specific table only, How to reach out to specific index of a table then.
How to scrape specific rows inside one specific table . Know your "tr' tags.
How to scrape all data insider rows or just one specific data value using td tag. Its awesome when you have so much control.
How to export tables with out running collection loops and what is the difference between direct export and export using loops. You must know.
How to work with li tags inside unordered and ordered lists.
Know how to insert a value in drop down or combo-boxes .
How to select items in list box with single select property or multi select property.
Learn to select or de-select listbox options using collection loops or without the loops.
- How to alter the collection elements by referring to one object and second inside the first one and so on.
- First and foremost, this is a Part2. Students must have seen Part1 before.
Students will learn how to download the files
How to add or manage Cookies of a website and how to use it in a practical situation.
How to take screenshots and save those on desktop or export them in excel.
How to launch website new pages in a new window tabs.
Move from first window to second and so on. Challenges and more robust solutions to handle the window tabs.
You will see one of the real data based project which is super duper awesome from learning and getting confidence on webscraping.
We will see how to login to website and how to sort out captcha issues by simply letting code to wait for sometime till user enters captcha.
We will revise our learning in part1 as to how to practically use links using elementbyid, name or class attributes . Also, the best use of Xpath.
if page refreshes for a long time or uncertain , how to put a wait time.
You will see the use of magnificent loops and IF Conditions on this project . How smartly we have used the loops and IF Conditions and clicking on elements.
In this project you shall see how to fully control the website elements like drop downs or a tags from excel lists which are written on sheets.
How so far work done is going to be noted in excel sheet marking status as Done so next time when code runs it avoids previous already done codes.
Who this course is for:
- If you are a Business analyst and want to learn how to scrape websites using Chrome or other major browsers.
- If you like to export website tables into Excel. If you like to click on website links or fill up a form or download the files etc.
Goals
What will you learn in this course:
- Welcome in Part1 of this VBA Selenium course. Please note what we are covering in this part1
- How to use Selenium library inside Excel VBA Editor to scrape websites which supports major browsers like chrome, mozilla, firefox , edge etc.
- We are using chrome browser in this series to scrape website elements but you will know how to use other browsers as well.
- How to download selenium library and what is the procedure to download browser webdrivers
- How to navigate websites using chrome browsers
- Learn how to use attributes ID & name or classes to enter a value in search box or text boxes.
- Which attribute should you use and why. How to use find function on website for manual search and why it is important to be familiar with this method.
- How to click the buttons using attributes like id, name , classname
- How to work with tags like A tags and their attribute href.
- Also, learn how to use html in notepad and create webpages. It will help you in visualizing the things.
- Know how tables are designed on websites and how we can export every table in one go. Know table tags
- Know table rows tags and how to work with every or one specific rows and export whatever you need.
- Know table headers and table data tags like th and td. Learn how to locate specific td tag
- What are collection loops used to scrape tables OR how to scrape one specific table only.
- What if user wants to see data for few clients only out of 1000s rows. How to control these tables from excel where user enters the names.
- What is the fundamental difference between web element and its collection elements.
- Why and where we need SET Keyword and where to avoid it. Proper explanation given.
- Using send keys and enter if search button is unable to search data for you.
- How to use Header or Rows count property in code to handle them together. Its an amazing approach.
- How to use Xpath to enter keywords in input boxes and how we can click on search buttons using xpath
- How to read Xpath DOM structure, A proper explanation is given.
- How to use Xpath to scrape tables.
- How to work with tags like headers - H1,H2,H3 on individual levels and using Xpath method and its benefits.
- How to understand VBA Errors if they pop up on screen instead going on google.
- How to work with listbox with single property or multiple property.
- How to work with drop down using index, text and values property.
- Your questions and projects also discussed. Go inside one page drop down and then inside second one.
- This is Part2 and you are requested to go through Part1 First. In this part2 we are learning how to store cookies data and how to use it practically.
- You will learn how to navigate different windows on websites .
- How to define the windows or run a collection loop to activate or close them. Its all about fundamentals.
- In part1 whatever we have learnt , that all will be used in this project now.
- You will get a project from me, A very big and practical project
- From attributes like elements by name, or id or classes or its xpath - we will use all and understand them line by line.
- From selecting the dropdown and giving code a time to wait for seconds, how loops are going to set up. we will see everything in this project.
- how to set up the clickable list of categories in excel and have their status updated as Done in excel.
- How to handle recaptcha by letting code wait for few seconds. no need to use paid captcha softwares. Just use basics..
- How to avoid relogin if your website creates a issue in frequently log ins or multiple logins .
- How to download files from websites and locate them into your folders .
- How to take screenshots of websites or excel desktop using image class. Its super fun.
- You will learn how to identify if our element is present on webpage or not
- What is a By class and how we can use it.
Prerequisites
What are the prerequisites for this course?
You should have good understanding of VBA for next Loops and good understanding of IF functions.
Curriculum
Check out the detailed breakdown of what’s inside the course
Introduction to Selenium VBA Part1
28 Lectures
-
How to Download Selenium and chrome driver exe files
16:54
16:54
-
Let us Launch the website and understand the concepts.
11:33
11:33
-
Work with ID attribute
22:51
22:51
-
Work with Name Attribute
10:09
10:09
-
Work with a Class
15:39
15:39
-
Work with Atags hyperlinks
31:01
31:01
-
Work with Tables - HTML of Tables Behind coding - Part1
16:34
16:34
-
Work with Tables - Export every table data into excel -Part2
13:37
13:37
-
Work with Tables - Target the specific countries list from excel sheet - Part3
30:38
30:38
-
How to target specific td tags in a table - Superb Control - Part4
09:08
09:08
-
Target specific table among many and then target specific data -Part5
09:44
09:44
-
Work with Table specific rows -Part6
05:31
05:31
-
How to scrape a table in a reverse order - Part7
10:35
10:35
-
Learn how to handle Headers and Data in one code -Count property -Part8
08:31
08:31
-
How to start with Xpath
08:52
08:52
-
Use Xpath to export Tables -Part2
04:50
04:50
-
Xpath to refer to specific object by editing -Must know Part3
10:28
10:28
-
How to handle Headers tags along and with Xpath - H1,H2,H3 tags
10:52
10:52
-
Work with Check if element exist
06:12
06:12
-
Let us deal with dropdown now
12:52
12:52
-
Work with Partial Link text property- Click just by finding the text on website
05:35
05:35
-
Partial Link method - How to click website links even if you know few words.
09:31
09:31
-
Project for you- Load a website with today date page showing information
06:17
06:17
-
How to select item in a drop down -Select Webelement Class
07:20
07:20
-
Student Project is done here- More confident now .
26:19
26:19
-
Work with ListBox - Single select property - Part1
22:42
22:42
-
Work with listbox which has multi-select property on - Part2
09:43
09:43
-
Work with Listbox -How to export list box selected or all values -Part3
13:50
13:50
Introduction to VBA Selenium Web Scraping Part 2
8 Lectures
Instructor Details
ajay parmar
eCourse Certificate
Use your certificate to make a career change or to advance in your current career.
Our students work
with the Best
Related Video Courses
View MoreAnnual Membership
Become a valued member of Tutorials Point and enjoy unlimited access to our vast library of top-rated Video Courses
Subscribe now
Online Certifications
Master prominent technologies at full length and become a valued certified professional.
Explore Now