Web Scraping using API, Beautiful Soup using Python
Scrape your first web page using Python API, Beautiful soup and structure the data using Python and SQL
Updated on Sep, 2023
Language - English
Scrape your first web page using Python API ,Beautiful soup and structure the data using Python and SQL
This section help you understand the working on API and how to implement the same using Python.
Here we will learn how to get and post the request using API and implement the same.
Will create a simple currency conversion calculator using JSON.
We will also cover API for website which we need to sign in. We will be using the API keys and ID to login and fetch the details.
We will explain how to structure and export the data in CSV using Pandas.
This Section helps you to learn Scraping the data and storing the data in our desired Format.
Here we will have the data scraped and use parsing of data and store it in Pandas for reference.
2 Projects to Scrape the data and parse them as our wish and store them in SQL
It is easy to learn and master. for example, if we want to extract all the links from the webpage
It has good comprehensive documentation which helps us to learn the things quickly.
It has good community support to figure out the issues that arise while we are working with this library.
What will you learn in this course:
- To scrape data from website
- Read information from API
- Learn to use API, Beautiful Soup and Scrappy for Web crawling and Scraping
What are the prerequisites for this course?
- Basics of Python and HTML
- Installation of Python and Jupiter notebook
Check out the detailed breakdown of what’s inside the course
- Introduction to API 03:29 03:29
- Introduction to HTTP 04:18 04:18
- Introduction to JSON 02:21 02:21
- Installation of Python and Jupyter Notebook 02:43 02:43
- Installation of HTML request 01:11 01:11
- Get response from API 06:30 06:30
- Get JSON Response 02:20 02:20
- Get historical data 05:41 05:41
- How to handle wrong request in API? 01:23 01:23
- Itunes API and reading the value 04:37 04:37
- Project2: Edamam - Registration 03:14 03:14
- Getting response API from registered website 13:50 13:50
- Project 3: Currency convertor calculator 09:17 09:17
Web scraping and Beautiful Soup
Web scraping using Scrapy
Chandramouli JayendranOffice productivity, Data analyst and stock trader
I am a software engineer turned into a stock trader. I am very passionate about teaching office productivity, software programming, and stock market analysis.
Worked with teaching several corporate on Office productivity and Programming. Running a teaching center of my own.
Trade-in stock market whenever I could see opportunity.
User your certification to make a career change or to advance in your current career. Salaries are among the highest in the world.
Our students work
with the Best
Related Video CoursesView More
Become a valued member of Tutorials Point and enjoy unlimited access to our vast library of top-rated Video CoursesSubscribe now
Master prominent technologies at full length and become a valued certified professional.Explore Now