Tutorialspoint

Web Scraping using API, Beautiful Soup using Python

person icon Chandramouli Jayendran

Web Scraping using API, Beautiful Soup using Python

Scrape your first web page using Python API, Beautiful soup and structure the data using Python and SQL

updated on icon Updated on Sep, 2023

language icon Language - English

person icon Chandramouli Jayendran

architecture icon Development,Development Tools,Development Tools Other

price-loader

30-days Money-Back Guarantee

Training 5 or more people ?

Get your team access to 19,000+ top Tutorialspoint courses anytime, anywhere.

Course Description

Scrape your first web page using Python API ,Beautiful soup and structure the data using Python and SQL

API Python:

  • This section help you understand the working on API and how to implement the same using Python.

  • Here we will learn how to get and post the request using API and implement the same.

  • Will create a simple currency conversion calculator using JSON.

  • We will also cover API for website which we need to sign in. We will be using the API keys and ID to login and fetch the details.

  • We will explain how to structure and export the data in CSV using Pandas.

Web Scraping:

  • This Section helps you to learn Scraping the data and storing the data in our desired Format.

  • Here we will have the data scraped and use parsing of data and store it in Pandas for reference.

  • Helps in Understanding the structure of HTML and Javascript file to parse the data.

  • 2 Projects to Scrape the data and parse them as our wish and store them in SQL

Beautiful Soup:

  • It is easy to learn and master. for example, if we want to extract all the links from the webpage

  • It has good comprehensive documentation which helps us to learn the things quickly.

  • It has good community support to figure out the issues that arise while we are working with this library.

Goals

What will you learn in this course:

  • To scrape data from website
  • Read information from API
  • Learn to use API, Beautiful Soup and Scrappy for Web crawling and Scraping

Prerequisites

What are the prerequisites for this course?

  • Basics of Python and HTML
  • Installation of Python and Jupiter notebook
Web Scraping using API, Beautiful Soup using Python

Curriculum

Check out the detailed breakdown of what’s inside the course

API
13 Lectures
  • play icon Introduction to API 03:29 03:29
  • play icon Introduction to HTTP 04:18 04:18
  • play icon Introduction to JSON 02:21 02:21
  • play icon Installation of Python and Jupyter Notebook 02:43 02:43
  • play icon Installation of HTML request 01:11 01:11
  • play icon Get response from API 06:30 06:30
  • play icon Get JSON Response 02:20 02:20
  • play icon Get historical data 05:41 05:41
  • play icon How to handle wrong request in API? 01:23 01:23
  • play icon Itunes API and reading the value 04:37 04:37
  • play icon Project2: Edamam - Registration 03:14 03:14
  • play icon Getting response API from registered website 13:50 13:50
  • play icon Project 3: Currency convertor calculator 09:17 09:17
Web scraping and Beautiful Soup
11 Lectures
Tutorialspoint
Web scraping using Scrapy
14 Lectures
Tutorialspoint

Instructor Details

Chandramouli Jayendran

Chandramouli Jayendran

Office productivity, Data analyst and stock trader

I am a software engineer turned into a stock trader. I am very passionate about teaching office productivity, software programming, and stock market analysis.

Worked with teaching several corporate on Office productivity and Programming. Running a teaching center of my own.

Trade-in stock market whenever I could see opportunity.

Course Certificate

User your certification to make a career change or to advance in your current career. Salaries are among the highest in the world.

sample Tutorialspoint certificate

Our students work
with the Best

Related Video Courses

View More

Annual Membership

Become a valued member of Tutorials Point and enjoy unlimited access to our vast library of top-rated Video Courses

Subscribe now
People having fun around a laptop

Online Certifications

Master prominent technologies at full length and become a valued certified professional.

Explore Now
People having fun around a laptop

Talk to us

1800-202-0515