Scrapy - Create a Project


To scrap the data from web pages, first you need to create the Scrapy project where you will be storing the code. To create a new directory, run the following command −

scrapy startproject first_scrapy

The above code will create a directory with name first_scrapy and it will contain the following structure −

scrapy.cfg            # deploy configuration file
first_scrapy/         # project's Python module, you'll import your code from here              # project items file          # project pipelines file           # project settings file
spiders/              # a directory where you'll later put your spiders
Kickstart Your Career

Get certified by completing the course

Get Started