How to build a scraping project with Scrapy and MongoDB

Become a real “spiderman” in Python

Lynn G. Kwong
Level Up Coding
Published in
8 min readFeb 12, 2022

--

Scrapy is a versatile and powerful web scraping framework that can be used to crawl websites and extract structured data from web pages. It is suitable for large scraping projects where many websites or many pages need to be scraped.

Image by firaangella1 on Pixabay.

--

--

I’m a Software Developer (https://medium.com/@lynn-kwong) keen on sharing thoughts, tutorials, and solutions for the best practice of software development.