Resources for Scrapy Developers

Featured Resource

The official Scrapy documentation is the ultimate guide to mastering web scraping. Everything from installation to deploying massive crawling architectures.

Read the Docs →

Official Documentation

Start with the official docs to master Scrapy fundamentals and advanced topics.

Scrapy Docs

Official API and framework documentation.

Scrapy Tutorial

A step-by-step guide to creating your first spider.

Community & Help

Find help, contribute, and connect with other Scrapy developers.

GitHub Discussions

Community support, ideas, and Q&A.

Gitter Chat

Real-time chat with Scrapy developers.

Twitter

Follow @ScrapyProject for news and updates.

Helpful Tools

Useful libraries and services to power up your Scrapy projects.

Scrapyd

Deploy Scrapy spiders to a server as services.

Frontera

Scalable frontier management for large crawlers.

Portia

Visual scraping tool (point-and-click) for Scrapy.

ScrapyRT

Turn Scrapy spiders into web APIs.

Tutorials & Learning Resources

Level up your skills with these tutorials and practice platforms.

Real Python: Scrapy + MongoDB

Tutorial on scraping and storing data.

ScrapingClub Practice

Practice Scrapy skills with realistic projects.

Data Science Scrapy Tutorial

Guide to building crawlers with Scrapy.

YouTube: Scrapy Basics

Beginner-friendly Scrapy video tutorials.