Scrapy
Lean, extensible Python framework for extracting public web data at scale.
PlatformWebfreeglobal

A Python-based, production-oriented web scraping and crawling framework that scaffolds a full project (spiders, settings, items, pipelines) and is extensible through a community ecosystem. It helps teams extract public web data at scale and convert URLs into maintainable spiders, adding browser rendering, monitoring, anti-ban measures, and modern HTTP/2 and SOCKS proxy support for Python developers and professionals running large crawls.
Categories
web scraping frameworkweb crawling framework
Something wrong with this listing — dead link, not a real product, wrong info?

