Popular repositories Loading

1. scrapy-splash scrapy-splash Public

   Scrapy+Splash for JavaScript integration

   Python 3.2k 454

2. scrapy-playwright scrapy-playwright Public

   🎭 Playwright integration for Scrapy

   Python 1.1k 120

3. scrapy-djangoitem scrapy-djangoitem Public

   Scrapy extension to write scraped items using Django models

   Python 498 87

4. scrapy-zyte-smartproxy scrapy-zyte-smartproxy Public

   Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

   Python 359 88

5. scrapy-jsonrpc scrapy-jsonrpc Public

   Scrapy extension to control spiders using JSON-RPC

   Python 296 72

6. scrapy-deltafetch scrapy-deltafetch Public

   Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

   Python 269 49