Versions

Description

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Repository

https://github.com/istresearch/scrapy-cluster

Project Slug

scrapy-cluster

Last Built

3 years ago passed

Maintainers

Home Page

https://github.com/istresearch/scrapy-cluster

Badge

Tags

kafka, redis, scrapy

Short URLs

scrapy-cluster.readthedocs.io
scrapy-cluster.rtfd.io

Default Version

latest

'latest' Version

master