Versions

Build a version

Description

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Repository

https://github.com/istresearch/scrapy-cluster

Last Built

1 month, 3 weeks ago passed

Owners

Home Page

https://github.com/istresearch/scrapy-cluster

Badge

Tags

redis, kafka, scrapy

Project Privacy Level

Public

Short URLs

scrapy-cluster.readthedocs.io
scrapy-cluster.rtfd.io

Default Version

latest

'latest' Version

master