Metadata-Version: 2.1
Name: SoDo
Version: 1.0.1
Summary: Redis-based  scheduler and Message queue Spider for Scrapy,  Provide more flexible and practical ways for Scrapy
Home-page: https://github.com/ycvbcvfu/sodo
Author: ryan
Author-email: legotime@qq.com
Maintainer: ryan
License: MIT License
Platform: UNKNOWN
Requires-Dist: Scrapy
Requires-Dist: kafka
Requires-Dist: redis

# SoDo 

## Overview

Redis-based  scheduler and Message queue Spider for Scrapy,  Provide more flexible and practical ways for Scrapy.

For more information [Document](https://ycvbcvfu.github.io/SoDo) [中文文档](https://ycvbcvfu.github.io/SoDo/#/zh-cn/):

## Requirements

- Python 3
- Scrapy >=1.6


## Features

- Distributed 

> Redis-based  scheduler

- Hooks feature

> new  feature for Scrapy projects

- Flexible parameter configuration

> Kafka , Redis client parameter set by yourself.

- Filter interface 

> Built-in BloomFiler and OriginalFilter  




## Installation

```python
pip install -U sodo -i https://pypi.org/simple
``` 


## Contribution guidelines

If you want to contribute to `SoDo`, please see [CONTRIBUTING Doc](https://github.com/ycvbcvfu/SoDo/blob/master/CONTRIBUTING.md)


## For more information

- [HelloWorld Tutorial](https://github.com/ycvbcvfu/SoDo/blob/master/examples/helloworld)




### wechat

![wechat](docs/picture/wechat.JPG)






