Metadata-Version: 2.1
Name: boris-spider
Version: 0.0.2
Summary: A high-level Web Crawling and Web Scraping framework
Home-page: https://github.com/Boris-code/spider.git
Author: Boris
Author-email: boris@bzkj.tech
License: MIT
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Description-Content-Type: text/markdown
Requires-Dist: better-exceptions (==0.2.2)
Requires-Dist: DBUtils (==1.3)
Requires-Dist: parsel (==1.5.2)
Requires-Dist: PyExecJS (==1.5.1)
Requires-Dist: PyMySQL (==0.9.3)
Requires-Dist: redis (==2.10.6)
Requires-Dist: requests (>=2.22.0)
Requires-Dist: bs4 (==0.0.1)

# boris-spider

![](https://img.shields.io/badge/python-3.6-brightgreen)

一款高可用的python爬虫框架，支持分布式及批次采集

## 安装

From PyPi:

    pip3 install boris-spider

From Git:

    pip3 install git+https://github.com/Boris-code/boris-spider.git

## 快速上手

    import spider


    class DemoSpider(spider.SingleSpider):
        def start_requests(self, *args, **kws):
            yield spider.Request("https://www.baidu.com")

        def parser(self, request, response):
            print(response.text)


    if __name__ == "__main__":
        DemoSpider().start()

