Metadata-Version: 2.1
Name: aioscrapy-redis
Version: 0.5
Summary: A mini spider framework, Integrate aiohttp into scrapy
Home-page: https://github.com/pythonlw/aioscrapy_redis
Author: 道法自然_Tor
Author-email: 1540310556@qq.com
License: Apache License v2
Platform: UNKNOWN
Classifier: Programming Language :: Python
Classifier: Operating System :: Microsoft :: Windows
Classifier: Programming Language :: Python :: 3
Description-Content-Type: text/markdown

Python async library for web scraping
PyPI version License: MIT

Build Status codecov codebeat badge Codacy Badge

Installing
pip install aioscrapy_redis
Usage
Plain text scraping


from aioscrapy_redis.core.spider import Spider

from aioscrapy_redis.https.request import Request

import re

from urllib.parse import unquote

"""
The start url can be placed in start_urls or written to the redis queue
"""

class Async_Spider(Spider):

    name = 'aioscrapy_spider'

    redis_key = 'aioscrapy_spider:url'
    
    start_urls = []

    def parse(self, response):
        pass




