Metadata-Version: 2.0
Name: RunSpiders
Version: 1.0.1
Summary: Some predefined web crawlers
Home-page: UNKNOWN
Author: Ijustwantyouhappy
Author-email: 18817363043@163.com
Maintainer: 
Maintainer-email: 
License: MIT
Platform: all
Classifier: Environment :: Web Environment
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: MacOS
Classifier: Operating System :: Microsoft
Classifier: Operating System :: POSIX
Classifier: Operating System :: Unix
Classifier: Topic :: Internet
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Programming Language :: Python :: 3.5
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Requires-Dist: beautifulsoup4 (>=4.5.1)
Requires-Dist: gevent (>=1.1.2)
Requires-Dist: jinja2 (>=2.10.1)
Requires-Dist: pycryptodome (>=3.8.2)
Requires-Dist: requests (>=2.14.2)
Requires-Dist: tqdm (>=4.32.2)

RunSpiders
^^^^^^^^^^^

|Python3|

A python library contains some predefined web crawlers.
Attention: this package probably can't work properly because of the correlated webs updates.
If this situation happens, just fix it on your own.

Installation
>>>>>>>>>>>>>

.. code:: bash

    pip install RunSpiders

Examples
>>>>>>>>>>>>>

novel
::::::::::::::::
Please install calibre and add `ebook-convert` to environment variables.

.. code:: python

    from RunSpiders import NovelSpider

    spider = NovelSpider()
    spider.download_books(['***', ...])
    # spider.download_books(['***', ...], style="recipe_first")

movie
::::::::::::::::
Please install ffmpeg and add it to environment variables.

.. code:: python

    from RunSpiders import M3U8Spider

    spider = M3U8Spider(output="F\movies")
    spider.download_movies([(m3u8_url, file_name), ...])


.. |Python3| image:: https://img.shields.io/badge/python-3-red.svg

