Metadata-Version: 2.1
Name: graper
Version: 0.1.6
Summary: A Spider FrameWork
Home-page: https://github.com/dytttf/graper
Author: Dytttf
Author-email: dytttf@foxmail.com
License: BSD
Keywords: graper,spider,batch-spider
Platform: UNKNOWN
Classifier: Development Status :: 3 - Alpha
Classifier: Framework :: Scrapy
Classifier: Operating System :: POSIX
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: License :: OSI Approved :: BSD License
Description-Content-Type: text/markdown
Requires-Dist: better-exceptions
Requires-Dist: gevent
Requires-Dist: httpx[http2]
Requires-Dist: mysqlclient
Requires-Dist: oss2
Requires-Dist: pymysql
Requires-Dist: redis (>=3.0.0)
Requires-Dist: tqdm
Requires-Dist: urllib3
Requires-Dist: user-agent2

# graper
A Spider FrameWork.

## Installation
You can install graper by simply doing:

    pip install graper

## Usage
**Very Important Thing**
This line must be the first line in code
```
from graper.spiders import *
```


## About Environment Variable
> ~/.graper/.env < $(pwd)/.env


## docker build
```shell
cd docekr
bash build.sh
```

## TODO
- ftp download
- auto add task

