Metadata-Version: 2.1
Name: AioSpider-zly
Version: 2.0.0
Summary: 高并发异步爬虫框架
Home-page: https://github.com/zly717216/AioSpider
Author: zly717216
Author-email: zly717216@qq.com
Maintainer: zly
License: MIT
Keywords: 异步网页抓取,网络爬虫,异步爬虫,Python 异步抓取,数据提取,网络数据挖掘,异步爬虫框架,网络爬取工具,数据采集,数据挖掘工具
Classifier: Development Status :: 5 - Production/Stable
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Topic :: Software Development :: Libraries :: Application Frameworks
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Python: >=3.7
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: idna ==3.6
Requires-Dist: six ==1.16.0
Requires-Dist: typing-extensions ==4.9.0
Requires-Dist: aiocsv ==1.2.4
Requires-Dist: aiofiles ==23.2.1
Requires-Dist: aiohttp ==3.9.1
Requires-Dist: aiomysql ==0.2.0
Requires-Dist: aioredis ==2.0.1
Requires-Dist: aiosqlite ==0.19.0
Requires-Dist: motor ==3.3.1
Requires-Dist: beautifulsoup4 ==4.12.2
Requires-Dist: bitarray ==2.8.2
Requires-Dist: chardet ==3.0.4
Requires-Dist: cchardet ==2.1.7
Requires-Dist: ddddocr ==1.4.8
Requires-Dist: loguru ==0.7.2
Requires-Dist: lxml ==4.9.3
Requires-Dist: pydash ==7.0.6
Requires-Dist: opencv-python ==4.8.1.78
Requires-Dist: pillow ==9.5.0
Requires-Dist: openpyxl ==3.1.2
Requires-Dist: pycryptodome ==3.19.0
Requires-Dist: PyExecJS ==1.5.1
Requires-Dist: pymongo ==4.5.0
Requires-Dist: pymysql ==1.1.0
Requires-Dist: redis ==5.0.1
Requires-Dist: requests ==2.28.1
Requires-Dist: rsa ==4.9
Requires-Dist: selenium ==4.14.0
Requires-Dist: playwright ==1.39.0
Requires-Dist: tabula-py ==2.8.2
Requires-Dist: tqdm ==4.66.1
Requires-Dist: w3lib ==2.1.2
Requires-Dist: dataframe-image ==0.2.2
Requires-Dist: pandas ==2.1.2
Requires-Dist: pycryptodome

## License

This project is licensed under the terms of the MIT license. See the [LICENSE](LICENSE) file for details.

让爬虫更简单，让爬虫更高效，让爬虫更智能

## 快速开始

### 1 命令行

aioSpider 系统语法：aioSpider [action] [-argv] [--option]

#### 1.1 查看帮助

```bash
aioSpider -h
```

#### 1.2 查看版本

```bash
aioSpider -v
```

#### 1.3 创建项目

```bash
aioSpider create -p <project>
```

#### 1.4 创建爬虫

```bash
aioSpider create -s <name> --u <url> --en <spider_en_name> --s <source> --t <target> --h <help>
```

#### 1.5 `sql` 表结构转 `model`

```bash
aioSpider make -m --i <path> [--o <path>]
```

#### 1.6 生成爬虫 `bat` 启动脚本

```bash
aioSpider make -b [--i <path>] [--o <path>]
```

#### 1.7 启动 `aioSpider Server`

```bash
aioSpider server run
```

#### 1.8 停止 `aioSpider Server`

```bash
aioSpider server stop
```

#### 1.9 测试 `IP` 带宽 

```bash
aioSpider test proxy [-p <proxy>] [--d <timeout>]
```

### 1.10 适配浏览器环境

```bash
aioSpider install
```

### 1.11 启动redis服务器

```bash
aioSpider redis start
```

### 1.12 关闭redis服务器

```bash
aioSpider redis stop [-p <port>]
```

### 2 使用步骤

（1）创建项目

```bash
aioSpider create -p myproject
```

（2）进入项目根路径

```bash
cd myproject
```

