Metadata-Version: 2.4
Name: aiutil
Version: 0.87.1
Summary: A utils Python package for data scientists.
Project-URL: Repository, https://github.com/legendu-net/aiutil
Author-email: Benjamin Du <longendu@yahoo.com>
License-Expression: MIT
Keywords: AI,Machine Learning,tools,utils
Requires-Python: <3.14,>=3.10
Requires-Dist: dateparser>=0.7.1
Requires-Dist: dulwich>=0.20.24
Requires-Dist: loguru>=0.3.2
Requires-Dist: nbconvert>=7.16.6
Requires-Dist: nbformat>=5.10.4
Requires-Dist: notifiers>=1.2.1
Requires-Dist: numba>=0.53.0rc1.post1
Requires-Dist: pandas>=1.2.0
Requires-Dist: paramiko>=3.2.0
Requires-Dist: pathspec>=0.8.1
Requires-Dist: pytest>=3.0
Requires-Dist: python-magic>=0.4.0
Requires-Dist: pyyaml>=5.3.1
Requires-Dist: scikit-image>=0.18.3
Requires-Dist: sqlparse>=0.4.1
Requires-Dist: toml>=0.10.0
Requires-Dist: tqdm>=4.59.0
Provides-Extra: admin
Requires-Dist: psutil>=5.7.3; extra == 'admin'
Provides-Extra: all
Requires-Dist: black[jupyter]>=23.7.0; extra == 'all'
Requires-Dist: docker>=4.4.0; extra == 'all'
Requires-Dist: nbconvert>=5.6.1; extra == 'all'
Requires-Dist: nbformat>=5.0.7; extra == 'all'
Requires-Dist: networkx>=2.5; extra == 'all'
Requires-Dist: opencv-python>=4.0.0.0; extra == 'all'
Requires-Dist: pdfplumber>=0.11.7; extra == 'all'
Requires-Dist: pillow>=7.0.0; extra == 'all'
Requires-Dist: psutil>=5.7.3; extra == 'all'
Requires-Dist: pypdf>=3.16.1; extra == 'all'
Requires-Dist: requests>=2.20.0; extra == 'all'
Provides-Extra: cv
Requires-Dist: opencv-python>=4.0.0.0; extra == 'cv'
Requires-Dist: pillow>=7.0.0; extra == 'cv'
Provides-Extra: docker
Requires-Dist: docker>=4.4.0; extra == 'docker'
Requires-Dist: networkx>=2.5; extra == 'docker'
Requires-Dist: requests>=2.20.0; extra == 'docker'
Provides-Extra: jupyter
Requires-Dist: black[jupyter]>=23.7.0; extra == 'jupyter'
Requires-Dist: nbconvert>=5.6.1; extra == 'jupyter'
Requires-Dist: nbformat>=5.0.7; extra == 'jupyter'
Provides-Extra: pdf
Requires-Dist: pdfplumber>=0.11.7; extra == 'pdf'
Requires-Dist: pypdf>=3.16.1; extra == 'pdf'
Description-Content-Type: text/markdown

# AI/ML Utils  |  [@GitHub](https://github.com/legendu-net/aiutil)  |  [@PyPI](https://pypi.org/project/aiutil/)

This is a Python pacakage that contains misc utils for AI/ML.

1. Misc enhancement of Python's built-in functionalities.
    - string
    - collections
    - pandas DataFrame
    - datetime
2. Misc other tools
    - `aiutil.filesystem`: misc tools for querying and manipulating filesystems; convenient tools for manipulating text files.
    - `aiutil.url`: URL formatting for HTML, Excel, etc.
    - `aiutil.sql`: SQL formatting
    - `aiutil.cv`: some more tools (in addition to OpenCV) for image processing
    - `aiutil.shell`: parse command-line output to a pandas DataFrame
    - `aiutil.shebang`: auto correct SheBang of scripts
    - `aiutil.pydev`: tools for making it even easier to manage Python project
    - `aiutil.pdf`: easy and flexible extracting of PDF pages
    - `aiutil.memory`: query and consume memory to a specified range
    - `aiutil.notebook`: Jupyter/Lab notebook related tools
    - `aiutil.dockerhub`: managing Docker images on DockerHub in batch mode using Python
    - `aiutil.hadoop`: 
        - A Spark application log analyzing tool for identify root causes of failed Spark applications.
        - Pythonic wrappers to the `hdfs` command.
        - A auto authentication tool for Kerberos.
        - An improved version of `spark_submit`.
        - Other misc PySpark functions. 
    
## Supported Operating Systems and Python Versions

Python 3.10.x on Linux and macOS.
It might work on Windows but is not tested on Windows.

## Installation

```bash
pip3 install --user -U aiutil
```
Use the following commands if you want to install all components of aiutil. 
Available additional components are `cv`, `docker`, `pdf`, `jupyter`, `admin` and `all`.
```bash
pip3 install --user -U aiutil[all]
```
