Metadata-Version: 2.1
Name: autoresevaluator
Version: 0.1.4
Summary: 
Author: toma tanaka
Author-email: ulti4929@gmail.com
Requires-Python: >=3.9,<4.0
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Dist: openai (>=1.11.1,<2.0.0)
Requires-Dist: optuna (>=3.5.0,<4.0.0)
Requires-Dist: tqdm (>=4.66.1,<5.0.0)
Description-Content-Type: text/markdown

# AutoRes Evaluator


## How to use
- Install
    - https://pypi.org/project/autoresevaluator/

```Python
pip install autoresevaluator

from autoresevaluator import AutoResEvaluator
```

- Setting
```python
# Hyperparameter setting
# Specify "type" and "args" for items to be searched in optuna.
params = {
    'lambda_l1': {'type': 'log_float', 'args': [1e-8, 10.0]},
    'lambda_l2': {'type': 'log_float', 'args': [1e-8, 10.0]},
    'num_leaves': {'type': 'int', 'args': [2, 256]},
    'feature_fraction': {'type': 'float', 'args': [0.4, 1.0]},
    'bagging_fraction': {'type': 'float', 'args': [0.4, 1.0]},
    'verbosity': -1
}


are = AutoResEvaluator(
    # task type
    task_type='tabledata binary classification',
    # dataset name
    dataset_name='titanic',
    # model file path
    model_path='/Users/tanakatouma/vscode/autores-evaluator/test/lightgbm_model.py',
    params=params,
    # Metrics you want to maximize/minimize
    valuation_index='pr_auc'
    )
```

- Execution
```python
are.exec()
```

## Output
- result.log
    - File to output the results

- model_error.log
    - File to write errors in model files

