Metadata-Version: 2.5
Name: pipeloom
Version: 0.7.0
Summary: Declarative, engine-agnostic data pipelines in YAML.
Project-URL: Repository, https://github.com/emanuel-luis/pipeloom
Project-URL: Documentation, https://emanuel-luis.github.io/pipeloom/
Project-URL: Changelog, https://github.com/emanuel-luis/pipeloom/blob/main/CHANGELOG.md
Author-email: Emanuel Luis <emanuel.filho08@gmail.com>
License-Expression: Apache-2.0
License-File: LICENSE
License-File: NOTICE
Keywords: data-engineering,declarative,etl,orchestration,pipelines,yaml
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Programming Language :: Python :: 3.14
Classifier: Typing :: Typed
Requires-Python: >=3.11
Requires-Dist: click>=8.2
Requires-Dist: narwhals>=2.0
Requires-Dist: pydantic>=2.12
Requires-Dist: pyyaml>=6.0.2
Requires-Dist: rich>=13.7
Provides-Extra: airflow
Requires-Dist: pipeloom-airflow==0.7.0; extra == 'airflow'
Provides-Extra: databricks
Requires-Dist: pipeloom-databricks==0.7.0; extra == 'databricks'
Provides-Extra: pandas
Requires-Dist: pipeloom-pandas==0.7.0; extra == 'pandas'
Provides-Extra: polars
Requires-Dist: pipeloom-polars==0.7.0; extra == 'polars'
Provides-Extra: spark
Requires-Dist: pipeloom-spark[local]==0.7.0; extra == 'spark'
Provides-Extra: sqlglot
Requires-Dist: sqlglot>=26; extra == 'sqlglot'
Description-Content-Type: text/markdown

# pipeloom

Declarative, engine-agnostic data pipelines in YAML.

pipeloom 0.3 reads a YAML project, validates it in layers, builds the dependency graph, compiles
the execution plan into a manifest and runs it on polars or pandas. Every run writes
`run_results.json` with one row per model. 0.3 adds incremental models, merge and
replace_partitions writes, schema-change policies, expectations with quarantine, retries,
timeouts and cancellation.

```console
$ pip install "pipeloom[polars]"   # or pipeloom[pandas]
$ pipeloom validate
$ pipeloom run
```

Documentation: https://emanuel-luis.github.io/pipeloom/latest/

Source: https://github.com/emanuel-luis/pipeloom

License: Apache-2.0.
