Metadata-Version: 2.1
Name: data-lineage
Version: 0.2.0
Summary: Open Source Data Lineage Tool For AWS and GCP
Home-page: https://tokern.io/lineage
Author: Tokern
Author-email: info@tokern.io
License: MIT
Download-URL: https://github.com/tokern/data-lineage/tarball/0.2.0
Keywords: data-lineage databases postgres graphs plotly
Platform: UNKNOWN
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Topic :: Database
Classifier: Topic :: Software Development
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Description-Content-Type: text/markdown
Requires-Dist: decorator (==4.4.2)
Requires-Dist: inflection (==0.3.1)
Requires-Dist: networkx (==2.4)
Requires-Dist: pglast (==1.10)
Requires-Dist: plotly (==4.5.4)
Requires-Dist: retrying (==1.3.3)
Requires-Dist: six (==1.14.0)

[![CircleCI](https://circleci.com/gh/tokern/data-lineage.svg?style=svg)](https://circleci.com/gh/tokern/data-lineage)
[![codecov](https://codecov.io/gh/tokern/data-lineage/branch/master/graph/badge.svg)](https://codecov.io/gh/tokern/data-lineage)
[![PyPI](https://img.shields.io/pypi/v/data-lineage.svg)](https://pypi.python.org/pypi/data-lineage)
[![image](https://img.shields.io/pypi/l/data-lineage.svg)](https://pypi.org/project/data-lineage/)
[![image](https://img.shields.io/pypi/pyversions/data-lineage.svg)](https://pypi.org/project/data-lineage/)

# Data Lineage for Databases and Data Lakes

Data Lineage is an open source application to query and visualize data lineage in databases, 
data warehouses and data lakes in AWS and GCP.


# Features
* Generate lineage from SQL query history.
* Supports ANSI SQL queries
* Integrate with Jupyter Notebook
* Visualize data lineage using Plotly. 
* Select source or target table.
* Pan, Zoom, Select graph

Checkout an [example data lineage notebook](http://tokern.io/docs/data-lineage/example/).

## Use Cases

Data Lineage enables the following use cases:

* Business Rules Verification
* Change Impact Analysis
* Data Quality Verification

Check out [the post on using data lineage for cost control](https://tokern.io/blog/data-lineage-on-redshift/) for an 
example of how data lineage can be used in production.

## Quick Start
```shell script
# Install packages
pip install data-lineage
pip install jupyter

jupyter notebook

# Checkout example notebook: http://tokern.io/docs/data-lineage/example/ 

```

## Supported Technologies

* Postgres

### Coming Soon

* MySQL
* AWS Redshift
* SparkSQL
* Presto

## Developer Setup
```shell script
# Install dependencies
pipenv install --dev

# Setup pre-commit and pre-push hooks
pipenv run pre-commit install -t pre-commit
pipenv run pre-commit install -t pre-push
```



