Data Detective

Official homepage: Data Detective

Features

Data Catalog is an open-source metadata platform for your company.

• Data Catalog for entities of any type (Metadata loading of diagrams, tables, columns, reports, pipelines, DAGs, Zeppelin notes, Jupyter notebook is supported)
• Two-level lineage
• Flexible search
• Modern UI

Documentation

Official documentation is available here.

Quickstart

Quickstart instructions for each component of the project are available in the official documentation (Quickstart section).

Subprojects and repositories

• data-detective-airflow: This repository contains the source code of data-detective-airflow project. Also available in the PyPi repository.
• data-detective-etl: This repository contains the source code of data-detective-etl project.

Contributing

Our team always welcomes contributions to the project. Please see the contributing instruction for more information.

Articles & Talks

• Testing of Apache Airflow’s DAGs with docker compose and pytest

Data Detective team

License

Apache License 2.0.