Data Pipelines CLI
: CLI for data platform
Introduction
Data Pipelines CLI, also called DP tool, is a command-line tool providing an easy way to build and manage data pipelines based on dbt in an environment with GIT, Airflow, DataHub, VSCode, etc.
The tool can be used in any environment with access to shell and Python
installed.
data-pipelines-cli’s main task is to cover technical complexities and provides an abstraction over all components that take part in Data Pipelines creation and execution. Thanks to the integration with templating engine it allows Analytics Engineers to create and configure new projects. The tool also simplifies automation as it handles deployments and publications of created transformations.
Community
Although the tools were created by GetInData and used in their project it is open-sourced and everyone is welcome to use and contribute to making it better and more powerful.