Index

Symbols

--blob-args dp-deploy command line option --dags-path dp-deploy command line option --datahub-ingest dp-deploy command line option --docker-build dp-compile command line option --docker-push dp-deploy command line option --env dp-compile command line option dp-deploy command line option dp-prepare-env command line option dp-publish command line option dp-run command line option dp-test command line option

--key-path dp-publish command line option --vcs-ref dp-update command line option --version dp command line option

A

add_suffix_to_git_template_path() (in module data_pipelines_cli.vcs_utils)

AirflowDagsPathKeyError

B

blob_address_path (DeployCommand attribute)

C

cached_read_response (DockerResponseReader attribute) clean() (in module data_pipelines_cli.cli_commands.clean) cli() (in module data_pipelines_cli.cli) click_echo_ok_responses() (DockerResponseReader method) columns (DbtModel attribute) commit_sha (DockerArgs attribute)

compile_project() (in module data_pipelines_cli.cli_commands.compile) CONFIG_PATH dp-init command line option copy_config_dir_to_build_dir() (in module data_pipelines_cli.config_generation) copy_dag_dir_to_build_dir() (in module data_pipelines_cli.config_generation) create() (in module data_pipelines_cli.cli_commands.create) create_package() (in module data_pipelines_cli.cli_commands.publish)

D

data_pipelines_cli module data_pipelines_cli.cli module data_pipelines_cli.cli_commands module data_pipelines_cli.cli_commands.clean module data_pipelines_cli.cli_commands.compile module data_pipelines_cli.cli_commands.create module data_pipelines_cli.cli_commands.deploy module data_pipelines_cli.cli_commands.init module data_pipelines_cli.cli_commands.prepare_env module data_pipelines_cli.cli_commands.publish module data_pipelines_cli.cli_commands.run module data_pipelines_cli.cli_commands.template module data_pipelines_cli.cli_commands.test module data_pipelines_cli.cli_commands.update module data_pipelines_cli.cli_constants module data_pipelines_cli.cli_utils module data_pipelines_cli.config_generation module data_pipelines_cli.data_structures module data_pipelines_cli.dbt_utils module data_pipelines_cli.docker_response_reader module data_pipelines_cli.errors module data_pipelines_cli.filesystem_utils module data_pipelines_cli.io_utils module data_pipelines_cli.jinja module data_pipelines_cli.vcs_utils module

database (DbtSource attribute) datahub_ingest (DeployCommand attribute) DataPipelinesConfig (class in data_pipelines_cli.data_structures) DataPipelinesError DbtModel (class in data_pipelines_cli.data_structures) DbtProfile (class in data_pipelines_cli.config_generation) DbtSource (class in data_pipelines_cli.data_structures) DbtTableColumn (class in data_pipelines_cli.data_structures) DEFAULT_GLOBAL_CONFIG (in module data_pipelines_cli.cli_constants) DependencyNotInstalledError deploy() (DeployCommand method) DeployCommand (class in data_pipelines_cli.cli_commands.deploy) description (DbtModel attribute) (DbtSource attribute) (DbtTableColumn attribute) docker_args (DeployCommand attribute) docker_build_tag() (DockerArgs method) DockerArgs (class in data_pipelines_cli.data_structures) DockerErrorResponseError DockerNotInstalledError DockerReadResponse (class in data_pipelines_cli.docker_response_reader) DockerResponseReader (class in data_pipelines_cli.docker_response_reader) dp command line option --version dp-compile command line option --docker-build --env dp-create command line option PROJECT_PATH TEMPLATE_PATH dp-deploy command line option --blob-args --dags-path --datahub-ingest --docker-push --env dp-init command line option CONFIG_PATH dp-prepare-env command line option --env dp-publish command line option --env --key-path dp-run command line option --env dp-test command line option --env dp-update command line option --vcs-ref PROJECT_PATH

E

echo_error() (in module data_pipelines_cli.cli_utils) echo_info() (in module data_pipelines_cli.cli_utils)

echo_suberror() (in module data_pipelines_cli.cli_utils) echo_subinfo() (in module data_pipelines_cli.cli_utils) echo_warning() (in module data_pipelines_cli.cli_utils)

G

generate_profiles_dict() (in module data_pipelines_cli.config_generation) generate_profiles_yml() (in module data_pipelines_cli.config_generation) get_argument_or_environment_variable() (in module data_pipelines_cli.cli_utils)

get_dbt_profiles_env_name() (in module data_pipelines_cli.cli_constants) get_profiles_dir_build_path() (in module data_pipelines_cli.config_generation) git_revision_hash() (in module data_pipelines_cli.io_utils)

I

identifier (DbtModel attribute) IMAGE_TAG_TO_REPLACE (in module data_pipelines_cli.cli_constants)

init() (in module data_pipelines_cli.cli_commands.init) is_error (DockerReadResponse attribute)

J

JinjaVarKeyError

L

list_templates() (in module data_pipelines_cli.cli_commands.template) local_fs (LocalRemoteSync attribute)

local_path_str (LocalRemoteSync attribute) LocalRemoteSync (class in data_pipelines_cli.filesystem_utils) logs_generator (DockerResponseReader attribute)

M

message (AirflowDagsPathKeyError attribute) (DataPipelinesError attribute) (DependencyNotInstalledError attribute) (DockerErrorResponseError attribute) (DockerNotInstalledError attribute) (JinjaVarKeyError attribute) (NoConfigFileError attribute) (NotAProjectDirectoryError attribute) (SubprocessNonZeroExitError attribute) (SubprocessNotFound attribute) meta (DbtModel attribute) (DbtSource attribute) (DbtTableColumn attribute) module data_pipelines_cli data_pipelines_cli.cli data_pipelines_cli.cli_commands data_pipelines_cli.cli_commands.clean data_pipelines_cli.cli_commands.compile data_pipelines_cli.cli_commands.create data_pipelines_cli.cli_commands.deploy data_pipelines_cli.cli_commands.init data_pipelines_cli.cli_commands.prepare_env data_pipelines_cli.cli_commands.publish data_pipelines_cli.cli_commands.run data_pipelines_cli.cli_commands.template data_pipelines_cli.cli_commands.test data_pipelines_cli.cli_commands.update data_pipelines_cli.cli_constants data_pipelines_cli.cli_utils data_pipelines_cli.config_generation data_pipelines_cli.data_structures data_pipelines_cli.dbt_utils data_pipelines_cli.docker_response_reader data_pipelines_cli.errors data_pipelines_cli.filesystem_utils data_pipelines_cli.io_utils data_pipelines_cli.jinja data_pipelines_cli.vcs_utils

msg (DockerReadResponse attribute)

N

name (DbtModel attribute) (DbtSource attribute) (DbtTableColumn attribute)

NoConfigFileError NotAProjectDirectoryError

O

outputs (DbtProfile attribute)

P

prepare_env() (in module data_pipelines_cli.cli_commands.prepare_env) PROFILE_NAME_ENV_EXECUTION (in module data_pipelines_cli.cli_constants) PROFILE_NAME_LOCAL_ENVIRONMENT (in module data_pipelines_cli.cli_constants) PROJECT_PATH dp-create command line option dp-update command line option

provider_kwargs_dict (DeployCommand attribute) publish_package() (in module data_pipelines_cli.cli_commands.publish)

Q

quote (DbtTableColumn attribute)

R

read_dbt_vars_from_configs() (in module data_pipelines_cli.dbt_utils) read_dictionary_from_config_directory() (in module data_pipelines_cli.config_generation) read_env_config() (in module data_pipelines_cli.data_structures) read_response() (DockerResponseReader method) remote_path_str (LocalRemoteSync attribute)

replace() (in module data_pipelines_cli.io_utils) replace_image_settings() (in module data_pipelines_cli.cli_commands.compile) replace_vars_with_values() (in module data_pipelines_cli.jinja) repository (DockerArgs attribute) run() (in module data_pipelines_cli.cli_commands.run) run_dbt_command() (in module data_pipelines_cli.dbt_utils)

S

schema (DbtSource attribute) subprocess_run() (in module data_pipelines_cli.cli_utils)

SubprocessNonZeroExitError SubprocessNotFound sync() (LocalRemoteSync method)

T

tables (DbtSource attribute) tags (DbtModel attribute) (DbtSource attribute) (DbtTableColumn attribute) target (DbtProfile attribute) template_name (TemplateConfig attribute) TEMPLATE_PATH dp-create command line option

template_path (TemplateConfig attribute) TemplateConfig (class in data_pipelines_cli.data_structures) templates (DataPipelinesConfig attribute) test() (in module data_pipelines_cli.cli_commands.test) tests (DbtModel attribute) (DbtTableColumn attribute)

U

update() (in module data_pipelines_cli.cli_commands.update)

V

vars (DataPipelinesConfig attribute)