Index

Symbols

--auth-token dp-deploy command line option --bi-git-key-path dp-deploy command line option --blob-args dp-deploy command line option --dags-path dp-deploy command line option --datahub-ingest dp-deploy command line option --docker-args dp-compile command line option --docker-build dp-compile command line option --docker-push dp-deploy command line option --docker-tag dp-compile command line option --env dp-compile command line option dp-deploy command line option dp-docs-serve command line option dp-generate-model-yaml command line option dp-generate-source-sql command line option dp-generate-source-yaml command line option dp-prepare-env command line option dp-publish command line option dp-run command line option dp-seed command line option dp-test command line option

--key-path dp-publish command line option --overwrite dp-generate-model-yaml command line option dp-generate-source-sql command line option dp-generate-source-yaml command line option --port dp-docs-serve command line option --source-path dp-generate-source-yaml command line option --source-yaml-path dp-generate-source-sql command line option --staging-path dp-generate-source-sql command line option --vcs-ref dp-create command line option dp-update command line option --version dp command line option --with-meta dp-generate-model-yaml command line option

A

add_suffix_to_git_template_path() (in module data_pipelines_cli.vcs_utils) airbyte_config_path (AirbyteFactory attribute) AirbyteFactory (class in data_pipelines_cli.airbyte_utils)

AirflowDagsPathKeyError arg_name (MacroArgName attribute) auth_token (AirbyteFactory attribute) (DeployCommand attribute)

B

bi() (in module data_pipelines_cli.bi_utils) bi_git_key_path (DeployCommand attribute)

BiAction (class in data_pipelines_cli.bi_utils) blob_address_path (DeployCommand attribute) build_args (DockerArgs attribute)

C

cached_read_response (DockerResponseReader attribute) clean() (in module data_pipelines_cli.cli_commands.clean) cli() (in module data_pipelines_cli.cli) click_echo_ok_responses() (DockerResponseReader method) columns (DbtModel attribute) COMPILE (BiAction attribute) compile_project() (in module data_pipelines_cli.cli_commands.compile)

CONFIG_PATH dp-init command line option copy_config_dir_to_build_dir() (in module data_pipelines_cli.config_generation) copy_dag_dir_to_build_dir() (in module data_pipelines_cli.config_generation) create() (in module data_pipelines_cli.cli_commands.create) create_package() (in module data_pipelines_cli.cli_commands.publish) create_update_connection() (AirbyteFactory method) create_update_connections() (AirbyteFactory method)

D

data_pipelines_cli module data_pipelines_cli.airbyte_utils module data_pipelines_cli.bi_utils module data_pipelines_cli.cli module data_pipelines_cli.cli_commands module data_pipelines_cli.cli_commands.clean module data_pipelines_cli.cli_commands.compile module data_pipelines_cli.cli_commands.create module data_pipelines_cli.cli_commands.deploy module data_pipelines_cli.cli_commands.docs module data_pipelines_cli.cli_commands.generate module data_pipelines_cli.cli_commands.generate.generate module data_pipelines_cli.cli_commands.generate.model_yaml module data_pipelines_cli.cli_commands.generate.source_sql module data_pipelines_cli.cli_commands.generate.source_yaml module data_pipelines_cli.cli_commands.generate.utils module data_pipelines_cli.cli_commands.init module data_pipelines_cli.cli_commands.prepare_env module data_pipelines_cli.cli_commands.publish module data_pipelines_cli.cli_commands.run module data_pipelines_cli.cli_commands.seed module data_pipelines_cli.cli_commands.template module data_pipelines_cli.cli_commands.test module data_pipelines_cli.cli_commands.update module data_pipelines_cli.cli_configs module data_pipelines_cli.cli_constants module data_pipelines_cli.cli_utils module data_pipelines_cli.config_generation module data_pipelines_cli.data_structures module data_pipelines_cli.dbt_utils module data_pipelines_cli.docker_response_reader module data_pipelines_cli.errors module data_pipelines_cli.filesystem_utils module data_pipelines_cli.io_utils module data_pipelines_cli.jinja module data_pipelines_cli.looker_utils module data_pipelines_cli.vcs_utils module database (DbtSource attribute) datahub_ingest (DeployCommand attribute)

DataPipelinesConfig (class in data_pipelines_cli.data_structures) DataPipelinesError DbtModel (class in data_pipelines_cli.data_structures) DbtProfile (class in data_pipelines_cli.config_generation) DbtSource (class in data_pipelines_cli.data_structures) DbtTableColumn (class in data_pipelines_cli.data_structures) DEFAULT_GLOBAL_CONFIG (in module data_pipelines_cli.cli_constants) DependencyNotInstalledError DEPLOY (BiAction attribute) deploy() (DeployCommand method) deploy_lookML_model() (in module data_pipelines_cli.looker_utils) DeployCommand (class in data_pipelines_cli.cli_commands.deploy) deps_name (MacroArgName attribute) description (DbtModel attribute) (DbtSource attribute) (DbtTableColumn attribute) docker_args (DeployCommand attribute) docker_build_tag() (DockerArgs method) DockerArgs (class in data_pipelines_cli.data_structures) DockerErrorResponseError DockerNotInstalledError DockerReadResponse (class in data_pipelines_cli.docker_response_reader) DockerResponseReader (class in data_pipelines_cli.docker_response_reader) docs() (in module data_pipelines_cli.cli_commands.docs) dp command line option --version dp-compile command line option --docker-args --docker-build --docker-tag --env dp-create command line option --vcs-ref PROJECT_PATH TEMPLATE_PATH dp-deploy command line option --auth-token --bi-git-key-path --blob-args --dags-path --datahub-ingest --docker-push --env dp-docs-serve command line option --env --port dp-generate-model-yaml command line option --env --overwrite --with-meta MODEL_PATH dp-generate-source-sql command line option --env --overwrite --source-yaml-path --staging-path dp-generate-source-yaml command line option --env --overwrite --source-path SCHEMA_NAME dp-init command line option CONFIG_PATH dp-prepare-env command line option --env dp-publish command line option --env --key-path dp-run command line option --env dp-seed command line option --env dp-test command line option --env dp-update command line option --vcs-ref PROJECT_PATH

E

echo_error() (in module data_pipelines_cli.cli_utils) echo_info() (in module data_pipelines_cli.cli_utils) echo_suberror() (in module data_pipelines_cli.cli_utils)

echo_subinfo() (in module data_pipelines_cli.cli_utils) echo_warning() (in module data_pipelines_cli.cli_utils) env (DeployCommand attribute) env_replacer() (AirbyteFactory static method)

F

find_config_file() (AirbyteFactory static method)

find_datahub_config_file() (in module data_pipelines_cli.cli_configs)

G

generate_lookML_model() (in module data_pipelines_cli.looker_utils) generate_model_yamls() (in module data_pipelines_cli.cli_commands.generate.model_yaml) generate_models_or_sources_from_single_table() (in module data_pipelines_cli.cli_commands.generate.utils) generate_profiles_dict() (in module data_pipelines_cli.config_generation) generate_profiles_yml() (in module data_pipelines_cli.config_generation) generate_source_sqls() (in module data_pipelines_cli.cli_commands.generate.source_sql)

generate_source_yamls() (in module data_pipelines_cli.cli_commands.generate.source_yaml) get_argument_or_environment_variable() (in module data_pipelines_cli.cli_utils) get_dbt_profiles_env_name() (in module data_pipelines_cli.cli_constants) get_macro_run_output() (in module data_pipelines_cli.cli_commands.generate.utils) get_output_file_or_warn_if_exists() (in module data_pipelines_cli.cli_commands.generate.utils) get_profiles_dir_build_path() (in module data_pipelines_cli.config_generation) git_revision_hash() (in module data_pipelines_cli.io_utils)

I

identifier (DbtModel attribute) image_tag (DockerArgs attribute)

IMAGE_TAG_TO_REPLACE (in module data_pipelines_cli.cli_constants) init() (in module data_pipelines_cli.cli_commands.init) is_error (DockerReadResponse attribute)

J

JinjaVarKeyError

L

list_templates() (in module data_pipelines_cli.cli_commands.template) local_fs (LocalRemoteSync attribute)

local_path_str (LocalRemoteSync attribute) LocalRemoteSync (class in data_pipelines_cli.filesystem_utils) logs_generator (DockerResponseReader attribute)

M

macro_name (MacroArgName attribute) MacroArgName (class in data_pipelines_cli.cli_commands.generate.model_yaml) message (AirflowDagsPathKeyError attribute) (DataPipelinesError attribute) (DependencyNotInstalledError attribute) (DockerErrorResponseError attribute) (DockerNotInstalledError attribute) (JinjaVarKeyError attribute) (NoConfigFileError attribute) (NotAProjectDirectoryError attribute) (NotSuppertedBIError attribute) (SubprocessNonZeroExitError attribute) (SubprocessNotFound attribute) meta (DbtModel attribute) (DbtSource attribute) (DbtTableColumn attribute) MODEL_PATH dp-generate-model-yaml command line option module data_pipelines_cli data_pipelines_cli.airbyte_utils data_pipelines_cli.bi_utils data_pipelines_cli.cli data_pipelines_cli.cli_commands data_pipelines_cli.cli_commands.clean data_pipelines_cli.cli_commands.compile data_pipelines_cli.cli_commands.create data_pipelines_cli.cli_commands.deploy data_pipelines_cli.cli_commands.docs data_pipelines_cli.cli_commands.generate data_pipelines_cli.cli_commands.generate.generate data_pipelines_cli.cli_commands.generate.model_yaml data_pipelines_cli.cli_commands.generate.source_sql data_pipelines_cli.cli_commands.generate.source_yaml data_pipelines_cli.cli_commands.generate.utils data_pipelines_cli.cli_commands.init data_pipelines_cli.cli_commands.prepare_env data_pipelines_cli.cli_commands.publish data_pipelines_cli.cli_commands.run data_pipelines_cli.cli_commands.seed data_pipelines_cli.cli_commands.template data_pipelines_cli.cli_commands.test data_pipelines_cli.cli_commands.update data_pipelines_cli.cli_configs data_pipelines_cli.cli_constants data_pipelines_cli.cli_utils data_pipelines_cli.config_generation data_pipelines_cli.data_structures data_pipelines_cli.dbt_utils data_pipelines_cli.docker_response_reader data_pipelines_cli.errors data_pipelines_cli.filesystem_utils data_pipelines_cli.io_utils data_pipelines_cli.jinja data_pipelines_cli.looker_utils data_pipelines_cli.vcs_utils

msg (DockerReadResponse attribute)

N

name (DbtModel attribute) (DbtSource attribute) (DbtTableColumn attribute)

NoConfigFileError NotAProjectDirectoryError NotSuppertedBIError

O

outputs (DbtProfile attribute)

P

prepare_env() (in module data_pipelines_cli.cli_commands.prepare_env) PROFILE_NAME_ENV_EXECUTION (in module data_pipelines_cli.cli_constants) PROFILE_NAME_LOCAL_ENVIRONMENT (in module data_pipelines_cli.cli_constants) PROJECT_PATH dp-create command line option dp-update command line option

provider_kwargs_dict (DeployCommand attribute) publish_package() (in module data_pipelines_cli.cli_commands.publish)

Q

quote (DbtTableColumn attribute)

R

read_bi_config() (in module data_pipelines_cli.bi_utils) read_dbt_vars_from_configs() (in module data_pipelines_cli.dbt_utils) read_dictionary_from_config_directory() (in module data_pipelines_cli.config_generation) read_env_config() (in module data_pipelines_cli.data_structures) read_looker_config() (in module data_pipelines_cli.looker_utils) read_response() (DockerResponseReader method) remote_path_str (LocalRemoteSync attribute)

replace() (in module data_pipelines_cli.io_utils) replace_image_settings() (in module data_pipelines_cli.cli_commands.compile) replace_vars_with_values() (in module data_pipelines_cli.jinja) repository (DockerArgs attribute) request_handler() (AirbyteFactory method) run() (in module data_pipelines_cli.cli_commands.run) run_dbt_command() (in module data_pipelines_cli.dbt_utils)

S

schema (DbtSource attribute) SCHEMA_NAME dp-generate-source-yaml command line option seed() (in module data_pipelines_cli.cli_commands.seed) submessage (AirflowDagsPathKeyError attribute) (DataPipelinesError attribute) (DependencyNotInstalledError attribute) (DockerErrorResponseError attribute) (DockerNotInstalledError attribute) (JinjaVarKeyError attribute) (NoConfigFileError attribute) (NotAProjectDirectoryError attribute) (NotSuppertedBIError attribute) (SubprocessNonZeroExitError attribute) (SubprocessNotFound attribute)

subprocess_run() (in module data_pipelines_cli.cli_utils) SubprocessNonZeroExitError SubprocessNotFound sync() (LocalRemoteSync method)

T

tables (DbtSource attribute) tags (DbtModel attribute) (DbtSource attribute) (DbtTableColumn attribute) target (DbtProfile attribute) template_name (TemplateConfig attribute) TEMPLATE_PATH dp-create command line option

template_path (TemplateConfig attribute) TemplateConfig (class in data_pipelines_cli.data_structures) templates (DataPipelinesConfig attribute) test() (in module data_pipelines_cli.cli_commands.test) tests (DbtModel attribute) (DbtTableColumn attribute)

U

update() (in module data_pipelines_cli.cli_commands.update)

update_file() (AirbyteFactory method)

V

vars (DataPipelinesConfig attribute)