Airflow Provider for Paradime dbt

1.1.0 verified Fri May 01 auth: no python

An Apache Airflow provider that enables interaction with Paradime's Bolt scheduler and management APIs to run and manage dbt jobs in production. Current version is 1.1.0, with a monthly release cadence.

pip install airflow-provider-paradime-dbt

Common errors

error ModuleNotFoundError: No module named 'paradime_provider' ↓

cause Incorrect import path. The provider's module is named 'paradime_provider' not 'airflow.providers.paradime'.

fix

Use: from paradime_provider.operators.bolt_dbt_run import ParadimeBoltDbtRunOperator

error airflow.exceptions.AirflowException: Connection 'paradime_default' not found ↓

cause The required Airflow connection for Paradime is missing or incorrectly named.

fix

Create an Airflow connection with Conn ID 'paradime_default' and Conn Type 'paradime', providing your API key and secret.

Warnings

gotcha The connection ID must be configured in Airflow with a 'paradime' connection type. The default is 'paradime_default'. ↓

fix In Airflow UI, go to Admin > Connections, add a connection with Conn Type 'paradime', and fill in your Paradime API key and secret.

gotcha Operator names have changed in version 1.0.4. 'ParadimeBoltDbtScheduleRunOperator' now supports overriding dbt commands via the `override_dbt_command` parameter. ↓

fix Use the `override_dbt_command` parameter if you need custom dbt commands.

breaking Version 1.0.0 introduced breaking changes as initial release. No prior versions exist. ↓

fix Ensure you are using the correct import paths: `paradime_provider` instead of any alternative.

Imports

ParadimeBoltDbtRunOperator

wrong

from airflow.providers.paradime.operators.bolt_dbt_run import ParadimeBoltDbtRunOperator

correct

from paradime_provider.operators.bolt_dbt_run import ParadimeBoltDbtRunOperator

The package uses 'paradime_provider' not 'airflow.providers.paradime'

ParadimeBoltDbtScheduleRunOperator

from paradime_provider.operators.bolt_dbt_schedule_run import ParadimeBoltDbtScheduleRunOperator

ParadimeHook

from paradime_provider.hooks.paradime import ParadimeHook

Quickstart

Creates a simple DAG that triggers a dbt run via Paradime Bolt.

from datetime import datetime
from airflow import DAG
from paradime_provider.operators.bolt_dbt_run import ParadimeBoltDbtRunOperator

default_args = {
    'start_date': datetime(2023, 1, 1),
}

dag = DAG(
    'paradime_dbt_run',
    default_args=default_args,
    schedule_interval=None,
    catchup=False,
)

run_task = ParadimeBoltDbtRunOperator(
    task_id='run_dbt_job',
    paradime_conn_id='paradime_default',
    dag=dag,
)