Airflow

Open-source data orchestration and scheduling platform for building ETL pipelines. It integrates with MotherDuck for scheduling DuckDB and MotherDuck tasks in repeatable data workflows.

How it works with MotherDuck

1. Create a task, DAG, flow, or job in Airflow that runs a DuckDB or MotherDuck step.
2. Store the MotherDuck token in the orchestrator's secret manager.
3. Use a small validation query before scheduling larger ingestion, transformation, or export jobs.

Related content

• View the full process in the Airflow documentation
• Loading data into MotherDuck
• MotherDuck authentication