Orchestrate data movement without the glue code
Design, schedule, and monitor ETL and ELT pipelines visually — from extraction through transformation to your warehouse — with retries, alerting, and full run history.
- Visual pipeline designer with dependency graphs
- Schedule- and event-based triggers
- Incremental loads and change data capture
What you can do with Pipelines
Visual designer
Compose pipelines as a graph of activities — copy, transform, branch, and loop — with drag-and-drop simplicity.
Flexible triggers
Run on a cron schedule, on file arrival, or on demand via API. Chain pipelines with dependency triggers.
Incremental & CDC
Move only what changed. Watermark-based incremental loads and change data capture keep syncs fast and cheap.
SQL & visual transforms
Transform with SQL you control or visual dataflow steps — joins, filters, aggregations, pivots, and type casting.
Monitoring & alerts
Every run is logged with row counts, durations, and errors. Get alerted on failures or SLA breaches.
Retries & recovery
Automatic retries with backoff, checkpoint restarts, and dead-letter handling keep pipelines resilient.
How it works
Pick source & destination
Any connector to your warehouse or lake
Design the flow
Add transform, branch, and validation steps
Set the trigger
Schedule, event, or API-driven runs
Monitor runs
Track history, alerts, and data volumes
Frequently asked questions
Pipelines covers the core ADF workloads — copy activities, dataflows, triggers, and monitoring — inside the same platform as your BI, so lineage flows end to end without stitching tools together.