Overview
Azure Data Factory is Azure's managed ETL/ELT orchestration service. The Automize ADF connector covers pipelines, datasets, triggers, linked services, pipeline runs, and activity runs.
- Regions: Each Data Factory lives in one Azure region. Compute can span regions via Integration Runtimes.
- Plans: Pay-per-activity-run + Integration Runtime hours. Managed Virtual Network adds cost.
Setting up the connection
Auth type: OAuth 2.0 (Authorization Code).
- Entra ID → App registration → grant Data Factory Contributor role on the ADF resource.
- In Automize → Settings → Connectors → Azure Data Factory. Paste client ID + secret + subscription + resource group + factory name.
Find your credentials at https://entra.microsoft.com/.
Rate limits
Per-factory limits – typically generous. Activity concurrency limited by Integration Runtime capacity.
Data model
Orchestration primitives:
Data Factory ─┬─ Linked Services (connection configs)
├─ Datasets (data sources/sinks)
├─ Pipelines (activity DAGs)
│ └─ Activities (Copy, Lookup, ForEach, etc.)
└─ Triggers (schedule, tumbling window, event-based)Available operations
21 operations available. Click any row to jump to its detail.
| Operation | Category | What it does |
|---|---|---|
| Cancel Pipeline Run | General | Cancel a pipeline run |
| Create Dataset | General | Create or update a dataset |
| Create Pipeline | General | Create or update a pipeline |
| Create Pipeline Run | General | Trigger a pipeline run |
| Create Trigger | General | Create or update a trigger |
| Delete Dataset | General | Delete a dataset |
| Delete Pipeline | General | Delete a pipeline |
| Get Dataset | General | Get dataset definition |
| Get Factory | General | Get factory details |
| Get Linked Service | General | Get linked service details |
| Get Pipeline | General | Get pipeline definition |
| Get Pipeline Run | General | Get pipeline run details |
| Get Trigger | General | Get trigger definition |
| List Datasets | General | List datasets in a factory |
| List Factories | General | List all data factories |
| List Linked Services | General | List linked services |
| List Pipelines | General | List pipelines in a factory |
| List Triggers | General | List triggers in a factory |
| Query Pipeline Runs | General | Query pipeline runs with filters |
| Start Trigger | General | Start a trigger |
| Stop Trigger | General | Stop a trigger |
Operations
Cancel Pipeline Run
Cancel a pipeline run
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Run Id run_id | Yes | text |
Tips
- Cancels in-flight run. May take 1-2 min to actually cancel.
Create Dataset
Create or update a dataset
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Dataset Name dataset_name | Yes | text |
Create Pipeline
Create or update a pipeline
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Pipeline Name pipeline_name | Yes | text |
Create Pipeline Run
Trigger a pipeline run
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Pipeline Name pipeline_name | Yes | text |
Tips
- Trigger a pipeline run. Pass parameters object.
- Returns runId – use Describe Pipeline Run to poll status.
Create Trigger
Create or update a trigger
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Trigger Name trigger_name | Yes | text |
Delete Dataset
Delete a dataset
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Dataset Name dataset_name | Yes | text |
Delete Pipeline
Delete a pipeline
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Pipeline Name pipeline_name | Yes | text |
Get Dataset
Get dataset definition
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Dataset Name dataset_name | Yes | text |
Get Factory
Get factory details
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text |
Get Linked Service
Get linked service details
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Linked Service Name linked_service_name | Yes | text |
Get Pipeline
Get pipeline definition
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Pipeline Name pipeline_name | Yes | text |
Get Pipeline Run
Get pipeline run details
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Run Id run_id | Yes | text |
Get Trigger
Get trigger definition
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Trigger Name trigger_name | Yes | text |
List Datasets
List datasets in a factory
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text |
List Factories
List all data factories
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text |
List Linked Services
List linked services
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text |
List Pipelines
List pipelines in a factory
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text |
Tips
- Returns pipelines in the factory. Each has activities + parameters.
List Triggers
List triggers in a factory
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text |
Tips
- Triggers that can launch pipelines automatically.
Query Pipeline Runs
Query pipeline runs with filters
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text |
Start Trigger
Start a trigger
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Trigger Name trigger_name | Yes | text |
Tips
- Enable a stopped trigger. Stop Trigger pauses it.
Stop Trigger
Stop a trigger
| Parameter | Required | Type | Description |
|---|---|---|---|
Subscription Id subscription_id | Yes | text | |
Resource Group resource_group | Yes | text | |
Factory Name factory_name | Yes | text | |
Trigger Name trigger_name | Yes | text |
FAQ
- Self-Hosted vs Azure IR?
- Azure IR runs in Microsoft-managed compute. Self-Hosted runs on your VM (typically for on-prem data sources).
- Mapping Data Flow vs Copy Activity?
- Copy: simple source-to-sink with column mapping. Data Flow: visual transformation pipeline (joins, aggregations, etc.). Data Flows use Spark + cost more.