Azure Data Factory is a managed cloud service built for these complex hybrid extract-transform-load (ETL), extract-load-transform (ELT), and data integration projects.
Use the Azure public cloud integration to discover and collect metrics against the Azure service.
External reference
Azure Monitor - Platform metrics
Setup
To set up the Azure integration and discover the Azure service, go to Azure Integration Discovery Profile and select Data Factory.
Event support
- Supported
- Configurable in OpsRamp Azure Integration Discovery Profile.
Supported metrics
| OpsRamp Metric | Azure Metric | Metric Display Name | Unit | Aggregation Type | Description |
|---|---|---|---|---|---|
| azure_datafactories_FailedRuns | FailedRuns | Failed Runs | Count | Total | Failed Runs |
| azure_datafactories_SuccessfulRuns | SuccessfulRuns | Successful Runs | Count | Total | Successful Runs |
| azure_datafactories_ActivityCancelledRuns | ActivityCancelledRuns | Cancelled activity runs metrics | Count | Total | Cancelled activity runs metrics |
| azure_datafactories_ActivityFailedRuns | ActivityFailedRuns | Failed activity runs metrics | Count | Total | Failed activity runs metrics |
| azure_datafactories_ActivitySucceededRuns | ActivitySucceededRuns | Succeeded activity runs metrics | Count | Total | Succeeded activity runs metrics |
| azure_datafactories_AirflowIntegrationRuntimeCeleryTaskTimeoutError | AirflowIntegrationRuntimeCeleryTaskTimeoutError | Airflow Integration Runtime Celery Task Timeout Error | Count | Total | Airflow Integration Runtime Celery Task Timeout Error |
| azure_datafactories_AirflowIntegrationRuntimeCollectDBDags | AirflowIntegrationRuntimeCollectDBDags | Airflow Integration Runtime Collect DB Dags | Milliseconds | Average | Airflow Integration Runtime Collect DB Dags |
| azure_datafactories_AirflowIntegrationRuntimeCpuPercentage | AirflowIntegrationRuntimeCpuPercentage | Airflow Integration Runtime Cpu Percentage | Percent | Average | Airflow Integration Runtime Cpu Percentage |
| azure_datafactories_AirflowIntegrationRuntimeCpuUsage | AirflowIntegrationRuntimeCpuUsage | Airflow Integration Runtime Cpu Usage | Millicores | Average | Airflow Integration Runtime Cpu Usage |
| azure_datafactories_AirflowIntegrationRuntimeDagBagSize | AirflowIntegrationRuntimeDagBagSize | Airflow Integration Runtime Dag Bag Size | Count | Total | Airflow Integration Runtime Dag Bag Size |
| azure_datafactories_AirflowIntegrationRuntimeDagCallbackExceptions | AirflowIntegrationRuntimeDagCallbackExceptions | Airflow Integration Runtime Dag Callback Exceptions | Count | Total | Airflow Integration Runtime Dag Callback Exceptions |
| azure_datafactories_AirflowIntegrationRuntimeDAGFileRefreshError | AirflowIntegrationRuntimeDAGFileRefreshError | Airflow Integration Runtime DAG File Refresh Error | Count | Total | Airflow Integration Runtime DAG File Refresh Error |
| azure_datafactories_AirflowIntegrationRuntimeDAGProcessingImportErrors | AirflowIntegrationRuntimeDAGProcessingImportErrors | Airflow Integration Runtime DAG Processing Import Errors | Count | Total | Airflow Integration Runtime DAG Processing Import Errors |
| azure_datafactories_AirflowIntegrationRuntimeDAGProcessingLastDuration | AirflowIntegrationRuntimeDAGProcessingLastDuration | Airflow Integration Runtime DAG Processing Last Duration | Milliseconds | Average | Airflow Integration Runtime DAG Processing Last Duration |
| azure_datafactories_AirflowIntegrationRuntimeDAGProcessingLastRunSecondsAgo | AirflowIntegrationRuntimeDAGProcessingLastRunSecondsAgo | Airflow Integration Runtime DAG Processing Last Run Seconds Ago | Seconds | Average | Airflow Integration Runtime DAG Processing Last Run Seconds Ago |
| azure_datafactories_AirflowIntegrationRuntimeDAGProcessingManagerStalls | AirflowIntegrationRuntimeDAGProcessingManagerStalls | Airflow Integration Runtime DAG ProcessingManager Stalls | Count | Total | Airflow Integration Runtime DAG ProcessingManager Stalls |
| azure_datafactories_AirflowIntegrationRuntimeDAGProcessingProcesses | AirflowIntegrationRuntimeDAGProcessingProcesses | Airflow Integration Runtime DAG Processing Processes | Count | Total | Airflow Integration Runtime DAG Processing Processes |
| azure_datafactories_AirflowIntegrationRuntimeDAGProcessingProcessorTimeouts | AirflowIntegrationRuntimeDAGProcessingProcessorTimeouts | Airflow Integration Runtime DAG Processing Processor Timeouts | Seconds | Average | Airflow Integration Runtime DAG Processing Processor Timeouts |
| azure_datafactories_AirflowIntegrationRuntimeDAGProcessingTotalParseTime | AirflowIntegrationRuntimeDAGProcessingTotalParseTime | Airflow Integration Runtime DAG Processing Total Parse Time | Seconds | Average | Airflow Integration Runtime DAG Processing Total Parse Time |
| azure_datafactories_AirflowIntegrationRuntimeDAGRunDependencyCheck | AirflowIntegrationRuntimeDAGRunDependencyCheck | Airflow Integration Runtime DAG Run Dependency Check | Milliseconds | Average | Airflow Integration Runtime DAG Run Dependency Check |
| azure_datafactories_AirflowIntegrationRuntimeDAGRunDurationFailed | AirflowIntegrationRuntimeDAGRunDurationFailed | Airflow Integration Runtime DAG Run Duration Failed | Milliseconds | Average | Airflow Integration Runtime DAG Run Duration Failed |
| azure_datafactories_AirflowIntegrationRuntimeDAGRunDurationSuccess | AirflowIntegrationRuntimeDAGRunDurationSuccess | Airflow Integration Runtime DAG Run Duration Success | Milliseconds | Average | Airflow Integration Runtime DAG Run Duration Success |
| azure_datafactories_AirflowIntegrationRuntimeDAGRunFirstTaskSchedulingDelay | AirflowIntegrationRuntimeDAGRunFirstTaskSchedulingDelay | Airflow Integration Runtime DAG Run First Task Scheduling Delay | Milliseconds | Average | Airflow Integration Runtime DAG Run First Task Scheduling Delay |
| azure_datafactories_AirflowIntegrationRuntimeDAGRunScheduleDelay | AirflowIntegrationRuntimeDAGRunScheduleDelay | Airflow Integration Runtime DAG Run Schedule Delay | Milliseconds | Average | Airflow Integration Runtime DAG Run Schedule Delay |
| azure_datafactories_AirflowIntegrationRuntimeExecutorOpenSlots | AirflowIntegrationRuntimeExecutorOpenSlots | Airflow Integration Runtime Executor Open Slots | Count | Total | Airflow Integration Runtime Executor Open Slots |
| azure_datafactories_AirflowIntegrationRuntimeExecutorQueuedTasks | AirflowIntegrationRuntimeExecutorQueuedTasks | Airflow Integration Runtime Executor Queued Tasks | Count | Total | Airflow Integration Runtime Executor Queued Tasks |
| azure_datafactories_AirflowIntegrationRuntimeExecutorRunningTasks | AirflowIntegrationRuntimeExecutorRunningTasks | Airflow Integration Runtime Executor Running Tasks | Count | Total | Airflow Integration Runtime Executor Running Tasks |
| azure_datafactories_AirflowIntegrationRuntimeJobEnd | AirflowIntegrationRuntimeJobEnd | Airflow Integration Runtime Job End | Count | Total | Airflow Integration Runtime Job End |
| azure_datafactories_AirflowIntegrationRuntimeJobHeartbeatFailure | AirflowIntegrationRuntimeJobHeartbeatFailure | Airflow Integration Runtime Heartbeat Failure | Count | Total | Airflow Integration Runtime Heartbeat Failure |
| azure_datafactories_AirflowIntegrationRuntimeJobStart | AirflowIntegrationRuntimeJobStart | Airflow Integration Runtime Job Start | Count | Total | Airflow Integration Runtime Job Start |
| azure_datafactories_AirflowIntegrationRuntimeMemoryPercentage | AirflowIntegrationRuntimeMemoryPercentage | Airflow Integration Runtime Memory Percentage | Percent | Average | Airflow Integration Runtime Memory Percentage |
| azure_datafactories_AirflowIntegrationRuntimeMemoryUsage | AirflowIntegrationRuntimeMemoryUsage | Airflow Integration Runtime Memory Usage | Bytes | Average | Airflow Integration Runtime Memory Usage |
| azure_datafactories_AirflowIntegrationRuntimeNodeCount | AirflowIntegrationRuntimeNodeCount | Airflow Integration Runtime Node Count | Count | Average | Airflow Integration Runtime Node Count |
| azure_datafactories_AirflowIntegrationRuntimeOperatorFailures | AirflowIntegrationRuntimeOperatorFailures | Airflow Integration Runtime Operator Failures | Count | Total | Airflow Integration Runtime Operator Failures |
| azure_datafactories_AirflowIntegrationRuntimeOperatorSuccesses | AirflowIntegrationRuntimeOperatorSuccesses | Airflow Integration Runtime Operator Successes | Count | Total | Airflow Integration Runtime Operator Successes |
| azure_datafactories_AirflowIntegrationRuntimePoolOpenSlots | AirflowIntegrationRuntimePoolOpenSlots | Airflow Integration Runtime Pool Open Slots | Count | Total | Airflow Integration Runtime Pool Open Slots |
| azure_datafactories_AirflowIntegrationRuntimePoolQueuedSlots | AirflowIntegrationRuntimePoolQueuedSlots | Airflow Integration Runtime Pool Queued Slots | Count | Total | Airflow Integration Runtime Pool Queued Slots |
| azure_datafactories_AirflowIntegrationRuntimePoolRunningSlots | AirflowIntegrationRuntimePoolRunningSlots | Airflow Integration Runtime Pool Running Slots | Count | Total | Airflow Integration Runtime Pool Running Slots |
| azure_datafactories_AirflowIntegrationRuntimePoolStarvingTasks | AirflowIntegrationRuntimePoolStarvingTasks | Airflow Integration Runtime Pool Starving Tasks | Count | Total | Airflow Integration Runtime Pool Starving Tasks |
| azure_datafactories_AirflowIntegrationRuntimeSchedulerCriticalSectionBusy | AirflowIntegrationRuntimeSchedulerCriticalSectionBusy | Airflow Integration Runtime Scheduler Critical Section Busy | Count | Total | Airflow Integration Runtime Scheduler Critical Section Busy |
| azure_datafactories_AirflowIntegrationRuntimeSchedulerCriticalSectionDuration | AirflowIntegrationRuntimeSchedulerCriticalSectionDuration | Airflow Integration Runtime Scheduler Critical Section Duration | Milliseconds | Average | Airflow Integration Runtime Scheduler Critical Section Duration |
| azure_datafactories_AirflowIntegrationRuntimeSchedulerFailedSLAEmailAttempts | AirflowIntegrationRuntimeSchedulerFailedSLAEmailAttempts | Airflow Integration Runtime Scheduler Failed SLA Email Attempts | Count | Total | Airflow Integration Runtime Scheduler Failed SLA Email Attempts |
| azure_datafactories_AirflowIntegrationRuntimeSchedulerHeartbeat | AirflowIntegrationRuntimeSchedulerHeartbeat | Airflow Integration Runtime Scheduler Heartbeats | Count | Total | Airflow Integration Runtime Scheduler Heartbeats |
| azure_datafactories_AirflowIntegrationRuntimeSchedulerOrphanedTasksAdopted | AirflowIntegrationRuntimeSchedulerOrphanedTasksAdopted | Airflow Integration Runtime Scheduler Orphaned Tasks Adopted | Count | Total | Airflow Integration Runtime Scheduler Orphaned Tasks Adopted |
| azure_datafactories_AirflowIntegrationRuntimeSchedulerOrphanedTasksCleared | AirflowIntegrationRuntimeSchedulerOrphanedTasksCleared | Airflow Integration Runtime Scheduler Orphaned Tasks Cleared | Count | Total | Airflow Integration Runtime Scheduler Orphaned Tasks Cleared |
| azure_datafactories_AirflowIntegrationRuntimeSchedulerTasksExecutable | AirflowIntegrationRuntimeSchedulerTasksExecutable | Airflow Integration Runtime Scheduler Tasks Executable | Count | Total | Airflow Integration Runtime Scheduler Tasks Executable |
| azure_datafactories_AirflowIntegrationRuntimeSchedulerTasksKilledExternally | AirflowIntegrationRuntimeSchedulerTasksKilledExternally | Airflow Integration Runtime Scheduler Tasks Killed Externally | Count | Total | Airflow Integration Runtime Scheduler Tasks Killed Externally |
| azure_datafactories_AirflowIntegrationRuntimeSchedulerTasksRunning | AirflowIntegrationRuntimeSchedulerTasksRunning | Airflow Integration Runtime Scheduler Tasks Running | Count | Total | Airflow Integration Runtime Scheduler Tasks Running |
| azure_datafactories_AirflowIntegrationRuntimeSchedulerTasksStarving | AirflowIntegrationRuntimeSchedulerTasksStarving | Airflow Integration Runtime Scheduler Tasks Starving | Count | Total | Airflow Integration Runtime Scheduler Tasks Starving |
| azure_datafactories_AirflowIntegrationRuntimeStartedTaskInstances | AirflowIntegrationRuntimeStartedTaskInstances | Airflow Integration Runtime Started Task Instances | Count | Total | Airflow Integration Runtime Started Task Instances |
| azure_datafactories_AirflowIntegrationRuntimeTaskInstanceCreatedUsingOperator | AirflowIntegrationRuntimeTaskInstanceCreatedUsingOperator | Airflow Integration Runtime Task Instance Created Using Operator | Count | Total | Airflow Integration Runtime Task Instance Created Using Operator |
| azure_datafactories_AirflowIntegrationRuntimeTaskInstanceDuration | AirflowIntegrationRuntimeTaskInstanceDuration | Airflow Integration Runtime Task Instance Duration | Milliseconds | Average | Airflow Integration Runtime Task Instance Duration |
| azure_datafactories_AirflowIntegrationRuntimeTaskInstanceFailures | AirflowIntegrationRuntimeTaskInstanceFailures | Airflow Integration Runtime Task Instance Failures | Count | Total | Airflow Integration Runtime Task Instance Failures |
| azure_datafactories_AirflowIntegrationRuntimeTaskInstanceFinished | AirflowIntegrationRuntimeTaskInstanceFinished | Airflow Integration Runtime Task Instance Finished | Count | Total | Airflow Integration Runtime Task Instance Finished |
| azure_datafactories_AirflowIntegrationRuntimeTaskInstancePreviouslySucceeded | AirflowIntegrationRuntimeTaskInstancePreviouslySucceeded | Airflow Integration Runtime Task Instance Previously Succeeded | Count | Total | Airflow Integration Runtime Task Instance Previously Succeeded |
| azure_datafactories_AirflowIntegrationRuntimeTaskInstanceSuccesses | AirflowIntegrationRuntimeTaskInstanceSuccesses | Airflow Integration Runtime Task Instance Successes | Count | Total | Airflow Integration Runtime Task Instance Successes |
| azure_datafactories_AirflowIntegrationRuntimeTaskRemovedFromDAG | AirflowIntegrationRuntimeTaskRemovedFromDAG | Airflow Integration Runtime Task Removed From DAG | Count | Total | Airflow Integration Runtime Task Removed From DAG |
| azure_datafactories_AirflowIntegrationRuntimeTaskRestoredToDAG | AirflowIntegrationRuntimeTaskRestoredToDAG | Airflow Integration Runtime Task Restored To DAG | Count | Total | Airflow Integration Runtime Task Restored To DAG |
| azure_datafactories_AirflowIntegrationRuntimeTriggersBlockedMainThread | AirflowIntegrationRuntimeTriggersBlockedMainThread | Airflow Integration Runtime Triggers Blocked Main Thread | Count | Total | Airflow Integration Runtime Triggers Blocked Main Thread |
| azure_datafactories_AirflowIntegrationRuntimeTriggersFailed | AirflowIntegrationRuntimeTriggersFailed | Airflow Integration Runtime Triggers Failed | Count | Total | Airflow Integration Runtime Triggers Failed |
| azure_datafactories_AirflowIntegrationRuntimeTriggersRunning | AirflowIntegrationRuntimeTriggersRunning | Airflow Integration Runtime Triggers Running | Count | Total | Airflow Integration Runtime Triggers Running |
| azure_datafactories_AirflowIntegrationRuntimeTriggersSucceeded | AirflowIntegrationRuntimeTriggersSucceeded | Airflow Integration Runtime Triggers Succeeded | Count | Total | Airflow Integration Runtime Triggers Succeeded |
| azure_datafactories_AirflowIntegrationRuntimeZombiesKilled | AirflowIntegrationRuntimeZombiesKilled | Airflow Integration Runtime Zombie Tasks Killed | Count | Total | Airflow Integration Runtime Zombie Tasks Killed |
| azure_datafactories_FactorySizeInGbUnits | FactorySizeInGbUnits | Total factory size (GB unit) | Count | Maximum | Total factory size (GB unit) |
| azure_datafactories_IntegrationRuntimeAvailableMemory | IntegrationRuntimeAvailableMemory | Integration runtime available memory | Bytes | Average | Integration runtime available memory |
| azure_datafactories_IntegrationRuntimeAvailableNodeNumber | IntegrationRuntimeAvailableNodeNumber | Integration runtime available node count | Count | Average | Integration runtime available node count |
| azure_datafactories_IntegrationRuntimeAverageTaskPickupDelay | IntegrationRuntimeAverageTaskPickupDelay | Integration runtime queue duration | Seconds | Average | Integration runtime queue duration |
| azure_datafactories_IntegrationRuntimeCpuPercentage | IntegrationRuntimeCpuPercentage | Integration runtime CPU utilization | Percent | Average | Integration runtime CPU utilization |
| azure_datafactories_IntegrationRuntimeQueueLength | IntegrationRuntimeQueueLength | Integration runtime queue length | Count | Average | Integration runtime queue length |
| azure_datafactories_MaxAllowedFactorySizeInGbUnits | MaxAllowedFactorySizeInGbUnits | Maximum allowed factory size (GB unit) | Count | Maximum | Maximum allowed factory size (GB unit) |
| azure_datafactories_MaxAllowedResourceCount | MaxAllowedResourceCount | Maximum allowed entities count | Count | Maximum | Maximum allowed entities count |
| azure_datafactories_MVNetIRCopyAvailableCapacityPCT | MVNetIRCopyAvailableCapacityPCT | Copy available capacity percentage of MVNet integration runtime | Percent | Maximum | Copy available capacity percentage of MVNet integration runtime |
| azure_datafactories_MVNetIRCopyCapacityUtilization | MVNetIRCopyCapacityUtilization | Copy capacity utilization of MVNet integration runtime | Percent | Maximum | Copy capacity utilization of MVNet integration runtime |
| azure_datafactories_MVNetIRCopyWaitingQueueLength | MVNetIRCopyWaitingQueueLength | Copy waiting queue length of MVNet integration runtime | Count | Average | Copy waiting queue length of MVNet integration runtime |
| azure_datafactories_MVNetIRExternalAvailableCapacityPCT | MVNetIRExternalAvailableCapacityPCT | External available capacity percentage of MVNet integration runtime | Percent | Maximum | External available capacity percentage of MVNet integration runtime |
| azure_datafactories_MVNetIRExternalCapacityUtilization | MVNetIRExternalCapacityUtilization | External capacity utilization of MVNet integration runtime | Percent | Maximum | External capacity utilization of MVNet integration runtime |
| azure_datafactories_MVNetIRExternalWaitingQueueLength | MVNetIRExternalWaitingQueueLength | External waiting queue length of MVNet integration runtime | Count | Average | External waiting queue length of MVNet integration runtime |
| azure_datafactories_MVNetIRPipelineAvailableCapacityPCT | MVNetIRPipelineAvailableCapacityPCT | Pipeline available capacity percentage of MVNet integration runtime | Percent | Maximum | Pipeline available capacity percentage of MVNet integration runtime |
| azure_datafactories_MVNetIRPipelineCapacityUtilization | MVNetIRPipelineCapacityUtilization | Pipeline capacity utilization of MVNet integration runtime | Percent | Maximum | Pipeline capacity utilization of MVNet integration runtime |
| azure_datafactories_MVNetIRPipelineWaitingQueueLength | MVNetIRPipelineWaitingQueueLength | Pipeline waiting queue length of MVNet integration runtime | Count | Average | Pipeline waiting queue length of MVNet integration runtime |
| azure_datafactories_PipelineCancelledRuns | PipelineCancelledRuns | Cancelled pipeline runs metrics | Count | Total | Cancelled pipeline runs metrics |
| azure_datafactories_PipelineElapsedTimeRuns | PipelineElapsedTimeRuns | Elapsed Time Pipeline Runs Metrics | Count | Total | Elapsed Time Pipeline Runs Metrics |
| azure_datafactories_PipelineFailedRuns | PipelineFailedRuns | Failed pipeline runs metrics | Count | Total | Failed pipeline runs metrics |
| azure_datafactories_PipelineSucceededRuns | PipelineSucceededRuns | Succeeded pipeline runs metrics | Count | Total | Succeeded pipeline runs metrics |
| azure_datafactories_ResourceCount | ResourceCount | Total entities count | Count | Maximum | Total entities count |
| azure_datafactories_SSISIntegrationRuntimeStartCancel | SSISIntegrationRuntimeStartCancel | Cancelled SSIS integration runtime start metrics | Count | Total | Cancelled SSIS integration runtime start metrics |
| azure_datafactories_SSISIntegrationRuntimeStartFailed | SSISIntegrationRuntimeStartFailed | Failed SSIS integration runtime start metrics | Count | Total | Failed SSIS integration runtime start metrics |
| azure_datafactories_SSISIntegrationRuntimeStartSucceeded | SSISIntegrationRuntimeStartSucceeded | Succeeded SSIS integration runtime start metrics | Count | Total | Succeeded SSIS integration runtime start metrics |
| azure_datafactories_SSISIntegrationRuntimeStopStuck | SSISIntegrationRuntimeStopStuck | Stuck SSIS integration runtime stop metrics | Count | Total | Stuck SSIS integration runtime stop metrics |
| azure_datafactories_SSISIntegrationRuntimeStopSucceeded | SSISIntegrationRuntimeStopSucceeded | Succeeded SSIS integration runtime stop metrics | Count | Total | Succeeded SSIS integration runtime stop metrics |
| azure_datafactories_SSISPackageExecutionCancel | SSISPackageExecutionCancel | Cancelled SSIS package execution metrics | Count | Total | Cancelled SSIS package execution metrics |
| azure_datafactories_SSISPackageExecutionFailed | SSISPackageExecutionFailed | Failed SSIS package execution metrics | Count | Total | Failed SSIS package execution metrics |
| azure_datafactories_SSISPackageExecutionSucceeded | SSISPackageExecutionSucceeded | Succeeded SSIS package execution metrics | Count | Total | Succeeded SSIS package execution metrics |
| azure_datafactories_TriggerCancelledRuns | TriggerCancelledRuns | Cancelled trigger runs metrics | Count | Total | Cancelled trigger runs metrics |
| azure_datafactories_TriggerFailedRuns | TriggerFailedRuns | Failed trigger runs metrics | Count | Total | Failed trigger runs metrics |
| azure_datafactories_TriggerSucceededRuns | TriggerSucceededRuns | Succeeded trigger runs metrics | Count | Total | Succeeded trigger runs metrics |