Azure Synapse is an integrated analytics service that accelerates time to insight across data warehouses and big data systems. Azure Synapse brings together the best of SQL technologies used in enterprise data warehousing, Spark technologies used for big data, Pipelines for data integration and ETL/ELT, and deep integration with other Azure services such as Power BI, CosmosDB, and AzureML.
External reference
Setup
To set up the Azure integration and discover the Azure service, go to Azure Integration Discovery Profile and select Synapse Workspace.
Event support
- Supported
- Configure Azure Events in OpsRamp Azure Integration Discovery Profile.
Supported metrics
Workspace metrics
| OpsRamp Metric | Azure Metric | Metric Display Name | Unit | Aggregation Type | Description |
|---|---|---|---|---|---|
| azure_synapse_workspaces_BuiltinSqlPoolDataProcessedBytes | BuiltinSqlPoolDataProcessedBytes | Data processed (bytes) | Bytes | Total | Amount of data processed by queries |
| azure_synapse_workspaces_BuiltinSqlPoolLoginAttempts | BuiltinSqlPoolLoginAttempts | Login attempts | Count | Average | Count of login attempts that succeded or failed |
| azure_synapse_workspaces_BuiltinSqlPoolRequestsEnded | BuiltinSqlPoolRequestsEnded | Requests ended | Count | Average | Count of Requests that succeeded, failed, or were cancelled |
| azure_synapse_workspaces_IntegrationActivityRunsEnded | IntegrationActivityRunsEnded | Activity runs ended | Count | Count | Count of integration activities that succeeded, failed, or were cancelled |
| azure_synapse_workspaces_IntegrationLinkConnectionEvents | IntegrationLinkConnectionEvents | Link connection events | Count | Total | Number of Synapse Link connection events including start, stop and failure |
| azure_synapse_workspaces_IntegrationLinkProcessedChangedRows | IntegrationLinkProcessedChangedRows | Link processed rows | Count | Total | Changed row count processed by Synapse Link |
| azure_synapse_workspaces_IntegrationLinkProcessedDataVolume | IntegrationLinkProcessedDataVolume | Link processed data volume (bytes) | Bytes | Total | Data volume in bytes processed by Synapse Link |
| azure_synapse_workspaces_IntegrationLinkProcessingLatencyInSeconds | IntegrationLinkProcessingLatencyInSeconds | Link latency in seconds | Count | Maximum | Synapse Link data processing latency in seconds |
| azure_synapse_workspaces_IntegrationLinkTableEvents | IntegrationLinkTableEvents | Link table events | Count | Total | Number of Synapse Link table events including snapshot, removal and failure |
| azure_synapse_workspaces_IntegrationPipelineRunsEnded | IntegrationPipelineRunsEnded | Pipeline runs ended | Count | Count | Count of integration pipeline runs that succeeded, failed, or were cancelled |
| azure_synapse_workspaces_IntegrationTriggerRunsEnded | IntegrationTriggerRunsEnded | Trigger Runs ended | Count | Count | Count of integration triggers that succeeded, failed, or were cancelled |
| azure_synapse_workspaces_SQLStreamingBackloggedInputEventSources | SQLStreamingBackloggedInputEventSources | Backlogged input events | Count | Total | This is a preview metric available in East US, West Europe. Number of input events sources backlogged |
| azure_synapse_workspaces_SQLStreamingConversionErrors | SQLStreamingConversionErrors | Data conversion errors | Count | Total | This is a preview metric available in East US, West Europe. Number of output events that could not be converted to the expected output schema. Error policy can be changed to 'Drop' to drop events that encounter this scenario |
| azure_synapse_workspaces_SQLStreamingDeserializationError | SQLStreamingDeserializationError | Input deserialization errors | Count | Total | This is a preview metric available in East US, West Europe. Number of input events that could not be deserialized |
| azure_synapse_workspaces_SQLStreamingEarlyInputEvents | SQLStreamingEarlyInputEvents | Early input events | Count | Total | This is a preview metric available in East US, West Europe. Number of input events which application time is considered early compared to arrival time, according to early arrival policy |
| azure_synapse_workspaces_SQLStreamingInputEventBytes | SQLStreamingInputEventBytes | Input event bytes | Count | Total | This is a preview metric available in East US, West Europe. Amount of data received by the streaming job, in bytes. This can be used to validate that events are being sent to the input source |
| azure_synapse_workspaces_SQLStreamingInputEvents | SQLStreamingInputEvents | Input events | Count | Total | This is a preview metric available in East US, West Europe. Number of input events |
| azure_synapse_workspaces_SQLStreamingInputEventsSourcesPerSecond | SQLStreamingInputEventsSourcesPerSecond | Input sources received | Count | Total | This is a preview metric available in East US, West Europe. Number of input events sources per second |
| azure_synapse_workspaces_SQLStreamingLateInputEvents | SQLStreamingLateInputEvents | Late input events | Count | Total | This is a preview metric available in East US, West Europe. Number of input events which application time is considered late compared to arrival time, according to late arrival policy |
| azure_synapse_workspaces_SQLStreamingOutOfOrderEvents | SQLStreamingOutOfOrderEvents | Out of order events | Count | Total | This is a preview metric available in East US, West Europe. Number of Event Hub Events (serialized messages) received by the Event Hub Input Adapter, received out of order that were either dropped or given an adjusted timestamp, based on the Event Ordering Policy |
| azure_synapse_workspaces_SQLStreamingOutputEvents | SQLStreamingOutputEvents | Output events | Count | Total | This is a preview metric available in East US, West Europe. Number of output events |
| azure_synapse_workspaces_SQLStreamingOutputWatermarkDelaySeconds | SQLStreamingOutputWatermarkDelaySeconds | Watermark delay | Count | Maximum | This is a preview metric available in East US, West Europe. Output watermark delay in seconds |
| azure_synapse_workspaces_SQLStreamingResourceUtilization | SQLStreamingResourceUtilization | Resource % utilization | Percent | Maximum | This is a preview metric available in East US, West Europe |
| azure_synapse_workspaces_SQLStreamingRuntimeErrors | SQLStreamingRuntimeErrors | Runtime errors | Count | Total | This is a preview metric available in East US, West Europe. Total number of errors related to query processing (excluding errors found while ingesting events or outputting results) |
SQL pool metrics
| OpsRamp Metric | Azure Metric | Metric Display Name | Unit | Aggregation Type | Description |
|---|---|---|---|---|---|
| azure_synapse_workspaces_sqlpools_ActiveQueries | ActiveQueries | Active queries | Count | Total | The active queries. Using this metric unfiltered and unsplit displays all active queries running on the system |
| azure_synapse_workspaces_sqlpools_AdaptiveCacheHitPercent | AdaptiveCacheHitPercent | Adaptive cache hit percentage | Percent | Maximum | Measures how well workloads are utilizing the adaptive cache. Use this metric with the cache hit percentage metric to determine whether to scale for additional capacity or rerun workloads to hydrate the cache |
| azure_synapse_workspaces_sqlpools_AdaptiveCacheUsedPercent | AdaptiveCacheUsedPercent | Adaptive cache used percentage | Percent | Maximum | Measures how well workloads are utilizing the adaptive cache. Use this metric with the cache used percentage metric to determine whether to scale for additional capacity or rerun workloads to hydrate the cache |
| azure_synapse_workspaces_sqlpools_Connections | Connections | Connections | Count | Total | Count of Total logins to the SQL pool |
| azure_synapse_workspaces_sqlpools_ConnectionsBlockedByFirewall | ConnectionsBlockedByFirewall | Connections blocked by firewall | Count | Total | Count of connections blocked by firewall rules. Revisit access control policies for your SQL pool and monitor these connections if the count is high |
| azure_synapse_workspaces_sqlpools_CPUPercent | CPUPercent | CPU used percentage | Percent | Maximum | CPU utilization across all nodes in the SQL pool |
| azure_synapse_workspaces_sqlpools_DWULimit | DWULimit | DWU limit | Count | Maximum | Service level objective of the SQL pool |
| azure_synapse_workspaces_sqlpools_DWUUsed | DWUUsed | DWU used | Count | Maximum | Represents a high-level representation of usage across the SQL pool. Measured by DWU limit * DWU percentage |
| azure_synapse_workspaces_sqlpools_DWUUsedPercent | DWUUsedPercent | DWU used percentage | Percent | Maximum | Represents a high-level representation of usage across the SQL pool. Measured by taking the maximum between CPU percentage and Data IO percentage |
| azure_synapse_workspaces_sqlpools_LocalTempDBUsedPercent | LocalTempDBUsedPercent | Local tempdb used percentage | Percent | Maximum | Local tempdb utilization across all compute nodes - values are emitted every five minute |
| azure_synapse_workspaces_sqlpools_MemoryUsedPercent | MemoryUsedPercent | Memory used percentage | Percent | Maximum | Memory utilization across all nodes in the SQL pool |
| azure_synapse_workspaces_sqlpools_QueuedQueries | QueuedQueries | Queued queries | Count | Total | Cumulative count of requests queued after the max concurrency limit was reached |
| azure_synapse_workspaces_sqlpools_WLGActiveQueries | WLGActiveQueries | Workload group active queries | Count | Total | The active queries within the workload group. Using this metric unfiltered and unsplit displays all active queries running on the system |
| azure_synapse_workspaces_sqlpools_WLGActiveQueriesTimeouts | WLGActiveQueriesTimeouts | Workload group query timeouts | Count | Total | Queries for the workload group that have timed out. Query timeouts reported by this metric are only once the query has started executing (it does not include wait time due to locking or resource waits) |
| azure_synapse_workspaces_sqlpools_WLGAllocationByEffectiveCapResourcePercent | WLGAllocationByEffectiveCapResourcePercent | Workload group allocation by max resource percent | Percent | Maximum | Displays the percentage allocation of resources relative to the Effective cap resource percent per workload group. This metric provides the effective utilization of the workload group |
| azure_synapse_workspaces_sqlpools_WLGAllocationBySystemPercent | WLGAllocationBySystemPercent | Workload group allocation by system percent | Percent | Maximum | The percentage allocation of resources relative to the entire system |
| azure_synapse_workspaces_sqlpools_WLGEffectiveCapResourcePercent | WLGEffectiveCapResourcePercent | Effective cap resource percent | Percent | Maximum | The effective cap resource percent for the workload group. If there are other workload groups with min_percentage_resource > 0, the effective_cap_percentage_resource is lowered proportionally |
| azure_synapse_workspaces_sqlpools_WLGEffectiveMinResourcePercent | WLGEffectiveMinResourcePercent | Effective min resource percent | Percent | Minimum | The effective min resource percentage setting allowed considering the service level and the workload group settings. The effective min_percentage_resource can be adjusted higher on lower service levels |
| azure_synapse_workspaces_sqlpools_WLGQueuedQueries | WLGQueuedQueries | Workload group queued queries | Count | Total | Cumulative count of requests queued after the max concurrency limit was reached |
Spark pool metrics
| OpsRamp Metric | Azure Metric | Metric Display Name | Unit | Aggregation Type | Description |
|---|---|---|---|---|---|
| azure_synapse_workspaces_bigdatapools_BigDataPoolAllocatedCores | BigDataPoolAllocatedCores | vCores allocated | Count | Maximum | Allocated vCores for an Apache Spark Pool |
| azure_synapse_workspaces_bigdatapools_BigDataPoolAllocatedMemory | BigDataPoolAllocatedMemory | Memory allocated (GB) | Count | Maximum | Allocated Memory for Apach Spark Pool (GB) |
| azure_synapse_workspaces_bigdatapools_BigDataPoolApplicationsActive | BigDataPoolApplicationsActive | Active Apache Spark applications | Count | Maximum | Total Active Apache Spark Pool Applications |
| azure_synapse_workspaces_bigdatapools_BigDataPoolApplicationsEnded | BigDataPoolApplicationsEnded | Ended Apache Spark applications | Count | Total | Count of Apache Spark pool applications ended |