Automated Technique to Get Newest Pipeline Execution Particulars of an Azure Information Manufacturing unit

Harsh Bakshi
3 min readDec 19, 2023

--

Downside Assertion

As of Dec 18,2023; One can get the record of all execution particulars of a selected pipeline of an Azure Information Manufacturing unit by way of the Powershell Module: Get-AzDataFactoryV2PipelineRun. However this Module gives all execution particulars of the pipeline or the execution element of the particular pipeline runid.

Equally, the Monitor part gives all execution particulars, and we have now to manually scan for the most recent execution per pipeline.

Get Latest Pipeline Execution Details of an Azure Data Factory

So, is there an automatic strategy to Get the Newest Pipeline Execution Particulars of an Azure Information Manufacturing unit.

Resolution

1. Open Powershell in admin mode and import the Azure SDK modules by executing the under instructions :

Import-Module Az.Accounts
Import-Module Az.DataFactory

2. Set up the customized module by executing the under command

Set up-Module -Identify AzDataFactoryV2PipelinesLastExecution

3. Now, the atmosphere is ready for us to execute the instructions to fetch the pipeline particulars .

To get the record of all Pipelines in an ADF and its corresponding final execution particulars, execute the under command:

Get-AzDataFactoryV2PipelinesLastExecution -ResourceGroupName “<>” -DataFactoryName “<>”

To get the main points of a selected Pipeline in an ADF and its corresponding final execution, execute the under command:

Get-AzDataFactoryV2PipelinesLastExecution -ResourceGroupName “<>” -DataFactoryName “<>” -PipelineName “<>”

To get the record of all Pipelines in an ADF and its corresponding final execution particulars in a selected time vary, execute the under command:

Get-AzDataFactoryV2PipelinesLastExecution -ResourceGroupName “<>” -DataFactoryName “<>” -StartRange "<>" -EndRange "<>"

Output Outcomes

1. General ADF output

Get-AzDataFactoryV2PipelinesLastExecution -ResourceGroupName “<<RGName>>” -DataFactoryName “>”

2. Particular Pipeline output

Get-AzDataFactoryV2PipelinesLastExecution -ResourceGroupName “<<RGName>>” -DataFactoryName “>” -PipelineName “>”

3. Particular Vary output

Get-AzDataFactoryV2PipelinesLastExecution -ResourceGroupName “<<RGName>>” -DataFactoryName “>” -StartRange

: In case no values are offered to StartRange and EndRange; then default values could be assigned as 1900–01–01 and newest datetime accordingly.

This could keep away from manually figuring out the most recent execution particulars of a pipeline in Azure Information Manufacturing unit.

Know extra about our firm at Skrots. Know extra about our companies at Skrots Companies, Additionally checkout all different blogs at Weblog at Skrots


Know more about our company at Skrots. Know more about our services at Skrots Services, Also checkout all other blogs at Blog at Skrots

Thanks, Harsh
Founder | CEO — Skrots

Learn more about our blog at Blog at Skrots. Checkout our list of services on Skrots. Give a look at our website design at Skrots . Checkout our LinkedIn Page at LinkedIn.com. Check out our original post at https://blog.skrots.com/automated-way-to-get-latest-pipeline-execution-details-of-an-azure-data-factory/?feed_id=1707&_unique_id=6581d100889bf

--

--

No responses yet