Automated Method to Get Newest Pipeline Execution Particulars of Synapse

Harsh Bakshi
3 min readDec 21, 2023

--

Drawback Assertion

As of Dec 18, 2023, One can get the record of all execution particulars of a particular pipeline of an Azure Information Manufacturing unit by way of the Powershell Module: Get-AzSynapsePipelineRun. However this module gives all execution particulars of the pipeline or the execution particulars of the particular pipeline runid.

Equally, the Monitor part gives all execution particulars, and we’ve got to scan for the most recent execution per pipeline manually.

Execution details

So, is there an automatic technique to Get the Newest Pipeline Execution Particulars of Synapse?

Resolution

1. Open Powershell in admin mode and import the Azure SDK modules by executing the under instructions.

Import-Module Az.Accounts
Import-Module Az.Synapse

2. Set up the customized module by executing the under command.

Set up-Module -Identify AzSynapsePipelineLastExecution

3. Now, the atmosphere is about for us to execute the instructions to fetch the pipeline particulars.

To get the record of all pipelines in Synapse and their corresponding final execution particulars, execute the command under.

Get-AzSynapsePipelineLastExecution -WorkspaceName “<>”

To get the main points of a particular pipeline in Synapse and its corresponding final execution, execute the under command.

Get-AzSynapsePipelineLastExecution -WorkspaceName “<>” -PipelineName “<>”

To get the record of all pipelines in Synapse and their corresponding final execution particulars in a particular time vary, execute the under command.

Get-AzSynapsePipelineLastExecution -WorkspaceName “<>” -StartRange "<>" -EndRange "<>"

Output Outcomes

1. Total Synapse output

Synapse output

2. Particular Pipeline output

Pipeline output

3. Particular Vary output

Specific Range output

Word. In case no values are offered to StartRange and EndRange, then default values could be assigned as 1900–01–01 and the most recent datetime accordingly.

This is able to keep away from manually figuring out the most recent execution particulars of a pipeline in Synapse.

Know extra about our firm at Skrots. Know extra about our companies at Skrots Companies, Additionally checkout all different blogs at Weblog at Skrots


Know more about our company at Skrots. Know more about our services at Skrots Services, Also checkout all other blogs at Blog at Skrots

Thanks, Harsh
Founder | CEO — Skrots

Learn more about our blog at Blog at Skrots. Checkout our list of services on Skrots. Give a look at our website design at Skrots . Checkout our LinkedIn Page at LinkedIn.com. Check out our original post at https://blog.skrots.com/automated-way-to-get-latest-pipeline-execution-details-of-synapse/?feed_id=1764&_unique_id=658488dcbd6cd

--

--

No responses yet