talk-data.com talk-data.com

Event

Andy Leonard - Designing an Execution Framework for Azure Data Factory

2024-01-11 – 2024-01-12 Meetup Visit website ↗

Activities tracked

0

Attend “Designing an Execution Framework for Azure Data Factory” and takeaway:

1. Comparison and contrast of Azure Data Factory debug and triggered execution. 2. Benefits and limitations of the Execute Pipeline activity. 3. Benefits and complexity of using the Azure Data Factory REST API for execution. Experience or familiarity with developing, scheduling, and monitoring Azure Data Factory pipeline executions is suggested.

If your enterprise manages dozens of ADF pipelines, an execution framework is unnecessary overhead. If your enterprise manages thousands of ADF pipelines? You need an execution framework. But how should you implement it? Should you take a straightforward approach and use the Execute Pipeline activity or implement a metadata-driven approach using the Azure Data Factory REST API?

Prerequisites: Experience or familiarity with developing, scheduling, and monitoring Azure Data Factory pipeline executions is suggested.

Goals: 1. Comparison and contrast of Azure Data Factory debug and triggered execution. 2. Benefits and limitations of the Execute Pipeline activity. 3. Benefits and complexity of using the Azure Data Factory REST API for execution.

Sessions & talks

Showing 1–0 of 0 · Newest first

Search within this event →

No individual activities are attached to this event yet.