talk-data.com

Join Andy Leonard as he demonstrates a real-world example of authoring a Fabric Data Factory pipeline to read data from an Azure Blob source and write it to an on-premises data store.

A Day of Fabric Data Factory with Andy Leonard, Pittsburgh SQL Saturday Pre-Con, Friday October 11 Cost: $125

Location: Commonwealth Charter Academy The Waterfront 149 W. Bridge Street Homestead, PA 15120

Do you want to learn more about cloud data integration using Fabric Data Factory? Is your enterprise planning to migrate its data, databases, data warehouses (or some of them) to the cloud? Do you currently use SSIS or ADF? If you answered yes, A Day of Fabric Data Factory is for you! In this session, we discuss data engineering using Microsoft Fabric Data Factory, compare Azure Data Factory with Fabric Data Factory, and demonstrate how to use Fabric Data Factory for data engineering in the modern data enterprise.Topics include: – Making the move from Azure Data Factory to Fabric Data Factory – Copying data – Using newer activities (Outlook, Teams, etc. – Managing workflow (looping, iteration, conditionals) – Using Parameters– Metadata and design patterns – Version control integration – Monitoring – Debugging and troubleshooting – Design patterns – Interacting with on-premises data

Andy Leonard is a husband, dad, and grandfather; founder and Chief Data Engineer at both Enterprise Data & Analytics and Enterprise Data & AI; creator of – and Data Philosopher at – DILM (Data Integration Lifecycle Management) Suite; a Microsoft Fabric Data Factory, Azure Data Factory, and SSIS blogger, trainer, consultant, and developer; a SQL Server database and data warehouse developer; an author, mentor, engineer, and farmer.

To attend this full day precon, you must register here: https://www.eventbrite.com/e/a-day-of-fabric-data-factory-with-andy-leonard-tickets-950221547227

This event is a precon the day before Pittsburgh SQL Saturday. Make sure you register to attend SQL Saturday as well here: https://www.eventbrite.com/e/pittsburgh-sql-saturday-tickets-945110901147

Note: Registration is required and closes on May 13th.

In this session, we discuss data engineering using Microsoft Fabric Data Factory, compare Azure Data Factory with Fabric Data Factory, and demonstrate how to use Data Factory for data engineering in the modern data enterprise.

Topics include: - Copying data - Using newer activities (Outlook\, Teams\, etc.) - Managing workflow (looping\, iteration\, conditionals) - Using Parameters - Metadata and design patterns - Version control integration - Monitoring - Debugging and troubleshooting - Design patterns - Interacting with on-premises data - Execution frameworks

Attend “Designing an Execution Framework for Azure Data Factory” and takeaway:

1. Comparison and contrast of Azure Data Factory debug and triggered execution. 2. Benefits and limitations of the Execute Pipeline activity. 3. Benefits and complexity of using the Azure Data Factory REST API for execution. Experience or familiarity with developing, scheduling, and monitoring Azure Data Factory pipeline executions is suggested.

If your enterprise manages dozens of ADF pipelines, an execution framework is unnecessary overhead. If your enterprise manages thousands of ADF pipelines? You need an execution framework. But how should you implement it? Should you take a straightforward approach and use the Execute Pipeline activity or implement a metadata-driven approach using the Azure Data Factory REST API?

Prerequisites: Experience or familiarity with developing, scheduling, and monitoring Azure Data Factory pipeline executions is suggested.

Goals: 1. Comparison and contrast of Azure Data Factory debug and triggered execution. 2. Benefits and limitations of the Execute Pipeline activity. 3. Benefits and complexity of using the Azure Data Factory REST API for execution.

Enjoy reading interviews with more than two dozen data professionals to see a picture of what it’s like to work in the industry managing and analyzing data, helping you to know what it takes to move from your current expertise into one of the fastest growing areas of technology today. Data is the hottest word of the century, and data professionals are in high demand. You may already be a data professional such as a database administrator or business intelligence analyst. Or you may be one of the many people who want to work as a data professional, and are curious how to get there. Either way, this collection helps you understand how data professionals work, what makes them successful, and what they do to keep up. You’ll find interviews in this book with database administrators, database programmers, data architects, business intelligence professionals, and analytics professionals. Interviewees work across industry sectors ranging from healthcare and banking tofinance and transportation and beyond. Each chapter illuminates a successful professional at the top of their game, who shares what helped them get to the top, and what skills and attitudes combine to make them successful in their respective fields. Interviewees in the book include: Mindy Curnutt, Julie Smith, Kenneth Fisher, Andy Leonard, Jes Borland, Kevin Feasel, Ginger Grant, Vicky Harp, Kendra Little, Jason Brimhall, Tim Costello, Andy Mallon, Steph Locke, Jonathan Stewart, Joseph Sack, John Q. Martin, John Morehouse, Kathi Kellenberger, Argenis Fernandez, Kirsten Benzel, Tracy Boggiano, Dave Walden, Matt Gordon, Jimmy May, Drew Furgiuele, Marlon Ribunal, and Joseph Fleming. All of them have been successful in their careers, and share their perspectives on working and succeeding in the field as data and database professionals. What You'll Learn Stand out as an outstanding professional in your area of data work by developing the right set of skills and attitudes that lead to success Avoid common mistakes and pitfalls, and recover from operational failures and bad technology decisions Understand current trends and best practices, and stay out in front as the field evolves Break into working with data through database administration, business intelligence, or any of the other career paths represented in this book Manage stress and develop a healthy work-life balance no matter which career path you decide upon Choose a suitable path for yourself from among the different career paths in working with data Who This Book Is For Database administrators and developers, database and business intelligence architects, consultants, and analytic professionals, as well as those intent on moving into one of those career paths. Aspiring data professionals and those in related technical fields who want to make a move toward managing or analyzing data on a full-time basis will find the book useful. Existing data professionals who want to be outstanding and successful at what they do will also appreciate the book's advice and guidance.