Developing with Spark for Microsoft Fabric with Copilot - Ginger Grant & Warwick Rudd

Description

Developing solutions in Microsoft Fabric can include Apache Spark and in this environment that includes Copilot generated code to document, comment, debug and create error handling. We will show you how to incorporate Copilot to perform these task either within Fabric or in a tool you may be more comfortable using VS Code.

We will also talk about the unique methods that Fabric includes for improving developer productivity by utilizing drag and drop methods for creating common code patterns. We will also demonstrate how to use Data Wrangler to analyze and clean your code and add the spark dataframe modifications to your code.

We will review how to use this code in a data pipeline and monitor results. If you want to improve your Spark productivity in Fabric, you won’t want to miss this session.