talk-data.com

This is an In-Person Evening Session

Detailed information and registration can be found here : https://dataminds.be/fabric-cicd-intro-to-fabric-data-pipelines-in-person-ae/

Fabric CI/CD

Speaker: Oliver De Vijt

In Microsoft Fabric, deploying all items efficiently across environments requires a robust CI/CD strategy. While Fabric’s built-in deployment pipelines offer a no-code approach for basic promotion between workspaces, they lack flexibility, automation capabilities, and testing.

In this session, we’ll dive deep into Fabric CI/CD practices, leveraging Git integration, the Fabric REST APIs, and the fabric-cicd Python library to automate the deployment of Fabric items such as semantic models, notebooks, dataflows, and reports. You’ll see how to design YAML-based Azure DevOps pipelines that deploy from source control into your Fabric development, test, and production workspaces, and even include steps to run and validate your models using Tabular Editor.

By the end of this session, you’ll understand how to implement your own end-to-end CI/CD framework for Microsoft Fabric, even in Power BI Pro environments, using entirely free and open-source tools.

Intro to Fabric (Data) Pipelines

Speakers: Koen Verbeeck

Fabric Pipelines, formerly known as Fabric Data Pipelines, is the low-code ELT (extract-load-transform) solution in Microsoft Fabric.

With this tool, you can orchestrate various activities, such as reading data from various data sources, executing Spark notebooks, running SQL statements on your warehouse and so on.

In the wider Azure Data Platform, Fabric Pipelines are a close sibling of Azure Data Factory and Synapse Pipelines.

In this session, we’ll cover the following topics:

• Intro to the various concepts of Fabric Pipelines (activities, connections, parameters, variables etc)
• What are the differences with ADF and Synapse Pipelines?
• Tips & tricks

After the session, you’ll be able to start your own data engineering journey with Fabric Pipelines in Microsoft Fabric. Knowledge of general ETL concepts are a plus when attending this presentation.

Event Description:

Unlock the full potential of Continuous Integration and Continuous Deployment (CI/CD) in your data projects with our upcoming meetup on Microsoft Fabric! We’ll guide you through the lifecycle management tutorial, focusing on integrating Git with Azure DevOps, creating deployment pipelines, and managing workspace content effectively.

Key Topics:

• Workspace Setup: Learn to create and manage workspaces with the right permissions. • Git Integration: Master Git version control within your Fabric workspace. • Deployment Pipelines: Develop, test, and deploy content seamlessly across stages.

Hands-On Demonstration: Follow along with a practical demonstration to solidify your understanding.

This meetup is ideal for data professionals looking to enhance their workflow efficiency and collaboration. Don’t miss this chance to elevate your skills and network with peers.

Event Description:

Unlock the full potential of Continuous Integration and Continuous Deployment (CI/CD) in your data projects with our upcoming meetup on Microsoft Fabric! We’ll guide you through the lifecycle management tutorial, focusing on integrating Git with Azure DevOps, creating deployment pipelines, and managing workspace content effectively.

Key Topics:

• Workspace Setup: Learn to create and manage workspaces with the right permissions. • Git Integration: Master Git version control within your Fabric workspace. • Deployment Pipelines: Develop, test, and deploy content seamlessly across stages.

Hands-On Demonstration: Follow along with a practical demonstration to solidify your understanding.

This meetup is ideal for data professionals looking to enhance their workflow efficiency and collaboration. Don’t miss this chance to elevate your skills and network with peers.

Streamlining CI/CD for Data Projects with Microsoft Fabric

Event Description:

Unlock the full potential of Continuous Integration and Continuous Deployment (CI/CD) in your data projects with our upcoming meetup on Microsoft Fabric! We'll guide you through the lifecycle management tutorial, focusing on integrating Git with Azure DevOps, creating deployment pipelines, and managing workspace content effectively.

Key Topics:

Workspace Setup: Learn to create and manage workspaces with the right permissions. Git Integration: Master Git version control within your Fabric workspace. Deployment Pipelines: Develop, test, and deploy content seamlessly across stages. Hands-On Demonstration: Follow along with a practical demonstration to solidify your understanding.

This meetup is ideal for data professionals looking to enhance their workflow efficiency and collaboration. Don't miss this chance to elevate your skills and network with peers.

https://learn.microsoft.com/en-us/fabric/cicd/cicd-tutorial?tabs=azure-devops

During this session we’ll present different devops strategies for Fabric. There is more than one way to skin a cat and we found at least three ways to skin Fabric!

1. Branch Based Deployments via Git
2. Dacpac Deployments
3. Deployment Pipelines (aka PBI Premium Deployment Pipelines)

The branch based deployment is the most robust, but warehouses still don’t work 100% and Deployment Pipelines have some great deployment rules that make separation of layers easier. So we’ll discuss how to combine the three into a robust devops strategy for any larger Fabric project.

When: Thursday 21st March 2024 Time: arrive for 5:45pm with talks starting from 6pm start prompt Location: Number 1 Spinningfields, 1 Hardman Street, Manchester, M3 3EB Session will not be streamed over MS Teams Complimentary drinks & pizza provided by our hosts & sponsors Robert Walters

March's PBIMCR will feature Pets at Home's Chris Elton & Brook Bracewell and Nat Van Gulck.

Pets at Home “The Journey from Tableau to Power BI self-service”

• As-Is describing our Tableau viz solution on data sets supporting reporting
• Setting the Standards
• Themes
• Governance & Control
• Dax Standardisation
• Domain based semantic models
• How we identified the domains
• Aspiring to few models supporting many reports
• -Considerations on when to use direct query with GCP (Drill throughs) – demo hopefully with some example costs reporting
• - Challenges on how to aggregate we have distinct counts over time
• Source control
• Deployment Patterns
• Demo pushing a semantic model to git source control explain how azure dev ops is slicker but out of scope
• Demo updating measures on a deployed model using git and ALM tool kit
• Demo moving from dev to prod using power bi pipelines

Bio: Brook Bracewell Brook has nearly a decade of experience in data analytics, with a focus on data modelling, SQL, and DAX. Over the past 14 months at Pets at Home, Brook has been developing the Data Warehouse on Google Cloud Platform, specialising in optimising models for Power BI self-service. This role builds on Brook's extensive background in data warehouse implementations and Power BI deployments across various sectors, supporting both small and large enterprises. With a career history as a business analyst, project manager, and operational lead, Brook brings a wealth of expertise to the table in a pragmatic and experienced manner.

Chris Elton has over 10 years experience in BI, mostly working in healthcare and recently moving into retail at Pets. Chris has worked as a BI Analyst, developing dashboards to deliver value and add insight to the business, with a primary focus on customer experience. More recently he has led tool migrations to Power BI, with a user first approach; gaining stakeholder buy in and driving a cultural shift.

PBI Inspector with Nat Van Gulck:

Testing the visual layer of Power BI reports has usually been a manual task. Thanks to the new Power BI Project file format however there is an opportunity to automatically check for visuals' issues around accessibility, consistency and performance and thereby align with your organizations Power BI Centre of Excellence guidelines. In this session we will see how PBI Inspector, an open-source community tool, supports this process.

About Nat: I started my career over twenty years ago as a .NET Software Developer while also developing an interest for Data Visualization. This led me to work on Qlik and Tableau data projects. Then Power BI became so compelling that I had to join Microsoft. As a Cloud Solutions Architect I help customers be successful with Power BI; PBI Inspector is part of this endeavour. The adventure continues with Microsoft Fabric.

PBI Inspector GitHub repository -- https://github.com/NatVanG/PBI-Inspector Tutorial: PBI Inspector as part of an Azure DevOps pipeline: https://learn.microsoft.com/en-us/power-bi/developer/projects/projects-build-pipelines

Join our Microsoft Fabric - UK User Group for our webinar in association with Onyx Data (https://onyxdata.co.uk).

This session we are excited to announce our host Microsoft MVP Leon Gordon and co-host Microsoft MVP Pragati Jain will be introducing Microsoft Product Manager Rui Romano.

Join the Microsoft Fabric UK - User Group on -

Microsoft Community - https://community.powerbi.com/t5/Power-BI-UK-User-Group/gh-p/pbi_UK_usergroup LinkedIn - https://www.linkedin.com/groups/8909321/ MeetUp - https://www.meetup.com/microsoft-power-bi-uk/

Session Abstract -

Developer mode seamlessly integrates developer-centric features directly into Microsoft Power BI Desktop. This advancement empowers users to effortlessly implement source control for their work, thereby boosting efficiency and enhancing the maintenance of Power BI projects.

When combined with Azure DevOps and Fabric Git Integration, Developer Mode opens up unprecedented collaboration possibilities, facilitating the establishment of robust Continuous Integration/Continuous Deployment (CI/CD) pipelines. These pipelines not only improve the reliability of Power BI projects but also enable scalability, ultimately elevating the development and collaboration experience to new heights.

Join me to explore how these powerful tools can transform your Power BI development experience.

Biography

Rui is an experienced Microsoft Professional with a deep passion for data and analytics. He has spent the last decade helping companies make better data-driven decisions and is known for his innovative and practical solutions to complex problems.

Currently works as Product Manager at the Power BI product team, focusing on Pro-BI experiences.

Social Media / Website Links

https://www.linkedin.com/in/ruiromano