talk-data.com

Power BI on Databricks Best Practices

Want to supercharge the house part of your lake house? This session will cover best practices of building visualization using Power BI on top of Databricks SQL in terms of performance, security and different architecture patterns.

Hi, I am Liping, Data & AI Solution Architect, ex-Microsoft, I specialize in Big Data Analytics, Data Engineering, Data Warehousing and Business Intelligence. In addition to helping customers build out data platforms and solving real-world problems using data

I am also a blogger (https://www.dataleaps.co.uk), YouTuber (https://www.youtube.com/@dataleaps), international public speaker (https://www.sessionize.com/lipinght).

Follow me on socials https://linktr.ee/liping_dataleaps for career in data content & Data & AI tutorials.

Welcome to the first Databricks Scotland Meetup in Glasgow!

We're kicking off the first Databricks Scotland Meetup in Glasgow with a special event the night before DATA:Scotland. We'll have some fantastic speakers from the DATA:Scotland line-up and tons more in the room for Q&A and discussions.

Whether you're a seasoned Databricks user, just dipping your toes, or simply intrigued about what the platform can offer, this meetup promises to deliver insights, best practices, and opportunities for networking with like-minded individuals. We hope to see you there!

Come join us for the Scotland Databricks meetup at BJSS, Sept 12th at 5.30pm for an evening of amazing data talks!

17:00 - 17:30 Welcome & Networking 17:30 - 18:15 Liping Huang - Data Quality Management with Databricks 18:15 - 18:45 Networking, Food and Drinks 18:45 - 19:30 Johnny Winter - Exploring Databricks SQL: Life as an Analyst in a Databricks world 19:30 - 19:45 Networking & Close

Liping Huang - Data Quality Management with Databricks Data quality has been a critical and common practice employed across industries for many years. At the core, data quality encompasses six dimensions, including consistency, accuracy, validity, completeness, timeliness, and uniqueness.

However, a significant challenge remains in streamlining these processes to prevent data management issues and enhance their utility for downstream analytics, data science, and machine learning. The session will delve into the six dimensions of data quality based on the maturity level of data quality management implementation, detailing the specific techniques and features that enhance the Databricks Platform's functionality.

Johnny Winter - Exploring Databricks SQL: Life as an Analyst in a Databricks world

So your Data Engineering team have built a shiny new data platform using Databricks. Now, as an analyst, you want to explore and analyse the data. You need Databricks SQL in your life! Databricks SQL is the collection of services that bring data warehousing capabilities and performance to your existing data lake , and it’s THE best way for you to get started with analysing your data. We’ll dive into explaining what these services are and how they differ from other experiences in Databricks, before getting our hands dirty and jumping on some demonstrations of how you can utilise Databricks SQL to query and visualise data , as well as show casing some practical examples of how using Databricks SQL features can be useful to you.

About Us If you need to contact us for any reason you can email us at: [email protected]

We are sponsored by:

• Databricks
• Advancing Analytics
• BJSS

When: Thursday 29th August 2024

Time: arrive from 5:30pm with talks starting from 6pm start prompt Location: GM Digital Security Hub (DiSH) Heron House, 47 Lloyd Street M2 5LE

Session will not be streamed over MS Teams Complimentary drinks & pizza provided by our hosts & sponsors Robert Walters

August's #PBIMCR will feature: Liping Huang & Ben Wolfenden

Session 1 - Liping with "Best practice for Power BI on Databricks" Want to supercharge the house part of your Databricks lakehouse? This session will cover best practices for building visualization using Power BI on top of Databricks SQL in terms of performance, security and different architecture patterns for batch and streaming.

Session 2 - Ben with "Intro to Delta Lake in Fabric"

Discover the powerful capabilities of Delta Lake in Microsoft Fabric in this talk. Learn about Delta Lake's key features, including ACID transactions, scalable metadata handling, and data versioning (time travel), and see how these can enhance your data workflows. Gain practical insights on integrating and utilizing Delta Lake within Microsoft Fabric to optimize your data lakehouse architecture.

About Speaker 2 Ben is a Head of Data Engineering with several years of Azure data experience. Strong interest in Lakehouse + Kimball architecture and building data solutions to enable powerful AI/ML products to improve business efficiency and enhance customer offerings.

Event Overview: We are thrilled to invite you to London Data Engineering Coffee Chat. This time we will invite two speakers from Databricks to share their data career. Also, an exciting gathering dedicated to exploring the latest advancements and insights in Databricks. This event will bring together industry leaders, experts, and enthusiasts for an engaging series of discussions, presentations, and networking opportunities.

Speakers: Liping Huang, Data Architect in Databricks and founder of Youtube channel Data Leaps. Dustin Smith, Data Architect in Databricks with 10+ years in Big Data Engineering and Machines Learning.

Why Attend?

• Learn from the Best: Gain insights from top experts and innovators.
• Network: Connect with professionals and peers in the industry.
• Innovate: Discover new ideas and approaches that can drive your work forward.

Engage: Participate in Q&A sessions, panel discussions, and networking.

This session is comprised of a series of end-to-end technical demos illustrating the synergy between Databricks and Power BI for streaming use cases, and considerations around when to choose which scenario:

Scenario 1: DLT + Power BI Direct Query and Auto Refresh

Scenario 2: Structured Streaming + Power BI streaming datasets

Scenario 3: DLT + Power BI composite datasets

Talk by: Liping Huang and Marius Panga

Connect with us: Website: https://databricks.com Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/databricks Instagram: https://www.instagram.com/databricksinc Facebook: https://www.facebook.com/databricksinc