Today, host Kirk Offel is joined by Sean Hughes and Scott Yappen for a candid conversation that dives deep into the world of on-site power solutions, cutting-edge energy technology, and the evolving landscape of data center infrastructure. Wärtsilä, a powerhouse in the energy sector, steps into the spotlight as Sean and Scott share their journey of leading the charge for utility-scale natural gas engines that are reshaping the way data centers manage their energy needs. For more about us: https://linktr.ee/overwatchmissioncritical

DevOps Society Meetup – Wednesday 1st October @6PM

Location: Zilch Offices, London - 111 Buckingham Palace Rd, London SW1W 0SR

We’re excited to invite you to our next DevOps Society Meetup, hosted by Zilch in London. This event brings together the DevOps and cloud-native community for an evening of conversation, learning, and networking.

A huge thank you to Zilch for sponsoring this event, and for providing the venue, refreshments, and support!

Format of the Meetup:

6:00pm – 6:30pm — Networking on arrival, with pizza and drinks provided by Zilch 6:30pm – 7:10pm — First speakers will take to the stage 7:10pm – 7:20pm — Break for refreshments and networking 7:20pm – 8:00pm — Second speaker will take to the stage 8:00pm onwards — More networking at the venue and then at a nearby pub

Timings can vary depending on the length of the Q&A after each talk!

We are delighted to welcome three fantastic speakers to our event at Zilch, across two talks.

SPEAKERS 1 & 2 – Nick Gilbert & Sean Hederman

Nick Gilbert – DevOps Engineer III at Zilch

Nick Gilbert is a Senior DevOps Engineer with a decade of experience working across public and private cloud systems. He has worked extensively with CI/CD and immutable infrastructure, focusing on modernising on-premise solutions into cloud-native architectures. Since joining Zilch, Nick has enhanced system capabilities to shorten feedback loops, improve the developer experience, and increase the reliability of CI/CD pipelines.

Sean Hederman – CTO at Zilch

With nearly three decades of experience in technology delivery and leadership, Sean Hederman has been instrumental in shaping Zilch’s technological evolution as Chief Technology Officer. He previously held senior roles in technology and DevOps at leading organisations, gaining deep expertise in building and scaling enterprise-grade systems. At Zilch, Sean designed and built the company’s foundational technology and platforms, scaling the team from just a few engineers to more than 120 specialists across multiple disciplines and regions. Originally from South Africa and now based in London, Sean is a recognised thought leader in AI and a leading voice in software engineering, architecture, and DevSecOps.

Talk Title: ZOE and Zephyrs: An Overview of Our Journey to Ephemeral Environments at Zilch

Nick and Sean will take us through the architecture, challenges, and triumphs of establishing ephemeral environments at Zilch.

They’ll share insights into:

• How Kubernetes, ArgoCD, and AWS power ephemeral environments at scale, at Zilch.
• The organisational and technical hurdles they had to overcome
• The wins (and lessons learned) from adopting ephemeral environments in a fast-paced fintech environment

Expect a candid walkthrough of what it really takes to make ephemeral environments reliable, scalable, and developer-friendly.

SPEAKER 3 – Dhruv Parekh

Senior DevOps Engineer at EDF

Dhruv Parekh is a Senior DevOps Engineer at EDF, specialising in cloud engineering and automation. With over 4 years of experience in building scalable DevOps solutions, Dhruv focuses on driving automation strategies that go beyond the basics of infrastructure as code, bringing a holistic approach to engineering efficiency and business value. Dhruv is also a valued member of our community, holding the "Ambassador for Terraform" title!

Talk Title: Automating Beyond Terraform

When people hear DevOps automation, many think of Terraform plans and YAML pipelines. While powerful, they’re only part of the picture. In this talk, Dhruv explores what it means to automate beyond Terraform:

• Using Python to stitch together cross-cloud tasks and business logic Terraform can’t reach
• Building dashboards with Power BI to bring automation full circle, telling the story of your platform
• Thinking like a solution architect to design scalable, observable automations that deliver lasting value, not just quick fixes

By the end of this talk, you’ll see automation not just as code, but as a way to design the entire lifecycle of change, from idea to insight.

Please RSVP to book your spot. Space is limited, so it’s first come, first served! We look forward to seeing you all there.

Ben & Vytas – Co-organisers.

En esta ocasión analizaremos las novedades que nos han proporcionado las últimas actualizaciones de Microsoft Fabric para el trabajo con Agentes de IA que sean expertos en nuestros datos. Veremos la posibilidad de configurar instrucciones para varios orígenes de datos y como integrar estos agentes con Copilot para Power BI, para complementar las capacidades de este.

📢 Leeds Power BI, Data & Analytics User Group – April Event! 🚀

Livestream link: https://www.youtube.com/watch?v=418vtDael-M

Join us for another incredible evening of learning, networking, and inspiration at the Leeds Power BI, Data & Analytics User Group! This month, we’re bringing you two top-tier speakers, plenty of real-world insights, and, of course, pizza & drinks to keep you fuelled. 🍕🥤

🔹 This Month’s Lineup

🎤 Holly Smith – "How Databricks Does Analytics, Data Warehousing, and a Whole Lot More!"

• Ever wondered how Databricks handles analytics? Holly, a London-based expert, will walk us through how Databricks is revolutionising analytics and data warehousing.

🎤 Sean Best – "Best Power BI Report Ever!"

• Sean, a local Leeds-based Consultant, will showcase what he believes is the best Power BI report ever—packed with design tips, usability tricks, and real-world impact!

🔥 Thursday 17th April \| 5:30 PM Onwards 📍 Gravitas Recruitment Group, Park Row, Leeds 🎥 Live-streamed on YouTube for remote attendees!

🔹 Who Should Attend?

🚀 Power BI users of all levels, from beginners to pros. 📊 Data professionals working with analytics, visualization, and data engineering. 🤝 Anyone who loves learning, sharing, and networking with like-minded people!

🔹 How to Find Us?

📍 Gravitas Recruitment Group, Park Row, Leeds – A fantastic central venue!

🛜 If you can’t join in person, catch the event live on YouTube! 💡 Seats are limited, so RSVP now! If you can’t make it, please update your RSVP so others can attend.

Please note this is a free to attend event and no fees are taken for attendance or RSVP. Let’s make this another fantastic event! 🎉 See you there! 🚀

Details

Welcome to the Databricks Scotland Meetup in Glasgow! Whether you're a seasoned Databricks user, just dipping your toes, or simply intrigued about what the platform can offer, this meetup promises to deliver insights, best practices, and opportunities for networking with like-minded individuals. We hope to see you there!

Come join us for the Scotland Databricks meetup at BJSS, March 13th at 5.30pm for an evening of Databricks!

17:30 - 17:45 Welcome & Networking 17:45 - 18:30 Sean Caldwell 18:30 - 19:00 Networking, Food and Drinks 19:00 - 19:45 Networking, Food and Drinks

Spark up the Savings - Sean Caldwell

Migrating data ingestion Spark jobs from Databricks to AKS to allow more control over compute for each job. Reducing the overall cost of a data platform.

Fabric and Databricks: Better together? - Craig Porteous

Fabric is Microsoft's new unified data platform and with it brings many questions of which platform to choose, where does Databricks excel, What makes Fabric the right choice?

But it doesn't have to be a binary choice. Rather than thinking about which route to take, You can enrich your Databricks Data Lakehouse with Microsoft Fabric, taking advantage of Fabric's key features such as lightning fast Direct Lake connectivity from your Delta Lake to Power BI.

In this session we will deep dive into the synergistic relationship between Azure Databricks and Microsoft Fabric. Together these platforms can deliver performance and value in data analytics. We'll explore architecture patterns to enhance and augment your existing Databricks Lakehouse allowing you to fully harness key features in Fabric all built upon the same robust storage of Delta Lake.

We will also explore how the close integration of these platforms can lead to improved analytics capabilities, and ultimately, better business insights. Whether you are an analytics engineer looking to get the most out of your data, or a business leader seeking to drive data-driven decision making, this session will provide valuable insights into maximizing the potential of your data platform by bringing Azure Databricks and Microsoft Fabric together

About Us If you need to contact us for any reason you can email us at: [email protected] We are sponsored by:

• Databricks
• Advancing Analytics
• BJSS

PBIBRUM - April meetup!

17:45 - Welcome & networking

18:00 - Introductions

18:05 - Sean Bedson with: Empowering Insights: Unveiling Power BI's Cutting-Edge In-Visual Calculations and Rolling Month Functions. As a Data Engineer at KPMG, Sean designs, tests, and maintains data pipelines & visualizations, working predominately with the Microsoft Azure technology stack, including Data Factory, SQL Server, Synapse, Power BI and now Microsoft Fabric.

18:50 - Break

19:15 - John Kerski with: Commenting Power Query with Azure OpenAI. Large Language Models (such as ChatGPT) can greatly enhance the way you develop and deliver Power BI solutions. In this session, John will show you how to integrate Azure Open AI into Power BI using prompt engineering techniques.

20:00 - Finish

About this Session: Microsoft Mesh, now in public preview, provides a built-for-business toolkit that accelerates the creation of 3D multi-user experiences and solutions for PC and VR. These experiences can be even better when you bring everyday apps and information from the web into your 3D worlds. Imagine bringing your distributed workforce together in an immersive space to review dashboards or business intelligence apps, compete in classic online games, or walk through interactive exhibits. The WebSlate component of the Mesh Toolkit provides a secure, streamlined way to add and interact with web content by bringing the power of WebView2 technology to world builders. With WebSlate, you can add a URL to a screen placed anywhere in a virtual Mesh environment and experience it across multiple users during an event. As an avatar in an immersive space, you can view, click, and discuss secure web content just as you would from a traditional web browser but with co-presence - right from your PC or Meta Quest headset.

What will I learn? This session will provide a brief intro to Mesh and the Mesh Toolkit, discuss scenarios for using web content in Mesh, introduce WebSlates and then provide a demo on adding web content to your Mesh environment and using WebSlates and scripting in Mesh (cloud scripting and visual scripting). Find out how you can leverage WebSlates to highlight products, services, customer stories, brand identity and more, with interactive maps, diagrams, data, dashboards, web pages, photos, and videos. Session content will be followed by a live question and answer session.

Who should attend? VR/MR/XR developers, world builders, Unity developers. If you are new to Mesh development, we recommend watching this 8-minute introduction video prior to attending.

Develop your skills and learn more about WebSlates: Display and interact with web content \| Microsoft Learn

Speakers: Sean Kerawala and Samira Hirji

Sean Kerawala, Product Manager, Mesh Web Content Sean is a product manager with 9 years of experience across the edtech startup world and Microsoft. He is passionate about quality, user experience, business analysis, monetization, and developer platforms. Sean worked with Azure Commerce, Xbox Game Pass, HoloLens, Windows Mixed Reality OS, and Microsoft Mesh. Currently, his focus is on developer platform growth, web content, and leading the Content & Learning program on the Mesh App & Developer Experience team to create collaborative and meaningful immersive experiences.

Samira Hirji, Software Engineer, Mesh Web Samira is a software engineer at Microsoft and has had the privilege of working on diverse projects within Windows Mixed Reality, WebXR for Edge, HoloLens and Microsoft Mesh. She is fueled by her excitement in the possibilities that the mixed reality space offers and continues to explore experiences in which this space can benefit everyday customers.

Welcome to the 2023 Power BI User Group Finale!

We have 2 fantastic sessions to end the year in Lars Anderson from Microsoft and our resident presenter Sean Best!

Lars is Program Manager on Fabric Customer Advisory Team at Microsoft. His passion is helping organizations getting insights out of data. He joined Microsoft in 2014 and has been working with BI solutions since 1999. Lars will be covering the exciting new feature Data Activator along with a bonus demo of the new Co Pilot feature: Your data is only valuable if you can act on it. But acting on data often requires manual monitoring of reports and dashboards, which can be time-consuming. That's why we have created Data Activator. Data Activator is an experience in Microsoft Fabric that lets you create alerts and trigger an event like email, Teams message or Power Automate flows from your data, without writing code. In this session. In this session you will see how Data Activator works in action

Sean is a Business Intelligence Developer & Data Engineer in the Microsoft stack, with deep expertise in Power BI, SQL & Data factory. Sean will be talking Data Modelling in Power BI: Leaders often get the fundamental economics of data delivery wrong, exclusively chasing business “value”. A data team should instead aim for “ROI” – Return on Investment – which is “value over cost”. Costs of reporting projects differ radically, pivoting around the current Data Model. This session is a deep dive into how to choose your next data project wisely.

Join us as we share drinks, pizza and stories in this end of year extravaganza that is the Power BI User Group, Leeds!

To access this webinar, please register here: https://hubs.li/Q021Rn6z0

Topic: “Unlocking the Power of Knowledge Graphs for Generative AI in Enterprise Environments”

Speaker: Sean Martin, CTO & Co–Founder of Cambridge Semantics Sean's experience covers multiple aspects of starting and growing a software company, including holding various titles from President through to co-lead dish washer. He continues in a leadership role as CTO and serves on the board.

Abstract: Join us for an insightful exploration of how Knowledge Graphs are revolutionizing the way enterprises harness the capabilities of Generative AI.

Webinar Highlights: - Understand the rapid rise and significance of Generative AI in the data sphere. - Discover the challenges and risks associated with implementing Generative AI in enterprise settings. - Learn how Knowledge Graphs serve as a foundational technology to address these challenges. - Explore how Knowledge Graphs enable accurate responses to natural language queries and ensure data provenance. - Dive into legal considerations\, access controls\, and data privacy in the context of Generative AI. - Get practical insights on implementing Knowledge Graphs for Generative AI with real-world case studies. - Engage in a Q&A session with experts in the field.

Why Attend? In less than a year, Generative AI has transformed from a niche technology to a sought-after capability across industries. However, unlocking its potential in enterprise environments requires addressing critical concerns related to accuracy, privacy, and legality. This webinar will equip you with the knowledge and strategies to make Generative AI a success within your organization.

Who Should Attend: - Data Scientists - AI Enthusiasts - Business Leaders - IT Professionals - Decision-makers

ODSC Links: • Get free access to more talks/trainings like this at Ai+ Training platform: https://hubs.li/H0Zycsf0 • ODSC blog: https://opendatascience.com/ • Facebook: https://www.facebook.com/OPENDATASCI • Twitter: https://twitter.com/_ODSC & @odsc • LinkedIn: https://www.linkedin.com/company/open-data-science • Slack Channel: https://hubs.li/Q01_Yrgb0 • Code of conduct: https://odsc.com/code-of-conduct/

To access this webinar, please register here: https://hubs.li/Q021Rn6z0

Topic: “Unlocking the Power of Knowledge Graphs for Generative AI in Enterprise Environments”

Speaker: Sean Martin, CTO & Co–Founder of Cambridge Semantics Sean's experience covers multiple aspects of starting and growing a software company, including holding various titles from President through to co-lead dish washer. He continues in a leadership role as CTO and serves on the board.

Abstract: Join us for an insightful exploration of how Knowledge Graphs are revolutionizing the way enterprises harness the capabilities of Generative AI.

Webinar Highlights: - Understand the rapid rise and significance of Generative AI in the data sphere. - Discover the challenges and risks associated with implementing Generative AI in enterprise settings. - Learn how Knowledge Graphs serve as a foundational technology to address these challenges. - Explore how Knowledge Graphs enable accurate responses to natural language queries and ensure data provenance. - Dive into legal considerations\, access controls\, and data privacy in the context of Generative AI. - Get practical insights on implementing Knowledge Graphs for Generative AI with real-world case studies. - Engage in a Q&A session with experts in the field.

Why Attend? In less than a year, Generative AI has transformed from a niche technology to a sought-after capability across industries. However, unlocking its potential in enterprise environments requires addressing critical concerns related to accuracy, privacy, and legality. This webinar will equip you with the knowledge and strategies to make Generative AI a success within your organization.

Who Should Attend: - Data Scientists - AI Enthusiasts - Business Leaders - IT Professionals - Decision-makers

ODSC Links: • Get free access to more talks/trainings like this at Ai+ Training platform: https://hubs.li/H0Zycsf0 • ODSC blog: https://opendatascience.com/ • Facebook: https://www.facebook.com/OPENDATASCI • Twitter: https://twitter.com/_ODSC & @odsc • LinkedIn: https://www.linkedin.com/company/open-data-science • Slack Channel: https://hubs.li/Q01_Yrgb0 • Code of conduct: https://odsc.com/code-of-conduct/

To access this webinar, please register here: https://hubs.li/Q021Rn6z0

Topic: “Unlocking the Power of Knowledge Graphs for Generative AI in Enterprise Environments”

Speaker: Sean Martin, CTO & Co–Founder of Cambridge Semantics Sean's experience covers multiple aspects of starting and growing a software company, including holding various titles from President through to co-lead dish washer. He continues in a leadership role as CTO and serves on the board.

Abstract: Join us for an insightful exploration of how Knowledge Graphs are revolutionizing the way enterprises harness the capabilities of Generative AI.

Webinar Highlights: - Understand the rapid rise and significance of Generative AI in the data sphere. - Discover the challenges and risks associated with implementing Generative AI in enterprise settings. - Learn how Knowledge Graphs serve as a foundational technology to address these challenges. - Explore how Knowledge Graphs enable accurate responses to natural language queries and ensure data provenance. - Dive into legal considerations\, access controls\, and data privacy in the context of Generative AI. - Get practical insights on implementing Knowledge Graphs for Generative AI with real-world case studies. - Engage in a Q&A session with experts in the field.

Why Attend? In less than a year, Generative AI has transformed from a niche technology to a sought-after capability across industries. However, unlocking its potential in enterprise environments requires addressing critical concerns related to accuracy, privacy, and legality. This webinar will equip you with the knowledge and strategies to make Generative AI a success within your organization.

Who Should Attend: - Data Scientists - AI Enthusiasts - Business Leaders - IT Professionals - Decision-makers

ODSC Links: • Get free access to more talks/trainings like this at Ai+ Training platform: https://hubs.li/H0Zycsf0 • ODSC blog: https://opendatascience.com/ • Facebook: https://www.facebook.com/OPENDATASCI • Twitter: https://twitter.com/_ODSC & @odsc • LinkedIn: https://www.linkedin.com/company/open-data-science • Slack Channel: https://hubs.li/Q01_Yrgb0 • Code of conduct: https://odsc.com/code-of-conduct/

In this episode, Conor concludes his conversation with Jason Turner! Link to Episode 105 on Website

Twitter ADSP: The PodcastConor HoekstraBryce Adelstein LelbachAbout the Guest: Jason is host of the YouTube channel C++ Weekly, co-host emeritus of the podcast CppCast, author of C++ Best Practices, and author of the first casual puzzle books designed to teach C++ fundamentals while having fun! A list of Jason’s content: C++ Weekly YouTube ChannelThe [Fill in the Blank] Programmer YouTube ChannelC++ BooksTalk PlaylistShow Notes

Date Recorded: 2022-10-26 Date Released: 2022-11-25 The Best Parts of C++ - Jason Turner - CppNorth 2022The Power Of Compile-Time Resources - Jason Turner - CppNorth 2022Making C++ Fun, Safe, and Accessible – Jason Turner - C++ on Sea 2022Your New Mental Model of constexpr - Jason Turner - CppCon 2021C++ AdressSanitizerC++ UndefinedBehaviorSanitizerC++ Sarter ProjectCircle CompilerVal Programming LanguageJakt Programming LanguageCarbon Programming LanguageCppFrontADSP Episode 97: C++ vs Carbon vs Circle vs CppFront with Sean BaxterJT on TwitterCppCast Episode 242 is AWESOME!Chapel Programming LanguageCppCast Episode with Adreas KlingChaiScriptRhai Programming LanguageC++ Pattern Matching ProposalC++ Pattern matching using is and asC++ Code Smells - Jason Turner - CppCon 2019Conor Hoekstra — ITM: My least favorite anti-patternIntro Song Info Miss You by Sarah Jansen https://soundcloud.com/sarahjansenmusic Creative Commons — Attribution 3.0 Unported — CC BY 3.0

Summary As data engineers the health of our pipelines is our highest priority. Unfortunately, there are countless ways that our dataflows can break or degrade that have nothing to do with the business logic or data transformations that we write and maintain. Sean Knapp founded Ascend to address the operational challenges of running a production grade and scalable Spark infrastructure, allowing data engineers to focus on the problems that power their business. In this episode he explains the technical implementation of the Ascend platform, the challenges that he has faced in the process, and how you can use it to simplify your dataflow automation. This is a great conversation to get an understanding of all of the incidental engineering that is necessary to make your data reliable.

Announcements

Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. With 200Gbit private networking, scalable shared block storage, and a 40Gbit public network, you’ve got everything you need to run a fast, reliable, and bullet-proof data platform. If you need global distribution, they’ve got that covered too with world-wide datacenters including new ones in Toronto and Mumbai. And for your machine learning workloads, they just announced dedicated CPU instances. Go to dataengineeringpodcast.com/linode today to get a $20 credit and launch a new server in under a minute. And don’t forget to thank them for their continued support of this show! This week’s episode is also sponsored by Datacoral, an AWS-native, serverless, data infrastructure that installs in your VPC. Datacoral helps data engineers build and manage the flow of data pipelines without having to manage any infrastructure, meaning you can spend your time invested in data transformations and business needs, rather than pipeline maintenance. Raghu Murthy, founder and CEO of Datacoral built data infrastructures at Yahoo! and Facebook, scaling from terabytes to petabytes of analytic data. He started Datacoral with the goal to make SQL the universal data programming language. Visit dataengineeringpodcast.com today to find out more. Having all of your logs and event data in one place makes your life easier when something breaks, unless that something is your Elastic Search cluster because it’s storing too much data. CHAOSSEARCH frees you from having to worry about data retention, unexpected failures, and expanding operating costs. They give you a fully managed service to search and analyze all of your logs in S3, entirely under your control, all for half the cost of running your own Elastic Search cluster or using a hosted platform. Try it out for yourself at dataengineeringpodcast.com/chaossearch and don’t forget to thank them for supporting the show! You listen to this show to learn and stay up to date with what’s happening in databases, streaming platforms, big data, and everything else you need to know about modern data management. For even more opportunities to meet, listen, and learn from your peers you don’t want to miss out on this year’s conference season. We have partnered with organizations such as O’Reilly Media, Dataversity, Corinium Global Intelligence, Alluxio, and Data Council. Upcoming events include the combined events of the Data Architecture Summit and Graphorum, the Data Orchestration Summit, and Data Council in NYC. Go to dataengineeringpodcast.com/conferences to learn more about these and other events, and take advantage of our partner discounts to save money when you register today. Your host is Tobias Macey and today I’m interviewing Sean Knapp about Ascend, which he is billing as an autonomous dataflow service

Interview

Introduction How did you get involved in the area of data management? Can you start by explaining what the Ascend

Traditional engineering is built upon a world of knowledge and scientific laws, with components and systems that operate predictably. But what happens when a large number of these devices are interconnected? You get a complex system that’s no longer deterministic, but probabilistic. That’s happening today in many industries, including manufacturing, petroleum, transportation, and energy. In this O’Reilly report, Sean Patrick Murphy, Chief Data Scientist at PingThings, describes how data science is helping electric utilities make sense of a stochastic world filled with increasing uncertainty—including fundamental changes to the energy market and random phenomena such as weather and solar activity. Murphy also reviews several cutting-edge tools for storing and processing big data that he’s used in his work with electric utilities—tools that can help traditional engineers pursue a data-driven approach in many industries. Topics in this report include: Key drivers that have changed the electric grid from a deterministic machine into probabilistic system Fundamental differences that put traditional engineering and data science at odds with one another Why the time is right for engineering organizations to adopt a complete data-driven approach Contemporary tools that traditional engineers can use to store and process big data A PingThings case study for dealing with random geomagnetic disturbances to the energy grid