talk-data.com

** Please register here Join Sam Barlien as he unpacks the 2025 State of Platform Engineering report: why platform engineering is “eating the world,” how “shifting down” beats “shifting left,” and what a platform engineering-driven AI-native era means for platforms, teams, and the end of the artisan software engineer.

In this webinar, we will cover:

• Data on salary, maturity, best practices and more from 518 platform engineers
• What the best led platform teams are doing in 2026
• How platform engineering is industrializing the software delivery lifecycle

After a 30-minute talk there’ll be a 15-minute Q&A, for which we encourage you to submit questions in advance. A webinar recording and related materials will be shared with all attendees after the event.

Speaker: Sam Barlien - Head of Ecosystem @ Platform Engineering

Sam Barlien is a community organiser for the Platform Engineering Community. He is a tech nerd, and has been involved in tech communities for more than 10 years. He helps manage Platform Weekly, co-hosts PlatformCon, and drives the community Ambassador program, blog and Youtube channel

** Please register here Join Sam Barlien as he unpacks the 2025 State of Platform Engineering report: why platform engineering is “eating the world,” how “shifting down” beats “shifting left,” and what a platform engineering-driven AI-native era means for platforms, teams, and the end of the artisan software engineer.

In this webinar, we will cover:

• Data on salary, maturity, best practices and more from 518 platform engineers
• What the best led platform teams are doing in 2026
• How platform engineering is industrializing the software delivery lifecycle

After a 30-minute talk there’ll be a 15-minute Q&A, for which we encourage you to submit questions in advance. A webinar recording and related materials will be shared with all attendees after the event.

Speaker: Sam Barlien - Head of Ecosystem @ Platform Engineering

Sam Barlien is a community organiser for the Platform Engineering Community. He is a tech nerd, and has been involved in tech communities for more than 10 years. He helps manage Platform Weekly, co-hosts PlatformCon, and drives the community Ambassador program, blog and Youtube channel

** Please register here Join Sam Barlien as he unpacks the 2025 State of Platform Engineering report: why platform engineering is “eating the world,” how “shifting down” beats “shifting left,” and what a platform engineering-driven AI-native era means for platforms, teams, and the end of the artisan software engineer.

In this webinar, we will cover:

• Data on salary, maturity, best practices and more from 518 platform engineers
• What the best led platform teams are doing in 2026
• How platform engineering is industrializing the software delivery lifecycle

After a 30-minute talk there’ll be a 15-minute Q&A, for which we encourage you to submit questions in advance. A webinar recording and related materials will be shared with all attendees after the event.

Speaker: Sam Barlien - Head of Ecosystem @ Platform Engineering

Sam Barlien is a community organiser for the Platform Engineering Community. He is a tech nerd, and has been involved in tech communities for more than 10 years. He helps manage Platform Weekly, co-hosts PlatformCon, and drives the community Ambassador program, blog and Youtube channel

** Please register here Join Sam Barlien as he unpacks the 2025 State of Platform Engineering report: why platform engineering is “eating the world,” how “shifting down” beats “shifting left,” and what a platform engineering-driven AI-native era means for platforms, teams, and the end of the artisan software engineer.

In this webinar, we will cover:

• Data on salary, maturity, best practices and more from 518 platform engineers
• What the best led platform teams are doing in 2026
• How platform engineering is industrializing the software delivery lifecycle

After a 30-minute talk there’ll be a 15-minute Q&A, for which we encourage you to submit questions in advance. A webinar recording and related materials will be shared with all attendees after the event.

Speaker: Sam Barlien - Head of Ecosystem @ Platform Engineering

Sam Barlien is a community organiser for the Platform Engineering Community. He is a tech nerd, and has been involved in tech communities for more than 10 years. He helps manage Platform Weekly, co-hosts PlatformCon, and drives the community Ambassador program, blog and Youtube channel

** Please register here Join Sam Barlien as he unpacks the 2025 State of Platform Engineering report: why platform engineering is “eating the world,” how “shifting down” beats “shifting left,” and what a platform engineering-driven AI-native era means for platforms, teams, and the end of the artisan software engineer.

In this webinar, we will cover:

• Data on salary, maturity, best practices and more from 518 platform engineers
• What the best led platform teams are doing in 2026
• How platform engineering is industrializing the software delivery lifecycle

After a 30-minute talk there’ll be a 15-minute Q&A, for which we encourage you to submit questions in advance. A webinar recording and related materials will be shared with all attendees after the event.

Speaker: Sam Barlien - Head of Ecosystem @ Platform Engineering

Sam Barlien is a community organiser for the Platform Engineering Community. He is a tech nerd, and has been involved in tech communities for more than 10 years. He helps manage Platform Weekly, co-hosts PlatformCon, and drives the community Ambassador program, blog and Youtube channel

👉 Register here 2025 was a landmark year for the platform engineering industry. With the release of the State of Platform Engineering, the State of AI in Platform Engineering, and the 2025 DORA report, the data is in on what the world of platform engineering looks like as we close out the year and enter the next. This webinar will explore the key trends from 2025, and what we can expect in 2026.

We will break down: - What the data tells us about the future of platform engineering - How the intersection of AI and platform engineering defined 2025 - Current best practices and frameworks for doing “great” platform engineering

After a 30-minute talk there’ll be a 15-minute Q&A, for which we encourage you to submit questions in advance. A webinar recording and related materials will be shared with all attendees after the event.

Speakers:

Rickey Zachary - Global Engineering Platforms Lead @ Thoughtworks For more than 15 years, Rickey has worked across both the public and private sectors, designing and developing large-scale, mission-critical software systems. He has had the opportunity to contribute to highly secure government agencies and extremely early-stage startups, both environments offering unique and interesting challenges that have shaped his career.

Sam Barlien - Head of Ecosystem @ Platform Engineering Sam Barlien is a community organiser for the Platform Engineering Community. He is a tech nerd, and has been involved in tech communities for more than 10 years. He helps manage Platform Weekly, co-hosts PlatformCon, and drives the community Ambassador program, blog and Youtube channel

👉 Register here 2025 was a landmark year for the platform engineering industry. With the release of the State of Platform Engineering, the State of AI in Platform Engineering, and the 2025 DORA report, the data is in on what the world of platform engineering looks like as we close out the year and enter the next. This webinar will explore the key trends from 2025, and what we can expect in 2026.

We will break down: - What the data tells us about the future of platform engineering - How the intersection of AI and platform engineering defined 2025 - Current best practices and frameworks for doing “great” platform engineering

After a 30-minute talk there’ll be a 15-minute Q&A, for which we encourage you to submit questions in advance. A webinar recording and related materials will be shared with all attendees after the event.

Speakers:

Rickey Zachary - Global Engineering Platforms Lead @ Thoughtworks For more than 15 years, Rickey has worked across both the public and private sectors, designing and developing large-scale, mission-critical software systems. He has had the opportunity to contribute to highly secure government agencies and extremely early-stage startups, both environments offering unique and interesting challenges that have shaped his career.

Sam Barlien - Head of Ecosystem @ Platform Engineering Sam Barlien is a community organiser for the Platform Engineering Community. He is a tech nerd, and has been involved in tech communities for more than 10 years. He helps manage Platform Weekly, co-hosts PlatformCon, and drives the community Ambassador program, blog and Youtube channel

👉 Register here 2025 was a landmark year for the platform engineering industry. With the release of the State of Platform Engineering, the State of AI in Platform Engineering, and the 2025 DORA report, the data is in on what the world of platform engineering looks like as we close out the year and enter the next. This webinar will explore the key trends from 2025, and what we can expect in 2026.

We will break down: - What the data tells us about the future of platform engineering - How the intersection of AI and platform engineering defined 2025 - Current best practices and frameworks for doing “great” platform engineering

After a 30-minute talk there’ll be a 15-minute Q&A, for which we encourage you to submit questions in advance. A webinar recording and related materials will be shared with all attendees after the event.

Speakers:

Rickey Zachary - Global Engineering Platforms Lead @ Thoughtworks For more than 15 years, Rickey has worked across both the public and private sectors, designing and developing large-scale, mission-critical software systems. He has had the opportunity to contribute to highly secure government agencies and extremely early-stage startups, both environments offering unique and interesting challenges that have shaped his career.

Sam Barlien - Head of Ecosystem @ Platform Engineering Sam Barlien is a community organiser for the Platform Engineering Community. He is a tech nerd, and has been involved in tech communities for more than 10 years. He helps manage Platform Weekly, co-hosts PlatformCon, and drives the community Ambassador program, blog and Youtube channel

In this landmark 100th episode of Data Unchained, host Molly Presley sits down with Jonathan Flynn, Director of Applied Systems at Hammerspace, live from Supercomputing 2025. Together they explore the performance engineering breakthroughs that enabled Hammerspace and Samsung to deliver a historic IO500 10 Node Production result using only standard Linux, the upstream NFSv4.2 client, and off the shelf NVMe hardware. This episode breaks down how the Hammerspace Data Platform delivered more than a 33 percent gain over earlier submissions, doubled overall bandwidth, and achieved an unprecedented 809 percent improvement in the IO Hard Read test using Samsung PM1753 Gen 5 NVMe SSDs. Jonathan explains the Linux kernel innovations, metadata advancements, IO path optimization, parallel file system breakthroughs, and multi instance file placement strategies that allowed Hammerspace to reach genuine HPC class performance without proprietary clients or custom networking. Listeners get a detailed walkthrough of the architectural differences between Research and Production IO500 submissions, the impact of metadata redundancy, the performance benefits of NFSd direct and NFS direct, the role of ZFS locking improvements, and how upstream Linux contributions directly advanced the state of HPC and AI data infrastructure. Jonathan also highlights the evolution of MLPerf benchmarking, the benefits of tier zero storage, and how Hammerspace performance engineering is unlocking new levels of efficiency and scalability for AI training, scientific workloads, and large scale analytics. This episode is essential for AI architects, HPC engineers, kernel developers, data scientists, and infrastructure leaders building the next generation of high performance data platforms. Cyberpunk by jiglr | https://soundcloud.com/jiglrmusic Music promoted by https://www.free-stock-music.com Creative Commons Attribution 3.0 Unported License https://creativecommons.org/licenses/by/3.0/deed.en_US Hosted on Acast. See acast.com/privacy for more information.

Presentation of the brand new State of AI in Platform Engineering industry report drawn from a survey of over 200 platform engineers. Topics include: how the intersection of AI and platform engineering is driving the AI revolution; is “prompt fatigue” the new cognitive overload; and the gap between AI potential and realized value.

Presentation of the brand new State of AI in Platform Engineering industry report, based on a survey of over 200 platform engineers. Sam Barlien will discuss: how AI and platform engineering intersect to drive AI-driven transformation; is 'prompt fatigue' the new cognitive overload; and the disconnect between AI potential and realized value.

Send us a text Welcome to the cozy corner of the tech world! Datatopics is your go-to spot for relaxed discussions around tech, news, data, and society. In this episode of Data Topics, we sit down with Nick Schouten — data engineer at dataroots — for a full recap of KubeCon Europe 2025 and a deep dive into the current and future state of Kubernetes. We talk through what’s actually happening in the Kubernetes ecosystem — from platform engineering trends to AI infra challenges — and why some teams are doubling down while others are stepping away. Here’s what we cover: What Kubernetes actually is, and how to explain it beyond the buzzwordWhen Kubernetes is the right choice (e.g., hybrid environments, GPU-heavy workloads) — and when it’s overkillHow teams are trying to host LLMs and AI models on Kubernetes, and the blockers they’re hitting (GPUs, complexity, cost)GitOps innovations spotted at KubeCon — like tools that convert UI clicks into Git commits for infrastructure-as-codeWhy observability is still one of Kubernetes’ biggest weaknesses, and how a wave of new startups are trying to solve itThe push to improve developer experience for ML and data teams (no more YAML overload)The debate around abstraction vs control — and how some teams are turning away from Kubernetes entirely in favor of simpler toolsWhat “vibe coding” means in an LLM-driven world, and how voice-to-code workflows are changing how we write infrastructureWhether the future of Kubernetes is more “visible and accessible,” or further under the hoodIf you're a data engineer, MLOps practitioner, platform lead, or simply trying to stay ahead of the curve in infrastructure and AI — this episode is packed with relevant insights from someone who's hands-on with both the tools and the teaching.

Summary In this episode of the Data Engineering Podcast Pete DeJoy, co-founder and product lead at Astronomer, talks about building and managing Airflow pipelines on Astronomer and the upcoming improvements in Airflow 3. Pete shares his journey into data engineering, discusses Astronomer's contributions to the Airflow project, and highlights the critical role of Airflow in powering operational data products. He covers the evolution of Airflow, its position in the data ecosystem, and the challenges faced by data engineers, including infrastructure management and observability. The conversation also touches on the upcoming Airflow 3 release, which introduces data awareness, architectural improvements, and multi-language support, and Astronomer's observability suite, Astro Observe, which provides insights and proactive recommendations for Airflow users.

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data managementData migrations are brutal. They drag on for months—sometimes years—burning through resources and crushing team morale. Datafold's AI-powered Migration Agent changes all that. Their unique combination of AI code translation and automated data validation has helped companies complete migrations up to 10 times faster than manual approaches. And they're so confident in their solution, they'll actually guarantee your timeline in writing. Ready to turn your year-long migration into weeks? Visit dataengineeringpodcast.com/datafold today for the details.Your host is Tobias Macey and today I'm interviewing Pete DeJoy about building and managing Airflow pipelines on Astronomer and the upcoming improvements in Airflow 3Interview IntroductionCan you describe what Astronomer is and the story behind it?How would you characterize the relationship between Airflow and Astronomer?Astronomer just released your State of Airflow 2025 Report yesterday and it is the largest data engineering survey ever with over 5,000 respondents. Can you talk a bit about top level findings in the report?What about the overall growth of the Airflow project over time?How have the focus and features of Astronomer changed since it was last featured on the show in 2017?Astro Observe GA’d in early February, what does the addition of pipeline observability mean for your customers? What are other capabilities similar in scope to observability that Astronomer is looking at adding to the platform?Why is Airflow so critical in providing an elevated Observability–or cataloging, or something simlar - experience in a DataOps platform? What are the notable evolutions in the Airflow project and ecosystem in that time?What are the core improvements that are planned for Airflow 3.0?What are the most interesting, innovative, or unexpected ways that you have seen Astro used?What are the most interesting, unexpected, or challenging lessons that you have learned while working on Airflow and Astro?What do you have planned for the future of Astro/Astronomer/Airflow?Contact Info LinkedInParting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?Closing Announcements Thank you for listening! Don't forget to check out our other shows. Podcast.init covers the Python language, its community, and the innovative ways it is being used. The AI Engineering Podcast is your guide to the fast-moving world of building AI systems.Visit the site to subscribe to the show, sign up for the mailing list, and read the show notes.If you've learned something or tried out a project from the show then tell us about it! Email [email protected] with your story.Links AstronomerAirflowMaxime BeaucheminMongoDBDatabricksConfluentSparkKafkaDagsterPodcast EpisodePrefectAirflow 3The Rise of the Data Engineer blog postdbtJupyter NotebookZapiercosmos library for dbt in AirflowRuffAirflow Custom OperatorSnowflakeThe intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA