Dev → Test → Prod promotion, and WHY pipelines beat manual deployments (one click, no errors)
talk-data.com
Topic
ci/cd
28
tagged
Activity Trend
Top Events
Dev → Test → Prod promotion; pipelines beat manual deployments.
Dev → Test → Prod promotion; CI/CD pipelines that replace manual deployments with one-click reliability.
Ditch the hand-cranked Word specs and kill your documentation debt for good. In this 45-minute demo you’ll see the Power Platform Documentation Extension turn every pipeline run into living, version-controlled docs—complete with ER-diagrams, data dictionaries, security-role matrices, option-set tables and workflow summaries. We’ll wire the extension into Azure DevOps, commit Markdown/Branded Word Documents artefacts back to Git. By session-end you’ll have a reusable YAML snippet that can be added to any Power Platform CI/CD flow.
JAX is a key framework for LLM development, offering composable function transformations and a powerful bridge between low-level compilers and high-level code. To help address the challenges of moving from development to large-scale production, this talk introduces JAX-Toolbox, an open-source project that provides a robust foundation for the LLM development lifecycle. The session covers the CI/CD architecture that provides a stable foundation for JAX-based frameworks, how to build GPU-optimized containers for LLM frameworks such as MaxText and AXLearn to ensure reproducible workflows, and practical methods for deploying frameworks' containers on Kubernetes and SLURM-based clusters.
Microsoft Fabric is transforming how organizations build unified data platforms for analytics, data science, and business intelligence. Until recently, deploying and managing Fabric resources required manual effort or ad hoc automation. That changed with the release of the Terraform provider for Microsoft Fabric last year, enabling teams to manage Fabric infrastructure as code. In this session, you'll learn how to get started using Terraform to provision and manage Microsoft Fabric components — including workspaces, pipelines, dataflows, and more — in a repeatable and scalable way. Aimed at data engineers, cloud architects, and DevOps professionals, we'll cover core Terraform concepts, walk through practical examples, and share best practices for integrating with Azure and CI/CD workflows. By the end of the session, you'll be equipped to bring automation, consistency, and governance to your Microsoft Fabric environments using Terraform.
Are you tired of manual and failing dbt deployments? This talk explores how CI/CD and IaC can revolutionize your data transformation workflows, enhancing collaboration and data quality within your dbt projects. Learn the core concepts of CI/CD, including automated testing and deployment pipelines, I will guide you through building a CI/CD pipeline for dbt, triggering it with code changes and running comprehensive tests. Next to that we will dive into Infrastructure as Code (IaC) and how it automates dbt Cloud deployments using tools like Terraform. You will gain practical knowledge for automating dbt Cloud resources, projects, and environments. As a bonus we will do a sneak peek into the recently announced dbt Fusion engine.
An in-depth talk by Orell Garten on how his background in high-precision electromagnetic simulations informs rapid prototyping, automation, and production-grade data pipelines. Topics include Simulation Foundations, Rapid MVPs, Production Checklist (CI/CD, monitoring, schema versioning), and Workflow Automation.
Jonah will walk through his experience helping migrate a legacy enterprise system from stored procedures to a microservices architecture. Early in the project, they introduced SonarQube to improve code quality and surface security concerns during the POC phase leading them to reevaluate some of their initial architectural choices. Jonah will share how they integrated SonarQube into their CI, how it shaped their dev process, and what he learned from digging through the codebase to clean up smells and reduce tech debt! Key Takeaways: 1. Practical lessons from cleaning up real-world code smells and vulnerabilities manually as part of a growing team. 2. How to integrate SonarQube into a CI/CD pipeline for a microservices project and what impact it actually has on code quality. 3. Using SonarQube for POC work benefits as a design feedback tool, not just a cleanup tool.
In today’s fast-evolving tech landscape, automation is no longer just about writing test scripts. It’s about building a strategy that scales across services, teams, and time. In this session, Ronak Ray breaks down how modern QA teams can move from patchwork testing to future-ready automation architectures. Learn how to design modular, API-first frameworks, reduce test flakiness, align coverage with risk—and most importantly, how to harness AI to generate, prioritize, and self-heal tests. This is the new blueprint for automation: faster, smarter, and scalable.
how do you automate data inputs, retraining, or model monitoring?
In this talk, we’ll share how Compass successfully transitioned to using Bazel for its iOS app with zero downtime, significantly improving build performance, CI/CD speeds, and developer experience. You'll hear about the technical challenges we faced during the migration, the solutions that worked (and why), and the strategies that helped us keep everything running smoothly while moving fast.
Setting up a CI/CD isn't rocket science, but optimizing your workflows for the best results can be a challenge. In this talk Kevin will discuss some of the top tips he's come across working in the CI/CD space for the last 5 years. This will cover topics as installing custom software, memory issues, caching, DRY scripting, app store tricks, build versioning, and more. Kevin has been working in the CI/CD space for over 5 years at Codemagic.io, previously as a mobile application developer. In his day-to-day, Kevin works with Codemagic customers to help them get started and debug issues. This often leads to trying new things and learning about all the ways your pipelines can fail, but also discovering new ways that they can be improved. In his free time he enjoys long walks, playing guitar and iOS code signing.
Workshop on Policy as Code (PaC) transforming traditional manual compliance into automated, version-controlled guardrails. Topics include writing custom policies, integrating PaC into CI/CD pipelines, and establishing automated enforcement mechanisms.
Join this in-depth session on automated testing in the Power Platform. Learn how to address common challenges, insights into approaches to test and monitor solutions, how to build robust applications, integrate quality gates into CI/CD, and how to apply engineering excellence principles to both code-first and low-code development.
How we tackle infrastructure migrations at scale, with hundreds of services and dozens of dev teams; Changing culture to aid teams in using the new tooling; DevX practices and tooling for team onboarding and self-service; Internally developed tools to keep on-call rotation manageable during and beyond the migration process.
In this talk, I’ll briefly introduce the Continuous Delivery Foundation (CDF), part of the Linux Foundation, which focuses on improving CI/CD practices. I’ll share a bit about CDF’s mission to support open-source projects like Jenkins and Tekton, which play a crucial role in software delivery. We’ll also touch on the Foundation's values, such as collaboration, open governance, and the belief that Continuous Delivery helps teams build better software faster.
Migrations are often motivated by reliability, but can also harm reliability if not done with care. Tom will explore several migrations he led over the past few years, including moving 2000+ jobs to Nomad, subsequently containerizing 2600 and moving to an HA setup with RabbitMQ. We will discuss what went well and what went wrong in each instance, and how we applied what we learned to improve our migration competency.