talk-data.com talk-data.com

Event

DevOps/DataOps Journey to implement a Data Platform streaming solution

2025-10-01 – 2025-10-01 Meetup Visit website ↗

Activities tracked

1

🗓 Agenda:

  • 6:00pm: Doors open
  • 6:00pm - 6:30pm: Food, Drinks & Networking
  • 6:30pm - 7:15pm: Rafael Natali, Lead DevSecOps, Marionete
  • 7:15pm - 8:00pm - Additional Q&A & Networking

💡 Speaker: Rafael Natali, Lead DevSecOps, Marionete Venkata Abburi, Lead Data Engineer, Marionete

Title of Talk: DevOps/DataOps Journey to implement a Data Platform streaming solution

Abstract: In this session, we’ll explore the real-world journey of implementing a scalable, secure, and resilient data streaming platform—from the ground up. Bridging DevOps and DataOps practices, we’ll cover how our team designed the architecture, selected the right tools (like Kafka and Kubernetes), automated deployments, and enforced data governance across environments. You'll learn how we tackled challenges like schema evolution, CI/CD for data pipelines, monitoring at scale, and team collaboration. Whether you're just starting or scaling your data platform, this talk offers practical takeaways and battle-tested lessons from the trenches of building streaming infrastructure in production.

Bio: Rafael Natali has 20 years of experience in the IT industry, specifically as a System Administrator and DevSecOps professional. Throughout his career, he has developed extensive knowledge in designing, operating, and troubleshooting solutions that prioritize scalability and reliability. Rafael is also an expert in Automation as well as Continuous Integration and Delivery. Venkata Abburi is a Big Data Engineer with 12+ years of expertise in designing and implementing large-scale data solutions. Specializing in big data technologies, ETL processes, and data pipelines, I bring a proven track record of working on end-to-end data projects—from solution conception to successful delivery.

*** DISCLAIMER NOTE: We are unable to cater for any attendees under the age of 18.

Sessions & talks

Showing 1–1 of 1 · Newest first

Search within this event →

DevOps/DataOps Journey to implement a Data Platform streaming solution

2025-10-01
talk
Rafael Natali (Marionete) , Venkata Abburi (Marionete)
Kafka Kubernetes

In this session, we’ll explore the real-world journey of implementing a scalable, secure, and resilient data streaming platform—from the ground up. Bridging DevOps and DataOps practices, we’ll cover how our team designed the architecture, selected the right tools (like Kafka and Kubernetes), automated deployments, and enforced data governance across environments. You'll learn how we tackled challenges like schema evolution, CI/CD for data pipelines, monitoring at scale, and team collaboration. Whether you're just starting or scaling your data platform, this talk offers practical takeaways and battle-tested lessons from the trenches of building streaming infrastructure in production.