In this session, we’ll explore the real-world journey of implementing a scalable, secure, and resilient data streaming platform—from the ground up. Bridging DevOps and DataOps practices, we’ll cover how our team designed the architecture, selected the right tools (like Kafka and Kubernetes), automated deployments, and enforced data governance across environments. You'll learn how we tackled challenges like schema evolution, CI/CD for data pipelines, monitoring at scale, and team collaboration. Whether you're just starting or scaling your data platform, this talk offers practical takeaways and battle-tested lessons from the trenches of building streaming infrastructure in production.
talk-data.com
R
Speaker
Rafael Natali
1
talks
Lead DevSecOps
Marionete
Rafael Natali has 20 years of experience in the IT industry, specifically as a System Administrator and DevSecOps professional. He has developed extensive knowledge in designing, operating, and troubleshooting solutions that prioritize scalability and reliability. He is also an expert in Automation as well as Continuous Integration and Delivery.
Bio from: I Fought the Pod and the Pod Won: Breaking and Defending Kubernetes from Within
Filtering by:
DevOps/DataOps Journey to implement a Data Platform streaming solution
×
Filter by Event / Source
Talks & appearances
Showing 1 of 2 activities