In this session, we’ll explore the real-world journey of implementing a scalable, secure, and resilient data streaming platform—from the ground up. Bridging DevOps and DataOps practices, we’ll cover how our team designed the architecture, selected the right tools (like Kafka and Kubernetes), automated deployments, and enforced data governance across environments. You'll learn how we tackled challenges like schema evolution, CI/CD for data pipelines, monitoring at scale, and team collaboration. Whether you're just starting or scaling your data platform, this talk offers practical takeaways and battle-tested lessons from the trenches of building streaming infrastructure in production.
talk-data.com
V
Speaker
Venkata Abburi
1
talks
Lead Data Engineer
Marionete
Venkata Abburi is a Big Data Engineer with 12+ years of expertise in designing and implementing large-scale data solutions. Specializing in big data technologies, ETL processes, and data pipelines, I bring a proven track record of working on end-to-end data projects—from solution conception to successful delivery.
Bio from: DevOps/DataOps Journey to implement a Data Platform streaming solution
Filter by Event / Source
Talks & appearances
1 activities · Newest first