talk-data.com
Topic
Flink
Apache Flink
6
tagged
Activity Trend
Top Events
๐ Session Overview ๐
Session Name: Speaker: Alexey Novakov Session Description: Today, many data teams choose lakehouse architecture for their data platforms. But what if they process all data in streaming mode? Then they end up building a streaming lakehouse, or 'streamhouse' for short! This means they use stream processing engines to ingest, transform, and analyze business data in near real-time. However, they still want to use inexpensive storage infrastructure. How can they achieve that?
This talk introduces data teams to tools like Apache Paimon in combination with Flink. Paimon has been built with a strong focus on streaming workflows, serving as a table format in a lakehouse. It takes the stream processing approach in lakehouse architecture to the next level compared to other table formats that are more oriented towards batch data. After this talk, data teams will know how to use Paimon and Flink to build a cost-efficient and fast data layer for different data processing scenarios.
๐ About Big Data and RPA 2024 ๐
Unlock the future of innovation and automation at Big Data & RPA Conference Europe 2024! ๐ This unique event brings together the brightest minds in big data, machine learning, AI, and robotic process automation to explore cutting-edge solutions and trends shaping the tech landscape. Perfect for data engineers, analysts, RPA developers, and business leaders, the conference offers dual insights into the power of data-driven strategies and intelligent automation. ๐ Gain practical knowledge on topics like hyperautomation, AI integration, advanced analytics, and workflow optimization while networking with global experts. Donโt miss this exclusive opportunity to expand your expertise and revolutionize your processesโall from the comfort of your home! ๐๐คโจ
๐ Yearly Conferences: Curious about the evolution of QA? Check out our archive of past Big Data & RPA sessions. Watch the strategies and technologies evolve in our videos! ๐ ๐ Find Other Years' Videos: 2023 Big Data Conference Europe https://www.youtube.com/playlist?list=PLqYhGsQ9iSEpb_oyAsg67PhpbrkCC59_g 2022 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEryAOjmvdiaXTfjCg5j3HhT 2021 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEqHwbQoWEXEJALFLKVDRXiP
๐ก Stay Connected & Updated ๐ก
Donโt miss out on any updates or upcoming event information from Big Data & RPA Conference Europe. Follow us on our social media channels and visit our website to stay in the loop!
๐ Website: https://bigdataconference.eu/, https://rpaconference.eu/ ๐ค Facebook: https://www.facebook.com/bigdataconf, https://www.facebook.com/rpaeurope/ ๐ฆ Twitter: @BigDataConfEU, @europe_rpa ๐ LinkedIn: https://www.linkedin.com/company/73234449/admin/dashboard/, https://www.linkedin.com/company/75464753/admin/dashboard/ ๐ฅ YouTube: http://www.youtube.com/@DATAMINERLT
๐ Session Overview ๐
Session Name: Data Contracts In Practice With Debezium and Apache Flink Speaker: Gunnar Morling Session Description: Log-based change data capture (CDC) is an invaluable part of the data engineering toolbox: it enables a variety of use cases such as real-time analytics, full-text search, or cache invalidation by publishing data change events from your database. But when publishing change event streams across context or team boundaries, arenโt you tying external consumers to your applicationโs data model, thus limiting yourself in evolving the same?
Enter data contractsโconsciously designed abstractions between your internal data model and the outside world. Come and join us for this session to learn about:
Challenges you may encounter when exposing table-level change event streams and how data contracts can mitigate them Implementation strategies for data contracts, such as the outbox pattern and stream processing Evolving your data model and the corresponding data contracts without breaking any existing consumers Weโll also touch on some advanced topics at the intersection of CDC and stream processing, such as hydrating partial change events, using the popular change stream processing duo of Debezium and Apache Flink.
๐ About Big Data and RPA 2024 ๐
Unlock the future of innovation and automation at Big Data & RPA Conference Europe 2024! ๐ This unique event brings together the brightest minds in big data, machine learning, AI, and robotic process automation to explore cutting-edge solutions and trends shaping the tech landscape. Perfect for data engineers, analysts, RPA developers, and business leaders, the conference offers dual insights into the power of data-driven strategies and intelligent automation. ๐ Gain practical knowledge on topics like hyperautomation, AI integration, advanced analytics, and workflow optimization while networking with global experts. Donโt miss this exclusive opportunity to expand your expertise and revolutionize your processesโall from the comfort of your home! ๐๐คโจ
๐ Yearly Conferences: Curious about the evolution of QA? Check out our archive of past Big Data & RPA sessions. Watch the strategies and technologies evolve in our videos! ๐ ๐ Find Other Years' Videos: 2023 Big Data Conference Europe https://www.youtube.com/playlist?list=PLqYhGsQ9iSEpb_oyAsg67PhpbrkCC59_g 2022 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEryAOjmvdiaXTfjCg5j3HhT 2021 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEqHwbQoWEXEJALFLKVDRXiP
๐ก Stay Connected & Updated ๐ก
Donโt miss out on any updates or upcoming event information from Big Data & RPA Conference Europe. Follow us on our social media channels and visit our website to stay in the loop!
๐ Website: https://bigdataconference.eu/, https://rpaconference.eu/ ๐ค Facebook: https://www.facebook.com/bigdataconf, https://www.facebook.com/rpaeurope/ ๐ฆ Twitter: @BigDataConfEU, @europe_rpa ๐ LinkedIn: https://www.linkedin.com/company/73234449/admin/dashboard/, https://www.linkedin.com/company/75464753/admin/dashboard/ ๐ฅ YouTube: http://www.youtube.com/@DATAMINERLT
๐ Session Overview ๐
Session Name: Sentiment Analysis in Action: Building Your Real-time Pipeline Speaker: Olena Kutsenko Session Description: Monitoring and interpreting the sentiment of data records is important for a variety of use cases. However, traditional human-based methods fall short in handling huge volumes of information with the required speed and efficiency. AI, however, can address this challenge.
AI is only part of the solution. We need to build a data pipeline that ingests data from various channels, processes it using AI-driven sentiment analysis models to classify the sentiment of each individual record, and prepares it to be consumed by applications for aggregation and analysis.
In this session, we'll build a system using open-source technologies Apache Kafka and Apache Flink with AI models to obtain real-time sentiment from social media data. Apache Kafka's scalability ensures that no record is left behind, making it a reliable foundation for sentiment analysis. Apache Flink, with its adaptability to fluctuations in data volume and velocity, will enable the analysis of a continuous data stream using an AI model.
๐ About Big Data and RPA 2024 ๐
Unlock the future of innovation and automation at Big Data & RPA Conference Europe 2024! ๐ This unique event brings together the brightest minds in big data, machine learning, AI, and robotic process automation to explore cutting-edge solutions and trends shaping the tech landscape. Perfect for data engineers, analysts, RPA developers, and business leaders, the conference offers dual insights into the power of data-driven strategies and intelligent automation. ๐ Gain practical knowledge on topics like hyperautomation, AI integration, advanced analytics, and workflow optimization while networking with global experts. Donโt miss this exclusive opportunity to expand your expertise and revolutionize your processesโall from the comfort of your home! ๐๐คโจ
๐ Yearly Conferences: Curious about the evolution of QA? Check out our archive of past Big Data & RPA sessions. Watch the strategies and technologies evolve in our videos! ๐ ๐ Find Other Years' Videos: 2023 Big Data Conference Europe https://www.youtube.com/playlist?list=PLqYhGsQ9iSEpb_oyAsg67PhpbrkCC59_g 2022 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEryAOjmvdiaXTfjCg5j3HhT 2021 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEqHwbQoWEXEJALFLKVDRXiP
๐ก Stay Connected & Updated ๐ก
Donโt miss out on any updates or upcoming event information from Big Data & RPA Conference Europe. Follow us on our social media channels and visit our website to stay in the loop!
๐ Website: https://bigdataconference.eu/, https://rpaconference.eu/ ๐ค Facebook: https://www.facebook.com/bigdataconf, https://www.facebook.com/rpaeurope/ ๐ฆ Twitter: @BigDataConfEU, @europe_rpa ๐ LinkedIn: https://www.linkedin.com/company/73234449/admin/dashboard/, https://www.linkedin.com/company/75464753/admin/dashboard/ ๐ฅ YouTube: http://www.youtube.com/@DATAMINERLT
Join Volker Janz to unlock the magic of Real-Time Customer Engagement in gaming with Kafka and Flink, processing 1.5 billion daily events for immersive player experiences. ๐ฎโจ #Gaming #RealTimeEngagement
โจ H I G H L I G H T S โจ
๐ A huge shoutout to all the incredible participants who made Big Data Conference Europe 2023 in Vilnius, Lithuania, from November 21-24, an absolute triumph! ๐ Your attendance and active participation were instrumental in making this event so special. ๐
Don't forget to check out the session recordings from the conference to relive the valuable insights and knowledge shared! ๐ฝ๏ธ
Once again, THANK YOU for playing a pivotal role in the success of Big Data Conference Europe 2023. ๐ See you next year for another unforgettable conference! ๐ #BigDataConference #SeeYouNextYear
Join Timothy Spann as he takes you on a journey of 'Building Real-time Travel Alerts' ๐๐. Learn how to construct a dynamic streaming application using Apache NiFi, Apache Kafka, and Apache Flink, ensuring optimal performance, productivity, and development simplicity in delivering timely travel advisories. ๐๐ซ #RealTimeAlerts #Streaming #ApacheStack
โจ H I G H L I G H T S โจ
๐ A huge shoutout to all the incredible participants who made Big Data Conference Europe 2023 in Vilnius, Lithuania, from November 21-24, an absolute triumph! ๐ Your attendance and active participation were instrumental in making this event so special. ๐
Don't forget to check out the session recordings from the conference to relive the valuable insights and knowledge shared! ๐ฝ๏ธ
Once again, THANK YOU for playing a pivotal role in the success of Big Data Conference Europe 2023. ๐ See you next year for another unforgettable conference! ๐ #BigDataConference #SeeYouNextYear