talk-data.com talk-data.com

Topic

Flink

Apache Flink

stream_processing batch_processing big_data

6

tagged

Activity Trend

7 peak/qtr
2020-Q1 2026-Q1

Activities

Showing filtered results

Filtering by: DATA MINER Big Data Europe Conference 2020 ×
Alexey Novakov: Streamhouse Architecture with Flink and Paimon

๐ŸŒŸ Session Overview ๐ŸŒŸ

Session Name: Speaker: Alexey Novakov Session Description: Today, many data teams choose lakehouse architecture for their data platforms. But what if they process all data in streaming mode? Then they end up building a streaming lakehouse, or 'streamhouse' for short! This means they use stream processing engines to ingest, transform, and analyze business data in near real-time. However, they still want to use inexpensive storage infrastructure. How can they achieve that?

This talk introduces data teams to tools like Apache Paimon in combination with Flink. Paimon has been built with a strong focus on streaming workflows, serving as a table format in a lakehouse. It takes the stream processing approach in lakehouse architecture to the next level compared to other table formats that are more oriented towards batch data. After this talk, data teams will know how to use Paimon and Flink to build a cost-efficient and fast data layer for different data processing scenarios.

๐Ÿš€ About Big Data and RPA 2024 ๐Ÿš€

Unlock the future of innovation and automation at Big Data & RPA Conference Europe 2024! ๐ŸŒŸ This unique event brings together the brightest minds in big data, machine learning, AI, and robotic process automation to explore cutting-edge solutions and trends shaping the tech landscape. Perfect for data engineers, analysts, RPA developers, and business leaders, the conference offers dual insights into the power of data-driven strategies and intelligent automation. ๐Ÿš€ Gain practical knowledge on topics like hyperautomation, AI integration, advanced analytics, and workflow optimization while networking with global experts. Donโ€™t miss this exclusive opportunity to expand your expertise and revolutionize your processesโ€”all from the comfort of your home! ๐Ÿ“Š๐Ÿค–โœจ

๐Ÿ“… Yearly Conferences: Curious about the evolution of QA? Check out our archive of past Big Data & RPA sessions. Watch the strategies and technologies evolve in our videos! ๐Ÿš€ ๐Ÿ”— Find Other Years' Videos: 2023 Big Data Conference Europe https://www.youtube.com/playlist?list=PLqYhGsQ9iSEpb_oyAsg67PhpbrkCC59_g 2022 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEryAOjmvdiaXTfjCg5j3HhT 2021 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEqHwbQoWEXEJALFLKVDRXiP

๐Ÿ’ก Stay Connected & Updated ๐Ÿ’ก

Donโ€™t miss out on any updates or upcoming event information from Big Data & RPA Conference Europe. Follow us on our social media channels and visit our website to stay in the loop!

๐ŸŒ Website: https://bigdataconference.eu/, https://rpaconference.eu/ ๐Ÿ‘ค Facebook: https://www.facebook.com/bigdataconf, https://www.facebook.com/rpaeurope/ ๐Ÿฆ Twitter: @BigDataConfEU, @europe_rpa ๐Ÿ”— LinkedIn: https://www.linkedin.com/company/73234449/admin/dashboard/, https://www.linkedin.com/company/75464753/admin/dashboard/ ๐ŸŽฅ YouTube: http://www.youtube.com/@DATAMINERLT

Gunnar Morling: Data Contracts In Practice With Debezium and Apache Flink

๐ŸŒŸ Session Overview ๐ŸŒŸ

Session Name: Data Contracts In Practice With Debezium and Apache Flink Speaker: Gunnar Morling Session Description: Log-based change data capture (CDC) is an invaluable part of the data engineering toolbox: it enables a variety of use cases such as real-time analytics, full-text search, or cache invalidation by publishing data change events from your database. But when publishing change event streams across context or team boundaries, arenโ€™t you tying external consumers to your applicationโ€™s data model, thus limiting yourself in evolving the same?

Enter data contractsโ€”consciously designed abstractions between your internal data model and the outside world. Come and join us for this session to learn about:

Challenges you may encounter when exposing table-level change event streams and how data contracts can mitigate them Implementation strategies for data contracts, such as the outbox pattern and stream processing Evolving your data model and the corresponding data contracts without breaking any existing consumers Weโ€™ll also touch on some advanced topics at the intersection of CDC and stream processing, such as hydrating partial change events, using the popular change stream processing duo of Debezium and Apache Flink.

๐Ÿš€ About Big Data and RPA 2024 ๐Ÿš€

Unlock the future of innovation and automation at Big Data & RPA Conference Europe 2024! ๐ŸŒŸ This unique event brings together the brightest minds in big data, machine learning, AI, and robotic process automation to explore cutting-edge solutions and trends shaping the tech landscape. Perfect for data engineers, analysts, RPA developers, and business leaders, the conference offers dual insights into the power of data-driven strategies and intelligent automation. ๐Ÿš€ Gain practical knowledge on topics like hyperautomation, AI integration, advanced analytics, and workflow optimization while networking with global experts. Donโ€™t miss this exclusive opportunity to expand your expertise and revolutionize your processesโ€”all from the comfort of your home! ๐Ÿ“Š๐Ÿค–โœจ

๐Ÿ“… Yearly Conferences: Curious about the evolution of QA? Check out our archive of past Big Data & RPA sessions. Watch the strategies and technologies evolve in our videos! ๐Ÿš€ ๐Ÿ”— Find Other Years' Videos: 2023 Big Data Conference Europe https://www.youtube.com/playlist?list=PLqYhGsQ9iSEpb_oyAsg67PhpbrkCC59_g 2022 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEryAOjmvdiaXTfjCg5j3HhT 2021 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEqHwbQoWEXEJALFLKVDRXiP

๐Ÿ’ก Stay Connected & Updated ๐Ÿ’ก

Donโ€™t miss out on any updates or upcoming event information from Big Data & RPA Conference Europe. Follow us on our social media channels and visit our website to stay in the loop!

๐ŸŒ Website: https://bigdataconference.eu/, https://rpaconference.eu/ ๐Ÿ‘ค Facebook: https://www.facebook.com/bigdataconf, https://www.facebook.com/rpaeurope/ ๐Ÿฆ Twitter: @BigDataConfEU, @europe_rpa ๐Ÿ”— LinkedIn: https://www.linkedin.com/company/73234449/admin/dashboard/, https://www.linkedin.com/company/75464753/admin/dashboard/ ๐ŸŽฅ YouTube: http://www.youtube.com/@DATAMINERLT

Olena Kutsenko: Sentiment Analysis in Action: Building Your Real-time Pipeline

๐ŸŒŸ Session Overview ๐ŸŒŸ

Session Name: Sentiment Analysis in Action: Building Your Real-time Pipeline Speaker: Olena Kutsenko Session Description: Monitoring and interpreting the sentiment of data records is important for a variety of use cases. However, traditional human-based methods fall short in handling huge volumes of information with the required speed and efficiency. AI, however, can address this challenge.

AI is only part of the solution. We need to build a data pipeline that ingests data from various channels, processes it using AI-driven sentiment analysis models to classify the sentiment of each individual record, and prepares it to be consumed by applications for aggregation and analysis.

In this session, we'll build a system using open-source technologies Apache Kafka and Apache Flink with AI models to obtain real-time sentiment from social media data. Apache Kafka's scalability ensures that no record is left behind, making it a reliable foundation for sentiment analysis. Apache Flink, with its adaptability to fluctuations in data volume and velocity, will enable the analysis of a continuous data stream using an AI model.

๐Ÿš€ About Big Data and RPA 2024 ๐Ÿš€

Unlock the future of innovation and automation at Big Data & RPA Conference Europe 2024! ๐ŸŒŸ This unique event brings together the brightest minds in big data, machine learning, AI, and robotic process automation to explore cutting-edge solutions and trends shaping the tech landscape. Perfect for data engineers, analysts, RPA developers, and business leaders, the conference offers dual insights into the power of data-driven strategies and intelligent automation. ๐Ÿš€ Gain practical knowledge on topics like hyperautomation, AI integration, advanced analytics, and workflow optimization while networking with global experts. Donโ€™t miss this exclusive opportunity to expand your expertise and revolutionize your processesโ€”all from the comfort of your home! ๐Ÿ“Š๐Ÿค–โœจ

๐Ÿ“… Yearly Conferences: Curious about the evolution of QA? Check out our archive of past Big Data & RPA sessions. Watch the strategies and technologies evolve in our videos! ๐Ÿš€ ๐Ÿ”— Find Other Years' Videos: 2023 Big Data Conference Europe https://www.youtube.com/playlist?list=PLqYhGsQ9iSEpb_oyAsg67PhpbrkCC59_g 2022 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEryAOjmvdiaXTfjCg5j3HhT 2021 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEqHwbQoWEXEJALFLKVDRXiP

๐Ÿ’ก Stay Connected & Updated ๐Ÿ’ก

Donโ€™t miss out on any updates or upcoming event information from Big Data & RPA Conference Europe. Follow us on our social media channels and visit our website to stay in the loop!

๐ŸŒ Website: https://bigdataconference.eu/, https://rpaconference.eu/ ๐Ÿ‘ค Facebook: https://www.facebook.com/bigdataconf, https://www.facebook.com/rpaeurope/ ๐Ÿฆ Twitter: @BigDataConfEU, @europe_rpa ๐Ÿ”— LinkedIn: https://www.linkedin.com/company/73234449/admin/dashboard/, https://www.linkedin.com/company/75464753/admin/dashboard/ ๐ŸŽฅ YouTube: http://www.youtube.com/@DATAMINERLT

Volker Janz: Real-time Customer Engagement in Gaming Using Kafka and Flink

Join Volker Janz to unlock the magic of Real-Time Customer Engagement in gaming with Kafka and Flink, processing 1.5 billion daily events for immersive player experiences. ๐ŸŽฎโœจ #Gaming #RealTimeEngagement

โœจ H I G H L I G H T S โœจ

๐Ÿ™Œ A huge shoutout to all the incredible participants who made Big Data Conference Europe 2023 in Vilnius, Lithuania, from November 21-24, an absolute triumph! ๐ŸŽ‰ Your attendance and active participation were instrumental in making this event so special. ๐ŸŒ

Don't forget to check out the session recordings from the conference to relive the valuable insights and knowledge shared! ๐Ÿ“ฝ๏ธ

Once again, THANK YOU for playing a pivotal role in the success of Big Data Conference Europe 2023. ๐Ÿš€ See you next year for another unforgettable conference! ๐Ÿ“… #BigDataConference #SeeYouNextYear

Timothy Spann: Building Real-time Travel Alerts

Join Timothy Spann as he takes you on a journey of 'Building Real-time Travel Alerts' ๐ŸŒ๐Ÿš€. Learn how to construct a dynamic streaming application using Apache NiFi, Apache Kafka, and Apache Flink, ensuring optimal performance, productivity, and development simplicity in delivering timely travel advisories. ๐ŸŒ๐Ÿ›ซ #RealTimeAlerts #Streaming #ApacheStack

โœจ H I G H L I G H T S โœจ

๐Ÿ™Œ A huge shoutout to all the incredible participants who made Big Data Conference Europe 2023 in Vilnius, Lithuania, from November 21-24, an absolute triumph! ๐ŸŽ‰ Your attendance and active participation were instrumental in making this event so special. ๐ŸŒ

Don't forget to check out the session recordings from the conference to relive the valuable insights and knowledge shared! ๐Ÿ“ฝ๏ธ

Once again, THANK YOU for playing a pivotal role in the success of Big Data Conference Europe 2023. ๐Ÿš€ See you next year for another unforgettable conference! ๐Ÿ“… #BigDataConference #SeeYouNextYear