talk-data.com
Activities & events
| Title & Speakers | Event |
|---|---|
|
Mehreen Tahir
– Software Engineer
@ New Relic
By leveraging tools like Jaeger and New Relic, we will uncover how to gain a full view of your microservices, even in the face of Apache Kafka's asynchronous nature. Join us for a live demo with a simple Java Spring-Boot app, where we will walk through both automatic and manual instrumentation to capture rich telemetry. We will also touch on infrastructure-level observability, pulling metrics and traces from Apache Kafka brokers and Apache Flink. |
IN PERSON: Apache Kafka x Apache Flink
|
|
Mehreen Tahir
– Software Engineer
@ New Relic
By leveraging tools like Jaeger and New Relic, we’ll uncover how to gain a full view of your microservices, even in the face of Apache Kafka’s asynchronous nature. Join us for a live demo with a simple Java Spring-Boot app, where we’ll walk through both automatic and manual instrumentation to capture rich telemetry. We’ll also touch on infrastructure-level observability, pulling metrics and traces from Apache Kafka brokers and Apache Flink. |
IN-PERSON: Apache Kafka® x Apache Flink® Meetup
|
|
In-PERSON: Apache Kafka® x Kong Meetup in London
2025-03-27 · 18:00
Join us for an Apache Kafka® x Kong meetup on Thursday, March 27th from 6:00pm in London hosted by TurinTech AI! 📍Venue: TurinTech AI 1 Finsbury Ave, City of London, London EC2M 2PF · London IMPORTANT: If you RSVP on the this page, you don't need to RSVP on Kong London meetup page. 🗓 Agenda:
💡 Speaker One: Johannes Brännström, Staff Solutions Engineer, Kong Title of Talk: Extending the worlds most used API platform to Kafka -- Why it matters, what's here today, what's coming and how to learn more. Abstract: In this talk, we’ll explore how Kong facilitates the way Kafka users interact with both synchronous and asynchronous APIs. Through the lens of example companies, we'll showcase how Kong helps manage and optimize their API ecosystems, balancing the needs for real-time event streaming with traditional API patterns. Attendees will gain an understanding of Kong’s current capabilities for Kafka integration, highlighting key features that enable smooth API management, enhanced scalability, and reliability. We'll also offer ways for you to get first-hand experience. Looking ahead, we’ll share exciting developments on the horizon, including upcoming features, enhancements that will further empower Kafka users as well as learn more. Bio: Joining Kong from MongoDB & Red Hat Johannes is passionate about agile, modern application architecture and continuous delivery in all areas required to build great software. 💡 Speaker Two: Harry Kimpel, Principal Developer Relations Engineer, New Relic Title of Talk: Unlock full end-to-end tracing through Kong and Kafka with OpenTelemetry Abstract: Ideally, you should be using distributed tracing to trace requests through your system, but Kafka decouples producers and consumers, which means there are no direct transactions to trace between them. Kafka also uses asynchronous processes, which have implicit, not explicit, dependencies. Another key component of such an architecture is securing and exposing endpoints with a powerful platform such as Kong. All of this makes it challenging to understand how your microservices are working together. However, it is possible to observe your Kong Gateway interactions and Kafka-based applications with distributed tracing and OpenTelemetry. You can then analyze and visualize your traces in an open source distributed tracing tool like Jaeger or a full observability platform like New Relic. In this talk I will leverage a simple application to show how you can achieve this. Bio: Passionate software craftsman with 25+ years experience in a broad spectrum of development technologies and platforms. Mostly focusing on .NET/C#, the Microsoft development stack and cloud-native software architectures. Key focus also on Microsoft Azure as well as Amazon Web Services (AWS) and Google Cloud Platform (GCP). Observability, monitoring and securing these environments are key aspects. Currently extremely interested in the Distributed Application Runtime (Dapr). *** DISCLAIMER NOTE: We are unable to cater for any attendees under the age of 18. If you would like to speak or host our next event please let us know! [email protected] |
In-PERSON: Apache Kafka® x Kong Meetup in London
|
|
IN PERSON: Apache Kafka® x Kong meetup
2025-03-27 · 18:00
Join us for an Apache Kafka® x Kong meetup on Thursday, March 27th from 6:00pm in London hosted by TurinTech AI! Venue: TurinTech AI, 1 Finsbury Ave, City of London, London EC2M 2PF · London Agenda:
Title of Talk 1: Extending the worlds most used API platform to Kafka -- Why it matters, what's here today, what's coming and how to learn more. Abstract: In this talk, we’ll explore how Kong facilitates the way Kafka users interact with both synchronous and asynchronous APIs. Through the lens of example companies, we'll showcase how Kong helps manage and optimize their API ecosystems, balancing the needs for real-time event streaming with traditional API patterns. Attendees will gain an understanding of Kong’s current capabilities for Kafka integration, highlighting key features that enable smooth API management, enhanced scalability, and reliability. We'll also offer ways for you to get first-hand experience. Looking ahead, we’ll share exciting developments on the horizon, including upcoming features, enhancements that will further empower Kafka users as well as learn more. Speaker One: Bio: Johannes Brännström, Staff Solutions Engineer, Kong. Joining Kong from MongoDB & Red Hat Johannes is passionate about agile, modern application architecture and continuous delivery in all areas required to build great software Title of Talk 2: Unlock full end-to-end tracing through Kong and Kafka with OpenTelemetry Abstract: Ideally, you should be using distributed tracing to trace requests through your system, but Kafka decouples producers and consumers, which means there are no direct transactions to trace between them. Kafka also uses asynchronous processes, which have implicit, not explicit, dependencies. Another key component of such an architecture is securing and exposing endpoints with a powerful platform such as Kong. All of this makes it challenging to understand how your microservices are working together. However, it is possible to observe your Kong Gateway interactions and Kafka-based applications with distributed tracing and OpenTelemetry. You can then analyze and visualize your traces in an open source distributed tracing tool like Jaeger or a full observability platform like New Relic. In this talk I will leverage a simple application to show how you can achieve this. Speaker Two Bio: Harry Kimpel, Principal Developer Relations Engineer, New Relic. Passionate software craftsman with 25+ years experience in a broad spectrum of development technologies and platforms. Mostly focusing on .NET/C#, the Microsoft development stack and cloud-native software architectures. Key focus also on Microsoft Azure as well as Amazon Web Services (AWS) and Google Cloud Platform (GCP). Observability, monitoring and securing these environments are key aspects. Currently extremely interested in the Distributed Application Runtime (Dapr). |
IN PERSON: Apache Kafka® x Kong meetup
|
|
In-PERSON: Apache Kafka® x Kong Meetup in London
2025-03-27 · 18:00
We are thrilled to welcome you to our in-person Meetup in London in collaboration with Confluent! The event will be hosted by TurinTech AI. When March 27, 18:00 - 21:00 Where 1 Finsbury Ave, London EC2M 2PF Agenda 18:00 - 18:30 Doors open 18:00 - 18:30 Food & Drinks and Networking 18:30 - 19:00 TurinTech AI / Welcome 19:00 - 19:45 [Talk 1] Extending the worlds most used API platform to Kafka -- Why it matters, what's here today, what's coming and how to learn more by Johannes Brännström (Staff Solutions Engineer, Kong) 19:45 - 20:30 [Talk 2] Unlock full end-to-end tracing through Kong and Kafka with OpenTelemetry from Harry Kimpel (Principal Developer Relations Engineer, New Relic) 20:30 - 21:00 Additional Q&A and Networking Talks 1) Extending the worlds most used API platform to Kafka -- Why it matters, what's here today, what's coming and how to learn more In this talk, we’ll explore how Kong facilitates the way Kafka users interact with both synchronous and asynchronous APIs. Through the lens of example companies, we'll showcase how Kong helps manage and optimize their API ecosystems, balancing the needs for real-time event streaming with traditional API patterns. Attendees will gain an understanding of Kong’s current capabilities for Kafka integration, highlighting key features that enable smooth API management, enhanced scalability, and reliability. We'll also offer ways for you to get first-hand experience. Looking ahead, we’ll share exciting developments on the horizon, including upcoming features, enhancements that will further empower Kafka users as well as learn more. 2) Unlock full end-to-end tracing through Kong and Kafka with OpenTelemetry Ideally, you should be using distributed tracing to trace requests through your system, but Kafka decouples producers and consumers, which means there are no direct transactions to trace between them. Kafka also uses asynchronous processes, which have implicit, not explicit, dependencies. Another key component of such an architecture is securing and exposing endpoints with a powerful platform such as Kong. All of this makes it challenging to understand how your microservices are working together. However, it is possible to observe your Kong Gateway interactions and Kafka-based applications with distributed tracing and OpenTelemetry. You can then analyze and visualize your traces in an open source distributed tracing tool like Jaeger or a full observability platform like New Relic. In this talk I will leverage a simple application to show how you can achieve this. Speakers Johannes Brännström (Staff Solutions Engineer, Kong) Joining Kong from MongoDB & Red Hat Johannes is passionate about agile, modern application architecture and continuous delivery in all areas required to build great software.highly available. Harry Kimpel (Principal Developer Relations Engineer, New Relic) Passionate software craftsman with 25+ years experience in a broad spectrum of development technologies and platforms. Mostly focusing on .NET/C#, the Microsoft development stack and cloud-native software architectures. Key focus also on Microsoft Azure as well as Amazon Web Services (AWS) and Google Cloud Platform (GCP). Observability, monitoring and securing these environments are key aspects. Currently extremely interested in the Distributed Application Runtime (Dapr). See you there! Kong Community Team By registering for this event, I understand that my personal information will be processed in accordance with Kong's Privacy Policy. |
In-PERSON: Apache Kafka® x Kong Meetup in London
|
|
Monitoring Apache Kafka®-Based Applications
2025-03-25 · 16:00
IMPORTANT: PLEASE RSVP @ https://www.meetup.com/hacktalk/events/306700830/ Harry Kimpel: By leveraging tools like Jaeger and New Relic, we’ll uncover how to gain a full view of your microservices, even in the face of Apache Kafka’s asynchronous nature. Join us for a live demo with a simple Java Spring-Boot app, where we’ll walk through both automatic and manual instrumentation to capture rich telemetry. We’ll also touch on infrastructure-level observability, pulling metrics and traces from Apache Kafka brokers and Apache Flink. This event will be held in English language! |
Monitoring Apache Kafka®-Based Applications
|
|
🌟 Session Overview 🌟 Session Name: Sentiment Analysis in Action: Building Your Real-time Pipeline Speaker: Olena Kutsenko Session Description: Monitoring and interpreting the sentiment of data records is important for a variety of use cases. However, traditional human-based methods fall short in handling huge volumes of information with the required speed and efficiency. AI, however, can address this challenge. AI is only part of the solution. We need to build a data pipeline that ingests data from various channels, processes it using AI-driven sentiment analysis models to classify the sentiment of each individual record, and prepares it to be consumed by applications for aggregation and analysis. In this session, we'll build a system using open-source technologies Apache Kafka and Apache Flink with AI models to obtain real-time sentiment from social media data. Apache Kafka's scalability ensures that no record is left behind, making it a reliable foundation for sentiment analysis. Apache Flink, with its adaptability to fluctuations in data volume and velocity, will enable the analysis of a continuous data stream using an AI model. 🚀 About Big Data and RPA 2024 🚀 Unlock the future of innovation and automation at Big Data & RPA Conference Europe 2024! 🌟 This unique event brings together the brightest minds in big data, machine learning, AI, and robotic process automation to explore cutting-edge solutions and trends shaping the tech landscape. Perfect for data engineers, analysts, RPA developers, and business leaders, the conference offers dual insights into the power of data-driven strategies and intelligent automation. 🚀 Gain practical knowledge on topics like hyperautomation, AI integration, advanced analytics, and workflow optimization while networking with global experts. Don’t miss this exclusive opportunity to expand your expertise and revolutionize your processes—all from the comfort of your home! 📊🤖✨ 📅 Yearly Conferences: Curious about the evolution of QA? Check out our archive of past Big Data & RPA sessions. Watch the strategies and technologies evolve in our videos! 🚀 🔗 Find Other Years' Videos: 2023 Big Data Conference Europe https://www.youtube.com/playlist?list=PLqYhGsQ9iSEpb_oyAsg67PhpbrkCC59_g 2022 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEryAOjmvdiaXTfjCg5j3HhT 2021 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEqHwbQoWEXEJALFLKVDRXiP 💡 Stay Connected & Updated 💡 Don’t miss out on any updates or upcoming event information from Big Data & RPA Conference Europe. Follow us on our social media channels and visit our website to stay in the loop! 🌐 Website: https://bigdataconference.eu/, https://rpaconference.eu/ 👤 Facebook: https://www.facebook.com/bigdataconf, https://www.facebook.com/rpaeurope/ 🐦 Twitter: @BigDataConfEU, @europe_rpa 🔗 LinkedIn: https://www.linkedin.com/company/73234449/admin/dashboard/, https://www.linkedin.com/company/75464753/admin/dashboard/ 🎥 YouTube: http://www.youtube.com/@DATAMINERLT |
DATA MINER Big Data Europe Conference 2020 |
|
Kafka in Action
2022-02-13
Master the wicked-fast Apache Kafka streaming platform through hands-on examples and real-world projects. In Kafka in Action you will learn: Understanding Apache Kafka concepts Setting up and executing basic ETL tasks using Kafka Connect Using Kafka as part of a large data project team Performing administrative tasks Producing and consuming event streams Working with Kafka from Java applications Implementing Kafka as a message queue Kafka in Action is a fast-paced introduction to every aspect of working with Apache Kafka. Starting with an overview of Kafka's core concepts, you'll immediately learn how to set up and execute basic data movement tasks and how to produce and consume streams of events. Advancing quickly, you’ll soon be ready to use Kafka in your day-to-day workflow, and start digging into even more advanced Kafka topics. About the Technology Think of Apache Kafka as a high performance software bus that facilitates event streaming, logging, analytics, and other data pipeline tasks. With Kafka, you can easily build features like operational data monitoring and large-scale event processing into both large and small-scale applications. About the Book Kafka in Action introduces the core features of Kafka, along with relevant examples of how to use it in real applications. In it, you’ll explore the most common use cases such as logging and managing streaming data. When you’re done, you’ll be ready to handle both basic developer- and admin-based tasks in a Kafka-focused team. What's Inside Kafka as an event streaming platform Kafka producers and consumers from Java applications Kafka as part of a large data project About the Reader For intermediate Java developers or data engineers. No prior knowledge of Kafka required. About the Authors Dylan Scott is a software developer in the insurance industry. Viktor Gamov is a Kafka-focused developer advocate. At Confluent, Dave Klein helps developers, teams, and enterprises harness the power of event streaming with Apache Kafka. Quotes The authors have had many years of real-world experience using Kafka, and this book’s on-the-ground feel really sets it apart. - From the foreword by Jun Rao, Confluent Cofounder A surprisingly accessible introduction to a very complex technology. Developers will want to keep a copy close by. - Conor Redmond, InComm Payments A comprehensive and practical guide to Kafka and the ecosystem. - Sumant Tambe, Linkedin It quickly gave me insight into how Kafka works, and how to design and protect distributed message applications. - Gregor Rayman, Cloudfarms |
|
|
Kafka Streams in Action
2018-09-19
Bill Bejeck
– author
Kafka Streams in Action teaches you everything you need to know to implement stream processing on data flowing into your Kafka platform, allowing you to focus on getting more from your data without sacrificing time or effort. About the Technology Not all stream-based applications require a dedicated processing cluster. The lightweight Kafka Streams library provides exactly the power and simplicity you need for message handling in microservices and real-time event processing. With the Kafka Streams API, you filter and transform data streams with just Kafka and your application. About the Book Kafka Streams in Action teaches you to implement stream processing within the Kafka platform. In this easy-to-follow book, you’ll explore real-world examples to collect, transform, and aggregate data, work with multiple processors, and handle real-time events. You’ll even dive into streaming SQL with KSQL! Practical to the very end, it finishes with testing and operational aspects, such as monitoring and debugging. What's Inside Using the KStreams API Filtering, transforming, and splitting data Working with the Processor API Integrating with external systems About the Reader Assumes some experience with distributed systems. No knowledge of Kafka or streaming applications required. About the Author Bill Bejeck is a Kafka Streams contributor and Confluent engineer with over 15 years of software development experience. Quotes A great way to learn about Kafka Streams and how it is a key enabler of event-driven applications. - From the Foreword by Neha Narkhede, Cocreator of Apache Kafka A comprehensive guide to Kafka Streams—from introduction to production! - Bojan Djurkovic, Cvent Bridges the gap between message brokering and real-time streaming analytics. - Jim Mantheiy Jr., Next Century Valuable both as an introduction to streams as well as an ongoing reference. - Robin Coe, TD Bank |
|