In this session, see how meshIQ, a comprehensive management and observability platform for messaging and event streaming technologies like Kafka, RabbitMQ and IBM MQ, can be used to track application message flows, help identify bottlenecks and locate "missing" messages.

In this session, see how meshIQ, a comprehensive management and observability platform for messaging and event streaming technologies like Kafka, RabbitMQ and IBM MQ, can be used to track application message flows, help identify bottlenecks and locate missing messages.

Python is at the core of our analytics platform, which processes over 8,000 game records daily, each approximately 500 MB in size. Over the past two years, we have accumulated more than 200 TB of data, equivalent to 1,600 years of game time from over 7 million players—and our goal is to increase this user count tenfold. This talk will cover how we transitioned from Go and C++ parsers connected via PyBind to data frames in Python, how our analyses evolved from Pandas to Polars, and why we migrated our backend from Django to FastAPI. Finally, we will share our real-world experience with performance optimization, leveraging RabbitMQ, Redis, and process monitoring in an environment where Python bridges the worlds of game data and AI analysis.

Migrations are often motivated by reliability, but can also harm reliability if not done with care. Tom will explore several migrations he led over the past few years, including moving 2000+ jobs to Nomad, subsequently containerizing 2600 and moving to an HA setup with RabbitMQ. We will discuss what went well and what went wrong in each instance, and how we applied what we learned to improve our migration competency.

Un nombre croissant d'applications s'appuient sur Kafka pour sa fiabilité et le haut débit de son traitement des flux d'événements, dans des cas d'utilisation allant de l'analyse des flux de clics à l'intégration d'applications et à l'analyse en temps réel des données en mouvement. Alors que l'adoption de Kafka par les entreprises continue de croître, 90 % des implémentations nécessitent que Kafka fonctionne avec d'autres technologies de messagerie telles qu'IBM MQ, RabbitMQ, ActiveMQ et autres. Comment obtenir une visibilité et une surveillance de bout en bout pour les transactions couvrant les technologiques aussi diverses ? Dans cette présentation, nous discuterons des moyens d'assurer l'observabilité et la gestion d'infrastructures complexes de messagerie et de streaming afin d’éliminer les temps d'arrêt, fournir des topologies de flux de messages d'applications et le lignage des données.

Discover how to power your distributed and scalable applications using RabbitMQ in "RabbitMQ Essentials". This book provides a detailed journey into understanding and implementing message queuing architectures, guiding you from the basics through advanced techniques. Through a realistic case study, you'll gain the skills necessary to succeed with RabbitMQ. What this Book will help me do Understand the core concepts and architecture of RabbitMQ and message queuing. Learn how to configure and use RabbitMQ, including installation and plugin management. Master the use of channels, routing strategies, and exchange types for optimized message delivery. Apply strategies for ensuring message queue scalability and robust fault-tolerance. Gain insights and best practices directly from RabbitMQ experts for production-level deployment. Author(s) None Johansson and David Dossot bring a wealth of experience managing and deploying systems based on RabbitMQ. As part of CloudAMQP, they oversee the largest RabbitMQ installations globally. This book reflects their dedication to helping developers succeed with message queuing technology. Who is it for? This book is perfectly suited for developers and software engineers interested in designing scalable and distributed applications. Whether you're new to RabbitMQ or already familiar with microservices and message queuing, "RabbitMQ Essentials" provides clear guidance and real-world insights. Beginners will appreciate its accessible approach, while advanced developers will value its comprehensive coverage and best practices.

RabbitMQ in Depth is a practical guide to building and maintaining message-based applications. This book provides detailed coverage of RabbitMQ with an emphasis on why it works the way it does. You'll find examples and detailed explanations based in real-world systems ranging from simple networked services to complex distributed designs. You'll also find the insights you need to make core architectural choices and develop procedures for effective operational management. About the Technology At the heart of most modern distributed applications is a queue that buffers, prioritizes, and routes message traffic. RabbitMQ is a high-performance message broker based on the Advanced Message Queueing Protocol. It's battle tested, ultrafast, and powerful enough to handle anything you can throw at it. It requires a few simple setup steps, and you can instantly start using it to manage low-level service communication, application integration, and distributed system message routing. About the Book What's Inside AMQP, the Advanced Message Queueing Protocol Communicating via MQTT, Stomp, and HTTP Valuable troubleshooting techniques Database integration About the Reader Written for programmers with a basic understanding of messaging-oriented systems. About the Author Gavin M. Roy is an active, open source evangelist and advocate who has been working with internet and enterprise technologies since the mid-90s. Technical editor James Titcumb is a freelance developer, trainer, speaker, and active contributor to open source projects. Quotes An excellent resource for beginners and experts alike...shows how to integrate RabbitMQ into a successful enterprise application. - Ian Dallas, Hewlett-Packard The most comprehensive source for everything RabbitMQ. From terms to code to patterns, it's all here! - Andrew Meredith, Quantum Metric A cheat sheet for getting started and troubleshooting the migration process to RabbitMQ. - Nadia Noori, La Salle University Barcelona Filled with pragmatic advice and pearls of wisdom. - Milos Milivojevic, Mozzart Bet

Dive into the world of MQTT, the preferred protocol for IoT and M2M communication. This book provides a comprehensive guide to understanding, implementing, and securing MQTT-based systems, enabling readers to create efficient and lightweight communication networks for their connected devices. What this Book will help me do Understand the underlying principles and protocol structure of MQTT. Securely configure and deploy an MQTT broker for communication. Develop Python, Java, and JavaScript-based MQTT client applications. Utilize MQTT for real-world IoT use cases such as sensor data interchange. Optimize MQTT usage for low-latency and lightweight communication scenarios. Author(s) Gastón C. Hillar is an experienced IoT developer and author with a deep understanding of IoT protocols and technologies. With years of practical experience in designing and deploying secure IoT systems, Gastón specializes in breaking down complex topics into digestible and actionable insights. Through his books, he aims to empower developers to effectively integrate IoT technologies into their work. Who is it for? The book is tailored for software developers and engineers who are looking to integrate MQTT into their IoT solutions. It's ideal for individuals with pre-existing knowledge in IoT concepts who want to deepen their understanding of MQTT. Readers seeking to secure, optimize, and utilize MQTT for communication and automation tasks will find it especially useful. It's a perfect fit for those working with Python, Java, and web technologies in IoT contexts.

Mastering RabbitMQ provides a comprehensive guide to developing and scaling message-driven applications using RabbitMQ. From installation and configuration to advanced concepts like cluster management and high availability, this book equips you with the knowledge and practical skills to ensure robust and efficient messaging solutions. What this Book will help me do Effectively set up and configure RabbitMQ for scalable applications. Implement robust messaging solutions using RabbitMQ's administrative tools. Leverage clustering and high availability for fault-tolerant systems. Create custom RabbitMQ plugins using Erlang for extended capabilities. Monitor and secure RabbitMQ environments leveraging popular tools and practices. Author(s) Yusuf Aytas and the co-authors bring a wealth of technical knowledge and practical experience in messaging systems and RabbitMQ. With years of expertise in software engineering and hands-on implementations in enterprise environments, they provide insights that combine theory with real-world application. Who is it for? This book is ideal for developers and IT professionals with basic knowledge of RabbitMQ seeking to master advanced usage and best practices. It caters to those looking to design, develop, and maintain robust messaging systems efficiently. Perfect for those with a background in message queuing, it provides an in-depth understanding to take your expertise to the next level.

Learning RabbitMQ offers developers and system administrators a clear and practical guide to mastering RabbitMQ, the popular message-broker solution. By going through concrete scenarios and examples, this book equips you with the skills to configure, manage, and optimize RabbitMQ instances effectively. What this Book will help me do Understand and apply common messaging patterns using RabbitMQ. Set up and manage RabbitMQ clusters with high availability. Integrate RabbitMQ with popular tools like Spring, MuleESB, and Docker. Optimize RabbitMQ performance and ensure secure messaging. Troubleshoot and extend RabbitMQ for different use cases. Author(s) None Toshev, the author of Learning RabbitMQ, is an expert in middleware and distributed systems, with extensive hands-on experience working with message brokers. Toshev's practical approach and clear explanations make complex topics easy to understand, helping readers effectively apply best practices when using RabbitMQ. Who is it for? This book is for developers and system administrators who aim to incorporate RabbitMQ as part of their applications. Beginners with a basic understanding of messaging will find it foundational, while experienced users will appreciate the advanced insights on integration, performance tuning, and troubleshooting.

RabbitMQ Essentials provides a comprehensive introduction to RabbitMQ, a versatile message broker solution frequently used in distributed systems. Through a clear set of examples and practical exercises, readers will gain the skills needed to start building robust messaging applications. What this Book will help me do Understand the core concepts and architecture of RabbitMQ. Learn how to set up RabbitMQ and develop messaging applications. Master sending, receiving, and routing messages effectively with RabbitMQ exchanging types such as direct, topic, and fanout. Implement robust error handling and monitoring mechanisms for RabbitMQ implementations. Create intelligent messaging workflows and scalable systems leveraging RabbitMQ's advanced features. Author(s) David Dossot is a seasoned software architect and developer with deep expertise in distributed systems and messaging solutions. With years of practical experience, David brings clarity and actionable insight to the complex subject of message-oriented middleware. His goal is to help technologists bridge the gap between theory and implementation. Who is it for? This book is intended for developers interested in learning how to utilize RabbitMQ for building modern messaging applications. It's suitable for readers with basic programming knowledge who want to deepen their understanding of distributed systems. Ideal for professionals seeking to implement message queuing solutions in their systems or enhance existing setups. The book progresses from beginner-friendly explanations to more advanced topics, making it a perfect choice for developers at any stage of learning RabbitMQ.

The "RabbitMQ Cookbook" is a hands-on guide to mastering RabbitMQ, a powerful and versatile message broker enabling efficient communication between distributed applications. Through practical recipes, you will learn the concepts and techniques for building scalable, reliable, and robust messaging systems. What this Book will help me do Implement and optimize RabbitMQ message brokers for distributed systems. Create RabbitMQ integrations with protocols like MQTT and STOMP. Develop scalable and high-availability RabbitMQ cluster solutions. Deploy and manage RabbitMQ in cloud environments like AWS. Extend RabbitMQ functionalities by creating custom plugins in Erlang. Author(s) The authors of "RabbitMQ Cookbook" are seasoned software architects and developers with extensive hands-on experience with RabbitMQ. They have utilized RabbitMQ in real-world projects to provide innovative solutions for scalable distributed systems. Their collaborative approach focuses on breaking down complex topics into actionable, practical lessons that empower readers to develop their skills. Who is it for? This book is perfect for software developers and architects aiming to design scalable and distributed systems. If you have a basic understanding of web, cloud, and multithreading concepts, this book will provide you with valuable tools and techniques to incorporate RabbitMQ effectively into your projects. It bridges the gap between theoretical concepts and practical implementation with detailed examples.

RabbitMQ in Action is a fast-paced run through building and managing scalable applications using the RabbitMQ messaging server. It starts by explaining how message queuing works, its history, and how RabbitMQ fits in. Then it shows you real-world examples you can apply to your own scalability and interoperability challenges. About the Technology There's a virtual switchboard at the core of most large applications where messages race between servers, programs, and services. RabbitMQ is an efficient and easy-to-deploy queue that handles this message traffic effortlessly in all situations, from web startups to massive enterprise systems. About the Book RabbitMQ in Action teaches you to build and manage scalable applications in multiple languages using the RabbitMQ messaging server. It's a snap to get started. You'll learn how message queuing works and how RabbitMQ fits in. Then, you'll explore practical scalability and interoperability issues through many examples. By the end, you'll know how to make Rabbit run like a well-oiled machine in a 24 x 7 x 365 environment. What's Inside Learn fundamental messaging design patterns Use patterns for on-demand scalability Glue a PHP frontend to a backend written in anything Implement a PubSub-alerting service in 30 minutes flat Configure RabbitMQ's built-in clustering Monitor, manage, extend, and tune RabbitMQ About the Reader Written for developers familiar with Python, PHP, Java, .NET, or any other modern programming language. No RabbitMQ experience required. About the Authors Alvaro Videla is a developer and architect specializing in MQ-based applications. Jason J. W. Williams is CTO of DigiTar, a messaging service provider, where he directs design and development. Quotes In this outstanding work, two experts share their years of experience running large-scale RabbitMQ systems. - Alexis Richardson, VMware Well-written, thoughtful, and easy to follow. - Karsten Strøbæk, Microsoft Soup to nuts on RabbitMQ; a wide variety of in-depth examples. - Patrick Lemiuex, Voxel Internap This book will take you to a messaging wonderland. - David Dossot, Coauthor of Mule in Action