Python is at the core of our analytics platform, which processes over 8,000 game records daily, each approximately 500 MB in size. Over the past two years, we have accumulated more than 200 TB of data, equivalent to 1,600 years of game time from over 7 million players—and our goal is to increase this user count tenfold. This talk will cover how we transitioned from Go and C++ parsers connected via PyBind to data frames in Python, how our analyses evolved from Pandas to Polars, and why we migrated our backend from Django to FastAPI. Finally, we will share our real-world experience with performance optimization, leveraging RabbitMQ, Redis, and process monitoring in an environment where Python bridges the worlds of game data and AI analysis.
talk-data.com
Topic
Redis
database
caching
in_memory
1
tagged
Activity Trend
3
peak/qtr
2020-Q1
2026-Q1
Top Events
O'Reilly Data Engineering Books
22
Data Engineering Podcast
9
Google Cloud Next '24
4
DATA MINER Big Data Europe Conference 2020
3
O'Reilly Data Science Books
2
Microsoft Ignite 2023
2
Airflow Summit 2024
1
Microsoft Ignite 2025
1
PyData Prague #31 - PyData Prague meets TechMeetup Ostrava
1
November Gophers @ NALA!
1
Databricks DATA + AI Summit 2023
1
O'Reilly AI & ML Books
1
Filtering by:
PyData Prague #31 - PyData Prague meets TechMeetup Ostrava
×