In this talk, I will share our journey, which began with local applications leveraging Open-Source LLMs and has now evolved to serve our internal teams. I will dive into the practical lessons we've learned along the way, offering insights that can help you navigate the complexities of LLM implementation.