In this talk, we will delve into the emerging challenges that generative artificial intelligence GenAI and Large Language Models (LLMs) bring to the world of software quality and testing. We will explore how the integration, use, or design of solutions with GenAI models pose new challenges, including data quality and bias detection, dealing with non-determinism in our test automation and privacy and security concerns. We will review some proposals that are being implemented to adjust our testing tasks to the development of such systems, including approaches to automated testing and observability.