There is growing interest in leveraging data mining and machine learning techniques in the analysis, maintenance and testing of software systems. This talk discusses how Google uses such techniques to automatically mine system invariants, uses those invariants in monitoring our systems in real-time and alerts engineers of any potential production problems within minutes.
The talk consists of two tools that Google testers use internally and how they combine them to provide real-time production monitoring for engineers almost for free:
* A tool that can mine system invariants.
* A tool that monitors production systems, and uses the first tool to automatically generate part of the logic it uses to identify potential problems in real-time.
[youtube ExXATBlygl0]