High volume metric collection, visualization and analysis
Collecting performance data is vital to any technology ecosystem. It gives visibility into the system and helps us understand what the system is doing and how it is performing.
This talk will mainly focus on the challenges with collecting performance data in large environments in terms of granularity, resolution, retention, space consumption and usability of this data.
Although vast amounts of performance data is collected, one of - granularity, resolution, retention, or usability is usually sacrificed due to the amount of sheer volume.
- How does OpenTSDB attempt to solve the problem of granularity, resolution and retention?
- How does Ticketmaster's visualization tool - Metrilyx, address the issue of usability (visualization and analysis) given the amount of data and bridge the gap between the user and raw data to something that could be understood, analyzed and made sense of?