Metrics have for a very long time served as the view model for visualizations within IT monitoring dashboards, but are they really suitable as the foundation for a data collection model that powers analytics and control in the performance monitoring and management of applications and services? Well just recently at a customer site I was given further cause for concern regarding the suitability of metrics as the basis for a monitoring data model when it was found out that a metric collected by another application performance monitoring vendor solution did not match a similar metric derived from our metering model. After an investigation it was found that the other monitoring vendor being replaced had wrongly calculated the metrics measure. That was the good news. The bad news was the customer wanted us to calculate the metric wrongly as well. Why? Because all their trend management reports would be thrown off. It was better to be consistently wrong as long as the change was tracked correctly across time samples and reports.

We managed to get the customer to see it from our perspective and in the process view metrics as merely snapshots of answers to questions which may have been wrongly proposed, constructed and answered. Once this view takes hold other issues and concerns come to mind including: Maturity, Traceability and Reproducability....

http://www.jinspired.com/site/metric-monitoring-tracking-change-over-time-but-not-changing-with-time