The measurement of the overall performance of a machine translation system has always been important for the MT system development community. There has always been a need to quickly understand if an MT system is improving or not during development. There is also a need to understand long-term progress.
However,