Microsoft is a company that heavily leverages scorecards for managing performance. Our CIO's scorecard has nearly 100 separate metrics that are used to evaluate his performance - indicated by green, yellow, or red. Recently, he cautioned us about scorecard "watermelons," that is, items that appear green on the scorecard but are actually significantly underperforming and should be red. This happens when the scorecard fails to capture the right measure.
I recently had a "watermelon" experience that should be a standard risk to look out for on business architecture engagements, especially if you suspect that the organization is not strategically mature. I had an executive sponsor insist that we conduct an engagement for his organization as they were undergoing a major strategic shift. He made available some of his managers who committed nearly 20% of their time to helping us create the strategy deliverables.
This engagement appeared green on our scorecard since we had executive sponsorship, commitment from the client, and were making progress on the deliverables. The only problem was that the people we were working with didn't really know what the strategy was. The executives had kept the strategy close to the vest and the managers we were working with were taking their best guess.
This internal disconnect with the client wasn't discovered until the end of the engagement when the SOAP was presented for validation. The executives were expecting something that articulated their transformational strategy and instead something that showed incremental improvements. We were green when it came to the engagement but bright red when it came to the actual content .
It was a terrific lesson - I had allowed the fact that I had engagement from the client obscure the fact that I didn't have the right level of engagement. In retrospect, I should have structured more frequent and earlier reviews with the sponsor to ensure that we were going in the right direction. The deliverables that I'm prescribing are primarily listening devices - they should be used often to validate whether you are on the right track to avoid watermelons.
Recent Comments