<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Tenacious Tortoise &#187; Measurement</title>
	<atom:link href="http://tenacioustortoise.com/index.php/category/measurement/feed/" rel="self" type="application/rss+xml" />
	<link>http://tenacioustortoise.com</link>
	<description>insights and consulting for change</description>
	<lastBuildDate>Fri, 21 Jan 2011 15:09:28 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.1.2</generator>
		<item>
		<title>Five Traps of Performance Measurement</title>
		<link>http://tenacioustortoise.com/index.php/2009/09/22/performance-measurement-traps/</link>
		<comments>http://tenacioustortoise.com/index.php/2009/09/22/performance-measurement-traps/#comments</comments>
		<pubDate>Tue, 22 Sep 2009 12:00:59 +0000</pubDate>
		<dc:creator>Robert S. Gold</dc:creator>
				<category><![CDATA[Leadership]]></category>
		<category><![CDATA[Measurement]]></category>
		<category><![CDATA[Reporting]]></category>
		<category><![CDATA[Andrew Likierman]]></category>
		<category><![CDATA[HBR]]></category>
		<category><![CDATA[London Business School]]></category>

		<guid isPermaLink="false">http://tenacioustortoise.com/?p=1654</guid>
		<description><![CDATA[An unusually practical article appears in the October issue of Harvard Business Review on the topic of performance measurement. I regret that I can’t share a link with you, because HBR content is not available online, except to subscribers of the magazine (perhaps the folks at Harvard haven’t yet read about the idea of Free). [...]]]></description>
			<content:encoded><![CDATA[<div id="attachment_1659" class="wp-caption alignright" style="width: 123px"><br />
<a href="http://faculty.london.edu/ALikierman/"><img class="size-full wp-image-1659" title="alikierman_w113" src="http://tenacioustortoise.com/wp-content/uploads/2009/09/alikierman_w113.jpg" alt="Sir Andrew Likierman" width="113" height="113" /></a><br />
<p class="wp-caption-text">Sir Andrew Likierman</p></div>
<p style="text-align: left;"><strong><em>An unusually practical article</em></strong> appears in the October issue of Harvard Business Review on the topic of performance measurement. I regret that I can’t share a link with you, because HBR content is not available online, except to subscribers of the magazine (perhaps the folks at Harvard haven’t yet read about the idea of Free). No matter. Though I can’t share the article itself with you, <strong><em>at least I can summarize it here.</em></strong></p>
<p style="text-align: left;">Entitled <em>The Five Traps of Performance Measurement</em>, Andrew Likierman’s article is concise and valuable. <a href="http://www.london.edu/theschool/thedean.html">Sir Andrew Likierman</a> is no less than the Dean of the London Business School, a non-executive director of Barclay’s Bank, and Chairman of the UK’s National Audit Office. <strong><em>He knows of what he writes.</em></strong></p>
<p><span id="more-1654"></span></p>
<p style="text-align: left;"><strong><em>As strategists and change agents, we’re all part of the process of performance measurement and management in our organizations.</em></strong> The task of measurement is neither easy, nor especially satisfying, at least in the short run. And those charged with measurement easily fall prey to pitfalls and traps. Sir Andrew highlights five that are most common.</p>
<ol style="text-align: left;">
<li><strong>Measuring Against Yourself</strong>. While it is important to understand change in performance measures from one period to the next, <strong><em>it is vital to understand how the organization is doing relative to its competitors</em></strong>. While competitive benchmarks may be difficult and potentially costly to obtain, there are ways to understand how one is doing relative to the competition. Likierman offers the example of Enterprise Rent-A-Car’s Quality Index, which captures customers’ plans for future rentals. From a random telephone survey of recent customers, Enterprise is able to project future increases or decreases in market share.  </li>
<li><strong>Looking Backward. <em>Comparisons with last year’s numbers aren’t useful if you’re not also looking at <a href="http://tenacioustortoise.com/index.php/2009/09/18/leading-questions/">leading indicators</a> that help make better decisions now to predict future performance</em></strong>. Likierman moves from this assertion to a discussion of the quality of management decisions as a leading indicator of success. He cites one European investment bank that tracks the eventual outcome of deals the bank chose not to do; if they turn out to be bad deals, the no-go decision is rated as a success. It is as important to focus on what the organization chooses not to do as it is to track what is done.</li>
<li><strong>Putting Your Faith in Numbers.</strong> Likierman asserts that <strong><em>numbers-driven managers tend to produce high volumes of low-quality data.</em></strong> There is a tendency to use popular measures (ones that may be fashionable in an industry), rather than choosing the right ones for the firm’s unique strategy. An example given is that of the Net Promoter Score, the likelihood that a customer will recommend a product or service to others. But the NPS is useful only if customers are likely to make purchase decisions on the basis of a recommendation. <strong><em>Another symptom of this trap is trying to fashion links to financial performance when no tangible links exist; the apparent ROI of such service functions as HR or especially IT is far more circumstantial than real.</em></strong> Most of the numbers that I’ve seen used in IT ROI calculations are somewhere between rough estimates and wishful thinking – certainly not reliable enough for making decisions.</li>
<li><strong>Gaming Your Metrics.</strong> It comes as no surprise that people whose performance is being measured will attempt to influence those numbers. <strong><em>This happens at an institutional level, not just with individuals.</em></strong> As Likierman reports, Royal Dutch Shell has paid $470 million since 2004 to settle lawsuits contending that Shell overstated its reserves. Morgan Stanley was reported to have deliberately lost a €20 million deal in order to improve its position in a global ranking. And who hasn’t seen sales behavior change at the end of the fiscal year, either trying to book business in the current year, or delay booking until the following year? All of these are examples of deliberate decisions to manipulate measurements. <strong><em>Likierman accepts the reality that gaming will happen, but prescribes a diversity of indicators </em></strong>that would be harder to manipulate; law firm Cliffor Chance changed from simply measuring billable hours to a portfolio of seven criteria on which to base bonuses; including measures of work quality and integrity.</li>
<li><strong>Sticking to Your Numbers Too Long.</strong> Once instituted, measurement systems become part of enterprise culture, and evolve more slowly than the organization itself. By deliberately stating the purpose of a measure (and connecting to a strategic intent, as in the balanced scorecard process), <strong><em>leaders are more likely to question an indicator that has outlived its usefulness</em></strong>. To me, the sign of a healthy strategic management process is one in which measures are easily and frequently challenged, and the portfolio of measures is frequently revised.</li>
</ol>
<p style="text-align: left;">Likierman concludes by reminding us that most business managers are not experts in performance measurement, and <strong><em>that line managers suffer from hopeless conflicts of interest in the measures design process.</em></strong> Measures design must include checks and balances, and (I believe) is best enabled by an outside, objective facilitator.</p>
<p style="text-align: left;">Are these pitfalls present in your organization? What are the other traps you’ve seen?<strong><em> Please comment below.</em></strong></p>
<p><a class="a2a_dd addtoany_share_save" href="http://www.addtoany.com/share_save#url=http%3A%2F%2Ftenacioustortoise.com%2Findex.php%2F2009%2F09%2F22%2Fperformance-measurement-traps%2F&amp;title=Five%20Traps%20of%20Performance%20Measurement">share or save this post</a> </p>]]></content:encoded>
			<wfw:commentRss>http://tenacioustortoise.com/index.php/2009/09/22/performance-measurement-traps/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Leading Questions</title>
		<link>http://tenacioustortoise.com/index.php/2009/09/18/leading-questions/</link>
		<comments>http://tenacioustortoise.com/index.php/2009/09/18/leading-questions/#comments</comments>
		<pubDate>Fri, 18 Sep 2009 12:00:33 +0000</pubDate>
		<dc:creator>Robert S. Gold</dc:creator>
				<category><![CDATA[Measurement]]></category>
		<category><![CDATA[Reporting]]></category>
		<category><![CDATA[causation]]></category>
		<category><![CDATA[cause and effect]]></category>
		<category><![CDATA[hypotheses]]></category>
		<category><![CDATA[hypothesis]]></category>
		<category><![CDATA[lagging indicators]]></category>
		<category><![CDATA[leading indicators]]></category>

		<guid isPermaLink="false">http://tenacioustortoise.com/?p=1621</guid>
		<description><![CDATA[At the center of the balanced scorecard concept is the observation that measures of organizational performance have traditionally been lagging indicators; measurement of actual performance after the fact. Management accounting is focused on describing performance during a time period that has ended – last quarter, last year, year-to-date, etc. And while there is nothing inherently [...]]]></description>
			<content:encoded><![CDATA[<p style="text-align: left;">At the center of the balanced scorecard concept is the observation that measures of organizational performance have traditionally been lagging indicators; measurement of actual performance after the fact. Management accounting is focused on describing performance during a time period that has ended – last quarter, last year, year-to-date, etc. And while <strong><em>there is nothing inherently wrong with lagging measures, they are of limited use to an organization’s leaders. All they do is tell what has already happened.</em></strong></p>
<p style="text-align: left;">The ‘balance’ in balanced scorecard refers to the ideal of providing leaders with a balanced portfolio of lagging <em>and</em> <em>leading</em> performance indicators. <strong><em>Leading indicators are valuable because they help managers form an expectation of what will happen</em></strong>, and enable testing of the <a href="http://tenacioustortoise.com/index.php/2009/06/02/cause-and-effect/">cause-and-effect hypotheses</a> that are at the core of the strategic planning process. But identifying candidate leading indicators and selecting from among them requires careful consideration and a <strong><em>healthy skepticism of apparently easy answers.</em></strong></p>
<p><span id="more-1621"></span></p>
<p style="text-align: left;"><strong><em>But this careful consideration requires familiarity with the concept of causation.</em></strong> Having just pulled down my trusty copy of <em><a href="http://amzn.com/0495093254">The Practice of Social Research</a></em> – a textbook from an undergrad class I took too many years ago, I was daunted by the prospect of condensing a lengthy entire <em>chapter</em> on the nature of causation to offer a brief understanding here. Wikipedia’s <a href="http://en.wikipedia.org/wiki/Causation_(sociology)">definition</a> is far more concise:</p>
<blockquote>
<p style="text-align: left;"><strong><em>Causation</em></strong>: The belief that events occur in predictable ways and that one event leads to another. If the relationship between the variables is non-spurious (there is not a third variable causing the effect), the temporal order is in line (cause before effect), and the study is longitudinal, it may be deduced that it is a causal relationship.</p>
</blockquote>
<p style="text-align: left;"><strong><em>When working with executives, I find real-world examples to be especially useful.</em></strong> One of my favorites offers a measurement of <a href="http://www.census.gov/const/www/newresconstindex.html">housing starts</a> (a <a href="http://www.census.gov/const/www/nrcdatarelationships.html">statistic</a> produced monthly by the U.S. Census Bureau) as a leading indicator of the sales of so-called “<a href="http://www.merriam-webster.com/dictionary/white%20goods">white goods</a>” (a wonderful old term meaning major appliances, like refrigerators, washing machines, stoves, etc.). An uptick in housing starts is an extremely reliable leading indicator of a nearly identical uptick in sales of white goods several months later. As those new housing units near completion they are furnished with new appliances. <strong><em>So if you’re in the business of making refrigerators, you’re going to be very interested in tracking housing starts.</em></strong></p>
<p style="text-align: left;"><strong><em>Unfortunately, causation isn’t usually that obvious.</em></strong> One client of mine (some details have been changed) operated an inbound call center for taking resort hotel reservations.<strong><em> As part of a broad strategy, this firm undertook an initiative to increase revenue</em></strong> by cross-selling reservations for nearby dining and attractions, along with the core hotel reservations. Call-center agents whose performance had previously been measured as <em>calls handled per hour </em>were now expected to engage callers in more personal conversations about their vacation plans, in order to find opportunities to cross-sell the associated reservations. The new performance measures became <em>average call duration</em> (the hypothetical leading indicator that was expected to increase) and <em>average revenue per call</em> (the lagging indicator). <strong><em>The strategic hypothesis: keep customers on the phone longer, and they’ll buy (reserve) more.</em></strong></p>
<p style="text-align: left;"><strong><em>It didn’t work out that way.</em></strong> Even though the call-center agents had been trained extensively in cross-selling, the majority of customers calling in were not easily engaged in the longer, more personal conversations. These customers called expecting a brief transaction (the hotel reservation) and were impatient with the questions. But a subset of customers calling in were quite happy to chat with the friendly reservations agents. <strong><em>Unfortunately, these chatty customers turned out to be especially</em> unlikely <em>to make dining and attraction reservations, and ultimately</em> reduced <em>the productivity of the agents.</em></strong></p>
<p style="text-align: left;">A continuing theme in my posts has been that of <a href="http://tenacioustortoise.com/index.php/2009/08/21/hypotheses-of-strategy/">strategy as a set of hypotheses to be tested</a>. <strong><em>A tested hypothesis proven to be false is just as valuable as one proven true.</em></strong> Measure such as those in the example above enabled managers to quickly identify flaws in the hypothesis, and revise the strategy. <strong><em>The value of a measure is in its ability to enable valuable decisions.</em></strong></p>
<blockquote>
<p style="text-align: left;">Do you have a favorite example of a pair of leading / lagging indicators that you can share? <strong><em>Please comment below.</em></strong></p>
</blockquote>
<p><a class="a2a_dd addtoany_share_save" href="http://www.addtoany.com/share_save#url=http%3A%2F%2Ftenacioustortoise.com%2Findex.php%2F2009%2F09%2F18%2Fleading-questions%2F&amp;title=Leading%20Questions">share or save this post</a> </p>]]></content:encoded>
			<wfw:commentRss>http://tenacioustortoise.com/index.php/2009/09/18/leading-questions/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Innumeracy and The Flaw of Averages</title>
		<link>http://tenacioustortoise.com/index.php/2009/09/16/flaw-of-averages/</link>
		<comments>http://tenacioustortoise.com/index.php/2009/09/16/flaw-of-averages/#comments</comments>
		<pubDate>Wed, 16 Sep 2009 12:00:27 +0000</pubDate>
		<dc:creator>Robert S. Gold</dc:creator>
				<category><![CDATA[Measurement]]></category>
		<category><![CDATA[Reporting]]></category>
		<category><![CDATA[Risk]]></category>
		<category><![CDATA[Flaw of Averages]]></category>
		<category><![CDATA[innumeracy]]></category>
		<category><![CDATA[John Allen Paulos]]></category>
		<category><![CDATA[Sam L. Savage]]></category>
		<category><![CDATA[statistics]]></category>

		<guid isPermaLink="false">http://tenacioustortoise.com/?p=1610</guid>
		<description><![CDATA[Desperately casting around for a topic to write about today, I was grateful to see a link to an interview in the San Jose Mercury News with Stanford professor Sam L. Savage about his book, The Flaw of Averages (great title!). I’ve not read the book yet, but the review has certainly piqued my interest: [...]]]></description>
			<content:encoded><![CDATA[<div id="attachment_1614" class="wp-caption alignnone" style="width: 563px"><a href="http://flawofaverages.com/"><img class="size-full wp-image-1614" title="flaw_of_averages" src="http://tenacioustortoise.com/wp-content/uploads/2009/09/flaw_of_averages.png" alt="caption text" width="553" height="334" /></a><p class="wp-caption-text">A classic example of the Flaw of Averages involves the Statistician who drowned crossing a river that was on average 3 ft. deep.</p></div>
<p style="text-align: left;">Desperately casting around for a topic to write about today, I was grateful to see a link to an <a href="http://www.mercurynews.com/businessheadlines/ci_13318018">interview</a> in the San Jose Mercury News with Stanford professor <strong><em>Sam L. Savage</em></strong> about his book, <em><a href="http://www.flawofaverages.com/">The Flaw of Averages</a></em> (great title!). I’ve not read the book yet, but the review has certainly <strong><em>piqued my interest:</em></strong></p>
<blockquote>
<p style="text-align: left;">How does General Motors, Sam L. Savage wonders, explain the pathetic performance of its crystal ball? When Americans started driving hybrids, GM was still pushing Hummers. Executives at the giant carmaker — fully aware of union contracts, presumably prepared for rising gasoline prices and economic uncertainty — drove straight into the ditch of bankruptcy.</p>
<p style="text-align: left;">&#8220;Probability management&#8221; is often mismanaged by business leaders, says Savage, a consulting professor of management science and engineering at Stanford University and a fellow at the Judge Business School at the University of Cambridge. Savage, who has performed probability studies for Royal Dutch Shell, set out to right statistical wrongs in his book &#8220;The Flaw of Averages.&#8221;</p>
<p style="text-align: left;">The Information Age has transformed statistics into a vital field of study, yet Savage says many habits and practices have been slow to change from the &#8220;steam era statistics&#8221; of the Industrial Age.</p>
<p style="text-align: left;">Written for a business audience, &#8220;<em>The Flaw of Averages</em>&#8221; leavens the math with levity, even the occasional cartoon.</p>
</blockquote>
<p style="text-align: left;"><strong><em>Well alright then.</em></strong> Working with business executives and their measures for so many years, I continue to be amazed at how easily decisions are made on the basis of numbers with little consideration for the risks and consequences of those decisions. I’ve been meaning to write at some length about the need for the discipline of risk management in change programs, but before doing so, <strong><em>we all need to take a deep breath and consider the magnitude of our collective innumeracy.</em></strong></p>
<p style="text-align: left;"><strong><em>The topic has been covered before.</em></strong> I just pulled<em> </em><a href="http://amzn.com/0809058405"><em>Innumeracy: Mathematical Illiteracy and its Consequences</em></a>by John Allen Paulos from my bookshelf, and thumbing through it, I remember how much I appreciated the book, but that is wasn&#8217;t the easiest read. From the back cover description:</p>
<blockquote>
<p style="text-align: left;">Why do even well-educated people understand so little about mathematics? And what are the costs of our innumeracy? John Allen Paulos, in his celebrated bestseller first published in 1988, argues that our inability to deal rationally with very large numbers and the probabilities associated with them results in misinformed governmental policies, confused personal decisions, and an increased susceptibility to pseudoscience of all kinds. <em>Innumeracy</em> lets us know what we&#8217;re missing, and how we can do something about it.</p>
<p style="text-align: left;">Sprinkling his discussion of numbers and probabilities with quirky stories and anecdotes, Paulos ranges freely over many aspects of modern life, from contested elections to sports stats, from stock scams and newspaper psychics to diet and medical claims, sex discrimination, insurance, lotteries, and drug testing. Readers of <em>Innumeracy</em> will be rewarded with scores of astonishing facts, a fistful of powerful ideas, and, most important, a clearer, more quantitative way of looking at their world.</p>
</blockquote>
<p style="text-align: left;">SinceI found that <em>Innumeracy</em> was not especially accessible, I haven’t yet found occasion to use examples from it. Perhaps <em>The</em> <em>Flaw of Averages</em> will be better. It looks promising. From the interview with Savage:</p>
<blockquote>
<p style="text-align: left;"><strong>Q.</strong> What are the most common ways people foolishly apply the law of averages? Is it the faith placed in &#8220;average returns&#8221; on retirement portfolio?</p>
<p style="text-align: left;"><strong>A.</strong> Plenty of people have been caught off base by the Flaw of Averages in investing, but here is an example that is closer to home. Imagine that both you and your wife are right on time for appointments, on average.</p>
<p style="text-align: left;">When you go somewhere together, however, you will be late, on average. Why? If we model being early or late for each of you by flipping a coin (heads is early, tails is late), then the only way you will not be late as a couple, is if neither of you is late. This is like flipping two heads in a row, or one chance in four. Now expand this to a big industrial project with thousands of tasks, and you can imagine the implications.</p>
</blockquote>
<p style="text-align: left;"><strong><em>We don’t have to imagine the implications – we live with them every day.</em></strong> More to come (soon, I hope), on the topics of innumeracy and strategic risk management.</p>
<p><a class="a2a_dd addtoany_share_save" href="http://www.addtoany.com/share_save#url=http%3A%2F%2Ftenacioustortoise.com%2Findex.php%2F2009%2F09%2F16%2Fflaw-of-averages%2F&amp;title=%3Cem%3EInnumeracy%3C%2Fem%3E%20and%20%3Cem%3EThe%20Flaw%20of%20Averages%3C%2Fem%3E">share or save this post</a> </p>]]></content:encoded>
			<wfw:commentRss>http://tenacioustortoise.com/index.php/2009/09/16/flaw-of-averages/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Scorecard Blues (plus Three Other Colors)</title>
		<link>http://tenacioustortoise.com/index.php/2009/07/17/scorecard-blues/</link>
		<comments>http://tenacioustortoise.com/index.php/2009/07/17/scorecard-blues/#comments</comments>
		<pubDate>Fri, 17 Jul 2009 12:00:00 +0000</pubDate>
		<dc:creator>Robert S. Gold</dc:creator>
				<category><![CDATA[Measurement]]></category>
		<category><![CDATA[Reporting]]></category>
		<category><![CDATA[balanced scorecard]]></category>
		<category><![CDATA[BSC]]></category>
		<category><![CDATA[dashboard]]></category>
		<category><![CDATA[indicator]]></category>
		<category><![CDATA[red yellow green]]></category>
		<category><![CDATA[RYG]]></category>
		<category><![CDATA[scorecard]]></category>
		<category><![CDATA[vocabulary]]></category>

		<guid isPermaLink="false">http://tenacioustortoise.com/?p=1215</guid>
		<description><![CDATA[To my chagrin, the term &#8216;scorecard&#8217; is widely used in both the disciplines of performance management and strategy execution, and without further qualification, has an imprecise variety of meanings. To some, it may mean a large collection of indicators of operational performance. To others, it is an ambiguous shorthand for &#8216;balanced scorecard,&#8217; which is a [...]]]></description>
			<content:encoded><![CDATA[<p><img class="alignleft size-full wp-image-1216" title="stoplight_t" src="http://tenacioustortoise.com/wp-content/uploads/2009/07/stoplight_t.png" alt="stoplight_t" width="200" height="275" /></p>
<p style="text-align: justify;">To my chagrin, the term &#8216;scorecard&#8217; is widely used in both the disciplines of performance management and strategy execution, and without further qualification, <strong><em>has an imprecise variety of meanings</em></strong>. To some, it may mean a large collection of indicators of operational performance. To others, it is an ambiguous shorthand for &#8216;balanced scorecard,&#8217; which is a well-developed set of related ideas and practices around strategy management and execution. <strong><em>Ambiguity comes from the fact that to some, the term &#8216;balanced scorecard&#8217; means simply a collection of measures that has been balanced according to some real or imagine scheme.</em></strong> On far too many occasions, I&#8217;ve been approached by a conference attendee with a request to review and comment on his so-called &#8216;balanced scorecard,&#8217; <strong><em>only to find that the proud offering is a only collection of operational measures with no connection to strategy</em></strong>. This is the basis of my Scorecard Blues. So let me be blunt:<strong><em> if a set of measures has been selected without the prior development of a strategy map, it cannot be properly called a balanced scorecard.</em></strong></p>
<p style="text-align: justify;">Even without the qualifier of &#8216;balanced,&#8217; a &#8216;scorecard&#8217; is seen as a group of measures, and / or the visual representation of those measures, and / or the tool for managing measurement data. Many software tools called &#8216;scorecards&#8217; have been developed to facilitate the collection, analysis, and presentation of scorecards, both for operational and strategic use.<strong><em> Because the term &#8216;scorecard&#8217; has so many diverse meanings and uses, it simply cannot be used alone without further explanation.</em></strong> But there is one trait that attaches to nearly every individual&#8217;s own definition of the term &#8216;scorecard.&#8217;</p>
<p style="text-align: justify;"><strong><em>The lowest common denominator of nearly all &#8216;scorecards&#8217; is the ubiquitous red &#8211; yellow (amber in Europe) &#8211; green summary indicator scheme (hence RYG).</em></strong><span id="more-1215"></span> I am not aware of any research into the origin of the RYG scheme for summarizing measure data. Of course, the scheme is universally used in traffic control, but the meanings are simple: red simply means stop, and green simply means go. I suspect that the first use of colors to summarize data was in aviation and later in aerospace, where green means that an indicator is within its normal operational range, with yellow and red varying degrees of abnormal results. This origin suggests the basis for a similarly ambiguous term, &#8216;dashboard.&#8217;</p>
<p style="text-align: justify;">It is easy to see the appeal of using this scheme to summarize a large portfolio of operational measures. At a glance, one can observe the RYG summaries of dozens or even hundreds of indicators and quickly know which ones are in need of immediate attention. <strong><em>The ability to translate and display a measure as an RYG indicator is a basic capability in every scorecard software tool I&#8217;ve seen. </em></strong></p>
<p style="text-align: justify;">&#8216;Scorecards&#8217; predate &#8216;balanced scorecard,&#8217; and as the BSC discipline has evolved and matured, so has the sophistication of BSC reporting. Adaptation of &#8216;scorecard&#8217; tools to BSC reporting has been rampant. But<strong><em> the inevitable application of RYG to BSC reporting has been problematic.</em></strong> Most organizations that I&#8217;ve worked with <strong><em>have struggled with RYG indicators.</em></strong></p>
<p style="text-align: justify;">The BSC development process identifies strategic objectives as the basis for subsequent selection of measures. During the first several months of the life of a BSC, an organization may have difficulty in selecting effective measures and obtaining measure data; strategic measures are often very different than operational measures, and require that new information sources be developed. <strong><em>New measures do not always lend themselves as easily to target setting;</em></strong> measuring an objective to &#8216;Manage turnover of key employees&#8217; not only requires data on turnover, but definitions of &#8216;key employees,&#8217; and what &#8216;management&#8217; actually means. Setting a target for the <a href="http://tenacioustortoise.com/index.php/2009/06/30/how-was-your-flight/">concept</a> of turnover is far from intuitive.</p>
<p style="text-align: justify;">Even when a target can be set for a particular measure, the target is probably is only useful to delineate between the green and yellow indicators. <strong><em>I&#8217;ve had to preside over many spirited (e.g., angry) and wasteful discussions of the right distinction between yellow and red for a particular measure.</em></strong> One of my colleagues has even advocated using only red and green indicators to his clients, but with limited success.</p>
<p style="text-align: justify;">Because effective BSC programs require transparent and frequent communication of strategic performance among selected stakeholders (e.g. employees), <strong><em>members of leadership teams can become quite defensive about the colors.</em></strong> In the language of scorecard color, red means &#8216;bad&#8217; for operational indicators, but not necessarily so for strategic objectives, where &#8216;red&#8217; may be interpreted as &#8216;objective needing attention.&#8217; <strong><em>Cultural attachments to the meaning of &#8216;red&#8217; often causes contortions to avoid putting a red indicator on a strategy map. </em></strong></p>
<p style="text-align: justify;">In practice, I&#8217;ve arrived at a couple of conclusions and approached to using the RYG scheme on BSCs:</p>
<ol style="text-align: justify;" type="1">
<li>Leadership teams insist on having RYG indicators, <strong><em>but need to be guided to a shared set of definitions of their meanings.</em></strong></li>
<li>Strict numerical targets don&#8217;t work very well for setting the colors.</li>
<li>Without guidance,<strong><em> a leadership team will become obsessed by color setting </em></strong>and distracted from productive strategic management efforts.</li>
<li><strong><em>A healthy set of strategic objectives will have a good mixture of the colors.</em></strong> A strategy map with all green objectives isn&#8217;t believable. A strategy map with all red objectives is too demoralizing. Either extreme is dysfunctional.</li>
<li>Because there is subjectivity in target setting,<strong><em> it is better to have leadership teams come to a subjective agreement on the RYG setting for each objective on a strategy map, each time measures are updated.</em></strong> The discussion that leads to a consensus decision often helps the leaders uncover and understand root causes of deficient performance far better than any automatically set indicator will.</li>
<li>Over time, the <strong><em>RYG indicators of strategic performance become far less important than the rich discussions of strategic objectives</em></strong>, <a href="http://tenacioustortoise.com/index.php/2009/06/02/cause-and-effect/">cause and effect</a>, and <a href="http://tenacioustortoise.com/index.php/2009/07/08/taking-the-initiative/">initiatives</a> in the strategic management process.</li>
</ol>
<p style="text-align: justify;">Is your organization using RYG indicators on its scorecards? Does everyone agree on the meanings of each color? <strong><em>Do RYG indicators help or hinder strategic management? Please comment below.</em></strong></p>
<p><a class="a2a_dd addtoany_share_save" href="http://www.addtoany.com/share_save#url=http%3A%2F%2Ftenacioustortoise.com%2Findex.php%2F2009%2F07%2F17%2Fscorecard-blues%2F&amp;title=Scorecard%20Blues%20%28plus%20Three%20Other%20Colors%29">share or save this post</a> </p>]]></content:encoded>
			<wfw:commentRss>http://tenacioustortoise.com/index.php/2009/07/17/scorecard-blues/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>How Was Your Flight? A Journey From Concept to Indicator</title>
		<link>http://tenacioustortoise.com/index.php/2009/06/30/how-was-your-flight/</link>
		<comments>http://tenacioustortoise.com/index.php/2009/06/30/how-was-your-flight/#comments</comments>
		<pubDate>Tue, 30 Jun 2009 12:00:41 +0000</pubDate>
		<dc:creator>Robert S. Gold</dc:creator>
				<category><![CDATA[Measurement]]></category>
		<category><![CDATA[dimension]]></category>
		<category><![CDATA[indicator]]></category>
		<category><![CDATA[measurement concept]]></category>
		<category><![CDATA[passenger comfort]]></category>
		<category><![CDATA[vocabulary]]></category>

		<guid isPermaLink="false">http://tenacioustortoise.com/?p=1004</guid>
		<description><![CDATA[In our pursuit of a shared vocabulary of measurement, we&#8217;ve already considered the ideas of accuracy, precision, and healthy skepticism. Here, we take a step back and look at key terms of measurement concept, dimension, and indicator. A measurement concept is a mental image that describes an area of interest, such as speed, warmth, or [...]]]></description>
			<content:encoded><![CDATA[<p style="text-align: justify;">In our pursuit of a <strong><em>shared <a href="http://tenacioustortoise.com/index.php/tag/vocabulary/">vocabulary</a> of measurement</em></strong>, we&#8217;ve already considered the ideas of <a href="http://tenacioustortoise.com/index.php/2009/06/29/skepticism-precision-accuracy/">accuracy, precision, and healthy skepticism</a>. Here, we take a step back and look at key terms of <strong><em>measurement</em></strong> <strong><em>concept</em></strong>, <strong><em>dimension</em></strong>, and <strong><em>indicator</em></strong>.</p>
<p style="text-align: justify;">A <strong><em>measurement concept is a mental image</em></strong> that describes an area of interest, such as <em>speed</em>, <em>warmth</em>, <em>or comfort</em>. The key to thinking abou<strong><em>t a concept is that it springs from an idea; an impression or perception that cannot be directly measured.</em></strong> To <strong><em>conceptualize</em></strong> an idea is to specify what we mean when we use that mental image.</p>
<p><span id="more-1004"></span></p>
<blockquote>
<p style="text-align: justify;">Imagine that you&#8217;re an airline executive interested in improving passenger comfort. To say that I was &#8216;comfortable&#8217; on a recent flight is to share my perception, <strong><em>but your understanding of my experience is not quantifiable</em></strong>. When you ask me what I mean by &#8216;comfort,&#8217; I might say that I had a good seat, and that the flight attendant was helpful. In this example, &#8216;good seat&#8217; is one of my <strong><em>concepts</em></strong> of comfort. But the concept of a &#8216;good seat&#8217; <strong><em>has different meanings to different people</em></strong>. I describe a &#8216;good seat&#8217; as an aisle seat with ample legroom and width, which are some of my <strong><em>dimensions</em></strong> of the concept (another has to do with being next to an empty seat).</p>
<p style="text-align: justify;">In the course of speaking to many other passengers, and your understanding of possible approaches to improving passenger comfort, you conclude that the best leading<strong><em> indicator</em></strong> of the dimension of comfort is whether the passenger is in his or her preferred seat type (since some prefer window or even middle seats). So you choose &#8216;share of selected passengers in their preferred seat type&#8217; as your indicator of the dimension of passenger comfort. Of course, you could have chosen other dimensions, and other indicators, but you know that after a point,<strong><em> the measurement process is not improved by more measures.</em></strong></p>
<p style="text-align: justify;">As part of the airline&#8217;s <strong><em>initiative</em></strong> to improve passenger comfort, you identify a target group of passengers (perhaps those at or above a loyalty program tier), and capture their preferred seat type in their online profile. You then modify seat assignment policies and processes (both automated and manual) to try to increase the number of times that those selected passengers are seated according to their preference. <strong><em>Only now have we arrived at a quantifiable, leading indicator</em></strong> of passenger comfort. <strong><em>The hypothesis implied by this choice </em></strong>is that getting passengers in their preferred seats will cause them to experience comfortable flights more often. An appropriate lagging indicator would be a survey of those selected passengers to capture their actual experience of comfort, and to then correlate that data with their seat assignments.</p>
</blockquote>
<p><img class="aligncenter size-full wp-image-1005" title="passenger-comfort" src="http://tenacioustortoise.com/wp-content/uploads/2009/06/passenger-comfort.png" alt="passenger-comfort" width="696" height="537" /></p>
<p style="text-align: justify;">Of course, this example does not show how measures are usually selected. <strong><em>Measurement is often difficult</em></strong>, and <strong><em>every measurement choice implies a hypothesis</em></strong>. Leadership teams tend to choose those measures that are <strong><em>easily captured</em></strong>, not those that are <strong><em>reasoned choices</em></strong> as shown in the example. <strong><em>The choice of measurement may be delegated to subordinates whose understanding of the strategy may be incomplete,</em></strong> or have a vested interest in <strong><em>presenting a measure whose outcomes can easily be, ahem, &#8216;managed.&#8217;</em></strong></p>
<p style="text-align: justify;">A shared understanding of the vocabulary of measurement will <strong><em>enable leaders to more effectively consider and chose measures</em></strong> that will motive desired change behaviors and effective describe the performance and impact of strategic initiatives.</p>
<p style="text-align: justify;"><strong><em>Please share below some of the best and worst measures in your change program. </em></strong></p>
<p><a class="a2a_dd addtoany_share_save" href="http://www.addtoany.com/share_save#url=http%3A%2F%2Ftenacioustortoise.com%2Findex.php%2F2009%2F06%2F30%2Fhow-was-your-flight%2F&amp;title=How%20Was%20Your%20Flight%3F%20A%20Journey%20From%20Concept%20to%20Indicator">share or save this post</a> </p>]]></content:encoded>
			<wfw:commentRss>http://tenacioustortoise.com/index.php/2009/06/30/how-was-your-flight/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Healthy Skepticism, Precision, and Measurement Accuracy</title>
		<link>http://tenacioustortoise.com/index.php/2009/06/29/skepticism-precision-accuracy/</link>
		<comments>http://tenacioustortoise.com/index.php/2009/06/29/skepticism-precision-accuracy/#comments</comments>
		<pubDate>Mon, 29 Jun 2009 11:30:15 +0000</pubDate>
		<dc:creator>Robert S. Gold</dc:creator>
				<category><![CDATA[Measurement]]></category>
		<category><![CDATA[accuracy]]></category>
		<category><![CDATA[precision]]></category>
		<category><![CDATA[skepticism]]></category>
		<category><![CDATA[vocabulary]]></category>

		<guid isPermaLink="false">http://tenacioustortoise.com/?p=979</guid>
		<description><![CDATA[Much has already been written here about the process of capturing the change agenda and developing strategy maps. These important tools are valuable for communicating strategy across the organization. But they also serve as the foundation for identifying the performance measures that will motivate the behavior changes needed for strategy execution. And without a healthy [...]]]></description>
			<content:encoded><![CDATA[<p style="TEXT-ALIGN: justify">Much has already been written here about the process of capturing the <a href="http://tenacioustortoise.com/index.php/2009/06/25/capturing-change-agenda/">change agenda</a> and developing <a href="http://tenacioustortoise.com/index.php/tag/vertical-and-horizontal/">strategy maps</a>. These important tools are valuable for communicating strategy across the organization. But they also serve as the foundation for identifying the <strong><em>performance measures that will motivate the behavior changes needed for strategy execution</em></strong>. And without a <strong><em>healthy skepticism</em></strong>, measures can mislead as much as they inform. Many remember that Mark Twain wrote,</p>
<blockquote><p>&#8220;Figures often beguile me, particularly when I have the arranging of them myself; in which case the remark attributed to Disraeli would often apply with justice and force: &#8216;<strong><em>There are three kinds of lies: <a href="http://en.wikipedia.org/wiki/Lies,_damned_lies,_and_statistics">lies, damned lies, and statistics</a>.</em></strong>&#8216;&#8221;</p></blockquote>
<p><span id="more-979"></span><br />
While there is certainly <strong><em>deliberate distortion of statistics every day in the political sphere</em></strong>, we hope that the measures that become part of a strategy execution program are effective in both motivating behavior and helping people make good decisions. There are many blog posts yet to be written about checks and balances in the design of measurement processes. But it&#8217;s a good idea to <strong><em>begin with a shared vocabulary of measurement</em></strong>. Two fundamental terms in the measurement discipline are <strong><em>accuracy</em></strong> and <strong><em>precision</em></strong>. </p>
<p style="TEXT-ALIGN: justify">A bag full of marbles may be said to contain &#8216;about 100 marbles,&#8217; but <strong><em>it is accurate to actually count the marbles</em></strong> and be able to say that the bag has &#8216;exactly 103 marbles.&#8217; With the marbles, we reach absolute accuracy by direct observation. But <strong><em>most measures can&#8217;t be directly observed</em></strong>, and determining their accuracy is less straightforward. When a web site says that it is 91 degrees where I live, but my outdoor thermometer says that it is 86 digress, it isn&#8217;t clear which measurement is more accurate, especially since temperature isn&#8217;t observable. <strong><em>It is the measurement process that determines accuracy. </em></strong></p>
<p style="TEXT-ALIGN: justify"><strong><em>Observability doesn&#8217;t guarantee accuracy.</em></strong> A call center manager may measure call volume per employee during a one-hour period by watching his employees and making tick marks on a piece of paper, but that direct observation is subject to error. Statistics from the telephone equipment in the call center should be more accurate (unless there is a flaw in the equipment&#8217;s software).</p>
<p style="TEXT-ALIGN: justify">We&#8217;re surrounded by measurements that we can&#8217;t independently confirm, and <strong><em>we take the accuracy of most measurements for granted.</em></strong> Our inclination to <strong><em>trust a measure has as much to do with the source of the information</em></strong> (the web site vs. my wall thermometer) <strong><em>as the measurement process itself</em></strong>. It&#8217;s also important to remember in the business setting that those performing a measurement process may have an interest in the interpretation of that measurement.</p>
<p style="TEXT-ALIGN: justify"><strong><em>Precision is a simple attribute of measurement. It is simply the fineness of distinctions made when expressing a variable.</em></strong> When I tell you that the bag of marbles contains &#8216;about 100 marbles,&#8217; I am fairly representing an absence of precision in the measurement. But if I tell you that the bag contains &#8217;108 marbles,&#8217; I am expressing a degree of <strong><em>precision</em></strong> (down to the single marble) <strong><em>that implies accuracy</em></strong>, that is independent of how I actually arrived at the number. If the call center manager&#8217;s tick marks result in a calculation of 3.42 calls per employee per hour, <strong><em>we trust his measure simply because of that degree of precision.</em></strong></p>
<p style="TEXT-ALIGN: justify"><strong><em>It is simple human nature to confuse precision with accuracy.</em></strong> My outdoor thermometer is digital, and is actually telling me that it is 86.9 degrees outside. The web site says 91 degrees. If I hadn&#8217;t taken the time to think about it, I might be more inclined to believe the outdoor thermometer, <strong><em>just because of that decimal point</em></strong>, but my healthy skepticism says that I shouldn&#8217;t. <strong><em>All I know for sure is that it&#8217;s hot</em></strong><strong><em>.</em></strong></p>
<p><a class="a2a_dd addtoany_share_save" href="http://www.addtoany.com/share_save#url=http%3A%2F%2Ftenacioustortoise.com%2Findex.php%2F2009%2F06%2F29%2Fskepticism-precision-accuracy%2F&amp;title=Healthy%20Skepticism%2C%20Precision%2C%20and%20Measurement%20Accuracy">share or save this post</a> </p>]]></content:encoded>
			<wfw:commentRss>http://tenacioustortoise.com/index.php/2009/06/29/skepticism-precision-accuracy/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Cascading Conundrums &#8211; Part III</title>
		<link>http://tenacioustortoise.com/index.php/2009/06/22/cascading-conundrums-iii/</link>
		<comments>http://tenacioustortoise.com/index.php/2009/06/22/cascading-conundrums-iii/#comments</comments>
		<pubDate>Mon, 22 Jun 2009 12:11:54 +0000</pubDate>
		<dc:creator>Robert S. Gold</dc:creator>
				<category><![CDATA[Change]]></category>
		<category><![CDATA[Communication]]></category>
		<category><![CDATA[Measurement]]></category>
		<category><![CDATA[Strategy]]></category>
		<category><![CDATA[Strategy Map Design]]></category>
		<category><![CDATA[balanced scorecard]]></category>
		<category><![CDATA[BSC]]></category>
		<category><![CDATA[cascade]]></category>
		<category><![CDATA[expectations]]></category>
		<category><![CDATA[facilitation]]></category>
		<category><![CDATA[hierarchy]]></category>
		<category><![CDATA[leadership]]></category>
		<category><![CDATA[strategy map]]></category>

		<guid isPermaLink="false">http://tenacioustortoise.com/?p=852</guid>
		<description><![CDATA[In Parts I and II of this topic, I asserted that cascading a balanced scorecard (BSC) across an organization is a process that requires careful planning, and thoughtful answers to the &#8216;When&#8217;, &#8216;Why&#8217;, and &#8216;Where&#8217; questions. I cautioned that hastily planned cascading can derail the entire change program. Here, we conclude with the final three [...]]]></description>
			<content:encoded><![CDATA[<p>In <a href="http://tenacioustortoise.com/index.php/2009/06/18/cascading-conundrums-i/">Parts I</a> and <a href="http://tenacioustortoise.com/index.php/2009/06/19/cascading-conundrums-ii/">II</a> of this topic, I asserted that cascading a balanced scorecard (BSC) across an organization is a process that requires careful planning, and thoughtful answers to the <a href="http://tenacioustortoise.com/index.php/2009/06/18/cascading-conundrums-i/">&#8216;When&#8217;</a>, <a href="http://tenacioustortoise.com/index.php/2009/06/18/cascading-conundrums-i/">&#8216;Why&#8217;</a>, and <a href="http://tenacioustortoise.com/index.php/2009/06/19/cascading-conundrums-ii/">&#8216;Where&#8217;</a> questions. I cautioned that hastily planned cascading can derail the entire change program. Here, <strong><em>we conclude with the final three questions a leadership team should consider before cascading strategy across the organization.</em></strong><br />
<span id="more-852"></span></p>
<h5>Carefully Balance Autonomy and Mandates to Answer the &#8216;What&#8217; Question</h5>
<p>The &#8216;what&#8217; question entails the actual content of strategy maps and measures. <strong><em>Unsurprisingly, there have been a variety of approaches used, with mixed results.</em></strong></p>
<p>One such approach is to simply <strong><em>cascade the enterprise-level strategy map intact to subordinate units, and requiring them to select their own measures</em></strong>, which may be unique, subordinate to, or identical to enterprise-level measures. Sometimes there are no strategy maps at all at subordinate levels. But business and support units each have their own internal value proposition, and the top-level strategy map is rarely a good fit at subordinate levels. <strong><em>The motivation for this approach may not be benign</em></strong>; it has been employed to both eliminate the effort of creating subordinate strategy maps, and to offload the effort of collection measurement data to the subordinates. This approach is likely to create resentment at the subordinate level, and <strong><em>rarely results in a sustainable change program. Avoid this approach if at all possible.  </em></strong></p>
<p><strong><em>A more balanced approach is to require that subordinates follow the established <a href="http://tenacioustortoise.com/index.php/tag/vertical-and-horizontal/">vertical and horizontal</a> structure of the parent strategy, but give them the freedom to establish their own objectives and measures.</em></strong> The reward from this approach is much higher engagement and buy-in for subordinate leadership teams, but the risk is fragmented or unaligned strategic messages. It is best to ensure that the same facilitator(s) who guided development of the higher-level strategy also facilitate development of the subordinates&#8217; strategies &#8211; the facilitator can guide leadership teams to a better-aligned change agenda. <strong><em>It is important that subordinate and parent strategy maps resemble one another </em></strong>(I describe it as a &#8216;family resemblance&#8217;) and that there are no obviously conflicting strategic objectives. <strong><em>An excess of autonomy at subordinate levels will fragment and confuse the strategic intent. </em></strong></p>
<p>The endless additional variations on approaches to managing cascaded content simply cannot be captured properly here. Please submit comments with your organization&#8217;s approach, and how well it is working.</p>
<h5>The &#8216;Who&#8217; Question Helps to Answer the &#8216;How&#8217; Question, and Informs the &#8216;When&#8217; Question</h5>
<p><strong><em>The &#8216;Who&#8217; question is far easier to answer, as in, &#8216;Who facilitates the cascade?&#8217;</em></strong> As the organization cascades its strategy deeper and deeper, the number of parallel efforts quickly multiplies. To save time and money, the pragmatic approach has been to <strong><em>enable third- and fourth- tier groups to self-facilitate </em></strong>their strategy development. <strong><em>Don&#8217;t do this</em></strong>. An <strong><em>expert, objective facilitator, </em></strong>(whether an outside consultant or from the enterprise&#8217;s own strategy office) <strong><em>is absolutely essential to the success of each step in the cascading. </em></strong>Self-facilitated meetings are likely to create poor quality BSCs, or none at all. Another unwise approach is to have the strategy create the strategy map and measures for the subordinate organization, and simply provide it to them as a mandate. This easily alienates the subordinate organization to the entire process, and loses any possibility of true engagement with the change agenda.</p>
<p><strong><em>The &#8216;How&#8217; question is answered by the choice of facilitator</em></strong>. An expert facilitator makes good decisions about the process of creating the BSC on the basis of his or her past experience, and tailor the approach to the unique characteristics of each subordinate organization. <strong><em>There is no one right way to make or cascade strategy in an organization; sadly, there are many ways the process can go awry. </em></strong>Expert facilitation is insurance against bad outcomes.</p>
<p>We now return to the <a href="http://tenacioustortoise.com/index.php/2009/06/18/cascading-conundrums-i/">&#8216;When&#8217;</a> question. Leaders want to sustain the momentum of enterprise-level strategy development, and aggressively pursue rapid cascading. But <strong><em>the enterprise probably doesn&#8217;t have the facilitation capacity for too many such efforts simultaneously, and this is where dangerous shortcuts are likely to be considered.</em></strong> It is far better to develop a high-quality cascade over time than one that is rushed and poorly-executed. <strong><em>A carefully planned and executed cascade is an essential ingredient to an effective and sustainable strategic management effort. </em></strong></p>
<p>Agree with these ideas? Disagree? Seek clarification? <strong><em>Please comment below with your own cascading experience and questions.</em></strong> I hope we&#8217;ll have a robust dialog here.</p>
<p><a class="a2a_dd addtoany_share_save" href="http://www.addtoany.com/share_save#url=http%3A%2F%2Ftenacioustortoise.com%2Findex.php%2F2009%2F06%2F22%2Fcascading-conundrums-iii%2F&amp;title=Cascading%20Conundrums%20%26%238211%3B%20Part%20III">share or save this post</a> </p>]]></content:encoded>
			<wfw:commentRss>http://tenacioustortoise.com/index.php/2009/06/22/cascading-conundrums-iii/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Cascading Conundrums &#8211; Part II</title>
		<link>http://tenacioustortoise.com/index.php/2009/06/19/cascading-conundrums-ii/</link>
		<comments>http://tenacioustortoise.com/index.php/2009/06/19/cascading-conundrums-ii/#comments</comments>
		<pubDate>Fri, 19 Jun 2009 17:29:45 +0000</pubDate>
		<dc:creator>Robert S. Gold</dc:creator>
				<category><![CDATA[Change]]></category>
		<category><![CDATA[Communication]]></category>
		<category><![CDATA[Measurement]]></category>
		<category><![CDATA[Strategy]]></category>
		<category><![CDATA[Strategy Map Design]]></category>
		<category><![CDATA[balanced scorecard]]></category>
		<category><![CDATA[BSC]]></category>
		<category><![CDATA[cascade]]></category>
		<category><![CDATA[expectations]]></category>
		<category><![CDATA[hierarchy]]></category>
		<category><![CDATA[leadership]]></category>
		<category><![CDATA[matrix organization]]></category>
		<category><![CDATA[strategy map]]></category>

		<guid isPermaLink="false">http://tenacioustortoise.com/?p=843</guid>
		<description><![CDATA[In Part I of this topic, I asserted that cascading a balanced scorecard (BSC) across an organization is a process that requires careful planning, and thoughtful answers to the &#8216;When&#8217; and &#8216;Why&#8217; questions. I cautioned that hastily planned cascading can derail the entire change program. Here, we continue with the next question every leadership team [...]]]></description>
			<content:encoded><![CDATA[<p style="TEXT-ALIGN: justify">In <a href="http://tenacioustortoise.com/index.php/2009/06/18/cascading-conundrums-i/">Part I</a> of this topic, I asserted that cascading a balanced scorecard (BSC) across an organization is a process that requires careful planning, and thoughtful answers to the &#8216;When&#8217; and &#8216;Why&#8217; questions. I cautioned that hastily planned cascading can derail the entire change program. Here, we continue with <em><strong>the next question every leadership team should consider before cascading strategy across the organization</strong></em>.</p>
<p><span id="more-843"></span></p>
<h5 style="TEXT-ALIGN: justify">Look Beyond the Organization Chart to Answer the &#8216;Where&#8217; Question</h5>
<p style="TEXT-ALIGN: justify">The easy and obvious approach to deciding where to cascade in the organization entails looking at the organization chart, and deciding which business and support units should get their own BSCs. So simple and obvious that leaders miss the fact that <strong><em>there are other approaches that may be more effective.</em></strong></p>
<p style="TEXT-ALIGN: justify">When an organization&#8217;s structure changes slowly over time, it is usually due to the political pressure to preserve leadership roles for certain individuals, as well as the natural resistance to change. These are the organizations whose members see themselves as working in &#8216;silos.&#8217; <strong><em>The effect of a static organization structure may be to sub-optimize the organization&#8217;s effectiveness.</em></strong> The organization&#8217;s value proposition may need to evolve to meet external opportunities and challenges, but that evolution is constrained by an assumption that the existing structure is sacred. When decisions about the strategy itself are made in the context of the assumed permanence of the organization structure, it can be said that <strong><em>&#8216;Strategy Follows Structure.&#8217;</em></strong> This is an <strong><em>unnecessary and prospectively costly constraint on the change program.</em></strong></p>
<p style="TEXT-ALIGN: justify">But <strong><em>some organizations restructure too frequently.</em></strong> There, the absence of certainty creates an underlying level of anxiety for staff members and managers, and <strong><em>valuable energy is devoted to personal political posturing</em></strong> (for the next re-org) <strong><em>instead of value creation</em></strong>. These organizations may be better poised to anticipate and respond to external opportunities and challenges, but I am not convinced. In one such client enterprise, a paralysis in accomplishing change resulted from the relative impermanence of people and groups.</p>
<p style="TEXT-ALIGN: justify">And <strong><em>some organizations use matrix structures</em></strong>. While not inherently dysfunctional (some matrixes actually do work!), this approach requires staff members and managers to hone their political skills to navigate the challenges of conflicting leadership messages. <strong><em>There is no doubt that matrix organizations are less efficient</em></strong>, due to the overhead cost of overlapping (and sometimes competing) management structures.  </p>
<p style="TEXT-ALIGN: justify">The controlling principle for answering the &#8216;Where&#8217; question should be <strong><em>&#8216;Structure Follows Strategy.&#8217; </em></strong>Look at the newly-hatched strategy at the enterprise level. Will success require different parts of the organization to work closely together across boundaries? Will existing political rivalries inhibit execution? <strong><em>If you could start from scratch, would you draw the organization chart the same way it is now?</em></strong> If you are answering yes to any of these questions, it may be best to <strong><em>use the cascading structure to blur or erase the existing boundaries, and create ad hoc overlay structures that align with strategic themes and objectives.</em></strong> Such &#8216;theme teams&#8217; have proven to be very effective in tearing down walls, creating better cooperation and partnerships across the enterprise. While it may not be possible to erase and redraw the incumbent organization structure, these cross-functional teams may become the primary leadership structure for accomplishing change, and can<strong><em> render the old silos irrelevant.</em></strong></p>
<p style="TEXT-ALIGN: justify">Sound scary? You bet. But the default approach of aligning strategy to the existing structure will <strong><em>serve to reinforce the existing structure, no matter how sub-optimal it may be.</em></strong> <strong><em>Cascading strategy can be a powerful tool for effecting (or inhibiting) positive change in an organization&#8217;s structure. </em></strong></p>
<p style="TEXT-ALIGN: justify">Another aspect of the &#8216;where&#8217; question is about depth. Of course, the size and diversity of the organization should be a key determinate, but <strong><em>as one goes deeper, the size of each group with its own BSC shrinks.</em></strong> It is impractical to have a BSC for a very small number of people, when the overhead of sustaining that BSC represents a significant fraction of the labor pool in the group. It is better to invest energy in <strong><em>integrating the strategy management system with individual employee performance management processes</em></strong>, in partnership with front-line managers and the HR organization. But that is a topic for another post. The best guidance on depth is to go only as deep through layers of the organization as absolutely necessary to ensure alignment and staff engagement. <strong><em>As the number of BSCs multiplies, so does the overhead cost of the strategic management system. </em></strong></p>
<p style="TEXT-ALIGN: justify">A final note about organizational geography: Some organization have such highly-entrenched functional and business units and hands-off management style that <strong><em>strategy at the enterprise level is too generic to offer meaningful guidance to subordinate units.</em></strong> An alternative approach to top-down cascading that has worked in these cases was dubbed <strong><em>&#8220;middle-up-down&#8221;</em></strong> by one of my colleagues. This approach entails enabling the <strong><em>subordinate units to create provisional strategy maps and measures and feed them up to enterprise-level leadership for a process of review and reconciliation</em></strong>, followed by a downward cascade that is informed by the reconciliation. Please comment below if you&#8217;d like to learn more about this approach in a future posting.</p>
<p style="TEXT-ALIGN: justify">Next: <strong><em><a href="http://tenacioustortoise.com/index.php/2009/06/22/cascading-conundrums-iii/">The Final Three Questions</a></em></strong></p>
<p><a class="a2a_dd addtoany_share_save" href="http://www.addtoany.com/share_save#url=http%3A%2F%2Ftenacioustortoise.com%2Findex.php%2F2009%2F06%2F19%2Fcascading-conundrums-ii%2F&amp;title=Cascading%20Conundrums%20%26%238211%3B%20Part%20II">share or save this post</a> </p>]]></content:encoded>
			<wfw:commentRss>http://tenacioustortoise.com/index.php/2009/06/19/cascading-conundrums-ii/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Cascading Conundrums – Part I</title>
		<link>http://tenacioustortoise.com/index.php/2009/06/18/cascading-conundrums-i/</link>
		<comments>http://tenacioustortoise.com/index.php/2009/06/18/cascading-conundrums-i/#comments</comments>
		<pubDate>Thu, 18 Jun 2009 17:24:17 +0000</pubDate>
		<dc:creator>Robert S. Gold</dc:creator>
				<category><![CDATA[Change]]></category>
		<category><![CDATA[Communication]]></category>
		<category><![CDATA[Measurement]]></category>
		<category><![CDATA[Strategy]]></category>
		<category><![CDATA[Strategy Map Design]]></category>
		<category><![CDATA[balanced scorecard]]></category>
		<category><![CDATA[BSC]]></category>
		<category><![CDATA[cascade]]></category>
		<category><![CDATA[expectations]]></category>
		<category><![CDATA[hierarchy]]></category>
		<category><![CDATA[leadership]]></category>
		<category><![CDATA[strategy map]]></category>

		<guid isPermaLink="false">http://tenacioustortoise.com/?p=831</guid>
		<description><![CDATA[Cascading is a term that has been used in the balanced scorecard (BSC) community to describe the process of propagating the BSC across an organization. Although the term implies a downward movement (through the organization&#8217;s hierarchy), propagation in any direction has come to be referred to as &#8216;cascading.&#8217; Some people mistakenly apply the term to [...]]]></description>
			<content:encoded><![CDATA[<p style="TEXT-ALIGN: justify"><strong><em>Cascading</em></strong> is a term that has been used in the balanced scorecard (BSC) community to describe the process of propagating the BSC across an organization. Although the term implies a downward movement (through the organization&#8217;s hierarchy), propagation in any direction has come to be referred to as &#8216;cascading.&#8217; Some people mistakenly apply the term to the strategy communication process; after all, they reason, communication of strategy also cascades through the organization, and is certainly related to BSC propagation. But I believe that cascading and communication are two separate processes, especially since <a href="http://tenacioustortoise.com/index.php/category/communication/">communication</a> is absolutely essential to the change process, <strong><em>while cascading is not always necessary or beneficial. And poorly-planned cascading can derail the change program.</em></strong></p>
<p><span id="more-831"></span></p>
<p style="TEXT-ALIGN: justify">Many cascades follow a basic pattern: a BSC (consisting of a strategy map and associated measures) is developed for the organization as a whole, then subordinate maps and / or measures are developed for each subordinate business unit and support organization (such as Information Technology and Human Resources). <strong><em>But the predictable pattern quickly disappears.</em></strong> Subordinate organizations may be required or allowed to choose to replicate or adapt the higher level strategy map and measures, or given the freedom to create an entirely new BSC. Unfortunately, <strong><em>there is often too little time and energy invested in understanding and making good decisions about cascading</em></strong>, and <strong><em>there are no well-established rules</em></strong>. The objective of this post is to outline the key questions that should be considered when planning to cascade BSCs in any organization.</p>
<h5 style="TEXT-ALIGN: justify">Ask the &#8216;When&#8217; Question First</h5>
<p style="TEXT-ALIGN: justify">Before considering any of the other questions, <strong><em>leaders should consider the timing of cascading</em></strong>. In their enthusiasm to leverage a newly-hatched strategy map, they may mandate that business unit cascades be completed quickly; unsurprisingly, rapid cascading is the default recommendation of outside consultants (<em>mea culpa</em>). <strong><em>But rapid cascading has its drawbacks.</em></strong> The enterprise-level strategy map may lose relevance in the shadow of those created for business units. That outcome is probably okay if the enterprise is operating as a holding company, but more often than not, the enterprise seeks to leverage strategic objectives across business and operating units. When this is the case, <strong><em>there is a large benefit in broadly socializing the enterprise-level change agenda across the entire organization before enabling the subordinate units to participate in the cascade</em></strong>. Not only does this enhance the credibility of the change program, but it avoids the risk of forcing a subordinate organization to cascade before its leaders are ready.</p>
<p style="TEXT-ALIGN: justify">But the best reason to manage the timing of the cascade is to <strong><em>enable leaders to understand and carefully consider their approach to cascading, and make informed decisions</em></strong>. But it is easy for leaders to assume they instinctively know the best way to cascade, and to want to sustain the momentum of their initial work.</p>
<p style="TEXT-ALIGN: justify">Of course, the vary real risk in not rapidly cascading is to lose executive level buy-in for the change program. <strong><em>Leaders should be encouraged to publicly commit to a cascading process, but avoid releasing details of the cascading approach.</em></strong> Public commitment reduces (but does not eliminate) the risk of losing support, and buys the critical time and flexibility necessary for leaders to make those informed decisions.</p>
<h5 style="TEXT-ALIGN: justify">Reach Agreement on the &#8216;Why&#8217; Question</h5>
<p style="TEXT-ALIGN: justify">Leaders who have agreed to undertake a change program using the BSC will easily agree that cascading is a good idea. But <strong><em>challenging them to describe their expectations of cascading</em></strong> will probably yield different answers and valuable insights into each leader&#8217;s management style. <strong><em>Why cascade?</em></strong> The easy answer comes from Kaplan and Norton&#8217;s <a href="http://amzn.com/1578512506">Strategy-Focused Organization</a>: to align the organization to the strategy. But what does alignment mean? To some, it means instituting a control and feedback regime that entails populating the measures on the enterprise scorecard. To others, it means enabling and empowering subordinate units to escape from bland and imprecise objectives at the enterprise level, and to &#8220;get it right&#8221; for the subordinate organization. Others may only see the cascaded BSC as an emblem of organizational status, and are most likely to volunteer their subordinate organization to &#8216;go first&#8217; in leading the cascading effort. Some may confuse or conflate the optional cascading process with the necessary change communication program, as mentioned above.</p>
<p style="TEXT-ALIGN: justify">While there is some merit to each of these expectations, <strong><em>it is vital that leaders express and agree to their expectations for the cascading process. </em></strong>A shared answer to the &#8216;Why&#8217; question informs the remaining decisions on cascading, and enables executives&#8217; expectations to be realized.</p>
<p style="TEXT-ALIGN: justify">Next: <strong><em><a href="http://tenacioustortoise.com/index.php/2009/06/19/cascading-conundrums-ii/">The &#8216;Where&#8217; Question</a></em></strong></p>
<p><a class="a2a_dd addtoany_share_save" href="http://www.addtoany.com/share_save#url=http%3A%2F%2Ftenacioustortoise.com%2Findex.php%2F2009%2F06%2F18%2Fcascading-conundrums-i%2F&amp;title=Cascading%20Conundrums%20%E2%80%93%20Part%20I">share or save this post</a> </p>]]></content:encoded>
			<wfw:commentRss>http://tenacioustortoise.com/index.php/2009/06/18/cascading-conundrums-i/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>The Motivating Power of Measurement</title>
		<link>http://tenacioustortoise.com/index.php/2009/06/08/motivating-power-of-measurement/</link>
		<comments>http://tenacioustortoise.com/index.php/2009/06/08/motivating-power-of-measurement/#comments</comments>
		<pubDate>Mon, 08 Jun 2009 16:36:16 +0000</pubDate>
		<dc:creator>Robert S. Gold</dc:creator>
				<category><![CDATA[Change]]></category>
		<category><![CDATA[Leadership]]></category>
		<category><![CDATA[Measurement]]></category>
		<category><![CDATA[Atul Gawande]]></category>
		<category><![CDATA[balanced scorecard]]></category>
		<category><![CDATA[BSC]]></category>
		<category><![CDATA[childbirth]]></category>
		<category><![CDATA[Economist]]></category>
		<category><![CDATA[Hawthorne effect]]></category>
		<category><![CDATA[motivation]]></category>
		<category><![CDATA[New Yorker]]></category>
		<category><![CDATA[Virginia Apgar]]></category>

		<guid isPermaLink="false">http://tenacioustortoise.com/?p=674</guid>
		<description><![CDATA[Practitioners and fans of the balanced scorecard concept understand that measurement has the power to motivate behavior. The great challenge in driving change in any organization isn&#8217;t just to change the culture, but to change the behavior of individuals and groups inside the organization. Performance measurement doesn&#8217;t just tell us how well we&#8217;re doing at [...]]]></description>
			<content:encoded><![CDATA[<p style="text-align: justify;">Practitioners and fans of the balanced scorecard concept understand that measurement has the power to motivate behavior. The great challenge in driving change in any organization isn&#8217;t just to change the culture, but to <strong><em>change the behavior of individuals and groups inside the organization</em></strong>. Performance measurement doesn&#8217;t just tell us how well we&#8217;re doing at achieving a desired outcome, the <strong><em>very process of measurement and communication of measure results actually changes behavior</em></strong>.</p>
<p><span id="more-674"></span></p>
<p style="text-align: justify;">A brief detour: when thinking about behavioral change in the workplace, you may be reminded of the <a href="http://en.wikipedia.org/wiki/Hawthorne_effect">Hawthorne Effect</a>, a term referring to a famous experiment in the 1920s where factory workers productivity was found to improve when the lighting level in the factory was increased. Paradoxically, productivity also improved when the lighting level was subsequently <em>decreased</em>. The summary explanation for the effect suggested that the <strong><em>productivity gain among the factory workers was simply due to the motivational effect of the interest being shown in them</em></strong>. Well, there is a new development: according to an <a href="http://www.economist.com/finance/displaystory.cfm?story_id=13788427">article</a> in this week&#8217;s <a href="http://economist.com/">Economist</a>, &#8220;idiosyncrasies in the way the experiments were conducted may have led to misleading interpretations of what happened.&#8221; In other words, <strong><em>the Hawthorne effect may not be true</em></strong>.</p>
<p style="text-align: justify;">Notwithstanding new doubt about the Hawthorne effect, a compelling example of the power of measurement to change behavior comes from the world of medicine and public health. As detailed in an extensive <a href="http://www.newyorker.com/archive/2006/10/09/061009fa_fact">2006 New Yorker article</a> by Atul Gawande, an unlikely revolutionary named <a href="http://en.wikipedia.org/wiki/Virginia_Apgar">Virginia Apgar</a> transformed obstetrics and the nature of childbirth by devising a simple standard for <a href="http://en.wikipedia.org/wiki/Apgar_score">scoring</a> the health of a newborn baby at one, five, and sometimes ten minutes after birth. According to the New Yorker article (emphasis added):</p>
<blockquote>
<p style="text-align: justify;">The score was published in 1953, and it <strong><em>transformed child delivery</em></strong>. It turned an intangible and impressionistic clinical concept-the condition of a newly born baby-into a number that people could collect and compare. Using it required observation and documentation of the true condition of every baby. Moreover, <strong><em>even if only because doctors are competitive, it drove them to want to produce better scores-and therefore better outcomes-for the newborns they delivered</em></strong>.</p>
</blockquote>
<p style="text-align: justify;">Before Apgar scoring, babies delivered prematurely and with critical neonatal problems were often assumed to be not viable, and simply left to perish. The Apgar score, and the competition it produced, motivated doctors to take already understood steps to aid low-scoring newborns. The impact on neonatal mortality and survival has been astonishing. Again from the article:</p>
<blockquote>
<p style="text-align: justify;">In the United States today, a full-term baby dies in just one out of five hundred childbirths, and a mother dies in one in ten thousand. If the statistics of 1940 had persisted, fifteen thousand mothers would have died last year (instead of fewer than five hundred)-and a hundred and twenty thousand newborns (instead of one-sixth that number).</p>
</blockquote>
<p style="text-align: justify;">A simple measurement changed the behavior of medical professionals, and by extension, the hospitals in which they worked. The outcome of the behavior change is the survival of millions of babies. <strong><em>Carefully chosen and communicated measures have the power to change behavior and outcomes.</em></strong> This is the foundation for the design of every change program driven by the balanced scorecard.</p>
<p><a class="a2a_dd addtoany_share_save" href="http://www.addtoany.com/share_save#url=http%3A%2F%2Ftenacioustortoise.com%2Findex.php%2F2009%2F06%2F08%2Fmotivating-power-of-measurement%2F&amp;title=The%20Motivating%20Power%20of%20Measurement">share or save this post</a> </p>]]></content:encoded>
			<wfw:commentRss>http://tenacioustortoise.com/index.php/2009/06/08/motivating-power-of-measurement/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>

