Portfolio & delivery governance · Field note

The faster your review steps in, the better its rescues look

TL;DR

Many portfolio reviews step in each quarter where a project's numbers turn bad, and count the projects that come back as rescues that worked. But a project picked for a bad quarter is picked partly for swing that does not last. So it partly recovers, whatever the rescue did. The more readily a review steps in, the higher its turnaround rate. A stricter rule lowers it. Both hold whether or not the rescues help. The review's own line for stepping in holds the makings of a fairer test: compare projects just past the line with projects just short of it. That works as long as teams cannot steer their numbers around the line.

What the paper develops

The decision

Companies that move more capital between units over the medium to long term have earned higher returns [1]. Many portfolios also step in each quarter where a project's numbers turn bad. They add a recovery plan, more people or a new lead. When the project comes back, the rescue gets the credit. The share that come back becomes the review's record.

What a quarter's numbers contain

A study tracked cost efficiency on 155 US defense contracts [2]. Over the second half of each contract, the three-month figure stayed within a narrow band in only 6 percent of contracts. The running total since the start did so in 153 of the 155. So most of the quarterly movement did not last. A project picked for the worst number is picked partly for that swing. On average, it partly recovers, whatever the rescue did.

What the record shows

In 15 seasons of English Premier League football, clubs that changed manager gained 0.21 points per match on average. In matched seasons, the same clubs with a similar poor run and no change also gained 0.21 [4]. By the same logic, a number over a shorter period, a lower bar or looking more often picks more swing. So the turnaround rate rises whether or not rescues help. A stricter rule makes it fall.

What to do instead

Act at once on a change you can confirm without the numbers and expect to last. To judge what stepping in does, use your own line for stepping in. Projects just past it and just short of it looked almost the same when you decided. The line, not a guess about who would recover, decided which side each fell on [5]. Group projects by side of the line. Set the outcome in advance, on the original baseline. Over years of dips, look for a jump at the line. The test fails if teams can steer their numbers around the line.

What to do next

Stop judging rescues by the turnaround rate. Over years of dips, plot each project's later result against its reading when the board decided, and look for a jump at the trigger line, with the result fixed in advance and every project kept in its group.

Inside the white paper

  • Why you step in during the year
  • How much of a bad quarter lasts
  • Why the projects you pick will partly recover anyway
  • What happened when football clubs changed managers
  • Why a quicker trigger makes the record look better
  • "But a bad quarter can be a real warning"
  • How to tell whether stepping in works
  • Picking less swing in the first place
  • Other ways to respond
  • When it is worth the trouble

Sources and notes

  1. Stephen Hall, Dan Lovallo and Reinier Musters, McKinsey Quarterly — How to put your money where your strategy is (2012)
  2. David S. Christensen and Scott R. Heise, National Contract Management Journal — Cost Performance Index Stability (1993)
  3. Lucas M. Besters, Jan C. van Ours and Martin A. van Tuijl, De Economist — Effectiveness of In-Season Manager Changes in English Premier League Football (2016)
  4. David S. Lee and Thomas Lemieux, NBER Working Paper 14723 (published in the Journal of Economic Literature, 2010) — Regression Discontinuity Designs in Economics (2009)