Tag Archives: Capability studies

FIFA and the Iron Law of Oligarchy

Posted on by
Reply

Йозеф Блаттер.jpgIn 1911, Robert Michels embarked on one of the earliest investigations into organisational culture. Michels was a pioneering sociologist, a student of Max Weber. In his book Political Parties he aggregated evidence about a range of trade unions and political groups, in particular the German Social Democratic Party.

He concluded that, as organisations become larger and more complex, a bureaucracy inevitably forms to take, co-ordinate and optimise decisions. It is the most straightforward way of creating alignment in decision making and unified direction of purpose and policy. Decision taking power ends up in the hands of a few bureaucrats and they increasingly use such power to further their own interests, isolating themselves from the rest of the organisation to protect their privilege. Michels called this the Iron Law of Oligarchy.

These are very difficult matters to capture quantitavely and Michels’ limited evidential sampling frame has more of the feel of anecdote than data. “Iron Law” surely takes the matter too far. However, when we look at the allegations concerning misconduct within FIFA it is tempting to feel that Michels’ theory is validated, or at least has gathered another anecdote to take the evidence base closer to data.

But beyond that, what Michels surely identifies is a danger that a bureaucracy, a management cadre, can successfully isolate itself from superior and inferior strata in an organisation, limiting the mobility of business data and fostering their own ease. The legitimate objectives of the organisation suffer.

Michels failed to identify a realistic solution, being seduced by the easy, but misguided, certainties of fascism. However, I think that a rigorous approach to the use of data can guard against some abuses without compromising human rights.

Oligarchs love traffic lights

I remember hearing the story of a CEO newly installed in a mature organisation. His direct reports had instituted a “traffic light” system to report status to the weekly management meeting. A green light meant all was well. An amber light meant that some intervention was needed. A red light signalled that threats to the company’s goals had emerged. At his first meeting, the CEO found that nearly all “lights” were green, with a few amber. The new CEO perceived an opportunity to assert his authority and show his analytical skills. He insisted that could not be so. There must be more problems and he demanded that the next meeting be an opportunity for honesty and confronting reality.

At the next meeting there was a kaleidoscope of red, amber and green “lights”. Of course, it turned out that the managers had flagged as red the things that were either actually fine or could be remedied quickly. They could then report green at the following meeting. Real career limiting problems were hidden behind green lights. The direct reports certainly didn’t want those exposed.

Openness and accountability

I’ve quoted Nobel laureate economist Kenneth Arrow before.

… a manager is an information channel of decidedly limited capacity.

Essays in the Theory of Risk-Bearing

Perhaps the fundamental problem of organisational design is how to enable communication of information so that:

  • Individual managers are not overloaded.
  • Confidence in the reliable satisfaction of process and organisational goals is shared.
  • Systemic shortfalls in process capability are transparent to the managers responsible, and their managers.
  • Leading indicators yield early warnings of threats to the system.
  • Agile responses to market opportunities are catalysed.
  • Governance functions can exploit the borrowing strength of diverse data sources to identify misreporting and misconduct.

All that requires using analytics to distinguish between signal and noise. Traffic lights offer a lousy system of intra-organisational analytics. Traffic light systems leave it up to the individual manager to decide what is “signal” and what “noise”. Nobel laureate psychologist Daniel Kahneman has studied how easily managers are confused and misled in subjective attempts to separate signal and noise. It is dangerous to think that What you see is all there is. Traffic lights offer a motley cloak to an oligarch wishing to shield his sphere of responsibility from scrutiny.

The answer is trenchant and candid criticism of historical data. That’s the only data you have. A rigorous system of goal deployment and mature use of process behaviour charts delivers a potent stimulus to reluctant data sharers. Process behaviour charts capture the development of process performance over time, for better or for worse. They challenge the current reality of performance through the Voice of the Customer. They capture a shared heuristic for characterising variation as signal or noise.

Individual managers may well prefer to interpret the chart with various competing narratives. The message of the data, the Voice of the Process, will not always be unambiguous. But collaborative sharing of data compels an organisation to address its structural and people issues. Shared data generation and investigation encourage an organisation to find practical ways of fostering team work, enabling problem solving and motivating participation. It is the data that can support the organic emergence of a shared organisational narrative that adds further value to the data and how it is used and developed. None of these organisational and people matters have generalised solutions but a proper focus on data drives an organisation to find practical strategies that work within their own context. And to test the effectiveness of those strategies.

Every week the press discloses allegations of hidden or fabricated assets, repudiated valuations, fraud, misfeasance, regulators blindsided, creative reporting, anti-competitive behaviour, abused human rights and freedoms.

Where a proper system of intra-organisational analytics is absent, you constantly have to ask yourself whether you have another FIFA on your hands. The FIFA allegations may be true or false but that they can be made surely betrays an absence of effective governance.

#oligarchslovetrafficlights

Deconstructing Deming XI B – Eliminate numerical goals for management

Posted on by
6

11. Part B. Eliminate numerical goals for management.

W. Edwards Deming.jpgA supposed corollary to the elimination of numerical quotas for the workforce.

This topic seems to form a very large part of what passes for exploration and development of Deming’s ideas in the present day. It gets tied in to criticisms of remuneration practices and annual appraisal, and target-setting in general (management by objectives). It seems to me that interest flows principally from a community who have some passionately held emotional attitudes to these issues. Advocates are enthusiastic to advance the views of theorists like Alfie Kohn who deny, in terms, the effectiveness of traditional incentives. It is sad that those attitudes stifle analytical debate. I fear that the problem started with Deming himself.

Deming’s detailed arguments are set out in Out of the Crisis (at pp75-76). There are two principle reasoned objections.

  1. Managers will seek empty justification from the most convenient executive time series to hand.
  2. Surely, if we can improve now, we would have done so previously, so managers will fall back on (1).

The executive time series

I’ve used the time series below in some other blogs (here in 2013 and here in 2012). It represents the anual number of suicides on UK railways. This is just the data up to 2013.
RailwaySuicides2

The process behaviour chart shows a stable system of trouble. There is variation from year to year but no significant (sic) pattern. There is noise but no signal. There is an average of just over 200 fatalities, varying irregularly between around 175 and 250. Sadly, as I have discussed in earlier blogs, simply selecting a pair of observations enables a polemicist to advance any theory they choose.

In Railway Suicides in the UK: risk factors and prevention strategies, Kamaldeep Bhui and Jason Chalangary of the Wolfson Institute of Preventive Medicine, and Edgar Jones of the Institute of Psychiatry, King’s College, London quoted the Rail Safety and Standards Board (RSSB) in the following two assertions.

  • Suicides rose from 192 in 2001-02 to a peak 233 in 2009-10; and
  • The total fell from 233 to 208 in 2010-11 because of actions taken.

Each of these points is what Don Wheeler calls an executive time series. Selective attention, or inattention, on just two numbers from a sequence of irregular variation can be used to justify any theory. Deming feared such behaviour could be perverted to justify satisfaction of any goal. Of course, the process behaviour chart, nowhere more strongly advocated than by Deming himself in Out of the Crisis, is the robust defence against such deceptions. Diligent criticism of historical data by means of process behaviour charts is exactly what is needed to improve the business and exactly what guards against success-oriented interpretations.

Wishful thinking, and the more subtle cognitive biases studied by Daniel Kahneman and others, will always assist us in finding support for our position somewhere in the data. Process behaviour charts keep us objective.

If not now, when?

If I am not for myself, then who will be for me?
And when I am for myself, then what am “I”?
And if not now, when?

Hillel the Elder

Deming criticises managerial targets on the grounds that, were the means of achieving the target known, it would already have been achieved and, further, that without having the means efforts are futile at best. It’s important to remember that Deming is not here, I think, talking about efforts to stabilise a business process. Deming is talking about working to improve an already stable, but incapable, process.

There are trite reasons why a target might legitimately be mandated where it has not been historically realised. External market conditions change. A manager might unremarkably be instructed to “Make 20% more of product X and 40% less of product Y“. That plays in to the broader picture of targets’ role in co-ordinating the parts of a system, internal to the organisation of more widely. It may be a straightforward matter to change the output of a well-understood, stable system by an adjustment of the inputs.

Deming says:

If you have a stable system, then there is no use to specify a goal. You will get whatever the system will deliver.

But it is the manager’s job to work on a stable system to improve its capability (Out of the Crisis at pp321-322). That requires capital and a plan. It involves a target because the target captures the consensus of the whole system as to what is required, how much to spend, what the new system looks like to its customer. Simply settling for the existing process, being managed through systematic productivity to do its best, is exactly what Deming criticises at his Point 1 (Constancy of purpose for improvement).

Numerical goals are essential

… a manager is an information channel of decidedly limited capacity.

Kenneth Arrow
Essays in the Theory of Risk-Bearing

Deming’s followers have, to some extent, conceded those criticisms. They say that it is only arbitrary targets that are deprecated and not the legitimate Voice of the Customer/ Voice of the Business. But I think they make a distinction without a difference through the weasel words “arbitrary” and “legitimate”. Deming himself was content to allow managerial targets relating to two categories of existential risk.

However, those two examples are not of any qualitatively different type from the “Increase sales by 10%” that he condemns. Certainly back when Deming was writing Out of the Crisis most OELs were based on LD50 studies, a methodology that I am sure Deming would have been the first to criticise.

Properly defined targets are essential to business survival as they are one of the principal means by which the integrated function of the whole system is communicated. If my factory is producing more than I can sell, I will not work on increasing capacity until somebody promises me that there is a plan to improve sales. And I need to know the target of the sales plan to know where to aim with plant capacity. It is no good just to say “Make as much as you can. Sell as much as you can.” That is to guarantee discoordination and inefficiency. It is unsurprising that Deming’s thinking has found so little real world implementation when he seeks to deprive managers of one of the principle tools of managing.

Targets are dangerous

I have previously blogged about what is needed to implement effective targets. An ill judged target can induce perverse incentives. These can be catastrophic for an organisation, particularly one where the rigorous criticism of historical data is absent.

Deconstructing Deming VIII – Drive out fear

Posted on by
Reply

8. Drive out fear.

W Edwards Deming Point 8 of Deming’s 14 Points and quite my least favourite of all his slogans. As Harry Lime averred in the motion picture The Third Man:

Like the fella says, in Italy for 30 years under the Borgias they had warfare, terror, murder, and bloodshed, but they produced Michelangelo, Leonardo da Vinci, and the Renaissance. In Switzerland they had brotherly love – they had 500 years of democracy and peace, and what did that produce? The cuckoo clock.

It’s a wisecrack and not analysis but I quote Lime to remind myself that fear isn’t inevitably the debilitating sentiment that Deming made it out to be. Inspirational writer Helen Keller vividly captured an alternative reality.

Security is mostly a superstition. It does not exist in nature, nor do the children of humankind as a whole experience it. Avoiding danger is no safer in the long run than outright exposure. Life is either a daring adventure, or it is nothing at all.

In Out of the Crisis, Deming recounts several anecdotes of corrosive fear in the workplace. He directs his criticism at managers who threaten their subordinates with dire consequences for future outcomes that are, in fact, beyond the control of the workers. There is a recurring theme in Deming’s writing, and it is a good one, that many of the factors that determine an outcome are often outside the control of the person superficially held answerable. Any business process is influenced by diverse sources of variation. The aggregate of those sources determines the capability of the process and provides a fundamental bound on its future performance. An incapable process will never meet the aspirations of the business. Berating the person who works within it will never improve it because intervention is needed to re-engineer the process. Blind attempts to coax more out of an incapable process generally lead to over adjustment and even worse outcomes.

However, there have to be some people in an organisation for whom it wasn’t my fault isn’t available as an analysis of unsatisfactory outcomes. Some people willingly and enthusiastically own the goal of re-engineering the business process, of achieving higher and higher degrees of capability, of influencing the organisation’s environment, desensitising the system to external variation, of (following Eliyahu Goldratt) bringing the constraint back inside the system, fostering radical thinking, of managing unknown and unknowable risks.

Brian Joiner used to argue that it was wishful thinking to expect a prescribed outcome next year when the responsible manager had been incapable of achieving it last. Yet business is always a matter of resources and priorities. Typically, people do not energetically pursue objectives whose importance has not been urged upon them. They already have plenty to do. It is simply disingenuous to suggest that telling somebody that something is critical, and that they will be rewarded only for achieving it, is ultimately inexpedient.

Some people must manage and take responsibility for outcomes. They are responsible for the business system. They can change it.

There is nothing wrong in holding those who have the power to effect change responsible for outcomes.

Alternatively, some employees are responsible principally for operating a process in a disciplined and repeatable way. They are not responsible if that process is ultimately incapable but they are answerable for any lack of discipline. Their managers expect them to operate in a disciplined way, so do their co-workers. They should have no comfort that safety and security will be the consequence of failure to do their job.

Those workers will though, I fear, not be able to rest easily just because they turn up and do their job conscientiously. If management fail to take on the goal of the continual improvement of the alignment between the voice of the process and the voice of the customer then their diligence will be in vain. As business leader Ian MacGregor observed:

Management is a calling and people ought to be dedicated to it. British managers have far too much security. A poor manager should be dumped. What’s at stake is the happiness of society, not the comfort of managers.

How to use data to scare people …

Posted on by
Reply

… and how to use data for analytics.

Crisis hit GP surgeries forced to turn away millions of patients

That was the headline on the Royal College of General Practitioners (“RCGP” – UK family physicians) website today. The catastrophic tone was elaborated in The (London) Times: Millions shut out of doctors’ surgeries (paywall).
Blutdruck.jpg
The GPs’ alarm was based on data from the GP Patient Survey which is a survey conducted on behalf or the National Health Service (“NHS”) by pollsters Ipsos MORI. The study is conducted by way of a survey questionnaire sent out to selected NHS patients. You can find the survey form here. Ipsos MORI’s careful analysis is here.

Participants were asked to recall their experience of making an appointment last time they wanted to. From this, the GPs have extracted the material for their blog’s lead paragraph.

GP surgeries are so overstretched due to the lack of investment in general practice that in 2015 on more than 51.3m occasions patients in England will be unable to get an appointment to see a GP or nurse when they contact their local practice, according to new research.

Now, this is not analysis. For the avoidance of doubt, the Ipsos MORI report cited above does not suffer from such tendentious framing. The RCGP blog features the following tropes of Langian statistical method.

  • Using emotive language such as “crisis”, “forced” and “turn away”.
  • Stating the cause of the avowed problem, “lack of investment”, without presenting any supporting argument.
  • Quoting an absolute number of affected patients rather than a percentage which would properly capture individual risk.
  • Casually extrapolating to a future round number, over 50 million.
  • Seeking to bolster their position by citing “new research”.
  • Failing to recognise the inevitable biases that beset human descriptions of past events.

Humans are notoriously susceptible to bias in how they recall and report past events. Psychologist Daniel Kahneman has spent a lifetime mapping out the various cognitive biases that afflict our thinking. The Ipsos MORI survey appears to me rigorously designed but no degree of rigour can eliminate the frailties of human memory, especially about an uneventful visit to the GP. An individual is much more likely to recall a frustrating attempt to make an appointment than a straightforward encounter.

Sometimes, such survey data will be the best we can do and will be the least bad guide to action though in itself flawed. As Charles Babbage observed:

Errors using inadequate data are much less than those using no data at all.

Yet the GPs’ use of this external survey data to support their funding campaign looks particularly out of place in this situation. This is a case where there is a better source of evidence. The point is that the problem under investigation lies entirely within the GPs’ own domain. The GPs themselves are in a vastly superior position to collect data on frustrated appointments, within their own practices. Data can be generated at the moment an appointment is sought. Memory biases and patient non-responses can be eliminated. The reasons for any diary difficulties can be recorded as they are encountered. And investigated before the trail has gone cold. Data can be explored within the practice, improvements proposed, gains measured, solutions shared on social media. The RCGP could play the leadership role of aggregating the data and fostering sharing of ideas.

It is only with local data generation that the capability of an appointments system can be assessed. Constraints can be identified, managed and stabilised. It is only when the system is shown to be incapable that a case can be made for investment. And the local data collected is exactly the data needed to make that case. Not only does such data provide a compelling visual narrative of the appointment system’s inability to heal itself but, when supported by rigorous analysis, it liquidates the level of investment and creates its own business case. Rigorous criticism of data inhibits groundless extrapolation. At the very least, local data would have provided some borrowing strength to validate the patient survey.

Looking to external data to support a case when there is better data to be had internally, both to improve now what is in place and to support the business case for new investment, is neither pretty nor effective. And it is not analysis.

Bang! UK Passport Office hits the kerb

Posted on by
Reply

Her Majesty's Passport OfficeThe UK’s Passport Office is in difficulties. They have a backlog that is resulting in customers’ passport applications being delayed. This is not a mere internal procedural inconvenience. The public has noticed the problem and started complaining. Emergency measures are being put in place to deal with the backlog. Politicians have become involved and are looking over their shoulders at their careers.

It is a typical organisational mess. There is a problem. Resources are thrown at it. Personalities wager their reputations. Any hero able to solve the problem will be feted and rewarded. There will be blame and punishment. Solutions will involve huge cost. The costs will be passed on to the customer because, in the end, there is no one else to pay.

A suggestion for investigation

From the outside, it is impossible to know the realities of what has caused the problem at HM Passport Office. However, I think I can respectfully and tentatively suggest some questions to ask in any inquiry as to how the mess occurred.

  • Had any surprising variation in passport processing occurred before the crisis hit?
  • If so, what action, if any, was taken?
  • Why was the action ineffective?
  • If no surprising variation was observed, were the managers measuring “upstream” indicators of process performance in addition to mere volumes?
  • Was historic data routinely interrogated to find signals among the noise?
  • If signals were only observed once it was too late to protect the customer, was the issuing process only marginally capable?

“Managing the passport issuing process on historical data is like …”

… trying to drive a car by watching the line in the rear-view mirror.

Myron Tribus

And, of course, that is what HM Passport Office and every manager has to do. There is only historical data. There is no data on the future. You cannot see out of the windscreen of the organisational SUV. Management is about subjecting the historic experience base to continual, rigorous statistical criticism to separate signal from noise. It is about having a good rear view mirror.

A properly managed, capable process will operate reliably, well within customer expectations. In process management terms, the Voice of the Process will be reliably aligned with the Voice of the Customer.

Forever improving the capability of the process gives it the elbow room or “rattle space” within which signals can occur that the customer never perceives. Those signals could represent changes in customer behaviour, problems within the organisation, or external events that have an impact. But the fact that they are unnoticed by the customer does not mean those signals are unimportant or can be neglected. It is by taking action to investigate those signals when they are detected, and by making necessary adjustments to work processes, that a future crisis can be averted.

While the customer is unaffected, the problem can be thoroughly investigated, solutions considered calmly and alternative remedies tested. Because the problem is invisible to the outside world there will be no sense of panic, political pressure, cash-flow deficit, reputational damage or destruction of employee engagement. The matter can be addressed soundly and privately.

Continual statistical analysis is the “rear view mirror”. It gives an historical picture as to how well the Voice of the Process emulates the Voice of the Customer. Coupled with a “roadmap” of the business, some supportive data from the “speedometer” and a little basic numeracy, the “rear view mirror” enables sensible predictions to be made about the near future.

Without that historical data, properly presented on live process behaviour charts to provide running statistical insight, then there is no rear view mirror. That is when the only business guidance is the Bang! when the organisation hits the kerb.

It looks like that is what happened at HM Passport Office. Everything was fine until the customers started complaining to the press. Bang! That’s how it looks to the customer and that is the only reality that counts.

#Bang!youhitthekerb