John Coakley on improving the patient experience

How can we improve customer care in the NHS? It is obviously important to seek the views of users of the service, its staff and the general public.

The patient survey as currently used by the Healthcare Commission would seem to be a reasonable starting point. Given that my hospital featured in the bottom 10, it would perhaps be unwise to be unduly defensive. Nevertheless, there are some points that have to be made. I should emphasise that only a fool would deny that the NHS needs to up its game in respect of consumer care.

In trying to improve the patient experience, one of the key drivers has to be the ability to motivate staff. When they recognise the validity of the points made, motivation becomes easy. The patient survey devised by the Picker Institute for the Healthcare Commission is designed to be developmental. It picks out many aspects of care that are important to patients (and to staff, of course) and then allows each trust to see where they stand and where they need to improve.

"Hospitals such as ours should move to an ethnically homogeneous area, close the A&E department and stop dealing with the generality of medicine"


There are, however, a number of problems with the way the current survey is used.

Questionable results

First, an "English only" postal survey carried out months in arrears and based on recollections is always likely to be problematic, particularly when a high proportion of the target population has a poor command of English and low educational attainment. One organisation with decades' experience of gauging public opinion suggests that London and trusts serving younger, more ethnically fractionalised populations face particular challenges when it comes to patient surveys. The reason for this is not yet fully understood.

Second, when results are presented as comparative data there is a problem. The current patient survey divides hospitals into the lowest and highest-scoring 20 per cent and the middle-scoring 60 per cent. Other surveys have been presented as interquartile ranges. No matter how such results are presented, statistically there will always be a bottom-performing percentage. This inevitably leads to the NHS as a whole being portrayed as failing large numbers of patients when it may be doing no such thing.

Third, the make-up of those responding means interpretation needs to be done carefully. As an example, around 25 per cent of our survey respondents said they waited more than four hours to be admitted from accident and emergency, whereas we know the overall figure to be around 2 per cent. This respondent population is thus very different from the general population of patients we admit and is therefore not representative.

Best practice

Ironically, when we have been inspected (often at short notice) by the Healthcare Commission in response to previous patient survey results, the commission has tended to support our view rather than the patient survey. Indeed, they have found evidence of "best practice" in some areas.

HSJ's report on the survey results quotes Healthcare Commission chief executive Anna Walker saying the lowest-performing trusts should look to the best for ideas.

In the absence of any useable qualitative information from the patient survey, it seems that hospitals such as ours should move to an ethnically homogeneous area, close the A&E department, stop dealing with the generality of medicine and surgery and opt instead for a well-defined range of life-saving treatments for dramatic diseases. That should work.

We need a tool that provides rapid, simple feedback from patients to staff in order to improve their performance. The current method is not helpful to those of us who wish to improve the patient experience.


Please note: In order to post a response you need to be registered on the site. You can register here.

Reader Response

I am sorry that the Picker is defensive about the survey. I find it helpful and use it a lot. I wasn’t making points about the survey, rather the use of it to create league tables and a name and shame culture.

I was not referring to IpsosMORI in suggesting ways we could improve our ratings, but to the HCC and the suggestion that those at the bottom should look up for guidance. Any institution or individual who suggests that there is a ‘weighting’ that can be applied so that the Brompton or Marsden (top ten) can be compared with Whittington (bottom ten) is naïve at the most charitable interpretation. They are hospitals, but then Bowls and Rugby League are sports.

The statement that ‘adjusting for age removes much of the ethnicity effect’ conceals that fact that ethnicity is broken down into only: White; Mixed; Asian or Asian British; Black or Black British; Chinese or other ethnic group. In Hackney I can think of at least 10 different ethnic groups described as white. It is not safe to assume that we can correct for this degree of multi-ethnicity.

I was also raising its uselessness as a means of changing behaviour. It's fantastic for beating people over the head with, particularly if the hospitals at the bottom are deemed to be failing without any predefined criteria for failure. It's rather like saying that 20% of the population is failing because they're under 5' 8".

Dr Coakley includes many misconceptions.

The analysis by Ipsos MORI to which he refers is interesting, but exploratory; its methods can be questioned; and its own conclusions do not support the assertion that population effects mean there is nothing that some trusts can do to improve patient experience scores, short of moving to a suburban, 'ethnically homogeneous area'.

In fact, Ipsos MORI concluded (check website)that population effects are strong in primary care, but:

''In the acute sector, it's a different story... the nature of the locality has much less impact.''

Therefore: ''there appear to be more opportunities for acute trusts to influence patient ratings regardless of where they are situated: patients' experience of the service they receive overrides the effects of local demographics.''

As for the figures published for trust comparisons, these are 'weighted' - adjusted for variations in age, gender and route of admission.

Adjusting for age removes much of the ethnicity effect.

Thus population variables have little influence on the comparisons.

Immediate, more frequent patient feedback can be highly valuable. The Picker Institute is running such a service with clients.

But it is an addition, not a replacement: the patient experience survey has the most proven, reliable and rigorous national methodology.

Don Redding, Picker Institute