By continuing to use the site you agree to our Privacy & Cookies policy

Your browser seems to have cookies disabled. For the best experience of this website, please enable cookies in your browser.


Your browser is no longer supported

For the best possible experience using our website we recommend you upgrade to a newer version or another browser.


How to improve quality of diagnosis

Little research exists into issues around GPs and acute clinicians getting diagnoses wrong. Ingrid Torjesen asks what the NHS is doing about this crucial quality issue

Key points

  • Misdiagnosis is the big fear for three in five patients seeing a GP.
  • Computerised diagnostic aids are now available for doctors.
  • Specialist advice may have to be called in earlier.

The rash that was in fact meningitis; the painful limb that turned out to be fractured; the cancer not picked up until it was too advanced to treat; or the aching shoulder that was actually a sign of Parkinson’s disease. All are serious examples of misdiagnosis.

Most people will have been misdiagnosed at some stage in their lives. The consequences may not have been fatal or caused permanent harm, but it would most certainly have delayed care and perhaps subjected that person to investigations or treatment they did not need. Not only will this have been unpleasant, it will have increased NHS costs and caused bottlenecks.

“Excessive testing might ensure serious conditions are unlikely to be missed, but it is not an indicator of good diagnostic skills”

The right diagnosis is vital because it determines the pathway a patient takes and ultimately the care they will receive. Diagnosis is a journey, rather than a single event, and begins when the patient is first assessed, usually in general practice. This initial decision will determine whether the patient needs further care and from whom.

A YouGov poll in 2005 found that one in five people had either been misdiagnosed in the previous five years or had a friend or relative who had been; three in five said being misdiagnosed was their biggest fear when seeing a GP.

These fears are not unfounded. While problems with diagnosis accounted for 9 per cent of patient complaints to the Healthcare Commission in 2007-08, they made up a quarter of complaints about general practice.

But, despite obvious concerns, little or no research appears to have been done on the quality of the GP consultation and diagnosis.

Not much more has taken place on diagnosis in hospitals. A review of 1,000 hospital admissions found that at least one adverse event was experienced by 8.7 per cent of patients and that 5 per cent of these were due to diagnostic error and preventable. Another review, of 840 emergency admissions, revealed five (0.6 per cent) had been diagnosed incorrectly - all by junior doctors.

Doctors make hundreds of diagnostic decisions every week, so it is not surprising that they get some wrong, particularly while training. But what is surprising is that there are no internationally agreed methods of assessing the quality of the consultation and diagnosis. It is usually only when something goes very badly wrong that the diagnostic journey is reviewed.

The National Patient Safety Agency has only looked at diagnosis in cancer. It reviewed the records of 141 patients who had died or been severely harmed, due to late diagnosis or misdiagnosis, to determine the contributing factors.

Rather than the timeliness of GP referrals, the focus was on the longest delays, which appeared to result from glitches in the reporting of test results, misinterpretation of tests, administrative errors and patients not being chased to be told the diagnosis if they did not attend.

Evidence suggests delays in GPs identifying and referring suspected cancer patients is one reason why the UK has poorer cancer outcomes than elsewhere in Europe and North America, so national cancer director Mike Richards has requested an audit of cancer diagnoses in primary care. This is being led by the Royal College of GPs.

Expensive diagnostic tests

Case note reviews occur more frequently in the US because it is more litigious and it has been estimated that 40,000-80,000 people die in US hospitals every year due to late or misdiagnosis. If those figures are extrapolated to the UK, purely on population, it would equate to somewhere between 8,000 and 16,000 - and that does not take account of the much readier access to expensive diagnostic tests in the US.

King’s Fund senior fellow Nick Goodwin says: “In the US a lot of the larger primary care units have MRI scanners and just because you have insurance they say we will just run you under. They do it because they have got the technology, because it is paid for and because it reduces their liability if something goes wrong, but it is tremendously more expensive by a factor of three or four.”

While excessive testing might ensure serious conditions are unlikely to be missed, it is certainly not an indicator of good diagnostic skills. Every investigation impacts on the patient’s holistic health; even with something as simple as a blood test there is a risk of infection.

Doctors in the US will often ask for “a full blood work-up”, says the British Medical Association’s GPs committee chair Laurence Buckman, whereas what are really needed are appropriate investigations.

“Any test that was normal because you did a battery of tests - that was an unnecessary test and a waste of resources and you should have known better,” says Dr Buckman.

While a specialist is automatically looking for something that is wrong, the generalist is focused on dealing with the 95 per cent of cases that can be treated with advice or a prescription or a non-urgent referral. Recognising conditions is becoming increasingly difficult for GPs because there is a greater variety to choose between, and many patients will have more than one.

Aneez Esmail, professor of general practice at Manchester University and an expert in diagnostic error in primary care, says circumstances also make it easier for hospital doctors to identify problems.

“You don’t that often get a problem misdiagnosed in hospital because you are seeing disease at a much further end of the spectrum in effect, where things are much clearer,” he says. Hospital doctors have many more tools available to them: blood tests and x-rays can be ordered, or a nurse asked to monitor the patient. A GP must make a judgement simply on the history and a short physical examination.

Only a tiny part of the NHS research budget goes into projects looking at diagnostic quality, but Professor Esmail points out that to be able to assess and improve the quality of diagnosis, it is important to understand how and why particular diagnoses are reached and the thinking processes involved.

“It is dependent on the individual clinician, their knowledge base and the context in which they are working,” he says.

It does not help that how to hone and improve diagnostic skills forms a very small part of the undergraduate medical curriculum. In Professor Esmail’s view even that is poorly taught.

Royal College of GPs chair Steve Field says GPs coming out of training are “competent”, but many are not “confident” because they have not had sufficient experience of the conditions they are coming across, so the college is pushing for longer training. For example, only trainees in Liverpool are currently guaranteed a placement in paediatrics, he says.

“We need to do more work looking at the quality of diagnosis and referrals, we need to know more about what we are doing in primary care because when you start to look at that, and look at the variability, you can start to improve not just the bottom end of the curve but the lot,” says Professor Field.

Something sinister

When a patients first presents, the most important thing is for the GP to pick up when a symptom such as an ache, pain or rash is not a minor problem but a manifestation of something more sinister.

Computerised diagnostic aids are now available to prompt doctors to consider conditions they may not have thought of. One of these is Isabel, with information on more than 10,000 conditions.

Isabel Healthcare chief executive Jason Maude says there is no requirement for doctors to note the conditions they have considered and discounted.

“There is a tendency for people to think about one or two things and then forget the third or fourth thing that could be extremely important,” he says.

He asks: “How can you talk about quality and not talk about diagnosis? It is like aviation safety looking at every aspect of aviation except take-off.”

Doctors frequently refer to reference books and the internet to check things out, says Professor Field, who admits he always carries the Oxford Handbook of General Practice. He adds: “Some GPs might find a computerised aid irritating and some GPs might find it helpful as part of their development.”

One GP who would find such an aid intensely irritating is Dr Buckman.

“I think it is very dangerous to have computerised fail-safe mechanisms,” he says. “You have to have doctors who are competent and know their limits. You should not be doing something if you need to be reminded what to do; if you need to be reminded you need to educate yourself so you don’t.

“I am not anti rule book, I just think the rule book has to be written in such a way that it allows for variation. Otherwise, you end up with a pathway you can’t get off.”

Mr Goodwin says the consultation is the key to a quality diagnosis. He believes that the doctor often focuses on the main symptom being presented rather than looking for other associated signs.

“If you were able to collect all of the range of the presenting conditions that someone comes to you with, which is quite difficult to do in a consultation of five or 10 minutes, you are more able to make a more accurate and reasoned diagnosis,” he says.

Longer GP consultations or referral to a long term conditions nurse to collect a fuller history could help. Patients should also be educated, through initiatives like health coaching schemes, in how to have a good consultation by presenting everything they feel is wrong with them. The threshold at which GPs get more specialist advice might also need to be reduced if diagnostic quality is to be improved, Mr Goodwin adds. This does not necessarily mean more hospital referrals, it could involve asking advice from or referring to a specialist doctor based in the practice or a telephone call.

Last month the King’s Fund announced plans to look at GP diagnosis as part of a wider inquiry into the quality of primary care. The aim is to develop indicators to assess and compare different practice and suggest ways in which it could be improved.

Of course, the ultimate audit of whether a diagnosis was correct is a post-mortem.

Royal College of Pathologists president Peter Furness says one study found major diagnostic discrepancies at post-mortem in one in five patients who died on an intensive care unit. These included undiagnosed bleeds, pulmonary embolisms, heart attacks and complications of infections which would have affected treatment.

“That is in patients on an intensive care unit,” he says. “What it is like out in the community, goodness only knows.”

Professor Furness adds that post-mortems are rarely carried out on patients who die at home because there is not a clear NHS mechanism for how the body should be transported to a mortuary.

Doctors used to request post-mortems more frequently when they were not sure that what they were putting on patients’ death certificates was correct. However, Professor Furness reveals that doctors mistakenly believe discrepancies occur less often these days because of improved and increased availability of diagnostic techniques.

“The direct evidence does not indicate that there has been a reduction in the number of discrepancies between pre- and post-mortem diagnoses, despite the improvement in imaging and diagnostic techniques,” he says.

A reluctance in society to interfere with bodies after death, bound up loosely with concepts of human rights and dignity, and heightened by the Alder Hey and Bristol organ retention scandals, has also contributed to the fall in post-mortems.

In 1999, before the scandals’ peak, post-mortems were carried out on 6 per cent of patients who died in hospital in Leicester, but in 2001 it was just 1 per cent. The same audit shows it was not relatives refusing consent - 51 per cent in 1999 agreed compared with 49 per cent in 2001 - but doctors not asking for it.

Not surprisingly, doctors who regularly have to consider asking for consent find it a difficult process. BMA consultants committee chair Jonathan Fielden says: “It is something you have to do very carefully. It is not a simple exercise to say we will just increase the number of post-mortems. Although it would give us more information, there is a knock-on effect for families.”

Vast amounts of data are already picked up through clinical governance systems, complaints and monitoring tools, Dr Fielden adds. “What we need to do,” he says, “is continually drive up quality by building systems to turn this vast amount of data into information that is then made available to more clinicians. The problem is that has not been, until very recently, a priority for the health service.”

Getting it right at Rotherham General

Rotherham General Hospital foundation trust is conducting an analysis of the quality of diagnosis in its accident and emergency department. The main aim is to reduce the number of delayed and wrong diagnoses, such as missed fractures and conditions where deterioration is not spotted promptly, flagged up by the serious untoward incident system.

Trisha Bain, deputy chief of quality and standards at Rotherham General Hospital, says that, as well as getting the right diagnosis quickly, it is also about reducing variations in diagnosis. The InterQual tool has identified that quite a high proportion of patients are not meeting the set admission criteria and some are staying in hospital much longer than expected.

“We were thinking is that is an issue around diagnosis as well,” she says.

The analysis involves an in-depth case note review of 50 patients readmitted within six months by a multidisciplinary team using the global trigger tool to ascertain whether any diagnostic errors contributed to the readmission. Diagnostic errors will also be looked for specifically in the 20 randomly selected case notes already reviewed for incidents every month and through existing mortality review processes.

The team will consider whether diagnosis was made promptly and correctly, whether the right investigations were carried out and on time, who made the initial diagnosis - a junior doctor or a consultant - and whether a consultant later changed the junior doctor’s diagnosis.

An aggregate root cause analysis will be conducted on cases where there appear to have been diagnostic issues to identify common themes.

Dr Bain says: “We hope that by looking at it in various ways and through different tools we should be able to pick up some general themes.

“We imagine it will be things like timeliness of tests, who is actually making the decisions, is it junior doctors, and does the diagnosis get changed when a consultant reviews the case.”

Readers' comments (5)

  • Medicine is an art and not a pure science. Many times when patients go to see the doctors they may have early stages of illness and it is humanly impossible to diagnose the disease if the patient doesn't have any sign or symptoms of the illness at the time when the doctor sees them.
    It is equally important that common presentations of serious and rare illnesses at an early stage are common for some simple and common illnesses. Doctors are not Gods neither we have crystal ball which can help us make the right diagnosis every tine in every patient.
    During my life time as a doctor, I would probably see 200,000 patients. Even if I get it right 99.9% of the time, I will still make mistakes with 200 patients and even if 99.9% don’t come to any harm, my mistake will harm 1 or 2 patients! Should I be punished, should I lose my job, should I be criminalized for that?
    Of course, even one death of a patient due to doctor's mistake is acceptable and it is important we all learn from lessons. Doctors make mistakes not because they deliberately set out to make mistakes but it happens. There are many reasons for it and too early presentation is one of the common one that too when seen by GPs or in A&E. I commend my GP colleagues but the society as to understand that doctors are simply human beings and will make mistakes. What we got to do is to understand the reasons, learn lessons and help them to be better doctors and not punish them.
    Of course, if there are doctors who are dodgy doctors, who show gross disregard for patient safety or who fail to learn lessons from their mistakes or one who covers it up; should be punished.
    This is what I teach my junior doctors;
    10 rules which doctors must follow:

    1. Always take a good history and examine properly.
    2. Document clearly as to what history you have taken and what examination you have done.
    3. Beware of complaints like fever and rash, acute severe chest pain, acute severe headache, vomiting bile, fever with severe headache, patient who is progressively sleepy for more than 8 hours during the day time, acute backache, who vomits bile, severe acute tummy ache and so on. These are warning symptoms.
    4. Remember rule of 3 days – within 3 days you will have a diagnosis or your patient will die in any acute illness. So ask patients to keep in touch with you if the patient has any acute symptoms.
    5. Learn from mistakes. Be honest and sincere with your patients and if you have made a mistake then tell them honestly and apologies. Patients are willing to forgive you if you are honest and sincere. If you try to cover it up then you are unfit to be a doctor and your patients will be angry and rightly so.
    6. Never blame your patients if you make a mistake.
    7. Always take a good medication history so that you won’t give any drug which can damage your patients’ health.
    8. Be careful about any history of allergy.
    9. Always work with your patients to find the best treatment for them. They who got to live with the consequences.
    10. Always treat your patients with respect, dignity and courtesy. Involve them in any decision making.

    Unsuitable or offensive?

  • A recent BMJ study formally described the diagnostic strategies used by GPs and, for 70% of consultations, the strategy depended heavily on their memory. Medicine has got too complex for this and the point that the HSJ article makes well is that delays in diagnosis are a major issue but there are tools available now which can help such as Isabel ( which has been tried and tested over many years. We know that GPs have a difficult but crucial role in early diagnosis but they will be remiss if they do not consider tools that are validated and readily available to help them.

    Unsuitable or offensive?

  • Sorry this is a long post but it is very important that you read this and take in what I am saying. Especially because you who are involved with diagnosis are paid very highly indeed.
    Medicine in NOT an ART it is a branch of Engineering Science. Diagnosis is a skill that can be learned by trial and error and experience to some degree but it can also be taught. The medical profession could learn a considerable amount from other branches of engineering which use diagnostic techniques and actually teach diagnostics/fault finding a subject in its own right. Electronic engineering being one of many.
    For instance have you heard of the "Half Split Method"? if not ask yourself why not?

    I have been misdiagnosed several times by doctors who obviously do not understand how the human body works. Before you can diagnose anything you have to have a very good understanding of how it is supposed to work. In total.

    How many GPs know anything about "backs" for example. If a patient has a back problem they just don't want to know but the spine and spinal cord is a vital part of the working body connecting arguably the most vital organ the BRAIN to the rest of the body.
    In my case I am very unhappy with the number of times my symptoms have been misdiagnosed so here follows just some of my personal bad experiences with the NHS.

    1. I had a detached ligament in my lower back diagnosed as lower back pain and was sent to physiotherapy and given various exercises which made it worse. in the end I had to self diagnose and I decided to totally rest my back and not even bend over for 5 days which allowed the ligament to reattach and heal perfectly, FIXED FOREVER no problems since.

    2. I have had attacks of rapid heart rate intermittently for 35 years and never diagnosed despite going to the GP many times. And guess what? There is a recording device that I could have been given to take with me at all times and record the attacks as they happened. So the excuse that the attacks could not be recorded was incorrect. I have recently had a heart attack due to this condition which I was told was harmless despite no diagnosis. It could have been avoided if only I had been diagnosed properly. I am very annoyed to say the least.

    3. I went back into hospital with chest pain and spent 5 days in agony at times and on oxygen only to be discharged with "NON SPECIFIC CHEST PAIN".
    What sort of diagnosis is that?
    I self diagnosed myself from my symptoms and by using GOOGLE. I had pericarditis. This was made worse by lying on my back in a hospital bed and eased by sitting, leaning forward.
    My GP said pericarditis was unlikely because it is rare. However after 5 days in a cardiac ward without an answer I would have thought that any logical person would be looking for a rare condition! Just because something is rare does not mean a patient can not have it!

    What an unusual story you might think. But no, I hear the same complaints from everyone I meet who has had the pleasure of going to the GP or having NHS hospital treatment.
    If the condition is trivial like a broken finger then fine, but anything more complicated is a "We don't know" or "No one knows what the cause is" even though a bit of careful detective work and understanding of the human body would provide an answer to the cause in many cases.

    Treat the cause, not the symptoms.

    Take it from me as a person experienced in advanced diagnostic techniques, NHS, you are ****. I am sure you can fill in the letters to make an appropriate word to describe how bad you are at diagnosing ailments.
    So you are very right to have this discussion, you might just learn something at last.

    Unsuitable or offensive?

  • I think the contribution from Dr Umesh Prabhu is the nicest I have ever read in the comments system. Despite the case I have just read for medicine as an arm of engineering science I still tend to agree with him. The pscyhi, even the soul, can have quite a dramatic effect on the human body which is not fully understood yet by science or art.

    Unsuitable or offensive?

  • In answer to Anonymous,
    I would much rather have the cause of my illness treated and cured than have a doctor be nice to me and leave me in pain.
    Personally my soul feels much better when my body is not ill. So when I am ill I like to be diagnosed and cured as quickly as possible.
    In the engineering world misdiagnosis is not a luxury we can afford. And in many cases we have to diagnose not only the equipment but the human user also. Either machine or human could be the cause of the problem and engineers need to have people skills these days.
    The advantages of taking the engineering approach would be as follows.

    1) Engineers do not suffer from information overload in fact they lap it up, they are information geeks and they need all the information they can get, the more information the better. I have never had a problem where I was given too much information. Not so with doctors, 2 or 3 symptoms seem to be their limit!
    2) Engineers are not techno phobic in fact I used to work with two desk top computers or more at a time if I could get my hands on them and so did my colleagues.
    3) Engineers are not fazed by diagnostic equipment and learn new skills very quickly indeed.
    4) Engineers look for the cause of the problem whereas NHS doctors generally treat the symptoms. If you find the cause of the problem no matter how strange that cause may be, the problem can be treated and cured.
    5) Engineers are open minded; they have to be in a zero tolerance commercial environment. Every problem has to be fixed no matter how complex and the time restraint is usually no more than a day at most. Zero tolerance to misdiagnosis works! If you get it wrong money is lost and your boss will not be pleased not to mention what the customer might say about the matter. Get it wrong twice and your present employment will cease very quickly. For instance how would you feel if your bank's computers crashed and no one could get them to work again? Supposing you rang your bank and they told you that no one could have their wages because the computer had an "Unknown Fault". You would soon change your bank.

    Correct diagnosis is the very first step to treating all health problems. Get this right and huge amounts of public money can be saved. The NHS approach of "Try this", "Try that", "Try something else" is a money waster. And treating the symptoms never cured anyone.

    Getting the right diagnostic system in place and learning from the commercial engineering world could save the NHS bundles of money and make the UK population much healthier.

    In fact if the NHS does not change along these lines then I suspect that there will not even be an NHS in the near future and that would be sad.

    Unsuitable or offensive?

Have your say

You must sign in to make a comment.

Share this

Post a comment

Related images

Related Jobs

Sign in to see the latest jobs relevant to you!

Sign up to get the latest health policy news direct to your inbox