Aletho News

Lies, Damned Lies and Health Statistics – the Deadly Danger of False Positives

By Dr Michael Yeadon | Lockdown Sceptics | September 20, 2020

I never expected to be writing something like this. I am an ordinary person, recently semi-retired from a career in the pharmaceutical industry and biotech, where I spent over 30 years trying to solve problems of disease understanding and seek new treatments for allergic and inflammatory disorders of lung and skin. I’ve always been interested in problem solving, so when anything biological comes along, my attention is drawn to it. Come 2020, came SARS-CoV-2. I’ve written about the pandemic as objectively as I could. The scientific method never leaves a person who trained and worked as a professional scientist. Please do read that piece. My co-authors & I will submit it to the normal rigours of peer review, but that process is slow and many pieces of new science this year have come to attention through pre-print servers and other less conventional outlets.

While paying close attention to data, we all initially focused on the sad matter of deaths. I found it remarkable that, in discussing the COVID-19 related deaths, most people I spoke to had no idea of large numbers. Asked approximately how many people a year die in the UK in the ordinary course of events, each a personal tragedy, they usually didn’t know. I had to inform them it is around 620,000, sometimes less if we had a mild winter, sometimes quite a bit higher if we had a severe ’flu season. I mention this number because we know that around 42,000 people have died with or of COVID-19. While it’s a huge number of people, its ‘only’ 0.06% of the UK population. Its not a coincidence that this is almost the same proportion who have died with or of COVID-19 in each of the heavily infected European countries – for example, Sweden. The annual all-causes mortality of 620,000 amounts to 1,700 per day, lower in summer and higher in winter. That has always been the lot of humans in the temperate zones. So for context, 42,000 is about ~24 days worth of normal mortality. Please know I am not minimising it, just trying to get some perspective on it. Deaths of this magnitude are not uncommon, and can occur in the more severe flu seasons. Flu vaccines help a little, but on only three occasions in the last decade did vaccination reach 50% effectiveness. They’re good, but they’ve never been magic bullets for respiratory viruses. Instead, we have learned to live with such viruses, ranging from numerous common colds all the way to pneumonias which can kill. Medicines and human caring do their best.

So, to this article. Its about the testing we do with something called PCR, an amplification technique, better known to biologists as a research tool used in our labs, when trying to unpick mechanisms of disease. I was frankly astonished to realise they’re sometimes used in population screening for diseases – astonished because it is a very exacting technique, prone to invisible errors and it’s quite a tall order to get reliable information out of it, especially because of the prodigious amounts of amplification involved in attempting to pick up a strand of viral genetic code. The test cannot distinguish between a living virus and a short strand of RNA from a virus which broke into pieces weeks or months ago.

I believe I have identified a serious, really a fatal flaw in the PCR test used in what is called by the UK Government the Pillar 2 screening – that is, testing many people out in their communities. I’m going to go through this with care and in detail because I’m a scientist and dislike where this investigation takes me. I’m not particularly political and my preference is for competent, honest administration over the actual policies chosen. We’re a reasonable lot in UK and not much given to extremes. What I’m particularly reluctant about is that, by following the evidence, I have no choice but to show that the Health Secretary, Matt Hancock, misled the House of Commons and also made misleading statements in a radio interview. Those are serious accusations. I know that. I’m not a ruthless person. But I’m writing this anyway, because what I have uncovered is of monumental importance to the health and wellbeing of all the people living in the nation I have always called home.

Back to the story, and then to the evidence. When the first (and I think, only) wave of COVID-19 hit the UK, I was with almost everyone else in being very afraid. I’m 60 and in reasonable health, but on learning that I had about a 1% additional risk of perishing if I caught the virus, I discovered I was far from ready to go. So, I wasn’t surprised or angry when the first lockdown arrived. It must have been a very difficult thing to decide. However, before the first three-week period was over, I’d begun to develop an understanding of what was happening. The rate of infection, which has been calculated to have infected well over 100,000 new people every day around the peak, began to fall, and was declining before lockdown. Infection continued to spread out, at an ever-reducing rate and we saw this in the turning point of daily deaths, at a grim press conference each afternoon. We now know that lockdown made no difference at all to the spread of the virus. We can tell this because the interval between catching the virus and, in those who don’t make it, their death is longer than the interval between lockdown and peak daily deaths. There isn’t any controversy about this fact, which is easily demonstrated, but I’m aware some people like to pretend it was lockdown that turned the pandemic, perhaps to justify the extraordinary price we have all paid to do it. That price wasn’t just economic. It involved avoidable deaths from diseases other than COVID-19, as medical services were restricted, in order to focus on the virus. Some say that lockdown, directly and indirectly, killed as many as the virus. I don’t know. Its not something I’ve sought to learn. But I mention because interventions in all our lives should not be made lightly. Its not only inconvenience, but real suffering, loss of livelihoods, friendships, anchors of huge importance to us all, that are severed by such acts. We need to be certain that the prize is worth the price. While it is uncertain it was, even for the first lockdown, I too supported it, because we did not know what we faced, and frankly, almost everyone else did it, except Sweden. I am now resolutely against further interventions in what I have become convinced is a fruitless attempt to ‘control the virus’. We are, in my opinion – shared by others, some of whom are well placed to assess the situation – closer to the end of the pandemic in terms of deaths, than we are to its middle. I believe we should provide the best protection we can for any vulnerable people, and otherwise cautiously get on with our lives. I think we are all going to get a little more Swedish over time.

In recent weeks, though, it cannot have escaped anyone’s attention that there has been a drum beat which feels for all the world like a prelude to yet more fruitless and damaging restrictions. Think back to mid-summer. We were newly out of lockdown and despite concerns for crowded beaches, large demonstrations, opening of shops and pubs, the main item on the news in relation to COVID-19 was the reassuring and relentless fall in daily deaths. I noticed that, as compared to the slopes of the declining death tolls in many nearby countries, that our slope was too flat. I even mentioned to scientist friends that inferred the presence of some fixed signal that was being mixed up with genuine COVID-19 deaths. Imagine how gratifying it was when the definition of a COVID-19 death was changed to line up with that in other countries and in a heartbeat our declining death toll line became matched with that elsewhere. I was sure it would: what we have experienced and witnessed is a terrible kind of equilibrium. A virus that kills few, then leaves survivors who are almost certainly immune – a virus to which perhaps 30-50% were already immune because it has relatives and some of us have already encountered them – accounts for the whole terrible but also fascinating biological process. There was a very interesting piece in the BMJ in recent days that offers potential support for this contention.

Now we have learned some of the unusual characteristics of the new virus, better treatments (anti-inflammatory steroids, anti-coagulants and in particular, oxygen masks and not ventilators in the main) the ‘case fatality rate’ even for the most hard-hit individuals is far lower now than it was six months ago.

As there is no foundational, medical or scientific literature which tells us to expect a ‘second wave’, I began to pay more attention to the phrase as it appeared on TV, radio and print media – all on the same day – and has been relentlessly repeated ever since. I was interviewed recently by Julia Hartley-Brewer on her talkRADIO show and on that occasion I called on the Government to disclose to us the evidence upon which they were relying to predict this second wave. Surely they have some evidence? I don’t think they do. I searched and am very qualified to do so, drawing on academic friends, and we were all surprised to find that there is nothing at all. The last two novel coronaviruses, Sar (2003) and MERS (2012), were of one wave each. Even the WW1 flu ‘waves’ were almost certainly a series of single waves involving more than one virus. I believe any second wave talk is pure speculation. Or perhaps it is in a model somewhere, disconnected from the world of evidence to me? It would be reasonable to expect some limited ‘resurgence’ of a virus given we don’t mix like cordial in a glass of water, but in a more lumpy, human fashion. You’re most in contact with family, friends and workmates and they are the people with whom you generally exchange colds.

A long period of imposed restrictions, in addition to those of our ordinary lives did prevent the final few percent of virus mixing with the population. With the movements of holidays, new jobs, visiting distant relatives, starting new terms at universities and schools, that final mixing is under way. It should not be a terrifying process. It happens with every new virus, flu included. It’s just that we’ve never before in our history chased it around the countryside with a technique more suited to the biology lab than to a supermarket car park.

A very long prelude, but necessary. Part of the ‘project fear’ that is rather too obvious, involving second waves, has been the daily count of ‘cases’. Its important to understand that, according to the infectious disease specialists I’ve spoken to, the word ‘case’ has to mean more than merely the presence of some foreign organism. It must present signs (things medics notice) and symptoms (things you notice). And in most so-called cases, those testing positive had no signs or symptoms of illness at all. There was much talk of asymptomatic spreading, and as a biologist this surprised me. In almost every case, a person is symptomatic because they have a high viral load and either it is attacking their body or their immune system is fighting it, generally a mix. I don’t doubt there have been some cases of asymptomatic transmission, but I’m confident it is not important.

That all said, Government decided to call a person a ‘case’ if their swab sample was positive for viral RNA, which is what is measured in PCR. A person’s sample can be positive if they have the virus, and so it should. They can also be positive if they’ve had the virus some weeks or months ago and recovered. It’s faintly possible that high loads of related, but different coronaviruses, which can cause some of the common colds we get, might also react in the PCR test, though it’s unclear to me if it does.

But there’s a final setting in which a person can be positive and that’s a random process. This may have multiple causes, such as the amplification technique not being perfect and so amplifying the ‘bait’ sequences placed in with the sample, with the aim of marrying up with related SARS-CoV-2 viral RNA. There will be many other contributions to such positives. These are what are called false positives.

Think of any diagnostic test a doctor might use on you. The ideal diagnostic test correctly confirms all who have the disease and never wrongly indicates that healthy people have the disease. There is no such test. All tests have some degree of weakness in generating false positives. The important thing is to know how often this happens, and this is called the false positive rate. If 1 in 100 disease-free samples are wrongly coming up positive, the disease is not present, we call that a 1% false positive rate. The actual or operational false positive rate differs, sometimes substantially, under different settings, technical operators, detection methods and equipment. I’m focusing solely on the false positive rate in Pillar 2, because most people do not have the virus (recently around 1 in 1000 people and earlier in summer it was around 1 in 2000 people). It is when the amount of disease, its so-called prevalence, is low that any amount of a false positive rate can be a major problem. This problem can be so severe that unless changes are made, the test is hopelessly unsuitable to the job asked of it. In this case, the test in Pillar 2 was and remains charged with the job of identifying people with the virus, yet as I will show, it is unable to do so.

Because of the high false positive rate and the low prevalence, almost every positive test, a so-called case, identified by Pillar 2 since May of this year has been a FALSE POSITIVE. Not just a few percent. Not a quarter or even a half of the positives are FALSE, but around 90% of them. Put simply, the number of people Mr Hancock sombrely tells us about is an overestimate by a factor of about ten-fold. Earlier in the summer, it was an overestimate by about 20-fold.

Let me take you through this, though if you’re able to read Prof Carl Heneghan’s clearly written piece first, I’m more confident that I’ll be successful in explaining this dramatic conclusion to you. (Here is a link to the record of numbers of tests, combining Pillar 1 (hospital) and Pillar 2 (community).)

Imagine 10,000 people getting tested using those swabs you see on TV. We have a good estimate of the general prevalence of the virus from the ONS, who are wholly independent (from Pillar 2 testing) and are testing only a few people a day, around one per cent of the numbers recently tested in Pillar 2. It is reasonable to assume that most of the time, those being tested do not have symptoms. People were asked to only seek a test if they have symptoms. However, we know from TV news and stories on social media from sampling staff, from stern guidance from the Health Minister and the surprising fact that in numerous locations around the country, the local council is leafleting people’s houses, street by street to come and get tested.

The bottom line is that it is reasonable to expect the prevalence of the virus to be close to the number found by ONS, because they sample randomly, and would pick up symptomatic and asymptomatic people in proportion to their presence in the community. As of the most recent ONS survey, to a first approximation, the virus was found in 1 in every 1000 people. This can also be written as 0.1%. So when all these 10,000 people are tested in Pillar 2, you’d expect 10 true positives to be found (false negatives can be an issue when the virus is very common, but in this community setting, it is statistically unimportant and so I have chosen to ignore it, better to focus only on false positives).

So, what is the false positive rate of testing in Pillar 2? For months, this has been a concern. It appears that it isn’t known, even though as I’ve mentioned, you absolutely need to know it in order to work out whether the diagnostic test has any value! What do we know about the false positive rate? Well, we do know that the Government’s own scientists were very concerned about it, and a report on this problem was sent to SAGE dated June 3rd 2020. I quote: “Unless we understand the operational false positive rate of the UK’s RT-PCR testing system, we risk over-estimating the COVID-19 incidence, the demand on track and trace and the extent of asymptomatic infection”. In that same report, the authors helpfully listed the lowest to highest false positive rate of dozens of tests using the same technology. The lowest value for false positive rate was 0.8%.

Allow me to explain the impact of a false positive rate of 0.8% on Pillar 2. We return to our 10,000 people who’ve volunteered to get tested, and the expected ten with virus (0.1% prevalence or 1:1000) have been identified by the PCR test. But now we’ve to calculate how many false positives are accompanying them. The shocking answer is 80. 80 is 0.8% of 10,000. That’s how many false positives you’d get every time you were to use a Pillar 2 test on a group of that size.

The effect of this is, in this example, where 10,000 people have been tested in Pillar 2, could be summarised in a headline like this: “90 new cases were identified today” (10 real positive cases and 80 false positives). But we know this is wildly incorrect. Unknown to the poor technician, there were in this example, only 10 real cases. 80 did not even have a piece of viral RNA in their sample. They are really false positives.

I’m going to explain how bad this is another way, back to diagnostics. If you’d submitted to a test and it was positive, you’d expect the doctor to tell you that you had a disease, whatever it was testing for. Usually, though, they’ll answer a slightly different question: “If the patient is positive in this test, what is the probability they have the disease?” Typically, for a good diagnostic test, the doctor will be able to say something like 95% and you and they can live with that. You might take a different, confirmatory test, if the result was very serious, like cancer. But in our Pillar 2 example, what is the probability a person testing positive in Pillar 2 actually has COVID-19? The awful answer is 11% (10 divided by 80 + 10). The test exaggerates the number of covid-19 cases by almost ten-fold (90 divided by 10). Scared yet? That daily picture they show you, with the ‘cases’ climbing up on the right-hand side? Its horribly exaggerated. Its not a mistake, as I shall show.

Earlier in the summer, the ONS showed the virus prevalence was a little lower, 1 in 2000 or 0.05%. That doesn’t sound much of a difference, but it is. Now the Pillar 2 test will find half as many real cases from our notional 10,000 volunteers, so 5 real cases. But the flaw in the test means it will still find 80 false positives (0.8% of 10,000). So its even worse. The headline would be “85 new cases identified today”. But now the probability a person testing positive has the virus is an absurdly low 6% (5 divided by 80 + 5). Earlier in the summer, this same test exaggerated the number of COVID-19 cases by 17-fold (85 divided by 5). Its so easy to generate an apparently large epidemic this way. Just ignore the problem of false positives. Pretend its zero. But it is never zero.

This test is fatally flawed and MUST immediately be withdrawn and never used again in this setting unless shown to be fixed. The examples I gave are very close to what is actually happening every day as you read this.

I’m bound to ask, did Mr Hancock know of this fatal flaw? Did he know of the effect it would inevitably have, and is still having, not only on the reported case load, but the nation’s state of anxiety. I’d love to believe it is all an innocent mistake. If it was, though, he’d have to resign over sheer incompetence. But is it? We know that internal scientists wrote to SAGE, in terms, and, surely, this short but shocking warning document would have been drawn to the Health Secretary’s attention? If that was the only bit of evidence, you might be inclined to give him the benefit of the doubt. But the evidence grows more damning.

Recently, I published with my co-authors a short Position Paper. I don’t think by then, a month ago or so, the penny had quite dropped with me. And I’m an experienced biomedical research scientist, used to dealing with complex datasets and probabilities.

On September 11th 2020, I was a guest on Julia Hartley-Brewer’s talkRADIO show. Among other things, I called upon Mr Hancock to release the evidence underscoring his confidence in and planning for ‘the second wave’. This evidence has not yet been shown to the public by anyone. I also demanded he disclose the operational false positive rate in Pillar 2 testing.

On September 16th, I was back on Julia’s show and this time focused on the false positive rate issue (1m 45s – 2min 30s). I had read Carl Heneghan’s analysis showing that even if the false positive rate was as low as 0.1%, 8 times lower than any similar test, it still yields a majority of false positives. So, my critique doesn’t fall if the actual false positive rate is lower than my assumed 0.8%.

On September 18th, Mr Hancock again appeared, as often he does, on Julia Hartley-Brewer’s show. Julia asked him directly (1min 50s – on) what the false positive rate in Pillar 2 is. Mr Hancock said “It’s under 1%”. Julia again asked him exactly what it was, and did he even know it? He didn’t answer that, but then said “it means that, for all the positive cases, the likelihood of one being a false positive is very small”.

That is a seriously misleading statement as it is incorrect. The likelihood of an apparently positive case being a false positive is between 89-94%, or near-certainty. Of note, even when ONS was recording its lowest-ever prevalence, the positive rate in Pillar 2 testing never fell below 0.8%.

It gets worse for the Health Secretary. On September the 17th, I believe, Mr Hancock took a question from Sir Desmond Swayne about false positives. It is clear that Sir Desmond is asking about Pillar 2.

Mr Hancock replied: “I like my right honourable friend very much and I wish it were true. The reason we have surveillance testing, done by ONS, is to ensure that we’re constantly looking at a nationally representative sample at what the case rate is. The latest ONS survey, published on Friday, does show a rise consummate (sic) with the increased number of tests that have come back positive.”

He did not answer Sir Desmond’s question, but instead answered a question of his choosing. Did the Health Secretary knowingly mislead the House? By referring only to ONS and not even mentioning the false positive rate of the test in Pillar 2 he was, as it were, stealing the garb of ONS’s more careful work which has a lower false positive rate, in order to smuggle through the hidden and very much higher, false positive rate in Pillar 2. The reader will have to decide for themselves.

Pillar 2 testing has been ongoing since May but it’s only in recent weeks that it has reached several hundreds of thousands of tests per day. The effect of the day by day climb in the number of people that are being described as ‘cases’ cannot be overstated. I know it is inducing fear, anxiety and concern for the possibility of new and unjustified restrictions, including lockdowns. I have no idea what Mr Hancock’s motivations are. But he has and continues to use the hugely inflated output from a fatally flawed Pillar 2 test and appears often on media, gravely intoning the need for additional interventions (none of which, I repeat, are proven to be effective).

You will be very familiar with the cases plot which is shown on most TV broadcasts at the moment. It purports to show the numbers of cases which rose then fell in the spring, and the recent rise in cases. This graph is always accompanied by the headline that “so many thousands of new cases were detected in the last 24 hours”.

You should know that there are two major deceptions, in that picture, which combined are very likely both to mislead and to induce anxiety. Its ubiquity indicates that it is a deliberate choice.

Firstly, it is very misleading in relation to the spring peak of cases. This is because we had no community screening capacity at that time. A colleague has adjusted the plot to show the number of cases we would have detected, had there been a well-behaved community test capability available. The effect is to greatly increase the size of the spring cases peak, because there are very many cases for each hospitalisation and many hospitalisations for every death.

Secondly, as I hope I have shown and persuaded you, the cases in summer and at present, generated by seriously flawed Pillar 2 tests, should be corrected downwards by around ten-fold.

I do believe genuine cases are rising somewhat. This is, however, also true for flu, which we neither measure daily nor report on every news bulletin. If we did, you would appreciate that, going forward, it is quite likely that flu is a greater risk to public health than COVID-19. The corrected cases plot (above) does, I believe, put the recent rises in incidence of COVID-19 in a much more reasonable context. I thought you should see that difference before arriving at your own verdict on this sorry tale.

There are very serious consequences arising from grotesque over-estimation of so-called cases in Pillar 2 community testing, which I believe was put in place knowingly. Perhaps Mr Hancock believes his own copy about the level of risk now faced by the general public? Its not for me to deduce. What this huge over-estimation has done is to have slowed the normalisation of the NHS. We are all aware that access to medical services is, to varying degrees, restricted. Many specialities were greatly curtailed in spring and after some recovery, some are still between a third and a half below their normal capacities. This has led both to continuing delays and growth of waiting lists for numerous operations and treatments. I am not qualified to assess the damage to the nation’s and individuals’ health as a direct consequence of this extended wait for a second wave. Going into winter with this configuration will, on top of the already restricted access for six months, lead inevitably to a large number of avoidable, non-Covid deaths. That is already a serious enough charge. Less obvious but, in aggregate, additional impacts arise from fear of the virus, inappropriately heightened in my view, which include: damage to or even destruction of large numbers of businesses, especially small businesses, with attendant loss of livelihoods, loss of educational opportunities, strains on family relationships, eating disorders, increasing alcoholism and domestic abuse and even suicides, to name but a few.

In closing, I wish to note that in the last 40 years alone the UK has had seven official epidemics/pandemics; AIDS, Swine flu, CJD, SARS, MERS, Bird flu as well as annual, seasonal flu. All were very worrying but schools remained open and the NHS treated everybody and most of the population were unaffected. The country would rarely have been open if it had been shut down every time.

I have explained how a hopelessly-performing diagnostic test has been, and continues to be used, not for diagnosis of disease but, it seems, solely to create fear.

This misuse of power must cease. All the above costs are on the ledger, too, when weighing up the residual risks to society from COVID-19 and the appropriate actions to take, if any. Whatever else happens, the test used in Pillar 2 must be immediately withdrawn as it provides no useful information. In the absence of vastly inflated case numbers arising from this test, the pandemic would be seen and felt to be almost over.

Dr Mike Yeadon is the former CSO and VP, Allergy and Respiratory Research Head with Pfizer Global R&D and co-Founder of Ziarco Pharma Ltd.

September 21, 2020 Posted by aletho | Deception, Economics, Fake News, Mainstream Media, Warmongering, Science and Pseudo-Science | Covid-19, UK | Leave a comment