Time to assume that health research is fraudulent until proven otherwise?
By Richard Smith | BMJ | July 5, 2021
Health research is based on trust. Health professionals and journal editors reading the results of a clinical trial assume that the trial happened and that the results were honestly reported. But about 20% of the time, said Ben Mol, professor of obstetrics and gynaecology at Monash Health, they would be wrong. As I’ve been concerned about research fraud for 40 years, I wasn’t that surprised as many would be by this figure, but it led me to think that the time may have come to stop assuming that research actually happened and is honestly reported, and assume that the research is fraudulent until there is some evidence to support it having happened and been honestly reported. The Cochrane Collaboration, which purveys “trusted information,” has now taken a step in that direction.
As he described in a webinar last week, Ian Roberts, professor of epidemiology at the London School of Hygiene & Tropical Medicine, began to have doubts about the honest reporting of trials after a colleague asked if he knew that his systematic review showing the mannitol halved death from head injury was based on trials that had never happened. He didn’t, but he set about investigating the trials and confirmed that they hadn’t ever happened. They all had a lead author who purported to come from an institution that didn’t exist and who killed himself a few years later. The trials were all published in prestigious neurosurgery journals and had multiple co-authors. None of the co-authors had contributed patients to the trials, and some didn’t know that they were co-authors until after the trials were published. When Roberts contacted one of the journals the editor responded that “I wouldn’t trust the data.” Why, Roberts wondered, did he publish the trial? None of the trials have been retracted.
Later Roberts, who headed one of the Cochrane groups, did a systematic review of colloids versus crystalloids only to discover again that many of the trials that were included in the review could not be trusted. He is now sceptical about all systematic reviews, particularly those that are mostly reviews of multiple small trials. He compared the original idea of systematic reviews as searching for diamonds, knowledge that was available if brought together in systematic reviews; now he thinks of systematic reviewing as searching through rubbish. He proposed that small, single centre trials should be discarded, not combined in systematic reviews.
Mol, like Roberts, has conducted systematic reviews only to realise that most of the trials included either were zombie trials that were fatally flawed or were untrustworthy. What, he asked, is the scale of the problem? Although retractions are increasing, only about 0.04% of biomedical studies have been retracted, suggesting the problem is small. But the anaesthetist John Carlisle analysed 526 trials submitted to Anaesthesia and found that 73 (14%) had false data, and 43 (8%) he categorised as zombie. When he was able to examine individual patient data in 153 studies, 67 (44%) had untrustworthy data and 40 (26%) were zombie trials. Many of the trials came from the same countries (Egypt, China, India, Iran, Japan, South Korea, and Turkey), and when John Ioannidis, a professor at Stanford University, examined individual patient data from trials submitted from those countries to Anaesthesia during a year he found that many were false: 100% (7/7) in Egypt; 75% (3/ 4) in Iran; 54% (7/13) in India; 46% (22/48) in China; 40% (2/5) in Turkey; 25% (5/20) in South Korea; and 18% (2/11) in Japan. Most of the trials were zombies. Ioannidis concluded that there are hundreds of thousands of zombie trials published from those countries alone.
Others have found similar results, and Mol’s best guess is that about 20% of trials are false. Very few of these papers are retracted.
We have long known that peer review is ineffective at detecting fraud, especially if the reviewers start, as most have until now, by assuming that the research is honestly reported. I remember being part of a panel in the 1990s investigating one of Britain’s most outrageous cases of fraud, when the statistical reviewer of the study told us that he had found multiple problems with the study and only hoped that it was better done than it was reported. We asked if he had ever considered that the study might be fraudulent, and he told us that he hadn’t.
We have now reached a point where those doing systematic reviews must start by assuming that a study is fraudulent until they can have some evidence to the contrary. Some supporting evidence comes from the trial having been registered and having ethics committee approval. Andrew Grey, an associate professor of medicine at the University of Auckland, and others have developed a checklist with around 40 items that can be used as a screening tool for fraud (you can view the checklist here). The REAPPRAISED checklist (Research governance, Ethics, Authorship, Plagiarism, Research conduct, Analyses and methods, Image manipulation, Statistics, Errors, Data manipulation and reporting) covers issues like “ethical oversight and funding, research productivity and investigator workload, validity of randomisation, plausibility of results and duplicate data reporting.” The checklist has been used to detect studies that have subsequently been retracted but hasn’t been through the full evaluation that you would expect for a clinical screening tool. (But I must congratulate the authors on a clever acronym: some say that dreaming up the acronym for a study is the most difficult part of the whole process.)
Roberts and others wrote about the problem of the many untrustworthy and zombie trials in The BMJ six years ago with the provocative title: “The knowledge system underpinning healthcare is not fit for purpose and must change.” They wanted the Cochrane Collaboration and anybody conducting systematic reviews to take very seriously the problem of fraud. It was perhaps coincidence, but a few weeks before the webinar the Cochrane Collaboration produced guidelines on reviewing studies where there has been a retraction, an expression of concern, or the reviewers are worried about the trustworthiness of the data.
Retractions are the easiest to deal with, but they are, as Mol said, only a tiny fraction of untrustworthy or zombie studies. An editorial in the Cochrane Library accompanying the new guidelines recognises that there is no agreement on what constitutes an untrustworthy study, screening tools are not reliable, and “Misclassification could also lead to reputational damage to authors, legal consequences, and ethical issues associated with participants having taken part in research, only for it to be discounted.” The Collaboration is being cautious but does stand to lose credibility—and income—if the world ceases to trust Cochrane Reviews because they are thought to be based on untrustworthy trials.
Research fraud is often viewed as a problem of “bad apples,” but Barbara K Redman, who spoke at the webinar insists that it is not a problem of bad apples but bad barrels if not, she said, of rotten forests or orchards. In her book Research Misconduct Policy in Biomedicine: Beyond the Bad-Apple Approach she argues that research misconduct is a systems problem—the system provides incentives to publish fraudulent research and does not have adequate regulatory processes. Researchers progress by publishing research, and because the publication system is built on trust and peer review is not designed to detect fraud it is easy to publish fraudulent research. The business model of journals and publishers depends on publishing, preferably lots of studies as cheaply as possible. They have little incentive to check for fraud and a positive disincentive to experience reputational damage—and possibly legal risk—from retracting studies. Funders, universities, and other research institutions similarly have incentives to fund and publish studies and disincentives to make a fuss about fraudulent research they may have funded or had undertaken in their institution—perhaps by one of their star researchers. Regulators often lack the legal standing and the resources to respond to what is clearly extensive fraud, recognising that proving a study to be fraudulent (as opposed to suspecting it of being fraudulent) is a skilled, complex, and time consuming process. Another problem is that research is increasingly international with participants from many institutions in many countries: who then takes on the unenviable task of investigating fraud? Science really needs global governance.
Everybody gains from the publication game, concluded Roberts, apart from the patients who suffer from being given treatments based on fraudulent data.
Stephen Lock, my predecessor as editor of The BMJ, became worried about research fraud in the 1980s, but people thought his concerns eccentric. Research authorities insisted that fraud was rare, didn’t matter because science was self-correcting, and that no patients had suffered because of scientific fraud. All those reasons for not taking research fraud seriously have proved to be false, and, 40 years on from Lock’s concerns, we are realising that the problem is huge, the system encourages fraud, and we have no adequate way to respond. It may be time to move from assuming that research has been honestly conducted and reported to assuming it to be untrustworthy until there is some evidence to the contrary.
Richard Smith was the editor of The BMJ until 2004.
Competing interest: RS was a cofounder of the Committee on Medical Ethics (COPE), for many years the chair of the Cochrane Library Oversight Committee, and a member of the board of the UK Research Integrity Office.
Share this:
Related
July 20, 2021 - Posted by aletho | Corruption, Deception, Science and Pseudo-Science, Timeless or most popular
No comments yet.
This site uses Akismet to reduce spam. Learn how your comment data is processed.
Featured Video
HOW DTAP VACCINE SPREADS WHOOPING COUGH
or go to
Aletho News Archives – Video-Images
From the Archives
Major rabbi says non-Jews are donkeys, created to serve Jews
By Khalid Amayreh, in occupied East Jerusalem | The People’s Voice | October 18, 2010
A major Jewish religious figure in Israel has likened non-Jews to donkeys and beasts of burden, saying the main reason for their very existence is to serve Jews.
Rabbi Ovadia Yosef, spiritual mentor of the religious fundamentalist party, Shas, which represents Middle Eastern Jews, reportedly said during a Sabbath homily earlier this week that “the sole purpose of non-Jews is to serve Jews.”
Yosef is considered a major religious leader in Israel who enjoys the allegiance of hundreds of thousands of followers.
Shas is a chief coalition partner in the current Israeli government.
Yosef, also a former Chief Rabbi of Israel, was quoted by the right-wing newspaper, the Jerusalem Post, as saying that the basic function of a goy, a derogatory word for a gentile, was to serve Jews.
“Non-Jews were born only to serve us. Without that, they have no place in the world-only to serve the People of Israel,” Yosef said in his weekly Saturday night sermon which was devoted to laws regarding actions non-Jews are permitted to perform on the Sabbath.
Yosef also reportedly said that the lives of non-Jews in Israel are preserved by God in order to prevent losses to Jews.
Yosef, widely considered a prominent Torah sage and authority on the interpretation of Talmud, a basic Jewish scripture, held a comparison between animals of burden and non-Jews. … continue
Blog Roll
-
Join 2,755 other subscribers
Visits Since December 2009
- 6,739,815 hits
Looking for something?
Archives
Calendar
Categories
Aletho News Civil Liberties Corruption Deception Economics Environmentalism Ethnic Cleansing, Racism, Zionism Fake News False Flag Terrorism Full Spectrum Dominance Illegal Occupation Mainstream Media, Warmongering Malthusian Ideology, Phony Scarcity Militarism Progressive Hypocrite Russophobia Science and Pseudo-Science Solidarity and Activism Subjugation - Torture Supremacism, Social Darwinism Timeless or most popular Video War Crimes Wars for IsraelTags
9/11 Afghanistan Africa al-Qaeda Australia BBC Benjamin Netanyahu Brazil Canada CDC Central Intelligence Agency China CIA CNN Colombia Covid-19 COVID-19 Vaccine Da’esh Donald Trump Egypt European Union Facebook FBI FDA France Gaza Germany Google Hamas Hebron Hezbollah Hillary Clinton Human rights India Iran Iraq ISIS Israel Israeli settlement Japan Jerusalem Joe Biden Korea Latin America Lebanon Libya Middle East National Security Agency NATO New York Times North Korea NSA Obama Pakistan Palestine Qatar Russia Sanctions against Iran Saudi Arabia Syria The Guardian Turkey Twitter UAE UK Ukraine United Nations United States USA Venezuela Washington Post West Bank WHO Yemen ZionismRecent Comments
roberthstiver on Israeli officials’ jaws… papasha408 on Georgian President Vetoes Fore… poisonedwater on Washington is essentially defy… poisonedwater on Houthis Take Down Another US R… poisonedwater on Israeli officials’ jaws… Dennis Wilson on Labor strike in 10 California… roberthstiver on US university president placed… roberthstiver on Israeli officials’ jaws… 5 dancing shlomos on US: Ilan Pappe interrogated by… Tollef Ås/秋涛乐/טלפ וש on UK media outlet accused of ‘ju… Dennis Wilson on EU Big Brother is Watching New… roberthstiver on US: Ilan Pappe interrogated by…
Aletho News
- Japan’s most senior cancer doctor: COVID shots are ‘essentially murder’
- One civilian killed as Ukrainian drone strikes minibus – governor
- Former FPV-Drone Operators From Ukraine Pose Threat to Global Security – Expert
- Another Palestinian journalist killed in Gaza, death toll climbs to 145 since Oct. 7
- Zionists cry wolf endlessly
- HOW DTAP VACCINE SPREADS WHOOPING COUGH
- Fatal Post COVID-19 mRNA-Vaccine Associated Cerebral Ischemia
- Brussels should remember that Europeans are sovereign, not the EU treaties or the Eurocrats
- Georgian President Vetoes Foreign Agents Bill
- Moscow responds to latest EU ban on Russian media
If Americans Knew
- As aid dribbles into Gaza, displacement and death prevail – Day 225
- Rain is Coming – On the ongoing Nakba, and the present revolution.
- NWU Report Details Retaliation Against Western Media Workers Speaking Out on Gaza War
- Israeli lawyers at Int’l Court of Justice out of touch with reality – Day 224
- The Israel-Affiliated Organization Leading the Backlash Against Student Protests
- The writing was on the wall for Israel’s torture of prisoners
- Not even the US government knows the US government line on Rafah
- Israeli anti-Zionist academic Ilan Pappe interrogated by FBI in Detroit
- Jewish billionaires secretly worked to shape U.S. public opinion on Israel’s war against Gaza
- As it defends its planned genocidal Rafah invasion before ICJ, Israel vows to “intensify” raids – Day 223
Richie Allen
- The Richie Allen Show Returns Tomorrow Wednesday April 24th
- Call Richie Today Monday March 11th From 4.30pm
- Connect To The Richie Allen Show WhatsApp Today
- NHS Asks Patients To Choose From 12 Genders, 10 sexual Preferences & 159 Religions
- The Richie Allen Show Moves To A New Time Slot From Monday Nov 20th
- Starmer Will Sack Shadow Ministers Who Vote For Gaza Ceasefire
- AI Tool Can Predict Heart Attacks Years In Advance
- Nepal Bans TikTok To Preserve Social Harmony
- Bloke Appointed Boss Of Womb Health Charity
- WHO – “Gaza’s Biggest Hospital Becoming A Cemetery”
No Tricks Zone
- Data Reveal That US Heat Wave Index, Japan Drought Coincide With Solar Activity
- New Study Finds An Extremely Low CO2 Climate Sensitivity For The Arctic And Antarctic
- U.N. Contributing Scientist: ‘Culling’ Human Population Could Avert Climate Catastrophe
- Using Nets On The Seafloor To Retrieve Seafood ‘Roughly The Same As Running 100 Coal-Fired Plants’
- New Paper: Global Warming Leading To HIMALAYAN COOLING, Preventing Glacial Melt!
- DNA Evidence Reveals Domestic Cats, Dogs, African Wildcats, Frogs Lived In The Arctic 9000 Years Ago
- -80°C: Antarctic Vostok Station Records “Extreme Winter Cold”…Not Even Winter Yet!
- The German E-Vehicle Nightmare, 2024 Q1 Sales Plummet 14%… “Graveyard” For Unsold Cars
- Newly Discovered 90,000-Year-Old Human Footprints Reveal How Much Higher Sea Levels Used To Be
- Germany’s Economic Bloodbath Worsens As Green Revolution Causes Economy To Bleed To Death
More Links
Contact:
atheonews (at) gmail.com
Disclaimer
This site is provided as a research and reference tool. Although we make every reasonable effort to ensure that the information and data provided at this site are useful, accurate, and current, we cannot guarantee that the information and data provided here will be error-free. By using this site, you assume all responsibility for and risk arising from your use of and reliance upon the contents of this site.
This site and the information available through it do not, and are not intended to constitute legal advice. Should you require legal advice, you should consult your own attorney.
Nothing within this site or linked to by this site constitutes investment advice or medical advice.
Materials accessible from or added to this site by third parties, such as comments posted, are strictly the responsibility of the third party who added such materials or made them accessible and we neither endorse nor undertake to control, monitor, edit or assume responsibility for any such third-party material.
The posting of stories, commentaries, reports, documents and links (embedded or otherwise) on this site does not in any way, shape or form, implied or otherwise, necessarily express or suggest endorsement or support of any of such posted material or parts therein.
The word “alleged” is deemed to occur before the word “fraud.” Since the rule of law still applies. To peasants, at least.
Fair Use
This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in our efforts to advance understanding of environmental, political, human rights, economic, democracy, scientific, and social justice issues, etc. We believe this constitutes a ‘fair use’ of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. For more info go to: http://www.law.cornell.edu/uscode/17/107.shtml. If you wish to use copyrighted material from this site for purposes of your own that go beyond ‘fair use’, you must obtain permission from the copyright owner.
DMCA Contact
This is information for anyone that wishes to challenge our “fair use” of copyrighted material.
If you are a legal copyright holder or a designated agent for such and you believe that content residing on or accessible through our website infringes a copyright and falls outside the boundaries of “Fair Use”, please send a notice of infringement by contacting atheonews@gmail.com.
We will respond and take necessary action immediately.
If notice is given of an alleged copyright violation we will act expeditiously to remove or disable access to the material(s) in question.
All 3rd party material posted on this website is copyright the respective owners / authors. Aletho News makes no claim of copyright on such material.
Leave a comment