Trials showing a positive treatment effect, or those with important or striking findings, were much more likely to be published in scientific journals than those with negative findings.
Trials showing a positive treatment effect, or those with important or striking findings, were much more likely to be published in scientific journals than those with negative findings, a new review from The Cochrane Library has found.
"This publication bias has important implications for healthcare. Unless both positive and negative findings from clinical trials are made available, it is impossible to make a fair assessment of a drug's safety and efficacy," says lead researcher, Sally Hopewell of the UK Cochrane Centre in Oxford, UK.
The international team of researchers carried out a systematic review of all the existing research in this area. In addition to showing that negative results were published less often, they found that if these results were eventually published, they would take between one and four more years to appear in journals than studies showing positive results.
Results from one of the five studies in the review indicated that investigators and not editors might be to blame. The reasons most commonly given for not publishing were that investigators thought their findings were not interesting enough or did not have time. "The registration of all clinical trial protocols before they start should make it easier to identify where we are missing results," says Kay Dickersin from Johns Hopkins University in Baltimore, USA, another of the researchers on this project.
One of the other researchers, Kirsty Loudon, based in Scotland, adds, "Registration of trials and their results would help people conducting systematic reviews to look at both published and unpublished evidence, to reach reliable conclusions."
The researchers say their study also highlights the need for a worldwide commitment to the disclosure of the findings of clinical trials. Mike Clarke of Trinity College Dublin in Ireland, says, "The World Health Organisation recently found widespread support for the development of such a process."
Andy Oxman from the Norwegian Knowledge Centre for Health Services concludes, "Healthcare decisions need to be based on all the evidence, not just the most exciting results."
http://www.wiley.com/wiley-blackwell
Comments
Sunshine law - online postings of all clinical trial results
January 21, 2009 by Anonymous, 44 weeks 21 hours ago
Comment: 33889
That's one thing the Obama Administration can put online for all to see - the possitive AND negative results of ALL clinical trials !!!
Re: Not Clinical Trial Specific
January 21, 2009 by Fred Bortz, 44 weeks 1 day ago
Comment: 33884
Thanks, Anon, for your clarification and for making the point that this issue is germane to all scientific research.
However, I think it is unfair to blame the journal editors.
The researchers (in any grant-dependent field) may be required by a grantor or a code of ethics to attempt publication, but my guess is that they don't work very hard to produce a high quality manuscript when all they have to discuss are unsuccessful trials or nul results.
That is especially true when they have other active research to attend to.
Fred Bortz
Children's Science Books
and
Science Book Reviews
Not Clinical Trial Specific
January 21, 2009 by Anonymous, 44 weeks 1 day ago
Comment: 33881
I think you could argue that publication bias negatively affects the entirety of scientific research, not just clinical trials. As someone who works in the business, I wanted to mention the PHARMA Code, the code of ethics for the industry. Regarding publication it's pretty clear: you must ATTEMPT to publish findings, significant or not. Now, whether a journal editor wants to publish non-significant results is another story entirely.
peer review
January 21, 2009 by Anonymous, 44 weeks 1 day ago
Comment: 33878
so you don't end up S. Korea style with fake publications
Learning from failures
January 21, 2009 by Fred Bortz, 44 weeks 1 day ago
Comment: 33874
The worst part of this very understandable human trait to publish only successes is this:
How can we learn from failures if we never hear about them?
In 1995, I borrowed the theme of Henry Petrosky's To Engineer is Human: The Role of Failure in Successful Design to write my best known children's book, Catastrophe! Great Engineering Failure--and Success.
In drug testing, I think there are registries of clinical trials, so that failures (no doubt the majority) can be found. However, the fact of failure is far less interesting than the reason for it.
If we can avoid going down similar blind alleys or can discover something useful about human or animal biology from a failure, then the study has produced valuable and publishable results. I'd bet such failures do receive attention, while the ones that had no clear lessons remain unpublished.
Is there a drug researcher out there who would care to comment on these speculations of mine?
Fred Bortz
Children's Science Books
and
Science Book Reviews
No surprise
January 21, 2009 by Anonymous, 44 weeks 1 day ago
Comment: 33873
It's like this for all scientific publications. No one will publish a paper about an experiment that gave negative results. The problem is that negative results could as important as positive ones (so maybe other researcher won't try the same thing again, for example).
I hope the publication industry will soon disappear, and that the strengths and paradigm of the Internet will finally be used also for scientific articles.
Who needs a journal when you have google and thousands of readers ready to comment on your findings?
Post new comment