publication and citation bias - Mothering Forums
Forum Jump: 
 
Thread Tools
#1 of 4 Old 11-27-2012, 09:03 AM - Thread Starter
 
kathymuggle's Avatar
 
Join Date: Jul 2012
Posts: 3,888
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 98 Post(s)

There is a tendency to publish and cite studies that show positive results (statistically significant) than negative (null/void) or inconclusive studies 

 

This is called publication bias and citation bias.

 

A few articles to get people started:

 

http://www.bmj.com/content/315/7109/640

http://bmg.cochrane.org/addressing-reporting-biases

http://blogs.trusttheevidence.net/category/blog-keywords/publication-bias

 

The last article mentions that publication bias a big issue in pediatrics.

 

From cochrane:

 

"Reporting biases arise when the dissemination of research findings is influenced by the nature and direction of results. Statistically significant, ‘positive’ results that indicate that an intervention works are more likely to be published, more likely to be published rapidly, more likely to be published in English, more likely to be published more than once, more likely to be published in high impact journals and, related to the last point, more likely to be cited by others. The contribution made to the totality of the evidence in systematic reviews by studies with non-significant results is as important as that from studies with statistically significant results."

 

Bolding mine.  I bolded it because it highlights why we should care about publication bias


There is a battle of two wolves inside us.  One is good and the other is evil.  The wolf that wins is the one you feed.

 

Book and herb loving mama to 1 preteen and 2 teens (when did that happen?).  We travel, go to school, homeschool, live rurally, eat our veggies, spend too much time...

kathymuggle is online now  
#2 of 4 Old 11-27-2012, 09:25 AM
 
Rrrrrachel's Avatar
 
Join Date: Jan 2012
Posts: 3,154
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
I was reading about this the other day, Kathy. What influence do you think this has on vaccine research as a whole? I know what I think but I'm interested in what you have to say about it. smile.gif
Rrrrrachel is offline  
#3 of 4 Old 11-27-2012, 09:55 AM - Thread Starter
 
kathymuggle's Avatar
 
Join Date: Jul 2012
Posts: 3,888
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 98 Post(s)

I don't know yet.  

 

I knew publication and citation bias existed - but only in a fuzzy out-there sort of way until a few days ago.

 

At this moment in time ( and this is not a firm or fully formed position)  I would say people have to make decisions on the studies they see.  What else can they do?

 

On a personal level, I am suffering from study fatigue.  Who made a study?  Is it well designed? How can we know?  Who funded it?  Any major conflicts of interest?  (all rhetorical questions)…and now, are we missing studies because of publication and citation bias? 

 

I am starting to think the answers are unknowable.  It is too big a ball of wax to unwind.  This leaves one with falling back on…. something.  For some that might be doctors, for others it might be stats they strongly believe to be true (say CDC), spirituality and religion, general beliefs about medicine, their own observations and probably some other stuff I am missing.

 

In any event, knowing it (publication and citation) bias exists is a good thing. It seems some people are working on it, although how effective solutions will be are still up in the air.

 

From trusttheevidence:

 

 

"Several initiatives have been spearheaded to help reduce publication bias. The creation of open-access journals have shifted the focus from the importance of the results... to the methodological rigour by which the study was completed.

But more importantly has been the creation of online trial registries, such asClinicalTrials.gov launched in 2000. ..Registration is optional, however in 2005 the ICMJE made registration of clinical trials as a pre-requisite of publication...it sent a strong message of the importance of registration."


There is a battle of two wolves inside us.  One is good and the other is evil.  The wolf that wins is the one you feed.

 

Book and herb loving mama to 1 preteen and 2 teens (when did that happen?).  We travel, go to school, homeschool, live rurally, eat our veggies, spend too much time...

kathymuggle is online now  
#4 of 4 Old 11-27-2012, 09:59 AM
 
Rrrrrachel's Avatar
 
Join Date: Jan 2012
Posts: 3,154
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
I posted a piece a few days ago from sciencebasedmedicine about transparency in clinical trials. It addressed some of these same issues. You might like it. If you can't find te post on here it was a relatively recent post on the blog.

I hear you on the study fatigue thing. I think out decisions are definitely colored a lot by our life experiences and a healthy dose of intuition, not just the research.
Rrrrrachel is offline  
Reply

Quick Reply
Message:
Drag and Drop File Upload
Drag files here to attach!
Upload Progress: 0
Options

Register Now

In order to be able to post messages on the Mothering Forums forums, you must first register.
Please enter your desired user name, your email address and other required details in the form below.
User Name:
If you do not want to register, fill this field only and the name will be used as user name for your post.
Password
Please enter a password for your user account. Note that passwords are case-sensitive.
Password:
Confirm Password:
Email Address
Please enter a valid email address for yourself.
Email Address:

Log-in

Human Verification

In order to verify that you are a human and not a spam bot, please enter the answer into the following box below based on the instructions contained in the graphic.



User Tag List

Thread Tools
Show Printable Version Show Printable Version
Email this Page Email this Page


Forum Jump: 

Posting Rules  
You may post new threads
You may post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off