Mothering › Forums › Health › Vaccinations › How do you evaluate scientific information?
New Posts  All Forums:Forum Nav:

How do you evaluate scientific information?

post #1 of 6
Thread Starter 
When you are (or were) looking for information about vaccinations, how did you evaluate the sources of information that you found? What criteria do you use now to decide whether a source or study is valid or trustworthy?

I'm not looking to debate or criticize anyone's responses, just curious as to what routes people are taking.
post #2 of 6
post #3 of 6
I think that's a really good question. I think that no matter who is doing the study there's human bias involved and there's always someone who is out to profit from it. So I don't really care much who funded the studies, because I just automatically assume that they are all biased (sad but true), no matter the results. I look for
1. A solid review board
2. Large enough sample (when applicable)
3. Reliable testing methods
4. Reliable data collection

and the most important
5. Reproducability

If a study can't be reproduced with the same, or very similar, results, then I don't trust it at all. If, however, it can and is, then I feel confident in its accuracy. That's why no one study holds a lot of water with me. Once there are others that come to the same conclusion is when I begin to trust it.

P.S. I'm sure there's some stuff I'm forgetting, but this is just off of the top of my head...
post #4 of 6
Use a good dictionary.
Use a good medical dictionary; Taber's is one.
Learn to use a Merck Index if necessary.
Learn about the different kinds of scientific studies; there are many.
Try to see how the subjects were selected.
Try to figure out who financed and/or sponsored the study.
For each study, there should be several references and footnotes that can lead you to further study.

Realize that you are intelligent and are able to read any study and understand its meaning so you can draw conclusions for you and your family.
post #5 of 6
Those suggestions are all good ones, but I think it's really important to understand that in order to really evaluate the content of a scientific study, you need some training. I'm not trying to suggest that people without training can't educate themselves on medical matters, but it takes more than knowing the difference between a case-control vs. cohort study, you know? There are many intricacies involved in scientific research that aren't really easy to just "teach yourself." For instance, reading through a study and knowing if they used the right stats, and whether they reported the right tests of assumptions and significance to go along with them, isn't something that you're going to learn from the internet. It's just not. Knowing whether the authors adequately addressed the limitations of their sampling and design choices also requires formal training. Those are just basic things about research, and not even specific to medical research, which is pretty complex.

I totally agree that there are excellent steps people can take to decide if the source is reliable, and something they would consider reading. Getting a general feel for the results is also something that one can pick up with some practice and background learning. However, it's not accurate to suggest that one can become as fluent in research evaluation as a trained scientist, just by looking things up in a book, or on the internet. I've been learning how to conduct research as my full-time job for many years now, and I still consider my skills to be developing, and realize my own limitations in understanding research.

Contacting researchers to ask them about their studies is perfectly acceptable, too. They always provide correspondence emails on the articles, and while some researchers are really busy, many are happy to take the time to explain their results and discuss implications. If you have questions, don't be shy!
post #6 of 6
Quote:
Originally Posted by stiss View Post
Those suggestions are all good ones, but I think it's really important to understand that in order to really evaluate the content of a scientific study, you need some training. I'm not trying to suggest that people without training can't educate themselves on medical matters, but it takes more than knowing the difference between a case-control vs. cohort study, you know? There are many intricacies involved in scientific research that aren't really easy to just "teach yourself." For instance, reading through a study and knowing if they used the right stats, and whether they reported the right tests of assumptions and significance to go along with them, isn't something that you're going to learn from the internet. It's just not. Knowing whether the authors adequately addressed the limitations of their sampling and design choices also requires formal training. Those are just basic things about research, and not even specific to medical research, which is pretty complex.
I agree. I think it would be naive of me to claim that I am just as capable of understanding the studies as someone who works in the field. Mostly because:
1. I've never been in their position, so how could I know the difference?
2. I haven't been to the hundreds of hours of schooling that teach them how to conduct and read studies
3. I know some of the basics of scientific method, studies can't prove a negative, etc. But there is undoubtedly lots more that I don't know.
4. I've had the opportunity of hearing people in the field talk to each other about studies. It wasn't until then that I realized how much I didn't know!

With that said, there's still some studies out there that I'm able to tell are garbage right away. And coming from an ametuer, that's pretty bad!
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Vaccinations
Mothering › Forums › Health › Vaccinations › How do you evaluate scientific information?